2020-07-16T13:16:54.570 INFO:root:teuthology version: 1.0.0-be90814 2020-07-16T13:16:54.572 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --archive /home/teuthworker/archive/gregf-2020-07-16_11:01:26-rados-wip-stretch-mode-1-distro-basic-smithi/5230565 --description rados/cephadm/upgrade/{1-start 2-start-upgrade 3-wait distro$/{rhel_latest} fixed-2 mon_election/classic} --name gregf-2020-07-16_11:01:26-rados-wip-stretch-mode-1-distro-basic-smithi --owner scheduled_gregf@teuthology --lock --block -- /tmp/teuthology-worker.y8cwasst.tmp 2020-07-16T13:16:54.598 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-07-16T13:16:54.679 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/gregf-2020-07-16_11:01:26-rados-wip-stretch-mode-1-distro-basic-smithi/5230565 branch: wip-stretch-mode-1 description: rados/cephadm/upgrade/{1-start 2-start-upgrade 3-wait distro$/{rhel_latest} fixed-2 mon_election/classic} email: null first_in_suite: false job_id: '5230565' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: gregf-2020-07-16_11:01:26-rados-wip-stretch-mode-1-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: rhel os_version: '8.1' overrides: admin_socket: branch: wip-stretch-mode-1 ceph: conf: global: mon election default strategy: 1 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug filestore: 20 debug journal: 20 debug ms: 20 debug osd: 25 osd shutdown pgref assert: true log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 7260671e53beca8ba2a87a02b9c7c669f4c30eca ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: sha1: 7260671e53beca8ba2a87a02b9c7c669f4c30eca selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 workunit: branch: wip-stretch-mode sha1: 7260671e53beca8ba2a87a02b9c7c669f4c30eca owner: scheduled_gregf@teuthology priority: 101 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - alertmanager.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - grafana.a - node-exporter.b sha1: 7260671e53beca8ba2a87a02b9c7c669f4c30eca sleep_before_teardown: 0 suite: rados suite_branch: wip-stretch-mode suite_path: /home/teuthworker/src/github.com_gregsfortytwo_ceph_wip-stretch-mode/qa suite_relpath: qa suite_repo: https://github.com/gregsfortytwo/ceph.git suite_sha1: 7260671e53beca8ba2a87a02b9c7c669f4c30eca tasks: - cephadm: cephadm_branch: v15.2.0 image: docker.io/ceph/ceph:v15.2.0 - cephadm.shell: env: - sha1 mon.a: - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 mon.a: - while ceph orch upgrade status | jq '.in_progress' | grep true ; do ceph orch ps ; ceph versions ; sleep 30 ; done - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 teuthology_branch: master tube: smithi verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.27845 2020-07-16T13:16:54.680 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_gregsfortytwo_ceph_wip-stretch-mode/qa; will attempt to use it 2020-07-16T13:16:54.682 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_gregsfortytwo_ceph_wip-stretch-mode/qa/tasks 2020-07-16T13:16:54.682 INFO:teuthology.run_tasks:Running task internal.check_packages... 2020-07-16T13:16:54.686 INFO:teuthology.task.internal:Checking packages... 2020-07-16T13:16:54.724 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'basic' and ceph hash '7260671e53beca8ba2a87a02b9c7c669f4c30eca' 2020-07-16T13:16:54.724 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-07-16T13:16:54.726 INFO:teuthology.packaging:ref: None 2020-07-16T13:16:54.726 INFO:teuthology.packaging:tag: None 2020-07-16T13:16:54.726 INFO:teuthology.packaging:branch: wip-stretch-mode-1 2020-07-16T13:16:54.727 INFO:teuthology.packaging:sha1: 7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T13:16:54.727 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-stretch-mode-1 2020-07-16T13:16:54.912 INFO:teuthology.task.internal:Found packages for ceph version 16.0.0-3349.g7260671e53b 2020-07-16T13:16:54.913 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2020-07-16T13:16:54.924 INFO:teuthology.task.internal:no buildpackages task found 2020-07-16T13:16:54.924 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2020-07-16T13:16:54.945 INFO:teuthology.task.internal.lock_machines:Locking machines... 2020-07-16T13:16:54.945 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-07-16T13:16:55.337 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-07-16T13:17:05.355 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-07-16T13:17:15.372 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-07-16T13:17:25.390 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-07-16T13:17:35.407 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-07-16T13:17:45.428 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-07-16T13:17:55.444 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-07-16T13:18:05.463 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-07-16T13:18:15.483 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-07-16T13:18:25.500 DEBUG:teuthology.lock.ops:lock_many request: {'locked_by': 'scheduled_gregf@teuthology', 'count': 2, 'machine_type': 'smithi', 'description': '/home/teuthworker/archive/gregf-2020-07-16_11:01:26-rados-wip-stretch-mode-1-distro-basic-smithi/5230565'} 2020-07-16T13:18:25.530 DEBUG:teuthology.lock.ops:locked ubuntu@smithi132.front.sepia.ceph.com, ubuntu@smithi188.front.sepia.ceph.com 2020-07-16T13:18:25.598 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fde4f9d8d08>, signals=[15]) 2020-07-16T13:18:25.824 INFO:teuthology.provision.fog.smithi188:Scheduling deploy of rhel 8.1 2020-07-16T13:18:25.835 INFO:teuthology.provision.fog.smithi132:Scheduling deploy of rhel 8.1 2020-07-16T13:18:26.190 INFO:teuthology.orchestra.console:Power off smithi188 2020-07-16T13:18:26.193 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-07-16T13:18:26.225 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-07-16T13:18:26.253 INFO:teuthology.orchestra.console:Power off smithi132 2020-07-16T13:18:26.254 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-07-16T13:18:26.283 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-07-16T13:18:30.271 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-07-16T13:18:30.317 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-07-16T13:18:34.389 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-07-16T13:18:34.441 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-07-16T13:18:34.605 INFO:teuthology.orchestra.console:Power off for smithi188 completed 2020-07-16T13:18:34.654 INFO:teuthology.orchestra.console:Power off for smithi132 completed 2020-07-16T13:18:34.707 INFO:teuthology.orchestra.console:Power on smithi188 2020-07-16T13:18:34.707 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-07-16T13:18:34.734 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-07-16T13:18:34.755 INFO:teuthology.orchestra.console:Power on smithi132 2020-07-16T13:18:34.756 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-07-16T13:18:34.786 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-07-16T13:18:38.770 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-07-16T13:18:38.818 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-07-16T13:18:42.894 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-07-16T13:18:42.933 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-07-16T13:18:43.112 INFO:teuthology.orchestra.console:Power on for smithi188 completed 2020-07-16T13:18:43.215 INFO:teuthology.provision.fog.smithi188:Waiting for deploy to finish 2020-07-16T13:18:43.241 INFO:teuthology.orchestra.console:Power on for smithi132 completed 2020-07-16T13:18:43.343 INFO:teuthology.provision.fog.smithi132:Waiting for deploy to finish 2020-07-16T13:21:14.473 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T13:21:14.477 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T13:21:23.538 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T13:21:23.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T13:21:32.594 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T13:21:32.597 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T13:21:41.647 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T13:21:41.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T13:21:50.707 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T13:21:50.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T13:21:59.767 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T13:21:59.791 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T13:22:08.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T13:22:08.853 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T13:22:33.432 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T13:22:42.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T13:22:43.647 INFO:teuthology.orchestra.run:Running command with timeout 600 2020-07-16T13:22:43.648 INFO:teuthology.orchestra.run.smithi188:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2020-07-16T13:23:04.507 INFO:teuthology.provision.fog.smithi188:Node is ready 2020-07-16T13:23:04.507 INFO:teuthology.orchestra.run.smithi188:> hostname 2020-07-16T13:23:04.528 INFO:teuthology.orchestra.run.smithi188.stdout:smithi188.front.sepia.ceph.com 2020-07-16T13:23:04.528 INFO:teuthology.orchestra.run.smithi188:> grep smithi188.front.sepia.ceph.com /etc/hosts 2020-07-16T13:23:04.584 INFO:teuthology.orchestra.run.smithi188.stdout:172.21.15.188 smithi188.front.sepia.ceph.com smithi188 2020-07-16T13:23:04.585 INFO:teuthology.orchestra.run.smithi188:> sudo hostname smithi188 2020-07-16T13:23:04.720 INFO:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/smithi188.front.sepia.ceph.com/smithi188/g' /etc/hosts 2020-07-16T13:23:04.752 INFO:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/172.21.15.188/172.21.15.188/g' /etc/hosts 2020-07-16T13:23:04.821 INFO:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/smithi188.front.sepia.ceph.com/smithi188/g' /etc/hostname 2020-07-16T13:23:04.889 INFO:teuthology.orchestra.run.smithi188:> sudo hostname smithi188 2020-07-16T13:23:04.957 INFO:teuthology.provision.fog.smithi188:Deploy complete! 2020-07-16T13:23:04.958 DEBUG:teuthology.parallel:result is None 2020-07-16T13:23:14.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T13:23:15.096 INFO:teuthology.orchestra.run:Running command with timeout 600 2020-07-16T13:23:15.097 INFO:teuthology.orchestra.run.smithi132:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2020-07-16T13:23:15.394 INFO:teuthology.provision.fog.smithi132:Node is ready 2020-07-16T13:23:15.395 INFO:teuthology.orchestra.run.smithi132:> hostname 2020-07-16T13:23:15.409 INFO:teuthology.orchestra.run.smithi132.stdout:smithi132.front.sepia.ceph.com 2020-07-16T13:23:15.409 INFO:teuthology.orchestra.run.smithi132:> grep smithi132.front.sepia.ceph.com /etc/hosts 2020-07-16T13:23:15.463 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.15.132 smithi132.front.sepia.ceph.com smithi132 2020-07-16T13:23:15.463 INFO:teuthology.orchestra.run.smithi132:> sudo hostname smithi132 2020-07-16T13:23:15.579 INFO:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/smithi132.front.sepia.ceph.com/smithi132/g' /etc/hosts 2020-07-16T13:23:15.607 INFO:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/172.21.15.132/172.21.15.132/g' /etc/hosts 2020-07-16T13:23:15.674 INFO:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/smithi132.front.sepia.ceph.com/smithi132/g' /etc/hostname 2020-07-16T13:23:15.741 INFO:teuthology.orchestra.run.smithi132:> sudo hostname smithi132 2020-07-16T13:23:15.807 INFO:teuthology.provision.fog.smithi132:Deploy complete! 2020-07-16T13:23:15.807 DEBUG:teuthology.parallel:result is None 2020-07-16T13:23:15.955 INFO:teuthology.lock.ops:Checking smithi132.front.sepia.ceph.com 2020-07-16T13:23:15.957 INFO:teuthology.lock.ops:New key found. Updating... 2020-07-16T13:23:15.979 INFO:teuthology.lock.ops:Checking smithi188.front.sepia.ceph.com 2020-07-16T13:23:15.979 INFO:teuthology.lock.ops:New key found. Updating... 2020-07-16T13:23:15.998 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: set os type and version on server 2020-07-16T13:23:15.999 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-07-16T13:23:16.000 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T13:23:16.067 INFO:teuthology.orchestra.run.smithi132:> true 2020-07-16T13:23:16.223 INFO:teuthology.orchestra.run.smithi132:> uname -m 2020-07-16T13:23:16.277 INFO:teuthology.orchestra.run.smithi132.stdout:x86_64 2020-07-16T13:23:16.278 INFO:teuthology.orchestra.run.smithi132:> cat /etc/os-release 2020-07-16T13:23:16.330 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="Red Hat Enterprise Linux" 2020-07-16T13:23:16.331 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="8.1 (Ootpa)" 2020-07-16T13:23:16.331 INFO:teuthology.orchestra.run.smithi132.stdout:ID="rhel" 2020-07-16T13:23:16.331 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="fedora" 2020-07-16T13:23:16.332 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="8.1" 2020-07-16T13:23:16.332 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el8" 2020-07-16T13:23:16.332 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.1 (Ootpa)" 2020-07-16T13:23:16.332 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31" 2020-07-16T13:23:16.332 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.1:GA" 2020-07-16T13:23:16.333 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://www.redhat.com/" 2020-07-16T13:23:16.333 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2020-07-16T13:23:16.333 INFO:teuthology.orchestra.run.smithi132.stdout: 2020-07-16T13:23:16.333 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2020-07-16T13:23:16.333 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.1 2020-07-16T13:23:16.334 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2020-07-16T13:23:16.334 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.1" 2020-07-16T13:23:16.335 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2020-07-16T13:23:16.371 INFO:teuthology.lock.ops:Updating [smithi188.front.sepia.ceph.com]: set os type and version on server 2020-07-16T13:23:16.372 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-07-16T13:23:16.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T13:23:16.442 INFO:teuthology.orchestra.run.smithi188:> true 2020-07-16T13:23:16.613 INFO:teuthology.orchestra.run.smithi188:> uname -m 2020-07-16T13:23:16.666 INFO:teuthology.orchestra.run.smithi188.stdout:x86_64 2020-07-16T13:23:16.666 INFO:teuthology.orchestra.run.smithi188:> cat /etc/os-release 2020-07-16T13:23:16.720 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="Red Hat Enterprise Linux" 2020-07-16T13:23:16.720 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="8.1 (Ootpa)" 2020-07-16T13:23:16.721 INFO:teuthology.orchestra.run.smithi188.stdout:ID="rhel" 2020-07-16T13:23:16.721 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE="fedora" 2020-07-16T13:23:16.721 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="8.1" 2020-07-16T13:23:16.721 INFO:teuthology.orchestra.run.smithi188.stdout:PLATFORM_ID="platform:el8" 2020-07-16T13:23:16.721 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.1 (Ootpa)" 2020-07-16T13:23:16.722 INFO:teuthology.orchestra.run.smithi188.stdout:ANSI_COLOR="0;31" 2020-07-16T13:23:16.722 INFO:teuthology.orchestra.run.smithi188.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.1:GA" 2020-07-16T13:23:16.722 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://www.redhat.com/" 2020-07-16T13:23:16.722 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2020-07-16T13:23:16.722 INFO:teuthology.orchestra.run.smithi188.stdout: 2020-07-16T13:23:16.723 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2020-07-16T13:23:16.723 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.1 2020-07-16T13:23:16.723 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2020-07-16T13:23:16.723 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.1" 2020-07-16T13:23:16.724 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server 2020-07-16T13:23:16.744 INFO:teuthology.task.internal.lock_machines:2 smithi machines locked this try, 2/2 locked so far 2020-07-16T13:23:16.774 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi132.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCvIuirzRS6U6ohl6susHLz3IIE1mXye4/ZFM+g7TNSGxnQJZ4RWgtdQPawNdW9JzeFwlStbtgFCpIoCv35wDV3omOJtWrOJHaqmWcco/WGxFBzUM+7N7VFU5h2v26Suu+SWVezrm6Nqj4r34NtZqfb3VijzjYuY3Aw7+jPW9QcarNhXFs1tvrD65vtTIhcv+I7wo/1tAU2o+1yrua/ArUvSu0kkR0CDUM/y08FqQ0CllYwDfkyJR4YSXwuT3Y6FT4Yguwqlhwd8qdhK2QeUp34WIJm4BW3tmj1SK/zCFB9qCL5DvJb9/krc+gDXaX6pzNFiDAmDgdGGwyCFYunIwcA+7T+88JesduF1Bex8SyasvL4AstCSG3Km2tLmoiitDuXI3oEbPYvcJrcnfXU+IpG1rG0BaAN5EEallJXwa+SEhley6VB65XPxt6AieAeBAj/XGiKe9WA2Y3A6TzYBcPkmhfA8SZDqb3ZflMJx36P3pcbsQF2a6Xhsa0vWLW4wgs= smithi188.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD6ryyafuBRnqzPt36ip72Rhwq6is9EC2mGLmcpqghzrtvkVq0hCq6rEhe1wA0bWT0RgkESivKvW8lOsK2vN+excowc5+8Te3X0SGS0wtxyzQPAwWUxK5PdeNI65fQ1//7T3UEiNn2iq9QM4vIKCAnyGBv0kRlCrL6KQ/KB8NYmopIAxi0YvFXUskkYQQpnXBkaFR54xje4LC/Dbz94LPphJoMkJHipOIYndYr/Wq5jfi8dA0XCOND4xplePrXZPxeFewy3UGUOTk09mxo/w/N/sJGoJjD1PLF2kcpg8gejmYyS2y0J75jbCIvCQoDpx8gRPe4MaJm+4fuOIHzsjPOr+3uNh/4cgaxPc7sk+YvUjgC+A8J3fCuMBCKCz9ItYw3wgzYrk+yF7AqGAvaWWMxNdm1yI4sdBs2+XAVazyuc4BbyK1OaPgbmpmzsu9J5iylPvVZEg38/S+dd3KE+/wfQRYsnNs+KBxbEPiIsDoQ06wesRVIYB5sSio5ZnyxvBQU= 2020-07-16T13:23:16.775 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-07-16T13:23:16.830 INFO:teuthology.run_tasks:Running task internal.save_config... 2020-07-16T13:23:16.838 INFO:teuthology.task.internal:Saving configuration 2020-07-16T13:23:16.850 INFO:teuthology.run_tasks:Running task internal.check_lock... 2020-07-16T13:23:16.859 INFO:teuthology.task.internal.check_lock:Checking locks... 2020-07-16T13:23:16.875 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2020-07-16 13:18:25.510891', 'description': '/home/teuthworker/archive/gregf-2020-07-16_11:01:26-rados-wip-stretch-mode-1-distro-basic-smithi/5230565', 'locked_by': 'scheduled_gregf@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPpJMQj3zUItSimH41i2I1E2C2kyTXX6fZzYrvep1uX5fwblZYKbbk2sPEByn4VrTcLxkwRfJJRWzJVpaStkzG0=', 'os_version': '8.1', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'rhel', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi132.front.sepia.ceph.com'} 2020-07-16T13:23:16.891 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2020-07-16 13:18:25.510912', 'description': '/home/teuthworker/archive/gregf-2020-07-16_11:01:26-rados-wip-stretch-mode-1-distro-basic-smithi/5230565', 'locked_by': 'scheduled_gregf@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIvTAyxhyxylDLXr2ttl/kKuwc+OeV7qKah1XUauhloH7iSxWgBpjlC7aq8GAoEKJsMsuYb++UAgjEoclZ0+2SQ=', 'os_version': '8.1', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'rhel', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi188.front.sepia.ceph.com'} 2020-07-16T13:23:16.892 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2020-07-16T13:23:16.902 INFO:teuthology.task.internal:roles: ubuntu@smithi132.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a', 'alertmanager.a'] 2020-07-16T13:23:16.902 INFO:teuthology.task.internal:roles: ubuntu@smithi188.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b'] 2020-07-16T13:23:16.902 INFO:teuthology.run_tasks:Running task console_log... 2020-07-16T13:23:16.975 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fde4f944d08>, signals=[15]) 2020-07-16T13:23:16.977 INFO:teuthology.run_tasks:Running task internal.connect... 2020-07-16T13:23:16.987 INFO:teuthology.task.internal:Opening connections... 2020-07-16T13:23:16.988 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi132.front.sepia.ceph.com 2020-07-16T13:23:16.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T13:23:17.062 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi188.front.sepia.ceph.com 2020-07-16T13:23:17.064 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T13:23:17.139 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2020-07-16T13:23:17.149 INFO:teuthology.orchestra.run.smithi132:> uname -m 2020-07-16T13:23:17.178 INFO:teuthology.orchestra.run.smithi132.stdout:x86_64 2020-07-16T13:23:17.178 INFO:teuthology.orchestra.run.smithi132:> cat /etc/os-release 2020-07-16T13:23:17.231 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="Red Hat Enterprise Linux" 2020-07-16T13:23:17.232 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="8.1 (Ootpa)" 2020-07-16T13:23:17.232 INFO:teuthology.orchestra.run.smithi132.stdout:ID="rhel" 2020-07-16T13:23:17.232 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="fedora" 2020-07-16T13:23:17.232 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="8.1" 2020-07-16T13:23:17.233 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el8" 2020-07-16T13:23:17.233 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.1 (Ootpa)" 2020-07-16T13:23:17.233 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31" 2020-07-16T13:23:17.233 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.1:GA" 2020-07-16T13:23:17.233 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://www.redhat.com/" 2020-07-16T13:23:17.234 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2020-07-16T13:23:17.234 INFO:teuthology.orchestra.run.smithi132.stdout: 2020-07-16T13:23:17.234 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2020-07-16T13:23:17.234 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.1 2020-07-16T13:23:17.234 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2020-07-16T13:23:17.235 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.1" 2020-07-16T13:23:17.235 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2020-07-16T13:23:17.269 INFO:teuthology.orchestra.run.smithi188:> uname -m 2020-07-16T13:23:17.284 INFO:teuthology.orchestra.run.smithi188.stdout:x86_64 2020-07-16T13:23:17.285 INFO:teuthology.orchestra.run.smithi188:> cat /etc/os-release 2020-07-16T13:23:17.337 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="Red Hat Enterprise Linux" 2020-07-16T13:23:17.338 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="8.1 (Ootpa)" 2020-07-16T13:23:17.338 INFO:teuthology.orchestra.run.smithi188.stdout:ID="rhel" 2020-07-16T13:23:17.338 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE="fedora" 2020-07-16T13:23:17.339 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="8.1" 2020-07-16T13:23:17.339 INFO:teuthology.orchestra.run.smithi188.stdout:PLATFORM_ID="platform:el8" 2020-07-16T13:23:17.339 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.1 (Ootpa)" 2020-07-16T13:23:17.339 INFO:teuthology.orchestra.run.smithi188.stdout:ANSI_COLOR="0;31" 2020-07-16T13:23:17.339 INFO:teuthology.orchestra.run.smithi188.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.1:GA" 2020-07-16T13:23:17.340 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://www.redhat.com/" 2020-07-16T13:23:17.340 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2020-07-16T13:23:17.340 INFO:teuthology.orchestra.run.smithi188.stdout: 2020-07-16T13:23:17.341 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2020-07-16T13:23:17.341 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.1 2020-07-16T13:23:17.341 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2020-07-16T13:23:17.341 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.1" 2020-07-16T13:23:17.342 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server 2020-07-16T13:23:17.364 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2020-07-16T13:23:17.383 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2020-07-16T13:23:17.393 INFO:teuthology.task.internal:Checking for old test directory... 2020-07-16T13:23:17.394 INFO:teuthology.orchestra.run.smithi132:> test '!' -e /home/ubuntu/cephtest 2020-07-16T13:23:17.398 INFO:teuthology.orchestra.run.smithi188:> test '!' -e /home/ubuntu/cephtest 2020-07-16T13:23:17.410 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2020-07-16T13:23:17.421 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2020-07-16T13:23:17.421 INFO:teuthology.orchestra.run.smithi132:> test -z $(ls -A /var/lib/ceph) 2020-07-16T13:23:17.450 INFO:teuthology.orchestra.run.smithi188:> test -z $(ls -A /var/lib/ceph) 2020-07-16T13:23:17.468 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2020-07-16T13:23:17.511 INFO:teuthology.run_tasks:Running task kernel... 2020-07-16T13:23:17.529 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.c': {'kdb': True, 'sha1': 'distro'}, 'mgr.y': {'kdb': True, 'sha1': 'distro'}, 'osd.0': {'kdb': True, 'sha1': 'distro'}, 'osd.1': {'kdb': True, 'sha1': 'distro'}, 'osd.2': {'kdb': True, 'sha1': 'distro'}, 'osd.3': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'node-exporter.a': {'kdb': True, 'sha1': 'distro'}, 'alertmanager.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}, 'osd.4': {'kdb': True, 'sha1': 'distro'}, 'osd.5': {'kdb': True, 'sha1': 'distro'}, 'osd.6': {'kdb': True, 'sha1': 'distro'}, 'osd.7': {'kdb': True, 'sha1': 'distro'}, 'client.1': {'kdb': True, 'sha1': 'distro'}, 'prometheus.a': {'kdb': True, 'sha1': 'distro'}, 'grafana.a': {'kdb': True, 'sha1': 'distro'}, 'node-exporter.b': {'kdb': True, 'sha1': 'distro'}} 2020-07-16T13:23:17.530 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2020-07-16T13:23:17.530 INFO:teuthology.orchestra.run.smithi132:> uname -r 2020-07-16T13:23:17.544 INFO:teuthology.orchestra.run.smithi132.stdout:4.18.0-193.el8.x86_64 2020-07-16T13:23:17.544 INFO:teuthology.task.kernel:Running kernel on smithi132: 4.18.0-193.el8.x86_64 2020-07-16T13:23:17.544 INFO:teuthology.orchestra.run.smithi132:> sudo yum install -y kernel 2020-07-16T13:23:19.446 INFO:teuthology.orchestra.run.smithi132.stdout:Updating Subscription Management repositories. 2020-07-16T13:23:19.451 INFO:teuthology.orchestra.run.smithi132.stdout:Unable to read consumer identity 2020-07-16T13:23:19.605 INFO:teuthology.orchestra.run.smithi132.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2020-07-16T13:23:21.008 INFO:teuthology.orchestra.run.smithi132.stdout:Copr repo for ceph-el8 owned by ktdreyer 2.4 kB/s | 257 B 00:00 2020-07-16T13:23:21.354 INFO:teuthology.orchestra.run.smithi132.stdout:Extra Packages for Enterprise Linux 23 MB/s | 7.4 MB 00:00 2020-07-16T13:23:22.800 INFO:teuthology.orchestra.run.smithi132.stdout:lab-extras 4.1 MB/s | 20 kB 00:00 2020-07-16T13:23:23.096 INFO:teuthology.orchestra.run.smithi132.stderr:Modular dependency problem: 2020-07-16T13:23:23.096 INFO:teuthology.orchestra.run.smithi132.stderr: 2020-07-16T13:23:23.096 INFO:teuthology.orchestra.run.smithi132.stderr: Problem: conflicting requests 2020-07-16T13:23:23.097 INFO:teuthology.orchestra.run.smithi132.stderr: - nothing provides module(perl:5.26) needed by module perl-YAML:1.24:8010020190322131811:a5949e2e-0.x86_64 2020-07-16T13:23:23.238 INFO:teuthology.orchestra.run.smithi132.stdout:Package kernel-4.18.0-193.el8.x86_64 is already installed. 2020-07-16T13:23:23.239 INFO:teuthology.orchestra.run.smithi132.stdout:Package kernel-4.18.0-147.el8.x86_64 is already installed. 2020-07-16T13:23:23.313 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2020-07-16T13:23:23.314 INFO:teuthology.orchestra.run.smithi132.stdout:Nothing to do. 2020-07-16T13:23:23.314 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2020-07-16T13:23:23.469 INFO:teuthology.orchestra.run.smithi132:> echo no | sudo yum reinstall kernel || true 2020-07-16T13:23:23.836 INFO:teuthology.orchestra.run.smithi132.stdout:Updating Subscription Management repositories. 2020-07-16T13:23:23.836 INFO:teuthology.orchestra.run.smithi132.stdout:Unable to read consumer identity 2020-07-16T13:23:23.901 INFO:teuthology.orchestra.run.smithi132.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2020-07-16T13:23:24.065 INFO:teuthology.orchestra.run.smithi132.stdout:Last metadata expiration check: 0:00:02 ago on Thu 16 Jul 2020 01:23:22 PM UTC. 2020-07-16T13:23:24.096 INFO:teuthology.orchestra.run.smithi132.stderr:Modular dependency problem: 2020-07-16T13:23:24.097 INFO:teuthology.orchestra.run.smithi132.stderr: 2020-07-16T13:23:24.097 INFO:teuthology.orchestra.run.smithi132.stderr: Problem: conflicting requests 2020-07-16T13:23:24.097 INFO:teuthology.orchestra.run.smithi132.stderr: - nothing provides module(perl:5.26) needed by module perl-YAML:1.24:8010020190322131811:a5949e2e-0.x86_64 2020-07-16T13:23:24.168 INFO:teuthology.orchestra.run.smithi132.stdout:Installed package kernel-4.18.0-193.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2020-07-16T13:23:24.168 INFO:teuthology.orchestra.run.smithi132.stdout:Installed package kernel-4.18.0-147.el8.x86_64 (from anaconda) not available. 2020-07-16T13:23:24.234 INFO:teuthology.orchestra.run.smithi132.stderr:Error: No packages marked for reinstall. 2020-07-16T13:23:24.346 INFO:teuthology.orchestra.run.smithi132:> sudo yum reinstall -y kernel || true 2020-07-16T13:23:24.672 INFO:teuthology.orchestra.run.smithi132.stdout:Updating Subscription Management repositories. 2020-07-16T13:23:24.673 INFO:teuthology.orchestra.run.smithi132.stdout:Unable to read consumer identity 2020-07-16T13:23:24.750 INFO:teuthology.orchestra.run.smithi132.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2020-07-16T13:23:24.911 INFO:teuthology.orchestra.run.smithi132.stdout:Last metadata expiration check: 0:00:02 ago on Thu 16 Jul 2020 01:23:22 PM UTC. 2020-07-16T13:23:24.940 INFO:teuthology.orchestra.run.smithi132.stderr:Modular dependency problem: 2020-07-16T13:23:24.941 INFO:teuthology.orchestra.run.smithi132.stderr: 2020-07-16T13:23:24.941 INFO:teuthology.orchestra.run.smithi132.stderr: Problem: conflicting requests 2020-07-16T13:23:24.941 INFO:teuthology.orchestra.run.smithi132.stderr: - nothing provides module(perl:5.26) needed by module perl-YAML:1.24:8010020190322131811:a5949e2e-0.x86_64 2020-07-16T13:23:25.022 INFO:teuthology.orchestra.run.smithi132.stdout:Installed package kernel-4.18.0-193.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2020-07-16T13:23:25.022 INFO:teuthology.orchestra.run.smithi132.stdout:Installed package kernel-4.18.0-147.el8.x86_64 (from anaconda) not available. 2020-07-16T13:23:25.101 INFO:teuthology.orchestra.run.smithi132.stderr:Error: No packages marked for reinstall. 2020-07-16T13:23:25.179 INFO:teuthology.orchestra.run.smithi132:> rpm -q kernel --last | head -n 1 2020-07-16T13:23:25.269 INFO:teuthology.orchestra.run.smithi132.stdout:kernel-4.18.0-193.el8.x86_64 Sun 10 May 2020 01:56:55 PM UTC 2020-07-16T13:23:25.271 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-193.el8.x86_64 2020-07-16T13:23:25.271 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2020-07-16T13:23:25.271 INFO:teuthology.orchestra.run.smithi188:> uname -r 2020-07-16T13:23:25.288 INFO:teuthology.orchestra.run.smithi188.stdout:4.18.0-193.el8.x86_64 2020-07-16T13:23:25.289 INFO:teuthology.task.kernel:Running kernel on smithi188: 4.18.0-193.el8.x86_64 2020-07-16T13:23:25.289 INFO:teuthology.orchestra.run.smithi188:> sudo yum install -y kernel 2020-07-16T13:23:27.403 INFO:teuthology.orchestra.run.smithi188.stdout:Updating Subscription Management repositories. 2020-07-16T13:23:27.410 INFO:teuthology.orchestra.run.smithi188.stdout:Unable to read consumer identity 2020-07-16T13:23:27.542 INFO:teuthology.orchestra.run.smithi188.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2020-07-16T13:23:29.091 INFO:teuthology.orchestra.run.smithi188.stdout:Copr repo for ceph-el8 owned by ktdreyer 1.6 kB/s | 257 B 00:00 2020-07-16T13:23:29.456 INFO:teuthology.orchestra.run.smithi188.stdout:Extra Packages for Enterprise Linux 23 MB/s | 7.4 MB 00:00 2020-07-16T13:23:30.913 INFO:teuthology.orchestra.run.smithi188.stdout:lab-extras 4.1 MB/s | 20 kB 00:00 2020-07-16T13:23:31.215 INFO:teuthology.orchestra.run.smithi188.stderr:Modular dependency problem: 2020-07-16T13:23:31.216 INFO:teuthology.orchestra.run.smithi188.stderr: 2020-07-16T13:23:31.216 INFO:teuthology.orchestra.run.smithi188.stderr: Problem: conflicting requests 2020-07-16T13:23:31.216 INFO:teuthology.orchestra.run.smithi188.stderr: - nothing provides module(perl:5.26) needed by module perl-YAML:1.24:8010020190322131811:a5949e2e-0.x86_64 2020-07-16T13:23:31.462 INFO:teuthology.orchestra.run.smithi188.stdout:Package kernel-4.18.0-193.el8.x86_64 is already installed. 2020-07-16T13:23:31.462 INFO:teuthology.orchestra.run.smithi188.stdout:Package kernel-4.18.0-147.el8.x86_64 is already installed. 2020-07-16T13:23:31.537 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2020-07-16T13:23:31.538 INFO:teuthology.orchestra.run.smithi188.stdout:Nothing to do. 2020-07-16T13:23:31.538 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2020-07-16T13:23:31.713 INFO:teuthology.orchestra.run.smithi188:> echo no | sudo yum reinstall kernel || true 2020-07-16T13:23:32.040 INFO:teuthology.orchestra.run.smithi188.stdout:Updating Subscription Management repositories. 2020-07-16T13:23:32.040 INFO:teuthology.orchestra.run.smithi188.stdout:Unable to read consumer identity 2020-07-16T13:23:32.519 INFO:teuthology.orchestra.run.smithi188.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2020-07-16T13:23:32.682 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:00:02 ago on Thu 16 Jul 2020 01:23:30 PM UTC. 2020-07-16T13:23:32.710 INFO:teuthology.orchestra.run.smithi188.stderr:Modular dependency problem: 2020-07-16T13:23:32.710 INFO:teuthology.orchestra.run.smithi188.stderr: 2020-07-16T13:23:32.711 INFO:teuthology.orchestra.run.smithi188.stderr: Problem: conflicting requests 2020-07-16T13:23:32.711 INFO:teuthology.orchestra.run.smithi188.stderr: - nothing provides module(perl:5.26) needed by module perl-YAML:1.24:8010020190322131811:a5949e2e-0.x86_64 2020-07-16T13:23:32.826 INFO:teuthology.orchestra.run.smithi188.stdout:Installed package kernel-4.18.0-193.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2020-07-16T13:23:32.827 INFO:teuthology.orchestra.run.smithi188.stdout:Installed package kernel-4.18.0-147.el8.x86_64 (from anaconda) not available. 2020-07-16T13:23:32.899 INFO:teuthology.orchestra.run.smithi188.stderr:Error: No packages marked for reinstall. 2020-07-16T13:23:32.968 INFO:teuthology.orchestra.run.smithi188:> sudo yum reinstall -y kernel || true 2020-07-16T13:23:33.333 INFO:teuthology.orchestra.run.smithi188.stdout:Updating Subscription Management repositories. 2020-07-16T13:23:33.334 INFO:teuthology.orchestra.run.smithi188.stdout:Unable to read consumer identity 2020-07-16T13:23:33.416 INFO:teuthology.orchestra.run.smithi188.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2020-07-16T13:23:33.576 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:00:03 ago on Thu 16 Jul 2020 01:23:30 PM UTC. 2020-07-16T13:23:33.603 INFO:teuthology.orchestra.run.smithi188.stderr:Modular dependency problem: 2020-07-16T13:23:33.604 INFO:teuthology.orchestra.run.smithi188.stderr: 2020-07-16T13:23:33.604 INFO:teuthology.orchestra.run.smithi188.stderr: Problem: conflicting requests 2020-07-16T13:23:33.604 INFO:teuthology.orchestra.run.smithi188.stderr: - nothing provides module(perl:5.26) needed by module perl-YAML:1.24:8010020190322131811:a5949e2e-0.x86_64 2020-07-16T13:23:33.695 INFO:teuthology.orchestra.run.smithi188.stdout:Installed package kernel-4.18.0-193.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2020-07-16T13:23:33.695 INFO:teuthology.orchestra.run.smithi188.stdout:Installed package kernel-4.18.0-147.el8.x86_64 (from anaconda) not available. 2020-07-16T13:23:33.776 INFO:teuthology.orchestra.run.smithi188.stderr:Error: No packages marked for reinstall. 2020-07-16T13:23:33.846 INFO:teuthology.orchestra.run.smithi188:> rpm -q kernel --last | head -n 1 2020-07-16T13:23:33.903 INFO:teuthology.orchestra.run.smithi188.stdout:kernel-4.18.0-193.el8.x86_64 Sun 10 May 2020 01:56:55 PM UTC 2020-07-16T13:23:33.905 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-193.el8.x86_64 2020-07-16T13:23:33.905 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2020-07-16T13:23:33.906 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2020-07-16T13:23:33.906 INFO:teuthology.orchestra.run.smithi132:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-07-16T13:23:33.947 INFO:teuthology.orchestra.run.smithi132.stdout:ttyS1 2020-07-16T13:23:33.962 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2020-07-16T13:23:33.962 INFO:teuthology.orchestra.run.smithi188:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-07-16T13:23:34.001 INFO:teuthology.orchestra.run.smithi188.stdout:ttyS1 2020-07-16T13:23:34.020 INFO:teuthology.run_tasks:Running task internal.base... 2020-07-16T13:23:34.030 INFO:teuthology.task.internal:Creating test directory... 2020-07-16T13:23:34.031 INFO:teuthology.orchestra.run.smithi132:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-07-16T13:23:34.034 INFO:teuthology.orchestra.run.smithi188:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-07-16T13:23:34.073 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2020-07-16T13:23:34.084 INFO:teuthology.run_tasks:Running task internal.archive... 2020-07-16T13:23:34.126 INFO:teuthology.task.internal:Creating archive directory... 2020-07-16T13:23:34.127 INFO:teuthology.orchestra.run.smithi132:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-07-16T13:23:34.140 INFO:teuthology.orchestra.run.smithi188:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-07-16T13:23:34.181 INFO:teuthology.run_tasks:Running task internal.coredump... 2020-07-16T13:23:34.194 INFO:teuthology.task.internal:Enabling coredump saving... 2020-07-16T13:23:34.195 INFO:teuthology.orchestra.run.smithi132:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-07-16T13:23:34.204 INFO:teuthology.orchestra.run.smithi188:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-07-16T13:23:34.256 INFO:teuthology.orchestra.run.smithi132.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-07-16T13:23:34.271 INFO:teuthology.orchestra.run.smithi132.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-07-16T13:23:34.284 INFO:teuthology.orchestra.run.smithi188.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-07-16T13:23:34.297 INFO:teuthology.orchestra.run.smithi188.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-07-16T13:23:34.299 INFO:teuthology.run_tasks:Running task internal.sudo... 2020-07-16T13:23:34.311 INFO:teuthology.task.internal:Configuring sudo... 2020-07-16T13:23:34.312 INFO:teuthology.orchestra.run.smithi132:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-07-16T13:23:34.315 INFO:teuthology.orchestra.run.smithi188:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-07-16T13:23:34.344 INFO:teuthology.run_tasks:Running task internal.syslog... 2020-07-16T13:23:34.361 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2020-07-16T13:23:34.362 INFO:teuthology.orchestra.run.smithi132:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-07-16T13:23:34.387 INFO:teuthology.orchestra.run.smithi188:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-07-16T13:23:34.402 INFO:teuthology.orchestra.run.smithi132:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-07-16T13:23:34.476 INFO:teuthology.orchestra.run.smithi132:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2020-07-16T13:23:34.539 INFO:teuthology.orchestra.run.smithi132:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-07-16T13:23:34.627 INFO:teuthology.orchestra.run.smithi132:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2020-07-16T13:23:34.668 INFO:teuthology.orchestra.run.smithi132:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2020-07-16T13:23:34.764 INFO:teuthology.orchestra.run.smithi188:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-07-16T13:23:34.798 INFO:teuthology.orchestra.run.smithi188:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2020-07-16T13:23:34.863 INFO:teuthology.orchestra.run.smithi188:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-07-16T13:23:34.935 INFO:teuthology.orchestra.run.smithi188:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2020-07-16T13:23:34.987 INFO:teuthology.orchestra.run.smithi188:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2020-07-16T13:23:35.072 INFO:teuthology.orchestra.run.smithi132:> sudo service rsyslog restart 2020-07-16T13:23:35.074 INFO:teuthology.orchestra.run.smithi188:> sudo service rsyslog restart 2020-07-16T13:23:35.135 INFO:teuthology.orchestra.run.smithi132.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2020-07-16T13:23:35.168 INFO:teuthology.orchestra.run.smithi188.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2020-07-16T13:23:35.538 INFO:teuthology.run_tasks:Running task internal.timer... 2020-07-16T13:23:35.546 INFO:teuthology.task.internal:Starting timer... 2020-07-16T13:23:35.547 INFO:teuthology.run_tasks:Running task pcp... 2020-07-16T13:23:35.584 INFO:teuthology.run_tasks:Running task selinux... 2020-07-16T13:23:35.599 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2020-07-16T13:23:35.600 INFO:teuthology.orchestra.run.smithi132:> sudo service auditd rotate 2020-07-16T13:23:35.661 INFO:teuthology.orchestra.run.smithi132.stdout:Rotating logs: [ OK ] 2020-07-16T13:23:35.663 INFO:teuthology.orchestra.run.smithi188:> sudo service auditd rotate 2020-07-16T13:23:35.734 INFO:teuthology.orchestra.run.smithi188.stdout:Rotating logs: [ OK ] 2020-07-16T13:23:35.735 DEBUG:teuthology.task.selinux:Getting current SELinux state 2020-07-16T13:23:35.736 INFO:teuthology.orchestra.run.smithi132:> /usr/sbin/getenforce 2020-07-16T13:23:35.774 INFO:teuthology.orchestra.run.smithi132.stdout:Permissive 2020-07-16T13:23:35.775 INFO:teuthology.orchestra.run.smithi188:> /usr/sbin/getenforce 2020-07-16T13:23:35.795 INFO:teuthology.orchestra.run.smithi188.stdout:Permissive 2020-07-16T13:23:35.796 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi132.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi188.front.sepia.ceph.com': 'permissive'} 2020-07-16T13:23:35.796 INFO:teuthology.orchestra.run.smithi132:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2020-07-16T13:23:35.843 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-07-16T13:23:35.844 INFO:teuthology.orchestra.run.smithi188:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2020-07-16T13:23:35.872 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-07-16T13:23:35.873 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2020-07-16T13:23:35.874 INFO:teuthology.orchestra.run.smithi132:> sudo /usr/sbin/setenforce permissive 2020-07-16T13:23:35.912 INFO:teuthology.orchestra.run.smithi188:> sudo /usr/sbin/setenforce permissive 2020-07-16T13:23:35.941 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2020-07-16T13:23:35.951 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated; assuming it is current 2020-07-16T13:23:35.952 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to branch origin/master 2020-07-16T13:23:35.981 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2020-07-16T13:23:35.984 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi132.front.sepia.ceph.com,smithi188.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2020-07-16T13:23:36.400 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2020-07-16T13:23:37.520 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2020-07-16T13:23:39.903 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2020-07-16T13:23:39.925 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:23:39 +0000 (0:00:00.072) 0:00:00.072 ********* 2020-07-16T13:23:39.944 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:23:39 +0000 (0:00:00.018) 0:00:00.090 ********* 2020-07-16T13:23:41.451 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi188.front.sepia.ceph.com] 2020-07-16T13:23:41.480 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] 2020-07-16T13:23:41.610 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:23:41 +0000 (0:00:01.666) 0:00:01.757 ********* 2020-07-16T13:23:41.645 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:23:41 +0000 (0:00:00.034) 0:00:01.792 ********* 2020-07-16T13:23:42.110 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2020-07-16T13:23:42.111 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-07-16T13:23:42.113 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-07-16T13:23:42.146 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:23:42 +0000 (0:00:00.501) 0:00:02.293 ********* 2020-07-16T13:23:42.184 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:23:42 +0000 (0:00:00.037) 0:00:02.331 ********* 2020-07-16T13:23:42.707 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2020-07-16T13:23:42.709 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-07-16T13:23:42.742 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:23:42 +0000 (0:00:00.557) 0:00:02.888 ********* 2020-07-16T13:23:42.751 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-07-16T13:23:42.786 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:23:42 +0000 (0:00:00.044) 0:00:02.933 ********* 2020-07-16T13:23:42.794 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2020-07-16T13:23:42.796 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:23:42.830 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:23:42 +0000 (0:00:00.043) 0:00:02.977 ********* 2020-07-16T13:23:42.839 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:23:42.875 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:23:42 +0000 (0:00:00.045) 0:00:03.022 ********* 2020-07-16T13:23:43.249 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2020-07-16T13:23:43.250 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-07-16T13:23:43.288 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:23:43 +0000 (0:00:00.412) 0:00:03.435 ********* 2020-07-16T13:23:43.299 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-07-16T13:23:43.351 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:23:43 +0000 (0:00:00.062) 0:00:03.498 ********* 2020-07-16T13:23:44.290 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2020-07-16T13:23:44.292 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1594905823.3731344-28690460883936/source", "state": "file", "uid": 0} changed: [smithi132.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1594905823.306221-19966786116932/source", "state": "file", "uid": 0} 2020-07-16T13:23:44.329 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:23:44 +0000 (0:00:00.977) 0:00:04.476 ********* 2020-07-16T13:23:44.365 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:23:44 +0000 (0:00:00.035) 0:00:04.512 ********* 2020-07-16T13:23:44.877 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtC 2020-07-16T13:23:44.879 INFO:teuthology.task.ansible.out:toHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-07-16T13:23:44.916 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2020-07-16T13:23:44.918 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-07-16T13:23:45.039 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2020-07-16T13:23:45.053 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2020-07-16T13:23:45.217 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:23:45 +0000 (0:00:00.851) 0:00:05.364 ********* 2020-07-16T13:23:45.255 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:23:45 +0000 (0:00:00.037) 0:00:05.402 ********* 2020-07-16T13:23:45.881 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi132.front.sepia.ceph.com] 2020-07-16T13:23:45.932 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] 2020-07-16T13:23:45.986 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. Thursday 16 July 2020 13:23:45 +0000 (0:00:00.731) 0:00:06.133 ********* 2020-07-16T13:23:46.068 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:23:46 +0000 (0:00:00.082) 0:00:06.215 ********* 2020-07-16T13:23:46.633 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2020-07-16T13:23:46.634 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.180866", "end": "2020-07-16 13:23:46.547885", "rc": 0, "start": "2020-07-16 13:23:46.367019", "stderr": "", "stderr_lines": [], "stdout": "d2c541f972f084049b707e8806b2858a9ab4fb83", "stdout_lines": ["d2c541f972f084049b707e8806b2858a9ab4fb83"]} changed: [smithi188.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.178684", "end": "2020-07-16 13:23:46.587438", "rc": 0, "start": "2020-07-16 13:23:46.408754", "stderr": "", "stderr_lines": [], "stdout": "d2c541f972f084049b707e8806b2858a9ab4fb83", "stdout_lines": ["d2c541f972f084049b707e8806b2858a9ab4fb83"]} 2020-07-16T13:23:46.680 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:23:46 +0000 (0:00:00.612) 0:00:06.827 ********* 2020-07-16T13:23:46.722 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:23:46 +0000 (0:00:00.041) 0:00:06.869 ********* 2020-07-16T13:23:46.902 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** changed: [smithi132.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.011985", "end": "2020-07-16 13:23:46.874735", "failed_when_result": false, "rc": 0, "start": "2020-07-16 13:23:46.862750", "stderr": "", "stderr_lines": [], "stdout": "f148133fb0c07a635fda93cc17e7dcc2a5d008b7", "stdout_lines": ["f148133fb0c07a635fda93cc17e7dcc2a5d008b7"]} 2020-07-16T13:23:46.945 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:23:46 +0000 (0:00:00.221) 0:00:07.091 ********* 2020-07-16T13:23:46.958 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.006259", "end": "2020-07-16 13:23:46.924308", "failed_when_result": false, "rc": 0, "start": "2020-07-16 13:23:46.918049", "stderr": "", "stderr_lines": [], "stdout": "f148133fb0c07a635fda93cc17e7dcc2a5d008b7", "stdout_lines": ["f148133fb0c07a635fda93cc17e7dcc2a5d008b7"]} 2020-07-16T13:23:47.031 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:23:47 +0000 (0:00:00.086) 0:00:07.178 ********* 2020-07-16T13:23:47.040 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2020-07-16T13:23:47.042 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:23:47.079 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:23:47 +0000 (0:00:00.048) 0:00:07.226 ********* 2020-07-16T13:23:47.088 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:23:47.130 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:23:47 +0000 (0:00:00.051) 0:00:07.277 ********* 2020-07-16T13:23:47.140 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2020-07-16T13:23:47.142 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:23:47.186 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:23:47 +0000 (0:00:00.050) 0:00:07.328 ********* 2020-07-16T13:23:47.192 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:23:47.229 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:23:47 +0000 (0:00:00.047) 0:00:07.376 ********* 2020-07-16T13:23:47.239 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2020-07-16T13:23:47.241 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:23:47.282 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:23:47 +0000 (0:00:00.053) 0:00:07.429 ********* 2020-07-16T13:23:47.291 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:23:47.329 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:23:47 +0000 (0:00:00.047) 0:00:07.476 ********* 2020-07-16T13:23:47.339 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2020-07-16T13:23:47.341 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:23:47.378 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:23:47 +0000 (0:00:00.049) 0:00:07.525 ********* 2020-07-16T13:23:47.387 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:23:47.422 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:23:47 +0000 (0:00:00.043) 0:00:07.569 ********* 2020-07-16T13:23:47.430 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:23:47.466 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:23:47 +0000 (0:00:00.044) 0:00:07.613 ********* 2020-07-16T13:23:47.475 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:23:47.509 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:23:47 +0000 (0:00:00.042) 0:00:07.656 ********* 2020-07-16T13:23:47.669 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* ok: [smithi132.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-07-16T13:23:47.704 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:23:47 +0000 (0:00:00.194) 0:00:07.850 ********* 2020-07-16T13:23:47.731 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-07-16T13:23:47.769 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:23:47 +0000 (0:00:00.065) 0:00:07.916 ********* 2020-07-16T13:23:47.955 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-07-16T13:23:47.957 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2020-07-16T13:23:48.029 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2020-07-16T13:23:48.164 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2020-07-16T13:23:48.250 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2020-07-16T13:23:48.255 INFO:teuthology.task.ansible.out: 2020-07-16T13:23:48.359 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2020-07-16T13:23:48.455 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2020-07-16T13:23:48.574 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2020-07-16T13:23:48.649 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2020-07-16T13:23:48.775 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2020-07-16T13:23:48.878 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2020-07-16T13:23:48.967 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2020-07-16T13:23:49.082 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2020-07-16T13:23:49.176 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2020-07-16T13:23:49.298 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2020-07-16T13:23:49.384 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2020-07-16T13:23:49.509 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2020-07-16T13:23:49.597 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2020-07-16T13:23:49.709 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2020-07-16T13:23:49.796 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2020-07-16T13:23:49.917 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2020-07-16T13:23:50.002 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2020-07-16T13:23:50.122 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2020-07-16T13:23:50.211 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2020-07-16T13:23:50.330 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2020-07-16T13:23:50.430 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2020-07-16T13:23:50.567 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2020-07-16T13:23:50.657 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2020-07-16T13:23:50.753 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2020-07-16T13:23:50.863 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2020-07-16T13:23:50.958 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2020-07-16T13:23:51.063 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2020-07-16T13:23:51.169 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2020-07-16T13:23:51.269 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2020-07-16T13:23:51.381 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2020-07-16T13:23:51.477 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2020-07-16T13:23:51.587 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2020-07-16T13:23:51.676 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2020-07-16T13:23:51.788 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2020-07-16T13:23:51.887 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2020-07-16T13:23:52.005 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2020-07-16T13:23:52.092 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2020-07-16T13:23:52.218 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2020-07-16T13:23:52.297 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1122} 2020-07-16T13:23:52.418 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1122} 2020-07-16T13:23:52.503 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1123} 2020-07-16T13:23:52.619 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1123} 2020-07-16T13:23:52.700 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1124} 2020-07-16T13:23:52.819 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1124} 2020-07-16T13:23:52.907 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1125} 2020-07-16T13:23:53.030 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1125} 2020-07-16T13:23:53.113 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1126} 2020-07-16T13:23:53.244 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1126} 2020-07-16T13:23:53.319 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1127} 2020-07-16T13:23:53.456 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1127} 2020-07-16T13:23:53.509 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1128} 2020-07-16T13:23:53.662 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1128} 2020-07-16T13:23:53.741 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1129} 2020-07-16T13:23:53.877 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1129} 2020-07-16T13:23:53.932 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1130} 2020-07-16T13:23:54.083 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1130} 2020-07-16T13:23:54.139 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1131} 2020-07-16T13:23:54.277 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1131} 2020-07-16T13:23:54.376 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1132} 2020-07-16T13:23:54.478 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1132} 2020-07-16T13:23:54.588 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1133} 2020-07-16T13:23:54.684 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1133} 2020-07-16T13:23:54.788 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1134} 2020-07-16T13:23:54.906 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1134} 2020-07-16T13:23:54.992 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1135} 2020-07-16T13:23:55.119 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1135} 2020-07-16T13:23:55.192 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1136} 2020-07-16T13:23:55.319 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1136} 2020-07-16T13:23:55.395 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1137} 2020-07-16T13:23:55.526 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1137} 2020-07-16T13:23:55.606 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1138} 2020-07-16T13:23:55.722 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1138} 2020-07-16T13:23:55.810 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1139} 2020-07-16T13:23:55.934 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1139} 2020-07-16T13:23:56.009 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2020-07-16T13:23:56.147 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2020-07-16T13:23:56.221 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1141} 2020-07-16T13:23:56.341 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1141} 2020-07-16T13:23:56.428 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1142} 2020-07-16T13:23:56.552 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1142} 2020-07-16T13:23:56.626 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1143} 2020-07-16T13:23:56.763 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1143} 2020-07-16T13:23:56.826 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1144} 2020-07-16T13:23:56.969 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1144} 2020-07-16T13:23:57.021 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1145} 2020-07-16T13:23:57.182 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1145} 2020-07-16T13:23:57.225 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1146} 2020-07-16T13:23:57.383 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1146} 2020-07-16T13:23:57.447 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1147} 2020-07-16T13:23:57.583 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1147} 2020-07-16T13:23:57.646 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2020-07-16T13:23:57.789 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2020-07-16T13:23:57.875 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1149} 2020-07-16T13:23:57.992 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1149} 2020-07-16T13:23:58.093 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1150} 2020-07-16T13:23:58.201 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1150} 2020-07-16T13:23:58.296 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1151} 2020-07-16T13:23:58.404 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1151} 2020-07-16T13:23:58.503 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1152} 2020-07-16T13:23:58.627 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1152} 2020-07-16T13:23:58.723 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1153} 2020-07-16T13:23:58.832 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1153} 2020-07-16T13:23:58.934 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1154} 2020-07-16T13:23:59.037 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1154} 2020-07-16T13:23:59.142 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1155} 2020-07-16T13:23:59.248 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1155} 2020-07-16T13:23:59.356 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1156} 2020-07-16T13:23:59.452 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1156} 2020-07-16T13:23:59.558 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1157} 2020-07-16T13:23:59.648 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1157} 2020-07-16T13:23:59.763 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1158} 2020-07-16T13:23:59.859 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1158} 2020-07-16T13:23:59.966 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1159} 2020-07-16T13:24:00.058 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1159} 2020-07-16T13:24:00.190 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1160} 2020-07-16T13:24:00.269 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1160} 2020-07-16T13:24:00.383 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1161} 2020-07-16T13:24:00.385 INFO:teuthology.task.ansible.out: 2020-07-16T13:24:00.484 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1161} 2020-07-16T13:24:00.589 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1162} 2020-07-16T13:24:00.683 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1162} 2020-07-16T13:24:00.823 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1163} 2020-07-16T13:24:00.897 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1163} 2020-07-16T13:24:01.033 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1164} 2020-07-16T13:24:01.096 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1164} 2020-07-16T13:24:01.230 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2020-07-16T13:24:01.307 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2020-07-16T13:24:01.445 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1165} 2020-07-16T13:24:01.510 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1165} 2020-07-16T13:24:01.647 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1166} 2020-07-16T13:24:01.705 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1166} 2020-07-16T13:24:01.860 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1167} 2020-07-16T13:24:01.925 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1167} 2020-07-16T13:24:02.056 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1168} 2020-07-16T13:24:02.131 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1168} 2020-07-16T13:24:02.272 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1169} 2020-07-16T13:24:02.340 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1169} 2020-07-16T13:24:02.479 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1170} 2020-07-16T13:24:02.558 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1170} 2020-07-16T13:24:02.700 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1171} 2020-07-16T13:24:02.754 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1171} 2020-07-16T13:24:02.893 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1172} 2020-07-16T13:24:02.955 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1172} 2020-07-16T13:24:03.106 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1173} 2020-07-16T13:24:03.210 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1173} 2020-07-16T13:24:03.217 INFO:teuthology.task.ansible.out: 2020-07-16T13:24:03.312 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1174} 2020-07-16T13:24:03.414 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1174} 2020-07-16T13:24:03.526 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1175} 2020-07-16T13:24:03.622 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1175} 2020-07-16T13:24:03.733 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1176} 2020-07-16T13:24:03.835 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1176} 2020-07-16T13:24:03.940 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1177} 2020-07-16T13:24:04.038 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1177} 2020-07-16T13:24:04.139 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1178} 2020-07-16T13:24:04.245 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1178} 2020-07-16T13:24:04.336 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1179} 2020-07-16T13:24:04.447 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1179} 2020-07-16T13:24:04.543 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1180} 2020-07-16T13:24:04.653 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1180} 2020-07-16T13:24:04.739 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1181} 2020-07-16T13:24:04.857 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1181} 2020-07-16T13:24:04.966 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1182} 2020-07-16T13:24:05.074 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1182} 2020-07-16T13:24:05.181 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1183} 2020-07-16T13:24:05.271 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1183} 2020-07-16T13:24:05.391 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1184} 2020-07-16T13:24:05.496 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1184} 2020-07-16T13:24:05.599 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1185} 2020-07-16T13:24:05.705 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1185} 2020-07-16T13:24:05.821 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1186} 2020-07-16T13:24:05.918 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1186} 2020-07-16T13:24:06.016 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1187} 2020-07-16T13:24:06.122 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1187} 2020-07-16T13:24:06.244 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon iDR2L3LMuqFG10t1dKdXtA 61f19801e4ab7abb7597df1606036f11b0cf6a27df853dca2df8f0bb071318e1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon iDR2L3LMuqFG10t1dKdXtA 61f19801e4ab7abb7597df1606036f11b0cf6a27df853dca2df8f0bb071318e1"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1188} 2020-07-16T13:24:06.335 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon iDR2L3LMuqFG10t1dKdXtA 61f19801e4ab7abb7597df1606036f11b0cf6a27df853dca2df8f0bb071318e1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon iDR2L3LMuqFG10t1dKdXtA 61f19801e4ab7abb7597df1606036f11b0cf6a27df853dca2df8f0bb071318e1"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1188} 2020-07-16T13:24:06.443 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1189} 2020-07-16T13:24:06.538 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1189} 2020-07-16T13:24:06.639 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1190} 2020-07-16T13:24:06.745 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1190} 2020-07-16T13:24:06.850 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1191} 2020-07-16T13:24:06.950 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1191} 2020-07-16T13:24:07.059 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1192} 2020-07-16T13:24:07.160 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1192} 2020-07-16T13:24:07.264 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1193} 2020-07-16T13:24:07.367 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1193} 2020-07-16T13:24:07.476 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1194} 2020-07-16T13:24:07.582 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1194} 2020-07-16T13:24:07.687 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1195} 2020-07-16T13:24:07.793 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1195} 2020-07-16T13:24:07.927 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1196} 2020-07-16T13:24:08.043 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1196} 2020-07-16T13:24:08.129 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1197} 2020-07-16T13:24:08.250 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1197} 2020-07-16T13:24:08.337 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1198} 2020-07-16T13:24:08.468 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1198} 2020-07-16T13:24:08.571 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1199} 2020-07-16T13:24:08.697 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1199} 2020-07-16T13:24:08.786 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1200} 2020-07-16T13:24:08.918 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1200} 2020-07-16T13:24:09.007 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1201} 2020-07-16T13:24:09.122 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1201} 2020-07-16T13:24:09.216 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2020-07-16T13:24:09.328 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2020-07-16T13:24:09.417 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1202} 2020-07-16T13:24:09.551 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1202} 2020-07-16T13:24:09.623 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1203} 2020-07-16T13:24:09.748 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1203} 2020-07-16T13:24:09.825 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1204} 2020-07-16T13:24:09.953 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1204} 2020-07-16T13:24:10.022 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1205} 2020-07-16T13:24:10.151 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1205} 2020-07-16T13:24:10.235 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1206} 2020-07-16T13:24:10.351 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1206} 2020-07-16T13:24:10.440 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1207} 2020-07-16T13:24:10.549 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1207} 2020-07-16T13:24:10.663 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1208} 2020-07-16T13:24:10.757 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1208} 2020-07-16T13:24:10.870 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1209} 2020-07-16T13:24:10.958 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1209} 2020-07-16T13:24:11.048 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1210} 2020-07-16T13:24:11.161 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1210} 2020-07-16T13:24:11.271 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1211} 2020-07-16T13:24:11.376 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1211} 2020-07-16T13:24:11.470 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1212} 2020-07-16T13:24:11.580 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1212} 2020-07-16T13:24:11.672 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1213} 2020-07-16T13:24:11.791 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1213} 2020-07-16T13:24:11.882 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1214} 2020-07-16T13:24:11.987 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1214} 2020-07-16T13:24:13.406 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10102, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2020-07-16T13:24:13.459 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10102, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2020-07-16T13:24:14.573 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "name": "prateek", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2020-07-16T13:24:14.679 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "name": "prateek", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2020-07-16T13:24:15.711 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "name": "jelopez", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2020-07-16T13:24:15.892 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "name": "jelopez", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2020-07-16T13:24:16.831 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "name": "dcain", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10105} 2020-07-16T13:24:17.067 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "name": "dcain", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10105} 2020-07-16T13:24:18.014 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10106, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "name": "sunny", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10106} 2020-07-16T13:24:18.331 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10106, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "name": "sunny", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10106} 2020-07-16T13:24:19.224 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10107, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10107} 2020-07-16T13:24:19.514 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10107, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10107} 2020-07-16T13:24:20.469 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10108, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "name": "aclewett", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10108} 2020-07-16T13:24:20.672 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10108, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "name": "aclewett", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10108} 2020-07-16T13:24:21.673 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10109, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "name": "cblum", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10109} 2020-07-16T13:24:21.910 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10109, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "name": "cblum", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10109} 2020-07-16T13:24:22.911 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10110, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10110} 2020-07-16T13:24:23.024 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:24:23 +0000 (0:00:35.253) 0:00:43.169 ********* 2020-07-16T13:24:23.053 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-07-16T13:24:23.096 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:24:23 +0000 (0:00:00.069) 0:00:43.239 ********* 2020-07-16T13:24:23.158 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2020-07-16T13:24:23.160 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 2020-07-16T13:24:23.161 INFO:teuthology.task.ansible.out: 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b26 2020-07-16T13:24:23.163 INFO:teuthology.task.ansible.out:5c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivanci 2020-07-16T13:24:23.165 INFO:teuthology.task.ansible.out:ch", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0Wihhvk 2020-07-16T13:24:23.166 INFO:teuthology.task.ansible.out:KztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 2020-07-16T13:24:23.168 INFO:teuthology.task.ansible.out: HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfp 2020-07-16T13:24:23.170 INFO:teuthology.task.ansible.out:fKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73 2020-07-16T13:24:23.171 INFO:teuthology.task.ansible.out:dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "o 2020-07-16T13:24:23.172 INFO:teuthology.task.ansible.out:vpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localho 2020-07-16T13:24:23.173 INFO:teuthology.task.ansible.out:st eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon iDR2L3LMuqFG10t1dKdXtA 61f19801e4ab7abb7597df1606036f11b0cf6a27df853dca2df8f0bb071318e1"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn" 2020-07-16T13:24:23.175 INFO:teuthology.task.ansible.out:: "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02 2020-07-16T13:24:23.177 INFO:teuthology.task.ansible.out:"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28 2020-07-16T13:24:23.178 INFO:teuthology.task.ansible.out:eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}]}, "changed": false} TASK [users : Create all admin users with sudo access.] ************************ changed: [smithi188.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10110, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10110} 2020-07-16T13:24:23.302 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:24:23 +0000 (0:00:00.206) 0:00:43.445 ********* 2020-07-16T13:24:23.344 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:24:23 +0000 (0:00:00.045) 0:00:43.491 ********* 2020-07-16T13:24:23.387 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-07-16T13:24:23.429 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:24:23 +0000 (0:00:00.084) 0:00:43.575 ********* 2020-07-16T13:24:23.512 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* ok: [smithi188.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c 2020-07-16T13:24:23.514 INFO:teuthology.task.ansible.out:68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": " 2020-07-16T13:24:23.516 INFO:teuthology.task.ansible.out:ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 2020-07-16T13:24:23.518 INFO:teuthology.task.ansible.out:79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce66 2020-07-16T13:24:23.520 INFO:teuthology.task.ansible.out:8079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217 2020-07-16T13:24:23.521 INFO:teuthology.task.ansible.out:d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144 2020-07-16T13:24:23.522 INFO:teuthology.task.ansible.out:712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542 2020-07-16T13:24:23.524 INFO:teuthology.task.ansible.out:da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, 2020-07-16T13:24:23.526 INFO:teuthology.task.ansible.out:{"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c6 2020-07-16T13:24:23.528 INFO:teuthology.task.ansible.out:85b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon iDR2L3LMuqFG10t1dKdXtA 61f19801e4ab7abb7597df1606036f11b0cf6a27df853dca2df8f0bb071318e1"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae13 2020-07-16T13:24:23.532 INFO:teuthology.task.ansible.out:28c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, {"name": "rraja", "ovpn": "rraja@p50 4NM 2020-07-16T13:24:23.534 INFO:teuthology.task.ansible.out:Ughtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"n 2020-07-16T13:24:23.535 INFO:teuthology.task.ansible.out:ame": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}]}, "changed": false} 2020-07-16T13:24:23.577 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:24:23 +0000 (0:00:00.147) 0:00:43.723 ********* 2020-07-16T13:24:24.354 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2020-07-16T13:24:24.356 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com -> localhost] => {"after": "d2c541f972f084049b707e8806b2858a9ab4fb83", "attempts": 1, "before": "d2c541f972f084049b707e8806b2858a9ab4fb83", "changed": false, "remote_url_changed": false} 2020-07-16T13:24:24.394 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:24:24 +0000 (0:00:00.817) 0:00:44.541 ********* 2020-07-16T13:24:24.403 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com -> localhost] => {"after": "d2c541f972f084049b707e8806b2858a9ab4fb83", "attempts": 1, "before": "d2c541f972f084049b707e8806b2858a9ab4fb83", "changed": false, "remote_url_changed": false} 2020-07-16T13:24:24.440 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:24:24 +0000 (0:00:00.045) 0:00:44.587 ********* 2020-07-16T13:24:24.782 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-07-16T13:24:24.784 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2020-07-16T13:24:24.812 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2020-07-16T13:24:25.093 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2020-07-16T13:24:25.114 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2020-07-16T13:24:25.380 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2020-07-16T13:24:25.412 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2020-07-16T13:24:25.663 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2020-07-16T13:24:25.665 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2020-07-16T13:24:25.715 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2020-07-16T13:24:25.717 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2020-07-16T13:24:25.978 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2020-07-16T13:24:26.013 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2020-07-16T13:24:26.262 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2020-07-16T13:24:26.264 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2020-07-16T13:24:26.318 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2020-07-16T13:24:26.320 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2020-07-16T13:24:26.554 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2020-07-16T13:24:26.622 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2020-07-16T13:24:26.835 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2020-07-16T13:24:26.923 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2020-07-16T13:24:27.121 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2020-07-16T13:24:27.132 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:24:27.199 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2020-07-16T13:24:27.222 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:24:27.437 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2020-07-16T13:24:27.439 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2020-07-16T13:24:27.522 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2020-07-16T13:24:27.523 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2020-07-16T13:24:27.727 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "a 2020-07-16T13:24:27.729 INFO:teuthology.task.ansible.out:emerson", "validate_certs": true} 2020-07-16T13:24:27.740 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:24:27.742 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:24:27.829 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "a 2020-07-16T13:24:27.830 INFO:teuthology.task.ansible.out:emerson", "validate_certs": true} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:24:27.853 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:24:28.033 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2020-07-16T13:24:28.130 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2020-07-16T13:24:28.343 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2020-07-16T13:24:28.345 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2020-07-16T13:24:28.427 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2020-07-16T13:24:28.429 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2020-07-16T13:24:28.620 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2020-07-16T13:24:28.729 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2020-07-16T13:24:28.906 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2020-07-16T13:24:29.006 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2020-07-16T13:24:29.193 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2020-07-16T13:24:29.295 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2020-07-16T13:24:29.476 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2020-07-16T13:24:29.595 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2020-07-16T13:24:29.775 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2020-07-16T13:24:29.890 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2020-07-16T13:24:30.075 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2020-07-16T13:24:30.178 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2020-07-16T13:24:30.369 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2020-07-16T13:24:30.372 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2020-07-16T13:24:30.476 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2020-07-16T13:24:30.478 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2020-07-16T13:24:30.659 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2020-07-16T13:24:30.661 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2020-07-16T13:24:30.765 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2020-07-16T13:24:30.767 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2020-07-16T13:24:30.958 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2020-07-16T13:24:31.054 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2020-07-16T13:24:31.244 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2020-07-16T13:24:31.345 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2020-07-16T13:24:31.534 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46 2020-07-16T13:24:31.536 INFO:teuthology.task.ansible.out:TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2020-07-16T13:24:31.661 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46 2020-07-16T13:24:31.663 INFO:teuthology.task.ansible.out:TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2020-07-16T13:24:31.836 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2020-07-16T13:24:31.969 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2020-07-16T13:24:32.110 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2020-07-16T13:24:32.240 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2020-07-16T13:24:32.389 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2020-07-16T13:24:32.534 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2020-07-16T13:24:32.683 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2020-07-16T13:24:32.828 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2020-07-16T13:24:33.018 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2020-07-16T13:24:33.124 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2020-07-16T13:24:33.316 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2020-07-16T13:24:33.318 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2020-07-16T13:24:33.414 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2020-07-16T13:24:33.416 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2020-07-16T13:24:33.598 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2020-07-16T13:24:33.707 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2020-07-16T13:24:33.893 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2020-07-16T13:24:33.895 INFO:teuthology.task.ansible.out: 2020-07-16T13:24:33.991 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2020-07-16T13:24:34.212 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2020-07-16T13:24:34.276 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2020-07-16T13:24:34.501 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2020-07-16T13:24:34.586 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2020-07-16T13:24:34.803 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2020-07-16T13:24:34.869 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2020-07-16T13:24:35.093 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2020-07-16T13:24:35.161 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2020-07-16T13:24:35.411 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2020-07-16T13:24:35.452 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2020-07-16T13:24:35.697 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2020-07-16T13:24:35.730 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2020-07-16T13:24:36.007 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDH/YT1mGZg50qDdngGQ4Ea+jfJGZ582J6pQbYkrvuGsyATMzNwk73sAbn7mgbpw7nkW/ol/vwahXHZ5heC056BFnqiZ7tjoDeotDx/1XxFtkbyIaVflUeD1vBww38v6IslLHcVhPilauPVZSfVzEHI7JB0a+9OwNrEH3+dt1B6vR+WRy2gHG/aEJffPMv4yv/0FgRWy3cEiUvGlLq0KVVTbsqqLQhw/u5k8bBIoibBtZLFAMTrjLYp9Dv8dxJROvmey6O2TuX6gCY1rLGTAArYULpXH73OLIqaksJKc3srgoJrTSZPO6bo3BQeLz4ODJ7uvTpvQIhacBpp/dq1ln7p owasserm@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCiqChxNdielMPBchs0u6bxWstqU9oeY2K9qf1PNwEIrwDYTrpDjsdoVnS750tOBjWY0wr9Gf9ATOJXi89151oao9GaUueQ1rTgmu7GtPlKsuBUVNMFzLEa0mqneqDA4AfknisFt/LnL8fLM4BddT25tmQ4oUGS7F17p4kXqwboK/DsJciCMWWc/5AT4NVwdnYFzIA6ta25/bB94kpktaZ6HDw7G8q/mK62Yza3EZfq8SP7p0sPL7oVsInQ9AutcVonmALgzPa9t1/MPGaXUIqARaWtwe4MSlNEIs4afLFyteBVeq+dgU01yeyjFivwVmuS+aPFTm6sjGGe8/gOsFDIJiVertOqi663m7q1WYGlVANfif7uL2+uJ9yrvOmrFh5s/CJMJBRG1SLfK1j/ivFwvPAQc/uMqEIRzrVZOsuNLPO4zHPWzmBAPUteb+2BqSdUFYMlBxb3lmhFFffroDqnOK1nbdAfmyKiosUizQgX2Gs2wjjtejuhS9dpYkNu+sBOujsxa2mZUouyWf4fXyWGVjthrCZaM+FyeSDpJrgwgRiSKNB8aRxB10ZNo9WZEy6eH2adp0Xf6v2KsKvryDndqBEkBI8zLbGrPVHGSEqiSBWc+NeAB06uSscJd0pHU3hDg0qW0EaxOXaial9qrBiwcFVKEr0g7LDURQ6KZsZy9w== owasserm@owasserm.redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2020-07-16T13:24:36.050 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDH/YT1mGZg50qDdngGQ4Ea+jfJGZ582J6pQbYkrvuGsyATMzNwk73sAbn7mgbpw7nkW/ol/vwahXHZ5heC056BFnqiZ7tjoDeotDx/1XxFtkbyIaVflUeD1vBww38v6IslLHcVhPilauPVZSfVzEHI7JB0a+9OwNrEH3+dt1B6vR+WRy2gHG/aEJffPMv4yv/0FgRWy3cEiUvGlLq0KVVTbsqqLQhw/u5k8bBIoibBtZLFAMTrjLYp9Dv8dxJROvmey6O2TuX6gCY1rLGTAArYULpXH73OLIqaksJKc3srgoJrTSZPO6bo3BQeLz4ODJ7uvTpvQIhacBpp/dq1ln7p owasserm@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCiqChxNdielMPBchs0u6bxWstqU9oeY2K9qf1PNwEIrwDYTrpDjsdoVnS750tOBjWY0wr9Gf9ATOJXi89151oao9GaUueQ1rTgmu7GtPlKsuBUVNMFzLEa0mqneqDA4AfknisFt/LnL8fLM4BddT25tmQ4oUGS7F17p4kXqwboK/DsJciCMWWc/5AT4NVwdnYFzIA6ta25/bB94kpktaZ6HDw7G8q/mK62Yza3EZfq8SP7p0sPL7oVsInQ9AutcVonmALgzPa9t1/MPGaXUIqARaWtwe4MSlNEIs4afLFyteBVeq+dgU01yeyjFivwVmuS+aPFTm6sjGGe8/gOsFDIJiVertOqi663m7q1WYGlVANfif7uL2+uJ9yrvOmrFh5s/CJMJBRG1SLfK1j/ivFwvPAQc/uMqEIRzrVZOsuNLPO4zHPWzmBAPUteb+2BqSdUFYMlBxb3lmhFFffroDqnOK1nbdAfmyKiosUizQgX2Gs2wjjtejuhS9dpYkNu+sBOujsxa2mZUouyWf4fXyWGVjthrCZaM+FyeSDpJrgwgRiSKNB8aRxB10ZNo9WZEy6eH2adp0Xf6v2KsKvryDndqBEkBI8zLbGrPVHGSEqiSBWc+NeAB06uSscJd0pHU3hDg0qW0EaxOXaial9qrBiwcFVKEr0g7LDURQ6KZsZy9w== owasserm@owasserm.redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2020-07-16T13:24:36.290 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2020-07-16T13:24:36.292 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2020-07-16T13:24:36.343 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2020-07-16T13:24:36.345 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2020-07-16T13:24:36.576 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2020-07-16T13:24:36.579 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2020-07-16T13:24:36.675 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2020-07-16T13:24:36.677 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2020-07-16T13:24:36.863 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2020-07-16T13:24:36.973 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2020-07-16T13:24:37.156 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2020-07-16T13:24:37.261 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2020-07-16T13:24:37.444 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2020-07-16T13:24:37.570 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2020-07-16T13:24:37.744 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": nu 2020-07-16T13:24:37.746 INFO:teuthology.task.ansible.out:ll, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2020-07-16T13:24:37.885 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": nu 2020-07-16T13:24:37.888 INFO:teuthology.task.ansible.out:ll, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2020-07-16T13:24:38.066 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2020-07-16T13:24:38.069 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2020-07-16T13:24:38.071 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2020-07-16T13:24:38.171 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2020-07-16T13:24:38.173 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2020-07-16T13:24:38.175 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2020-07-16T13:24:38.357 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2020-07-16T13:24:38.467 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2020-07-16T13:24:38.634 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2020-07-16T13:24:38.762 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2020-07-16T13:24:38.936 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2020-07-16T13:24:39.057 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2020-07-16T13:24:39.227 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2020-07-16T13:24:39.347 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2020-07-16T13:24:39.526 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2020-07-16T13:24:39.641 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2020-07-16T13:24:39.821 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2020-07-16T13:24:39.822 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2020-07-16T13:24:39.938 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2020-07-16T13:24:39.940 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2020-07-16T13:24:40.127 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2020-07-16T13:24:40.220 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2020-07-16T13:24:40.414 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2020-07-16T13:24:40.524 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2020-07-16T13:24:40.713 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2020-07-16T13:24:40.723 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2020-07-16T13:24:40.816 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2020-07-16T13:24:40.817 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2020-07-16T13:24:40.998 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2020-07-16T13:24:41.105 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2020-07-16T13:24:41.298 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2020-07-16T13:24:41.395 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2020-07-16T13:24:41.606 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2020-07-16T13:24:41.608 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2020-07-16T13:24:41.702 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2020-07-16T13:24:41.704 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2020-07-16T13:24:41.894 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2020-07-16T13:24:41.991 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2020-07-16T13:24:42.195 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2020-07-16T13:24:42.301 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2020-07-16T13:24:42.473 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2020-07-16T13:24:42.583 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2020-07-16T13:24:42.767 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2020-07-16T13:24:42.883 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2020-07-16T13:24:43.045 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2020-07-16T13:24:43.175 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2020-07-16T13:24:43.325 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2020-07-16T13:24:43.487 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2020-07-16T13:24:43.615 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2020-07-16T13:24:43.773 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2020-07-16T13:24:43.913 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2020-07-16T13:24:44.075 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2020-07-16T13:24:44.204 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2020-07-16T13:24:44.360 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2020-07-16T13:24:44.502 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2020-07-16T13:24:44.656 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2020-07-16T13:24:44.783 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2020-07-16T13:24:44.931 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2020-07-16T13:24:45.073 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2020-07-16T13:24:45.230 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2020-07-16T13:24:45.360 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2020-07-16T13:24:45.522 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2020-07-16T13:24:45.524 INFO:teuthology.task.ansible.out: 2020-07-16T13:24:45.665 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2020-07-16T13:24:45.812 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2020-07-16T13:24:45.955 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9/Io6M3q8yQqoPNPKAPJ6Fzq18DMfmNtxcD8GUWNo0xcMxd7XOlarvYc7INDQjkpzx6s+aqMme55pSUZuN5plW+nuFmRPqBaIxyeCnNjzCch0wbtEZe5dzT270FhzM1Tu4W0dw+WD6zrGjXayLNs2uxNp3UrWtMTBRzd0IfxJ1R2aJtiCE/HNxIZn+bhS/OmEPV1izz23MvKXD+nRaeJK6Aqrg1zbnpoNskz2fZ/AnmhnAMc4EHl/NUyW1mi4g81KcQMwE8poWmw1NpZje9gWFcISVClLvvhk/A6at/v90P7PisX+/ulTA/QYJYvGBjgbNtURYu/PWzYBOAEZQGfj shilpa@dhcp35-184.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDqRSG3i8QY7t9sp6I8vDZ7LVdk+DDrMhI1QmvU2z+YQhUGDBOvvO6YP0gUXPDyalyj0sJXiwLWPmkrOsbnR96YCUcIt7Ba6R0d0w85JxcJ1WyPcsg2UyOBwq4A+s7VAFZm6FEWzlaubixsNp04gKDqBjSjaqA1Kwx8/Tg39byay8Hn3VJeZ1SkRukvhykz2e6gl7ydfuJQVmEyO3pTrd5157ZqgvQRABT10wc3vR2m4eC65hU/v0ci7HMY9oVtGEdWVBapWMuiocrOPCRWF5zrMJwW4vzPOCHa/47hBEIWfOWJidUVzAawnM3nOe7PykvvDK/iP8B6JpxKTE74eLeh shilpa@fedora.lab.eng.blr.redhat.com", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2020-07-16T13:24:46.112 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9/Io6M3q8yQqoPNPKAPJ6Fzq18DMfmNtxcD8GUWNo0xcMxd7XOlarvYc7INDQjkpzx6s+aqMme55pSUZuN5plW+nuFmRPqBaIxyeCnNjzCch0wbtEZe5dzT270FhzM1Tu4W0dw+WD6zrGjXayLNs2uxNp3UrWtMTBRzd0IfxJ1R2aJtiCE/HNxIZn+bhS/OmEPV1izz23MvKXD+nRaeJK6Aqrg1zbnpoNskz2fZ/AnmhnAMc4EHl/NUyW1mi4g81KcQMwE8poWmw1NpZje9gWFcISVClLvvhk/A6at/v90P7PisX+/ulTA/QYJYvGBjgbNtURYu/PWzYBOAEZQGfj shilpa@dhcp35-184.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDqRSG3i8QY7t9sp6I8vDZ7LVdk+DDrMhI1QmvU2z+YQhUGDBOvvO6YP0gUXPDyalyj0sJXiwLWPmkrOsbnR96YCUcIt7Ba6R0d0w85JxcJ1WyPcsg2UyOBwq4A+s7VAFZm6FEWzlaubixsNp04gKDqBjSjaqA1Kwx8/Tg39byay8Hn3VJeZ1SkRukvhykz2e6gl7ydfuJQVmEyO3pTrd5157ZqgvQRABT10wc3vR2m4eC65hU/v0ci7HMY9oVtGEdWVBapWMuiocrOPCRWF5zrMJwW4vzPOCHa/47hBEIWfOWJidUVzAawnM3nOe7PykvvDK/iP8B6JpxKTE74eLeh shilpa@fedora.lab.eng.blr.redhat.com", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2020-07-16T13:24:46.254 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2020-07-16T13:24:46.394 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2020-07-16T13:24:46.541 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2020-07-16T13:24:46.705 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2020-07-16T13:24:46.832 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2020-07-16T13:24:47.004 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2020-07-16T13:24:47.130 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2020-07-16T13:24:47.298 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2020-07-16T13:24:47.437 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2020-07-16T13:24:47.596 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2020-07-16T13:24:47.735 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2020-07-16T13:24:47.902 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2020-07-16T13:24:48.008 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2020-07-16T13:24:48.182 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2020-07-16T13:24:48.324 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2020-07-16T13:24:48.478 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2020-07-16T13:24:48.615 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2020-07-16T13:24:48.795 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2020-07-16T13:24:48.902 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2020-07-16T13:24:49.071 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2020-07-16T13:24:49.201 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.locald 2020-07-16T13:24:49.203 INFO:teuthology.task.ansible.out:omain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2020-07-16T13:24:49.360 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.locald 2020-07-16T13:24:49.362 INFO:teuthology.task.ansible.out:omain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2020-07-16T13:24:49.491 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2020-07-16T13:24:49.494 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2020-07-16T13:24:49.675 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2020-07-16T13:24:49.677 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2020-07-16T13:24:49.799 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon iDR2L3LMuqFG10t1dKdXtA 61f19801e4ab7abb7597df1606036f11b0cf6a27df853dca2df8f0bb071318e1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon iDR2L3LMuqFG10t1dKdXtA 61f19801e4ab7abb7597df1606036f11b0cf6a27df853dca2df8f0bb071318e1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2020-07-16T13:24:49.962 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon iDR2L3LMuqFG10t1dKdXtA 61f19801e4ab7abb7597df1606036f11b0cf6a27df853dca2df8f0bb071318e1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon iDR2L3LMuqFG10t1dKdXtA 61f19801e4ab7abb7597df1606036f11b0cf6a27df853dca2df8f0bb071318e1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2020-07-16T13:24:50.093 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2020-07-16T13:24:50.277 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2020-07-16T13:24:50.376 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2020-07-16T13:24:50.556 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2020-07-16T13:24:50.684 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2020-07-16T13:24:50.840 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2020-07-16T13:24:51.006 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2020-07-16T13:24:51.143 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2020-07-16T13:24:51.291 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2020-07-16T13:24:51.453 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2020-07-16T13:24:51.579 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2020-07-16T13:24:51.754 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2020-07-16T13:24:51.914 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2020-07-16T13:24:52.072 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2020-07-16T13:24:52.212 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2020-07-16T13:24:52.371 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2020-07-16T13:24:52.506 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2020-07-16T13:24:52.659 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2020-07-16T13:24:52.811 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2020-07-16T13:24:52.938 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2020-07-16T13:24:53.098 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2020-07-16T13:24:53.261 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2020-07-16T13:24:53.382 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2020-07-16T13:24:53.552 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2020-07-16T13:24:53.673 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2020-07-16T13:24:53.844 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2020-07-16T13:24:53.970 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", 2020-07-16T13:24:53.972 INFO:teuthology.task.ansible.out:"manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2020-07-16T13:24:54.145 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", 2020-07-16T13:24:54.148 INFO:teuthology.task.ansible.out:"manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2020-07-16T13:24:54.258 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlnlBzRdWRqns/9VrYuF9tLILUjeGd9z8Tf/dPZmxAt3nnZqpTvI2xXemQpyt/2lsD0U24EuTc1Y/dBsgqvXtZOw51TZE8RK26hvCCaKGfcKONjvR7goHAmkYPHK9+F6m7fgYkRzA0+ZW4HcWNh/xxhhL2G1EGfz5bzIoGQJHSdzc6VeVIsY7HiYEMTxvxdsgV72Kjq97BdmHm56RBzoH24oN0UzNZS8Syx5SuWj9dA3IyFBPwjLlozSk6U2Ofd7qaXuQKl807eD9g6RhRldzHPS+i0EK3EM6Jvho5Y08k1KqV4gIEwMdzDbD3SH0xq+nUPFKcDTUFNp+tkg10GxqN zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2020-07-16T13:24:54.421 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlnlBzRdWRqns/9VrYuF9tLILUjeGd9z8Tf/dPZmxAt3nnZqpTvI2xXemQpyt/2lsD0U24EuTc1Y/dBsgqvXtZOw51TZE8RK26hvCCaKGfcKONjvR7goHAmkYPHK9+F6m7fgYkRzA0+ZW4HcWNh/xxhhL2G1EGfz5bzIoGQJHSdzc6VeVIsY7HiYEMTxvxdsgV72Kjq97BdmHm56RBzoH24oN0UzNZS8Syx5SuWj9dA3IyFBPwjLlozSk6U2Ofd7qaXuQKl807eD9g6RhRldzHPS+i0EK3EM6Jvho5Y08k1KqV4gIEwMdzDbD3SH0xq+nUPFKcDTUFNp+tkg10GxqN zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2020-07-16T13:24:54.544 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2020-07-16T13:24:54.708 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2020-07-16T13:24:54.870 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2020-07-16T13:24:55.000 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2020-07-16T13:24:55.148 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2020-07-16T13:24:55.323 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2020-07-16T13:24:55.483 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2020-07-16T13:24:55.601 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2020-07-16T13:24:55.781 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2020-07-16T13:24:55.904 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2020-07-16T13:24:56.092 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2020-07-16T13:24:56.204 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2020-07-16T13:24:56.395 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2020-07-16T13:24:56.507 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2020-07-16T13:24:56.691 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2020-07-16T13:24:56.787 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2020-07-16T13:24:56.974 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2020-07-16T13:24:57.071 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2020-07-16T13:24:57.279 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2020-07-16T13:24:57.381 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2020-07-16T13:24:57.591 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2020-07-16T13:24:57.697 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2020-07-16T13:24:57.880 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2020-07-16T13:24:58.007 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2020-07-16T13:24:58.176 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2020-07-16T13:24:58.297 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2020-07-16T13:24:58.470 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2020-07-16T13:24:58.593 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2020-07-16T13:24:58.758 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2020-07-16T13:24:58.899 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2020-07-16T13:24:59.036 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2020-07-16T13:24:59.198 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2020-07-16T13:24:59.326 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2020-07-16T13:24:59.473 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2020-07-16T13:24:59.626 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpb 2020-07-16T13:24:59.628 INFO:teuthology.task.ansible.out:cmjLd+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2020-07-16T13:24:59.775 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpb 2020-07-16T13:24:59.777 INFO:teuthology.task.ansible.out:cmjLd+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2020-07-16T13:24:59.956 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2020-07-16T13:24:59.958 INFO:teuthology.task.ansible.out: 2020-07-16T13:25:00.065 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2020-07-16T13:25:00.230 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2020-07-16T13:25:00.348 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2020-07-16T13:25:00.542 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2020-07-16T13:25:00.628 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:00 +0000 (0:00:36.188) 0:01:20.775 ********* 2020-07-16T13:25:00.682 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-07-16T13:25:00.684 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** changed: [smithi132.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2020-07-16T13:25:00.739 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-07-16T13:25:00.741 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166a 2020-07-16T13:25:00.743 INFO:teuthology.task.ansible.out:f59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: 2020-07-16T13:25:00.745 INFO:teuthology.task.ansible.out: [smithi188.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ 2020-07-16T13:25:00.749 INFO:teuthology.task.ansible.out:+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:00.779 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:00 +0000 (0:00:00.150) 0:01:20.926 ********* 2020-07-16T13:25:00.834 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:00.856 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:00.858 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:00.871 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:00.880 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:00.883 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:00.892 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:00.894 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:01.027 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2020-07-16T13:25:01.039 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:01.050 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:01.182 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2020-07-16T13:25:01.193 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:01.204 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:01.330 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2020-07-16T13:25:01.490 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2020-07-16T13:25:01.602 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2020-07-16T13:25:01.613 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:01.624 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:01.625 INFO:teuthology.task.ansible.out: skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:01.640 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:01.651 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:01.662 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:01.673 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:01.684 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:01.695 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:01.696 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:01.706 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:01.719 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:01.729 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:01.740 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:01.742 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:01.765 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2020-07-16T13:25:01.767 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:01.777 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:01.779 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:01.789 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:01.791 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:01.801 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:01.803 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:01.812 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:01.814 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:01.824 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:01.826 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:01.826 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:01.839 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:01.850 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:01.851 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:01.853 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:01.863 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:01.864 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:01.866 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:01.877 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:01.887 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:01.889 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:01.890 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:01.902 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:01.903 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:01.914 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:01.915 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:01.918 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:01.928 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:01.929 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:01.931 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:01.932 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:01.944 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:01.945 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:01.947 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:01.957 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:01.959 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:01.960 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:01.971 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:01.983 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:01.984 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:01.996 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.026 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.027 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.028 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'na 2020-07-16T13:25:02.030 INFO:teuthology.task.ansible.out:me': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a49 2020-07-16T13:25:02.031 INFO:teuthology.task.ansible.out:34fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.032 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.032 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.043 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.044 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.056 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.058 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.072 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.074 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.075 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.076 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.095 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.099 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.099 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.101 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.113 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.115 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.117 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.127 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.129 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.139 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.150 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.152 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.162 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.164 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.175 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.178 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.187 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.188 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.198 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.201 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.211 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon iDR2L3LMuqFG10t1dKdXtA 61f19801e4ab7abb7597df1606036f11b0cf6a27df853dca2df8f0bb071318e1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon iDR2L3LMuqFG10t1dKdXtA 61f19801e4ab7abb7597df1606036f11b0cf6a27df853dca2df8f0bb071318e1"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.221 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.223 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.233 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.244 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.246 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.248 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.263 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.264 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.264 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.284 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.285 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.287 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.289 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.302 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.304 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.315 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.317 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.332 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "ite 2020-07-16T13:25:02.335 INFO:teuthology.task.ansible.out:m", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.343 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.345 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.354 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.356 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.367 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon iDR2L3LMuqFG10t1dKdXtA 61f19801e4ab7abb7597df1606036f11b0cf6a27df853dca2df8f0bb071318e1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon iDR2L3LMuqFG10t1dKdXtA 61f19801e4ab7abb7597df1606036f11b0cf6a27df853dca2df8f0bb071318e1"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.379 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.389 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.392 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.403 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.406 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.421 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.430 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.441 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.442 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.453 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.456 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.466 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.468 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.469 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.469 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.470 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@full 2020-07-16T13:25:02.472 INFO:teuthology.task.ansible.out:steam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.482 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.492 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.504 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.506 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.506 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664D 2020-07-16T13:25:02.508 INFO:teuthology.task.ansible.out:mg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.523 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.525 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.585 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:02 +0000 (0:00:01.805) 0:01:22.731 ********* 2020-07-16T13:25:02.611 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.612 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.621 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": 2020-07-16T13:25:02.625 INFO:teuthology.task.ansible.out: "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} TASK [users : Filter the revoked_users list] *********************************** skipping: [smithi 2020-07-16T13:25:02.626 INFO:teuthology.task.ansible.out:188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.663 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:02 +0000 (0:00:00.078) 0:01:22.810 ********* 2020-07-16T13:25:02.674 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.676 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.725 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:02 +0000 (0:00:00.061) 0:01:22.872 ********* 2020-07-16T13:25:02.757 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2020-07-16T13:25:02.758 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:02.789 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:02 +0000 (0:00:00.064) 0:01:22.936 ********* 2020-07-16T13:25:02.914 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-07-16T13:25:02.916 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2020-07-16T13:25:03.030 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2020-07-16T13:25:03.121 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2020-07-16T13:25:03.236 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2020-07-16T13:25:03.320 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2020-07-16T13:25:03.425 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2020-07-16T13:25:03.520 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2020-07-16T13:25:03.632 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2020-07-16T13:25:03.714 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2020-07-16T13:25:03.832 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2020-07-16T13:25:03.921 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2020-07-16T13:25:04.024 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2020-07-16T13:25:04.147 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2020-07-16T13:25:04.222 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2020-07-16T13:25:04.358 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2020-07-16T13:25:04.422 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2020-07-16T13:25:04.558 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2020-07-16T13:25:04.626 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2020-07-16T13:25:04.764 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2020-07-16T13:25:04.827 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2020-07-16T13:25:04.957 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2020-07-16T13:25:05.012 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2020-07-16T13:25:05.151 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2020-07-16T13:25:05.204 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2020-07-16T13:25:05.353 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2020-07-16T13:25:05.399 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2020-07-16T13:25:05.561 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2020-07-16T13:25:05.614 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2020-07-16T13:25:05.767 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2020-07-16T13:25:05.820 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2020-07-16T13:25:05.971 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2020-07-16T13:25:06.024 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2020-07-16T13:25:06.162 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2020-07-16T13:25:06.214 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2020-07-16T13:25:06.361 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2020-07-16T13:25:06.424 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2020-07-16T13:25:06.558 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2020-07-16T13:25:06.610 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2020-07-16T13:25:06.749 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2020-07-16T13:25:06.832 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2020-07-16T13:25:06.946 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2020-07-16T13:25:06.948 INFO:teuthology.task.ansible.out: 2020-07-16T13:25:07.004 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2020-07-16T13:25:07.005 INFO:teuthology.task.ansible.out: 2020-07-16T13:25:07.139 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2020-07-16T13:25:07.141 INFO:teuthology.task.ansible.out: 2020-07-16T13:25:07.200 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2020-07-16T13:25:07.201 INFO:teuthology.task.ansible.out: 2020-07-16T13:25:07.346 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2020-07-16T13:25:07.348 INFO:teuthology.task.ansible.out: 2020-07-16T13:25:07.399 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2020-07-16T13:25:07.538 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2020-07-16T13:25:07.590 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2020-07-16T13:25:07.592 INFO:teuthology.task.ansible.out: 2020-07-16T13:25:07.744 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2020-07-16T13:25:07.746 INFO:teuthology.task.ansible.out: 2020-07-16T13:25:07.798 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2020-07-16T13:25:07.936 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2020-07-16T13:25:08.001 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2020-07-16T13:25:08.139 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2020-07-16T13:25:08.223 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2020-07-16T13:25:08.337 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2020-07-16T13:25:08.422 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2020-07-16T13:25:08.423 INFO:teuthology.task.ansible.out: 2020-07-16T13:25:08.544 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2020-07-16T13:25:08.638 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2020-07-16T13:25:08.741 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2020-07-16T13:25:08.846 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2020-07-16T13:25:08.961 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2020-07-16T13:25:09.045 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2020-07-16T13:25:09.150 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2020-07-16T13:25:09.233 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2020-07-16T13:25:09.358 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2020-07-16T13:25:09.431 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2020-07-16T13:25:09.561 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2020-07-16T13:25:09.624 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2020-07-16T13:25:09.752 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2020-07-16T13:25:09.814 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2020-07-16T13:25:09.959 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2020-07-16T13:25:10.022 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2020-07-16T13:25:10.161 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2020-07-16T13:25:10.214 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2020-07-16T13:25:10.359 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2020-07-16T13:25:10.412 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2020-07-16T13:25:10.548 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2020-07-16T13:25:10.621 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2020-07-16T13:25:10.756 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2020-07-16T13:25:10.809 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2020-07-16T13:25:10.955 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2020-07-16T13:25:11.019 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2020-07-16T13:25:11.155 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2020-07-16T13:25:11.218 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2020-07-16T13:25:11.345 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2020-07-16T13:25:11.401 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:11 +0000 (0:00:08.611) 0:01:31.548 ********* 2020-07-16T13:25:11.423 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2020-07-16T13:25:11.474 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:11 +0000 (0:00:00.072) 0:01:31.621 ********* 2020-07-16T13:25:11.947 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2020-07-16T13:25:11.949 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => {"changed": true, "checksum": "c6bfe134f92d5cc325c43b188dcccb7cdd63c6be", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "dc3eeb033d49f5b6217dc6edc5bee607", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1594905911.4307137-33702094071726/source", "state": "file", "uid": 0} 2020-07-16T13:25:11.984 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:11 +0000 (0:00:00.510) 0:01:32.131 ********* 2020-07-16T13:25:12.018 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2020-07-16T13:25:12.020 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => { "msg": "Host smithi188.front.sepia.ceph.com is running RedHat 8.1 (Ootpa)" } 2020-07-16T13:25:12.058 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:12 +0000 (0:00:00.073) 0:01:32.205 ********* 2020-07-16T13:25:12.069 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2020-07-16T13:25:12.071 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"changed": true, "checksum": "c6bfe134f92d5cc325c43b188dcccb7cdd63c6be", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "dc3eeb033d49f5b6217dc6edc5bee607", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1594905911.5036786-267735315179678/source", "state": "file", "uid": 0} 2020-07-16T13:25:12.108 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:12 +0000 (0:00:00.049) 0:01:32.255 ********* 2020-07-16T13:25:12.122 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2020-07-16T13:25:12.124 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"], "rhsm_repos": ["rhel-8-for-x86_64-baseos-rpms", "rhel-8-for-x86_64-appstream-rpms"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml"} 2020-07-16T13:25:12.169 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:12 +0000 (0:00:00.061) 0:01:32.316 ********* 2020-07-16T13:25:12.180 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2020-07-16T13:25:12.182 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => { "msg": "Host smithi132.front.sepia.ceph.com is running RedHat 8.1 (Ootpa)" } 2020-07-16T13:25:12.221 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:12 +0000 (0:00:00.051) 0:01:32.368 ********* 2020-07-16T13:25:12.230 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2020-07-16T13:25:12.232 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:12.268 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:12 +0000 (0:00:00.047) 0:01:32.415 ********* 2020-07-16T13:25:12.276 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2020-07-16T13:25:12.278 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"], "rhsm_repos": ["rhel-8-for-x86_64-baseos-rpms", "rhel-8-for-x86_64-appstream-rpms"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml"} 2020-07-16T13:25:12.314 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:12 +0000 (0:00:00.045) 0:01:32.461 ********* 2020-07-16T13:25:12.348 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2020-07-16T13:25:12.349 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:12.386 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:12 +0000 (0:00:00.072) 0:01:32.533 ********* 2020-07-16T13:25:12.815 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2020-07-16T13:25:12.817 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.330830", "end": "2020-07-16 13:25:12.787029", "rc": 0, "start": "2020-07-16 13:25:12.456199", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-07-16T13:25:12.853 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:12 +0000 (0:00:00.467) 0:01:33.000 ********* 2020-07-16T13:25:12.885 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2020-07-16T13:25:12.887 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:12.923 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:12 +0000 (0:00:00.069) 0:01:33.070 ********* 2020-07-16T13:25:12.944 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2020-07-16T13:25:12.946 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.343680", "end": "2020-07-16 13:25:12.921495", "rc": 0, "start": "2020-07-16 13:25:12.577815", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-07-16T13:25:12.984 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:12 +0000 (0:00:00.060) 0:01:33.131 ********* 2020-07-16T13:25:13.000 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2020-07-16T13:25:13.002 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:13.044 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:13 +0000 (0:00:00.056) 0:01:33.188 ********* 2020-07-16T13:25:13.049 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2020-07-16T13:25:13.051 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:13.086 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:13 +0000 (0:00:00.045) 0:01:33.233 ********* 2020-07-16T13:25:13.095 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2020-07-16T13:25:13.097 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:13.132 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:13 +0000 (0:00:00.045) 0:01:33.279 ********* 2020-07-16T13:25:13.140 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2020-07-16T13:25:13.142 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:13.180 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:13 +0000 (0:00:00.048) 0:01:33.327 ********* 2020-07-16T13:25:13.194 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:13.228 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:13 +0000 (0:00:00.047) 0:01:33.375 ********* 2020-07-16T13:25:13.236 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2020-07-16T13:25:13.238 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:13.274 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:13 +0000 (0:00:00.046) 0:01:33.421 ********* 2020-07-16T13:25:13.283 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2020-07-16T13:25:13.285 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:13.322 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:13 +0000 (0:00:00.047) 0:01:33.469 ********* 2020-07-16T13:25:13.333 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2020-07-16T13:25:13.335 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:13.370 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:13 +0000 (0:00:00.047) 0:01:33.517 ********* 2020-07-16T13:25:13.381 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2020-07-16T13:25:13.382 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"ansible_facts": {"entitlements_path": "/etc/ansible/secrets/entitlements.yml"}, "changed": false} 2020-07-16T13:25:13.418 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:13 +0000 (0:00:00.047) 0:01:33.565 ********* 2020-07-16T13:25:13.428 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2020-07-16T13:25:13.430 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:13.466 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:13 +0000 (0:00:00.047) 0:01:33.613 ********* 2020-07-16T13:25:13.488 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2020-07-16T13:25:13.490 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ok: [smithi188.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-07-16T13:25:13.527 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:13 +0000 (0:00:00.061) 0:01:33.674 ********* 2020-07-16T13:25:13.537 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2020-07-16T13:25:13.538 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"ansible_facts": {"entitlements_path": "/etc/ansible/secrets/entitlements.yml"}, "changed": false} 2020-07-16T13:25:13.574 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:13 +0000 (0:00:00.047) 0:01:33.721 ********* 2020-07-16T13:25:13.583 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2020-07-16T13:25:13.585 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"ansible_facts": {"have_entitlements": true}, "changed": false} 2020-07-16T13:25:13.624 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:13 +0000 (0:00:00.050) 0:01:33.771 ********* 2020-07-16T13:25:13.632 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2020-07-16T13:25:13.634 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ok: [smithi132.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-07-16T13:25:13.670 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:13 +0000 (0:00:00.045) 0:01:33.817 ********* 2020-07-16T13:25:13.711 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2020-07-16T13:25:13.713 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"ansible_facts": {"have_entitlements": true}, "changed": false} 2020-07-16T13:25:13.747 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:13 +0000 (0:00:00.077) 0:01:33.894 ********* 2020-07-16T13:25:14.955 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed /root/.ansible/tmp/ansible-moduletmp-1594905914.8193765-pycbdrcf/katello-ca-consumer-latest.noarch5hykfpv5.rpm"]} 2020-07-16T13:25:14.990 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:14 +0000 (0:00:01.243) 0:01:35.137 ********* 2020-07-16T13:25:15.004 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed /root/.ansible/tmp/ansible-moduletmp-1594905914.8326097-0op340ji/katello-ca-consumer-latest.noarch5icw5n2x.rpm"]} 2020-07-16T13:25:15.072 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:15 +0000 (0:00:00.081) 0:01:35.219 ********* 2020-07-16T13:25:15.971 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2020-07-16T13:25:15.973 INFO:teuthology.task.ansible.out:fatal: [smithi132.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ...ignoring 2020-07-16T13:25:16.009 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:16 +0000 (0:00:00.936) 0:01:36.156 ********* 2020-07-16T13:25:16.057 INFO:teuthology.task.ansible.out:fatal: [smithi188.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ...ignoring 2020-07-16T13:25:16.059 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** ok: [smithi132.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": false}, "changed": false} 2020-07-16T13:25:16.093 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:16 +0000 (0:00:00.084) 0:01:36.240 ********* 2020-07-16T13:25:16.150 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:16 +0000 (0:00:00.055) 0:01:36.296 ********* 2020-07-16T13:25:16.218 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": false}, "changed": false} 2020-07-16T13:25:16.263 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:16 +0000 (0:00:00.114) 0:01:36.410 ********* 2020-07-16T13:25:24.525 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2020-07-16T13:25:24.527 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => {"attempts": 1, "censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-07-16T13:25:24.562 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:24 +0000 (0:00:08.298) 0:01:44.709 ********* 2020-07-16T13:25:24.606 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** ok: [smithi188.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": true}, "changed": false} 2020-07-16T13:25:24.648 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:24 +0000 (0:00:00.085) 0:01:44.794 ********* 2020-07-16T13:25:25.616 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2020-07-16T13:25:25.618 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager release --list | grep -E '[0-9]'", "delta": "0:00:00.740009", "end": "2020-07-16 13:25:25.581129", "failed_when_result": false, "rc": 0, "start": "2020-07-16 13:25:24.841120", "stderr": "", "stderr_lines": [], "stdout": "7.4\n7.5\n7.6\n7.7\n7.8\n7Server\n8\n8.0\n8.1\n8.2", "stdout_lines": ["7.4", "7.5", "7.6", "7.7", "7.8", "7Server", "8", "8.0", "8.1", "8.2"]} 2020-07-16T13:25:25.653 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:25 +0000 (0:00:01.005) 0:01:45.800 ********* 2020-07-16T13:25:25.693 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2020-07-16T13:25:25.698 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:25.743 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:25 +0000 (0:00:00.090) 0:01:45.890 ********* 2020-07-16T13:25:25.783 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2020-07-16T13:25:25.785 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:25.820 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:25 +0000 (0:00:00.077) 0:01:45.967 ********* 2020-07-16T13:25:25.853 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2020-07-16T13:25:25.855 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-07-16T13:25:25.890 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:25 +0000 (0:00:00.069) 0:01:46.037 ********* 2020-07-16T13:25:25.931 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-07-16T13:25:25.932 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:25.971 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:25 +0000 (0:00:00.080) 0:01:46.117 ********* 2020-07-16T13:25:26.030 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2020-07-16T13:25:26.032 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"attempts": 1, "censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-07-16T13:25:26.070 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:26 +0000 (0:00:00.099) 0:01:46.217 ********* 2020-07-16T13:25:26.116 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2020-07-16T13:25:26.118 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": true}, "changed": false} 2020-07-16T13:25:26.157 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:26 +0000 (0:00:00.086) 0:01:46.304 ********* 2020-07-16T13:25:27.045 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2020-07-16T13:25:27.047 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager release --list | grep -E '[0-9]'", "delta": "0:00:00.664943", "end": "2020-07-16 13:25:27.018769", "failed_when_result": false, "rc": 0, "start": "2020-07-16 13:25:26.353826", "stderr": "", "stderr_lines": [], "stdout": "7.4\n7.5\n7.6\n7.7\n7.8\n7Server\n8\n8.0\n8.1\n8.2", "stdout_lines": ["7.4", "7.5", "7.6", "7.7", "7.8", "7Server", "8", "8.0", "8.1", "8.2"]} 2020-07-16T13:25:27.089 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:27 +0000 (0:00:00.931) 0:01:47.236 ********* 2020-07-16T13:25:27.120 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:27.172 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:27 +0000 (0:00:00.083) 0:01:47.319 ********* 2020-07-16T13:25:27.223 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2020-07-16T13:25:27.225 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:27.260 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:27 +0000 (0:00:00.087) 0:01:47.407 ********* 2020-07-16T13:25:27.292 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* skipping: [smithi132.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-07-16T13:25:27.333 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:27 +0000 (0:00:00.072) 0:01:47.480 ********* 2020-07-16T13:25:27.384 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-07-16T13:25:27.386 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:27.422 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:27 +0000 (0:00:00.089) 0:01:47.569 ********* 2020-07-16T13:25:36.966 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2020-07-16T13:25:36.968 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager repos --list | grep -B4 'Enabled:.*1' | grep 'Repo ID:' | sed -e 's/Repo ID:\\s*\\(.*\\)/\\1/' | sort", "delta": "0:00:10.763959", "end": "2020-07-16 13:25:36.935814", "rc": 0, "start": "2020-07-16 13:25:26.171855", "stderr": "", "stderr_lines": [], "stdout": "rhel-8-for-x86_64-appstream-rpms\nrhel-8-for-x86_64-baseos-rpms", "stdout_lines": ["rhel-8-for-x86_64-appstream-rpms", "rhel-8-for-x86_64-baseos-rpms"]} 2020-07-16T13:25:37.015 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:37 +0000 (0:00:09.592) 0:01:57.162 ********* 2020-07-16T13:25:37.070 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ ok: [smithi188.front.sepia.ceph.com] => {"ansible_facts": {"repo_list": ["rhel-8-for-x86_64-appstream-rpms", "rhel-8-for-x86_64-baseos-rpms"]}, "changed": false} 2020-07-16T13:25:37.073 INFO:teuthology.task.ansible.out: 2020-07-16T13:25:37.113 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:37 +0000 (0:00:00.097) 0:01:57.259 ********* 2020-07-16T13:25:37.156 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2020-07-16T13:25:37.158 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:37.194 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:37 +0000 (0:00:00.081) 0:01:57.341 ********* 2020-07-16T13:25:37.267 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2020-07-16T13:25:37.269 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": false}, "changed": false} 2020-07-16T13:25:37.305 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:37 +0000 (0:00:00.107) 0:01:57.448 ********* 2020-07-16T13:25:37.357 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2020-07-16T13:25:37.359 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": true}, "changed": false} 2020-07-16T13:25:37.402 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:37 +0000 (0:00:00.100) 0:01:57.549 ********* 2020-07-16T13:25:38.524 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2020-07-16T13:25:38.525 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager repos --list | grep -B4 'Enabled:.*1' | grep 'Repo ID:' | sed -e 's/Repo ID:\\s*\\(.*\\)/\\1/' | sort", "delta": "0:00:10.874864", "end": "2020-07-16 13:25:38.495014", "rc": 0, "start": "2020-07-16 13:25:27.620150", "stderr": "", "stderr_lines": [], "stdout": "rhel-8-for-x86_64-appstream-rpms\nrhel-8-for-x86_64-baseos-rpms", "stdout_lines": ["rhel-8-for-x86_64-appstream-rpms", "rhel-8-for-x86_64-baseos-rpms"]} 2020-07-16T13:25:38.570 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:38 +0000 (0:00:01.159) 0:01:58.708 ********* 2020-07-16T13:25:38.608 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2020-07-16T13:25:38.610 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"ansible_facts": {"repo_list": ["rhel-8-for-x86_64-appstream-rpms", "rhel-8-for-x86_64-baseos-rpms"]}, "changed": false} 2020-07-16T13:25:38.663 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:38 +0000 (0:00:00.101) 0:01:58.810 ********* 2020-07-16T13:25:38.705 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2020-07-16T13:25:38.707 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:38.741 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:38 +0000 (0:00:00.077) 0:01:58.888 ********* 2020-07-16T13:25:38.781 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2020-07-16T13:25:38.783 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": false}, "changed": false} 2020-07-16T13:25:38.818 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:38 +0000 (0:00:00.076) 0:01:58.965 ********* 2020-07-16T13:25:38.868 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2020-07-16T13:25:38.870 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": true}, "changed": false} 2020-07-16T13:25:38.907 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:38 +0000 (0:00:00.089) 0:01:59.054 ********* 2020-07-16T13:25:43.354 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** changed: [smithi188.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-07-16T13:25:43.391 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:43 +0000 (0:00:04.484) 0:02:03.538 ********* 2020-07-16T13:25:44.948 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-07-16T13:25:44.993 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:44 +0000 (0:00:01.600) 0:02:05.138 ********* 2020-07-16T13:25:48.401 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2020-07-16T13:25:48.403 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => {"changed": true, "cmd": ["subscription-manager", "repos", "--enable=rhel-8-for-x86_64-baseos-rpms", "--enable=rhel-8-for-x86_64-appstream-rpms"], "delta": "0:00:04.794638", "end": "2020-07-16 13:25:48.372280", "rc": 0, "start": "2020-07-16 13:25:43.577642", "stderr": "", "stderr_lines": [], "stdout": "Internal Server Error): Required lock is already taken by other running tasks.\nPlease inspect their state, fix their errors and resume them.\n\nRequired lock: update\nConflicts with tasks:\n https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/5220e6c7 2778 4d87 8097 b4a159f444a8\n\nRepository 'rhel-8-for-x86_64-baseos-rpms' is enabled for this system.\nRepository 'rhel-8-for-x86_64-appstream-rpms' is enabled for this system.", "stdout_lines": ["Internal Server Error): Required lock is already taken by other running tasks.", "Please inspect their state, fix their errors and resume them.", "", "Required lock: update", "Conflicts with tasks:", " https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/5220e6c7 2778 4d87 8097 b4a159f444a8", "", "Repository 'rhel-8-for-x86_64-baseos-rpms' is enabled for this system.", "Repository 'rhel-8-for-x86_64-appstream-rpms' is enabled for this system."]} 2020-07-16T13:25:48.448 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:48 +0000 (0:00:03.456) 0:02:08.595 ********* 2020-07-16T13:25:49.031 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2020-07-16T13:25:49.033 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "path": "/etc/yum.repos.d/cd.repo", "state": "absent"} 2020-07-16T13:25:49.067 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:49 +0000 (0:00:00.618) 0:02:09.213 ********* 2020-07-16T13:25:49.273 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2020-07-16T13:25:49.275 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-07-16T13:25:49.308 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:49 +0000 (0:00:00.241) 0:02:09.455 ********* 2020-07-16T13:25:49.876 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-07-16T13:25:49.878 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2020-07-16T13:25:50.260 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2020-07-16T13:25:50.266 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"changed": true, "cmd": ["subscription-manager", "repos", "--enable=rhel-8-for-x86_64-baseos-rpms", "--enable=rhel-8-for-x86_64-appstream-rpms"], "delta": "0:00:05.034449", "end": "2020-07-16 13:25:50.232577", "rc": 0, "start": "2020-07-16 13:25:45.198128", "stderr": "", "stderr_lines": [], "stdout": "Internal Server Error): Required lock is already taken by other running tasks.\nPlease inspect their state, fix their errors and resume them.\n\nRequired lock: update\nConflicts with tasks:\n https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/5f57c495 7510 4c21 a040 687c39130365\n\nRepository 'rhel-8-for-x86_64-baseos-rpms' is enabled for this system.\nRepository 'rhel-8-for-x86_64-appstream-rpms' is enabled for this system.", "stdout_lines": ["Internal Server Error): Required lock is already taken by other running tasks.", "Please inspect their state, fix their errors and resume them.", "", "Required lock: update", "Conflicts with tasks:", " https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/5f57c495 7510 4c21 a040 687c39130365", "", "Repository 'rhel-8-for-x86_64-baseos-rpms' is enabled for this system.", "Repository 'rhel-8-for-x86_64-appstream-rpms' is enabled for this system."]} 2020-07-16T13:25:50.303 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:50 +0000 (0:00:00.994) 0:02:10.450 ********* 2020-07-16T13:25:50.355 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-07-16T13:25:50.356 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2020-07-16T13:25:50.394 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:50 +0000 (0:00:00.091) 0:02:10.541 ********* 2020-07-16T13:25:50.539 INFO:teuthology.task.ansible.out: 2020-07-16T13:25:50.541 INFO:teuthology.task.ansible.out:TASK [common : Remove old apt-mirror repository definition.] ******************* ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "path": "/etc/yum.repos.d/cd.repo", "state": "absent"} 2020-07-16T13:25:50.579 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:50 +0000 (0:00:00.185) 0:02:10.726 ********* 2020-07-16T13:25:50.799 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2020-07-16T13:25:50.801 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-07-16T13:25:50.843 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:50 +0000 (0:00:00.263) 0:02:10.990 ********* 2020-07-16T13:25:50.934 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-07-16T13:25:50.936 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2020-07-16T13:25:51.356 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-07-16T13:25:51.360 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2020-07-16T13:25:51.410 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-07-16T13:25:51.412 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2020-07-16T13:25:51.462 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:51 +0000 (0:00:00.616) 0:02:11.606 ********* 2020-07-16T13:25:51.506 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-07-16T13:25:51.513 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:51.556 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:51 +0000 (0:00:00.096) 0:02:11.703 ********* 2020-07-16T13:25:51.587 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-07-16T13:25:51.589 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:51.626 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:51 +0000 (0:00:00.069) 0:02:11.772 ********* 2020-07-16T13:25:51.665 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2020-07-16T13:25:51.667 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:51.703 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:51 +0000 (0:00:00.077) 0:02:11.850 ********* 2020-07-16T13:25:51.735 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2020-07-16T13:25:51.738 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:51.771 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:51 +0000 (0:00:00.067) 0:02:11.918 ********* 2020-07-16T13:25:51.812 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-07-16T13:25:51.814 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:51.856 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:51 +0000 (0:00:00.085) 0:02:12.003 ********* 2020-07-16T13:25:51.866 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-07-16T13:25:51.875 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2020-07-16T13:25:51.912 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:51 +0000 (0:00:00.055) 0:02:12.059 ********* 2020-07-16T13:25:51.923 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2020-07-16T13:25:51.925 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:51.968 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:51 +0000 (0:00:00.055) 0:02:12.115 ********* 2020-07-16T13:25:52.019 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-07-16T13:25:52.021 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:52.057 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:52 +0000 (0:00:00.089) 0:02:12.204 ********* 2020-07-16T13:25:52.098 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:52.136 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:52 +0000 (0:00:00.079) 0:02:12.283 ********* 2020-07-16T13:25:52.168 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2020-07-16T13:25:52.169 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:52.208 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:52 +0000 (0:00:00.071) 0:02:12.355 ********* 2020-07-16T13:25:52.455 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-07-16T13:25:52.458 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2020-07-16T13:25:53.002 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2020-07-16T13:25:53.049 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:53 +0000 (0:00:00.841) 0:02:13.196 ********* 2020-07-16T13:25:53.084 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-07-16T13:25:53.086 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:53.118 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:53 +0000 (0:00:00.069) 0:02:13.265 ********* 2020-07-16T13:25:53.159 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-07-16T13:25:53.160 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:53.193 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:53 +0000 (0:00:00.075) 0:02:13.340 ********* 2020-07-16T13:25:53.228 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2020-07-16T13:25:53.230 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:53.263 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:53 +0000 (0:00:00.069) 0:02:13.410 ********* 2020-07-16T13:25:53.304 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2020-07-16T13:25:53.306 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:53.346 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:53 +0000 (0:00:00.078) 0:02:13.489 ********* 2020-07-16T13:25:53.390 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:53.443 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:53 +0000 (0:00:00.101) 0:02:13.590 ********* 2020-07-16T13:25:53.482 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:53.536 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:53 +0000 (0:00:00.092) 0:02:13.683 ********* 2020-07-16T13:25:53.546 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2020-07-16T13:25:53.548 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:01.102238", "end": "2020-07-16 13:25:53.501433", "rc": 0, "start": "2020-07-16 13:25:52.399195", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T13:25:53.604 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:53 +0000 (0:00:00.067) 0:02:13.751 ********* 2020-07-16T13:25:53.615 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:53.656 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:53 +0000 (0:00:00.052) 0:02:13.803 ********* 2020-07-16T13:25:53.689 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2020-07-16T13:25:53.691 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:53.736 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:53 +0000 (0:00:00.074) 0:02:13.877 ********* 2020-07-16T13:25:53.786 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:53.830 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:53 +0000 (0:00:00.099) 0:02:13.977 ********* 2020-07-16T13:25:54.521 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2020-07-16T13:25:54.523 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.483077", "end": "2020-07-16 13:25:54.500331", "rc": 0, "start": "2020-07-16 13:25:54.017254", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T13:25:54.574 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:54 +0000 (0:00:00.743) 0:02:14.721 ********* 2020-07-16T13:25:56.113 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2020-07-16T13:25:56.115 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: krb5-workstation"]} 2020-07-16T13:25:56.154 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:56 +0000 (0:00:01.580) 0:02:16.301 ********* 2020-07-16T13:25:56.182 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:56.219 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:56 +0000 (0:00:00.064) 0:02:16.366 ********* 2020-07-16T13:25:56.258 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:56.295 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:56 +0000 (0:00:00.075) 0:02:16.442 ********* 2020-07-16T13:25:56.327 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2020-07-16T13:25:56.329 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:56.368 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:56 +0000 (0:00:00.072) 0:02:16.515 ********* 2020-07-16T13:25:56.412 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-07-16T13:25:56.413 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:56.458 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:56 +0000 (0:00:00.090) 0:02:16.605 ********* 2020-07-16T13:25:56.959 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2020-07-16T13:25:56.961 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2020-07-16T13:25:57.010 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:57 +0000 (0:00:00.551) 0:02:17.157 ********* 2020-07-16T13:25:57.064 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2020-07-16T13:25:57.066 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: krb5-workstation"]} 2020-07-16T13:25:57.110 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:57 +0000 (0:00:00.100) 0:02:17.257 ********* 2020-07-16T13:25:57.141 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2020-07-16T13:25:57.143 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:57.190 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:57 +0000 (0:00:00.080) 0:02:17.337 ********* 2020-07-16T13:25:57.226 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:57.257 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:57 +0000 (0:00:00.067) 0:02:17.404 ********* 2020-07-16T13:25:57.288 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2020-07-16T13:25:57.290 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:57.324 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:57 +0000 (0:00:00.067) 0:02:17.471 ********* 2020-07-16T13:25:57.367 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-07-16T13:25:57.369 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:25:57.403 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:57 +0000 (0:00:00.078) 0:02:17.550 ********* 2020-07-16T13:25:57.906 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2020-07-16T13:25:57.908 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2020-07-16T13:25:57.946 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:57 +0000 (0:00:00.542) 0:02:18.093 ********* 2020-07-16T13:25:59.353 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2020-07-16T13:25:59.355 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: smartmontools"]} 2020-07-16T13:25:59.398 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:25:59 +0000 (0:00:01.451) 0:02:19.544 ********* 2020-07-16T13:25:59.949 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-07-16T13:25:59.952 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2020-07-16T13:26:00.163 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2020-07-16T13:26:00.165 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: smartmontools"]} 2020-07-16T13:26:00.209 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:26:00 +0000 (0:00:00.811) 0:02:20.356 ********* 2020-07-16T13:26:00.454 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [smithi188.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2020-07-16T13:26:00.801 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2020-07-16T13:26:00.956 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2020-07-16T13:26:01.004 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:26:00 +0000 (0:00:00.794) 0:02:21.151 ********* 2020-07-16T13:26:01.207 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2020-07-16T13:26:01.209 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-07-16T13:26:01.244 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:26:01 +0000 (0:00:00.240) 0:02:21.391 ********* 2020-07-16T13:26:01.290 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [smithi132.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2020-07-16T13:26:01.765 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi188.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2020-07-16T13:26:01.797 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-07-16T13:26:01.815 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2020-07-16T13:26:01.860 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:26:01 +0000 (0:00:00.615) 0:02:22.006 ********* 2020-07-16T13:26:02.072 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2020-07-16T13:26:02.074 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-07-16T13:26:02.112 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:26:02 +0000 (0:00:00.252) 0:02:22.259 ********* 2020-07-16T13:26:02.240 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-07-16T13:26:02.242 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2020-07-16T13:26:02.609 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2020-07-16T13:26:02.707 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2020-07-16T13:26:02.779 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:26:02 +0000 (0:00:00.666) 0:02:22.926 ********* 2020-07-16T13:26:02.820 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-07-16T13:26:02.822 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:26:02.863 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:26:02 +0000 (0:00:00.084) 0:02:23.010 ********* 2020-07-16T13:26:02.908 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-07-16T13:26:02.910 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2020-07-16T13:26:02.943 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:26:02 +0000 (0:00:00.079) 0:02:23.090 ********* 2020-07-16T13:26:03.096 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-07-16T13:26:03.097 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2020-07-16T13:26:03.178 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* changed: [smithi188.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-07-16T13:26:03.222 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:26:03 +0000 (0:00:00.278) 0:02:23.368 ********* 2020-07-16T13:26:03.261 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-07-16T13:26:03.263 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-07-16T13:26:03.273 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-07-16T13:26:03.284 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-07-16T13:26:03.295 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-07-16T13:26:03.341 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:26:03 +0000 (0:00:00.119) 0:02:23.488 ********* 2020-07-16T13:26:03.625 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-07-16T13:26:03.627 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2020-07-16T13:26:03.670 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:26:03 +0000 (0:00:00.328) 0:02:23.817 ********* 2020-07-16T13:26:03.701 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-07-16T13:26:03.703 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:26:03.748 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:26:03 +0000 (0:00:00.078) 0:02:23.895 ********* 2020-07-16T13:26:03.790 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-07-16T13:26:03.791 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2020-07-16T13:26:03.836 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:26:03 +0000 (0:00:00.087) 0:02:23.982 ********* 2020-07-16T13:26:04.051 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2020-07-16T13:26:04.053 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-07-16T13:26:04.087 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:26:04 +0000 (0:00:00.251) 0:02:24.234 ********* 2020-07-16T13:26:04.138 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-07-16T13:26:04.140 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-07-16T13:26:04.161 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-07-16T13:26:04.163 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-07-16T13:26:04.201 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:26:04 +0000 (0:00:00.113) 0:02:24.347 ********* 2020-07-16T13:26:11.367 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-07-16T13:26:11.369 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load", "Installed: nagios-plugins-load-2.3.3-4.el8.x86_64", "Installed: nrpe-4.0.3-1.el8.x86_64", "Installed: nagios-plugins-2.3.3-4.el8.x86_64", "Removed: nrpe-4.0.2-2.el8.x86_64", "Removed: nagios-plugins-2.3.3-1.el8.x86_64", "Removed: nagios-plugins-load-2.3.3-1.el8.x86_64"]} 2020-07-16T13:26:11.412 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:26:11 +0000 (0:00:07.210) 0:02:31.558 ********* 2020-07-16T13:26:11.464 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2020-07-16T13:26:11.466 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:26:11.502 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:26:11 +0000 (0:00:00.090) 0:02:31.649 ********* 2020-07-16T13:26:12.040 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2020-07-16T13:26:12.042 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2020-07-16T13:26:12.088 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:26:12 +0000 (0:00:00.585) 0:02:32.235 ********* 2020-07-16T13:26:12.152 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-07-16T13:26:12.154 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load", "Installed: nagios-plugins-load-2.3.3-4.el8.x86_64", "Installed: nrpe-4.0.3-1.el8.x86_64", "Installed: nagios-plugins-2.3.3-4.el8.x86_64", "Removed: nrpe-4.0.2-2.el8.x86_64", "Removed: nagios-plugins-2.3.3-1.el8.x86_64", "Removed: nagios-plugins-load-2.3.3-1.el8.x86_64"]} 2020-07-16T13:26:12.196 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:26:12 +0000 (0:00:00.107) 0:02:32.343 ********* 2020-07-16T13:26:12.230 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2020-07-16T13:26:12.232 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:26:12.274 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:26:12 +0000 (0:00:00.076) 0:02:32.419 ********* 2020-07-16T13:26:12.595 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-07-16T13:26:12.597 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2020-07-16T13:26:12.636 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:26:12 +0000 (0:00:00.364) 0:02:32.783 ********* 2020-07-16T13:26:12.679 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-07-16T13:26:12.682 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} 2020-07-16T13:26:12.684 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2020-07-16T13:26:12.719 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:26:12 +0000 (0:00:00.082) 0:02:32.866 ********* 2020-07-16T13:26:12.775 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2020-07-16T13:26:12.777 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2020-07-16T13:26:12.816 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:26:12 +0000 (0:00:00.096) 0:02:32.963 ********* 2020-07-16T13:26:12.931 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-07-16T13:26:12.933 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-07-16T13:26:12.977 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:26:12 +0000 (0:00:00.160) 0:02:33.124 ********* 2020-07-16T13:26:13.246 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** fatal: [smithi188.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2020-07-16T13:26:13.294 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:26:13 +0000 (0:00:00.316) 0:02:33.440 ********* 2020-07-16T13:26:13.335 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-07-16T13:26:13.337 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:26:13.339 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-07-16T13:26:13.340 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2020-07-16T13:26:13.381 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:26:13 +0000 (0:00:00.087) 0:02:33.528 ********* 2020-07-16T13:26:13.428 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:26:13 +0000 (0:00:00.046) 0:02:33.575 ********* 2020-07-16T13:26:13.437 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-07-16T13:26:13.442 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} 2020-07-16T13:26:13.449 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2020-07-16T13:26:13.496 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:26:13 +0000 (0:00:00.068) 0:02:33.643 ********* 2020-07-16T13:26:13.702 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-07-16T13:26:13.709 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-07-16T13:26:13.774 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:26:13 +0000 (0:00:00.277) 0:02:33.921 ********* 2020-07-16T13:26:14.045 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2020-07-16T13:26:14.047 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => {"changed": true, "checksum": "aa9150d4582f919d7a8504c01c8d86f05e3eeb5d", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "md5sum": "28732085640fd0d909d798c6d3e4021a", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1184, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1594905973.4589314-150638034536169/source", "state": "file", "uid": 0} TASK [common : Check firewalld status] ***************************************** fatal: [smithi132.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2020-07-16T13:26:14.084 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:26:14 +0000 (0:00:00.309) 0:02:34.231 ********* 2020-07-16T13:26:14.132 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:26:14 +0000 (0:00:00.047) 0:02:34.278 ********* 2020-07-16T13:26:14.141 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-07-16T13:26:14.142 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:26:14.193 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:26:14 +0000 (0:00:00.061) 0:02:34.340 ********* 2020-07-16T13:26:14.804 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2020-07-16T13:26:14.806 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"changed": true, "checksum": "aa9150d4582f919d7a8504c01c8d86f05e3eeb5d", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "md5sum": "28732085640fd0d909d798c6d3e4021a", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1184, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1594905974.2199004-192793189309393/source", "state": "file", "uid": 0} 2020-07-16T13:26:14.860 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:26:14 +0000 (0:00:00.666) 0:02:35.007 ********* 2020-07-16T13:26:15.008 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-07-16T13:26:15.010 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2020-07-16 13:26:07 UTC", "ActiveEnterTimestampMonotonic": "224710172", "ActiveExitTimestamp": "Thu 2020-07-16 13:26:07 UTC", "ActiveExitTimestampMonotonic": "224685242", "ActiveState": "active", "After": "local-fs.target time-sync.target systemd-journald.socket basic.target tmp.mount network.target nss-lookup.target system.slice systemd-tmpfiles-setup.service -.mount var-run.mount sysinit.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2020-07-16 13:26:07 UTC", "AssertTimestampMonotonic": "224709045", "Before": "xdm.service multi-user.target getty@tty1.service plymouth-quit.service shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2020-07-16 13:26:07 UTC", "ConditionTimestampMonotonic": "224709044", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "C 2020-07-16T13:26:15.011 INFO:teuthology.task.ansible.out:ontrolGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "16640", "ExecMainStartTimestamp": "Thu 2020-07-16 13:26:07 UTC", "ExecMainStartTimestampMonotonic": "224710131", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "GID": "986", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Thu 2020-07-16 13:26:07 UTC", "InactiveEnterTimestampMonotonic": "224708395", "InactiveExitTimestamp": "Thu 2020-07-16 13:26:07 UTC", "InactiveExitTimestampMonotonic": "224710172", "InvocationID": "e8e83ba2134a4729890f6ebf6a6f30cd", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "Limi 2020-07-16T13:26:15.013 INFO:teuthology.task.ansible.out:tCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127425", "LimitNPROCSoft": "127425", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127425", "LimitSIGPENDINGSoft": "127425", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "16640", "MemoryAccounting": "yes", "MemoryCurrent": "901120", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/var/tmp /run/nrpe", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": " 2020-07-16T13:26:15.015 INFO:teuthology.task.ansible.out:no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "nrpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2020-07-16 13:26:07 UTC", "StateChangeTimestampMonotonic": "224710172", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "990", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2020-07-16 13:26:07 UTC", "WatchdogTimestampMonotonic": "224710171", "WatchdogUSec": "0"}} 2020-07-16T13:26:15.053 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:26:15 +0000 (0:00:00.192) 0:02:35.200 ********* 2020-07-16T13:26:15.210 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2020-07-16 13:26:08 UTC", "ActiveEnterTimestampMonotonic": "226245866", "ActiveExitTimestamp": "Thu 2020-07-16 13:26:08 UTC", "ActiveExitTimestampMonotonic": "226220232", "ActiveState": "active", "After": "-.mount sysinit.target nss-lookup.target systemd-tmpfiles-setup.service local-fs.target tmp.mount systemd-journald.socket basic.target var-run.mount network.target time-sync.target system.slice", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2020-07-16 13:26:08 UTC", "AssertTimestampMonotonic": "226245129", "Before": "multi-user.target getty@tty1.service plymouth-quit.service shutdown.target xdm.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2020-07-16 13:26:08 UTC", "ConditionTimestampMonotonic": "226245128", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "C 2020-07-16T13:26:15.211 INFO:teuthology.task.ansible.out:ontrolGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "16638", "ExecMainStartTimestamp": "Thu 2020-07-16 13:26:08 UTC", "ExecMainStartTimestampMonotonic": "226245842", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "GID": "986", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Thu 2020-07-16 13:26:08 UTC", "InactiveEnterTimestampMonotonic": "226244395", "InactiveExitTimestamp": "Thu 2020-07-16 13:26:08 UTC", "InactiveExitTimestampMonotonic": "226245866", "InvocationID": "74cc83c020d540a6a67bad0945238aa7", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "Limi 2020-07-16T13:26:15.213 INFO:teuthology.task.ansible.out:tCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127425", "LimitNPROCSoft": "127425", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127425", "LimitSIGPENDINGSoft": "127425", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "16638", "MemoryAccounting": "yes", "MemoryCurrent": "892928", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/run/nrpe /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": " 2020-07-16T13:26:15.215 INFO:teuthology.task.ansible.out:no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "nrpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2020-07-16 13:26:08 UTC", "StateChangeTimestampMonotonic": "226245866", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "990", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2020-07-16 13:26:08 UTC", "WatchdogTimestampMonotonic": "226245865", "WatchdogUSec": "0"}} 2020-07-16T13:26:15.284 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:26:15 +0000 (0:00:00.231) 0:02:35.431 ********* 2020-07-16T13:26:15.296 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2020-07-16T13:26:15.297 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001752", "end": "2020-07-16 13:26:15.235922", "rc": 0, "start": "2020-07-16 13:26:15.234170", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2020-07-16T13:26:15.336 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:26:15 +0000 (0:00:00.051) 0:02:35.483 ********* 2020-07-16T13:26:15.507 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001749", "end": "2020-07-16 13:26:15.478686", "rc": 0, "start": "2020-07-16 13:26:15.476937", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2020-07-16T13:26:15.574 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:26:15 +0000 (0:00:00.231) 0:02:35.715 ********* 2020-07-16T13:26:17.591 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2020-07-16T13:26:17.593 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils"]} 2020-07-16T13:26:17.638 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:26:17 +0000 (0:00:02.070) 0:02:37.785 ********* 2020-07-16T13:26:17.782 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils"]} 2020-07-16T13:26:17.831 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:26:17 +0000 (0:00:00.192) 0:02:37.978 ********* 2020-07-16T13:26:59.141 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2020-07-16T13:26:59.144 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: selinux-policy-targeted", "Installed: selinux-policy-targeted-3.14.3-41.el8_2.4.noarch", "Installed: selinux-policy-3.14.3-41.el8_2.4.noarch", "Removed: selinux-policy-3.14.3-41.el8_2.2.noarch", "Removed: selinux-policy-targeted-3.14.3-41.el8_2.2.noarch"]} 2020-07-16T13:26:59.185 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:26:59 +0000 (0:00:41.353) 0:03:19.332 ********* 2020-07-16T13:26:59.197 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: selinux-policy-targeted", "Installed: selinux-policy-3.14.3-41.el8_2.4.noarch", "Installed: selinux-policy-targeted-3.14.3-41.el8_2.4.noarch", "Removed: selinux-policy-3.14.3-41.el8_2.2.noarch", "Removed: selinux-policy-targeted-3.14.3-41.el8_2.2.noarch"]} 2020-07-16T13:26:59.238 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:26:59 +0000 (0:00:00.052) 0:03:19.384 ********* 2020-07-16T13:27:00.025 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2020-07-16T13:27:00.027 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2020-07-16T13:27:00.064 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:00 +0000 (0:00:00.826) 0:03:20.211 ********* 2020-07-16T13:27:00.074 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2020-07-16T13:27:00.113 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:00 +0000 (0:00:00.048) 0:03:20.260 ********* 2020-07-16T13:27:16.503 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** changed: [smithi132.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:16.158554", "end": "2020-07-16 13:27:16.468388", "failed_when_result": false, "rc": 0, "start": "2020-07-16 13:27:00.309834", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2020-07-16T13:27:16.539 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:16 +0000 (0:00:16.425) 0:03:36.686 ********* 2020-07-16T13:27:16.551 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:16.231370", "end": "2020-07-16 13:27:16.484048", "failed_when_result": false, "rc": 0, "start": "2020-07-16 13:27:00.252678", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2020-07-16T13:27:16.590 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:16 +0000 (0:00:00.050) 0:03:36.737 ********* 2020-07-16T13:27:17.061 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2020-07-16T13:27:17.063 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2020-07-16T13:27:17.111 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:17 +0000 (0:00:00.521) 0:03:37.258 ********* 2020-07-16T13:27:17.125 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2020-07-16T13:27:17.167 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:17 +0000 (0:00:00.055) 0:03:37.314 ********* 2020-07-16T13:27:17.332 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-07-16T13:27:17.334 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.018368", "end": "2020-07-16 13:27:17.309894", "rc": 0, "start": "2020-07-16 13:27:17.291526", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T13:27:17.368 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:17 +0000 (0:00:00.200) 0:03:37.515 ********* 2020-07-16T13:27:17.410 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.027602", "end": "2020-07-16 13:27:17.385708", "rc": 0, "start": "2020-07-16 13:27:17.358106", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T13:27:17.447 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:17 +0000 (0:00:00.078) 0:03:37.594 ********* 2020-07-16T13:27:17.584 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2020-07-16T13:27:17.585 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.007098", "end": "2020-07-16 13:27:17.562108", "rc": 0, "start": "2020-07-16 13:27:17.555010", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T13:27:17.622 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:17 +0000 (0:00:00.174) 0:03:37.769 ********* 2020-07-16T13:27:17.624 INFO:teuthology.task.ansible.out: 2020-07-16T13:27:17.673 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.019355", "end": "2020-07-16 13:27:17.651512", "rc": 0, "start": "2020-07-16 13:27:17.632157", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T13:27:17.711 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:17 +0000 (0:00:00.089) 0:03:37.858 ********* 2020-07-16T13:27:34.080 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2020-07-16T13:27:34.082 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:16.235010", "end": "2020-07-16 13:27:34.051058", "rc": 0, "start": "2020-07-16 13:27:17.816048", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T13:27:34.115 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:34 +0000 (0:00:16.404) 0:03:54.262 ********* 2020-07-16T13:27:34.340 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2020-07-16T13:27:34.342 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2020-07-16T13:27:34.376 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:34 +0000 (0:00:00.260) 0:03:54.523 ********* 2020-07-16T13:27:34.386 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2020-07-16T13:27:34.387 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:16.444428", "end": "2020-07-16 13:27:34.339398", "rc": 0, "start": "2020-07-16 13:27:17.894970", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T13:27:34.423 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:34 +0000 (0:00:00.047) 0:03:54.570 ********* 2020-07-16T13:27:34.434 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-07-16T13:27:34.436 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2020-07-16T13:27:34.473 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:34 +0000 (0:00:00.049) 0:03:54.620 ********* 2020-07-16T13:27:34.515 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-07-16T13:27:34.517 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-07-16T13:27:34.553 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:34 +0000 (0:00:00.079) 0:03:54.700 ********* 2020-07-16T13:27:34.606 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-07-16T13:27:34.607 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "epel_packages": ["dbench"], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["dnf-utils", "git-all", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "podman", "podman-docker", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "autoconf", "gdb", "iozone"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml"} 2020-07-16T13:27:34.651 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:34 +0000 (0:00:00.098) 0:03:54.798 ********* 2020-07-16T13:27:34.662 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2020-07-16T13:27:34.664 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2020-07-16T13:27:34.701 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:34 +0000 (0:00:00.050) 0:03:54.848 ********* 2020-07-16T13:27:34.712 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-07-16T13:27:34.714 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-07-16T13:27:34.755 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:34 +0000 (0:00:00.052) 0:03:54.901 ********* 2020-07-16T13:27:34.766 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-07-16T13:27:34.767 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2020-07-16T13:27:34.804 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:34 +0000 (0:00:00.049) 0:03:54.951 ********* 2020-07-16T13:27:34.856 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-07-16T13:27:34.858 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-07-16T13:27:34.891 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:34 +0000 (0:00:00.087) 0:03:55.038 ********* 2020-07-16T13:27:34.954 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-07-16T13:27:34.956 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "epel_packages": ["dbench"], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["dnf-utils", "git-all", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "podman", "podman-docker", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "autoconf", "gdb", "iozone"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml"} 2020-07-16T13:27:34.990 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:34 +0000 (0:00:00.098) 0:03:55.137 ********* 2020-07-16T13:27:35.000 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2020-07-16T13:27:35.002 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-07-16T13:27:35.040 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:35 +0000 (0:00:00.049) 0:03:55.186 ********* 2020-07-16T13:27:35.049 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ ok: [smithi188.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-07-16T13:27:35.088 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:35 +0000 (0:00:00.049) 0:03:55.235 ********* 2020-07-16T13:27:35.243 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-07-16T13:27:35.245 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "name": "ubuntu", "state": "present", "system": false} 2020-07-16T13:27:35.282 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:35 +0000 (0:00:00.192) 0:03:55.428 ********* 2020-07-16T13:27:35.303 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2020-07-16T13:27:35.304 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-07-16T13:27:35.346 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:35 +0000 (0:00:00.059) 0:03:55.488 ********* 2020-07-16T13:27:35.352 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:27:35.392 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:35 +0000 (0:00:00.051) 0:03:55.539 ********* 2020-07-16T13:27:35.434 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2020-07-16T13:27:35.436 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:27:35.471 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:35 +0000 (0:00:00.078) 0:03:55.618 ********* 2020-07-16T13:27:35.545 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-07-16T13:27:35.547 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "name": "ubuntu", "state": "present", "system": false} 2020-07-16T13:27:35.587 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:35 +0000 (0:00:00.116) 0:03:55.734 ********* 2020-07-16T13:27:35.618 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2020-07-16T13:27:35.620 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:27:35.656 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:35 +0000 (0:00:00.068) 0:03:55.803 ********* 2020-07-16T13:27:35.698 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-07-16T13:27:35.700 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} TASK [testnode : Delete the teuthology users password.] ************************ skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:27:35.735 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:35 +0000 (0:00:00.079) 0:03:55.882 ********* 2020-07-16T13:27:35.777 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:35 +0000 (0:00:00.041) 0:03:55.923 ********* 2020-07-16T13:27:36.020 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-07-16T13:27:36.021 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2020-07-16T13:27:36.055 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:36 +0000 (0:00:00.278) 0:03:56.202 ********* 2020-07-16T13:27:36.368 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-07-16T13:27:36.370 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2020-07-16T13:27:36.413 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:36 +0000 (0:00:00.358) 0:03:56.560 ********* 2020-07-16T13:27:36.456 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-07-16T13:27:36.458 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi132"}, "changed": false} 2020-07-16T13:27:36.493 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:36 +0000 (0:00:00.079) 0:03:56.640 ********* 2020-07-16T13:27:36.634 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2020-07-16T13:27:36.684 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:36 +0000 (0:00:00.190) 0:03:56.831 ********* 2020-07-16T13:27:36.730 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-07-16T13:27:36.732 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi188"}, "changed": false} 2020-07-16T13:27:36.772 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:36 +0000 (0:00:00.087) 0:03:56.919 ********* 2020-07-16T13:27:37.554 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2020-07-16T13:27:37.556 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi188", "ansible_hostname": "smithi188", "ansible_nodename": "smithi188"}, "changed": false, "name": "smithi188"} 2020-07-16T13:27:37.607 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:37 +0000 (0:00:00.835) 0:03:57.754 ********* 2020-07-16T13:27:37.619 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi132", "ansible_hostname": "smithi132", "ansible_nodename": "smithi132"}, "changed": false, "name": "smithi132"} 2020-07-16T13:27:37.661 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:37 +0000 (0:00:00.053) 0:03:57.808 ********* 2020-07-16T13:27:38.118 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2020-07-16T13:27:38.155 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:38 +0000 (0:00:00.494) 0:03:58.302 ********* 2020-07-16T13:27:38.187 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2020-07-16T13:27:38.229 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:38 +0000 (0:00:00.073) 0:03:58.375 ********* 2020-07-16T13:27:38.682 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2020-07-16T13:27:38.685 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2020-07-16T13:27:38.718 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:38 +0000 (0:00:00.489) 0:03:58.865 ********* 2020-07-16T13:27:38.784 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2020-07-16T13:27:38.830 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:38 +0000 (0:00:00.111) 0:03:58.976 ********* 2020-07-16T13:27:39.390 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** changed: [smithi188.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-07-16T13:27:39.428 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:39 +0000 (0:00:00.598) 0:03:59.575 ********* 2020-07-16T13:27:39.489 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-07-16T13:27:39.555 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:39 +0000 (0:00:00.127) 0:03:59.702 ********* 2020-07-16T13:27:39.944 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2020-07-16T13:27:39.977 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:39 +0000 (0:00:00.421) 0:04:00.124 ********* 2020-07-16T13:27:40.062 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2020-07-16T13:27:40.109 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:40 +0000 (0:00:00.127) 0:04:00.251 ********* 2020-07-16T13:27:40.189 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-07-16T13:27:40.191 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2020-07-16T13:27:40.255 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:40 +0000 (0:00:00.149) 0:04:00.400 ********* 2020-07-16T13:27:40.322 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2020-07-16T13:27:40.358 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:40 +0000 (0:00:00.104) 0:04:00.505 ********* 2020-07-16T13:27:40.475 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2020-07-16T13:27:40.501 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:40 +0000 (0:00:00.143) 0:04:00.648 ********* 2020-07-16T13:27:40.562 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2020-07-16T13:27:40.599 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:40 +0000 (0:00:00.097) 0:04:00.746 ********* 2020-07-16T13:27:40.743 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-07-16T13:27:40.745 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1215, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-07-16T13:27:40.783 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:40 +0000 (0:00:00.183) 0:04:00.930 ********* 2020-07-16T13:27:40.839 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1215, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-07-16T13:27:40.896 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:40 +0000 (0:00:00.113) 0:04:01.043 ********* 2020-07-16T13:27:41.303 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-07-16T13:27:41.305 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2020-07-16T13:27:41.343 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:41 +0000 (0:00:00.446) 0:04:01.490 ********* 2020-07-16T13:27:41.472 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2020-07-16T13:27:41.534 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:41 +0000 (0:00:00.187) 0:04:01.677 ********* 2020-07-16T13:27:41.887 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-07-16T13:27:41.889 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2020-07-16T13:27:41.945 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:41 +0000 (0:00:00.414) 0:04:02.092 ********* 2020-07-16T13:27:42.052 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2020-07-16T13:27:42.104 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:42 +0000 (0:00:00.158) 0:04:02.251 ********* 2020-07-16T13:27:43.884 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-07-16T13:27:43.885 INFO:teuthology.task.ansible.out:[WARNING]: Consider using the yum, dnf or zypper module rather than running 'rpm'. If you need to use command because yum, dnf or zypper is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi188.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.723388", "end": "2020-07-16 13:27:43.856100", "rc": 0, "start": "2020-07-16 13:27:42.132712", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T13:27:43.924 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:43 +0000 (0:00:01.818) 0:04:04.070 ********* 2020-07-16T13:27:43.971 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2020-07-16T13:27:43.973 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:27:44.015 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:44 +0000 (0:00:00.091) 0:04:04.162 ********* 2020-07-16T13:27:44.036 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-07-16T13:27:44.038 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.721191", "end": "2020-07-16 13:27:44.009454", "rc": 0, "start": "2020-07-16 13:27:42.288263", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T13:27:44.073 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:44 +0000 (0:00:00.058) 0:04:04.220 ********* 2020-07-16T13:27:44.116 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:27:44.153 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:44 +0000 (0:00:00.079) 0:04:04.300 ********* 2020-07-16T13:27:44.573 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-07-16T13:27:44.575 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'key': 'lab-extras', 'value': {'name': 'lab-extras', 'baseurl': 'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2020-07-16T13:27:44.627 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:44 +0000 (0:00:00.472) 0:04:04.772 ********* 2020-07-16T13:27:44.655 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-07-16T13:27:44.689 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:44 +0000 (0:00:00.063) 0:04:04.836 ********* 2020-07-16T13:27:44.719 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-07-16T13:27:44.721 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'key': 'lab-extras', 'value': {'name': 'lab-extras', 'baseurl': 'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2020-07-16T13:27:44.721 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-07-16T13:27:44.770 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:44 +0000 (0:00:00.081) 0:04:04.917 ********* 2020-07-16T13:27:44.813 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:44 +0000 (0:00:00.042) 0:04:04.960 ********* 2020-07-16T13:27:44.824 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-07-16T13:27:44.865 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:44 +0000 (0:00:00.046) 0:04:05.007 ********* 2020-07-16T13:27:44.869 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2020-07-16T13:27:44.870 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:27:44.909 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:44 +0000 (0:00:00.049) 0:04:05.056 ********* 2020-07-16T13:27:44.919 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-07-16T13:27:44.965 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:44 +0000 (0:00:00.049) 0:04:05.105 ********* 2020-07-16T13:27:44.973 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2020-07-16T13:27:44.974 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-07-16T13:27:45.022 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:45 +0000 (0:00:00.057) 0:04:05.163 ********* 2020-07-16T13:27:45.038 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2020-07-16T13:27:45.040 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:27:45.079 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:45 +0000 (0:00:00.062) 0:04:05.226 ********* 2020-07-16T13:27:45.092 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2020-07-16T13:27:45.094 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:27:45.132 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:45 +0000 (0:00:00.052) 0:04:05.279 ********* 2020-07-16T13:27:45.145 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2020-07-16T13:27:45.147 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-07-16T13:27:45.185 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:45 +0000 (0:00:00.053) 0:04:05.332 ********* 2020-07-16T13:27:45.195 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-07-16T13:27:45.197 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:27:45.233 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:45 +0000 (0:00:00.047) 0:04:05.380 ********* 2020-07-16T13:27:45.241 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2020-07-16T13:27:45.243 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:27:45.277 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:45 +0000 (0:00:00.044) 0:04:05.424 ********* 2020-07-16T13:27:45.286 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:27:45.322 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:45 +0000 (0:00:00.044) 0:04:05.469 ********* 2020-07-16T13:27:45.331 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-07-16T13:27:45.333 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:27:45.366 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:45 +0000 (0:00:00.044) 0:04:05.513 ********* 2020-07-16T13:27:45.376 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-07-16T13:27:45.378 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:27:45.413 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:45 +0000 (0:00:00.046) 0:04:05.560 ********* 2020-07-16T13:27:45.421 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-07-16T13:27:45.423 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:27:45.458 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:45 +0000 (0:00:00.044) 0:04:05.604 ********* 2020-07-16T13:27:45.497 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-07-16T13:27:45.499 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:27:45.534 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:45 +0000 (0:00:00.076) 0:04:05.681 ********* 2020-07-16T13:27:45.644 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-07-16T13:27:45.646 INFO:teuthology.task.ansible.out:fatal: [smithi188.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.007181", "end": "2020-07-16 13:27:45.611918", "msg": "non-zero return code", "rc": 1, "start": "2020-07-16 13:27:45.604737", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2020-07-16T13:27:45.695 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:45 +0000 (0:00:00.161) 0:04:05.842 ********* 2020-07-16T13:27:45.738 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2020-07-16T13:27:45.739 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:27:45.781 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:45 +0000 (0:00:00.085) 0:04:05.928 ********* 2020-07-16T13:27:45.793 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-07-16T13:27:45.795 INFO:teuthology.task.ansible.out:fatal: [smithi132.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.006986", "end": "2020-07-16 13:27:45.745762", "msg": "non-zero return code", "rc": 1, "start": "2020-07-16 13:27:45.738776", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2020-07-16T13:27:45.833 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:45 +0000 (0:00:00.051) 0:04:05.980 ********* 2020-07-16T13:27:45.877 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2020-07-16T13:27:45.879 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:27:45.912 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:45 +0000 (0:00:00.079) 0:04:06.059 ********* 2020-07-16T13:27:51.611 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-07-16T13:27:51.613 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: qemu-kvm-block-rbd-15:2.12.0-99.module+el8.2.0+5827+8c39933c.x86_64", "Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64"]} 2020-07-16T13:27:51.660 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:51 +0000 (0:00:05.747) 0:04:11.807 ********* 2020-07-16T13:27:51.671 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: qemu-kvm-block-rbd-15:2.12.0-99.module+el8.2.0+5827+8c39933c.x86_64", "Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64"]} 2020-07-16T13:27:51.717 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:51 +0000 (0:00:00.056) 0:04:11.863 ********* 2020-07-16T13:27:57.258 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-07-16T13:27:57.260 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-7.el8.x86_64", "Removed: boost-random-1.66.0-7.el8.x86_64"]} 2020-07-16T13:27:57.306 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:57 +0000 (0:00:05.583) 0:04:17.447 ********* 2020-07-16T13:27:57.365 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-7.el8.x86_64", "Removed: boost-random-1.66.0-7.el8.x86_64"]} 2020-07-16T13:27:57.409 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:27:57 +0000 (0:00:00.107) 0:04:17.554 ********* 2020-07-16T13:28:10.116 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-07-16T13:28:10.118 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: dnf-utils", "Installed: git-all", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: podman", "Installed: podman-docker", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: autoconf", "Installed: gdb", "Installed: iozone", "Installed: boost-program-options-1.66.0-7.el8.x86_64", "Installed: boost-random-1.66.0-7.el8.x86_64", "Installed: podman-1.6.4-12.module+el8.2.0+6669+dde598ec.x86_64", "Installed: qemu-kvm-core-15:2.12.0-99.module+el8.2.0+6870+55b789b4.2.x86_64", "Installed: qemu-kvm-common-15:2.12.0-99.module+el8.2.0+6870+55b789b4.2.x86_64", "Installed: qemu-kvm-block-rbd-15:2.12.0-99.module+el8.2.0+6870+55b789b4.2.x86_64", "Installed: qemu-img-15:2.12.0-99.module+el8.2.0+6870+55b789b4.2.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: podman-docker-1.6.4-12.module+el8.2.0+6669+dde598ec.noarch", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Removed: qemu-img-15:2.12.0-99.module+el8.2.0+5827+8c39933c.x86_64", "Removed: qemu-kvm-common-15:2.12.0-99.module+el8.2.0+5827+8c39933c.x86_64", "Removed: qemu-kvm-core-15:2.12.0-99.module+el8.2.0+5827+8c39933c.x86_64", "Removed: podman-1.6.4-11.module+el8.2.0+6368+cf16aa14.x86_64", "Removed: podman-docker-1.6.4-11.module+el8.2.0+6368+cf16aa14.noarch"]} 2020-07-16T13:28:10.168 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:10 +0000 (0:00:12.759) 0:04:30.314 ********* 2020-07-16T13:28:10.517 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: dnf-utils", "Installed: git-all", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: podman", "Installed: podman-docker", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: autoconf", "Installed: gdb", "Installed: iozone", "Installed: qemu-kvm-block-rbd-15:2.12.0-99.module+el8.2.0+6870+55b789b4.2.x86_64", "Installed: qemu-img-15:2.12.0-99.module+el8.2.0+6870+55b789b4.2.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: podman-docker-1.6.4-12.module+el8.2.0+6669+dde598ec.noarch", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: boost-program-options-1.66.0-7.el8.x86_64", "Installed: boost-random-1.66.0-7.el8.x86_64", "Installed: podman-1.6.4-12.module+el8.2.0+6669+dde598ec.x86_64", "Installed: qemu-kvm-core-15:2.12.0-99.module+el8.2.0+6870+55b789b4.2.x86_64", "Installed: qemu-kvm-common-15:2.12.0-99.module+el8.2.0+6870+55b789b4.2.x86_64", "Removed: qemu-img-15:2.12.0-99.module+el8.2.0+5827+8c39933c.x86_64", "Removed: qemu-kvm-common-15:2.12.0-99.module+el8.2.0+5827+8c39933c.x86_64", "Removed: qemu-kvm-core-15:2.12.0-99.module+el8.2.0+5827+8c39933c.x86_64", "Removed: podman-1.6.4-11.module+el8.2.0+6368+cf16aa14.x86_64", "Removed: podman-docker-1.6.4-11.module+el8.2.0+6368+cf16aa14.noarch"]} 2020-07-16T13:28:10.554 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:10 +0000 (0:00:00.386) 0:04:30.701 ********* 2020-07-16T13:28:12.603 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-07-16T13:28:12.605 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: dbench"]} 2020-07-16T13:28:12.643 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:12 +0000 (0:00:02.087) 0:04:32.789 ********* 2020-07-16T13:28:12.935 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: dbench"]} 2020-07-16T13:28:12.980 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:12 +0000 (0:00:00.338) 0:04:33.127 ********* 2020-07-16T13:28:14.941 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-07-16T13:28:14.943 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2020-07-16T13:28:14.979 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:14 +0000 (0:00:01.998) 0:04:35.125 ********* 2020-07-16T13:28:15.021 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-07-16T13:28:15.023 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:15.057 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:15 +0000 (0:00:00.078) 0:04:35.204 ********* 2020-07-16T13:28:15.249 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-07-16T13:28:15.251 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2020-07-16T13:28:15.285 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:15 +0000 (0:00:00.227) 0:04:35.432 ********* 2020-07-16T13:28:15.329 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-07-16T13:28:15.331 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:15.365 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:15 +0000 (0:00:00.080) 0:04:35.512 ********* 2020-07-16T13:28:15.404 INFO:teuthology.task.ansible.out: 2020-07-16T13:28:15.407 INFO:teuthology.task.ansible.out:TASK [testnode : Stop and disable firewalld] *********************************** 2020-07-16T13:28:15.408 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "basic.target dbus.service sysinit.target dbus.socket polkit.service system.slice", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "network-pre.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "ip6tables.service ipset.service iptables.service ebtables.service shutdown.target", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTim 2020-07-16T13:28:15.410 INFO:teuthology.task.ansible.out:estampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127425", "LimitNPROCSoft": "127425", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127425", 2020-07-16T13:28:15.412 INFO:teuthology.task.ansible.out:"LimitSIGPENDINGSoft": "127425", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target dbus.socket system.slice", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3 2020-07-16T13:28:15.426 INFO:teuthology.task.ansible.out:", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2020-07-16T13:28:15.450 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:15 +0000 (0:00:00.084) 0:04:35.597 ********* 2020-07-16T13:28:15.704 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "polkit.service basic.target system.slice dbus.service dbus.socket sysinit.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "network-pre.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "ebtables.service ip6tables.service ipset.service iptables.service shutdown.target", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTim 2020-07-16T13:28:15.706 INFO:teuthology.task.ansible.out:estampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127425", "LimitNPROCSoft": "127425", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127425", 2020-07-16T13:28:15.707 INFO:teuthology.task.ansible.out:"LimitSIGPENDINGSoft": "127425", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice dbus.socket sysinit.target", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3 2020-07-16T13:28:15.709 INFO:teuthology.task.ansible.out:", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2020-07-16T13:28:15.744 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:15 +0000 (0:00:00.294) 0:04:35.891 ********* 2020-07-16T13:28:15.765 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2020-07-16T13:28:15.767 INFO:teuthology.task.ansible.out:fatal: [smithi132.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2020-07-16T13:28:15.805 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:15 +0000 (0:00:00.060) 0:04:35.952 ********* 2020-07-16T13:28:16.048 INFO:teuthology.task.ansible.out:fatal: [smithi188.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2020-07-16T13:28:16.083 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:16 +0000 (0:00:00.278) 0:04:36.230 ********* 2020-07-16T13:28:16.674 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2020-07-16T13:28:16.709 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:16 +0000 (0:00:00.626) 0:04:36.856 ********* 2020-07-16T13:28:16.721 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2020-07-16T13:28:16.775 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:16 +0000 (0:00:00.065) 0:04:36.921 ********* 2020-07-16T13:28:16.784 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2020-07-16T13:28:16.785 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:16.836 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:16 +0000 (0:00:00.061) 0:04:36.983 ********* 2020-07-16T13:28:16.848 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:16.886 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:16 +0000 (0:00:00.050) 0:04:37.033 ********* 2020-07-16T13:28:16.894 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2020-07-16T13:28:16.896 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:16.931 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:16 +0000 (0:00:00.045) 0:04:37.078 ********* 2020-07-16T13:28:16.939 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:16.976 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:16 +0000 (0:00:00.044) 0:04:37.123 ********* 2020-07-16T13:28:16.984 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2020-07-16T13:28:16.986 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:17.023 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:17 +0000 (0:00:00.046) 0:04:37.170 ********* 2020-07-16T13:28:17.032 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:17.073 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:17 +0000 (0:00:00.050) 0:04:37.220 ********* 2020-07-16T13:28:17.082 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:17.119 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:17 +0000 (0:00:00.045) 0:04:37.266 ********* 2020-07-16T13:28:17.127 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:17.167 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:17 +0000 (0:00:00.047) 0:04:37.314 ********* 2020-07-16T13:28:17.175 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2020-07-16T13:28:17.177 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:17.213 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:17 +0000 (0:00:00.046) 0:04:37.360 ********* 2020-07-16T13:28:17.225 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:17.264 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:17 +0000 (0:00:00.050) 0:04:37.410 ********* 2020-07-16T13:28:17.274 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2020-07-16T13:28:17.276 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:17.312 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:17 +0000 (0:00:00.048) 0:04:37.459 ********* 2020-07-16T13:28:17.323 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:17.374 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:17 +0000 (0:00:00.062) 0:04:37.521 ********* 2020-07-16T13:28:17.384 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-07-16T13:28:17.425 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:17 +0000 (0:00:00.050) 0:04:37.572 ********* 2020-07-16T13:28:17.487 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:17 +0000 (0:00:00.061) 0:04:37.634 ********* 2020-07-16T13:28:17.496 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2020-07-16T13:28:17.497 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:17.538 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:17 +0000 (0:00:00.050) 0:04:37.685 ********* 2020-07-16T13:28:17.549 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:17.589 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:17 +0000 (0:00:00.051) 0:04:37.736 ********* 2020-07-16T13:28:17.599 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:17.635 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:17 +0000 (0:00:00.046) 0:04:37.782 ********* 2020-07-16T13:28:17.646 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:17.682 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:17 +0000 (0:00:00.046) 0:04:37.829 ********* 2020-07-16T13:28:17.689 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-07-16T13:28:17.691 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-07-16T13:28:17.726 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:17 +0000 (0:00:00.044) 0:04:37.873 ********* 2020-07-16T13:28:17.734 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-07-16T13:28:17.736 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-07-16T13:28:17.774 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:17 +0000 (0:00:00.048) 0:04:37.921 ********* 2020-07-16T13:28:17.783 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-07-16T13:28:17.785 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:17.819 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:17 +0000 (0:00:00.044) 0:04:37.966 ********* 2020-07-16T13:28:17.831 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:17.865 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:17 +0000 (0:00:00.046) 0:04:38.012 ********* 2020-07-16T13:28:17.882 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-07-16T13:28:17.914 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:17 +0000 (0:00:00.048) 0:04:38.061 ********* 2020-07-16T13:28:17.961 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:17 +0000 (0:00:00.046) 0:04:38.107 ********* 2020-07-16T13:28:17.969 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2020-07-16T13:28:17.971 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:18.006 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:18 +0000 (0:00:00.044) 0:04:38.152 ********* 2020-07-16T13:28:18.017 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:18.052 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:18 +0000 (0:00:00.046) 0:04:38.199 ********* 2020-07-16T13:28:18.062 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2020-07-16T13:28:18.065 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:18.101 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:18 +0000 (0:00:00.047) 0:04:38.246 ********* 2020-07-16T13:28:18.109 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:18.147 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:18 +0000 (0:00:00.047) 0:04:38.294 ********* 2020-07-16T13:28:18.157 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2020-07-16T13:28:18.159 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:18.211 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:18 +0000 (0:00:00.064) 0:04:38.358 ********* 2020-07-16T13:28:18.222 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:18.268 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:18 +0000 (0:00:00.057) 0:04:38.415 ********* 2020-07-16T13:28:18.277 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-07-16T13:28:18.279 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:18.315 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:18 +0000 (0:00:00.046) 0:04:38.462 ********* 2020-07-16T13:28:18.327 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:18.363 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:18 +0000 (0:00:00.048) 0:04:38.510 ********* 2020-07-16T13:28:18.371 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2020-07-16T13:28:18.373 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:18.409 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:18 +0000 (0:00:00.045) 0:04:38.555 ********* 2020-07-16T13:28:18.421 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:18.455 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:18 +0000 (0:00:00.046) 0:04:38.602 ********* 2020-07-16T13:28:18.471 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:18.500 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:18 +0000 (0:00:00.045) 0:04:38.647 ********* 2020-07-16T13:28:18.514 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:18.546 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:18 +0000 (0:00:00.045) 0:04:38.693 ********* 2020-07-16T13:28:18.555 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2020-07-16T13:28:18.557 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:18.592 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:18 +0000 (0:00:00.045) 0:04:38.738 ********* 2020-07-16T13:28:18.601 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:18.639 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:18 +0000 (0:00:00.046) 0:04:38.785 ********* 2020-07-16T13:28:18.647 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-07-16T13:28:18.648 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:18.682 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:18 +0000 (0:00:00.044) 0:04:38.829 ********* 2020-07-16T13:28:18.692 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:18.733 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:18 +0000 (0:00:00.050) 0:04:38.879 ********* 2020-07-16T13:28:18.742 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2020-07-16T13:28:18.749 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:18.778 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:18 +0000 (0:00:00.045) 0:04:38.925 ********* 2020-07-16T13:28:18.787 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:18.829 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:18 +0000 (0:00:00.051) 0:04:38.976 ********* 2020-07-16T13:28:18.840 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2020-07-16T13:28:18.842 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:18.878 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:18 +0000 (0:00:00.048) 0:04:39.025 ********* 2020-07-16T13:28:18.889 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:18.927 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:18 +0000 (0:00:00.048) 0:04:39.074 ********* 2020-07-16T13:28:18.937 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2020-07-16T13:28:18.939 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:18.975 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:18 +0000 (0:00:00.047) 0:04:39.121 ********* 2020-07-16T13:28:18.986 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:19.031 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:19 +0000 (0:00:00.056) 0:04:39.178 ********* 2020-07-16T13:28:19.043 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2020-07-16T13:28:19.045 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:19.082 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:19 +0000 (0:00:00.050) 0:04:39.228 ********* 2020-07-16T13:28:19.093 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:19.132 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:19 +0000 (0:00:00.050) 0:04:39.279 ********* 2020-07-16T13:28:19.142 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2020-07-16T13:28:19.144 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:19.188 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:19 +0000 (0:00:00.056) 0:04:39.335 ********* 2020-07-16T13:28:19.202 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:19.237 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:19 +0000 (0:00:00.048) 0:04:39.383 ********* 2020-07-16T13:28:19.245 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-07-16T13:28:19.247 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:19.281 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:19 +0000 (0:00:00.044) 0:04:39.428 ********* 2020-07-16T13:28:19.295 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:19.325 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:19 +0000 (0:00:00.043) 0:04:39.472 ********* 2020-07-16T13:28:19.333 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-07-16T13:28:19.335 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:19.372 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:19 +0000 (0:00:00.047) 0:04:39.519 ********* 2020-07-16T13:28:19.382 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:19.422 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:19 +0000 (0:00:00.050) 0:04:39.569 ********* 2020-07-16T13:28:19.432 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-07-16T13:28:19.433 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:19.468 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:19 +0000 (0:00:00.045) 0:04:39.615 ********* 2020-07-16T13:28:19.478 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:19.513 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:19 +0000 (0:00:00.045) 0:04:39.660 ********* 2020-07-16T13:28:19.526 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-07-16T13:28:19.527 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:19.562 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:19 +0000 (0:00:00.048) 0:04:39.709 ********* 2020-07-16T13:28:19.571 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:19.605 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:19 +0000 (0:00:00.043) 0:04:39.752 ********* 2020-07-16T13:28:19.613 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-07-16T13:28:19.615 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:19.658 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:19 +0000 (0:00:00.050) 0:04:39.803 ********* 2020-07-16T13:28:19.670 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:19.708 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:19 +0000 (0:00:00.051) 0:04:39.855 ********* 2020-07-16T13:28:19.717 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-07-16T13:28:19.719 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:19.757 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:19 +0000 (0:00:00.049) 0:04:39.904 ********* 2020-07-16T13:28:19.769 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:19.805 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:19 +0000 (0:00:00.048) 0:04:39.952 ********* 2020-07-16T13:28:19.821 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-07-16T13:28:19.823 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:19.859 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:19 +0000 (0:00:00.053) 0:04:40.006 ********* 2020-07-16T13:28:19.877 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:19.907 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:19 +0000 (0:00:00.047) 0:04:40.054 ********* 2020-07-16T13:28:19.916 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-07-16T13:28:19.918 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:19.955 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:19 +0000 (0:00:00.047) 0:04:40.102 ********* 2020-07-16T13:28:19.966 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:20.001 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:19 +0000 (0:00:00.046) 0:04:40.148 ********* 2020-07-16T13:28:20.012 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-07-16T13:28:20.013 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:20.051 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:20 +0000 (0:00:00.049) 0:04:40.198 ********* 2020-07-16T13:28:20.060 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:20.097 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:20 +0000 (0:00:00.046) 0:04:40.244 ********* 2020-07-16T13:28:20.111 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:20.147 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:20 +0000 (0:00:00.049) 0:04:40.294 ********* 2020-07-16T13:28:20.158 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:20.194 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:20 +0000 (0:00:00.047) 0:04:40.341 ********* 2020-07-16T13:28:20.202 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-07-16T13:28:20.204 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:20.244 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:20 +0000 (0:00:00.049) 0:04:40.391 ********* 2020-07-16T13:28:20.254 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:20.290 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:20 +0000 (0:00:00.045) 0:04:40.437 ********* 2020-07-16T13:28:20.301 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-07-16T13:28:20.302 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:20.336 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:20 +0000 (0:00:00.046) 0:04:40.483 ********* 2020-07-16T13:28:20.348 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:20.386 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:20 +0000 (0:00:00.049) 0:04:40.533 ********* 2020-07-16T13:28:20.394 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-07-16T13:28:20.396 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:20.431 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:20 +0000 (0:00:00.044) 0:04:40.578 ********* 2020-07-16T13:28:20.440 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:20.477 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:20 +0000 (0:00:00.046) 0:04:40.624 ********* 2020-07-16T13:28:20.486 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:20.522 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:20 +0000 (0:00:00.044) 0:04:40.669 ********* 2020-07-16T13:28:20.532 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:20.569 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:20 +0000 (0:00:00.047) 0:04:40.716 ********* 2020-07-16T13:28:20.578 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-07-16T13:28:20.580 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:20.619 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:20 +0000 (0:00:00.049) 0:04:40.766 ********* 2020-07-16T13:28:20.628 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:20.664 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:20 +0000 (0:00:00.045) 0:04:40.811 ********* 2020-07-16T13:28:20.673 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-07-16T13:28:20.675 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:20.711 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:20 +0000 (0:00:00.046) 0:04:40.857 ********* 2020-07-16T13:28:20.726 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:20.758 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:20 +0000 (0:00:00.047) 0:04:40.905 ********* 2020-07-16T13:28:20.768 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-07-16T13:28:20.770 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:20.807 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:20 +0000 (0:00:00.048) 0:04:40.954 ********* 2020-07-16T13:28:20.819 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:20.868 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:20 +0000 (0:00:00.060) 0:04:41.015 ********* 2020-07-16T13:28:20.878 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-07-16T13:28:20.881 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:20.917 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:20 +0000 (0:00:00.049) 0:04:41.064 ********* 2020-07-16T13:28:20.927 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:20.963 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:20 +0000 (0:00:00.046) 0:04:41.110 ********* 2020-07-16T13:28:20.972 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-07-16T13:28:20.973 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:21.008 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:21 +0000 (0:00:00.045) 0:04:41.155 ********* 2020-07-16T13:28:21.018 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:21.060 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:21 +0000 (0:00:00.051) 0:04:41.207 ********* 2020-07-16T13:28:21.068 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-07-16T13:28:21.070 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:21.114 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:21 +0000 (0:00:00.054) 0:04:41.261 ********* 2020-07-16T13:28:21.124 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:21.165 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:21 +0000 (0:00:00.050) 0:04:41.312 ********* 2020-07-16T13:28:21.176 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-07-16T13:28:21.178 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:21.214 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:21 +0000 (0:00:00.049) 0:04:41.361 ********* 2020-07-16T13:28:21.226 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:21.270 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:21 +0000 (0:00:00.055) 0:04:41.417 ********* 2020-07-16T13:28:21.282 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-07-16T13:28:21.283 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:21.325 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:21 +0000 (0:00:00.055) 0:04:41.472 ********* 2020-07-16T13:28:21.335 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:21.372 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:21 +0000 (0:00:00.046) 0:04:41.519 ********* 2020-07-16T13:28:21.382 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-07-16T13:28:21.384 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:21.427 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:21 +0000 (0:00:00.055) 0:04:41.574 ********* 2020-07-16T13:28:21.437 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:21.478 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:21 +0000 (0:00:00.050) 0:04:41.625 ********* 2020-07-16T13:28:21.488 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-07-16T13:28:21.490 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:21.525 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:21 +0000 (0:00:00.046) 0:04:41.672 ********* 2020-07-16T13:28:21.535 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:21.572 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:21 +0000 (0:00:00.047) 0:04:41.719 ********* 2020-07-16T13:28:21.593 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:21.626 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:21 +0000 (0:00:00.053) 0:04:41.772 ********* 2020-07-16T13:28:21.637 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:21.680 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:21 +0000 (0:00:00.054) 0:04:41.827 ********* 2020-07-16T13:28:21.691 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-07-16T13:28:21.692 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:21.728 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:21 +0000 (0:00:00.047) 0:04:41.875 ********* 2020-07-16T13:28:21.741 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:21.780 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:21 +0000 (0:00:00.052) 0:04:41.927 ********* 2020-07-16T13:28:21.792 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2020-07-16T13:28:21.794 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:21.831 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:21 +0000 (0:00:00.050) 0:04:41.978 ********* 2020-07-16T13:28:21.842 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:21.883 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:21 +0000 (0:00:00.052) 0:04:42.030 ********* 2020-07-16T13:28:21.894 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:21.932 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:21 +0000 (0:00:00.048) 0:04:42.078 ********* 2020-07-16T13:28:21.946 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:21.984 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:21 +0000 (0:00:00.052) 0:04:42.131 ********* 2020-07-16T13:28:21.993 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-07-16T13:28:21.995 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:22.040 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:22 +0000 (0:00:00.055) 0:04:42.187 ********* 2020-07-16T13:28:22.051 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:22.094 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:22 +0000 (0:00:00.053) 0:04:42.241 ********* 2020-07-16T13:28:22.105 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-07-16T13:28:22.107 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:22.143 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:22 +0000 (0:00:00.049) 0:04:42.290 ********* 2020-07-16T13:28:22.155 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:22.193 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:22 +0000 (0:00:00.049) 0:04:42.339 ********* 2020-07-16T13:28:22.204 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2020-07-16T13:28:22.206 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:22.245 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:22 +0000 (0:00:00.052) 0:04:42.392 ********* 2020-07-16T13:28:22.257 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:22.300 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:22 +0000 (0:00:00.055) 0:04:42.447 ********* 2020-07-16T13:28:22.312 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-07-16T13:28:22.313 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:22.350 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:22 +0000 (0:00:00.049) 0:04:42.497 ********* 2020-07-16T13:28:22.361 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:22.400 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:22 +0000 (0:00:00.048) 0:04:42.546 ********* 2020-07-16T13:28:22.407 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2020-07-16T13:28:22.409 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:22.451 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:22 +0000 (0:00:00.052) 0:04:42.598 ********* 2020-07-16T13:28:22.461 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:22.500 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:22 +0000 (0:00:00.048) 0:04:42.647 ********* 2020-07-16T13:28:22.509 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2020-07-16T13:28:22.511 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:22.563 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:22 +0000 (0:00:00.063) 0:04:42.710 ********* 2020-07-16T13:28:22.574 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:22.618 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:22 +0000 (0:00:00.051) 0:04:42.762 ********* 2020-07-16T13:28:22.625 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2020-07-16T13:28:22.626 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:22.664 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:22 +0000 (0:00:00.048) 0:04:42.810 ********* 2020-07-16T13:28:22.672 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:22.713 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:22 +0000 (0:00:00.049) 0:04:42.860 ********* 2020-07-16T13:28:22.723 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2020-07-16T13:28:22.724 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:22.762 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:22 +0000 (0:00:00.048) 0:04:42.909 ********* 2020-07-16T13:28:22.771 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:22.808 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:22 +0000 (0:00:00.046) 0:04:42.955 ********* 2020-07-16T13:28:22.817 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2020-07-16T13:28:22.818 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:22.852 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:22 +0000 (0:00:00.044) 0:04:42.999 ********* 2020-07-16T13:28:22.865 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:22.907 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:22 +0000 (0:00:00.054) 0:04:43.054 ********* 2020-07-16T13:28:22.916 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2020-07-16T13:28:22.918 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:22.959 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:22 +0000 (0:00:00.052) 0:04:43.106 ********* 2020-07-16T13:28:22.968 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:23.011 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:23 +0000 (0:00:00.048) 0:04:43.155 ********* 2020-07-16T13:28:23.017 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2020-07-16T13:28:23.019 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:23.062 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:23 +0000 (0:00:00.054) 0:04:43.209 ********* 2020-07-16T13:28:23.073 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:23.118 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:23 +0000 (0:00:00.055) 0:04:43.264 ********* 2020-07-16T13:28:23.128 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-07-16T13:28:23.130 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-07-16T13:28:23.169 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:23 +0000 (0:00:00.051) 0:04:43.316 ********* 2020-07-16T13:28:23.180 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-07-16T13:28:23.218 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:23 +0000 (0:00:00.048) 0:04:43.365 ********* 2020-07-16T13:28:23.230 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-07-16T13:28:23.231 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-07-16T13:28:23.233 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-07-16T13:28:23.255 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-07-16T13:28:23.267 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-07-16T13:28:23.277 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-07-16T13:28:23.280 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-07-16T13:28:23.329 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:23 +0000 (0:00:00.110) 0:04:43.475 ********* 2020-07-16T13:28:23.338 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-07-16T13:28:23.340 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-07-16T13:28:23.385 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:23 +0000 (0:00:00.056) 0:04:43.532 ********* 2020-07-16T13:28:23.587 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2020-07-16T13:28:23.588 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.004387", "end": "2020-07-16 13:28:23.551568", "rc": 0, "start": "2020-07-16 13:28:23.547181", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-07-16T13:28:23.650 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:23 +0000 (0:00:00.265) 0:04:43.797 ********* 2020-07-16T13:28:23.669 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003644", "end": "2020-07-16 13:28:23.585079", "rc": 0, "start": "2020-07-16 13:28:23.581435", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-07-16T13:28:23.729 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:23 +0000 (0:00:00.078) 0:04:43.876 ********* 2020-07-16T13:28:23.739 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2020-07-16T13:28:23.741 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:23.790 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:23 +0000 (0:00:00.061) 0:04:43.937 ********* 2020-07-16T13:28:23.799 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:23.844 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:23 +0000 (0:00:00.050) 0:04:43.987 ********* 2020-07-16T13:28:23.849 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-07-16T13:28:23.851 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:23.908 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:23 +0000 (0:00:00.067) 0:04:44.054 ********* 2020-07-16T13:28:23.918 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:23.954 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:23 +0000 (0:00:00.046) 0:04:44.101 ********* 2020-07-16T13:28:23.965 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:24.007 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:24 +0000 (0:00:00.051) 0:04:44.153 ********* 2020-07-16T13:28:24.017 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:24.070 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:24 +0000 (0:00:00.054) 0:04:44.208 ********* 2020-07-16T13:28:24.073 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-07-16T13:28:24.075 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:24.116 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:24 +0000 (0:00:00.055) 0:04:44.263 ********* 2020-07-16T13:28:24.127 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:24.166 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:24 +0000 (0:00:00.049) 0:04:44.312 ********* 2020-07-16T13:28:26.422 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper"]} 2020-07-16T13:28:26.474 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:26 +0000 (0:00:02.308) 0:04:46.621 ********* 2020-07-16T13:28:26.484 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper"]} 2020-07-16T13:28:26.522 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:26 +0000 (0:00:00.047) 0:04:46.669 ********* 2020-07-16T13:28:26.536 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ ok: [smithi132.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930490896384, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227170629, 'block_used': 12924479, 'inode_total': 61054976, 'inode_available': 60986774, 'inode_used': 68202, 'uuid': '0dcc33de-53c3-4ea8-baab-7ca3c59fe577'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227170629, "block_size": 4096, "block_total": 240095108, "block_used": 12924479, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986774, "inode_total": 61054976, "inode_used": 68202, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930490896384, "size_total": 983429562368, "uuid": "0dcc33de-53c3-4ea8-baab-7ca3c59fe577"}} 2020-07-16T13:28:26.585 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:26 +0000 (0:00:00.062) 0:04:46.731 ********* 2020-07-16T13:28:26.595 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930490892288, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227170628, 'block_used': 12924480, 'inode_total': 61054976, 'inode_available': 60986774, 'inode_used': 68202, 'uuid': '0dcc33de-53c3-4ea8-baab-7ca3c59fe577'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227170628, "block_size": 4096, "block_total": 240095108, "block_used": 12924480, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986774, "inode_total": 61054976, "inode_used": 68202, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930490892288, "size_total": 983429562368, "uuid": "0dcc33de-53c3-4ea8-baab-7ca3c59fe577"}} 2020-07-16T13:28:26.635 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:26 +0000 (0:00:00.050) 0:04:46.782 ********* 2020-07-16T13:28:26.792 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-07-16T13:28:26.794 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.004986", "end": "2020-07-16 13:28:26.768147", "rc": 0, "start": "2020-07-16 13:28:26.763161", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T13:28:26.855 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:26 +0000 (0:00:00.219) 0:04:47.002 ********* 2020-07-16T13:28:26.870 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005005", "end": "2020-07-16 13:28:26.825358", "rc": 0, "start": "2020-07-16 13:28:26.820353", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T13:28:26.909 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:26 +0000 (0:00:00.054) 0:04:47.056 ********* 2020-07-16T13:28:26.919 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-07-16T13:28:26.921 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930490896384, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227170629, 'block_used': 12924479, 'inode_total': 61054976, 'inode_available': 60986774, 'inode_used': 68202, 'uuid': '0dcc33de-53c3-4ea8-baab-7ca3c59fe577'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227170629, "block_size": 4096, "block_total": 240095108, "block_used": 12924479, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986774, "inode_total": 61054976, "inode_used": 68202, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930490896384, "size_total": 983429562368, "uuid": "0dcc33de-53c3-4ea8-baab-7ca3c59fe577"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:26.977 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:26 +0000 (0:00:00.067) 0:04:47.124 ********* 2020-07-16T13:28:26.989 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930490892288, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227170628, 'block_used': 12924480, 'inode_total': 61054976, 'inode_available': 60986774, 'inode_used': 68202, 'uuid': '0dcc33de-53c3-4ea8-baab-7ca3c59fe577'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227170628, "block_size": 4096, "block_total": 240095108, "block_used": 12924480, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986774, "inode_total": 61054976, "inode_used": 68202, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930490892288, "size_total": 983429562368, "uuid": "0dcc33de-53c3-4ea8-baab-7ca3c59fe577"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:27.035 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:27 +0000 (0:00:00.057) 0:04:47.181 ********* 2020-07-16T13:28:27.044 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-07-16T13:28:27.091 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:27 +0000 (0:00:00.056) 0:04:47.238 ********* 2020-07-16T13:28:27.143 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:27 +0000 (0:00:00.051) 0:04:47.290 ********* 2020-07-16T13:28:28.615 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-07-16T13:28:28.618 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-W3PBpVSOGUrJj21EUDeScLXma2eVMsVcuvtl76KLEu1CDM21XdidnWosFk40N9Vg'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.272344", "end": "2020-07-16 13:28:28.566583", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-W3PBpVSOGUrJj21EUDeScLXma2eVMsVcuvtl76KLEu1CDM21XdidnWosFk40N9Vg"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 13:28:27.294239", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-07-16T13:28:28.743 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-34MJaBgqJoO0RVJY2gpjVJHPcSlyuhVLMVIyIUhh2r2ZLKVzYWwHs5HudTtatNAo'], 'uuids': ['89440f43-d268-40b3-a410-81e86c241cd6'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.331188", "end": "2020-07-16 13:28:28.686944", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-34MJaBgqJoO0RVJY2gpjVJHPcSlyuhVLMVIyIUhh2r2ZLKVzYWwHs5HudTtatNAo"], "labels": [], "masters": [], "uuids": ["89440f43-d268-40b3-a410-81e86c241cd6"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 13:28:27.355756", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-07-16T13:28:29.874 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-pPYlkb-JfOJ-6ldX-QdBu-XqH4-o316-GmtlUz', 'nvme-INTEL_SSDPEDMD400G4_CVFT6232000B400BGN', 'nvme-nvme.8086-43564654363233323030304234303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.062497", "end": "2020-07-16 13:28:29.835982", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-pPYlkb-JfOJ-6ldX-QdBu-XqH4-o316-GmtlUz", "nvme-INTEL_SSDPEDMD400G4_CVFT6232000B400BGN", "nvme-nvme.8086-43564654363233323030304234303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 13:28:28.773485", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2020-07-16T13:28:29.885 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-07-16T13:28:30.016 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-F76TU5-qskG-jqcH-ROE1-zLa5-bO7s-Dnnvs0', 'nvme-INTEL_SSDPEDMD400G4_PHFT620500MP400BGN', 'nvme-nvme.8086-504846543632303530304d5034303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.066646", "end": "2020-07-16 13:28:29.987857", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-F76TU5-qskG-jqcH-ROE1-zLa5-bO7s-Dnnvs0", "nvme-INTEL_SSDPEDMD400G4_PHFT620500MP400BGN", "nvme-nvme.8086-504846543632303530304d5034303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 13:28:28.921211", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2020-07-16T13:28:30.018 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-07-16T13:28:31.130 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-W3PBpVSOGUrJj21EUDeScLXma2eVMsVccOf52HgcPjQb9LFJ43dr3JKB1z5cAlXj'], 'uuids': ['505b0ae2-5788-4a58-b658-98b3bf151368'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.050408", "end": "2020-07-16 13:28:31.096350", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-W3PBpVSOGUrJj21EUDeScLXma2eVMsVccOf52HgcPjQb9LFJ43dr3JKB1z5cAlXj"], "labels": [], "masters": [], "uuids": ["505b0ae2-5788-4a58-b658-98b3bf151368"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 13:28:30.045942", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-07-16T13:28:31.271 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-34MJaBgqJoO0RVJY2gpjVJHPcSlyuhVL4HMyh2ShVqgdFevt2iMcUuPHgyTlhyDz'], 'uuids': ['0f4c8b2c-73a5-4f34-8d1c-038c1ef3680e'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.049716", "end": "2020-07-16 13:28:31.230919", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-34MJaBgqJoO0RVJY2gpjVJHPcSlyuhVL4HMyh2ShVqgdFevt2iMcUuPHgyTlhyDz"], "labels": [], "masters": [], "uuids": ["0f4c8b2c-73a5-4f34-8d1c-038c1ef3680e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 13:28:30.181203", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-07-16T13:28:32.393 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-W3PBpVSOGUrJj21EUDeScLXma2eVMsVcE2su2R2Dt9eIjAIxNNmVFxBAMLsQOaBh'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.052785", "end": "2020-07-16 13:28:32.356490", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-W3PBpVSOGUrJj21EUDeScLXma2eVMsVcE2su2R2Dt9eIjAIxNNmVFxBAMLsQOaBh"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 13:28:31.303705", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-07-16T13:28:32.551 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-34MJaBgqJoO0RVJY2gpjVJHPcSlyuhVLnWnc1UCOpWt7Tux0wZlTe2OIviZyUvE2'], 'uuids': ['a7c382b4-f05b-42f2-928c-c88a414abdfd'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.077325", "end": "2020-07-16 13:28:32.516131", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-34MJaBgqJoO0RVJY2gpjVJHPcSlyuhVLnWnc1UCOpWt7Tux0wZlTe2OIviZyUvE2"], "labels": [], "masters": [], "uuids": ["a7c382b4-f05b-42f2-928c-c88a414abdfd"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 13:28:31.438806", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-07-16T13:28:33.658 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-W3PBpVSOGUrJj21EUDeScLXma2eVMsVcHWNLUARZI2S0qLPOavtu4TyKocXCbNAk'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.061441", "end": "2020-07-16 13:28:33.622416", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-W3PBpVSOGUrJj21EUDeScLXma2eVMsVcHWNLUARZI2S0qLPOavtu4TyKocXCbNAk"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 13:28:32.560975", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-07-16T13:28:33.670 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XM6D', 'wwn-0x5000c500929332c1'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5XM6D', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c500929332c1', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XM6D-part1', 'wwn-0x5000c500929332c1-part1'], 'uuids': ['0dcc33de-53c3-4ea8-baab-7ca3c59fe577'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '0dcc33de-53c3-4ea8-baab-7ca3c59fe577', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XM6D", "wwn-0x5000c500929332c1"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XM6D-part1", "wwn-0x5000c500929332c1-part1"], "labels": [], "masters": [], "uuids": ["0dcc33de-53c3-4ea8-baab-7ca3c59fe577"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "0dcc33de-53c3-4ea8-baab-7ca3c59fe577"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XM6D", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500929332c1"}}, 2020-07-16T13:28:33.672 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2020-07-16T13:28:33.798 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-34MJaBgqJoO0RVJY2gpjVJHPcSlyuhVLNDCdorO2BIGFezA77aJgVSpF41fuXNde'], 'uuids': ['644d25cb-9c0e-46ce-8ad3-b640877fd885'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.053482", "end": "2020-07-16 13:28:33.765967", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-34MJaBgqJoO0RVJY2gpjVJHPcSlyuhVLNDCdorO2BIGFezA77aJgVSpF41fuXNde"], "labels": [], "masters": [], "uuids": ["644d25cb-9c0e-46ce-8ad3-b640877fd885"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 13:28:32.712485", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-07-16T13:28:33.810 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XTEX', 'wwn-0x5000c5009294703b'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5XTEX', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c5009294703b', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XTEX-part1', 'wwn-0x5000c5009294703b-part1'], 'uuids': ['0dcc33de-53c3-4ea8-baab-7ca3c59fe577'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '0dcc33de-53c3-4ea8-baab-7ca3c59fe577', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XTEX", "wwn-0x5000c5009294703b"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XTEX-part1", "wwn-0x5000c5009294703b-part1"], "labels": [], "masters": [], "uuids": ["0dcc33de-53c3-4ea8-baab-7ca3c59fe577"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "0dcc33de-53c3-4ea8-baab-7ca3c59fe577"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XTEX", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c5009294703b"}}, 2020-07-16T13:28:33.812 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2020-07-16T13:28:34.955 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-W3PBpVSOGUrJj21EUDeScLXma2eVMsVcsaS0t4oeV0R2jxGqW3VLvcGInGs3n0Wt'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.078029", "end": "2020-07-16 13:28:34.915136", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-W3PBpVSOGUrJj21EUDeScLXma2eVMsVcsaS0t4oeV0R2jxGqW3VLvcGInGs3n0Wt"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 13:28:33.837107", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-07-16T13:28:34.997 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:34 +0000 (0:00:07.854) 0:04:55.144 ********* 2020-07-16T13:28:35.071 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-34MJaBgqJoO0RVJY2gpjVJHPcSlyuhVLyojy9uEHSWbQPJEOA6SgAxaovFgvf9rR'], 'uuids': ['d75f6ab0-8fea-40f3-9e05-8a8099487905'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.072631", "end": "2020-07-16 13:28:35.039971", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-34MJaBgqJoO0RVJY2gpjVJHPcSlyuhVLyojy9uEHSWbQPJEOA6SgAxaovFgvf9rR"], "labels": [], "masters": [], "uuids": ["d75f6ab0-8fea-40f3-9e05-8a8099487905"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 13:28:33.967340", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-07-16T13:28:35.118 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:35 +0000 (0:00:00.121) 0:04:55.265 ********* 2020-07-16T13:28:35.374 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-07-16T13:28:35.376 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-W3PBpVSOGUrJj21EUDeScLXma2eVMsVcuvtl76KLEu1CDM21XdidnWosFk40N9Vg'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.139890", "end": "2020-07-16 13:28:35.343896", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-W3PBpVSOGUrJj21EUDeScLXma2eVMsVcuvtl76KLEu1CDM21XdidnWosFk40N9Vg"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 13:28:35.204006", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.137129 s, 841 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.137129 s, 841 MB/s"], "stdout": "", "stdout_lines": []} 2020-07-16T13:28:35.505 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-34MJaBgqJoO0RVJY2gpjVJHPcSlyuhVLMVIyIUhh2r2ZLKVzYWwHs5HudTtatNAo'], 'uuids': ['89440f43-d268-40b3-a410-81e86c241cd6'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.137875", "end": "2020-07-16 13:28:35.470370", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-34MJaBgqJoO0RVJY2gpjVJHPcSlyuhVLMVIyIUhh2r2ZLKVzYWwHs5HudTtatNAo"], "labels": [], "masters": [], "uuids": ["89440f43-d268-40b3-a410-81e86c241cd6"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 13:28:35.332495", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.13521 s, 853 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.13521 s, 853 MB/s"], "stdout": "", "stdout_lines": []} 2020-07-16T13:28:35.602 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-pPYlkb-JfOJ-6ldX-QdBu-XqH4-o316-GmtlUz', 'nvme-INTEL_SSDPEDMD400G4_CVFT6232000B400BGN', 'nvme-nvme.8086-43564654363233323030304234303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.037094", "end": "2020-07-16 13:28:35.568763", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-pPYlkb-JfOJ-6ldX-QdBu-XqH4-o316-GmtlUz", "nvme-INTEL_SSDPEDMD400G4_CVFT6232000B400BGN", "nvme-nvme.8086-43564654363233323030304234303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 13:28:35.531669", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0345083 s, 3.3 GB/s", "std 2020-07-16T13:28:35.604 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0345083 s, 3.3 GB/s"], "stdout": "", "stdout_lines": []} 2020-07-16T13:28:35.731 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-F76TU5-qskG-jqcH-ROE1-zLa5-bO7s-Dnnvs0', 'nvme-INTEL_SSDPEDMD400G4_PHFT620500MP400BGN', 'nvme-nvme.8086-504846543632303530304d5034303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.037158", "end": "2020-07-16 13:28:35.704209", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-F76TU5-qskG-jqcH-ROE1-zLa5-bO7s-Dnnvs0", "nvme-INTEL_SSDPEDMD400G4_PHFT620500MP400BGN", "nvme-nvme.8086-504846543632303530304d5034303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 13:28:35.667051", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0346158 s, 3.3 GB/s", "std 2020-07-16T13:28:35.732 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0346158 s, 3.3 GB/s"], "stdout": "", "stdout_lines": []} 2020-07-16T13:28:35.929 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-W3PBpVSOGUrJj21EUDeScLXma2eVMsVccOf52HgcPjQb9LFJ43dr3JKB1z5cAlXj'], 'uuids': ['505b0ae2-5788-4a58-b658-98b3bf151368'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.140445", "end": "2020-07-16 13:28:35.907358", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-W3PBpVSOGUrJj21EUDeScLXma2eVMsVccOf52HgcPjQb9LFJ43dr3JKB1z5cAlXj"], "labels": [], "masters": [], "uuids": ["505b0ae2-5788-4a58-b658-98b3bf151368"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 13:28:35.766913", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.13794 s, 836 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.13794 s, 836 MB/s"], "stdout": "", "stdout_lines": []} 2020-07-16T13:28:36.057 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-34MJaBgqJoO0RVJY2gpjVJHPcSlyuhVL4HMyh2ShVqgdFevt2iMcUuPHgyTlhyDz'], 'uuids': ['0f4c8b2c-73a5-4f34-8d1c-038c1ef3680e'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.140409", "end": "2020-07-16 13:28:36.032041", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-34MJaBgqJoO0RVJY2gpjVJHPcSlyuhVL4HMyh2ShVqgdFevt2iMcUuPHgyTlhyDz"], "labels": [], "masters": [], "uuids": ["0f4c8b2c-73a5-4f34-8d1c-038c1ef3680e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 13:28:35.891632", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.137785 s, 837 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.137785 s, 837 MB/s"], "stdout": "", "stdout_lines": []} 2020-07-16T13:28:36.275 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-W3PBpVSOGUrJj21EUDeScLXma2eVMsVcE2su2R2Dt9eIjAIxNNmVFxBAMLsQOaBh'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.148613", "end": "2020-07-16 13:28:36.243996", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-W3PBpVSOGUrJj21EUDeScLXma2eVMsVcE2su2R2Dt9eIjAIxNNmVFxBAMLsQOaBh"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 13:28:36.095383", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.146034 s, 790 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.146034 s, 790 MB/s"], "stdout": "", "stdout_lines": []} 2020-07-16T13:28:36.395 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-34MJaBgqJoO0RVJY2gpjVJHPcSlyuhVLnWnc1UCOpWt7Tux0wZlTe2OIviZyUvE2'], 'uuids': ['a7c382b4-f05b-42f2-928c-c88a414abdfd'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.138346", "end": "2020-07-16 13:28:36.356849", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-34MJaBgqJoO0RVJY2gpjVJHPcSlyuhVLnWnc1UCOpWt7Tux0wZlTe2OIviZyUvE2"], "labels": [], "masters": [], "uuids": ["a7c382b4-f05b-42f2-928c-c88a414abdfd"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 13:28:36.218503", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.135834 s, 849 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.135834 s, 849 MB/s"], "stdout": "", "stdout_lines": []} 2020-07-16T13:28:36.605 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-W3PBpVSOGUrJj21EUDeScLXma2eVMsVcHWNLUARZI2S0qLPOavtu4TyKocXCbNAk'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.141063", "end": "2020-07-16 13:28:36.575338", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-W3PBpVSOGUrJj21EUDeScLXma2eVMsVcHWNLUARZI2S0qLPOavtu4TyKocXCbNAk"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 13:28:36.434275", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.138509 s, 833 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.138509 s, 833 MB/s"], "stdout": "", "stdout_lines": []} 2020-07-16T13:28:36.618 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XM6D', 'wwn-0x5000c500929332c1'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5XM6D', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c500929332c1', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XM6D-part1', 'wwn-0x5000c500929332c1-part1'], 'uuids': ['0dcc33de-53c3-4ea8-baab-7ca3c59fe577'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '0dcc33de-53c3-4ea8-baab-7ca3c59fe577', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XM6D", "wwn-0x5000c500929332c1"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XM6D-part1", "wwn-0x5000c500929332c1-part1"], "labels": [], "masters": [], "uuids": ["0dcc33de-53c3-4ea8-baab-7ca3c59fe577"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "0dcc33de-53c3-4ea8-baab-7ca3c59fe577"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XM6D", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500929332c1"}}, 2020-07-16T13:28:36.620 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2020-07-16T13:28:36.735 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-34MJaBgqJoO0RVJY2gpjVJHPcSlyuhVLNDCdorO2BIGFezA77aJgVSpF41fuXNde'], 'uuids': ['644d25cb-9c0e-46ce-8ad3-b640877fd885'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.149616", "end": "2020-07-16 13:28:36.700674", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-34MJaBgqJoO0RVJY2gpjVJHPcSlyuhVLNDCdorO2BIGFezA77aJgVSpF41fuXNde"], "labels": [], "masters": [], "uuids": ["644d25cb-9c0e-46ce-8ad3-b640877fd885"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 13:28:36.551058", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.146961 s, 785 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.146961 s, 785 MB/s"], "stdout": "", "stdout_lines": []} 2020-07-16T13:28:36.736 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XTEX', 'wwn-0x5000c5009294703b'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5XTEX', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c5009294703b', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XTEX-part1', 'wwn-0x5000c5009294703b-part1'], 'uuids': ['0dcc33de-53c3-4ea8-baab-7ca3c59fe577'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '0dcc33de-53c3-4ea8-baab-7ca3c59fe577', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XTEX", "wwn-0x5000c5009294703b"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XTEX-part1", "wwn-0x5000c5009294703b-part1"], "labels": [], "masters": [], "uuids": ["0dcc33de-53c3-4ea8-baab-7ca3c59fe577"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "0dcc33de-53c3-4ea8-baab-7ca3c59fe577"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XTEX", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c5009294703b"}}, 2020-07-16T13:28:36.738 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2020-07-16T13:28:36.944 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-W3PBpVSOGUrJj21EUDeScLXma2eVMsVcsaS0t4oeV0R2jxGqW3VLvcGInGs3n0Wt'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.146944", "end": "2020-07-16 13:28:36.918497", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-W3PBpVSOGUrJj21EUDeScLXma2eVMsVcsaS0t4oeV0R2jxGqW3VLvcGInGs3n0Wt"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 13:28:36.771553", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.144379 s, 799 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.144379 s, 799 MB/s"], "stdout": "", "stdout_lines": []} 2020-07-16T13:28:36.983 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:36 +0000 (0:00:01.865) 0:04:57.130 ********* 2020-07-16T13:28:37.068 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-34MJaBgqJoO0RVJY2gpjVJHPcSlyuhVLyojy9uEHSWbQPJEOA6SgAxaovFgvf9rR'], 'uuids': ['d75f6ab0-8fea-40f3-9e05-8a8099487905'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.138911", "end": "2020-07-16 13:28:37.038949", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-34MJaBgqJoO0RVJY2gpjVJHPcSlyuhVLyojy9uEHSWbQPJEOA6SgAxaovFgvf9rR"], "labels": [], "masters": [], "uuids": ["d75f6ab0-8fea-40f3-9e05-8a8099487905"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 13:28:36.900038", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.136421 s, 845 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.136421 s, 845 MB/s"], "stdout": "", "stdout_lines": []} 2020-07-16T13:28:37.110 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:37 +0000 (0:00:00.126) 0:04:57.257 ********* 2020-07-16T13:28:37.277 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** changed: [smithi132.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.073087", "end": "2020-07-16 13:28:37.246764", "rc": 0, "start": "2020-07-16 13:28:37.173677", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T13:28:37.321 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:37 +0000 (0:00:00.211) 0:04:57.468 ********* 2020-07-16T13:28:37.388 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.061481", "end": "2020-07-16 13:28:37.349011", "rc": 0, "start": "2020-07-16 13:28:37.287530", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T13:28:37.457 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:37 +0000 (0:00:00.135) 0:04:57.604 ********* 2020-07-16T13:28:37.590 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2020-07-16T13:28:37.592 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.054524", "end": "2020-07-16 13:28:37.556668", "rc": 0, "start": "2020-07-16 13:28:37.502144", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T13:28:37.635 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:37 +0000 (0:00:00.174) 0:04:57.778 ********* 2020-07-16T13:28:37.671 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-07-16T13:28:37.709 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:37 +0000 (0:00:00.077) 0:04:57.855 ********* 2020-07-16T13:28:37.724 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2020-07-16T13:28:37.727 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.050100", "end": "2020-07-16 13:28:37.683736", "rc": 0, "start": "2020-07-16 13:28:37.633636", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T13:28:37.765 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:37 +0000 (0:00:00.055) 0:04:57.911 ********* 2020-07-16T13:28:37.776 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2020-07-16T13:28:37.777 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:37.818 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:37 +0000 (0:00:00.053) 0:04:57.964 ********* 2020-07-16T13:28:37.829 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-07-16T13:28:37.869 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:37 +0000 (0:00:00.050) 0:04:58.015 ********* 2020-07-16T13:28:37.880 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2020-07-16T13:28:37.882 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:37.917 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:37 +0000 (0:00:00.048) 0:04:58.064 ********* 2020-07-16T13:28:37.928 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2020-07-16T13:28:37.930 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:37.967 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:37 +0000 (0:00:00.050) 0:04:58.114 ********* 2020-07-16T13:28:37.978 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-07-16T13:28:37.980 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:38.022 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:38 +0000 (0:00:00.054) 0:04:58.169 ********* 2020-07-16T13:28:38.034 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2020-07-16T13:28:38.036 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:38.071 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:38 +0000 (0:00:00.048) 0:04:58.218 ********* 2020-07-16T13:28:38.082 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-07-16T13:28:38.084 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:38.119 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:38 +0000 (0:00:00.048) 0:04:58.266 ********* 2020-07-16T13:28:38.131 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-07-16T13:28:38.133 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:38.177 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:38 +0000 (0:00:00.057) 0:04:58.324 ********* 2020-07-16T13:28:38.231 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-07-16T13:28:38.233 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:38.284 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:38 +0000 (0:00:00.107) 0:04:58.431 ********* 2020-07-16T13:28:38.337 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2020-07-16T13:28:38.339 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-07-16T13:28:38.384 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:38 +0000 (0:00:00.099) 0:04:58.531 ********* 2020-07-16T13:28:38.442 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-07-16T13:28:38.444 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930490896384, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227170629, 'block_used': 12924479, 'inode_total': 61054976, 'inode_available': 60986774, 'inode_used': 68202, 'uuid': '0dcc33de-53c3-4ea8-baab-7ca3c59fe577'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227170629, "block_size": 4096, "block_total": 240095108, "block_used": 12924479, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986774, "inode_total": 61054976, "inode_used": 68202, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930490896384, "size_total": 983429562368, "uuid": "0dcc33de-53c3-4ea8-baab-7ca3c59fe577"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:38.485 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:38 +0000 (0:00:00.101) 0:04:58.632 ********* 2020-07-16T13:28:38.495 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2020-07-16T13:28:38.496 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-07-16T13:28:38.542 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:38 +0000 (0:00:00.057) 0:04:58.689 ********* 2020-07-16T13:28:38.551 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-07-16T13:28:38.553 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:38.599 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:38 +0000 (0:00:00.056) 0:04:58.745 ********* 2020-07-16T13:28:38.609 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-07-16T13:28:38.610 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930490892288, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227170628, 'block_used': 12924480, 'inode_total': 61054976, 'inode_available': 60986774, 'inode_used': 68202, 'uuid': '0dcc33de-53c3-4ea8-baab-7ca3c59fe577'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227170628, "block_size": 4096, "block_total": 240095108, "block_used": 12924480, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986774, "inode_total": 61054976, "inode_used": 68202, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930490892288, "size_total": 983429562368, "uuid": "0dcc33de-53c3-4ea8-baab-7ca3c59fe577"}, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:38.668 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:38 +0000 (0:00:00.069) 0:04:58.815 ********* 2020-07-16T13:28:38.677 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-07-16T13:28:38.680 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:38.716 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:38 +0000 (0:00:00.048) 0:04:58.863 ********* 2020-07-16T13:28:38.726 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-07-16T13:28:38.728 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:38.764 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:38 +0000 (0:00:00.047) 0:04:58.911 ********* 2020-07-16T13:28:38.773 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-07-16T13:28:38.775 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:38.813 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:38 +0000 (0:00:00.049) 0:04:58.960 ********* 2020-07-16T13:28:38.824 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-07-16T13:28:38.826 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:38.872 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:38 +0000 (0:00:00.058) 0:04:59.019 ********* 2020-07-16T13:28:38.881 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-07-16T13:28:38.883 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:38.925 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:38 +0000 (0:00:00.053) 0:04:59.072 ********* 2020-07-16T13:28:38.936 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-07-16T13:28:38.939 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:38.979 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:38 +0000 (0:00:00.053) 0:04:59.125 ********* 2020-07-16T13:28:38.988 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-07-16T13:28:38.990 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:39.027 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:39 +0000 (0:00:00.048) 0:04:59.174 ********* 2020-07-16T13:28:39.047 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-07-16T13:28:39.049 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:39.097 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:39 +0000 (0:00:00.070) 0:04:59.244 ********* 2020-07-16T13:28:39.107 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-07-16T13:28:39.109 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:39.144 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:39 +0000 (0:00:00.046) 0:04:59.291 ********* 2020-07-16T13:28:39.155 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-07-16T13:28:39.157 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:39.195 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:39 +0000 (0:00:00.051) 0:04:59.342 ********* 2020-07-16T13:28:39.227 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-07-16T13:28:39.229 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:39.265 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:39 +0000 (0:00:00.069) 0:04:59.412 ********* 2020-07-16T13:28:39.931 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** changed: [smithi188.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-07-16T13:28:39.974 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:39 +0000 (0:00:00.709) 0:05:00.121 ********* 2020-07-16T13:28:39.992 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-07-16T13:28:40.034 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:40 +0000 (0:00:00.057) 0:05:00.178 ********* 2020-07-16T13:28:40.629 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-07-16T13:28:40.631 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-07-16T13:28:40.686 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-07-16T13:28:40.974 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-07-16T13:28:41.083 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-07-16T13:28:41.330 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-07-16T13:28:41.435 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-07-16T13:28:41.670 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-07-16T13:28:41.776 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-07-16T13:28:42.020 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-07-16T13:28:42.064 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:42 +0000 (0:00:02.032) 0:05:02.211 ********* 2020-07-16T13:28:42.126 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-07-16T13:28:42.166 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:42 +0000 (0:00:00.102) 0:05:02.313 ********* 2020-07-16T13:28:42.289 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-07-16T13:28:42.291 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-07-16T13:28:42.342 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:42 +0000 (0:00:00.175) 0:05:02.489 ********* 2020-07-16T13:28:42.400 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-07-16T13:28:42.454 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:42 +0000 (0:00:00.111) 0:05:02.601 ********* 2020-07-16T13:28:42.570 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-07-16T13:28:42.572 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-07-16T13:28:42.691 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-07-16T13:28:42.772 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-07-16T13:28:42.909 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-07-16T13:28:42.982 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-07-16T13:28:43.125 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-07-16T13:28:43.170 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-07-16T13:28:43.184 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:43.247 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:43 +0000 (0:00:00.793) 0:05:03.394 ********* 2020-07-16T13:28:43.337 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-07-16T13:28:43.338 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:43.388 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:43 +0000 (0:00:00.141) 0:05:03.535 ********* 2020-07-16T13:28:43.471 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2020-07-16T13:28:43.473 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-07-16T13:28:43.512 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:43 +0000 (0:00:00.122) 0:05:03.658 ********* 2020-07-16T13:28:43.554 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2020-07-16T13:28:43.555 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:43.591 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:43 +0000 (0:00:00.079) 0:05:03.738 ********* 2020-07-16T13:28:43.602 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2020-07-16T13:28:43.603 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-07-16T13:28:43.642 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:43 +0000 (0:00:00.051) 0:05:03.789 ********* 2020-07-16T13:28:43.683 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:43.721 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:43 +0000 (0:00:00.078) 0:05:03.868 ********* 2020-07-16T13:28:44.147 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2020-07-16T13:28:44.149 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => {"changed": true} 2020-07-16T13:28:44.197 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:44 +0000 (0:00:00.476) 0:05:04.344 ********* 2020-07-16T13:28:44.780 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2020-07-16T13:28:44.781 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-07-16T13:28:44.813 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:44 +0000 (0:00:00.616) 0:05:04.960 ********* 2020-07-16T13:28:44.844 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-07-16T13:28:44.846 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:44.885 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:44 +0000 (0:00:00.071) 0:05:05.032 ********* 2020-07-16T13:28:44.916 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2020-07-16T13:28:44.917 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:44.965 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:44 +0000 (0:00:00.079) 0:05:05.112 ********* 2020-07-16T13:28:44.994 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2020-07-16T13:28:44.996 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:45.032 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:45 +0000 (0:00:00.065) 0:05:05.177 ********* 2020-07-16T13:28:45.061 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:45.096 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:45 +0000 (0:00:00.065) 0:05:05.243 ********* 2020-07-16T13:28:45.126 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2020-07-16T13:28:45.128 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:45.182 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:45 +0000 (0:00:00.085) 0:05:05.328 ********* 2020-07-16T13:28:45.190 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2020-07-16T13:28:45.193 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"changed": true} 2020-07-16T13:28:45.227 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:45 +0000 (0:00:00.045) 0:05:05.374 ********* 2020-07-16T13:28:45.235 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2020-07-16T13:28:45.237 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:45.276 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:45 +0000 (0:00:00.049) 0:05:05.423 ********* 2020-07-16T13:28:45.313 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2020-07-16T13:28:45.316 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:45.348 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:45 +0000 (0:00:00.071) 0:05:05.495 ********* 2020-07-16T13:28:45.380 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:45.414 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:45 +0000 (0:00:00.065) 0:05:05.560 ********* 2020-07-16T13:28:45.443 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-07-16T13:28:45.445 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:45.484 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:45 +0000 (0:00:00.070) 0:05:05.631 ********* 2020-07-16T13:28:45.513 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2020-07-16T13:28:45.515 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:45.550 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:45 +0000 (0:00:00.065) 0:05:05.697 ********* 2020-07-16T13:28:45.579 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:45.613 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:45 +0000 (0:00:00.062) 0:05:05.760 ********* 2020-07-16T13:28:46.116 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2020-07-16T13:28:46.118 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2020-07-16T13:28:46.155 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:46 +0000 (0:00:00.541) 0:05:06.302 ********* 2020-07-16T13:28:46.481 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-07-16T13:28:46.483 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2020-07-16 13:22:39 UTC", "ActiveEnterTimestampMonotonic": "16484463", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "sysinit.target ntpdate.service systemd-journald.socket ntpd.service tmp.mount -.mount system.slice systemd-tmpfiles-setup.service sntp.service basic.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2020-07-16 13:22:38 UTC", "AssertTimestampMonotonic": "15367813", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2020-07-16 13:22:38 UTC", "ConditionTimestampMonotonic": "15367789", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service ntpd.service shutdown.target", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description" 2020-07-16T13:28:46.485 INFO:teuthology.task.ansible.out:: "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2413", "ExecMainStartTimestamp": "Thu 2020-07-16 13:22:39 UTC", "ExecMainStartTimestampMonotonic": "16454691", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2020-07-16 13:22:38 UTC", "InactiveExitTimestampMonotonic": "15386136", "InvocationID": "1bd33d792bed4f12bc0ad11ed3e35308", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "167772 2020-07-16T13:28:46.486 INFO:teuthology.task.ansible.out:16", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127425", "LimitNPROCSoft": "127425", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127425", "LimitSIGPENDINGSoft": "127425", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2413", "MemoryAccounting": "yes", "MemoryCurrent": "3006464", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardE 2020-07-16T13:28:46.488 INFO:teuthology.task.ansible.out:rror": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2020-07-16 13:22:39 UTC", "StateChangeTimestampMonotonic": "16484463", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2020-07-16 13:22:39 UTC", "WatchdogTimestampMonotonic": "16454703", "WatchdogUSec": "0"}} 2020-07-16T13:28:46.523 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:46 +0000 (0:00:00.368) 0:05:06.670 ********* 2020-07-16T13:28:46.565 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-07-16T13:28:46.567 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2020-07-16T13:28:46.624 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:46 +0000 (0:00:00.096) 0:05:06.767 ********* 2020-07-16T13:28:46.632 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2020-07-16T13:28:46.634 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-07-16T13:28:46.670 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:46 +0000 (0:00:00.049) 0:05:06.817 ********* 2020-07-16T13:28:46.672 INFO:teuthology.task.ansible.out: 2020-07-16T13:28:46.681 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-07-16T13:28:46.683 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2020-07-16T13:28:46.723 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:46 +0000 (0:00:00.048) 0:05:06.865 ********* 2020-07-16T13:28:46.728 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-07-16T13:28:46.730 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:46.764 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:46 +0000 (0:00:00.045) 0:05:06.911 ********* 2020-07-16T13:28:46.773 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2020-07-16T13:28:46.774 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:46.814 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:46 +0000 (0:00:00.049) 0:05:06.961 ********* 2020-07-16T13:28:46.823 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2020-07-16T13:28:46.825 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:46.859 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:46 +0000 (0:00:00.045) 0:05:07.006 ********* 2020-07-16T13:28:46.867 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-07-16T13:28:46.869 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:46.910 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:46 +0000 (0:00:00.050) 0:05:07.056 ********* 2020-07-16T13:28:46.919 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2020-07-16T13:28:46.921 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:46.955 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:46 +0000 (0:00:00.045) 0:05:07.102 ********* 2020-07-16T13:28:46.964 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-07-16T13:28:46.966 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:47.000 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:46 +0000 (0:00:00.045) 0:05:07.147 ********* 2020-07-16T13:28:47.017 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:47.047 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:47 +0000 (0:00:00.046) 0:05:07.193 ********* 2020-07-16T13:28:47.076 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2020-07-16T13:28:47.078 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:47.113 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:47 +0000 (0:00:00.066) 0:05:07.260 ********* 2020-07-16T13:28:47.143 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2020-07-16T13:28:47.145 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:47.183 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:47 +0000 (0:00:00.070) 0:05:07.330 ********* 2020-07-16T13:28:47.221 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2020-07-16T13:28:47.223 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create the .pip directory for the teuthology user.] *********** ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2020-07-16T13:28:47.256 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:47 +0000 (0:00:00.072) 0:05:07.403 ********* 2020-07-16T13:28:47.292 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:47 +0000 (0:00:00.036) 0:05:07.439 ********* 2020-07-16T13:28:47.300 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2020-07-16T13:28:47.302 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:47.350 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:47 +0000 (0:00:00.058) 0:05:07.497 ********* 2020-07-16T13:28:47.390 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-07-16T13:28:47.392 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:47.425 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:47 +0000 (0:00:00.074) 0:05:07.572 ********* 2020-07-16T13:28:47.467 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2020-07-16T13:28:47.469 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:47.504 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:47 +0000 (0:00:00.075) 0:05:07.648 ********* 2020-07-16T13:28:47.533 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2020-07-16T13:28:47.535 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:47.577 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:47 +0000 (0:00:00.076) 0:05:07.724 ********* 2020-07-16T13:28:47.852 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2020-07-16T13:28:47.853 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2020-07-16T13:28:47.902 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:47 +0000 (0:00:00.324) 0:05:08.049 ********* 2020-07-16T13:28:48.092 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2020-07-16T13:28:48.147 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:48 +0000 (0:00:00.244) 0:05:08.293 ********* 2020-07-16T13:28:48.471 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-07-16T13:28:48.478 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2020-07-16 13:22:38 UTC", "ActiveEnterTimestampMonotonic": "15762273", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "sysinit.target systemd-tmpfiles-setup.service basic.target ntpd.service system.slice -.mount systemd-journald.socket tmp.mount sntp.service ntpdate.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2020-07-16 13:22:37 UTC", "AssertTimestampMonotonic": "14514448", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2020-07-16 13:22:37 UTC", "ConditionTimestampMonotonic": "14514418", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target ntpd.service systemd-timesyncd.service", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description" 2020-07-16T13:28:48.480 INFO:teuthology.task.ansible.out:: "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2463", "ExecMainStartTimestamp": "Thu 2020-07-16 13:22:38 UTC", "ExecMainStartTimestampMonotonic": "15694947", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2020-07-16 13:22:37 UTC", "InactiveExitTimestampMonotonic": "14528134", "InvocationID": "6b044fde38344433beeef9a1a5e25a13", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "167772 2020-07-16T13:28:48.481 INFO:teuthology.task.ansible.out:16", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127425", "LimitNPROCSoft": "127425", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127425", "LimitSIGPENDINGSoft": "127425", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2463", "MemoryAccounting": "yes", "MemoryCurrent": "2527232", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardE 2020-07-16T13:28:48.483 INFO:teuthology.task.ansible.out:rror": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2020-07-16 13:22:38 UTC", "StateChangeTimestampMonotonic": "15762273", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2020-07-16 13:22:38 UTC", "WatchdogTimestampMonotonic": "15694961", "WatchdogUSec": "0"}} 2020-07-16T13:28:48.518 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:48 +0000 (0:00:00.371) 0:05:08.665 ********* 2020-07-16T13:28:48.549 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-07-16T13:28:48.551 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2020-07-16T13:28:48.589 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:48 +0000 (0:00:00.070) 0:05:08.736 ********* 2020-07-16T13:28:48.630 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-07-16T13:28:48.633 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2020-07-16T13:28:48.672 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:48 +0000 (0:00:00.082) 0:05:08.819 ********* 2020-07-16T13:28:48.713 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2020-07-16T13:28:48.714 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:48.752 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:48 +0000 (0:00:00.080) 0:05:08.899 ********* 2020-07-16T13:28:48.785 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-07-16T13:28:48.786 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:48.822 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:48 +0000 (0:00:00.069) 0:05:08.969 ********* 2020-07-16T13:28:48.857 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-07-16T13:28:48.862 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:48.898 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:48 +0000 (0:00:00.076) 0:05:09.045 ********* 2020-07-16T13:28:49.116 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2020-07-16T13:28:49.154 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:49 +0000 (0:00:00.256) 0:05:09.301 ********* 2020-07-16T13:28:49.345 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-07-16T13:28:49.383 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:49 +0000 (0:00:00.227) 0:05:09.529 ********* 2020-07-16T13:28:49.416 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2020-07-16T13:28:49.417 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:49.458 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:49 +0000 (0:00:00.075) 0:05:09.605 ********* 2020-07-16T13:28:49.505 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2020-07-16T13:28:49.507 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2020-07-16T13:28:49.547 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:49 +0000 (0:00:00.089) 0:05:09.694 ********* 2020-07-16T13:28:49.679 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2020-07-16T13:28:49.680 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2020-07-16T13:28:49.720 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:49 +0000 (0:00:00.172) 0:05:09.867 ********* 2020-07-16T13:28:49.763 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2020-07-16T13:28:49.764 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2020-07-16T13:28:49.823 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:49 +0000 (0:00:00.103) 0:05:09.970 ********* 2020-07-16T13:28:49.855 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2020-07-16T13:28:49.862 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:49.916 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:49 +0000 (0:00:00.092) 0:05:10.063 ********* 2020-07-16T13:28:49.949 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2020-07-16T13:28:49.951 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-07-16T13:28:50.000 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:49 +0000 (0:00:00.083) 0:05:10.146 ********* 2020-07-16T13:28:50.029 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2020-07-16T13:28:50.031 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:50.068 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:50 +0000 (0:00:00.068) 0:05:10.215 ********* 2020-07-16T13:28:50.275 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2020-07-16T13:28:50.277 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-07-16T13:28:50.326 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:50 +0000 (0:00:00.258) 0:05:10.473 ********* 2020-07-16T13:28:50.535 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2020-07-16T13:28:50.537 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-07-16T13:28:50.578 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:50 +0000 (0:00:00.252) 0:05:10.725 ********* 2020-07-16T13:28:50.621 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2020-07-16T13:28:50.622 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:50.659 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:50 +0000 (0:00:00.079) 0:05:10.805 ********* 2020-07-16T13:28:50.726 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2020-07-16T13:28:50.727 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2020-07-16T13:28:50.737 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2020-07-16T13:28:50.739 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2020-07-16T13:28:50.773 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:50 +0000 (0:00:00.114) 0:05:10.920 ********* 2020-07-16T13:28:50.819 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-07-16T13:28:50.821 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:50.831 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:50.833 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:50.843 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:50.844 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:50.879 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:50 +0000 (0:00:00.105) 0:05:11.026 ********* 2020-07-16T13:28:50.888 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2020-07-16T13:28:50.890 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-07-16T13:28:50.930 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:50 +0000 (0:00:00.050) 0:05:11.077 ********* 2020-07-16T13:28:50.939 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-07-16T13:28:50.941 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:50.980 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:50 +0000 (0:00:00.050) 0:05:11.127 ********* 2020-07-16T13:28:50.990 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2020-07-16T13:28:50.992 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:51.032 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:51 +0000 (0:00:00.051) 0:05:11.179 ********* 2020-07-16T13:28:51.042 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2020-07-16T13:28:51.046 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:51.082 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:51 +0000 (0:00:00.050) 0:05:11.229 ********* 2020-07-16T13:28:51.084 INFO:teuthology.task.ansible.out: 2020-07-16T13:28:51.091 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2020-07-16T13:28:51.093 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2020-07-16T13:28:51.138 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:51 +0000 (0:00:00.055) 0:05:11.285 ********* 2020-07-16T13:28:51.149 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2020-07-16T13:28:51.151 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:51.197 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:51 +0000 (0:00:00.059) 0:05:11.344 ********* 2020-07-16T13:28:51.239 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2020-07-16T13:28:51.241 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:51.274 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:51 +0000 (0:00:00.076) 0:05:11.421 ********* 2020-07-16T13:28:51.308 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:51.352 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:51 +0000 (0:00:00.077) 0:05:11.499 ********* 2020-07-16T13:28:51.361 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2020-07-16T13:28:51.362 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2020-07-16T13:28:51.398 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:51 +0000 (0:00:00.046) 0:05:11.545 ********* 2020-07-16T13:28:51.407 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-07-16T13:28:51.409 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:51.447 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:51 +0000 (0:00:00.048) 0:05:11.594 ********* 2020-07-16T13:28:51.458 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:51.498 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:51 +0000 (0:00:00.051) 0:05:11.645 ********* 2020-07-16T13:28:51.508 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2020-07-16T13:28:51.509 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:51.555 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:51 +0000 (0:00:00.057) 0:05:11.702 ********* 2020-07-16T13:28:51.566 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** ok: [smithi132.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-07-16T13:28:51.603 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:51 +0000 (0:00:00.047) 0:05:11.750 ********* 2020-07-16T13:28:51.613 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-07-16T13:28:51.615 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:51.651 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:51 +0000 (0:00:00.047) 0:05:11.798 ********* 2020-07-16T13:28:51.660 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2020-07-16T13:28:51.661 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:51.698 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:51 +0000 (0:00:00.046) 0:05:11.845 ********* 2020-07-16T13:28:51.898 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** changed: [smithi132.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-07-16T13:28:51.936 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:51 +0000 (0:00:00.238) 0:05:12.083 ********* 2020-07-16T13:28:51.946 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-07-16T13:28:51.948 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.004946", "end": "2020-07-16 13:28:51.857260", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-07-16 13:28:51.852314", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T13:28:52.081 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.002909", "end": "2020-07-16 13:28:52.054009", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-07-16 13:28:52.051100", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T13:28:52.156 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* changed: [smithi132.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-07-16T13:28:52.199 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:52 +0000 (0:00:00.262) 0:05:12.346 ********* 2020-07-16T13:28:52.231 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2020-07-16T13:28:52.233 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:52.269 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:52 +0000 (0:00:00.069) 0:05:12.416 ********* 2020-07-16T13:28:52.282 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-07-16T13:28:52.283 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002784", "end": "2020-07-16 13:28:52.233584", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-07-16 13:28:52.230800", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2020-07-16T13:28:52.304 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2020-07-16T13:28:52.306 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2020-07-16T13:28:52.315 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2020-07-16T13:28:52.316 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2020-07-16T13:28:52.326 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2020-07-16T13:28:52.328 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2020-07-16T13:28:52.367 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:52 +0000 (0:00:00.097) 0:05:12.514 ********* 2020-07-16T13:28:52.421 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-07-16T13:28:52.423 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:52.438 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:52.439 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:52.449 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:52.457 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-07-16T13:28:52.459 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.003179", "end": "2020-07-16 13:28:52.415747", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-07-16 13:28:52.412568", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T13:28:52.497 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:52 +0000 (0:00:00.130) 0:05:12.644 ********* 2020-07-16T13:28:52.555 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:52 +0000 (0:00:00.057) 0:05:12.702 ********* 2020-07-16T13:28:52.566 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-07-16T13:28:52.568 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:52.608 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:52 +0000 (0:00:00.052) 0:05:12.755 ********* 2020-07-16T13:28:52.622 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-07-16T13:28:52.653 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:52 +0000 (0:00:00.044) 0:05:12.800 ********* 2020-07-16T13:28:52.661 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2020-07-16T13:28:52.663 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:52.698 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:52 +0000 (0:00:00.045) 0:05:12.845 ********* 2020-07-16T13:28:52.727 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2020-07-16T13:28:52.729 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:52.765 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:52 +0000 (0:00:00.067) 0:05:12.912 ********* 2020-07-16T13:28:52.795 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2020-07-16T13:28:52.796 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:52.829 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:52 +0000 (0:00:00.063) 0:05:12.976 ********* 2020-07-16T13:28:52.849 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2020-07-16T13:28:52.853 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2020-07-16T13:28:52.888 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:52 +0000 (0:00:00.059) 0:05:13.035 ********* 2020-07-16T13:28:52.918 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2020-07-16T13:28:52.919 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:53.255 INFO:teuthology.task.ansible.out: RUNNING HANDLER [common : restart nagios-nrpe-server] ************************** 2020-07-16T13:28:53.257 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => {"changed": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2020-07-16 13:26:07 UTC", "ActiveEnterTimestampMonotonic": "224710172", "ActiveExitTimestamp": "Thu 2020-07-16 13:26:07 UTC", "ActiveExitTimestampMonotonic": "224685242", "ActiveState": "active", "After": "local-fs.target tmp.mount systemd-journald.socket systemd-tmpfiles-setup.service system.slice -.mount network.target sysinit.target nss-lookup.target var-run.mount time-sync.target basic.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2020-07-16 13:26:07 UTC", "AssertTimestampMonotonic": "224709045", "Before": "xdm.service getty@tty1.service plymouth-quit.service multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2020-07-16 13:26:07 UTC", "ConditionTimestampMonotonic": "224709044", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": 2020-07-16T13:28:53.258 INFO:teuthology.task.ansible.out: "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "16640", "ExecMainStartTimestamp": "Thu 2020-07-16 13:26:07 UTC", "ExecMainStartTimestampMonotonic": "224710131", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "GID": "986", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Thu 2020-07-16 13:26:07 UTC", "InactiveEnterTimestampMonotonic": "224708395", "InactiveExitTimestamp": "Thu 2020-07-16 13:26:07 UTC", "InactiveExitTimestampMonotonic": "224710172", "InvocationID": "e8e83ba2134a4729890f6ebf6a6f30cd", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infi 2020-07-16T13:28:53.260 INFO:teuthology.task.ansible.out:nity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127425", "LimitNPROCSoft": "127425", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127425", "LimitSIGPENDINGSoft": "127425", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "16640", "MemoryAccounting": "yes", "MemoryCurrent": "901120", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/var/tmp /run/nrpe", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "Restric 2020-07-16T13:28:53.262 INFO:teuthology.task.ansible.out:tRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "nrpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2020-07-16 13:26:07 UTC", "StateChangeTimestampMonotonic": "224710172", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "990", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2020-07-16 13:26:07 UTC", "WatchdogTimestampMonotonic": "224710171", "WatchdogUSec": "0"}} 2020-07-16T13:28:53.304 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:53 +0000 (0:00:00.415) 0:05:13.451 ********* 2020-07-16T13:28:53.359 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-07-16T13:28:53.361 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:53.394 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:53 +0000 (0:00:00.090) 0:05:13.541 ********* 2020-07-16T13:28:53.425 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:53.464 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:53 +0000 (0:00:00.067) 0:05:13.609 ********* 2020-07-16T13:28:53.492 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-07-16T13:28:53.493 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T13:28:53.526 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:53 +0000 (0:00:00.064) 0:05:13.673 ********* 2020-07-16T13:28:53.769 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-07-16T13:28:53.771 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.004816", "end": "2020-07-16 13:28:53.726733", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-07-16 13:28:53.721917", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T13:28:53.970 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.003121", "end": "2020-07-16 13:28:53.929330", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-07-16 13:28:53.926209", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T13:28:54.146 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002823", "end": "2020-07-16 13:28:54.115434", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-07-16 13:28:54.112611", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2020-07-16T13:28:54.331 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.003095", "end": "2020-07-16 13:28:54.296824", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-07-16 13:28:54.293729", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T13:28:54.372 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:54 +0000 (0:00:00.841) 0:05:14.514 ********* 2020-07-16T13:28:54.402 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-07-16T13:28:54.436 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:54 +0000 (0:00:00.068) 0:05:14.583 ********* 2020-07-16T13:28:54.643 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2020-07-16T13:28:54.645 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2020-07-16T13:28:54.681 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 13:28:54 +0000 (0:00:00.244) 0:05:14.828 ********* 2020-07-16T13:28:55.056 INFO:teuthology.task.ansible.out: RUNNING HANDLER [common : restart nagios-nrpe-server] ************************** 2020-07-16T13:28:55.058 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"changed": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2020-07-16 13:26:08 UTC", "ActiveEnterTimestampMonotonic": "226245866", "ActiveExitTimestamp": "Thu 2020-07-16 13:26:08 UTC", "ActiveExitTimestampMonotonic": "226220232", "ActiveState": "active", "After": "network.target time-sync.target sysinit.target var-run.mount local-fs.target system.slice -.mount basic.target nss-lookup.target systemd-journald.socket systemd-tmpfiles-setup.service tmp.mount", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2020-07-16 13:26:08 UTC", "AssertTimestampMonotonic": "226245129", "Before": "plymouth-quit.service multi-user.target xdm.service shutdown.target getty@tty1.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2020-07-16 13:26:08 UTC", "ConditionTimestampMonotonic": "226245128", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": 2020-07-16T13:28:55.059 INFO:teuthology.task.ansible.out: "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "16638", "ExecMainStartTimestamp": "Thu 2020-07-16 13:26:08 UTC", "ExecMainStartTimestampMonotonic": "226245842", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "GID": "986", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Thu 2020-07-16 13:26:08 UTC", "InactiveEnterTimestampMonotonic": "226244395", "InactiveExitTimestamp": "Thu 2020-07-16 13:26:08 UTC", "InactiveExitTimestampMonotonic": "226245866", "InvocationID": "74cc83c020d540a6a67bad0945238aa7", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infi 2020-07-16T13:28:55.061 INFO:teuthology.task.ansible.out:nity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127425", "LimitNPROCSoft": "127425", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127425", "LimitSIGPENDINGSoft": "127425", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "16638", "MemoryAccounting": "yes", "MemoryCurrent": "892928", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/run/nrpe /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "Restric 2020-07-16T13:28:55.062 INFO:teuthology.task.ansible.out:tRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "nrpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2020-07-16 13:26:08 UTC", "StateChangeTimestampMonotonic": "226245866", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "990", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2020-07-16 13:26:08 UTC", "WatchdogTimestampMonotonic": "226245865", "WatchdogUSec": "0"}} 2020-07-16T13:28:55.125 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** 2020-07-16T13:28:55.126 INFO:teuthology.task.ansible.out:skipping: no hosts matched 2020-07-16T13:28:55.131 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** 2020-07-16T13:28:55.131 INFO:teuthology.task.ansible.out:skipping: no hosts matched 2020-07-16T13:28:55.134 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** 2020-07-16T13:28:55.136 INFO:teuthology.task.ansible.out:skipping: no hosts matched PLAY RECAP ********************************************************************* smithi132.front.sepia.ceph.com : ok=128 changed=41 unreachable=0 failed=0 skipped=162 rescued=0 ignored=4 smithi188.front.sepia.ceph.com : ok=128 changed=41 unreachable=0 failed=0 skipped=162 rescued=0 ignored=4 Thursday 16 July 2020 13:28:55 +0000 (0:00:00.453) 0:05:15.282 ********* =============================================================================== common : nrpe - Ensure SELinux policy is up to date -------------------- 41.35s users : Update authorized_keys using the keys repo --------------------- 36.19s users : Create all admin users with sudo access. ----------------------- 35.25s common : nrpe - Remove SELinux policy package -------------------------- 16.43s common : nrpe - Load SELinux policy package ---------------------------- 16.40s testnode : Install packages -------------------------------------------- 12.76s common : Get list of enabled RHSM repos --------------------------------- 9.59s users : Remove revoked users -------------------------------------------- 8.61s common : Register with subscription-manager. ---------------------------- 8.30s testnode : Zap all non-root disks --------------------------------------- 7.85s common : Install nrpe package and dependencies (RHEL/CentOS) ------------ 7.21s testnode : Ensure ceph packages are not present. ------------------------ 5.75s testnode : Ensure ceph dependency packages are not present. ------------- 5.58s common : Disable all rhsm repos ----------------------------------------- 4.48s common : Enable necessary rhsm repos ------------------------------------ 3.46s testnode : Make sure rpm dependencies are installed --------------------- 2.31s testnode : Install epel packages ---------------------------------------- 2.09s common : nrpe - Install SELinux dependencies ---------------------------- 2.07s testnode : Create 2020-07-16T13:28:55.138 INFO:teuthology.task.ansible.out:logical volume(s) ------------------------------------- 2.03s testnode : Remove packages ---------------------------------------------- 2.00s 2020-07-16T13:28:55.471 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi132.front.sepia.ceph.com'), Remote(name='ubuntu@smithi188.front.sepia.ceph.com')] 2020-07-16T13:28:55.472 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-07-16T13:28:55.474 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T13:28:55.544 INFO:teuthology.orchestra.run.smithi132:> true 2020-07-16T13:28:55.625 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-07-16T13:28:55.626 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T13:28:55.702 INFO:teuthology.orchestra.run.smithi188:> true 2020-07-16T13:28:55.791 INFO:teuthology.run_tasks:Running task clock... 2020-07-16T13:28:55.801 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2020-07-16T13:28:55.802 INFO:teuthology.orchestra.run:Running command with timeout 360 2020-07-16T13:28:55.802 INFO:teuthology.orchestra.run.smithi132:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-07-16T13:28:55.836 INFO:teuthology.orchestra.run.smithi132.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2020-07-16T13:28:55.853 INFO:teuthology.orchestra.run.smithi132.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2020-07-16T13:28:55.895 INFO:teuthology.orchestra.run.smithi132.stderr:sudo: ntpd: command not found 2020-07-16T13:28:55.909 INFO:teuthology.orchestra.run.smithi132.stdout:506 Cannot talk to daemon 2020-07-16T13:28:55.926 INFO:teuthology.orchestra.run.smithi132.stderr:Failed to start ntp.service: Unit ntp.service not found. 2020-07-16T13:28:55.943 INFO:teuthology.orchestra.run.smithi132.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2020-07-16T13:28:55.998 INFO:teuthology.orchestra.run.smithi132.stderr:bash: ntpq: command not found 2020-07-16T13:28:56.001 INFO:teuthology.orchestra.run.smithi132.stdout:210 Number of sources = 4 2020-07-16T13:28:56.001 INFO:teuthology.orchestra.run.smithi132.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2020-07-16T13:28:56.001 INFO:teuthology.orchestra.run.smithi132.stdout:=============================================================================== 2020-07-16T13:28:56.002 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-07-16T13:28:56.002 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-07-16T13:28:56.002 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-07-16T13:28:56.002 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-07-16T13:28:56.002 INFO:teuthology.orchestra.run:Running command with timeout 360 2020-07-16T13:28:56.003 INFO:teuthology.orchestra.run.smithi188:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-07-16T13:28:56.043 INFO:teuthology.orchestra.run.smithi188.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2020-07-16T13:28:56.062 INFO:teuthology.orchestra.run.smithi188.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2020-07-16T13:28:56.104 INFO:teuthology.orchestra.run.smithi188.stderr:sudo: ntpd: command not found 2020-07-16T13:28:56.118 INFO:teuthology.orchestra.run.smithi188.stdout:506 Cannot talk to daemon 2020-07-16T13:28:56.136 INFO:teuthology.orchestra.run.smithi188.stderr:Failed to start ntp.service: Unit ntp.service not found. 2020-07-16T13:28:56.154 INFO:teuthology.orchestra.run.smithi188.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2020-07-16T13:28:56.222 INFO:teuthology.orchestra.run.smithi188.stderr:bash: ntpq: command not found 2020-07-16T13:28:56.225 INFO:teuthology.orchestra.run.smithi188.stdout:210 Number of sources = 4 2020-07-16T13:28:56.225 INFO:teuthology.orchestra.run.smithi188.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2020-07-16T13:28:56.225 INFO:teuthology.orchestra.run.smithi188.stdout:=============================================================================== 2020-07-16T13:28:56.226 INFO:teuthology.orchestra.run.smithi188.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-07-16T13:28:56.230 INFO:teuthology.orchestra.run.smithi188.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-07-16T13:28:56.230 INFO:teuthology.orchestra.run.smithi188.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-07-16T13:28:56.231 INFO:teuthology.orchestra.run.smithi188.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-07-16T13:28:56.231 INFO:teuthology.run_tasks:Running task cephadm... 2020-07-16T13:28:56.315 INFO:tasks.cephadm:Config: {'cephadm_branch': 'v15.2.0', 'image': 'docker.io/ceph/ceph:v15.2.0', 'conf': {'global': {'mon election default strategy': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'osd shutdown pgref assert': True}}, 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '7260671e53beca8ba2a87a02b9c7c669f4c30eca'} 2020-07-16T13:28:56.316 INFO:tasks.cephadm:Cluster image is docker.io/ceph/ceph:v15.2.0 2020-07-16T13:28:56.317 INFO:tasks.cephadm:Cluster fsid is 4c8ed362-c768-11ea-a06f-001a4aab830c 2020-07-16T13:28:56.318 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2020-07-16T13:28:56.319 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.132', 'mon.c': '[v2:172.21.15.132:3301,v1:172.21.15.132:6790]', 'mon.b': '172.21.15.188'} 2020-07-16T13:28:56.319 INFO:tasks.cephadm:First mon is mon.a on smithi132 2020-07-16T13:28:56.319 INFO:tasks.cephadm:First mgr is y 2020-07-16T13:28:56.320 INFO:tasks.cephadm:Normalizing hostnames... 2020-07-16T13:28:56.320 INFO:teuthology.orchestra.run.smithi132:> sudo hostname $(hostname -s) 2020-07-16T13:28:56.348 INFO:teuthology.orchestra.run.smithi188:> sudo hostname $(hostname -s) 2020-07-16T13:28:56.376 INFO:tasks.cephadm:Downloading cephadm (repo git://git.ceph.com/ceph-ci.git ref v15.2.0)... 2020-07-16T13:28:56.377 INFO:teuthology.orchestra.run.smithi132:> git archive --remote=git://git.ceph.com/ceph-ci.git v15.2.0 src/cephadm/cephadm | tar -xO src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm 2020-07-16T13:28:56.515 INFO:teuthology.orchestra.run.smithi188:> git archive --remote=git://git.ceph.com/ceph-ci.git v15.2.0 src/cephadm/cephadm | tar -xO src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm 2020-07-16T13:28:56.632 INFO:teuthology.orchestra.run.smithi132:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2020-07-16T13:28:56.647 INFO:teuthology.orchestra.run.smithi188:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2020-07-16T13:28:56.662 INFO:teuthology.orchestra.run.smithi132:> sudo mkdir -p /etc/ceph 2020-07-16T13:28:56.713 INFO:teuthology.orchestra.run.smithi188:> sudo mkdir -p /etc/ceph 2020-07-16T13:28:56.741 INFO:teuthology.orchestra.run.smithi132:> sudo chmod 777 /etc/ceph 2020-07-16T13:28:56.781 INFO:teuthology.orchestra.run.smithi188:> sudo chmod 777 /etc/ceph 2020-07-16T13:28:56.809 INFO:tasks.cephadm:Adding local image mirror vossi04.front.sepia.ceph.com:5000 2020-07-16T13:28:56.839 DEBUG:teuthology.orchestra.remote:smithi132:/etc/containers/registries.conf is 6KB 2020-07-16T13:28:56.907 INFO:teuthology.orchestra.run.smithi132:> sudo sh -c 'cat > /etc/containers/registries.conf' 2020-07-16T13:28:56.978 DEBUG:teuthology.orchestra.remote:smithi188:/etc/containers/registries.conf is 6KB 2020-07-16T13:28:57.058 INFO:teuthology.orchestra.run.smithi188:> sudo sh -c 'cat > /etc/containers/registries.conf' 2020-07-16T13:28:57.104 INFO:tasks.cephadm:Writing seed config... 2020-07-16T13:28:57.105 INFO:tasks.cephadm: override: [global] mon election default strategy = 1 2020-07-16T13:28:57.106 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2020-07-16T13:28:57.106 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2020-07-16T13:28:57.106 INFO:tasks.cephadm: override: [mon] debug mon = 20 2020-07-16T13:28:57.107 INFO:tasks.cephadm: override: [mon] debug ms = 1 2020-07-16T13:28:57.107 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2020-07-16T13:28:57.107 INFO:tasks.cephadm: override: [osd] debug filestore = 20 2020-07-16T13:28:57.108 INFO:tasks.cephadm: override: [osd] debug journal = 20 2020-07-16T13:28:57.108 INFO:tasks.cephadm: override: [osd] debug ms = 20 2020-07-16T13:28:57.108 INFO:tasks.cephadm: override: [osd] debug osd = 25 2020-07-16T13:28:57.108 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2020-07-16T13:28:57.110 INFO:teuthology.orchestra.run.smithi132:> cat > /home/ubuntu/cephtest/seed.ceph.conf 2020-07-16T13:28:57.124 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 4c8ed362-c768-11ea-a06f-001a4aab830c mon election default strategy = 1 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true debug filestore = 20 debug journal = 20 debug ms = 20 debug osd = 25 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2020-07-16T13:28:57.124 INFO:teuthology.orchestra.run.smithi132:mon.a> sudo journalctl -f -n 0 -u ceph-4c8ed362-c768-11ea-a06f-001a4aab830c@mon.a.service 2020-07-16T13:28:57.166 INFO:teuthology.orchestra.run.smithi132:mgr.y> sudo journalctl -f -n 0 -u ceph-4c8ed362-c768-11ea-a06f-001a4aab830c@mgr.y.service 2020-07-16T13:28:57.192 INFO:journalctl@ceph.mon.a.smithi132.stdout:-- Logs begin at Thu 2020-07-16 13:22:27 UTC. -- 2020-07-16T13:28:57.193 INFO:tasks.cephadm:Bootstrapping... 2020-07-16T13:28:57.193 INFO:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 -v bootstrap --fsid 4c8ed362-c768-11ea-a06f-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.132 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2020-07-16T13:28:57.219 INFO:journalctl@ceph.mgr.y.smithi132.stdout:-- Logs begin at Thu 2020-07-16 13:22:27 UTC. -- 2020-07-16T13:28:57.348 INFO:teuthology.orchestra.run.smithi132.stderr:INFO:cephadm:Verifying podman|docker is present... 2020-07-16T13:28:57.349 INFO:teuthology.orchestra.run.smithi132.stderr:INFO:cephadm:Verifying lvm2 is present... 2020-07-16T13:28:57.349 INFO:teuthology.orchestra.run.smithi132.stderr:INFO:cephadm:Verifying time synchronization is in place... 2020-07-16T13:28:57.349 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:Running command: systemctl is-enabled chrony.service 2020-07-16T13:28:57.353 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:systemctl:stderr Failed to get unit file state for chrony.service: No such file or directory 2020-07-16T13:28:57.354 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:Running command: systemctl is-active chrony.service 2020-07-16T13:28:57.359 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:systemctl:stdout inactive 2020-07-16T13:28:57.359 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:Running command: systemctl is-enabled chronyd.service 2020-07-16T13:28:57.364 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:systemctl:stdout enabled 2020-07-16T13:28:57.364 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:Running command: systemctl is-active chronyd.service 2020-07-16T13:28:57.369 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:systemctl:stdout active 2020-07-16T13:28:57.369 INFO:teuthology.orchestra.run.smithi132.stderr:INFO:cephadm:Unit chronyd.service is enabled and running 2020-07-16T13:28:57.369 INFO:teuthology.orchestra.run.smithi132.stderr:INFO:cephadm:Repeating the final host check... 2020-07-16T13:28:57.369 INFO:teuthology.orchestra.run.smithi132.stderr:INFO:cephadm:podman|docker (/bin/podman) is present 2020-07-16T13:28:57.370 INFO:teuthology.orchestra.run.smithi132.stderr:INFO:cephadm:systemctl is present 2020-07-16T13:28:57.370 INFO:teuthology.orchestra.run.smithi132.stderr:INFO:cephadm:lvcreate is present 2020-07-16T13:28:57.370 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:Running command: systemctl is-enabled chrony.service 2020-07-16T13:28:57.373 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:systemctl:stderr Failed to get unit file state for chrony.service: No such file or directory 2020-07-16T13:28:57.374 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:Running command: systemctl is-active chrony.service 2020-07-16T13:28:57.378 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:systemctl:stdout inactive 2020-07-16T13:28:57.379 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:Running command: systemctl is-enabled chronyd.service 2020-07-16T13:28:57.383 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:systemctl:stdout enabled 2020-07-16T13:28:57.383 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:Running command: systemctl is-active chronyd.service 2020-07-16T13:28:57.388 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:systemctl:stdout active 2020-07-16T13:28:57.388 INFO:teuthology.orchestra.run.smithi132.stderr:INFO:cephadm:Unit chronyd.service is enabled and running 2020-07-16T13:28:57.388 INFO:teuthology.orchestra.run.smithi132.stderr:INFO:cephadm:Host looks OK 2020-07-16T13:28:57.389 INFO:teuthology.orchestra.run.smithi132.stderr:INFO:root:Cluster fsid: 4c8ed362-c768-11ea-a06f-001a4aab830c 2020-07-16T13:28:57.389 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:Acquiring lock 140405967361080 on /run/cephadm/4c8ed362-c768-11ea-a06f-001a4aab830c.lock 2020-07-16T13:28:57.390 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:Lock 140405967361080 acquired on /run/cephadm/4c8ed362-c768-11ea-a06f-001a4aab830c.lock 2020-07-16T13:28:57.390 INFO:teuthology.orchestra.run.smithi132.stderr:INFO:cephadm:Verifying IP 172.21.15.132 port 3300 ... 2020-07-16T13:28:57.390 INFO:teuthology.orchestra.run.smithi132.stderr:INFO:cephadm:Verifying IP 172.21.15.132 port 6789 ... 2020-07-16T13:28:57.390 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:Base mon IP is 172.21.15.132, final addrv is [v2:172.21.15.132:3300,v1:172.21.15.132:6789] 2020-07-16T13:28:57.390 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:Running command: /sbin/ip route ls 2020-07-16T13:28:57.391 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/sbin/ip:stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp metric 102 2020-07-16T13:28:57.392 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/sbin/ip:stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.132 metric 102 2020-07-16T13:28:57.392 INFO:teuthology.orchestra.run.smithi132.stderr:INFO:cephadm:Mon IP 172.21.15.132 is in CIDR network 172.21.0.0/20 2020-07-16T13:28:57.392 INFO:teuthology.orchestra.run.smithi132.stderr:INFO:cephadm:Pulling latest docker.io/ceph/ceph:v15.2.0 container... 2020-07-16T13:28:57.392 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:Running command: /bin/podman pull docker.io/ceph/ceph:v15.2.0 2020-07-16T13:28:58.020 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/bin/podman:stderr Trying to pull docker.io/ceph/ceph:v15.2.0... 2020-07-16T13:28:58.318 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/bin/podman:stderr Getting image source signatures 2020-07-16T13:28:58.433 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/bin/podman:stderr Copying blob sha256:120f0bd0d532e2094e4c344cda2d32931787ee8c2e5d6b9ddd4698dfe3ef6110 2020-07-16T13:28:58.491 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/bin/podman:stderr Copying blob sha256:8a29a15cefaeccf6545f7ecf11298f9672d2f0cdaf9e357a95133ac3ad3e1f07 2020-07-16T13:29:05.998 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/bin/podman:stderr Copying config sha256:204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1 2020-07-16T13:29:06.358 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/bin/podman:stderr Writing manifest to image destination 2020-07-16T13:29:06.359 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/bin/podman:stderr Storing signatures 2020-07-16T13:29:16.393 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/bin/podman:stdout 204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1 2020-07-16T13:29:16.444 INFO:teuthology.orchestra.run.smithi132.stderr:INFO:cephadm:Extracting ceph user uid/gid from container image... 2020-07-16T13:29:16.444 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi132', '--entrypoint', 'stat', 'docker.io/ceph/ceph:v15.2.0', '-c', '%u %g', '/var/lib/ceph'] 2020-07-16T13:29:16.445 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi132 --entrypoint stat docker.io/ceph/ceph:v15.2.0 -c %u %g /var/lib/ceph 2020-07-16T13:29:17.213 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:stat:stdout 167 167 2020-07-16T13:29:28.006 INFO:teuthology.orchestra.run.smithi132.stderr:INFO:cephadm:Creating initial keys... 2020-07-16T13:29:28.007 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi132', '--entrypoint', '/usr/bin/ceph-authtool', 'docker.io/ceph/ceph:v15.2.0', '--gen-print-key'] 2020-07-16T13:29:28.007 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi132 --entrypoint /usr/bin/ceph-authtool docker.io/ceph/ceph:v15.2.0 --gen-print-key 2020-07-16T13:29:28.574 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-authtool:stdout AQA4VhBfFOCnIBAAtsShzZNltAlB+ro94JB4Lw== 2020-07-16T13:29:29.043 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi132', '--entrypoint', '/usr/bin/ceph-authtool', 'docker.io/ceph/ceph:v15.2.0', '--gen-print-key'] 2020-07-16T13:29:29.044 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi132 --entrypoint /usr/bin/ceph-authtool docker.io/ceph/ceph:v15.2.0 --gen-print-key 2020-07-16T13:29:29.607 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-authtool:stdout AQA5VhBfh2mdIhAAz5kcvilzwFkirzSEYWlaEw== 2020-07-16T13:29:30.145 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi132', '--entrypoint', '/usr/bin/ceph-authtool', 'docker.io/ceph/ceph:v15.2.0', '--gen-print-key'] 2020-07-16T13:29:30.146 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi132 --entrypoint /usr/bin/ceph-authtool docker.io/ceph/ceph:v15.2.0 --gen-print-key 2020-07-16T13:29:30.707 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-authtool:stdout AQA6VhBfTcaQKBAA5VZl+xzz2AFGe6sJFJH91A== 2020-07-16T13:29:31.193 INFO:teuthology.orchestra.run.smithi132.stderr:INFO:cephadm:Creating initial monmap... 2020-07-16T13:29:31.193 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi132', '-v', '/tmp/ceph-tmpp3ek_3ft:/tmp/monmap:z', '--entrypoint', '/usr/bin/monmaptool', 'docker.io/ceph/ceph:v15.2.0', '--create', '--clobber', '--fsid', '4c8ed362-c768-11ea-a06f-001a4aab830c', '--addv', 'a', '[v2:172.21.15.132:3300,v1:172.21.15.132:6789]', '/tmp/monmap'] 2020-07-16T13:29:31.194 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi132 -v /tmp/ceph-tmpp3ek_3ft:/tmp/monmap:z --entrypoint /usr/bin/monmaptool docker.io/ceph/ceph:v15.2.0 --create --clobber --fsid 4c8ed362-c768-11ea-a06f-001a4aab830c --addv a [v2:172.21.15.132:3300,v1:172.21.15.132:6789] /tmp/monmap 2020-07-16T13:29:31.791 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/monmaptool:stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2020-07-16T13:29:31.792 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/monmaptool:stdout /usr/bin/monmaptool: set fsid to 4c8ed362-c768-11ea-a06f-001a4aab830c 2020-07-16T13:29:31.792 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/monmaptool:stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2020-07-16T13:29:32.399 INFO:teuthology.orchestra.run.smithi132.stderr:INFO:cephadm:Creating mon... 2020-07-16T13:29:32.402 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi132', '-v', '/var/log/ceph/4c8ed362-c768-11ea-a06f-001a4aab830c:/var/log/ceph:z', '-v', '/var/lib/ceph/4c8ed362-c768-11ea-a06f-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z', '-v', '/tmp/ceph-tmp32hvgvng:/tmp/keyring:z', '-v', '/tmp/ceph-tmpp3ek_3ft:/tmp/monmap:z', '--entrypoint', '/usr/bin/ceph-mon', 'docker.io/ceph/ceph:v15.2.0', '--mkfs', '-i', 'a', '--fsid', '4c8ed362-c768-11ea-a06f-001a4aab830c', '-c', '/dev/null', '--monmap', '/tmp/monmap', '--keyring', '/tmp/keyring', '--setuser', 'ceph', '--setgroup', 'ceph', '--default-log-to-file=false', '--default-log-to-stderr=true', '--default-log-stderr-prefix="debug "', '--default-mon-cluster-log-to-file=false', '--default-mon-cluster-log-to-stderr=true'] 2020-07-16T13:29:32.402 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi132 -v /var/log/ceph/4c8ed362-c768-11ea-a06f-001a4aab830c:/var/log/ceph:z -v /var/lib/ceph/4c8ed362-c768-11ea-a06f-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z -v /tmp/ceph-tmp32hvgvng:/tmp/keyring:z -v /tmp/ceph-tmpp3ek_3ft:/tmp/monmap:z --entrypoint /usr/bin/ceph-mon docker.io/ceph/ceph:v15.2.0 --mkfs -i a --fsid 4c8ed362-c768-11ea-a06f-001a4aab830c -c /dev/null --monmap /tmp/monmap --keyring /tmp/keyring --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix="debug " --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true 2020-07-16T13:29:33.051 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.954+0000 7f6a12e306c0 0 set uid:gid to 167:167 (ceph:ceph) 2020-07-16T13:29:33.051 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 1 imported monmap: 2020-07-16T13:29:33.052 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr epoch 0 2020-07-16T13:29:33.052 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr fsid 4c8ed362-c768-11ea-a06f-001a4aab830c 2020-07-16T13:29:33.052 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr last_changed 2020-07-16T13:29:31.760388+0000 2020-07-16T13:29:33.053 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr created 2020-07-16T13:29:31.760388+0000 2020-07-16T13:29:33.053 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr min_mon_release 0 (unknown) 2020-07-16T13:29:33.053 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 0: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.a 2020-07-16T13:29:33.054 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2020-07-16T13:29:33.055 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 0 /usr/bin/ceph-mon: set fsid to 4c8ed362-c768-11ea-a06f-001a4aab830c 2020-07-16T13:29:33.055 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 0 set rocksdb option compression = kNoCompression 2020-07-16T13:29:33.055 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2020-07-16T13:29:33.055 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 0 set rocksdb option write_buffer_size = 33554432 2020-07-16T13:29:33.055 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 0 set rocksdb option compression = kNoCompression 2020-07-16T13:29:33.056 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2020-07-16T13:29:33.056 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 0 set rocksdb option write_buffer_size = 33554432 2020-07-16T13:29:33.056 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: RocksDB version: 6.1.2 2020-07-16T13:29:33.056 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2020-07-16T13:29:33.057 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2020-07-16T13:29:33.057 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Compile date Mar 23 2020 2020-07-16T13:29:33.057 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: DB SUMMARY 2020-07-16T13:29:33.057 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2020-07-16T13:29:33.058 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 0, files: 2020-07-16T13:29:33.058 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2020-07-16T13:29:33.058 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 2020-07-16T13:29:33.058 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2020-07-16T13:29:33.058 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.error_if_exists: 0 2020-07-16T13:29:33.059 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.create_if_missing: 1 2020-07-16T13:29:33.059 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.paranoid_checks: 1 2020-07-16T13:29:33.059 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.env: 0x55c7734e41a0 2020-07-16T13:29:33.059 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.info_log: 0x55c773eaba80 2020-07-16T13:29:33.059 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.max_file_opening_threads: 16 2020-07-16T13:29:33.060 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.statistics: (nil) 2020-07-16T13:29:33.060 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.use_fsync: 0 2020-07-16T13:29:33.060 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.max_log_file_size: 0 2020-07-16T13:29:33.060 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.max_manifest_file_size: 1073741824 2020-07-16T13:29:33.060 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.log_file_time_to_roll: 0 2020-07-16T13:29:33.061 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.keep_log_file_num: 1000 2020-07-16T13:29:33.061 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.recycle_log_file_num: 0 2020-07-16T13:29:33.061 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.allow_fallocate: 1 2020-07-16T13:29:33.062 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.allow_mmap_reads: 0 2020-07-16T13:29:33.062 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.allow_mmap_writes: 0 2020-07-16T13:29:33.062 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.use_direct_reads: 0 2020-07-16T13:29:33.062 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2020-07-16T13:29:33.062 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.create_missing_column_families: 0 2020-07-16T13:29:33.063 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.db_log_dir: 2020-07-16T13:29:33.063 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2020-07-16T13:29:33.063 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.table_cache_numshardbits: 6 2020-07-16T13:29:33.063 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.max_subcompactions: 1 2020-07-16T13:29:33.063 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.max_background_flushes: -1 2020-07-16T13:29:33.064 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.WAL_ttl_seconds: 0 2020-07-16T13:29:33.064 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.WAL_size_limit_MB: 0 2020-07-16T13:29:33.064 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.manifest_preallocation_size: 4194304 2020-07-16T13:29:33.065 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.is_fd_close_on_exec: 1 2020-07-16T13:29:33.065 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.advise_random_on_open: 1 2020-07-16T13:29:33.065 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.db_write_buffer_size: 0 2020-07-16T13:29:33.065 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.write_buffer_manager: 0x55c774a4a120 2020-07-16T13:29:33.066 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.access_hint_on_compaction_start: 1 2020-07-16T13:29:33.066 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2020-07-16T13:29:33.066 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2020-07-16T13:29:33.066 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.use_adaptive_mutex: 0 2020-07-16T13:29:33.067 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.rate_limiter: (nil) 2020-07-16T13:29:33.067 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2020-07-16T13:29:33.067 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.wal_recovery_mode: 2 2020-07-16T13:29:33.067 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.enable_thread_tracking: 0 2020-07-16T13:29:33.067 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.enable_pipelined_write: 0 2020-07-16T13:29:33.068 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2020-07-16T13:29:33.068 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2020-07-16T13:29:33.068 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.write_thread_max_yield_usec: 100 2020-07-16T13:29:33.068 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2020-07-16T13:29:33.068 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.row_cache: None 2020-07-16T13:29:33.069 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.wal_filter: None 2020-07-16T13:29:33.069 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.avoid_flush_during_recovery: 0 2020-07-16T13:29:33.069 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.allow_ingest_behind: 0 2020-07-16T13:29:33.069 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.preserve_deletes: 0 2020-07-16T13:29:33.069 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.two_write_queues: 0 2020-07-16T13:29:33.070 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.manual_wal_flush: 0 2020-07-16T13:29:33.070 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.atomic_flush: 0 2020-07-16T13:29:33.070 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2020-07-16T13:29:33.070 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.max_background_jobs: 2 2020-07-16T13:29:33.071 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.max_background_compactions: -1 2020-07-16T13:29:33.071 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2020-07-16T13:29:33.071 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2020-07-16T13:29:33.071 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.delayed_write_rate : 16777216 2020-07-16T13:29:33.072 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.max_total_wal_size: 0 2020-07-16T13:29:33.072 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2020-07-16T13:29:33.072 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.stats_dump_period_sec: 600 2020-07-16T13:29:33.072 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.stats_persist_period_sec: 600 2020-07-16T13:29:33.073 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.stats_history_buffer_size: 1048576 2020-07-16T13:29:33.073 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.max_open_files: -1 2020-07-16T13:29:33.074 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.bytes_per_sync: 0 2020-07-16T13:29:33.074 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.wal_bytes_per_sync: 0 2020-07-16T13:29:33.074 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Options.compaction_readahead_size: 0 2020-07-16T13:29:33.074 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Compression algorithms supported: 2020-07-16T13:29:33.075 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: kZSTDNotFinalCompression supported: 0 2020-07-16T13:29:33.075 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: kZSTD supported: 0 2020-07-16T13:29:33.075 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: kXpressCompression supported: 0 2020-07-16T13:29:33.075 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: kLZ4HCCompression supported: 1 2020-07-16T13:29:33.076 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: kLZ4Compression supported: 1 2020-07-16T13:29:33.076 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: kBZip2Compression supported: 0 2020-07-16T13:29:33.076 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: kZlibCompression supported: 1 2020-07-16T13:29:33.076 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: kSnappyCompression supported: 1 2020-07-16T13:29:33.076 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.955+0000 7f6a12e306c0 4 rocksdb: Fast CRC32 supported: Supported on x86 2020-07-16T13:29:33.077 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.956+0000 7f6a12e306c0 4 rocksdb: [db/db_impl_open.cc:228] Creating manifest 1 2020-07-16T13:29:33.077 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2020-07-16T13:29:33.077 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: [db/version_set.cc:3543] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 2020-07-16T13:29:33.077 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2020-07-16T13:29:33.077 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: [db/column_family.cc:477] --------------- Options for column family [default]: 2020-07-16T13:29:33.078 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2020-07-16T13:29:33.078 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2020-07-16T13:29:33.078 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.merge_operator: 2020-07-16T13:29:33.079 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.compaction_filter: None 2020-07-16T13:29:33.079 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.compaction_filter_factory: None 2020-07-16T13:29:33.079 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.memtable_factory: SkipListFactory 2020-07-16T13:29:33.079 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.table_factory: BlockBasedTable 2020-07-16T13:29:33.079 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55c773dd0130) 2020-07-16T13:29:33.080 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr cache_index_and_filter_blocks: 1 2020-07-16T13:29:33.080 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr cache_index_and_filter_blocks_with_high_priority: 1 2020-07-16T13:29:33.080 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr pin_l0_filter_and_index_blocks_in_cache: 0 2020-07-16T13:29:33.080 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr pin_top_level_index_and_filter: 1 2020-07-16T13:29:33.089 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr index_type: 0 2020-07-16T13:29:33.089 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr data_block_index_type: 0 2020-07-16T13:29:33.089 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr data_block_hash_table_util_ratio: 0.750000 2020-07-16T13:29:33.090 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr hash_index_allow_collision: 1 2020-07-16T13:29:33.090 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr checksum: 1 2020-07-16T13:29:33.090 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr no_block_cache: 0 2020-07-16T13:29:33.090 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_cache: 0x55c773e0a510 2020-07-16T13:29:33.091 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_cache_name: BinnedLRUCache 2020-07-16T13:29:33.091 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_cache_options: 2020-07-16T13:29:33.091 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr capacity : 536870912 2020-07-16T13:29:33.091 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr num_shard_bits : 4 2020-07-16T13:29:33.091 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr strict_capacity_limit : 0 2020-07-16T13:29:33.092 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr high_pri_pool_ratio: 0.000 2020-07-16T13:29:33.092 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_cache_compressed: (nil) 2020-07-16T13:29:33.092 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr persistent_cache: (nil) 2020-07-16T13:29:33.092 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_size: 4096 2020-07-16T13:29:33.092 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_size_deviation: 10 2020-07-16T13:29:33.093 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_restart_interval: 16 2020-07-16T13:29:33.093 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr index_block_restart_interval: 1 2020-07-16T13:29:33.093 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr metadata_block_size: 4096 2020-07-16T13:29:33.093 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr partition_filters: 0 2020-07-16T13:29:33.093 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr use_delta_encoding: 1 2020-07-16T13:29:33.094 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr filter_policy: rocksdb.BuiltinBloomFilter 2020-07-16T13:29:33.094 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr whole_key_filtering: 1 2020-07-16T13:29:33.094 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr verify_compression: 0 2020-07-16T13:29:33.094 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr read_amp_bytes_per_bit: 0 2020-07-16T13:29:33.094 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr format_version: 2 2020-07-16T13:29:33.095 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr enable_index_compression: 1 2020-07-16T13:29:33.095 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_align: 0 2020-07-16T13:29:33.095 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2020-07-16T13:29:33.095 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.write_buffer_size: 33554432 2020-07-16T13:29:33.096 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.max_write_buffer_number: 2 2020-07-16T13:29:33.096 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.compression: NoCompression 2020-07-16T13:29:33.096 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.bottommost_compression: Disabled 2020-07-16T13:29:33.097 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.prefix_extractor: nullptr 2020-07-16T13:29:33.097 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2020-07-16T13:29:33.097 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.num_levels: 7 2020-07-16T13:29:33.098 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2020-07-16T13:29:33.098 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2020-07-16T13:29:33.099 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2020-07-16T13:29:33.099 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2020-07-16T13:29:33.099 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2020-07-16T13:29:33.099 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2020-07-16T13:29:33.100 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2020-07-16T13:29:33.100 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2020-07-16T13:29:33.100 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.compression_opts.window_bits: -14 2020-07-16T13:29:33.101 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.compression_opts.level: 32767 2020-07-16T13:29:33.101 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.compression_opts.strategy: 0 2020-07-16T13:29:33.101 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2020-07-16T13:29:33.101 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2020-07-16T13:29:33.102 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.compression_opts.enabled: false 2020-07-16T13:29:33.102 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2020-07-16T13:29:33.102 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2020-07-16T13:29:33.102 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.level0_stop_writes_trigger: 36 2020-07-16T13:29:33.102 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.target_file_size_base: 67108864 2020-07-16T13:29:33.103 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.target_file_size_multiplier: 1 2020-07-16T13:29:33.103 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2020-07-16T13:29:33.103 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2020-07-16T13:29:33.103 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2020-07-16T13:29:33.103 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2020-07-16T13:29:33.104 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2020-07-16T13:29:33.104 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2020-07-16T13:29:33.104 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2020-07-16T13:29:33.104 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2020-07-16T13:29:33.104 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2020-07-16T13:29:33.105 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2020-07-16T13:29:33.105 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2020-07-16T13:29:33.105 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.max_compaction_bytes: 1677721600 2020-07-16T13:29:33.105 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.arena_block_size: 4194304 2020-07-16T13:29:33.106 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2020-07-16T13:29:33.106 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2020-07-16T13:29:33.106 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2020-07-16T13:29:33.106 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.disable_auto_compactions: 0 2020-07-16T13:29:33.107 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2020-07-16T13:29:33.107 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2020-07-16T13:29:33.107 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2020-07-16T13:29:33.107 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2020-07-16T13:29:33.107 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2020-07-16T13:29:33.108 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2020-07-16T13:29:33.108 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2020-07-16T13:29:33.108 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2020-07-16T13:29:33.108 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2020-07-16T13:29:33.108 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2020-07-16T13:29:33.109 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.table_properties_collectors: 2020-07-16T13:29:33.109 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.inplace_update_support: 0 2020-07-16T13:29:33.109 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.inplace_update_num_locks: 10000 2020-07-16T13:29:33.109 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2020-07-16T13:29:33.110 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.memtable_whole_key_filtering: 0 2020-07-16T13:29:33.110 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.memtable_huge_page_size: 0 2020-07-16T13:29:33.110 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.bloom_locality: 0 2020-07-16T13:29:33.110 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.max_successive_merges: 0 2020-07-16T13:29:33.110 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.optimize_filters_for_hits: 0 2020-07-16T13:29:33.111 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.paranoid_file_checks: 0 2020-07-16T13:29:33.111 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.force_consistency_checks: 0 2020-07-16T13:29:33.111 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.report_bg_io_stats: 0 2020-07-16T13:29:33.111 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.959+0000 7f6a12e306c0 4 rocksdb: Options.ttl: 0 2020-07-16T13:29:33.112 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.960+0000 7f6a12e306c0 4 rocksdb: [db/version_set.cc:3757] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2020-07-16T13:29:33.112 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2020-07-16T13:29:33.112 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.960+0000 7f6a12e306c0 4 rocksdb: [db/version_set.cc:3766] Column family [default] (ID 0), log number is 0 2020-07-16T13:29:33.112 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2020-07-16T13:29:33.112 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.961+0000 7f6a12e306c0 4 rocksdb: DB pointer 0x55c773ea5200 2020-07-16T13:29:33.113 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.961+0000 7f69fbff1700 4 rocksdb: [db/db_impl.cc:777] ------- DUMPING STATS ------- 2020-07-16T13:29:33.113 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.961+0000 7f69fbff1700 4 rocksdb: [db/db_impl.cc:778] 2020-07-16T13:29:33.113 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** DB Stats ** 2020-07-16T13:29:33.113 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Uptime(secs): 0.0 total, 0.0 interval 2020-07-16T13:29:33.113 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2020-07-16T13:29:33.114 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2020-07-16T13:29:33.114 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2020-07-16T13:29:33.114 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2020-07-16T13:29:33.114 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2020-07-16T13:29:33.115 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2020-07-16T13:29:33.115 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2020-07-16T13:29:33.115 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** Compaction Stats [default] ** 2020-07-16T13:29:33.115 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2020-07-16T13:29:33.115 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2020-07-16T13:29:33.116 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2020-07-16T13:29:33.116 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2020-07-16T13:29:33.116 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2020-07-16T13:29:33.116 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** Compaction Stats [default] ** 2020-07-16T13:29:33.116 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2020-07-16T13:29:33.117 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2020-07-16T13:29:33.117 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Uptime(secs): 0.0 total, 0.0 interval 2020-07-16T13:29:33.117 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Flush(GB): cumulative 0.000, interval 0.000 2020-07-16T13:29:33.117 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(GB): cumulative 0.000, interval 0.000 2020-07-16T13:29:33.118 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(Total Files): cumulative 0, interval 0 2020-07-16T13:29:33.118 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(L0 Files): cumulative 0, interval 0 2020-07-16T13:29:33.118 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(Keys): cumulative 0, interval 0 2020-07-16T13:29:33.118 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2020-07-16T13:29:33.118 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2020-07-16T13:29:33.119 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2020-07-16T13:29:33.119 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2020-07-16T13:29:33.119 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** File Read Latency Histogram By Level [default] ** 2020-07-16T13:29:33.119 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2020-07-16T13:29:33.119 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** Compaction Stats [default] ** 2020-07-16T13:29:33.120 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2020-07-16T13:29:33.120 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2020-07-16T13:29:33.120 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2020-07-16T13:29:33.120 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2020-07-16T13:29:33.120 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2020-07-16T13:29:33.121 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** Compaction Stats [default] ** 2020-07-16T13:29:33.121 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2020-07-16T13:29:33.121 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2020-07-16T13:29:33.121 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Uptime(secs): 0.0 total, 0.0 interval 2020-07-16T13:29:33.121 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Flush(GB): cumulative 0.000, interval 0.000 2020-07-16T13:29:33.122 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(GB): cumulative 0.000, interval 0.000 2020-07-16T13:29:33.122 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(Total Files): cumulative 0, interval 0 2020-07-16T13:29:33.122 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(L0 Files): cumulative 0, interval 0 2020-07-16T13:29:33.122 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(Keys): cumulative 0, interval 0 2020-07-16T13:29:33.122 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2020-07-16T13:29:33.123 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2020-07-16T13:29:33.123 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2020-07-16T13:29:33.123 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2020-07-16T13:29:33.123 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** File Read Latency Histogram By Level [default] ** 2020-07-16T13:29:33.124 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2020-07-16T13:29:33.124 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.962+0000 7f6a12e306c0 4 rocksdb: [db/db_impl.cc:390] Shutdown: canceling all background work 2020-07-16T13:29:33.124 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.962+0000 7f6a12e306c0 4 rocksdb: [db/db_impl.cc:563] Shutdown complete 2020-07-16T13:29:33.124 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2020-07-16T13:29:32.962+0000 7f6a12e306c0 0 /usr/bin/ceph-mon: created monfs at /var/lib/ceph/mon/ceph-a for mon.a 2020-07-16T13:29:33.594 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:Running command: install -d -m0770 -o 167 -g 167 /var/run/ceph/4c8ed362-c768-11ea-a06f-001a4aab830c 2020-07-16T13:29:33.598 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:Running command: systemctl disable ceph.target 2020-07-16T13:29:33.681 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:Running command: systemctl enable ceph.target 2020-07-16T13:29:33.688 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:systemctl:stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2020-07-16T13:29:33.757 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:Running command: systemctl start ceph.target 2020-07-16T13:29:33.763 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:Running command: systemctl enable ceph-4c8ed362-c768-11ea-a06f-001a4aab830c.target 2020-07-16T13:29:33.769 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:systemctl:stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-4c8ed362-c768-11ea-a06f-001a4aab830c.target → /etc/systemd/system/ceph-4c8ed362-c768-11ea-a06f-001a4aab830c.target. 2020-07-16T13:29:33.769 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:systemctl:stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-4c8ed362-c768-11ea-a06f-001a4aab830c.target → /etc/systemd/system/ceph-4c8ed362-c768-11ea-a06f-001a4aab830c.target. 2020-07-16T13:29:33.836 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:Running command: systemctl start ceph-4c8ed362-c768-11ea-a06f-001a4aab830c.target 2020-07-16T13:29:33.847 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:Running command: systemctl daemon-reload 2020-07-16T13:29:33.919 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:Running command: systemctl stop ceph-4c8ed362-c768-11ea-a06f-001a4aab830c@mon.a 2020-07-16T13:29:33.944 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:Running command: systemctl reset-failed ceph-4c8ed362-c768-11ea-a06f-001a4aab830c@mon.a 2020-07-16T13:29:33.949 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:systemctl:stderr Failed to reset failed state of unit ceph-4c8ed362-c768-11ea-a06f-001a4aab830c@mon.a.service: Unit ceph-4c8ed362-c768-11ea-a06f-001a4aab830c@mon.a.service not loaded. 2020-07-16T13:29:33.949 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:Running command: systemctl enable ceph-4c8ed362-c768-11ea-a06f-001a4aab830c@mon.a 2020-07-16T13:29:33.954 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:systemctl:stderr Created symlink /etc/systemd/system/ceph-4c8ed362-c768-11ea-a06f-001a4aab830c.target.wants/ceph-4c8ed362-c768-11ea-a06f-001a4aab830c@mon.a.service → /etc/systemd/system/ceph-4c8ed362-c768-11ea-a06f-001a4aab830c@.service. 2020-07-16T13:29:34.023 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:Running command: systemctl start ceph-4c8ed362-c768-11ea-a06f-001a4aab830c@mon.a 2020-07-16T13:29:34.132 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:34 smithi132 systemd[1]: Starting Ceph mon.a for 4c8ed362-c768-11ea-a06f-001a4aab830c... 2020-07-16T13:29:34.141 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:Running command: systemctl is-enabled firewalld.service 2020-07-16T13:29:34.150 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:systemctl:stdout disabled 2020-07-16T13:29:34.150 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:Running command: systemctl is-active firewalld.service 2020-07-16T13:29:34.156 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:systemctl:stdout inactive 2020-07-16T13:29:34.156 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:firewalld.service is not enabled 2020-07-16T13:29:34.157 INFO:teuthology.orchestra.run.smithi132.stderr:INFO:cephadm:Waiting for mon to start... 2020-07-16T13:29:34.157 INFO:teuthology.orchestra.run.smithi132.stderr:INFO:cephadm:Waiting for mon... 2020-07-16T13:29:34.158 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi132 -v /var/lib/ceph/4c8ed362-c768-11ea-a06f-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z -v /tmp/ceph-tmp4bxmt8sq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmprctwzzoo:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 status 2020-07-16T13:29:34.448 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:34 smithi132 podman[22855]: Error: no container with name or ID ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a found: no such container 2020-07-16T13:29:34.449 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:34 smithi132 systemd[1]: Started Ceph mon.a for 4c8ed362-c768-11ea-a06f-001a4aab830c. 2020-07-16T13:29:34.449 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:34 smithi132 podman[22875]: 2020-07-16 13:29:34.38039545 +0000 UTC m=+0.226234641 container create 124afdc625f5342296769cee80c3a79ae174eec21d5194c0bb1b14e1be6a146f (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a) 2020-07-16T13:29:34.715 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:34 smithi132 podman[22875]: 2020-07-16 13:29:34.547137401 +0000 UTC m=+0.392976663 container init 124afdc625f5342296769cee80c3a79ae174eec21d5194c0bb1b14e1be6a146f (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a) 2020-07-16T13:29:34.715 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:34 smithi132 podman[22875]: 2020-07-16 13:29:34.597264805 +0000 UTC m=+0.443104087 container start 124afdc625f5342296769cee80c3a79ae174eec21d5194c0bb1b14e1be6a146f (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a) 2020-07-16T13:29:34.715 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:34 smithi132 podman[22875]: 2020-07-16 13:29:34.597693777 +0000 UTC m=+0.443532969 container attach 124afdc625f5342296769cee80c3a79ae174eec21d5194c0bb1b14e1be6a146f (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a) 2020-07-16T13:29:34.715 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:34 smithi132 bash[22873]: cluster 2020-07-16T13:29:34.607239+0000 mon.a (mon.0) 0 : [INF] mkfs 4c8ed362-c768-11ea-a06f-001a4aab830c 2020-07-16T13:29:34.716 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:34 smithi132 bash[22873]: cluster 2020-07-16T13:29:34.592125+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2020-07-16T13:29:35.089 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout cluster: 2020-07-16T13:29:35.090 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout id: 4c8ed362-c768-11ea-a06f-001a4aab830c 2020-07-16T13:29:35.090 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout health: HEALTH_OK 2020-07-16T13:29:35.090 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2020-07-16T13:29:35.090 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout services: 2020-07-16T13:29:35.091 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon: 1 daemons, quorum a (age 0.48305s) 2020-07-16T13:29:35.091 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mgr: no daemons active 2020-07-16T13:29:35.091 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout osd: 0 osds: 0 up, 0 in 2020-07-16T13:29:35.091 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2020-07-16T13:29:35.091 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout data: 2020-07-16T13:29:35.091 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout pools: 0 pools, 0 pgs 2020-07-16T13:29:35.092 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout objects: 0 objects, 0 B 2020-07-16T13:29:35.092 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout usage: 0 B used, 0 B / 0 B avail 2020-07-16T13:29:35.092 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout pgs: 2020-07-16T13:29:35.092 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2020-07-16T13:29:35.693 INFO:teuthology.orchestra.run.smithi132.stderr:INFO:cephadm:Assimilating anything we can from ceph.conf... 2020-07-16T13:29:35.693 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi132', '-v', '/var/log/ceph/4c8ed362-c768-11ea-a06f-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmp4bxmt8sq:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmprctwzzoo:/etc/ceph/ceph.conf:z', '-v', '/var/lib/ceph/4c8ed362-c768-11ea-a06f-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'config', 'assimilate-conf', '-i', '/var/lib/ceph/mon/ceph-a/config'] 2020-07-16T13:29:35.694 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi132 -v /var/log/ceph/4c8ed362-c768-11ea-a06f-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp4bxmt8sq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmprctwzzoo:/etc/ceph/ceph.conf:z -v /var/lib/ceph/4c8ed362-c768-11ea-a06f-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 config assimilate-conf -i /var/lib/ceph/mon/ceph-a/config 2020-07-16T13:29:35.923 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:35 smithi132 bash[22873]: cluster 2020-07-16T13:29:34.603946+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2020-07-16T13:29:35.923 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:35 smithi132 bash[22873]: cluster 2020-07-16T13:29:34.606245+0000 mon.a (mon.0) 3 : cluster [DBG] monmap e1: 1 mons at {a=[v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0]} 2020-07-16T13:29:35.924 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:35 smithi132 bash[22873]: cluster 2020-07-16T13:29:34.609240+0000 mon.a (mon.0) 4 : cluster [DBG] fsmap 2020-07-16T13:29:35.924 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:35 smithi132 bash[22873]: cluster 2020-07-16T13:29:34.611713+0000 mon.a (mon.0) 5 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2020-07-16T13:29:35.924 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:35 smithi132 bash[22873]: cluster 2020-07-16T13:29:34.612120+0000 mon.a (mon.0) 6 : cluster [DBG] mgrmap e1: no daemons active 2020-07-16T13:29:35.925 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:35 smithi132 bash[22873]: audit 2020-07-16T13:29:35.086951+0000 mon.a (mon.0) 7 : audit [DBG] from='client.? 172.21.15.132:0/1701126725' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2020-07-16T13:29:36.388 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2020-07-16T13:29:36.388 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout [global] 2020-07-16T13:29:36.389 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout fsid = 4c8ed362-c768-11ea-a06f-001a4aab830c 2020-07-16T13:29:36.389 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_election_default_strategy = 1 2020-07-16T13:29:36.389 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_host = [v2:172.21.15.132:3300,v1:172.21.15.132:6789] 2020-07-16T13:29:36.389 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_osd_allow_pg_remap = true 2020-07-16T13:29:36.389 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_osd_allow_primary_affinity = true 2020-07-16T13:29:36.390 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_warn_on_no_sortbitwise = false 2020-07-16T13:29:36.390 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout osd_crush_chooseleaf_type = 0 2020-07-16T13:29:36.390 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2020-07-16T13:29:36.390 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout [mgr] 2020-07-16T13:29:36.390 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mgr/telemetry/nag = false 2020-07-16T13:29:36.391 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2020-07-16T13:29:36.391 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout [osd] 2020-07-16T13:29:36.391 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout osd_map_max_advance = 10 2020-07-16T13:29:36.391 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout osd_sloppy_crc = true 2020-07-16T13:29:36.845 INFO:teuthology.orchestra.run.smithi132.stderr:INFO:cephadm:Generating new minimal ceph.conf... 2020-07-16T13:29:36.846 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi132', '-v', '/var/log/ceph/4c8ed362-c768-11ea-a06f-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmp4bxmt8sq:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmprctwzzoo:/etc/ceph/ceph.conf:z', '-v', '/var/lib/ceph/4c8ed362-c768-11ea-a06f-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'config', 'generate-minimal-conf', '-o', '/var/lib/ceph/mon/ceph-a/config'] 2020-07-16T13:29:36.846 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi132 -v /var/log/ceph/4c8ed362-c768-11ea-a06f-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp4bxmt8sq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmprctwzzoo:/etc/ceph/ceph.conf:z -v /var/lib/ceph/4c8ed362-c768-11ea-a06f-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 config generate-minimal-conf -o /var/lib/ceph/mon/ceph-a/config 2020-07-16T13:29:37.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:36 smithi132 bash[22873]: audit 2020-07-16T13:29:36.382777+0000 mon.a (mon.0) 8 : audit [INF] from='client.? 172.21.15.132:0/3309945051' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2020-07-16T13:29:37.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:36 smithi132 bash[22873]: audit 2020-07-16T13:29:36.385322+0000 mon.a (mon.0) 9 : audit [INF] from='client.? 172.21.15.132:0/3309945051' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2020-07-16T13:29:37.786 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:37 smithi132 bash[22873]: audit 2020-07-16T13:29:37.534440+0000 mon.a (mon.0) 10 : audit [DBG] from='client.? 172.21.15.132:0/84535903' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:29:37.970 INFO:teuthology.orchestra.run.smithi132.stderr:INFO:cephadm:Restarting the monitor... 2020-07-16T13:29:37.971 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:Running command: systemctl restart ceph-4c8ed362-c768-11ea-a06f-001a4aab830c@mon.a 2020-07-16T13:29:38.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:37 smithi132 systemd[1]: Stopping Ceph mon.a for 4c8ed362-c768-11ea-a06f-001a4aab830c... 2020-07-16T13:29:38.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:38 smithi132 bash[22873]: debug 2020-07-16T13:29:38.019+0000 7fa98f8c5700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2020-07-16T13:29:38.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:38 smithi132 bash[22873]: debug 2020-07-16T13:29:38.019+0000 7fa98f8c5700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2020-07-16T13:29:38.712 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:38 smithi132 podman[23235]: 2020-07-16 13:29:38.382319592 +0000 UTC m=+0.393802087 container died 124afdc625f5342296769cee80c3a79ae174eec21d5194c0bb1b14e1be6a146f (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a) 2020-07-16T13:29:38.712 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:38 smithi132 podman[23235]: 2020-07-16 13:29:38.413191275 +0000 UTC m=+0.424673653 container stop 124afdc625f5342296769cee80c3a79ae174eec21d5194c0bb1b14e1be6a146f (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a) 2020-07-16T13:29:38.713 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:38 smithi132 podman[23235]: 124afdc625f5342296769cee80c3a79ae174eec21d5194c0bb1b14e1be6a146f 2020-07-16T13:29:38.864 INFO:teuthology.orchestra.run.smithi132.stderr:INFO:cephadm:Setting mon public_network... 2020-07-16T13:29:38.864 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi132', '-v', '/var/log/ceph/4c8ed362-c768-11ea-a06f-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmp4bxmt8sq:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmprctwzzoo:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'config', 'set', 'mon', 'public_network', '172.21.0.0/20'] 2020-07-16T13:29:38.865 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi132 -v /var/log/ceph/4c8ed362-c768-11ea-a06f-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp4bxmt8sq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmprctwzzoo:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 config set mon public_network 172.21.0.0/20 2020-07-16T13:29:39.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:38 smithi132 podman[22875]: 2020-07-16 13:29:38.711541805 +0000 UTC m=+4.557380990 container remove 124afdc625f5342296769cee80c3a79ae174eec21d5194c0bb1b14e1be6a146f (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a) 2020-07-16T13:29:39.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:38 smithi132 systemd[1]: Stopped Ceph mon.a for 4c8ed362-c768-11ea-a06f-001a4aab830c. 2020-07-16T13:29:39.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:38 smithi132 systemd[1]: Starting Ceph mon.a for 4c8ed362-c768-11ea-a06f-001a4aab830c... 2020-07-16T13:29:39.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:38 smithi132 podman[23282]: Error: no container with name or ID ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a found: no such container 2020-07-16T13:29:39.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:38 smithi132 systemd[1]: Started Ceph mon.a for 4c8ed362-c768-11ea-a06f-001a4aab830c. 2020-07-16T13:29:39.388 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 podman[23301]: 2020-07-16 13:29:39.346236679 +0000 UTC m=+0.469493430 container create fa8441eb419efc0ae0d02eab952f0f4b7293ad46aeefa0982bc1f82493859baa (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a) 2020-07-16T13:29:39.779 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 podman[23301]: 2020-07-16 13:29:39.496241305 +0000 UTC m=+0.619498055 container init fa8441eb419efc0ae0d02eab952f0f4b7293ad46aeefa0982bc1f82493859baa (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a) 2020-07-16T13:29:39.779 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 podman[23301]: 2020-07-16 13:29:39.537895766 +0000 UTC m=+0.661152537 container start fa8441eb419efc0ae0d02eab952f0f4b7293ad46aeefa0982bc1f82493859baa (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a) 2020-07-16T13:29:39.780 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 podman[23301]: 2020-07-16 13:29:39.537988529 +0000 UTC m=+0.661245289 container attach fa8441eb419efc0ae0d02eab952f0f4b7293ad46aeefa0982bc1f82493859baa (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a) 2020-07-16T13:29:39.780 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.528+0000 7f01415cb6c0 0 set uid:gid to 167:167 (ceph:ceph) 2020-07-16T13:29:39.780 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.528+0000 7f01415cb6c0 0 ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc), process ceph-mon, pid 1 2020-07-16T13:29:39.780 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.528+0000 7f01415cb6c0 0 pidfile_write: ignore empty --pid-file 2020-07-16T13:29:39.780 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.532+0000 7f01415cb6c0 0 load: jerasure load: lrc load: isa 2020-07-16T13:29:39.781 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.532+0000 7f01415cb6c0 0 set rocksdb option compression = kNoCompression 2020-07-16T13:29:39.781 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.532+0000 7f01415cb6c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2020-07-16T13:29:39.781 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.532+0000 7f01415cb6c0 0 set rocksdb option write_buffer_size = 33554432 2020-07-16T13:29:39.781 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.532+0000 7f01415cb6c0 0 set rocksdb option compression = kNoCompression 2020-07-16T13:29:39.781 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.532+0000 7f01415cb6c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2020-07-16T13:29:39.782 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.532+0000 7f01415cb6c0 0 set rocksdb option write_buffer_size = 33554432 2020-07-16T13:29:39.782 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 1 rocksdb: do_open column families: [default] 2020-07-16T13:29:39.782 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: RocksDB version: 6.1.2 2020-07-16T13:29:39.782 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2020-07-16T13:29:39.782 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Compile date Mar 23 2020 2020-07-16T13:29:39.783 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: DB SUMMARY 2020-07-16T13:29:39.783 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: CURRENT file: CURRENT 2020-07-16T13:29:39.783 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: IDENTITY file: IDENTITY 2020-07-16T13:29:39.783 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 109 Bytes 2020-07-16T13:29:39.783 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000004.sst 2020-07-16T13:29:39.784 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000006.log size: 69057 ; 2020-07-16T13:29:39.784 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.error_if_exists: 0 2020-07-16T13:29:39.784 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.create_if_missing: 0 2020-07-16T13:29:39.784 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.paranoid_checks: 1 2020-07-16T13:29:39.784 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.env: 0x55e0f20ba1a0 2020-07-16T13:29:39.784 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.info_log: 0x55e0f2fea9a0 2020-07-16T13:29:39.785 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.max_file_opening_threads: 16 2020-07-16T13:29:39.785 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.statistics: (nil) 2020-07-16T13:29:39.785 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.use_fsync: 0 2020-07-16T13:29:39.785 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.max_log_file_size: 0 2020-07-16T13:29:39.785 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.max_manifest_file_size: 1073741824 2020-07-16T13:29:39.786 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.log_file_time_to_roll: 0 2020-07-16T13:29:39.786 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.keep_log_file_num: 1000 2020-07-16T13:29:39.786 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.recycle_log_file_num: 0 2020-07-16T13:29:39.786 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.allow_fallocate: 1 2020-07-16T13:29:39.786 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.allow_mmap_reads: 0 2020-07-16T13:29:39.787 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.allow_mmap_writes: 0 2020-07-16T13:29:39.787 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.use_direct_reads: 0 2020-07-16T13:29:39.787 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2020-07-16T13:29:39.787 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.create_missing_column_families: 0 2020-07-16T13:29:39.787 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.db_log_dir: 2020-07-16T13:29:39.787 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2020-07-16T13:29:39.788 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.table_cache_numshardbits: 6 2020-07-16T13:29:39.788 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.max_subcompactions: 1 2020-07-16T13:29:39.788 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.max_background_flushes: -1 2020-07-16T13:29:39.788 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.WAL_ttl_seconds: 0 2020-07-16T13:29:39.788 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.WAL_size_limit_MB: 0 2020-07-16T13:29:39.789 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.manifest_preallocation_size: 4194304 2020-07-16T13:29:39.789 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.is_fd_close_on_exec: 1 2020-07-16T13:29:39.789 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.advise_random_on_open: 1 2020-07-16T13:29:39.789 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.db_write_buffer_size: 0 2020-07-16T13:29:39.789 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.write_buffer_manager: 0x55e0f3b82a80 2020-07-16T13:29:39.790 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.access_hint_on_compaction_start: 1 2020-07-16T13:29:39.790 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2020-07-16T13:29:39.790 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2020-07-16T13:29:39.790 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.use_adaptive_mutex: 0 2020-07-16T13:29:39.791 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.rate_limiter: (nil) 2020-07-16T13:29:39.791 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2020-07-16T13:29:39.791 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.wal_recovery_mode: 2 2020-07-16T13:29:39.791 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.enable_thread_tracking: 0 2020-07-16T13:29:39.791 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.enable_pipelined_write: 0 2020-07-16T13:29:39.792 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2020-07-16T13:29:39.792 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2020-07-16T13:29:39.792 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.write_thread_max_yield_usec: 100 2020-07-16T13:29:39.792 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2020-07-16T13:29:39.792 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.row_cache: None 2020-07-16T13:29:39.793 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.wal_filter: None 2020-07-16T13:29:39.793 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.avoid_flush_during_recovery: 0 2020-07-16T13:29:39.793 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.allow_ingest_behind: 0 2020-07-16T13:29:39.793 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.preserve_deletes: 0 2020-07-16T13:29:39.793 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.two_write_queues: 0 2020-07-16T13:29:39.793 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.manual_wal_flush: 0 2020-07-16T13:29:39.794 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.atomic_flush: 0 2020-07-16T13:29:39.794 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2020-07-16T13:29:39.794 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.max_background_jobs: 2 2020-07-16T13:29:39.794 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.max_background_compactions: -1 2020-07-16T13:29:39.794 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2020-07-16T13:29:39.795 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2020-07-16T13:29:39.795 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.delayed_write_rate : 16777216 2020-07-16T13:29:39.795 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.max_total_wal_size: 0 2020-07-16T13:29:39.795 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2020-07-16T13:29:39.795 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.stats_dump_period_sec: 600 2020-07-16T13:29:39.796 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.stats_persist_period_sec: 600 2020-07-16T13:29:39.796 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.stats_history_buffer_size: 1048576 2020-07-16T13:29:39.796 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.max_open_files: -1 2020-07-16T13:29:39.796 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.bytes_per_sync: 0 2020-07-16T13:29:39.796 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.wal_bytes_per_sync: 0 2020-07-16T13:29:39.796 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.compaction_readahead_size: 0 2020-07-16T13:29:39.797 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Compression algorithms supported: 2020-07-16T13:29:39.797 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: kZSTDNotFinalCompression supported: 0 2020-07-16T13:29:39.797 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: kZSTD supported: 0 2020-07-16T13:29:39.797 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: kXpressCompression supported: 0 2020-07-16T13:29:39.797 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: kLZ4HCCompression supported: 1 2020-07-16T13:29:39.798 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: kLZ4Compression supported: 1 2020-07-16T13:29:39.798 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: kBZip2Compression supported: 0 2020-07-16T13:29:39.798 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: kZlibCompression supported: 1 2020-07-16T13:29:39.798 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: kSnappyCompression supported: 1 2020-07-16T13:29:39.798 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Fast CRC32 supported: Supported on x86 2020-07-16T13:29:39.799 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: [db/version_set.cc:3543] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 2020-07-16T13:29:39.799 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: [db/column_family.cc:477] --------------- Options for column family [default]: 2020-07-16T13:29:39.799 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2020-07-16T13:29:39.802 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.merge_operator: 2020-07-16T13:29:39.802 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.compaction_filter: None 2020-07-16T13:29:39.803 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.compaction_filter_factory: None 2020-07-16T13:29:39.803 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.memtable_factory: SkipListFactory 2020-07-16T13:29:39.804 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.table_factory: BlockBasedTable 2020-07-16T13:29:39.804 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55e0f2f06138) 2020-07-16T13:29:39.805 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: cache_index_and_filter_blocks: 1 2020-07-16T13:29:39.805 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: cache_index_and_filter_blocks_with_high_priority: 1 2020-07-16T13:29:39.805 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: pin_l0_filter_and_index_blocks_in_cache: 0 2020-07-16T13:29:39.805 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: pin_top_level_index_and_filter: 1 2020-07-16T13:29:39.805 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: index_type: 0 2020-07-16T13:29:39.806 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: data_block_index_type: 0 2020-07-16T13:29:39.806 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: data_block_hash_table_util_ratio: 0.750000 2020-07-16T13:29:39.806 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: hash_index_allow_collision: 1 2020-07-16T13:29:39.806 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: checksum: 1 2020-07-16T13:29:39.806 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: no_block_cache: 0 2020-07-16T13:29:39.807 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: block_cache: 0x55e0f2f40610 2020-07-16T13:29:39.807 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: block_cache_name: BinnedLRUCache 2020-07-16T13:29:39.807 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: block_cache_options: 2020-07-16T13:29:39.807 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: capacity : 536870912 2020-07-16T13:29:39.807 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: num_shard_bits : 4 2020-07-16T13:29:39.808 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: strict_capacity_limit : 0 2020-07-16T13:29:39.808 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: high_pri_pool_ratio: 0.000 2020-07-16T13:29:39.808 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: block_cache_compressed: (nil) 2020-07-16T13:29:39.808 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: persistent_cache: (nil) 2020-07-16T13:29:39.808 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: block_size: 4096 2020-07-16T13:29:39.808 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: block_size_deviation: 10 2020-07-16T13:29:39.809 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: block_restart_interval: 16 2020-07-16T13:29:39.809 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: index_block_restart_interval: 1 2020-07-16T13:29:39.809 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: metadata_block_size: 4096 2020-07-16T13:29:39.809 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: partition_filters: 0 2020-07-16T13:29:39.809 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: use_delta_encoding: 1 2020-07-16T13:29:39.810 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: filter_policy: rocksdb.BuiltinBloomFilter 2020-07-16T13:29:39.810 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: whole_key_filtering: 1 2020-07-16T13:29:39.810 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: verify_compression: 0 2020-07-16T13:29:39.810 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: read_amp_bytes_per_bit: 0 2020-07-16T13:29:39.810 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: format_version: 2 2020-07-16T13:29:39.810 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: enable_index_compression: 1 2020-07-16T13:29:39.811 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: block_align: 0 2020-07-16T13:29:39.811 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.write_buffer_size: 33554432 2020-07-16T13:29:39.811 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.max_write_buffer_number: 2 2020-07-16T13:29:39.811 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.compression: NoCompression 2020-07-16T13:29:39.811 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.bottommost_compression: Disabled 2020-07-16T13:29:39.812 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.prefix_extractor: nullptr 2020-07-16T13:29:39.812 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2020-07-16T13:29:39.812 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.num_levels: 7 2020-07-16T13:29:39.812 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2020-07-16T13:29:39.812 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2020-07-16T13:29:39.812 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2020-07-16T13:29:39.813 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2020-07-16T13:29:39.813 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2020-07-16T13:29:39.813 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2020-07-16T13:29:39.813 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2020-07-16T13:29:39.813 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2020-07-16T13:29:39.814 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.compression_opts.window_bits: -14 2020-07-16T13:29:39.814 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.compression_opts.level: 32767 2020-07-16T13:29:39.814 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.compression_opts.strategy: 0 2020-07-16T13:29:39.814 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2020-07-16T13:29:39.814 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2020-07-16T13:29:39.815 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.compression_opts.enabled: false 2020-07-16T13:29:39.815 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2020-07-16T13:29:39.815 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2020-07-16T13:29:39.815 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.level0_stop_writes_trigger: 36 2020-07-16T13:29:39.815 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.target_file_size_base: 67108864 2020-07-16T13:29:39.815 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.target_file_size_multiplier: 1 2020-07-16T13:29:39.816 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2020-07-16T13:29:39.816 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2020-07-16T13:29:39.816 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2020-07-16T13:29:39.816 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2020-07-16T13:29:39.816 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2020-07-16T13:29:39.817 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2020-07-16T13:29:39.817 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2020-07-16T13:29:39.817 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2020-07-16T13:29:39.817 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2020-07-16T13:29:39.817 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2020-07-16T13:29:39.817 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2020-07-16T13:29:39.818 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.max_compaction_bytes: 1677721600 2020-07-16T13:29:39.818 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.arena_block_size: 4194304 2020-07-16T13:29:39.818 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2020-07-16T13:29:39.818 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2020-07-16T13:29:39.818 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2020-07-16T13:29:39.819 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.disable_auto_compactions: 0 2020-07-16T13:29:39.819 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2020-07-16T13:29:39.819 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2020-07-16T13:29:39.819 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2020-07-16T13:29:39.819 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2020-07-16T13:29:39.820 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2020-07-16T13:29:39.820 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2020-07-16T13:29:39.820 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2020-07-16T13:29:39.820 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2020-07-16T13:29:39.820 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2020-07-16T13:29:39.820 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2020-07-16T13:29:39.821 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.table_properties_collectors: 2020-07-16T13:29:39.821 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.inplace_update_support: 0 2020-07-16T13:29:39.821 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.inplace_update_num_locks: 10000 2020-07-16T13:29:39.821 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2020-07-16T13:29:39.821 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.memtable_whole_key_filtering: 0 2020-07-16T13:29:39.822 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.memtable_huge_page_size: 0 2020-07-16T13:29:39.822 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.bloom_locality: 0 2020-07-16T13:29:39.822 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.max_successive_merges: 0 2020-07-16T13:29:39.822 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.optimize_filters_for_hits: 0 2020-07-16T13:29:39.822 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.paranoid_file_checks: 0 2020-07-16T13:29:39.823 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.force_consistency_checks: 0 2020-07-16T13:29:39.823 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.report_bg_io_stats: 0 2020-07-16T13:29:39.823 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.533+0000 7f01415cb6c0 4 rocksdb: Options.ttl: 0 2020-07-16T13:29:39.823 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.534+0000 7f01415cb6c0 4 rocksdb: [db/version_set.cc:3757] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 5, log_number is 4,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2020-07-16T13:29:39.823 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.534+0000 7f01415cb6c0 4 rocksdb: [db/version_set.cc:3766] Column family [default] (ID 0), log number is 4 2020-07-16T13:29:39.823 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.534+0000 7f01415cb6c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1594906179535395, "job": 1, "event": "recovery_started", "log_files": [6]} 2020-07-16T13:29:39.824 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.534+0000 7f01415cb6c0 4 rocksdb: [db/db_impl_open.cc:583] Recovering log #6 mode 2 2020-07-16T13:29:39.824 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.535+0000 7f01415cb6c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1594906179536191, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 7, "file_size": 66152, "table_properties": {"data_size": 64447, "index_size": 310, "filter_size": 581, "raw_key_size": 8602, "raw_average_key_size": 46, "raw_value_size": 59501, "raw_average_value_size": 321, "num_data_blocks": 10, "num_entries": 185, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}} 2020-07-16T13:29:39.824 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.535+0000 7f01415cb6c0 4 rocksdb: [db/version_set.cc:3036] Creating manifest 8 2020-07-16T13:29:39.824 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.535+0000 7f01415cb6c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1594906179536563, "job": 1, "event": "recovery_finished"} 2020-07-16T13:29:39.824 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.536+0000 7f01415cb6c0 4 rocksdb: DB pointer 0x55e0f2fdb200 2020-07-16T13:29:39.825 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.536+0000 7f0128718700 4 rocksdb: [db/db_impl.cc:777] ------- DUMPING STATS ------- 2020-07-16T13:29:39.825 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.536+0000 7f0128718700 4 rocksdb: [db/db_impl.cc:778] 2020-07-16T13:29:39.825 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: ** DB Stats ** 2020-07-16T13:29:39.825 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: Uptime(secs): 0.0 total, 0.0 interval 2020-07-16T13:29:39.825 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2020-07-16T13:29:39.826 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2020-07-16T13:29:39.826 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2020-07-16T13:29:39.826 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2020-07-16T13:29:39.826 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2020-07-16T13:29:39.826 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2020-07-16T13:29:39.826 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: ** Compaction Stats [default] ** 2020-07-16T13:29:39.827 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2020-07-16T13:29:39.827 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2020-07-16T13:29:39.827 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: L0 2/0 66.22 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 117.5 0.00 0.00 1 0.001 0 0 2020-07-16T13:29:39.827 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: Sum 2/0 66.22 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 117.5 0.00 0.00 1 0.001 0 0 2020-07-16T13:29:39.827 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 117.5 0.00 0.00 1 0.001 0 0 2020-07-16T13:29:39.828 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: ** Compaction Stats [default] ** 2020-07-16T13:29:39.828 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2020-07-16T13:29:39.828 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2020-07-16T13:29:39.828 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 117.5 0.00 0.00 1 0.001 0 0 2020-07-16T13:29:39.828 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: Uptime(secs): 0.0 total, 0.0 interval 2020-07-16T13:29:39.829 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: Flush(GB): cumulative 0.000, interval 0.000 2020-07-16T13:29:39.829 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: AddFile(GB): cumulative 0.000, interval 0.000 2020-07-16T13:29:39.829 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: AddFile(Total Files): cumulative 0, interval 0 2020-07-16T13:29:39.829 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: AddFile(L0 Files): cumulative 0, interval 0 2020-07-16T13:29:39.829 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: AddFile(Keys): cumulative 0, interval 0 2020-07-16T13:29:39.829 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: Cumulative compaction: 0.00 GB write, 23.16 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2020-07-16T13:29:39.830 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: Interval compaction: 0.00 GB write, 23.16 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2020-07-16T13:29:39.830 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2020-07-16T13:29:39.830 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: ** File Read Latency Histogram By Level [default] ** 2020-07-16T13:29:39.830 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: ** Compaction Stats [default] ** 2020-07-16T13:29:39.830 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2020-07-16T13:29:39.831 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2020-07-16T13:29:39.831 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: L0 2/0 66.22 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 117.5 0.00 0.00 1 0.001 0 0 2020-07-16T13:29:39.831 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: Sum 2/0 66.22 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 117.5 0.00 0.00 1 0.001 0 0 2020-07-16T13:29:39.831 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2020-07-16T13:29:39.831 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: ** Compaction Stats [default] ** 2020-07-16T13:29:39.832 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2020-07-16T13:29:39.832 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2020-07-16T13:29:39.832 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 117.5 0.00 0.00 1 0.001 0 0 2020-07-16T13:29:39.832 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: Uptime(secs): 0.0 total, 0.0 interval 2020-07-16T13:29:39.832 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: Flush(GB): cumulative 0.000, interval 0.000 2020-07-16T13:29:39.832 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: AddFile(GB): cumulative 0.000, interval 0.000 2020-07-16T13:29:39.833 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: AddFile(Total Files): cumulative 0, interval 0 2020-07-16T13:29:39.833 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: AddFile(L0 Files): cumulative 0, interval 0 2020-07-16T13:29:39.833 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: AddFile(Keys): cumulative 0, interval 0 2020-07-16T13:29:39.833 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: Cumulative compaction: 0.00 GB write, 22.92 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2020-07-16T13:29:39.833 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2020-07-16T13:29:39.834 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2020-07-16T13:29:39.834 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: ** File Read Latency Histogram By Level [default] ** 2020-07-16T13:29:39.834 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.540+0000 7f01415cb6c0 0 starting mon.a rank 0 at public addrs [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] at bind addrs [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 4c8ed362-c768-11ea-a06f-001a4aab830c 2020-07-16T13:29:39.834 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.540+0000 7f01415cb6c0 1 mon.a@-1(???) e1 preinit fsid 4c8ed362-c768-11ea-a06f-001a4aab830c 2020-07-16T13:29:39.834 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.541+0000 7f01415cb6c0 0 mon.a@-1(???).mds e1 new map 2020-07-16T13:29:39.834 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.541+0000 7f01415cb6c0 0 mon.a@-1(???).mds e1 print_map 2020-07-16T13:29:39.835 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: e1 2020-07-16T13:29:39.835 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: enable_multiple, ever_enabled_multiple: 0,0 2020-07-16T13:29:39.835 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2020-07-16T13:29:39.835 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: legacy client fscid: -1 2020-07-16T13:29:39.835 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: 2020-07-16T13:29:39.836 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: No filesystems configured 2020-07-16T13:29:39.836 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.541+0000 7f01415cb6c0 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2020-07-16T13:29:39.836 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.541+0000 7f01415cb6c0 0 mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2020-07-16T13:29:39.836 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.541+0000 7f01415cb6c0 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2020-07-16T13:29:39.837 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: audit 2020-07-16T13:29:37.534440+0000 mon.a (mon.0) 10 : audit [DBG] from='client.? 172.21.15.132:0/84535903' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:29:39.837 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.541+0000 7f01415cb6c0 1 mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2020-07-16T13:29:39.837 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.542+0000 7f01415cb6c0 20 expand_channel_meta expand map: {default=false} 2020-07-16T13:29:39.837 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.542+0000 7f01415cb6c0 20 expand_channel_meta from 'false' to 'false' 2020-07-16T13:29:39.837 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.542+0000 7f01415cb6c0 20 expand_channel_meta expanded map: {default=false} 2020-07-16T13:29:39.838 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.542+0000 7f01415cb6c0 20 expand_channel_meta expand map: {default=info} 2020-07-16T13:29:39.838 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.542+0000 7f01415cb6c0 20 expand_channel_meta from 'info' to 'info' 2020-07-16T13:29:39.838 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.542+0000 7f01415cb6c0 20 expand_channel_meta expanded map: {default=info} 2020-07-16T13:29:39.838 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.542+0000 7f01415cb6c0 20 expand_channel_meta expand map: {default=daemon} 2020-07-16T13:29:39.838 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.542+0000 7f01415cb6c0 20 expand_channel_meta from 'daemon' to 'daemon' 2020-07-16T13:29:39.838 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.542+0000 7f01415cb6c0 20 expand_channel_meta expanded map: {default=daemon} 2020-07-16T13:29:39.839 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.542+0000 7f01415cb6c0 20 expand_channel_meta expand map: {default=debug} 2020-07-16T13:29:39.839 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.542+0000 7f01415cb6c0 20 expand_channel_meta from 'debug' to 'debug' 2020-07-16T13:29:39.839 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: debug 2020-07-16T13:29:39.542+0000 7f01415cb6c0 20 expand_channel_meta expanded map: {default=debug} 2020-07-16T13:29:39.839 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: cluster 2020-07-16T13:29:39.545613+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2020-07-16T13:29:39.839 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: cluster 2020-07-16T13:29:39.545674+0000 mon.a (mon.0) 2 : cluster [DBG] monmap e1: 1 mons at {a=[v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0]} 2020-07-16T13:29:39.840 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: cluster 2020-07-16T13:29:39.545719+0000 mon.a (mon.0) 3 : cluster [DBG] fsmap 2020-07-16T13:29:39.840 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: cluster 2020-07-16T13:29:39.545754+0000 mon.a (mon.0) 4 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2020-07-16T13:29:39.840 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:39 smithi132 bash[23299]: cluster 2020-07-16T13:29:39.546121+0000 mon.a (mon.0) 5 : cluster [DBG] mgrmap e1: no daemons active 2020-07-16T13:29:40.271 INFO:teuthology.orchestra.run.smithi132.stderr:INFO:cephadm:Creating mgr... 2020-07-16T13:29:40.273 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:Running command: systemctl daemon-reload 2020-07-16T13:29:40.352 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:Running command: systemctl stop ceph-4c8ed362-c768-11ea-a06f-001a4aab830c@mgr.y 2020-07-16T13:29:40.378 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:Running command: systemctl reset-failed ceph-4c8ed362-c768-11ea-a06f-001a4aab830c@mgr.y 2020-07-16T13:29:40.382 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:systemctl:stderr Failed to reset failed state of unit ceph-4c8ed362-c768-11ea-a06f-001a4aab830c@mgr.y.service: Unit ceph-4c8ed362-c768-11ea-a06f-001a4aab830c@mgr.y.service not loaded. 2020-07-16T13:29:40.383 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:Running command: systemctl enable ceph-4c8ed362-c768-11ea-a06f-001a4aab830c@mgr.y 2020-07-16T13:29:40.388 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:systemctl:stderr Created symlink /etc/systemd/system/ceph-4c8ed362-c768-11ea-a06f-001a4aab830c.target.wants/ceph-4c8ed362-c768-11ea-a06f-001a4aab830c@mgr.y.service → /etc/systemd/system/ceph-4c8ed362-c768-11ea-a06f-001a4aab830c@.service. 2020-07-16T13:29:40.460 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:Running command: systemctl start ceph-4c8ed362-c768-11ea-a06f-001a4aab830c@mgr.y 2020-07-16T13:29:40.510 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:Running command: systemctl is-enabled firewalld.service 2020-07-16T13:29:40.519 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:systemctl:stdout disabled 2020-07-16T13:29:40.519 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:Running command: systemctl is-active firewalld.service 2020-07-16T13:29:40.525 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:systemctl:stdout inactive 2020-07-16T13:29:40.526 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:firewalld.service is not enabled 2020-07-16T13:29:40.527 INFO:teuthology.orchestra.run.smithi132.stderr:INFO:cephadm:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2020-07-16T13:29:40.527 INFO:teuthology.orchestra.run.smithi132.stderr:INFO:cephadm:Wrote config to /etc/ceph/ceph.conf 2020-07-16T13:29:40.527 INFO:teuthology.orchestra.run.smithi132.stderr:INFO:cephadm:Waiting for mgr to start... 2020-07-16T13:29:40.527 INFO:teuthology.orchestra.run.smithi132.stderr:INFO:cephadm:Waiting for mgr... 2020-07-16T13:29:40.528 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi132', '-v', '/var/log/ceph/4c8ed362-c768-11ea-a06f-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmp4bxmt8sq:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmprctwzzoo:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'status', '-f', 'json-pretty'] 2020-07-16T13:29:40.528 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi132 -v /var/log/ceph/4c8ed362-c768-11ea-a06f-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp4bxmt8sq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmprctwzzoo:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 status -f json-pretty 2020-07-16T13:29:40.529 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:29:40 smithi132 podman[23523]: Error: no container with name or ID ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mgr.y found: no such container 2020-07-16T13:29:40.529 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:29:40 smithi132 systemd[1]: Started Ceph mgr.y for 4c8ed362-c768-11ea-a06f-001a4aab830c. 2020-07-16T13:29:40.988 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:40 smithi132 bash[23299]: audit 2020-07-16T13:29:39.744729+0000 mon.a (mon.0) 6 : audit [INF] from='client.? 172.21.15.132:0/3047945257' entity='client.admin' cmd=[{"prefix": "config set", "who": "mon", "name": "public_network", "value": "172.21.0.0/20"}]: dispatch 2020-07-16T13:29:40.989 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:40 smithi132 bash[23299]: audit 2020-07-16T13:29:39.749362+0000 mon.a (mon.0) 7 : audit [INF] from='client.? 172.21.15.132:0/3047945257' entity='client.admin' cmd='[{"prefix": "config set", "who": "mon", "name": "public_network", "value": "172.21.0.0/20"}]': finished 2020-07-16T13:29:40.989 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:29:40 smithi132 podman[23538]: 2020-07-16 13:29:40.721151098 +0000 UTC m=+0.198198793 container create 9aeb379e83104f2d2d09de0d3d4bf4b3efadd47e24f2e698d838540b6c22bc61 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mgr.y) 2020-07-16T13:29:41.278 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:29:41 smithi132 podman[23538]: 2020-07-16 13:29:41.070972658 +0000 UTC m=+0.548020269 container init 9aeb379e83104f2d2d09de0d3d4bf4b3efadd47e24f2e698d838540b6c22bc61 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mgr.y) 2020-07-16T13:29:41.279 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:29:41 smithi132 podman[23538]: 2020-07-16 13:29:41.112695617 +0000 UTC m=+0.589743216 container start 9aeb379e83104f2d2d09de0d3d4bf4b3efadd47e24f2e698d838540b6c22bc61 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mgr.y) 2020-07-16T13:29:41.279 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:29:41 smithi132 podman[23538]: 2020-07-16 13:29:41.112790825 +0000 UTC m=+0.589838463 container attach 9aeb379e83104f2d2d09de0d3d4bf4b3efadd47e24f2e698d838540b6c22bc61 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mgr.y) 2020-07-16T13:29:41.491 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2020-07-16T13:29:41.492 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:29:41.492 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsid": "4c8ed362-c768-11ea-a06f-001a4aab830c", 2020-07-16T13:29:41.492 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "health": { 2020-07-16T13:29:41.492 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status": "HEALTH_OK", 2020-07-16T13:29:41.492 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "checks": {}, 2020-07-16T13:29:41.493 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mutes": [] 2020-07-16T13:29:41.493 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:41.493 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "election_epoch": 5, 2020-07-16T13:29:41.493 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum": [ 2020-07-16T13:29:41.493 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 0 2020-07-16T13:29:41.494 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:41.494 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_names": [ 2020-07-16T13:29:41.494 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "a" 2020-07-16T13:29:41.494 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:41.494 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_age": 1, 2020-07-16T13:29:41.495 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "monmap": { 2020-07-16T13:29:41.495 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2020-07-16T13:29:41.495 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_mon_release_name": "octopus", 2020-07-16T13:29:41.495 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_mons": 1 2020-07-16T13:29:41.496 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:41.496 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osdmap": { 2020-07-16T13:29:41.496 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2020-07-16T13:29:41.496 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_osds": 0, 2020-07-16T13:29:41.496 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_up_osds": 0, 2020-07-16T13:29:41.497 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_up_since": 0, 2020-07-16T13:29:41.497 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_in_osds": 0, 2020-07-16T13:29:41.497 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_in_since": 0, 2020-07-16T13:29:41.497 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_remapped_pgs": 0 2020-07-16T13:29:41.497 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:41.497 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgmap": { 2020-07-16T13:29:41.498 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgs_by_state": [], 2020-07-16T13:29:41.498 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pgs": 0, 2020-07-16T13:29:41.498 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pools": 0, 2020-07-16T13:29:41.498 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_objects": 0, 2020-07-16T13:29:41.499 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "data_bytes": 0, 2020-07-16T13:29:41.499 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_used": 0, 2020-07-16T13:29:41.500 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_avail": 0, 2020-07-16T13:29:41.500 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_total": 0 2020-07-16T13:29:41.500 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:41.500 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsmap": { 2020-07-16T13:29:41.500 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2020-07-16T13:29:41.501 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "by_rank": [], 2020-07-16T13:29:41.501 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "up:standby": 0 2020-07-16T13:29:41.501 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:41.501 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mgrmap": { 2020-07-16T13:29:41.501 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available": false, 2020-07-16T13:29:41.502 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_standbys": 0, 2020-07-16T13:29:41.502 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modules": [ 2020-07-16T13:29:41.502 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "iostat", 2020-07-16T13:29:41.502 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "restful" 2020-07-16T13:29:41.502 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:41.502 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2020-07-16T13:29:41.503 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:41.503 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "servicemap": { 2020-07-16T13:29:41.503 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2020-07-16T13:29:41.503 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modified": "2020-07-16T13:29:34.607617+0000", 2020-07-16T13:29:41.503 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2020-07-16T13:29:41.504 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:41.504 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress_events": {} 2020-07-16T13:29:41.504 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:42.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:41 smithi132 bash[23299]: audit 2020-07-16T13:29:41.485366+0000 mon.a (mon.0) 8 : audit [DBG] from='client.? 172.21.15.132:0/71956892' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2020-07-16T13:29:42.037 INFO:teuthology.orchestra.run.smithi132.stderr:INFO:cephadm:mgr not available, waiting (1/10)... 2020-07-16T13:29:43.038 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi132', '-v', '/var/log/ceph/4c8ed362-c768-11ea-a06f-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmp4bxmt8sq:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmprctwzzoo:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'status', '-f', 'json-pretty'] 2020-07-16T13:29:43.038 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi132 -v /var/log/ceph/4c8ed362-c768-11ea-a06f-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp4bxmt8sq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmprctwzzoo:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 status -f json-pretty 2020-07-16T13:29:43.754 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2020-07-16T13:29:43.754 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:29:43.755 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsid": "4c8ed362-c768-11ea-a06f-001a4aab830c", 2020-07-16T13:29:43.755 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "health": { 2020-07-16T13:29:43.755 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status": "HEALTH_OK", 2020-07-16T13:29:43.755 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "checks": {}, 2020-07-16T13:29:43.755 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mutes": [] 2020-07-16T13:29:43.755 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:43.756 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "election_epoch": 5, 2020-07-16T13:29:43.756 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum": [ 2020-07-16T13:29:43.756 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 0 2020-07-16T13:29:43.756 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:43.756 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_names": [ 2020-07-16T13:29:43.757 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "a" 2020-07-16T13:29:43.757 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:43.757 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_age": 4, 2020-07-16T13:29:43.757 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "monmap": { 2020-07-16T13:29:43.757 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2020-07-16T13:29:43.758 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_mon_release_name": "octopus", 2020-07-16T13:29:43.758 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_mons": 1 2020-07-16T13:29:43.758 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:43.758 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osdmap": { 2020-07-16T13:29:43.758 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2020-07-16T13:29:43.758 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_osds": 0, 2020-07-16T13:29:43.759 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_up_osds": 0, 2020-07-16T13:29:43.759 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_up_since": 0, 2020-07-16T13:29:43.762 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_in_osds": 0, 2020-07-16T13:29:43.763 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_in_since": 0, 2020-07-16T13:29:43.763 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_remapped_pgs": 0 2020-07-16T13:29:43.763 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:43.763 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgmap": { 2020-07-16T13:29:43.763 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgs_by_state": [], 2020-07-16T13:29:43.764 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pgs": 0, 2020-07-16T13:29:43.764 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pools": 0, 2020-07-16T13:29:43.764 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_objects": 0, 2020-07-16T13:29:43.764 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "data_bytes": 0, 2020-07-16T13:29:43.764 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_used": 0, 2020-07-16T13:29:43.764 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_avail": 0, 2020-07-16T13:29:43.765 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_total": 0 2020-07-16T13:29:43.765 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:43.765 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsmap": { 2020-07-16T13:29:43.765 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2020-07-16T13:29:43.765 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "by_rank": [], 2020-07-16T13:29:43.766 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "up:standby": 0 2020-07-16T13:29:43.766 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:43.766 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mgrmap": { 2020-07-16T13:29:43.766 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available": false, 2020-07-16T13:29:43.768 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_standbys": 0, 2020-07-16T13:29:43.768 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modules": [ 2020-07-16T13:29:43.768 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "iostat", 2020-07-16T13:29:43.768 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "restful" 2020-07-16T13:29:43.769 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:43.769 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2020-07-16T13:29:43.769 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:43.769 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "servicemap": { 2020-07-16T13:29:43.769 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2020-07-16T13:29:43.769 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modified": "2020-07-16T13:29:34.607617+0000", 2020-07-16T13:29:43.770 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2020-07-16T13:29:43.770 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:43.770 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress_events": {} 2020-07-16T13:29:43.770 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:44.028 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:43 smithi132 bash[23299]: audit 2020-07-16T13:29:43.750858+0000 mon.a (mon.0) 9 : audit [DBG] from='client.? 172.21.15.132:0/1259810892' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2020-07-16T13:29:44.240 INFO:teuthology.orchestra.run.smithi132.stderr:INFO:cephadm:mgr not available, waiting (2/10)... 2020-07-16T13:29:45.242 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi132', '-v', '/var/log/ceph/4c8ed362-c768-11ea-a06f-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmp4bxmt8sq:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmprctwzzoo:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'status', '-f', 'json-pretty'] 2020-07-16T13:29:45.243 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi132 -v /var/log/ceph/4c8ed362-c768-11ea-a06f-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp4bxmt8sq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmprctwzzoo:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 status -f json-pretty 2020-07-16T13:29:45.763 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:45 smithi132 bash[23299]: cluster 2020-07-16T13:29:44.678848+0000 mon.a (mon.0) 10 : cluster [INF] Activating manager daemon y 2020-07-16T13:29:45.763 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:45 smithi132 bash[23299]: cluster 2020-07-16T13:29:44.683924+0000 mon.a (mon.0) 11 : cluster [DBG] mgrmap e2: y(active, starting, since 0.00517363s) 2020-07-16T13:29:45.764 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:45 smithi132 bash[23299]: audit 2020-07-16T13:29:44.684433+0000 mon.a (mon.0) 12 : audit [DBG] from='mgr.14100 172.21.15.132:0/206056556' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2020-07-16T13:29:45.764 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:45 smithi132 bash[23299]: audit 2020-07-16T13:29:44.684530+0000 mon.a (mon.0) 13 : audit [DBG] from='mgr.14100 172.21.15.132:0/206056556' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2020-07-16T13:29:45.764 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:45 smithi132 bash[23299]: audit 2020-07-16T13:29:44.684625+0000 mon.a (mon.0) 14 : audit [DBG] from='mgr.14100 172.21.15.132:0/206056556' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2020-07-16T13:29:45.764 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:45 smithi132 bash[23299]: audit 2020-07-16T13:29:44.684913+0000 mon.a (mon.0) 15 : audit [DBG] from='mgr.14100 172.21.15.132:0/206056556' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2020-07-16T13:29:45.764 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:45 smithi132 bash[23299]: audit 2020-07-16T13:29:44.685195+0000 mon.a (mon.0) 16 : audit [DBG] from='mgr.14100 172.21.15.132:0/206056556' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2020-07-16T13:29:45.765 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:45 smithi132 bash[23299]: cluster 2020-07-16T13:29:44.686875+0000 mon.a (mon.0) 17 : cluster [INF] Manager daemon y is now available 2020-07-16T13:29:45.765 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:45 smithi132 bash[23299]: audit 2020-07-16T13:29:44.696356+0000 mon.a (mon.0) 18 : audit [INF] from='mgr.14100 172.21.15.132:0/206056556' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2020-07-16T13:29:45.765 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:45 smithi132 bash[23299]: audit 2020-07-16T13:29:44.940609+0000 mon.a (mon.0) 19 : audit [INF] from='mgr.14100 172.21.15.132:0/206056556' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]': finished 2020-07-16T13:29:45.765 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:45 smithi132 bash[23299]: cluster 2020-07-16T13:29:44.940648+0000 mon.a (mon.0) 20 : cluster [DBG] osdmap e2: 0 total, 0 up, 0 in 2020-07-16T13:29:45.766 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:45 smithi132 bash[23299]: audit 2020-07-16T13:29:44.940924+0000 mon.a (mon.0) 21 : audit [INF] from='mgr.14100 172.21.15.132:0/206056556' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/telemetry/report_id","val":"f164cd07-6e6d-40f9-9d3e-58eb61584575"}]: dispatch 2020-07-16T13:29:45.766 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:45 smithi132 bash[23299]: audit 2020-07-16T13:29:44.941977+0000 mon.a (mon.0) 22 : audit [INF] from='mgr.14100 172.21.15.132:0/206056556' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2020-07-16T13:29:45.766 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:45 smithi132 bash[23299]: audit 2020-07-16T13:29:44.945553+0000 mon.a (mon.0) 23 : audit [INF] from='mgr.14100 172.21.15.132:0/206056556' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/telemetry/report_id","val":"f164cd07-6e6d-40f9-9d3e-58eb61584575"}]': finished 2020-07-16T13:29:45.766 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:45 smithi132 bash[23299]: audit 2020-07-16T13:29:44.946071+0000 mon.a (mon.0) 24 : audit [INF] from='mgr.14100 172.21.15.132:0/206056556' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/telemetry/salt","val":"9d95c11b-8eed-4b99-bbc0-64ad7b511389"}]: dispatch 2020-07-16T13:29:45.766 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:45 smithi132 bash[23299]: audit 2020-07-16T13:29:44.950126+0000 mon.a (mon.0) 25 : audit [INF] from='mgr.14100 172.21.15.132:0/206056556' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/telemetry/salt","val":"9d95c11b-8eed-4b99-bbc0-64ad7b511389"}]': finished 2020-07-16T13:29:46.456 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2020-07-16T13:29:46.457 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:29:46.457 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsid": "4c8ed362-c768-11ea-a06f-001a4aab830c", 2020-07-16T13:29:46.457 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "health": { 2020-07-16T13:29:46.457 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status": "HEALTH_OK", 2020-07-16T13:29:46.458 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "checks": {}, 2020-07-16T13:29:46.458 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mutes": [] 2020-07-16T13:29:46.458 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:46.458 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "election_epoch": 5, 2020-07-16T13:29:46.458 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum": [ 2020-07-16T13:29:46.459 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 0 2020-07-16T13:29:46.459 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:46.459 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_names": [ 2020-07-16T13:29:46.459 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "a" 2020-07-16T13:29:46.459 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:46.460 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_age": 6, 2020-07-16T13:29:46.461 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "monmap": { 2020-07-16T13:29:46.461 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2020-07-16T13:29:46.461 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_mon_release_name": "octopus", 2020-07-16T13:29:46.461 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_mons": 1 2020-07-16T13:29:46.462 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:46.462 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osdmap": { 2020-07-16T13:29:46.462 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 3, 2020-07-16T13:29:46.462 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_osds": 0, 2020-07-16T13:29:46.463 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_up_osds": 0, 2020-07-16T13:29:46.463 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_up_since": 0, 2020-07-16T13:29:46.463 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_in_osds": 0, 2020-07-16T13:29:46.463 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_in_since": 0, 2020-07-16T13:29:46.463 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_remapped_pgs": 0 2020-07-16T13:29:46.464 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:46.464 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgmap": { 2020-07-16T13:29:46.464 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgs_by_state": [], 2020-07-16T13:29:46.464 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pgs": 0, 2020-07-16T13:29:46.464 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pools": 0, 2020-07-16T13:29:46.465 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_objects": 0, 2020-07-16T13:29:46.465 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "data_bytes": 0, 2020-07-16T13:29:46.465 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_used": 0, 2020-07-16T13:29:46.465 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_avail": 0, 2020-07-16T13:29:46.465 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_total": 0 2020-07-16T13:29:46.465 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:46.466 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsmap": { 2020-07-16T13:29:46.466 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2020-07-16T13:29:46.466 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "by_rank": [], 2020-07-16T13:29:46.466 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "up:standby": 0 2020-07-16T13:29:46.466 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:46.467 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mgrmap": { 2020-07-16T13:29:46.467 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available": true, 2020-07-16T13:29:46.467 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_standbys": 0, 2020-07-16T13:29:46.467 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modules": [ 2020-07-16T13:29:46.467 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "iostat", 2020-07-16T13:29:46.467 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "restful" 2020-07-16T13:29:46.468 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:46.468 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2020-07-16T13:29:46.468 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:46.468 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "servicemap": { 2020-07-16T13:29:46.468 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2020-07-16T13:29:46.469 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modified": "2020-07-16T13:29:34.607617+0000", 2020-07-16T13:29:46.469 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2020-07-16T13:29:46.469 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:46.469 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress_events": {} 2020-07-16T13:29:46.469 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:46.778 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:46 smithi132 bash[23299]: cluster 2020-07-16T13:29:45.688480+0000 mon.a (mon.0) 26 : cluster [DBG] mgrmap e3: y(active, since 1.00973s) 2020-07-16T13:29:46.779 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:46 smithi132 bash[23299]: audit 2020-07-16T13:29:45.943485+0000 mon.a (mon.0) 27 : audit [INF] from='mgr.14100 172.21.15.132:0/206056556' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2020-07-16T13:29:46.779 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:46 smithi132 bash[23299]: cluster 2020-07-16T13:29:45.943526+0000 mon.a (mon.0) 28 : cluster [DBG] osdmap e3: 0 total, 0 up, 0 in 2020-07-16T13:29:46.779 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:46 smithi132 bash[23299]: audit 2020-07-16T13:29:45.945184+0000 mon.a (mon.0) 29 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2020-07-16T13:29:46.779 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:46 smithi132 bash[23299]: audit 2020-07-16T13:29:46.450919+0000 mon.a (mon.0) 30 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2020-07-16T13:29:46.780 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:46 smithi132 bash[23299]: audit 2020-07-16T13:29:46.451184+0000 mon.a (mon.0) 31 : audit [DBG] from='client.? 172.21.15.132:0/1040289001' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2020-07-16T13:29:46.996 INFO:teuthology.orchestra.run.smithi132.stderr:INFO:cephadm:Enabling cephadm module... 2020-07-16T13:29:46.997 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi132', '-v', '/var/log/ceph/4c8ed362-c768-11ea-a06f-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmp4bxmt8sq:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmprctwzzoo:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'mgr', 'module', 'enable', 'cephadm'] 2020-07-16T13:29:46.997 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi132 -v /var/log/ceph/4c8ed362-c768-11ea-a06f-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp4bxmt8sq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmprctwzzoo:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 mgr module enable cephadm 2020-07-16T13:29:48.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:47 smithi132 bash[23299]: cluster 2020-07-16T13:29:46.945015+0000 mon.a (mon.0) 32 : cluster [DBG] mgrmap e4: y(active, since 2s) 2020-07-16T13:29:48.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:47 smithi132 bash[23299]: audit 2020-07-16T13:29:47.755746+0000 mon.a (mon.0) 33 : audit [INF] from='client.? 172.21.15.132:0/4270641585' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2020-07-16T13:29:48.279 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:29:47 smithi132 bash[23536]: ignoring --setuser ceph since I am not root 2020-07-16T13:29:48.279 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:29:47 smithi132 bash[23536]: ignoring --setgroup ceph since I am not root 2020-07-16T13:29:48.459 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi132', '-v', '/var/log/ceph/4c8ed362-c768-11ea-a06f-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmp4bxmt8sq:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmprctwzzoo:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'mgr', 'dump'] 2020-07-16T13:29:48.460 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi132 -v /var/log/ceph/4c8ed362-c768-11ea-a06f-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp4bxmt8sq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmprctwzzoo:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 mgr dump 2020-07-16T13:29:49.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:48 smithi132 bash[23299]: audit 2020-07-16T13:29:47.947554+0000 mon.a (mon.0) 34 : audit [INF] from='client.? 172.21.15.132:0/4270641585' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2020-07-16T13:29:49.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:48 smithi132 bash[23299]: cluster 2020-07-16T13:29:47.947600+0000 mon.a (mon.0) 35 : cluster [DBG] mgrmap e5: y(active, since 3s) 2020-07-16T13:29:49.326 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:29:49.326 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 5, 2020-07-16T13:29:49.327 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_gid": 14100, 2020-07-16T13:29:49.327 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_name": "y", 2020-07-16T13:29:49.327 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_addrs": { 2020-07-16T13:29:49.327 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2020-07-16T13:29:49.327 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:29:49.328 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2020-07-16T13:29:49.328 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.132:6800", 2020-07-16T13:29:49.328 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 253269341 2020-07-16T13:29:49.328 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.328 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:29:49.329 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v1", 2020-07-16T13:29:49.329 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.132:6801", 2020-07-16T13:29:49.329 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 253269341 2020-07-16T13:29:49.329 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:49.329 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2020-07-16T13:29:49.330 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.330 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_addr": "172.21.15.132:6801/253269341", 2020-07-16T13:29:49.330 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_change": "2020-07-16T13:29:44.678738+0000", 2020-07-16T13:29:49.330 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_mgr_features": 4540138292836696063, 2020-07-16T13:29:49.330 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available": true, 2020-07-16T13:29:49.330 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standbys": [], 2020-07-16T13:29:49.331 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modules": [ 2020-07-16T13:29:49.331 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm", 2020-07-16T13:29:49.331 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "iostat", 2020-07-16T13:29:49.675 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "restful" 2020-07-16T13:29:49.675 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:49.676 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available_modules": [ 2020-07-16T13:29:49.676 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:29:49.676 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "alerts", 2020-07-16T13:29:49.676 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-07-16T13:29:49.677 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-07-16T13:29:49.677 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-07-16T13:29:49.677 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2020-07-16T13:29:49.677 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2020-07-16T13:29:49.677 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2020-07-16T13:29:49.678 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.678 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:49.678 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2020-07-16T13:29:49.678 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.678 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.678 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.679 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "How frequently to reexamine health status", 2020-07-16T13:29:49.679 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.679 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.679 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.679 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.680 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-07-16T13:29:49.680 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-07-16T13:29:49.680 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:49.680 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.680 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:49.680 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:49.681 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.681 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.681 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:29:49.681 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:29:49.681 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:29:49.682 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:29:49.682 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:29:49.682 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:29:49.682 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:29:49.682 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:49.682 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.683 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.683 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.683 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.683 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.683 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-07-16T13:29:49.684 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-07-16T13:29:49.684 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:49.684 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.684 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:49.684 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:49.684 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.685 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.685 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.685 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.685 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.685 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.686 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.686 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.686 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-07-16T13:29:49.686 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-07-16T13:29:49.686 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:49.687 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.687 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:49.687 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-07-16T13:29:49.687 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.688 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.688 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:29:49.688 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:29:49.688 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:29:49.688 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:29:49.688 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:29:49.689 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:29:49.689 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:29:49.689 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:49.689 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.689 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.690 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.690 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.690 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.690 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-07-16T13:29:49.690 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-07-16T13:29:49.690 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:49.691 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.691 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:49.691 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:49.691 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.691 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.692 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.692 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.692 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.692 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.692 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.692 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.693 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_destination": { 2020-07-16T13:29:49.693 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_destination", 2020-07-16T13:29:49.693 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:49.693 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.694 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:49.694 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:49.694 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.694 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.694 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.695 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Email address to send alerts to", 2020-07-16T13:29:49.695 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.695 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.695 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.695 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.695 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_from_name": { 2020-07-16T13:29:49.696 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_from_name", 2020-07-16T13:29:49.696 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:49.696 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.696 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:49.696 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "Ceph", 2020-07-16T13:29:49.697 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.697 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.697 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.697 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Email From: name", 2020-07-16T13:29:49.697 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.698 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.698 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.698 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.698 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_host": { 2020-07-16T13:29:49.698 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_host", 2020-07-16T13:29:49.698 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:49.699 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.699 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:49.699 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:49.699 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.699 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.700 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.700 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP server", 2020-07-16T13:29:49.700 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.700 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.700 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.700 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.701 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_password": { 2020-07-16T13:29:49.701 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_password", 2020-07-16T13:29:49.701 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:49.701 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.701 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:49.702 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:49.702 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.702 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.702 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.702 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Password to authenticate with", 2020-07-16T13:29:49.702 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.703 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.703 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.703 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.703 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_port": { 2020-07-16T13:29:49.703 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_port", 2020-07-16T13:29:49.704 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-07-16T13:29:49.704 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.704 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:49.704 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "465", 2020-07-16T13:29:49.704 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.704 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.705 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.705 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP port", 2020-07-16T13:29:49.705 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.705 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.705 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.706 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.706 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_sender": { 2020-07-16T13:29:49.706 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_sender", 2020-07-16T13:29:49.706 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:49.706 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.706 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:49.707 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:49.707 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.707 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.707 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.707 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP envelope sender", 2020-07-16T13:29:49.708 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.708 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.708 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.708 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.708 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_ssl": { 2020-07-16T13:29:49.708 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_ssl", 2020-07-16T13:29:49.709 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:49.709 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.709 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:49.709 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-07-16T13:29:49.709 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.710 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.710 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.710 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Use SSL to connect to SMTP server", 2020-07-16T13:29:49.710 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.710 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.710 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.711 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.711 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_user": { 2020-07-16T13:29:49.711 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_user", 2020-07-16T13:29:49.711 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:49.711 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.712 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:49.712 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:49.712 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.712 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.712 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.712 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "User to authenticate as", 2020-07-16T13:29:49.713 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.713 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.713 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.713 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:49.713 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:49.714 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.714 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:29:49.714 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "balancer", 2020-07-16T13:29:49.714 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-07-16T13:29:49.714 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-07-16T13:29:49.714 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-07-16T13:29:49.715 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active": { 2020-07-16T13:29:49.715 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "active", 2020-07-16T13:29:49.715 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:49.715 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.715 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:49.716 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:49.716 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.716 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.716 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.716 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "automatically balance PGs across cluster", 2020-07-16T13:29:49.716 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.717 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.717 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.717 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.717 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "begin_time": { 2020-07-16T13:29:49.717 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "begin_time", 2020-07-16T13:29:49.718 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:49.718 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.718 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:49.718 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0000", 2020-07-16T13:29:49.718 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.718 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.719 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.719 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "beginning time of day to automatically balance", 2020-07-16T13:29:49.719 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "This is a time of day in the format HHMM.", 2020-07-16T13:29:49.719 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.719 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.720 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.720 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "begin_weekday": { 2020-07-16T13:29:49.720 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "begin_weekday", 2020-07-16T13:29:49.720 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2020-07-16T13:29:49.720 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.721 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:49.721 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2020-07-16T13:29:49.721 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0", 2020-07-16T13:29:49.721 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "7", 2020-07-16T13:29:49.721 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.721 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Restrict automatic balancing to this day of the week or later", 2020-07-16T13:29:49.722 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2020-07-16T13:29:49.722 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.722 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.722 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.722 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_max_iterations": { 2020-07-16T13:29:49.723 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_max_iterations", 2020-07-16T13:29:49.723 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2020-07-16T13:29:49.723 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.723 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:49.723 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "25", 2020-07-16T13:29:49.723 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "1", 2020-07-16T13:29:49.724 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "250", 2020-07-16T13:29:49.724 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.724 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "maximum number of iterations to attempt optimization", 2020-07-16T13:29:49.724 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.724 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.725 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.725 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.725 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_metrics": { 2020-07-16T13:29:49.725 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_metrics", 2020-07-16T13:29:49.725 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:49.726 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.726 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:49.726 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "pgs,objects,bytes", 2020-07-16T13:29:49.726 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.726 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.726 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.727 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "metrics with which to calculate OSD utilization", 2020-07-16T13:29:49.727 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2020-07-16T13:29:49.727 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.727 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.727 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.728 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_step": { 2020-07-16T13:29:49.728 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_step", 2020-07-16T13:29:49.728 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2020-07-16T13:29:49.728 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.728 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:49.728 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0.5", 2020-07-16T13:29:49.729 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0.001", 2020-07-16T13:29:49.729 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "0.999", 2020-07-16T13:29:49.729 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.729 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "aggressiveness of optimization", 2020-07-16T13:29:49.729 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": ".99 is very aggressive, .01 is less aggressive", 2020-07-16T13:29:49.730 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.730 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.730 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.730 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "end_time": { 2020-07-16T13:29:49.730 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "end_time", 2020-07-16T13:29:49.730 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:49.731 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.731 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:49.731 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "2400", 2020-07-16T13:29:49.731 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.731 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.732 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.732 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "ending time of day to automatically balance", 2020-07-16T13:29:49.732 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "This is a time of day in the format HHMM.", 2020-07-16T13:29:49.732 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.732 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.732 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.733 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "end_weekday": { 2020-07-16T13:29:49.733 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "end_weekday", 2020-07-16T13:29:49.733 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2020-07-16T13:29:49.733 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.733 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:49.734 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7", 2020-07-16T13:29:49.734 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0", 2020-07-16T13:29:49.734 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "7", 2020-07-16T13:29:49.734 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.734 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Restrict automatic balancing to days of the week earlier than this", 2020-07-16T13:29:49.734 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2020-07-16T13:29:49.735 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.735 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.735 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.735 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-07-16T13:29:49.735 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-07-16T13:29:49.736 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:49.736 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.736 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:49.736 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:49.736 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.737 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.737 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:29:49.737 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:29:49.737 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:29:49.737 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:29:49.738 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:29:49.738 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:29:49.738 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:29:49.738 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:49.738 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.739 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.739 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.739 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.739 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.739 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-07-16T13:29:49.740 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-07-16T13:29:49.740 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:49.740 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.740 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:49.740 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:49.740 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.741 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.741 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.741 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.741 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.741 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.742 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.742 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.742 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-07-16T13:29:49.742 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-07-16T13:29:49.743 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:49.743 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.743 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:49.743 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-07-16T13:29:49.743 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.744 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.744 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:29:49.744 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:29:49.744 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:29:49.744 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:29:49.745 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:29:49.745 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:29:49.745 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:29:49.745 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:49.745 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.746 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.746 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.746 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.746 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.746 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-07-16T13:29:49.746 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-07-16T13:29:49.747 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:49.747 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.747 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:49.747 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:49.747 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.748 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.748 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.748 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.748 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.748 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.749 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.749 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.749 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_score": { 2020-07-16T13:29:49.749 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "min_score", 2020-07-16T13:29:49.749 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2020-07-16T13:29:49.750 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.750 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:49.750 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2020-07-16T13:29:49.750 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.750 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.751 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.751 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "minimum score, below which no optimization is attempted", 2020-07-16T13:29:49.751 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.751 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.751 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.751 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.752 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mode": { 2020-07-16T13:29:49.752 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mode", 2020-07-16T13:29:49.752 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:49.752 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.752 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:49.753 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "none", 2020-07-16T13:29:49.753 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.753 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.753 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:29:49.753 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush-compat", 2020-07-16T13:29:49.753 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "none", 2020-07-16T13:29:49.754 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap" 2020-07-16T13:29:49.754 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:49.754 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Balancer mode", 2020-07-16T13:29:49.754 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.755 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.755 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.755 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.755 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pool_ids": { 2020-07-16T13:29:49.756 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pool_ids", 2020-07-16T13:29:49.756 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:49.756 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.756 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:49.756 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:49.757 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.757 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.757 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.757 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "pools which the automatic balancing will be limited to", 2020-07-16T13:29:49.757 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.758 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.758 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.758 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.758 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2020-07-16T13:29:49.758 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2020-07-16T13:29:49.759 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2020-07-16T13:29:49.759 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.759 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:49.759 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2020-07-16T13:29:49.759 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.759 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.760 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.760 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to wake up and attempt optimization", 2020-07-16T13:29:49.760 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.760 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.760 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.761 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.761 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap_max_deviation": { 2020-07-16T13:29:49.761 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "upmap_max_deviation", 2020-07-16T13:29:49.761 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-07-16T13:29:49.761 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.762 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:49.762 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2020-07-16T13:29:49.762 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "1", 2020-07-16T13:29:49.762 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.762 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.762 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "deviation below which no optimization is attempted", 2020-07-16T13:29:49.763 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2020-07-16T13:29:49.763 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.763 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.763 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.763 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap_max_optimizations": { 2020-07-16T13:29:49.764 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "upmap_max_optimizations", 2020-07-16T13:29:49.764 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2020-07-16T13:29:49.764 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.764 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:49.765 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2020-07-16T13:29:49.765 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.765 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.765 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.765 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "maximum upmap optimizations to make per attempt", 2020-07-16T13:29:49.766 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.766 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.766 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.766 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:49.766 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:49.766 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.767 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:29:49.767 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "cephadm", 2020-07-16T13:29:49.767 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-07-16T13:29:49.767 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-07-16T13:29:49.767 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-07-16T13:29:49.768 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "allow_ptrace": { 2020-07-16T13:29:49.769 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "allow_ptrace", 2020-07-16T13:29:49.769 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:49.770 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.770 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:49.770 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:49.771 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.771 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.771 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.771 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "allow SYS_PTRACE capability on ceph containers", 2020-07-16T13:29:49.771 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2020-07-16T13:29:49.772 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.772 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.772 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.772 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "container_image_base": { 2020-07-16T13:29:49.772 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "container_image_base", 2020-07-16T13:29:49.772 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:49.773 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.773 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:49.773 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "ceph/ceph", 2020-07-16T13:29:49.773 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.773 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.774 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.774 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Container image name, without the tag", 2020-07-16T13:29:49.774 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.774 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.774 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.774 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.775 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "daemon_cache_timeout": { 2020-07-16T13:29:49.775 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "daemon_cache_timeout", 2020-07-16T13:29:49.775 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2020-07-16T13:29:49.775 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.775 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:49.776 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2020-07-16T13:29:49.776 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.776 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.776 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.776 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "seconds to cache service (daemon) inventory", 2020-07-16T13:29:49.777 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.777 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.777 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.777 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.778 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "device_cache_timeout": { 2020-07-16T13:29:49.778 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "device_cache_timeout", 2020-07-16T13:29:49.778 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2020-07-16T13:29:49.778 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.778 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:49.778 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1800", 2020-07-16T13:29:49.779 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.779 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.779 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.779 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "seconds to cache device inventory", 2020-07-16T13:29:49.779 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.780 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.780 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.780 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.780 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "host_check_interval": { 2020-07-16T13:29:49.780 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "host_check_interval", 2020-07-16T13:29:49.780 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2020-07-16T13:29:49.781 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.781 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:49.781 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2020-07-16T13:29:49.781 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.781 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.782 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.782 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to perform a host check", 2020-07-16T13:29:49.782 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.782 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.782 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.783 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.783 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-07-16T13:29:49.783 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-07-16T13:29:49.783 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:49.784 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.784 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:49.784 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:49.784 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.784 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.785 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:29:49.785 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:29:49.785 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:29:49.785 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:29:49.785 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:29:49.786 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:29:49.786 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:29:49.786 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:49.786 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.786 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.786 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.787 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.787 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.787 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-07-16T13:29:49.787 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-07-16T13:29:49.788 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:49.788 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.788 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:49.788 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-07-16T13:29:49.788 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.789 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.789 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.789 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "log to the \"cephadm\" cluster log channel\"", 2020-07-16T13:29:49.789 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.789 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.789 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.790 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.790 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-07-16T13:29:49.790 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-07-16T13:29:49.790 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:49.790 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.791 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:49.791 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-07-16T13:29:49.791 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.791 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.791 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:29:49.791 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:29:49.792 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:29:49.792 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:29:49.792 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:29:49.792 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:29:49.792 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:29:49.793 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:49.793 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.793 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.793 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.794 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.794 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.794 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-07-16T13:29:49.794 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-07-16T13:29:49.794 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:49.795 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.795 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:49.795 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:49.795 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.795 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.795 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.796 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.796 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.796 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.796 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.796 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.797 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mode": { 2020-07-16T13:29:49.797 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mode", 2020-07-16T13:29:49.797 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:49.797 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.797 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:49.797 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "root", 2020-07-16T13:29:49.798 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.798 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.798 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:29:49.798 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm-package", 2020-07-16T13:29:49.798 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "root" 2020-07-16T13:29:49.799 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:49.799 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "mode for remote execution of cephadm", 2020-07-16T13:29:49.799 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.799 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.799 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.799 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.800 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssh_config_file": { 2020-07-16T13:29:49.800 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssh_config_file", 2020-07-16T13:29:49.800 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:49.800 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.800 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:49.800 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2020-07-16T13:29:49.801 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.801 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.801 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.801 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "customized SSH config file to connect to managed hosts", 2020-07-16T13:29:49.801 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.802 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.802 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.802 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.802 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_failed_host_check": { 2020-07-16T13:29:49.802 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_failed_host_check", 2020-07-16T13:29:49.803 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:49.803 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.803 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:49.803 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-07-16T13:29:49.803 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.803 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.804 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.804 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if the host check fails", 2020-07-16T13:29:49.804 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.804 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.804 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.804 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.805 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_stray_daemons": { 2020-07-16T13:29:49.805 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_stray_daemons", 2020-07-16T13:29:49.805 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:49.805 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.805 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:49.806 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-07-16T13:29:49.806 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.806 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.806 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.806 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2020-07-16T13:29:49.807 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.807 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.807 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.807 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.807 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_stray_hosts": { 2020-07-16T13:29:49.807 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_stray_hosts", 2020-07-16T13:29:49.808 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:49.808 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.808 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:49.808 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-07-16T13:29:49.808 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.809 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.809 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.809 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2020-07-16T13:29:49.809 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.809 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.810 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.810 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:49.810 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:49.810 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.810 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:29:49.810 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crash", 2020-07-16T13:29:49.811 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-07-16T13:29:49.811 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-07-16T13:29:49.811 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-07-16T13:29:49.811 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-07-16T13:29:49.811 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-07-16T13:29:49.812 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:49.812 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.812 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:49.812 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:49.812 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.812 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.813 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:29:49.813 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:29:49.813 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:29:49.813 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:29:49.813 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:29:49.814 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:29:49.814 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:29:49.818 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:49.819 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.819 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.819 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.819 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.819 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.819 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-07-16T13:29:49.820 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-07-16T13:29:49.820 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:49.820 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.820 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:49.820 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:49.821 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.821 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.821 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.821 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.821 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.822 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.822 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.822 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.822 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-07-16T13:29:49.822 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-07-16T13:29:49.822 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:49.823 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.823 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:49.823 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-07-16T13:29:49.823 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.823 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.824 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:29:49.824 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:29:49.824 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:29:49.824 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:29:49.824 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:29:49.824 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:29:49.825 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:29:49.825 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:49.825 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.825 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.825 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.826 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.826 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.826 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-07-16T13:29:49.826 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-07-16T13:29:49.826 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:49.826 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.827 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:49.827 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:49.827 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.827 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.827 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.828 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.828 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.828 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.828 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.828 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.828 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "retain_interval": { 2020-07-16T13:29:49.829 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "retain_interval", 2020-07-16T13:29:49.829 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2020-07-16T13:29:49.829 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.829 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:49.829 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "31536000", 2020-07-16T13:29:49.830 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.830 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.830 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.830 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how long to retain crashes before pruning them", 2020-07-16T13:29:49.830 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.830 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.831 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.831 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.831 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_recent_interval": { 2020-07-16T13:29:49.831 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_recent_interval", 2020-07-16T13:29:49.831 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2020-07-16T13:29:49.831 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.832 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:49.832 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1209600", 2020-07-16T13:29:49.832 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.832 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.832 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.833 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "time interval in which to warn about recent crashes", 2020-07-16T13:29:49.833 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.833 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.833 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.833 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:49.834 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:49.834 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.834 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:29:49.834 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "dashboard", 2020-07-16T13:29:49.834 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-07-16T13:29:49.835 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-07-16T13:29:49.835 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-07-16T13:29:49.835 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ALERTMANAGER_API_HOST": { 2020-07-16T13:29:49.835 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ALERTMANAGER_API_HOST", 2020-07-16T13:29:49.835 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:49.835 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.836 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:49.836 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:49.836 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.836 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.836 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.837 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.837 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.837 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.837 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.838 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.838 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "AUDIT_API_ENABLED": { 2020-07-16T13:29:49.838 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "AUDIT_API_ENABLED", 2020-07-16T13:29:49.838 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:49.838 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.838 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:49.839 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:49.839 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.839 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.839 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.839 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.840 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.840 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.840 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.840 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.840 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "AUDIT_API_LOG_PAYLOAD": { 2020-07-16T13:29:49.840 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "AUDIT_API_LOG_PAYLOAD", 2020-07-16T13:29:49.841 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:49.841 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.841 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:49.841 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-07-16T13:29:49.841 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.842 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.842 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.842 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.842 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.842 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.842 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.843 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.843 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ENABLE_BROWSABLE_API": { 2020-07-16T13:29:49.843 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ENABLE_BROWSABLE_API", 2020-07-16T13:29:49.843 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:49.843 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.844 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:49.844 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-07-16T13:29:49.844 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.844 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.844 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.844 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.845 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.845 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.845 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.845 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.845 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_cephfs": { 2020-07-16T13:29:49.846 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_cephfs", 2020-07-16T13:29:49.846 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:49.846 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.846 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:49.846 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-07-16T13:29:49.846 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.847 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.847 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.847 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.847 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.847 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.848 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.848 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.848 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_iscsi": { 2020-07-16T13:29:49.848 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_iscsi", 2020-07-16T13:29:49.848 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:49.848 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.849 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:49.849 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-07-16T13:29:49.849 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.849 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.849 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.850 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.850 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.850 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.850 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.850 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.850 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_mirroring": { 2020-07-16T13:29:49.851 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_mirroring", 2020-07-16T13:29:49.851 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:49.851 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.851 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:49.851 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-07-16T13:29:49.852 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.852 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.852 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.852 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.852 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.852 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.853 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.853 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.853 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_nfs": { 2020-07-16T13:29:49.853 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_nfs", 2020-07-16T13:29:49.853 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:49.854 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.854 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:49.854 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-07-16T13:29:49.854 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.854 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.855 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.855 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.855 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.855 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.855 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.855 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.856 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_rbd": { 2020-07-16T13:29:49.856 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_rbd", 2020-07-16T13:29:49.856 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:49.856 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.856 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:49.857 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-07-16T13:29:49.857 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.857 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.857 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.857 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.858 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.858 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.858 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.858 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.858 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_rgw": { 2020-07-16T13:29:49.858 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_rgw", 2020-07-16T13:29:49.859 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:49.859 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.859 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:49.859 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-07-16T13:29:49.859 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.859 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.860 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.860 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.860 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.861 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.861 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.861 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.861 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2020-07-16T13:29:49.861 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2020-07-16T13:29:49.862 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:49.862 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.862 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:49.862 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:49.862 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.863 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.863 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.863 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.863 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.863 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.864 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.864 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.864 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_PASSWORD": { 2020-07-16T13:29:49.864 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_PASSWORD", 2020-07-16T13:29:49.864 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:49.864 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.865 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:49.865 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2020-07-16T13:29:49.865 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.865 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.866 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.866 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.866 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.866 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.866 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.867 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.867 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_SSL_VERIFY": { 2020-07-16T13:29:49.867 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_SSL_VERIFY", 2020-07-16T13:29:49.867 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:49.867 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.868 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:49.868 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-07-16T13:29:49.868 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.868 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.868 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.869 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.869 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.869 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.869 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.869 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.870 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_URL": { 2020-07-16T13:29:49.870 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_URL", 2020-07-16T13:29:49.870 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:49.870 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.871 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:49.871 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:49.871 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.871 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.871 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.871 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.872 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.872 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.872 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.872 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.872 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_USERNAME": { 2020-07-16T13:29:49.873 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_USERNAME", 2020-07-16T13:29:49.873 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:49.873 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.873 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:49.874 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2020-07-16T13:29:49.875 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.875 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.875 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.876 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.876 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.876 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.876 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.877 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.877 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_UPDATE_DASHBOARDS": { 2020-07-16T13:29:49.877 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_UPDATE_DASHBOARDS", 2020-07-16T13:29:49.878 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:49.878 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.878 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:49.879 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:49.879 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.879 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.880 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.880 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.880 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.880 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.880 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.881 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.881 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ISCSI_API_SSL_VERIFICATION": { 2020-07-16T13:29:49.881 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ISCSI_API_SSL_VERIFICATION", 2020-07-16T13:29:49.881 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:49.881 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.882 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:49.882 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-07-16T13:29:49.882 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.882 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.882 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.883 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.883 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.883 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.883 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.883 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.884 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PROMETHEUS_API_HOST": { 2020-07-16T13:29:49.884 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PROMETHEUS_API_HOST", 2020-07-16T13:29:49.884 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:49.884 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.884 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:49.884 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:49.885 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.885 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.885 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.885 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.885 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.886 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.886 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.886 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.886 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2020-07-16T13:29:49.886 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2020-07-16T13:29:49.887 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:49.887 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.887 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:49.887 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:49.887 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.887 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.888 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.888 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.888 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.888 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.888 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.889 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.889 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2020-07-16T13:29:49.889 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2020-07-16T13:29:49.889 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:49.889 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.890 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:49.890 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:49.890 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.890 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.890 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.890 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.891 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.891 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.891 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.891 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.891 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2020-07-16T13:29:49.892 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2020-07-16T13:29:49.892 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:49.892 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.892 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:49.892 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-07-16T13:29:49.892 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.893 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.893 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.893 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.893 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.893 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.894 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.894 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.894 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2020-07-16T13:29:49.894 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2020-07-16T13:29:49.894 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:49.895 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.895 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:49.895 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-07-16T13:29:49.895 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.895 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.895 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.896 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.896 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.896 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.896 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.896 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.897 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2020-07-16T13:29:49.897 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2020-07-16T13:29:49.897 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:49.897 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.897 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:49.897 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:49.898 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.898 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.898 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.898 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.898 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.899 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.899 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.899 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.899 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2020-07-16T13:29:49.899 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2020-07-16T13:29:49.900 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:49.900 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.900 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:49.900 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:49.900 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.900 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.901 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.901 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.901 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.901 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.901 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.902 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.902 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2020-07-16T13:29:49.902 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2020-07-16T13:29:49.902 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:49.902 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.903 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:49.903 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:49.903 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.903 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.903 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.903 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.904 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.904 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.904 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.904 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.904 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_ENABLED": { 2020-07-16T13:29:49.905 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_ENABLED", 2020-07-16T13:29:49.905 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:49.905 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.905 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:49.905 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-07-16T13:29:49.905 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.906 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.906 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.906 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.906 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.906 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.907 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.907 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.907 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_EXCLUSION_LIST": { 2020-07-16T13:29:49.907 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_EXCLUSION_LIST", 2020-07-16T13:29:49.907 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:49.907 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.908 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:49.908 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2020-07-16T13:29:49.908 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.908 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.908 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.909 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.909 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.909 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.909 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.909 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.910 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_MIN_COMPLEXITY": { 2020-07-16T13:29:49.910 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_MIN_COMPLEXITY", 2020-07-16T13:29:49.910 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-07-16T13:29:49.910 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.910 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:49.910 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2020-07-16T13:29:49.911 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.911 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.911 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.911 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.911 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.912 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.912 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.912 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.912 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_MIN_LENGTH": { 2020-07-16T13:29:49.912 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_MIN_LENGTH", 2020-07-16T13:29:49.912 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-07-16T13:29:49.913 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.913 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:49.913 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8", 2020-07-16T13:29:49.913 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.913 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.914 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.914 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.914 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.914 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.915 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.915 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.915 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "REST_REQUESTS_TIMEOUT": { 2020-07-16T13:29:49.915 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "REST_REQUESTS_TIMEOUT", 2020-07-16T13:29:49.915 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-07-16T13:29:49.915 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.916 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:49.916 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "45", 2020-07-16T13:29:49.916 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.916 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.916 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.917 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.917 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.917 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.917 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.917 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.917 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_ACCESS_KEY": { 2020-07-16T13:29:49.918 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_ACCESS_KEY", 2020-07-16T13:29:49.918 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:49.918 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.918 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:49.918 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:49.919 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.919 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.919 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.919 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.919 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.919 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.920 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.920 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.920 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_ADMIN_RESOURCE": { 2020-07-16T13:29:49.920 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_ADMIN_RESOURCE", 2020-07-16T13:29:49.920 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:49.921 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.921 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:49.921 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2020-07-16T13:29:49.921 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.921 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.922 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.922 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.923 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.923 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.923 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.923 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.923 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_HOST": { 2020-07-16T13:29:49.924 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_HOST", 2020-07-16T13:29:49.924 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:49.924 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.924 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:49.924 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:49.925 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.925 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.925 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.925 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.925 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.926 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.926 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.926 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.926 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_PORT": { 2020-07-16T13:29:49.926 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_PORT", 2020-07-16T13:29:49.927 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-07-16T13:29:49.927 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.927 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:49.927 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "80", 2020-07-16T13:29:49.927 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.927 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.928 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.928 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.928 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.928 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.928 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.929 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.929 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SCHEME": { 2020-07-16T13:29:49.929 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SCHEME", 2020-07-16T13:29:49.929 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:49.929 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.929 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:49.930 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "http", 2020-07-16T13:29:49.930 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.930 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.930 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.930 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.931 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.931 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.931 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.931 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.932 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SECRET_KEY": { 2020-07-16T13:29:49.932 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SECRET_KEY", 2020-07-16T13:29:49.932 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:49.932 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.932 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:49.933 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:49.933 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.933 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.933 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.933 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.934 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.934 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.934 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.934 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.934 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SSL_VERIFY": { 2020-07-16T13:29:49.935 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SSL_VERIFY", 2020-07-16T13:29:49.935 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:49.935 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.935 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:49.935 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-07-16T13:29:49.935 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.936 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.936 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.936 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.936 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.936 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.937 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.937 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.937 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_USER_ID": { 2020-07-16T13:29:49.937 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_USER_ID", 2020-07-16T13:29:49.937 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:49.937 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.938 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:49.938 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:49.938 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.938 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.938 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.939 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.939 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.939 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.939 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.939 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.939 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_SPAN": { 2020-07-16T13:29:49.940 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_SPAN", 2020-07-16T13:29:49.940 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-07-16T13:29:49.940 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.940 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:49.940 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2020-07-16T13:29:49.941 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.941 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.941 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.941 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.941 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.942 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.942 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.942 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.942 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_WARNING_1": { 2020-07-16T13:29:49.942 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_WARNING_1", 2020-07-16T13:29:49.943 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-07-16T13:29:49.943 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.943 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:49.943 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2020-07-16T13:29:49.943 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.944 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.944 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.944 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.944 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.944 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.944 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.945 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.945 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_WARNING_2": { 2020-07-16T13:29:49.945 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_WARNING_2", 2020-07-16T13:29:49.945 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-07-16T13:29:49.945 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.946 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:49.946 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2020-07-16T13:29:49.946 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.946 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.946 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.947 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.947 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.947 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.947 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.948 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.948 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crt_file": { 2020-07-16T13:29:49.948 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crt_file", 2020-07-16T13:29:49.948 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:49.949 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.949 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:49.949 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:49.950 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.950 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.950 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.950 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.951 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.951 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.951 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.952 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.952 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug": { 2020-07-16T13:29:49.952 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "debug", 2020-07-16T13:29:49.952 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:49.953 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.953 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:49.953 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:49.954 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.954 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.954 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.955 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Enable/disable debug options", 2020-07-16T13:29:49.955 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.955 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.955 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.956 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.956 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "jwt_token_ttl": { 2020-07-16T13:29:49.956 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "jwt_token_ttl", 2020-07-16T13:29:49.957 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-07-16T13:29:49.957 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.957 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:49.958 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "28800", 2020-07-16T13:29:49.958 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.958 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.958 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.959 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.959 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.959 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.959 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.959 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.959 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "key_file": { 2020-07-16T13:29:49.960 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "key_file", 2020-07-16T13:29:49.960 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:49.960 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.960 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:49.960 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:49.961 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.961 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.961 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.961 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.961 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.962 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.962 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.962 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.962 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-07-16T13:29:49.962 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-07-16T13:29:49.962 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:49.963 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.963 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:49.963 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:49.963 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.963 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.964 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:29:49.964 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:29:49.964 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:29:49.964 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:29:49.964 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:29:49.964 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:29:49.965 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:29:49.965 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:49.965 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.965 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.965 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.966 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.966 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.966 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-07-16T13:29:49.966 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-07-16T13:29:49.966 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:49.967 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.967 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:49.967 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:49.967 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.967 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.967 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.968 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.968 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.968 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.968 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.968 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.969 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-07-16T13:29:49.969 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-07-16T13:29:49.969 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:49.969 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.969 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:49.969 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-07-16T13:29:49.970 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.970 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.970 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:29:49.970 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:29:49.970 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:29:49.971 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:29:49.971 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:29:49.971 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:29:49.971 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:29:49.971 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:49.972 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.972 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.972 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.972 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.972 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.972 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-07-16T13:29:49.973 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-07-16T13:29:49.973 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:49.973 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.973 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:49.973 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:49.974 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.974 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.974 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.974 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.975 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.975 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.975 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.975 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.975 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "password": { 2020-07-16T13:29:49.975 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "password", 2020-07-16T13:29:49.976 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:49.976 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.976 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:49.976 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:49.976 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.977 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.977 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.977 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.977 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.977 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.978 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.978 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.978 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2020-07-16T13:29:49.978 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2020-07-16T13:29:49.978 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:49.978 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.979 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:49.979 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "::", 2020-07-16T13:29:49.979 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.979 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.979 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.980 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.980 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.980 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.980 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.980 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.980 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2020-07-16T13:29:49.981 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2020-07-16T13:29:49.981 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-07-16T13:29:49.981 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.981 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:49.981 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8080", 2020-07-16T13:29:49.982 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.982 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.982 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.982 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.982 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.983 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.983 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.983 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.983 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl": { 2020-07-16T13:29:49.983 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl", 2020-07-16T13:29:49.983 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:49.984 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.984 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:49.984 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-07-16T13:29:49.984 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.984 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.984 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.985 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.985 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.985 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.985 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.986 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.987 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl_server_port": { 2020-07-16T13:29:49.987 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl_server_port", 2020-07-16T13:29:49.987 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-07-16T13:29:49.987 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.987 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:49.988 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8443", 2020-07-16T13:29:49.988 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.988 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.988 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.988 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.988 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.989 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.989 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.989 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.989 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standby_behaviour": { 2020-07-16T13:29:49.990 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "standby_behaviour", 2020-07-16T13:29:49.990 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:49.990 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.990 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:49.990 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "redirect", 2020-07-16T13:29:49.990 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.991 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.991 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:29:49.991 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:29:49.991 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "redirect" 2020-07-16T13:29:49.991 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:49.992 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.992 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.992 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.992 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.992 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.992 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standby_error_status_code": { 2020-07-16T13:29:49.993 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "standby_error_status_code", 2020-07-16T13:29:49.993 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-07-16T13:29:49.993 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.993 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:49.993 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "500", 2020-07-16T13:29:49.994 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "400", 2020-07-16T13:29:49.994 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "599", 2020-07-16T13:29:49.994 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.994 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.994 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.995 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.995 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.995 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.995 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "url_prefix": { 2020-07-16T13:29:49.995 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "url_prefix", 2020-07-16T13:29:49.995 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:49.996 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:49.996 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:49.996 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:49.996 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:49.997 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:49.997 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:49.997 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:49.998 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:49.998 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:49.998 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:49.999 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:49.999 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "username": { 2020-07-16T13:29:49.999 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "username", 2020-07-16T13:29:49.999 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.000 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.000 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:50.000 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:50.001 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.001 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.001 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.002 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.002 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.002 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.002 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.003 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:50.003 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:50.003 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.003 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:29:50.004 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "devicehealth", 2020-07-16T13:29:50.004 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-07-16T13:29:50.004 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-07-16T13:29:50.004 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-07-16T13:29:50.005 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enable_monitoring": { 2020-07-16T13:29:50.005 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "enable_monitoring", 2020-07-16T13:29:50.005 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:50.005 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.006 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.006 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-07-16T13:29:50.006 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.006 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.006 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.007 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "monitor device health metrics", 2020-07-16T13:29:50.007 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.007 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.007 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.007 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.008 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-07-16T13:29:50.008 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-07-16T13:29:50.008 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.008 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.008 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.009 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:50.009 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.009 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.009 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:29:50.010 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:29:50.010 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:29:50.010 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:29:50.010 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:29:50.010 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:29:50.010 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:29:50.011 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:50.011 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.011 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.011 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.011 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.012 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.012 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-07-16T13:29:50.012 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-07-16T13:29:50.012 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:50.012 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.012 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.013 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:50.013 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.013 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.013 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.013 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.014 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.014 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.014 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.014 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.015 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-07-16T13:29:50.015 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-07-16T13:29:50.015 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.015 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.015 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.015 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-07-16T13:29:50.016 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.016 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.016 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:29:50.016 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:29:50.016 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:29:50.017 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:29:50.017 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:29:50.017 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:29:50.017 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:29:50.017 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:50.017 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.022 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.023 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.023 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.023 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.023 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-07-16T13:29:50.024 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-07-16T13:29:50.024 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:50.024 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.024 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.024 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:50.025 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.025 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.025 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.025 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.026 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.026 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.026 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.026 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.026 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mark_out_threshold": { 2020-07-16T13:29:50.027 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mark_out_threshold", 2020-07-16T13:29:50.027 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2020-07-16T13:29:50.027 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.027 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.027 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "2419200", 2020-07-16T13:29:50.028 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.028 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.028 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.028 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "automatically mark OSD if it may fail before this long", 2020-07-16T13:29:50.028 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.029 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.029 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.029 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.030 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pool_name": { 2020-07-16T13:29:50.030 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pool_name", 2020-07-16T13:29:50.030 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.031 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.031 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.031 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "device_health_metrics", 2020-07-16T13:29:50.032 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.032 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.032 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.032 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "name of pool in which to store device health metrics", 2020-07-16T13:29:50.033 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.033 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.033 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.033 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.034 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "retention_period": { 2020-07-16T13:29:50.034 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "retention_period", 2020-07-16T13:29:50.035 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2020-07-16T13:29:50.035 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.035 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.035 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "15552000", 2020-07-16T13:29:50.035 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.036 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.036 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.036 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how long to retain device health metrics", 2020-07-16T13:29:50.036 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.036 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.037 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.037 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.037 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "scrape_frequency": { 2020-07-16T13:29:50.037 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "scrape_frequency", 2020-07-16T13:29:50.037 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2020-07-16T13:29:50.038 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.038 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.038 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "86400", 2020-07-16T13:29:50.039 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.039 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.039 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.039 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to scrape device health metrics", 2020-07-16T13:29:50.039 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.039 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.040 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.040 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.040 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "self_heal": { 2020-07-16T13:29:50.041 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "self_heal", 2020-07-16T13:29:50.041 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:50.041 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.041 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.042 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-07-16T13:29:50.042 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.042 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.042 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.042 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "preemptively heal cluster around devices that may fail", 2020-07-16T13:29:50.043 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.043 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.043 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.044 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.044 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2020-07-16T13:29:50.044 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2020-07-16T13:29:50.044 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2020-07-16T13:29:50.045 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.045 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.045 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2020-07-16T13:29:50.045 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.046 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.046 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.046 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to wake up and check device health", 2020-07-16T13:29:50.047 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.047 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.047 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.048 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.048 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_threshold": { 2020-07-16T13:29:50.048 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_threshold", 2020-07-16T13:29:50.049 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2020-07-16T13:29:50.049 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.049 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.050 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7257600", 2020-07-16T13:29:50.050 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.050 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.051 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.051 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise health warning if OSD may fail before this long", 2020-07-16T13:29:50.051 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.052 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.052 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.052 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:50.052 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:50.053 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.053 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:29:50.053 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "diskprediction_local", 2020-07-16T13:29:50.054 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-07-16T13:29:50.054 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-07-16T13:29:50.054 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-07-16T13:29:50.055 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-07-16T13:29:50.055 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-07-16T13:29:50.055 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.056 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.056 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.056 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:50.056 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.057 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.057 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:29:50.057 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:29:50.058 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:29:50.058 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:29:50.058 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:29:50.059 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:29:50.059 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:29:50.059 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:50.060 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.060 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.060 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.060 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.061 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.061 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-07-16T13:29:50.062 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-07-16T13:29:50.062 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:50.062 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.063 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.063 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:50.064 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.064 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.064 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.064 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.065 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.065 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.065 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.066 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.066 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-07-16T13:29:50.066 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-07-16T13:29:50.067 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.067 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.067 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.068 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-07-16T13:29:50.068 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.068 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.069 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:29:50.069 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:29:50.069 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:29:50.069 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:29:50.070 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:29:50.070 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:29:50.070 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:29:50.071 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:50.071 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.071 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.072 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.072 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.072 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.072 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-07-16T13:29:50.073 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-07-16T13:29:50.073 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:50.074 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.074 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.074 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:50.074 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.075 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.075 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.075 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.076 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.076 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.076 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.077 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.077 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "predict_interval": { 2020-07-16T13:29:50.077 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "predict_interval", 2020-07-16T13:29:50.077 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.078 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.078 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:50.078 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "86400", 2020-07-16T13:29:50.079 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.079 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.079 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.079 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.080 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.080 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.080 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.080 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.081 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "predictor_model": { 2020-07-16T13:29:50.081 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "predictor_model", 2020-07-16T13:29:50.081 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.081 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.081 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:50.082 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "prophetstor", 2020-07-16T13:29:50.082 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.082 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.082 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.082 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.082 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.083 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.083 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.083 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.083 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2020-07-16T13:29:50.083 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2020-07-16T13:29:50.084 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.084 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.084 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:50.084 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2020-07-16T13:29:50.084 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.084 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.085 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.085 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.085 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.085 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.085 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.086 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:50.086 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:50.086 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.086 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:29:50.086 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "influx", 2020-07-16T13:29:50.086 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": false, 2020-07-16T13:29:50.087 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "influxdb python module not found", 2020-07-16T13:29:50.087 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-07-16T13:29:50.087 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "batch_size": { 2020-07-16T13:29:50.088 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "batch_size", 2020-07-16T13:29:50.088 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.088 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.088 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:50.088 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5000", 2020-07-16T13:29:50.088 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.089 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.089 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.089 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.089 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.089 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.090 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.090 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.090 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "database": { 2020-07-16T13:29:50.090 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "database", 2020-07-16T13:29:50.090 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.091 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.091 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:50.091 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "ceph", 2020-07-16T13:29:50.091 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.091 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.091 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.092 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.092 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.092 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.092 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.092 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.093 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "hostname": { 2020-07-16T13:29:50.093 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "hostname", 2020-07-16T13:29:50.093 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.093 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.093 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:50.093 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2020-07-16T13:29:50.094 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.094 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.094 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.094 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.094 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.095 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.095 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.095 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.095 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2020-07-16T13:29:50.095 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2020-07-16T13:29:50.095 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.096 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.096 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:50.096 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "30", 2020-07-16T13:29:50.096 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.096 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.097 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.097 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.097 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.097 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.097 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.097 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.098 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-07-16T13:29:50.098 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-07-16T13:29:50.098 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.098 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.098 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.099 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:50.099 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.099 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.099 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:29:50.099 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:29:50.099 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:29:50.100 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:29:50.100 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:29:50.100 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:29:50.100 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:29:50.100 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:50.101 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.101 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.101 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.101 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.101 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.101 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-07-16T13:29:50.102 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-07-16T13:29:50.102 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:50.102 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.102 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.102 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:50.103 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.103 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.103 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.103 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.103 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.103 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.104 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.104 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.104 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-07-16T13:29:50.104 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-07-16T13:29:50.104 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.104 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.105 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.105 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-07-16T13:29:50.105 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.105 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.105 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:29:50.106 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:29:50.106 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:29:50.106 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:29:50.106 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:29:50.106 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:29:50.106 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:29:50.107 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:50.107 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.107 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.107 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.107 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.108 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.108 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-07-16T13:29:50.108 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-07-16T13:29:50.108 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:50.108 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.109 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.109 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:50.109 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.109 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.109 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.109 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.110 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.110 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.110 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.110 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.110 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "password": { 2020-07-16T13:29:50.111 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "password", 2020-07-16T13:29:50.111 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.111 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.111 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:50.111 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2020-07-16T13:29:50.111 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.112 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.112 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.112 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.112 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.112 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.113 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.113 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.113 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "port": { 2020-07-16T13:29:50.113 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "port", 2020-07-16T13:29:50.113 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.113 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.114 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:50.114 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8086", 2020-07-16T13:29:50.114 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.114 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.114 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.115 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.115 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.115 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.115 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.115 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.115 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl": { 2020-07-16T13:29:50.116 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl", 2020-07-16T13:29:50.116 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.116 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.116 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:50.116 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "false", 2020-07-16T13:29:50.117 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.117 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.117 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.117 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.117 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.117 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.118 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.118 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.118 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "threads": { 2020-07-16T13:29:50.118 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "threads", 2020-07-16T13:29:50.118 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.119 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.119 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:50.119 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2020-07-16T13:29:50.119 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.119 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.119 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.120 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.120 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.120 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.120 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.120 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.121 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "username": { 2020-07-16T13:29:50.121 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "username", 2020-07-16T13:29:50.121 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.121 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.121 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:50.121 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2020-07-16T13:29:50.122 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.122 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.122 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.122 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.122 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.123 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.123 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.123 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.123 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "verify_ssl": { 2020-07-16T13:29:50.123 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "verify_ssl", 2020-07-16T13:29:50.124 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.124 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.124 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:50.124 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "true", 2020-07-16T13:29:50.124 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.125 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.125 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.125 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.125 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.126 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.126 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.126 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:50.126 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:50.126 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.126 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:29:50.127 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "insights", 2020-07-16T13:29:50.127 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-07-16T13:29:50.127 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-07-16T13:29:50.127 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-07-16T13:29:50.127 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-07-16T13:29:50.128 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-07-16T13:29:50.128 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.128 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.128 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.128 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:50.128 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.129 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.129 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:29:50.129 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:29:50.129 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:29:50.129 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:29:50.130 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:29:50.130 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:29:50.130 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:29:50.130 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:50.130 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.130 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.131 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.131 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.131 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.131 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-07-16T13:29:50.131 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-07-16T13:29:50.132 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:50.132 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.132 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.132 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:50.132 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.133 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.133 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.133 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.133 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.133 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.133 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.134 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.134 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-07-16T13:29:50.134 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-07-16T13:29:50.134 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.135 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.135 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.135 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-07-16T13:29:50.135 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.135 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.136 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:29:50.136 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:29:50.136 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:29:50.136 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:29:50.136 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:29:50.136 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:29:50.137 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:29:50.137 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:50.137 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.137 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.137 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.138 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.138 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.138 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-07-16T13:29:50.138 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-07-16T13:29:50.138 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:50.138 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.139 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.139 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:50.139 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.139 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.139 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.140 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.140 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.140 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.140 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.140 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:50.140 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:50.141 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.141 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:29:50.141 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "iostat", 2020-07-16T13:29:50.141 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-07-16T13:29:50.141 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-07-16T13:29:50.142 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-07-16T13:29:50.142 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-07-16T13:29:50.142 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-07-16T13:29:50.142 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.142 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.142 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.143 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:50.143 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.143 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.143 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:29:50.143 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:29:50.143 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:29:50.144 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:29:50.144 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:29:50.144 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:29:50.144 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:29:50.144 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:50.145 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.145 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.145 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.145 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.145 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.145 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-07-16T13:29:50.146 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-07-16T13:29:50.146 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:50.146 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.146 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.147 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:50.147 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.147 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.147 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.147 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.148 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.148 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.148 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.148 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.148 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-07-16T13:29:50.148 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-07-16T13:29:50.149 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.149 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.149 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.149 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-07-16T13:29:50.149 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.149 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.150 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:29:50.150 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:29:50.150 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:29:50.150 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:29:50.150 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:29:50.151 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:29:50.151 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:29:50.151 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:50.151 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.151 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.151 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.152 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.152 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.152 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-07-16T13:29:50.152 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-07-16T13:29:50.152 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:50.153 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.153 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.153 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:50.153 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.153 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.154 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.154 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.154 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.154 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.154 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.154 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:50.155 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:50.155 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.155 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:29:50.155 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "k8sevents", 2020-07-16T13:29:50.155 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-07-16T13:29:50.155 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-07-16T13:29:50.156 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-07-16T13:29:50.156 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ceph_event_retention_days": { 2020-07-16T13:29:50.156 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ceph_event_retention_days", 2020-07-16T13:29:50.156 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-07-16T13:29:50.156 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.157 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:50.157 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7", 2020-07-16T13:29:50.157 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.157 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.157 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.158 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Days to hold ceph event information within local cache", 2020-07-16T13:29:50.158 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.158 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.158 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.158 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.158 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "config_check_secs": { 2020-07-16T13:29:50.159 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "config_check_secs", 2020-07-16T13:29:50.159 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-07-16T13:29:50.159 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.159 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:50.159 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2020-07-16T13:29:50.159 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "10", 2020-07-16T13:29:50.160 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.160 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.160 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "interval (secs) to check for cluster configuration changes", 2020-07-16T13:29:50.160 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.160 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.161 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.161 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.161 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-07-16T13:29:50.161 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-07-16T13:29:50.161 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.161 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.162 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.162 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:50.162 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.162 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.162 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:29:50.163 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:29:50.163 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:29:50.163 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:29:50.163 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:29:50.163 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:29:50.163 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:29:50.164 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:50.164 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.164 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.164 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.164 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.165 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.165 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-07-16T13:29:50.165 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-07-16T13:29:50.165 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:50.165 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.165 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.166 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:50.166 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.166 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.166 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.166 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.167 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.167 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.167 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.167 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.167 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-07-16T13:29:50.167 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-07-16T13:29:50.168 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.168 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.168 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.168 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-07-16T13:29:50.168 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.169 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.169 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:29:50.169 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:29:50.169 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:29:50.169 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:29:50.169 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:29:50.170 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:29:50.170 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:29:50.170 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:50.170 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.170 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.171 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.171 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.171 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.171 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-07-16T13:29:50.171 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-07-16T13:29:50.171 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:50.172 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.172 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.172 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:50.172 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.172 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.172 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.173 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.173 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.173 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.173 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.173 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:50.174 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:50.174 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.174 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:29:50.174 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "localpool", 2020-07-16T13:29:50.174 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-07-16T13:29:50.175 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-07-16T13:29:50.175 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-07-16T13:29:50.175 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "failure_domain": { 2020-07-16T13:29:50.175 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "failure_domain", 2020-07-16T13:29:50.175 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.175 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.176 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.176 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "host", 2020-07-16T13:29:50.176 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.176 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.176 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.177 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "failure domain for any created local pool", 2020-07-16T13:29:50.177 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.177 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.177 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.177 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.177 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-07-16T13:29:50.178 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-07-16T13:29:50.178 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.178 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.178 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.178 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:50.179 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.179 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.179 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:29:50.179 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:29:50.179 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:29:50.179 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:29:50.180 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:29:50.180 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:29:50.180 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:29:50.180 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:50.180 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.180 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.181 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.181 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.181 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.181 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-07-16T13:29:50.181 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-07-16T13:29:50.182 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:50.182 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.182 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.182 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:50.182 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.182 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.183 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.183 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.183 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.183 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.183 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.184 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.184 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-07-16T13:29:50.184 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-07-16T13:29:50.184 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.184 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.184 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.185 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-07-16T13:29:50.185 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.185 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.185 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:29:50.185 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:29:50.186 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:29:50.186 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:29:50.186 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:29:50.186 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:29:50.186 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:29:50.186 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:50.187 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.187 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.187 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.187 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.187 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.188 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-07-16T13:29:50.188 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-07-16T13:29:50.188 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:50.188 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.188 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.188 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:50.189 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.189 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.189 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.189 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.189 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.190 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.190 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.190 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.190 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_size": { 2020-07-16T13:29:50.190 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "min_size", 2020-07-16T13:29:50.190 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-07-16T13:29:50.191 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.191 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.191 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:50.191 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.191 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.191 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.192 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default min_size for any created local pool", 2020-07-16T13:29:50.192 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.192 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.192 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.192 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.193 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_rep": { 2020-07-16T13:29:50.193 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "num_rep", 2020-07-16T13:29:50.193 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-07-16T13:29:50.193 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.193 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.193 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "3", 2020-07-16T13:29:50.194 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.194 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.194 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.194 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default replica count for any created local pool", 2020-07-16T13:29:50.194 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.195 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.195 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.195 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.195 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pg_num": { 2020-07-16T13:29:50.195 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pg_num", 2020-07-16T13:29:50.195 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-07-16T13:29:50.196 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.196 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.196 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "128", 2020-07-16T13:29:50.196 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.196 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.197 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.197 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default pg_num for any created local pool", 2020-07-16T13:29:50.197 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.197 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.197 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.198 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.198 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "prefix": { 2020-07-16T13:29:50.198 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "prefix", 2020-07-16T13:29:50.198 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.198 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.198 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.199 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:50.199 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.199 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.199 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.199 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "name prefix for any created local pool", 2020-07-16T13:29:50.199 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.200 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.200 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.200 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.200 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "subtree": { 2020-07-16T13:29:50.200 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "subtree", 2020-07-16T13:29:50.201 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.201 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.201 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.201 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "rack", 2020-07-16T13:29:50.201 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.201 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.202 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.202 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "CRUSH level for which to create a local pool", 2020-07-16T13:29:50.202 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.202 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.202 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.203 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:50.203 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:50.203 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.203 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:29:50.203 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "orchestrator", 2020-07-16T13:29:50.203 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-07-16T13:29:50.204 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-07-16T13:29:50.204 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-07-16T13:29:50.204 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-07-16T13:29:50.204 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-07-16T13:29:50.204 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.205 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.205 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.205 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:50.205 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.205 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.205 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:29:50.206 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:29:50.206 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:29:50.206 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:29:50.207 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:29:50.207 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:29:50.207 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:29:50.207 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:50.207 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.207 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.208 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.208 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.208 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.208 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-07-16T13:29:50.208 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-07-16T13:29:50.209 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:50.209 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.209 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.209 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:50.209 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.209 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.210 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.210 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.210 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.210 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.210 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.210 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.211 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-07-16T13:29:50.211 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-07-16T13:29:50.211 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.211 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.211 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.212 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-07-16T13:29:50.212 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.212 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.212 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:29:50.212 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:29:50.212 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:29:50.213 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:29:50.213 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:29:50.213 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:29:50.213 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:29:50.213 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:50.214 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.214 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.214 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.214 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.214 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.214 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-07-16T13:29:50.215 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-07-16T13:29:50.215 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:50.215 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.215 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.215 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:50.216 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.216 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.216 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.216 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.216 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.216 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.217 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.217 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.217 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator": { 2020-07-16T13:29:50.217 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "orchestrator", 2020-07-16T13:29:50.217 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.218 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.218 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.218 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2020-07-16T13:29:50.218 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.218 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.218 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:29:50.219 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm", 2020-07-16T13:29:50.219 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rook", 2020-07-16T13:29:50.219 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "test_orchestrator" 2020-07-16T13:29:50.219 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:50.219 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Orchestrator backend", 2020-07-16T13:29:50.220 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.220 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.220 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.220 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:50.220 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:50.220 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.221 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:29:50.221 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "osd_support", 2020-07-16T13:29:50.221 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-07-16T13:29:50.221 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-07-16T13:29:50.221 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-07-16T13:29:50.222 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-07-16T13:29:50.222 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-07-16T13:29:50.222 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.222 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.222 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.226 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:50.227 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.227 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.227 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:29:50.228 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:29:50.228 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:29:50.228 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:29:50.229 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:29:50.229 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:29:50.229 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:29:50.230 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:50.230 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.230 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.231 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.231 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.231 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.232 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-07-16T13:29:50.232 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-07-16T13:29:50.232 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:50.232 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.233 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.233 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:50.233 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.234 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.234 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.234 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.235 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.235 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.235 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.236 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.236 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-07-16T13:29:50.236 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-07-16T13:29:50.237 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.237 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.237 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.237 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-07-16T13:29:50.238 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.238 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.238 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:29:50.239 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:29:50.239 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:29:50.239 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:29:50.240 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:29:50.240 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:29:50.240 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:29:50.240 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:50.241 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.241 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.241 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.242 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.242 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.242 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-07-16T13:29:50.243 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-07-16T13:29:50.243 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:50.243 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.243 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.244 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:50.244 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.244 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.245 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.245 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.245 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.245 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.245 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.246 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:50.248 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:50.248 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.248 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:29:50.248 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pg_autoscaler", 2020-07-16T13:29:50.249 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-07-16T13:29:50.249 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-07-16T13:29:50.249 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-07-16T13:29:50.249 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-07-16T13:29:50.249 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-07-16T13:29:50.249 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.250 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.250 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.250 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:50.250 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.250 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.251 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:29:50.251 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:29:50.251 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:29:50.251 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:29:50.251 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:29:50.251 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:29:50.252 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:29:50.252 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:50.252 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.252 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.252 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.253 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.253 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.253 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-07-16T13:29:50.253 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-07-16T13:29:50.253 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:50.254 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.254 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.254 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:50.254 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.254 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.255 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.255 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.255 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.255 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.255 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.255 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.256 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-07-16T13:29:50.256 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-07-16T13:29:50.256 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.256 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.256 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.257 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-07-16T13:29:50.257 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.257 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.257 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:29:50.257 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:29:50.257 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:29:50.258 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:29:50.258 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:29:50.258 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:29:50.259 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:29:50.259 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:50.259 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.259 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.259 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.260 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.260 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.260 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-07-16T13:29:50.260 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-07-16T13:29:50.260 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:50.261 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.261 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.261 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:50.261 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.261 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.261 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.262 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.262 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.262 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.262 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.262 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.263 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2020-07-16T13:29:50.263 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2020-07-16T13:29:50.263 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.263 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.263 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:50.263 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2020-07-16T13:29:50.264 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.264 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.264 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.264 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.264 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.265 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.265 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.265 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:50.265 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:50.265 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.265 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:29:50.266 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "progress", 2020-07-16T13:29:50.266 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-07-16T13:29:50.266 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-07-16T13:29:50.266 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-07-16T13:29:50.266 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-07-16T13:29:50.267 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-07-16T13:29:50.267 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.267 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.267 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.267 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:50.268 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.268 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.268 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:29:50.268 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:29:50.269 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:29:50.269 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:29:50.269 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:29:50.269 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:29:50.269 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:29:50.270 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:50.270 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.270 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.270 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.270 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.270 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.271 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-07-16T13:29:50.271 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-07-16T13:29:50.271 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:50.271 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.271 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.272 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:50.272 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.272 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.272 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.272 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.272 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.273 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.273 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.273 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.273 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-07-16T13:29:50.273 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-07-16T13:29:50.274 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.274 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.274 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.274 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-07-16T13:29:50.274 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.274 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.275 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:29:50.275 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:29:50.275 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:29:50.275 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:29:50.275 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:29:50.276 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:29:50.276 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:29:50.276 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:50.276 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.276 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.277 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.277 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.277 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.277 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-07-16T13:29:50.277 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-07-16T13:29:50.277 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:50.278 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.278 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.278 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:50.278 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.279 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.279 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.279 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.279 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.279 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.280 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.280 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.280 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max_completed_events": { 2020-07-16T13:29:50.280 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "max_completed_events", 2020-07-16T13:29:50.280 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-07-16T13:29:50.281 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.281 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.281 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "50", 2020-07-16T13:29:50.281 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.281 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.282 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.282 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "number of past completed events to remember", 2020-07-16T13:29:50.282 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.282 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.282 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.282 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.283 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "persist_interval": { 2020-07-16T13:29:50.283 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "persist_interval", 2020-07-16T13:29:50.283 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2020-07-16T13:29:50.283 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.283 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.284 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2020-07-16T13:29:50.284 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.284 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.284 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.284 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to persist completed events", 2020-07-16T13:29:50.284 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.285 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.285 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.285 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:50.285 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:50.285 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.286 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:29:50.286 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "prometheus", 2020-07-16T13:29:50.286 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-07-16T13:29:50.286 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-07-16T13:29:50.286 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-07-16T13:29:50.286 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-07-16T13:29:50.287 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-07-16T13:29:50.287 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.287 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.287 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.287 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:50.288 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.288 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.288 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:29:50.288 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:29:50.288 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:29:50.288 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:29:50.289 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:29:50.290 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:29:50.290 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:29:50.290 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:50.290 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.291 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.291 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.291 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.291 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.291 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-07-16T13:29:50.292 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-07-16T13:29:50.292 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:50.292 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.292 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.292 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:50.293 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.293 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.293 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.293 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.293 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.294 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.294 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.294 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.294 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-07-16T13:29:50.294 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-07-16T13:29:50.295 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.295 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.295 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.295 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-07-16T13:29:50.295 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.296 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.296 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:29:50.296 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:29:50.296 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:29:50.296 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:29:50.297 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:29:50.297 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:29:50.297 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:29:50.297 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:50.297 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.298 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.298 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.298 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.298 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.298 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-07-16T13:29:50.299 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-07-16T13:29:50.299 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:50.299 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.299 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.299 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:50.300 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.300 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.300 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.300 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.300 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.301 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.301 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.301 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.301 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_stats_pools": { 2020-07-16T13:29:50.301 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_stats_pools", 2020-07-16T13:29:50.302 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.302 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.302 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:50.302 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:50.302 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.303 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.303 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.303 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.303 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.303 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.304 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.304 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.304 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_stats_pools_refresh_interval": { 2020-07-16T13:29:50.304 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_stats_pools_refresh_interval", 2020-07-16T13:29:50.304 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.305 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.305 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:50.305 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:50.305 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.305 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.306 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.306 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.306 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.306 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.306 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.307 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.307 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "scrape_interval": { 2020-07-16T13:29:50.307 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "scrape_interval", 2020-07-16T13:29:50.307 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.307 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.308 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:50.308 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:50.308 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.308 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.308 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.308 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.309 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.309 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.309 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.309 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.309 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2020-07-16T13:29:50.310 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2020-07-16T13:29:50.310 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.310 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.310 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:50.310 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:50.311 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.311 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.311 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.311 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.311 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.312 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.312 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.312 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.312 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2020-07-16T13:29:50.312 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2020-07-16T13:29:50.313 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.313 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.313 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:50.313 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:50.313 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.314 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.314 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.314 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.314 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.314 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.315 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.315 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:50.315 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:50.315 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.315 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:29:50.316 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_support", 2020-07-16T13:29:50.316 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-07-16T13:29:50.316 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-07-16T13:29:50.316 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-07-16T13:29:50.316 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-07-16T13:29:50.317 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-07-16T13:29:50.317 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.317 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.317 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.317 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:50.318 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.318 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.318 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:29:50.318 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:29:50.318 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:29:50.318 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:29:50.319 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:29:50.319 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:29:50.319 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:29:50.319 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:50.319 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.320 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.320 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.320 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.320 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.320 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-07-16T13:29:50.321 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-07-16T13:29:50.321 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:50.321 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.321 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.321 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:50.322 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.322 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.322 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.322 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.322 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.323 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.323 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.323 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.323 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-07-16T13:29:50.323 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-07-16T13:29:50.324 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.324 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.324 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.324 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-07-16T13:29:50.324 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.325 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.325 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:29:50.325 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:29:50.325 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:29:50.325 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:29:50.326 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:29:50.326 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:29:50.326 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:29:50.326 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:50.326 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.327 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.327 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.327 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.327 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.327 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-07-16T13:29:50.328 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-07-16T13:29:50.328 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:50.328 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.328 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.328 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:50.329 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.329 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.329 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.329 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.329 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.330 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.330 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.330 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.330 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mirror_snapshot_schedule": { 2020-07-16T13:29:50.330 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mirror_snapshot_schedule", 2020-07-16T13:29:50.331 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.331 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.331 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:50.331 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:50.331 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.332 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.332 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.332 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.332 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.332 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.332 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.333 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.333 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "trash_purge_schedule": { 2020-07-16T13:29:50.333 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "trash_purge_schedule", 2020-07-16T13:29:50.333 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.333 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.334 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:50.334 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:50.334 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.334 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.334 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.335 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.335 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.335 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.335 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.335 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:50.336 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:50.336 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.336 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:29:50.336 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "restful", 2020-07-16T13:29:50.336 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-07-16T13:29:50.337 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-07-16T13:29:50.337 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-07-16T13:29:50.337 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "key_file": { 2020-07-16T13:29:50.337 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "key_file", 2020-07-16T13:29:50.337 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.338 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.338 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:50.338 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:50.338 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.338 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.339 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.339 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.339 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.339 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.339 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.340 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.340 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-07-16T13:29:50.340 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-07-16T13:29:50.340 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.340 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.340 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.341 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:50.341 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.341 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.341 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:29:50.341 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:29:50.342 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:29:50.343 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:29:50.343 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:29:50.343 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:29:50.343 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:29:50.343 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:50.344 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.344 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.344 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.344 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.344 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.345 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-07-16T13:29:50.345 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-07-16T13:29:50.345 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:50.345 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.345 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.346 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:50.346 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.346 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.346 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.346 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.347 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.347 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.347 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.347 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.347 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-07-16T13:29:50.348 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-07-16T13:29:50.348 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.348 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.348 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.348 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-07-16T13:29:50.349 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.349 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.349 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:29:50.349 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:29:50.349 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:29:50.350 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:29:50.350 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:29:50.350 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:29:50.350 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:29:50.350 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:50.350 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.351 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.351 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.351 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.351 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.351 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-07-16T13:29:50.352 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-07-16T13:29:50.352 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:50.352 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.352 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.352 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:50.353 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.353 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.353 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.353 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.353 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.354 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.354 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.354 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.354 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2020-07-16T13:29:50.354 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2020-07-16T13:29:50.355 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.355 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.355 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:50.355 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:50.355 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.356 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.356 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.356 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.356 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.356 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.357 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.357 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.357 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2020-07-16T13:29:50.357 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2020-07-16T13:29:50.357 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.358 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.358 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:50.358 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:50.358 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.358 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.359 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.359 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.359 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.359 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.359 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.360 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:50.360 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:50.360 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.360 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:29:50.360 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rook", 2020-07-16T13:29:50.360 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-07-16T13:29:50.361 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-07-16T13:29:50.361 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-07-16T13:29:50.361 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-07-16T13:29:50.361 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-07-16T13:29:50.361 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.362 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.362 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.362 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:50.362 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.362 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.363 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:29:50.363 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:29:50.363 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:29:50.363 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:29:50.363 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:29:50.364 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:29:50.364 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:29:50.364 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:50.364 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.364 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.365 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.365 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.365 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.365 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-07-16T13:29:50.365 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-07-16T13:29:50.366 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:50.366 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.366 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.366 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:50.366 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.367 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.367 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.367 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.367 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.367 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.368 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.368 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.368 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-07-16T13:29:50.368 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-07-16T13:29:50.368 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.369 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.369 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.369 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-07-16T13:29:50.369 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.369 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.370 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:29:50.370 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:29:50.370 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:29:50.370 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:29:50.370 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:29:50.371 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:29:50.371 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:29:50.371 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:50.371 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.371 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.372 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.372 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.372 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.372 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-07-16T13:29:50.372 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-07-16T13:29:50.372 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:50.373 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.373 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.373 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:50.373 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.373 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.374 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.374 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.374 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.374 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.374 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.375 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:50.375 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:50.375 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.375 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:29:50.375 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "selftest", 2020-07-16T13:29:50.376 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-07-16T13:29:50.376 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-07-16T13:29:50.376 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-07-16T13:29:50.376 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-07-16T13:29:50.376 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-07-16T13:29:50.377 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.377 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.377 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.377 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:50.377 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.378 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.378 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:29:50.378 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:29:50.378 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:29:50.378 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:29:50.379 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:29:50.379 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:29:50.379 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:29:50.379 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:50.379 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.380 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.380 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.380 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.380 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.380 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-07-16T13:29:50.381 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-07-16T13:29:50.381 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:50.381 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.381 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.381 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:50.382 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.382 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.382 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.382 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.382 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.382 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.383 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.383 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.383 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-07-16T13:29:50.383 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-07-16T13:29:50.383 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.384 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.384 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.384 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-07-16T13:29:50.384 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.384 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.385 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:29:50.385 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:29:50.385 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:29:50.385 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:29:50.386 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:29:50.386 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:29:50.386 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:29:50.386 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:50.387 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.387 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.387 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.387 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.387 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.387 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-07-16T13:29:50.388 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-07-16T13:29:50.388 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:50.388 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.388 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.388 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:50.389 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.389 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.389 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.389 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.389 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.390 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.390 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.390 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.390 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "roption1": { 2020-07-16T13:29:50.390 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "roption1", 2020-07-16T13:29:50.391 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.391 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.391 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:50.391 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:50.391 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.392 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.392 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.392 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.392 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.392 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.393 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.393 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.393 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "roption2": { 2020-07-16T13:29:50.393 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "roption2", 2020-07-16T13:29:50.393 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.394 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.394 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:50.394 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "xyz", 2020-07-16T13:29:50.394 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.394 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.395 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.395 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.395 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.395 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.395 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.396 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.396 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption1": { 2020-07-16T13:29:50.396 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption1", 2020-07-16T13:29:50.396 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.396 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.397 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:50.397 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:50.397 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.397 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.397 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.398 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.398 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.398 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.398 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.398 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.399 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption2": { 2020-07-16T13:29:50.399 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption2", 2020-07-16T13:29:50.399 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-07-16T13:29:50.399 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.399 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:50.400 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:50.400 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.400 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.400 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.400 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.400 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.401 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.401 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.401 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.401 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption3": { 2020-07-16T13:29:50.401 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption3", 2020-07-16T13:29:50.402 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2020-07-16T13:29:50.402 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.402 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:50.402 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:50.402 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.403 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.403 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.403 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.403 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.403 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.404 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.404 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.404 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption4": { 2020-07-16T13:29:50.404 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption4", 2020-07-16T13:29:50.404 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.405 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.405 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:50.405 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:50.405 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.405 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.406 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.406 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.406 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.406 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.406 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.407 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.407 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption5": { 2020-07-16T13:29:50.407 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption5", 2020-07-16T13:29:50.407 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:50.407 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.408 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:50.408 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:50.408 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.408 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.408 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.408 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.409 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.409 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.409 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.409 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.409 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption6": { 2020-07-16T13:29:50.410 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption6", 2020-07-16T13:29:50.410 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:50.410 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.410 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:50.410 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-07-16T13:29:50.411 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.411 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.411 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.411 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.411 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.412 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.412 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.412 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.412 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testkey": { 2020-07-16T13:29:50.412 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testkey", 2020-07-16T13:29:50.413 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.413 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.413 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:50.413 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:50.413 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.414 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.414 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.414 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.414 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.414 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.415 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.415 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.415 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testlkey": { 2020-07-16T13:29:50.415 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testlkey", 2020-07-16T13:29:50.415 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.416 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.416 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:50.416 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:50.416 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.416 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.416 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.417 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.417 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.417 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.417 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.418 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.418 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testnewline": { 2020-07-16T13:29:50.418 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testnewline", 2020-07-16T13:29:50.418 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.418 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.418 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:50.419 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:50.419 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.419 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.419 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.419 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.420 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.420 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.420 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.420 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:50.420 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:50.421 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.421 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:29:50.421 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "status", 2020-07-16T13:29:50.421 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-07-16T13:29:50.421 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-07-16T13:29:50.422 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-07-16T13:29:50.422 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-07-16T13:29:50.422 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-07-16T13:29:50.422 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.422 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.423 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.423 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:50.423 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.423 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.423 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:29:50.424 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:29:50.424 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:29:50.424 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:29:50.424 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:29:50.424 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:29:50.425 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:29:50.425 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:50.425 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.425 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.425 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.426 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.426 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.426 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-07-16T13:29:50.431 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-07-16T13:29:50.431 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:50.431 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.431 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.431 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:50.432 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.432 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.432 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.432 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.432 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.433 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.433 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.433 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.433 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-07-16T13:29:50.433 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-07-16T13:29:50.434 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.434 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.434 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.434 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-07-16T13:29:50.434 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.435 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.435 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:29:50.435 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:29:50.435 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:29:50.435 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:29:50.436 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:29:50.436 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:29:50.436 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:29:50.436 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:50.436 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.437 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.437 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.437 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.437 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.437 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-07-16T13:29:50.438 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-07-16T13:29:50.438 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:50.438 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.438 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.438 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:50.438 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.439 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.439 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.439 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.439 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.439 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.440 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.440 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:50.440 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:50.440 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.440 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:29:50.441 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "telegraf", 2020-07-16T13:29:50.441 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-07-16T13:29:50.441 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-07-16T13:29:50.441 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-07-16T13:29:50.441 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "address": { 2020-07-16T13:29:50.442 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "address", 2020-07-16T13:29:50.442 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.442 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.442 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:50.442 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "unixgram:///tmp/telegraf.sock", 2020-07-16T13:29:50.443 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.443 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.443 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.443 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.443 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.444 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.444 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.444 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.444 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2020-07-16T13:29:50.444 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2020-07-16T13:29:50.445 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2020-07-16T13:29:50.445 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.445 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:50.445 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "15", 2020-07-16T13:29:50.445 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.446 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.446 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.446 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.446 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.446 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.447 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.447 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.447 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-07-16T13:29:50.447 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-07-16T13:29:50.447 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.448 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.448 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.448 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:50.448 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.448 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.448 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:29:50.449 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:29:50.449 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:29:50.449 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:29:50.449 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:29:50.449 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:29:50.450 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:29:50.450 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:50.450 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.450 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.450 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.451 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.451 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.451 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-07-16T13:29:50.451 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-07-16T13:29:50.451 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:50.452 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.452 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.452 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:50.452 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.452 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.453 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.453 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.453 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.453 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.453 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.454 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.454 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-07-16T13:29:50.454 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-07-16T13:29:50.454 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.454 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.455 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.455 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-07-16T13:29:50.455 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.455 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.455 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:29:50.456 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:29:50.456 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:29:50.456 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:29:50.456 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:29:50.456 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:29:50.457 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:29:50.457 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:50.457 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.457 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.457 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.458 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.458 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.458 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-07-16T13:29:50.458 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-07-16T13:29:50.458 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:50.458 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.459 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.459 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:50.459 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.459 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.459 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.460 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.460 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.460 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.460 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.460 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:50.461 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:50.461 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.461 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:29:50.461 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "telemetry", 2020-07-16T13:29:50.461 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-07-16T13:29:50.462 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-07-16T13:29:50.462 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-07-16T13:29:50.462 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_basic": { 2020-07-16T13:29:50.462 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_basic", 2020-07-16T13:29:50.462 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:50.463 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.463 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:50.463 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-07-16T13:29:50.463 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.463 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.464 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.464 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Share basic cluster information (size, version)", 2020-07-16T13:29:50.464 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.464 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.464 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.465 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.465 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_crash": { 2020-07-16T13:29:50.465 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_crash", 2020-07-16T13:29:50.465 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:50.465 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.466 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:50.466 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-07-16T13:29:50.466 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.466 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.466 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.467 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.467 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.467 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.467 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.467 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.467 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_device": { 2020-07-16T13:29:50.468 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_device", 2020-07-16T13:29:50.468 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:50.468 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.468 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:50.469 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-07-16T13:29:50.469 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.469 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.469 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.469 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.469 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.470 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.470 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.470 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.470 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_ident": { 2020-07-16T13:29:50.470 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_ident", 2020-07-16T13:29:50.471 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:50.471 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.471 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:50.471 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:50.471 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.472 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.472 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.472 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.472 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.472 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.473 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.473 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.473 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "contact": { 2020-07-16T13:29:50.473 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "contact", 2020-07-16T13:29:50.473 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.474 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.474 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:50.474 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2020-07-16T13:29:50.474 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.474 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.475 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.475 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.475 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.475 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.475 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.476 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.476 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "description": { 2020-07-16T13:29:50.476 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "description", 2020-07-16T13:29:50.476 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.476 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.477 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:50.477 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2020-07-16T13:29:50.477 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.477 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.477 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.477 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.478 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.478 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.478 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.478 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.478 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "device_url": { 2020-07-16T13:29:50.479 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "device_url", 2020-07-16T13:29:50.479 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.479 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.479 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:50.479 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "https://telemetry.ceph.com/device", 2020-07-16T13:29:50.480 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.480 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.480 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.481 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.481 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.481 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.481 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.481 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.482 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enabled": { 2020-07-16T13:29:50.482 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "enabled", 2020-07-16T13:29:50.482 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:50.482 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.482 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:50.483 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:50.483 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.483 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.483 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.483 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.483 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.484 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.484 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.484 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.484 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2020-07-16T13:29:50.484 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2020-07-16T13:29:50.485 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-07-16T13:29:50.485 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.485 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:50.485 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "24", 2020-07-16T13:29:50.485 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "8", 2020-07-16T13:29:50.486 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.486 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.486 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.486 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.486 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.487 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.487 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.487 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "last_opt_revision": { 2020-07-16T13:29:50.487 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "last_opt_revision", 2020-07-16T13:29:50.487 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-07-16T13:29:50.488 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.488 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:50.488 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1", 2020-07-16T13:29:50.488 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.488 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.489 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.489 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.489 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.489 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.489 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.490 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.490 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "leaderboard": { 2020-07-16T13:29:50.490 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "leaderboard", 2020-07-16T13:29:50.490 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:50.490 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.490 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:50.491 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:50.491 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.491 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.491 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.492 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.492 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.492 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.492 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.492 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.492 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-07-16T13:29:50.493 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-07-16T13:29:50.493 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.493 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.493 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.493 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:50.494 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.494 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.494 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:29:50.494 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:29:50.494 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:29:50.495 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:29:50.495 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:29:50.495 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:29:50.495 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:29:50.495 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:50.496 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.496 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.496 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.496 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.496 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.497 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-07-16T13:29:50.497 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-07-16T13:29:50.497 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:50.497 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.497 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.498 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:50.498 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.498 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.498 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.498 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.499 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.499 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.499 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.499 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.499 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-07-16T13:29:50.500 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-07-16T13:29:50.500 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.500 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.500 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.500 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-07-16T13:29:50.500 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.501 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.501 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:29:50.501 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:29:50.501 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:29:50.501 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:29:50.502 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:29:50.502 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:29:50.502 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:29:50.502 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:50.502 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.503 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.503 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.503 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.503 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.503 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-07-16T13:29:50.504 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-07-16T13:29:50.504 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:50.504 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.504 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.504 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:50.505 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.505 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.505 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.505 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.505 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.506 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.506 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.506 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.506 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "organization": { 2020-07-16T13:29:50.506 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "organization", 2020-07-16T13:29:50.507 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.507 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.507 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:50.507 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2020-07-16T13:29:50.507 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.508 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.508 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.508 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.508 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.508 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.508 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.509 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.509 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "proxy": { 2020-07-16T13:29:50.509 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "proxy", 2020-07-16T13:29:50.509 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.509 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.510 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:50.510 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2020-07-16T13:29:50.510 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.510 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.510 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.511 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.511 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.511 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.511 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.511 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.512 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "url": { 2020-07-16T13:29:50.512 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "url", 2020-07-16T13:29:50.512 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.512 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.512 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:50.513 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "https://telemetry.ceph.com/report", 2020-07-16T13:29:50.513 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.513 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.513 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.513 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.514 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.514 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.514 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.514 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:50.514 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:50.515 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.515 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:29:50.515 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "test_orchestrator", 2020-07-16T13:29:50.515 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-07-16T13:29:50.515 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-07-16T13:29:50.516 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-07-16T13:29:50.516 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-07-16T13:29:50.516 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-07-16T13:29:50.516 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.516 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.517 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.517 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:50.517 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.517 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.517 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:29:50.518 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:29:50.518 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:29:50.518 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:29:50.518 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:29:50.518 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:29:50.518 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:29:50.519 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:50.519 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.519 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.519 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.519 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.520 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.520 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-07-16T13:29:50.520 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-07-16T13:29:50.520 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:50.520 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.521 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.521 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:50.521 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.521 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.521 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.522 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.522 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.522 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.522 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.522 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.523 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-07-16T13:29:50.523 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-07-16T13:29:50.523 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.523 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.523 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.524 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-07-16T13:29:50.524 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.524 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.524 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:29:50.524 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:29:50.525 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:29:50.525 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:29:50.525 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:29:50.525 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:29:50.525 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:29:50.526 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:50.526 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.526 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.526 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.526 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.526 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.527 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-07-16T13:29:50.527 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-07-16T13:29:50.527 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:50.527 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.527 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.528 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:50.528 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.528 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.528 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.528 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.529 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.529 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.529 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.529 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:50.529 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:50.530 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.530 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:29:50.530 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "volumes", 2020-07-16T13:29:50.530 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-07-16T13:29:50.530 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-07-16T13:29:50.531 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-07-16T13:29:50.531 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-07-16T13:29:50.531 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-07-16T13:29:50.531 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.531 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.532 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.532 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:50.532 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.532 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.532 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:29:50.532 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:29:50.533 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:29:50.533 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:29:50.533 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:29:50.533 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:29:50.533 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:29:50.534 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:50.534 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.534 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.534 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.534 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.535 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.535 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-07-16T13:29:50.535 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-07-16T13:29:50.535 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:50.535 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.536 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.536 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:50.536 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.536 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.536 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.537 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.537 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.537 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.537 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.537 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.538 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-07-16T13:29:50.538 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-07-16T13:29:50.538 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.538 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.538 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.539 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-07-16T13:29:50.539 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.539 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.539 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:29:50.539 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:29:50.540 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:29:50.540 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:29:50.540 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:29:50.540 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:29:50.540 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:29:50.541 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:50.541 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.541 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.541 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.541 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.542 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.542 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-07-16T13:29:50.542 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-07-16T13:29:50.542 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:50.542 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.542 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.543 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:50.543 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.543 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.543 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.543 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.544 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.544 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.544 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.544 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:50.544 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:50.545 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.545 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:29:50.545 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix", 2020-07-16T13:29:50.545 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-07-16T13:29:50.545 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-07-16T13:29:50.546 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-07-16T13:29:50.546 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "discovery_interval": { 2020-07-16T13:29:50.546 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "discovery_interval", 2020-07-16T13:29:50.546 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.546 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.547 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:50.547 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "100", 2020-07-16T13:29:50.547 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.547 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.547 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.548 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.548 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.548 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.548 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.548 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.549 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "identifier": { 2020-07-16T13:29:50.549 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "identifier", 2020-07-16T13:29:50.549 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.549 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.549 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:50.550 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:50.550 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.550 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.550 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.550 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.550 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.551 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.551 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.551 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.551 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2020-07-16T13:29:50.551 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2020-07-16T13:29:50.552 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2020-07-16T13:29:50.552 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.552 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:50.552 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2020-07-16T13:29:50.552 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.553 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.553 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.553 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.553 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.553 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.554 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.554 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.554 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-07-16T13:29:50.554 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-07-16T13:29:50.554 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.555 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.555 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.555 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:29:50.555 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.555 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.556 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:29:50.556 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:29:50.556 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:29:50.556 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:29:50.556 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:29:50.556 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:29:50.557 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:29:50.557 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:50.557 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.557 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.557 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.558 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.558 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.558 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-07-16T13:29:50.558 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-07-16T13:29:50.558 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:50.559 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.559 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.559 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:50.559 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.559 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.560 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.560 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.560 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.560 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.560 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.561 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.561 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-07-16T13:29:50.561 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-07-16T13:29:50.561 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.561 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.562 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.562 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-07-16T13:29:50.562 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.562 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.562 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:29:50.563 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:29:50.563 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:29:50.563 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:29:50.563 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:29:50.563 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:29:50.564 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:29:50.564 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:50.564 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.564 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.564 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.565 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.565 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.565 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-07-16T13:29:50.565 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-07-16T13:29:50.565 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:29:50.566 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.566 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:29:50.566 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:29:50.566 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.566 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.566 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.567 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.567 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.567 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.567 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.567 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.568 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_host": { 2020-07-16T13:29:50.568 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_host", 2020-07-16T13:29:50.568 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.568 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.568 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:50.569 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2020-07-16T13:29:50.569 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.569 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.569 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.569 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.570 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.570 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.570 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.570 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.570 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_port": { 2020-07-16T13:29:50.571 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_port", 2020-07-16T13:29:50.571 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-07-16T13:29:50.571 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.571 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:50.571 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10051", 2020-07-16T13:29:50.572 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.572 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.572 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.572 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.572 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.573 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.573 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.573 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.573 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_sender": { 2020-07-16T13:29:50.573 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_sender", 2020-07-16T13:29:50.574 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:29:50.574 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:29:50.574 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:29:50.574 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "/usr/bin/zabbix_sender", 2020-07-16T13:29:50.574 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:29:50.574 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:29:50.575 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:29:50.575 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:29:50.575 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:29:50.575 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:29:50.575 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:29:50.576 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:50.576 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:50.576 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:50.576 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:50.576 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {}, 2020-07-16T13:29:50.577 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "always_on_modules": { 2020-07-16T13:29:50.577 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nautilus": [ 2020-07-16T13:29:50.577 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "balancer", 2020-07-16T13:29:50.577 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crash", 2020-07-16T13:29:50.577 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "devicehealth", 2020-07-16T13:29:50.578 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator_cli", 2020-07-16T13:29:50.578 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress", 2020-07-16T13:29:50.578 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_support", 2020-07-16T13:29:50.578 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status", 2020-07-16T13:29:50.578 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "volumes" 2020-07-16T13:29:50.579 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:50.579 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "octopus": [ 2020-07-16T13:29:50.579 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "balancer", 2020-07-16T13:29:50.579 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crash", 2020-07-16T13:29:50.579 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "devicehealth", 2020-07-16T13:29:50.580 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator", 2020-07-16T13:29:50.580 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_support", 2020-07-16T13:29:50.580 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pg_autoscaler", 2020-07-16T13:29:50.580 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress", 2020-07-16T13:29:50.580 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_support", 2020-07-16T13:29:50.580 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status", 2020-07-16T13:29:50.581 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "telemetry", 2020-07-16T13:29:50.581 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "volumes" 2020-07-16T13:29:50.581 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:29:50.581 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "last_failure_osd_epoch": 0, 2020-07-16T13:29:50.581 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_clients": [ 2020-07-16T13:29:50.582 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:29:50.582 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2020-07-16T13:29:50.582 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:29:50.582 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2020-07-16T13:29:50.582 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.132:0", 2020-07-16T13:29:50.583 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 4187674408 2020-07-16T13:29:50.583 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:50.583 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2020-07-16T13:29:50.583 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.583 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:29:50.584 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2020-07-16T13:29:50.584 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:29:50.584 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2020-07-16T13:29:50.584 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.132:0", 2020-07-16T13:29:50.584 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 4253611559 2020-07-16T13:29:50.585 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:50.585 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2020-07-16T13:29:50.585 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:29:50.585 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:29:50.586 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2020-07-16T13:29:50.586 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:29:50.586 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2020-07-16T13:29:50.586 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.132:0", 2020-07-16T13:29:50.586 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 1086302082 2020-07-16T13:29:50.587 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:50.587 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2020-07-16T13:29:50.587 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:50.587 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2020-07-16T13:29:50.587 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:50.588 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:50.589 INFO:teuthology.orchestra.run.smithi132.stderr:INFO:cephadm:Waiting for the mgr to restart... 2020-07-16T13:29:50.589 INFO:teuthology.orchestra.run.smithi132.stderr:INFO:cephadm:Waiting for Mgr epoch 5... 2020-07-16T13:29:50.589 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi132', '-v', '/var/log/ceph/4c8ed362-c768-11ea-a06f-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmp4bxmt8sq:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmprctwzzoo:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'tell', 'mgr', 'mgr_status'] 2020-07-16T13:29:50.589 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi132 -v /var/log/ceph/4c8ed362-c768-11ea-a06f-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp4bxmt8sq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmprctwzzoo:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 tell mgr mgr_status 2020-07-16T13:29:50.590 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:49 smithi132 bash[23299]: audit 2020-07-16T13:29:49.320071+0000 mon.a (mon.0) 36 : audit [DBG] from='client.? 172.21.15.132:0/3805497900' entity='client.admin' cmd=[{"prefix": "mgr dump"}]: dispatch 2020-07-16T13:29:52.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:51 smithi132 bash[23299]: cluster 2020-07-16T13:29:51.583829+0000 mon.a (mon.0) 37 : cluster [INF] Active manager daemon y restarted 2020-07-16T13:29:52.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:51 smithi132 bash[23299]: cluster 2020-07-16T13:29:51.584245+0000 mon.a (mon.0) 38 : cluster [INF] Activating manager daemon y 2020-07-16T13:29:52.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:51 smithi132 bash[23299]: cluster 2020-07-16T13:29:51.585854+0000 mon.a (mon.0) 39 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2020-07-16T13:29:52.653 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:29:52.654 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mgrmap_epoch": 7, 2020-07-16T13:29:52.654 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "initialized": true 2020-07-16T13:29:52.654 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:29:53.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:52 smithi132 bash[23299]: cluster 2020-07-16T13:29:51.636253+0000 mon.a (mon.0) 40 : cluster [DBG] mgrmap e6: y(active, starting, since 0.0520786s) 2020-07-16T13:29:53.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:52 smithi132 bash[23299]: audit 2020-07-16T13:29:51.638640+0000 mon.a (mon.0) 41 : audit [DBG] from='mgr.14117 172.21.15.132:0/1255722744' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2020-07-16T13:29:53.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:52 smithi132 bash[23299]: audit 2020-07-16T13:29:51.638835+0000 mon.a (mon.0) 42 : audit [DBG] from='mgr.14117 172.21.15.132:0/1255722744' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2020-07-16T13:29:53.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:52 smithi132 bash[23299]: audit 2020-07-16T13:29:51.638960+0000 mon.a (mon.0) 43 : audit [DBG] from='mgr.14117 172.21.15.132:0/1255722744' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2020-07-16T13:29:53.031 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:52 smithi132 bash[23299]: audit 2020-07-16T13:29:51.639078+0000 mon.a (mon.0) 44 : audit [DBG] from='mgr.14117 172.21.15.132:0/1255722744' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2020-07-16T13:29:53.031 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:52 smithi132 bash[23299]: audit 2020-07-16T13:29:51.639340+0000 mon.a (mon.0) 45 : audit [DBG] from='mgr.14117 172.21.15.132:0/1255722744' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2020-07-16T13:29:53.031 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:52 smithi132 bash[23299]: audit 2020-07-16T13:29:51.639915+0000 mon.a (mon.0) 46 : audit [DBG] from='mgr.14117 172.21.15.132:0/1255722744' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2020-07-16T13:29:53.032 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:52 smithi132 bash[23299]: audit 2020-07-16T13:29:51.640100+0000 mon.a (mon.0) 47 : audit [DBG] from='mgr.14117 172.21.15.132:0/1255722744' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2020-07-16T13:29:53.032 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:52 smithi132 bash[23299]: cluster 2020-07-16T13:29:51.641520+0000 mon.a (mon.0) 48 : cluster [INF] Manager daemon y is now available 2020-07-16T13:29:53.032 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:52 smithi132 bash[23299]: audit 2020-07-16T13:29:51.661728+0000 mon.a (mon.0) 49 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2020-07-16T13:29:53.033 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:52 smithi132 bash[23299]: audit 2020-07-16T13:29:52.161531+0000 mon.a (mon.0) 50 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2020-07-16T13:29:53.144 INFO:teuthology.orchestra.run.smithi132.stderr:INFO:cephadm:Setting orchestrator backend to cephadm... 2020-07-16T13:29:53.144 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi132', '-v', '/var/log/ceph/4c8ed362-c768-11ea-a06f-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmp4bxmt8sq:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmprctwzzoo:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'orch', 'set', 'backend', 'cephadm'] 2020-07-16T13:29:53.145 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi132 -v /var/log/ceph/4c8ed362-c768-11ea-a06f-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp4bxmt8sq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmprctwzzoo:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 orch set backend cephadm 2020-07-16T13:29:53.670 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:53 smithi132 bash[23299]: cluster 2020-07-16T13:29:52.644060+0000 mon.a (mon.0) 51 : cluster [DBG] mgrmap e7: y(active, since 1.05988s) 2020-07-16T13:29:54.473 INFO:teuthology.orchestra.run.smithi132.stderr:INFO:cephadm:Generating ssh key... 2020-07-16T13:29:54.474 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi132', '-v', '/var/log/ceph/4c8ed362-c768-11ea-a06f-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmp4bxmt8sq:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmprctwzzoo:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'cephadm', 'generate-key'] 2020-07-16T13:29:54.474 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi132 -v /var/log/ceph/4c8ed362-c768-11ea-a06f-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp4bxmt8sq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmprctwzzoo:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 cephadm generate-key 2020-07-16T13:29:54.743 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:54 smithi132 bash[23299]: cluster 2020-07-16T13:29:53.646417+0000 mon.a (mon.0) 52 : cluster [DBG] mgrmap e8: y(active, since 2s) 2020-07-16T13:29:54.744 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:54 smithi132 bash[23299]: audit 2020-07-16T13:29:53.930485+0000 mgr.y (mgr.14117) 1 : audit [DBG] from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:29:54.744 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:54 smithi132 bash[23299]: audit 2020-07-16T13:29:53.931601+0000 mon.a (mon.0) 53 : audit [INF] from='mgr.14117 172.21.15.132:0/1255722744' entity='mgr.y' cmd=[{"prefix":"config set","value":"cephadm","who":"mgr","name":"mgr/orchestrator/orchestrator"}]: dispatch 2020-07-16T13:29:54.744 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:54 smithi132 bash[23299]: audit 2020-07-16T13:29:53.934880+0000 mon.a (mon.0) 54 : audit [INF] from='mgr.14117 172.21.15.132:0/1255722744' entity='mgr.y' cmd='[{"prefix":"config set","value":"cephadm","who":"mgr","name":"mgr/orchestrator/orchestrator"}]': finished 2020-07-16T13:29:56.029 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:29:55 smithi132 bash[23536]: Generating public/private rsa key pair. 2020-07-16T13:29:56.029 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:29:55 smithi132 bash[23536]: Your identification has been saved in /tmp/tmp1tjg03s9/key. 2020-07-16T13:29:56.030 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:29:55 smithi132 bash[23536]: Your public key has been saved in /tmp/tmp1tjg03s9/key.pub. 2020-07-16T13:29:56.030 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:29:55 smithi132 bash[23536]: The key fingerprint is: 2020-07-16T13:29:56.030 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:29:55 smithi132 bash[23536]: SHA256:WAeNIwN+72TPbwclol8oVBNam/tcyrYiJpMmBQr3jHs ceph-4c8ed362-c768-11ea-a06f-001a4aab830c 2020-07-16T13:29:56.030 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:29:55 smithi132 bash[23536]: The key's randomart image is: 2020-07-16T13:29:56.030 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:29:55 smithi132 bash[23536]: +---[RSA 3072]----+ 2020-07-16T13:29:56.031 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:29:55 smithi132 bash[23536]: | .. .oo. | 2020-07-16T13:29:56.031 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:29:55 smithi132 bash[23536]: | . o o++o | 2020-07-16T13:29:56.031 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:29:55 smithi132 bash[23536]: | . .ooo+. | 2020-07-16T13:29:56.031 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:29:55 smithi132 bash[23536]: |. . .. +..... . | 2020-07-16T13:29:56.031 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:29:55 smithi132 bash[23536]: | o = ...S..o o. | 2020-07-16T13:29:56.032 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:29:55 smithi132 bash[23536]: | o o .+oo.+oo | 2020-07-16T13:29:56.032 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:29:55 smithi132 bash[23536]: | . . ..oo.*. | 2020-07-16T13:29:56.032 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:29:55 smithi132 bash[23536]: | . E = o oo... | 2020-07-16T13:29:56.032 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:29:55 smithi132 bash[23536]: | . o + . oo. | 2020-07-16T13:29:56.032 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:29:55 smithi132 bash[23536]: +----[SHA256]-----+ 2020-07-16T13:29:56.033 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:55 smithi132 bash[23299]: audit 2020-07-16T13:29:55.607476+0000 mon.a (mon.0) 55 : audit [INF] from='mgr.14117 172.21.15.132:0/1255722744' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/ssh_identity_key","val":"-----BEGIN OPENSSH PRIVATE KEY-----\nb3BlbnNzaC1rZXktdjEAAAAABG5vbmUAAAAEbm9uZQAAAAAAAAABAAABlwAAAAdzc2gtcn\nNhAAAAAwEAAQAAAYEAuK9P+k2vTtJq/qgBWnmpTgu8YbU3aKYXdrudzcluHo/fBmdAMO8L\n6O6rUruZ28Xf4wl34lhF7CQOb9aDjR/pWNC/lqtgrmpZx6PHPbfSLlhgS38O7wYVmWobjT\nPCioL6kzfJoLSmcPv7QQY+PWdOBnylF0hEThxbOhY0l8w7QYRXGmc51E2VHikzwgclklK1\npiKMr5E5qnkX7dcv/r8hFv5RwmWArJBRrRJ67oquemku0HuF/CIWrwITdV4P1ChSa81vvQ\nhS4QQzxkTsgCFuJIKX/p/WsVfkGbnsdMuebiTTHw80dv2Ia9n0Ahx3DKR83FeHi9fiGoNs\nWaGyiidgKr2dnRenSxyC9UTMZmLHuAwJSyUR2AGIQWMTlBXRWc0Q6JxldeH8MCFBa7c+4L\n3yOVClKdsfHLm6vyvVrXxEL4k1axPCE6vkexRzVWi4JpDGFehkfZxobZa+8MuDtPQ0My78\npc3xbfNPbOj42/CWC3oigiV9IT7sH/Bnc6ZTG0EPAAAFoEsHkVFLB5FRAAAAB3NzaC1yc2\nEAAAGBALivT/pNr07Sav6oAVp5qU4LvGG1N2imF3a7nc3Jbh6P3wZnQDDvC+juq1K7mdvF\n3+MJd+JYRewkDm/Wg40f6VjQv5arYK5qWcejxz230i5YYEt/Du8GFZlqG40zwoqC+pM3ya\nC0pnD7+0EGPj1nTgZ8pRdIRE4cWzoWNJfMO0GEVxpnOdRNlR4pM8IHJZJStaYijK+ROap5\nF+3XL/6/IRb+UcJlgKyQUa0Seu6KrnppLtB7hfwiFq8CE3VeD9QoUmvNb70IUuEEM8ZE7I\nAhbiSCl/6f1rFX5Bm57HTLnm4k0x8PNHb9iGvZ9AIcdwykfNxXh4vX4hqDbFmhsoonYCq9\nnZ0Xp0scgvVEzGZix7gMCUslEdgBiEFjE5QV0VnNEOicZXXh/DAhQWu3PuC98jlQpSnbHx\ny5ur8r1a18RC+JNWsTwhOr5HsUc1VouCaQxhXoZH2caG2WvvDLg7T0NDMu/KXN8W3zT2zo\n+Nvwlgt6IoIlfSE+7B/wZ3OmUxtBDwAAAAMBAAEAAAGAcsrNHFhy8bxKMtT8Wl8qg885nU\nXFFe++v9cn48QjBS4JwvIkbQX4UiUfKgJfRMI+QeEdufuCIp/atVsRU4OVR9Ygb6dAJckG\n2tcKvWrnYlUeLW7hOmJ+xGe2jlKwxeVZmG3hjlka5zlIV4do4kO2tMN+3fTWN/LaJUWuFP\nglkLiQZ2HoCPTcDe4wNJa6nLN6IrRw26OZw0MXQ4cwVtg32hHjgcATda8ShU/qRyC+CGoe\nZgmRI0GQ9eCFdbssfYM9gV6FMvEmVQXRx3P9i1QpLKdY4KR0JULZBmzgT+PFMr9PmHbbb9\n8ifAKGgKljx2qLb1sZmmAMLlJPYd6nQ5j51zooh0HcYnW32IqRwQhMBF3gNWkVzGOAOCFe\nQGFqrCfw+AiWhQ6ekAMnyuJ2id9IeLpkdl2XAS8dUXdX/D7CwXiWDhiyadXK9uyFIlG18+\nhGKMX5pmyqDrhB8gsmUWxV075Ew/h6ZXx3rCqHu4ijbWyvwZeylcPWRYSxddcHTWK5AAAA\nwFTrsnk14fgBqQI6BEKrR5M0zAeDX9TCKxleeZzSvYMo4UZPk/gDS8w/H0k2VxG0C30imu\nWJwvu4NjPiKQWOrprRc+xkwz5eeFz4vpVhmNCUxogcNu5UZW5ABqIz31acL7SJNUsDTJM5\n285LK4mml+N6DOOYZ6DZKtQ3wC2xcp2AgUD+/5Am/R2n1kab2zn0HhisbjBSonreHr3TQS\nnuNcBBrBjsb9+umsZ8mdPWb7icmZg06hZJInXU341FpOzeVQAAAMEA3DyNJdPHx9ABG76L\ndUTwkULgxaT7YAObiqtf14M8bdWMcIeYSEl9A7eW5WAUxX48ydXEW1uPNjFJZRHv19v2ru\n/HwTQ7m7y6eILpPvyABhNNydEG7DIoMaTJo9QvCYFY/5JB3iTZsP0gXm/psFfclPD22rBC\noXVQEVL+bEpceElrs6jOkfpvDW3sQbnqqUJlYOe/kq5GSZsCzPbUicPPFzlv18sT4Zha54\n1TeSlJ6txE+XwfvaD9agAi14C5eHpjAAAAwQDWrNdlHyfIdzehEXMDn5WFN/N0GKjETF6S\nYCyeqjHO6P5MTL/33Ghl3yqYmSM1KthfPM8W3AvPxg5xBrti0A6DjYigNuGf6eCX1080yQ\nWsEJjx3qJH5szUfTkHR1cNi0RGd9T2iJ4NeyVU1SWJpxVL3qO9fevkgDX1+59xxQT+c141\nixy3mCCGtcrZpW/iSNDHU8xgLbX5qVDF9u7AfH+63na5x6AN78v5uip3a7ttB4nY7lFFCK\nZSxnnfy/NWqGUAAAApY2VwaC00YzhlZDM2Mi1jNzY4LTExZWEtYTA2Zi0wMDFhNGFhYjgz\nMGMBAg==\n-----END OPENSSH PRIVATE KEY-----\n"}]: dispatch 2020-07-16T13:29:56.033 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:55 smithi132 bash[23299]: audit 2020-07-16T13:29:55.609242+0000 mon.a (mon.0) 56 : audit [INF] from='mgr.14117 172.21.15.132:0/1255722744' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/ssh_identity_key","val":"-----BEGIN OPENSSH PRIVATE KEY-----\nb3BlbnNzaC1rZXktdjEAAAAABG5vbmUAAAAEbm9uZQAAAAAAAAABAAABlwAAAAdzc2gtcn\nNhAAAAAwEAAQAAAYEAuK9P+k2vTtJq/qgBWnmpTgu8YbU3aKYXdrudzcluHo/fBmdAMO8L\n6O6rUruZ28Xf4wl34lhF7CQOb9aDjR/pWNC/lqtgrmpZx6PHPbfSLlhgS38O7wYVmWobjT\nPCioL6kzfJoLSmcPv7QQY+PWdOBnylF0hEThxbOhY0l8w7QYRXGmc51E2VHikzwgclklK1\npiKMr5E5qnkX7dcv/r8hFv5RwmWArJBRrRJ67oquemku0HuF/CIWrwITdV4P1ChSa81vvQ\nhS4QQzxkTsgCFuJIKX/p/WsVfkGbnsdMuebiTTHw80dv2Ia9n0Ahx3DKR83FeHi9fiGoNs\nWaGyiidgKr2dnRenSxyC9UTMZmLHuAwJSyUR2AGIQWMTlBXRWc0Q6JxldeH8MCFBa7c+4L\n3yOVClKdsfHLm6vyvVrXxEL4k1axPCE6vkexRzVWi4JpDGFehkfZxobZa+8MuDtPQ0My78\npc3xbfNPbOj42/CWC3oigiV9IT7sH/Bnc6ZTG0EPAAAFoEsHkVFLB5FRAAAAB3NzaC1yc2\nEAAAGBALivT/pNr07Sav6oAVp5qU4LvGG1N2imF3a7nc3Jbh6P3wZnQDDvC+juq1K7mdvF\n3+MJd+JYRewkDm/Wg40f6VjQv5arYK5qWcejxz230i5YYEt/Du8GFZlqG40zwoqC+pM3ya\nC0pnD7+0EGPj1nTgZ8pRdIRE4cWzoWNJfMO0GEVxpnOdRNlR4pM8IHJZJStaYijK+ROap5\nF+3XL/6/IRb+UcJlgKyQUa0Seu6KrnppLtB7hfwiFq8CE3VeD9QoUmvNb70IUuEEM8ZE7I\nAhbiSCl/6f1rFX5Bm57HTLnm4k0x8PNHb9iGvZ9AIcdwykfNxXh4vX4hqDbFmhsoonYCq9\nnZ0Xp0scgvVEzGZix7gMCUslEdgBiEFjE5QV0VnNEOicZXXh/DAhQWu3PuC98jlQpSnbHx\ny5ur8r1a18RC+JNWsTwhOr5HsUc1VouCaQxhXoZH2caG2WvvDLg7T0NDMu/KXN8W3zT2zo\n+Nvwlgt6IoIlfSE+7B/wZ3OmUxtBDwAAAAMBAAEAAAGAcsrNHFhy8bxKMtT8Wl8qg885nU\nXFFe++v9cn48QjBS4JwvIkbQX4UiUfKgJfRMI+QeEdufuCIp/atVsRU4OVR9Ygb6dAJckG\n2tcKvWrnYlUeLW7hOmJ+xGe2jlKwxeVZmG3hjlka5zlIV4do4kO2tMN+3fTWN/LaJUWuFP\nglkLiQZ2HoCPTcDe4wNJa6nLN6IrRw26OZw0MXQ4cwVtg32hHjgcATda8ShU/qRyC+CGoe\nZgmRI0GQ9eCFdbssfYM9gV6FMvEmVQXRx3P9i1QpLKdY4KR0JULZBmzgT+PFMr9PmHbbb9\n8ifAKGgKljx2qLb1sZmmAMLlJPYd6nQ5j51zooh0HcYnW32IqRwQhMBF3gNWkVzGOAOCFe\nQGFqrCfw+AiWhQ6ekAMnyuJ2id9IeLpkdl2XAS8dUXdX/D7CwXiWDhiyadXK9uyFIlG18+\nhGKMX5pmyqDrhB8gsmUWxV075Ew/h6ZXx3rCqHu4ijbWyvwZeylcPWRYSxddcHTWK5AAAA\nwFTrsnk14fgBqQI6BEKrR5M0zAeDX9TCKxleeZzSvYMo4UZPk/gDS8w/H0k2VxG0C30imu\nWJwvu4NjPiKQWOrprRc+xkwz5eeFz4vpVhmNCUxogcNu5UZW5ABqIz31acL7SJNUsDTJM5\n285LK4mml+N6DOOYZ6DZKtQ3wC2xcp2AgUD+/5Am/R2n1kab2zn0HhisbjBSonreHr3TQS\nnuNcBBrBjsb9+umsZ8mdPWb7icmZg06hZJInXU341FpOzeVQAAAMEA3DyNJdPHx9ABG76L\ndUTwkULgxaT7YAObiqtf14M8bdWMcIeYSEl9A7eW5WAUxX48ydXEW1uPNjFJZRHv19v2ru\n/HwTQ7m7y6eILpPvyABhNNydEG7DIoMaTJo9QvCYFY/5JB3iTZsP0gXm/psFfclPD22rBC\noXVQEVL+bEpceElrs6jOkfpvDW3sQbnqqUJlYOe/kq5GSZsCzPbUicPPFzlv18sT4Zha54\n1TeSlJ6txE+XwfvaD9agAi14C5eHpjAAAAwQDWrNdlHyfIdzehEXMDn5WFN/N0GKjETF6S\nYCyeqjHO6P5MTL/33Ghl3yqYmSM1KthfPM8W3AvPxg5xBrti0A6DjYigNuGf6eCX1080yQ\nWsEJjx3qJH5szUfTkHR1cNi0RGd9T2iJ4NeyVU1SWJpxVL3qO9fevkgDX1+59xxQT+c141\nixy3mCCGtcrZpW/iSNDHU8xgLbX5qVDF9u7AfH+63na5x6AN78v5uip3a7ttB4nY7lFFCK\nZSxnnfy/NWqGUAAAApY2VwaC00YzhlZDM2Mi1jNzY4LTExZWEtYTA2Zi0wMDFhNGFhYjgz\nMGMBAg==\n-----END OPENSSH PRIVATE KEY-----\n"}]': finished 2020-07-16T13:29:56.033 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:55 smithi132 bash[23299]: audit 2020-07-16T13:29:55.609568+0000 mon.a (mon.0) 57 : audit [INF] from='mgr.14117 172.21.15.132:0/1255722744' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/ssh_identity_pub","val":"ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4r0/6Ta9O0mr+qAFaealOC7xhtTdophd2u53NyW4ej98GZ0Aw7wvo7qtSu5nbxd/jCXfiWEXsJA5v1oONH+lY0L+Wq2CualnHo8c9t9IuWGBLfw7vBhWZahuNM8KKgvqTN8mgtKZw+/tBBj49Z04GfKUXSEROHFs6FjSXzDtBhFcaZznUTZUeKTPCByWSUrWmIoyvkTmqeRft1y/+vyEW/lHCZYCskFGtEnruiq56aS7Qe4X8IhavAhN1Xg/UKFJrzW+9CFLhBDPGROyAIW4kgpf+n9axV+QZuex0y55uJNMfDzR2/Yhr2fQCHHcMpHzcV4eL1+Iag2xZobKKJ2AqvZ2dF6dLHIL1RMxmYse4DAlLJRHYAYhBYxOUFdFZzRDonGV14fwwIUFrtz7gvfI5UKUp2x8cubq/K9WtfEQviTVrE8ITq+R7FHNVaLgmkMYV6GR9nGhtlr7wy4O09DQzLvylzfFt809s6Pjb8JYLeiKCJX0hPuwf8GdzplMbQQ8= ceph-4c8ed362-c768-11ea-a06f-001a4aab830c\n"}]: dispatch 2020-07-16T13:29:56.033 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:55 smithi132 bash[23299]: audit 2020-07-16T13:29:55.610818+0000 mon.a (mon.0) 58 : audit [INF] from='mgr.14117 172.21.15.132:0/1255722744' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/ssh_identity_pub","val":"ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4r0/6Ta9O0mr+qAFaealOC7xhtTdophd2u53NyW4ej98GZ0Aw7wvo7qtSu5nbxd/jCXfiWEXsJA5v1oONH+lY0L+Wq2CualnHo8c9t9IuWGBLfw7vBhWZahuNM8KKgvqTN8mgtKZw+/tBBj49Z04GfKUXSEROHFs6FjSXzDtBhFcaZznUTZUeKTPCByWSUrWmIoyvkTmqeRft1y/+vyEW/lHCZYCskFGtEnruiq56aS7Qe4X8IhavAhN1Xg/UKFJrzW+9CFLhBDPGROyAIW4kgpf+n9axV+QZuex0y55uJNMfDzR2/Yhr2fQCHHcMpHzcV4eL1+Iag2xZobKKJ2AqvZ2dF6dLHIL1RMxmYse4DAlLJRHYAYhBYxOUFdFZzRDonGV14fwwIUFrtz7gvfI5UKUp2x8cubq/K9WtfEQviTVrE8ITq+R7FHNVaLgmkMYV6GR9nGhtlr7wy4O09DQzLvylzfFt809s6Pjb8JYLeiKCJX0hPuwf8GdzplMbQQ8= ceph-4c8ed362-c768-11ea-a06f-001a4aab830c\n"}]': finished 2020-07-16T13:29:56.127 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi132', '-v', '/var/log/ceph/4c8ed362-c768-11ea-a06f-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmp4bxmt8sq:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmprctwzzoo:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'cephadm', 'get-pub-key'] 2020-07-16T13:29:56.128 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi132 -v /var/log/ceph/4c8ed362-c768-11ea-a06f-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp4bxmt8sq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmprctwzzoo:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 cephadm get-pub-key 2020-07-16T13:29:56.711 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:56 smithi132 bash[23299]: audit 2020-07-16T13:29:55.274690+0000 mgr.y (mgr.14117) 2 : audit [DBG] from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:29:56.711 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:56 smithi132 bash[23299]: cephadm 2020-07-16T13:29:55.274906+0000 mgr.y (mgr.14117) 3 : cephadm [INF] Generating ssh key... 2020-07-16T13:29:56.946 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4r0/6Ta9O0mr+qAFaealOC7xhtTdophd2u53NyW4ej98GZ0Aw7wvo7qtSu5nbxd/jCXfiWEXsJA5v1oONH+lY0L+Wq2CualnHo8c9t9IuWGBLfw7vBhWZahuNM8KKgvqTN8mgtKZw+/tBBj49Z04GfKUXSEROHFs6FjSXzDtBhFcaZznUTZUeKTPCByWSUrWmIoyvkTmqeRft1y/+vyEW/lHCZYCskFGtEnruiq56aS7Qe4X8IhavAhN1Xg/UKFJrzW+9CFLhBDPGROyAIW4kgpf+n9axV+QZuex0y55uJNMfDzR2/Yhr2fQCHHcMpHzcV4eL1+Iag2xZobKKJ2AqvZ2dF6dLHIL1RMxmYse4DAlLJRHYAYhBYxOUFdFZzRDonGV14fwwIUFrtz7gvfI5UKUp2x8cubq/K9WtfEQviTVrE8ITq+R7FHNVaLgmkMYV6GR9nGhtlr7wy4O09DQzLvylzfFt809s6Pjb8JYLeiKCJX0hPuwf8GdzplMbQQ8= ceph-4c8ed362-c768-11ea-a06f-001a4aab830c 2020-07-16T13:29:57.508 INFO:teuthology.orchestra.run.smithi132.stderr:INFO:cephadm:Wrote public SSH key to to /home/ubuntu/cephtest/ceph.pub 2020-07-16T13:29:57.508 INFO:teuthology.orchestra.run.smithi132.stderr:INFO:cephadm:Adding key to root@localhost's authorized_keys... 2020-07-16T13:29:57.509 INFO:teuthology.orchestra.run.smithi132.stderr:INFO:cephadm:Adding host smithi132... 2020-07-16T13:29:57.509 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi132', '-v', '/var/log/ceph/4c8ed362-c768-11ea-a06f-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmp4bxmt8sq:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmprctwzzoo:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'orch', 'host', 'add', 'smithi132'] 2020-07-16T13:29:57.509 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi132 -v /var/log/ceph/4c8ed362-c768-11ea-a06f-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp4bxmt8sq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmprctwzzoo:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 orch host add smithi132 2020-07-16T13:29:57.778 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:57 smithi132 bash[23299]: audit 2020-07-16T13:29:56.945100+0000 mgr.y (mgr.14117) 4 : audit [DBG] from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:29:58.779 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:29:58 smithi132 bash[23536]: Warning: Permanently added 'smithi132,172.21.15.132' (ECDSA) to the list of known hosts. 2020-07-16T13:29:59.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:58 smithi132 bash[23299]: audit 2020-07-16T13:29:58.840209+0000 mon.a (mon.0) 59 : audit [INF] from='mgr.14117 172.21.15.132:0/1255722744' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi132\": {\"hostname\": \"smithi132\", \"addr\": \"smithi132\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2020-07-16T13:29:59.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:58 smithi132 bash[23299]: audit 2020-07-16T13:29:58.841904+0000 mon.a (mon.0) 60 : audit [INF] from='mgr.14117 172.21.15.132:0/1255722744' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi132\": {\"hostname\": \"smithi132\", \"addr\": \"smithi132\", \"labels\": [], \"status\": \"\"}}"}]': finished 2020-07-16T13:29:59.342 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout Added host 'smithi132' 2020-07-16T13:30:00.014 INFO:teuthology.orchestra.run.smithi132.stderr:INFO:cephadm:Enabling the dashboard module... 2020-07-16T13:30:00.014 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi132', '-v', '/var/log/ceph/4c8ed362-c768-11ea-a06f-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmp4bxmt8sq:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmprctwzzoo:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'mgr', 'module', 'enable', 'dashboard'] 2020-07-16T13:30:00.015 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi132 -v /var/log/ceph/4c8ed362-c768-11ea-a06f-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp4bxmt8sq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmprctwzzoo:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 mgr module enable dashboard 2020-07-16T13:30:00.252 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:59 smithi132 bash[23299]: audit 2020-07-16T13:29:58.338967+0000 mgr.y (mgr.14117) 5 : audit [DBG] from='client.14136 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi132", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:30:00.252 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:59 smithi132 bash[23299]: cephadm 2020-07-16T13:29:58.842328+0000 mgr.y (mgr.14117) 6 : cephadm [INF] Added host smithi132 2020-07-16T13:30:00.253 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:59 smithi132 bash[23299]: audit 2020-07-16T13:29:59.045005+0000 mon.a (mon.0) 61 : audit [INF] from='mgr.14117 172.21.15.132:0/1255722744' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"networks\": {}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:30:00.253 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:59 smithi132 bash[23299]: audit 2020-07-16T13:29:59.047452+0000 mon.a (mon.0) 62 : audit [INF] from='mgr.14117 172.21.15.132:0/1255722744' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"networks\": {}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:30:00.253 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:29:59 smithi132 bash[23299]: audit 2020-07-16T13:29:59.047923+0000 mon.a (mon.0) 63 : audit [DBG] from='mgr.14117 172.21.15.132:0/1255722744' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:30:01.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:00 smithi132 bash[23299]: audit 2020-07-16T13:30:00.066397+0000 mon.a (mon.0) 64 : audit [INF] from='mgr.14117 172.21.15.132:0/1255722744' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:30:00.064779\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:30:00.065898\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2020-07-16T13:30:00.066003\", \"networks\": {}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:30:01.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:00 smithi132 bash[23299]: audit 2020-07-16T13:30:00.070680+0000 mon.a (mon.0) 65 : audit [INF] from='mgr.14117 172.21.15.132:0/1255722744' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:30:00.064779\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:30:00.065898\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2020-07-16T13:30:00.066003\", \"networks\": {}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:30:01.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:00 smithi132 bash[23299]: audit 2020-07-16T13:30:00.071128+0000 mon.a (mon.0) 66 : audit [DBG] from='mgr.14117 172.21.15.132:0/1255722744' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:30:01.926 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:01 smithi132 bash[23299]: audit 2020-07-16T13:30:00.918791+0000 mon.a (mon.0) 67 : audit [INF] from='client.? 172.21.15.132:0/329648324' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2020-07-16T13:30:02.279 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:30:01 smithi132 bash[23536]: ignoring --setuser ceph since I am not root 2020-07-16T13:30:02.279 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:30:01 smithi132 bash[23536]: ignoring --setgroup ceph since I am not root 2020-07-16T13:30:02.279 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:30:01 smithi132 bash[23536]: debug 2020-07-16T13:30:01.926+0000 7fd896cde700 1 --2- 172.21.15.132:0/3400155553 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ddcca98c00 0x55ddccab5a80 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x55ddccad8420 tx=0x55ddccadad70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-07-16T13:30:02.279 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:30:01 smithi132 bash[23536]: debug 2020-07-16T13:30:01.926+0000 7fd8a5593040 1 -- 172.21.15.132:0/3400155553 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ddcca98c00 msgr2=0x55ddccab5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T13:30:02.280 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:30:01 smithi132 bash[23536]: debug 2020-07-16T13:30:01.926+0000 7fd8a5593040 1 --2- 172.21.15.132:0/3400155553 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ddcca98c00 0x55ddccab5a80 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x55ddccad8420 tx=0x55ddccadad70).stop 2020-07-16T13:30:02.280 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:30:01 smithi132 bash[23536]: debug 2020-07-16T13:30:01.926+0000 7fd895cdc700 1 -- 172.21.15.132:0/3400155553 <== mon.0 v2:172.21.15.132:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ddccac04e0 con 0x55ddcca98c00 2020-07-16T13:30:02.377 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi132', '-v', '/var/log/ceph/4c8ed362-c768-11ea-a06f-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmp4bxmt8sq:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmprctwzzoo:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'mgr', 'dump'] 2020-07-16T13:30:02.378 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi132 -v /var/log/ceph/4c8ed362-c768-11ea-a06f-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp4bxmt8sq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmprctwzzoo:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 mgr dump 2020-07-16T13:30:03.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:02 smithi132 bash[23299]: audit 2020-07-16T13:30:01.900272+0000 mon.a (mon.0) 68 : audit [INF] from='client.? 172.21.15.132:0/329648324' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2020-07-16T13:30:03.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:02 smithi132 bash[23299]: cluster 2020-07-16T13:30:01.900327+0000 mon.a (mon.0) 69 : cluster [DBG] mgrmap e9: y(active, since 10s) 2020-07-16T13:30:03.391 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:30:03.391 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 9, 2020-07-16T13:30:03.391 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_gid": 14117, 2020-07-16T13:30:03.392 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_name": "y", 2020-07-16T13:30:03.392 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_addrs": { 2020-07-16T13:30:03.392 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2020-07-16T13:30:03.392 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:30:03.392 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2020-07-16T13:30:03.393 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.132:6800", 2020-07-16T13:30:03.393 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 2485003984 2020-07-16T13:30:03.393 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.393 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:30:03.393 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v1", 2020-07-16T13:30:03.394 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.132:6801", 2020-07-16T13:30:03.394 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 2485003984 2020-07-16T13:30:03.394 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:30:03.395 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2020-07-16T13:30:03.395 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.395 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_addr": "172.21.15.132:6801/2485003984", 2020-07-16T13:30:03.395 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_change": "2020-07-16T13:29:51.584166+0000", 2020-07-16T13:30:03.395 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_mgr_features": 4540138292836696063, 2020-07-16T13:30:03.395 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available": true, 2020-07-16T13:30:03.396 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standbys": [], 2020-07-16T13:30:03.396 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modules": [ 2020-07-16T13:30:03.396 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm", 2020-07-16T13:30:03.396 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "dashboard", 2020-07-16T13:30:03.396 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "iostat", 2020-07-16T13:30:03.397 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "restful" 2020-07-16T13:30:03.397 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:30:03.397 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available_modules": [ 2020-07-16T13:30:03.732 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:30:03.733 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "alerts", 2020-07-16T13:30:03.733 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-07-16T13:30:03.733 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-07-16T13:30:03.733 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-07-16T13:30:03.734 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2020-07-16T13:30:03.734 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2020-07-16T13:30:03.734 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2020-07-16T13:30:03.734 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.734 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:03.735 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2020-07-16T13:30:03.735 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.735 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.735 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.735 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "How frequently to reexamine health status", 2020-07-16T13:30:03.736 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.736 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.736 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.737 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.737 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-07-16T13:30:03.737 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-07-16T13:30:03.737 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:03.738 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.738 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:03.738 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:03.738 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.738 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.738 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:30:03.739 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:30:03.739 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:30:03.739 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:30:03.739 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:30:03.739 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:30:03.740 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:30:03.740 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:30:03.740 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:03.740 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.740 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.741 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.741 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.741 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-07-16T13:30:03.741 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-07-16T13:30:03.741 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:03.742 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.742 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:03.742 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:03.742 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.742 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.743 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.743 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:03.743 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.743 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.743 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.744 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.744 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-07-16T13:30:03.744 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-07-16T13:30:03.744 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:03.744 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.745 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:03.745 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-07-16T13:30:03.745 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.745 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.745 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:30:03.746 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:30:03.746 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:30:03.746 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:30:03.746 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:30:03.747 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:30:03.747 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:30:03.747 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:30:03.747 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:03.747 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.748 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.748 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.748 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.748 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-07-16T13:30:03.749 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-07-16T13:30:03.749 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:03.749 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.749 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:03.749 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:03.750 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.750 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.750 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.750 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:03.751 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.751 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.751 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.751 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.752 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_destination": { 2020-07-16T13:30:03.752 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_destination", 2020-07-16T13:30:03.752 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:03.752 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.752 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:03.753 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:03.753 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.753 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.753 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.753 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Email address to send alerts to", 2020-07-16T13:30:03.753 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.754 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.754 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.754 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.754 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_from_name": { 2020-07-16T13:30:03.754 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_from_name", 2020-07-16T13:30:03.755 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:03.755 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.755 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:03.755 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "Ceph", 2020-07-16T13:30:03.755 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.756 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.756 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.756 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Email From: name", 2020-07-16T13:30:03.756 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.757 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.757 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.757 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.758 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_host": { 2020-07-16T13:30:03.758 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_host", 2020-07-16T13:30:03.758 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:03.758 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.758 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:03.759 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:03.759 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.759 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.759 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.759 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP server", 2020-07-16T13:30:03.760 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.760 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.760 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.760 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.760 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_password": { 2020-07-16T13:30:03.761 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_password", 2020-07-16T13:30:03.761 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:03.761 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.761 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:03.761 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:03.762 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.762 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.762 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.762 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Password to authenticate with", 2020-07-16T13:30:03.762 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.763 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.763 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.763 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.763 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_port": { 2020-07-16T13:30:03.763 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_port", 2020-07-16T13:30:03.764 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-07-16T13:30:03.764 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.764 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:03.764 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "465", 2020-07-16T13:30:03.764 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.765 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.765 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.765 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP port", 2020-07-16T13:30:03.765 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.765 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.766 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.766 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.766 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_sender": { 2020-07-16T13:30:03.766 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_sender", 2020-07-16T13:30:03.766 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:03.767 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.767 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:03.767 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:03.768 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.768 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.768 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.768 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP envelope sender", 2020-07-16T13:30:03.768 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.769 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.769 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.769 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.769 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_ssl": { 2020-07-16T13:30:03.769 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_ssl", 2020-07-16T13:30:03.770 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:03.770 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.770 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:03.770 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-07-16T13:30:03.770 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.771 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.771 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.771 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Use SSL to connect to SMTP server", 2020-07-16T13:30:03.771 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.771 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.772 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.772 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.772 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_user": { 2020-07-16T13:30:03.772 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_user", 2020-07-16T13:30:03.773 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:03.773 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.773 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:03.773 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:03.773 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.774 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.774 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.774 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "User to authenticate as", 2020-07-16T13:30:03.774 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.774 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.775 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.775 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:30:03.775 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:30:03.775 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.775 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:30:03.776 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "balancer", 2020-07-16T13:30:03.776 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-07-16T13:30:03.776 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-07-16T13:30:03.776 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-07-16T13:30:03.776 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active": { 2020-07-16T13:30:03.776 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "active", 2020-07-16T13:30:03.777 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:03.777 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.778 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:03.778 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:03.778 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.778 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.779 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.779 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "automatically balance PGs across cluster", 2020-07-16T13:30:03.779 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.779 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.779 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.780 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.780 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "begin_time": { 2020-07-16T13:30:03.780 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "begin_time", 2020-07-16T13:30:03.780 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:03.780 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.781 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:03.781 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0000", 2020-07-16T13:30:03.781 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.781 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.781 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.782 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "beginning time of day to automatically balance", 2020-07-16T13:30:03.782 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "This is a time of day in the format HHMM.", 2020-07-16T13:30:03.782 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.782 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.782 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.783 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "begin_weekday": { 2020-07-16T13:30:03.783 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "begin_weekday", 2020-07-16T13:30:03.783 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2020-07-16T13:30:03.783 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.784 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:03.784 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2020-07-16T13:30:03.784 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0", 2020-07-16T13:30:03.784 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "7", 2020-07-16T13:30:03.784 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.785 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Restrict automatic balancing to this day of the week or later", 2020-07-16T13:30:03.785 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2020-07-16T13:30:03.785 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.785 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.785 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.786 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_max_iterations": { 2020-07-16T13:30:03.786 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_max_iterations", 2020-07-16T13:30:03.786 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2020-07-16T13:30:03.786 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.786 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:03.787 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "25", 2020-07-16T13:30:03.787 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "1", 2020-07-16T13:30:03.787 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "250", 2020-07-16T13:30:03.787 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.787 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "maximum number of iterations to attempt optimization", 2020-07-16T13:30:03.788 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.788 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.789 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.789 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.789 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_metrics": { 2020-07-16T13:30:03.789 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_metrics", 2020-07-16T13:30:03.789 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:03.790 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.790 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:03.790 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "pgs,objects,bytes", 2020-07-16T13:30:03.790 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.791 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.791 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.791 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "metrics with which to calculate OSD utilization", 2020-07-16T13:30:03.791 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2020-07-16T13:30:03.791 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.792 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.792 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.792 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_step": { 2020-07-16T13:30:03.792 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_step", 2020-07-16T13:30:03.792 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2020-07-16T13:30:03.793 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.793 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:03.793 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0.5", 2020-07-16T13:30:03.793 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0.001", 2020-07-16T13:30:03.793 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "0.999", 2020-07-16T13:30:03.794 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.794 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "aggressiveness of optimization", 2020-07-16T13:30:03.794 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": ".99 is very aggressive, .01 is less aggressive", 2020-07-16T13:30:03.794 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.794 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.795 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.795 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "end_time": { 2020-07-16T13:30:03.795 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "end_time", 2020-07-16T13:30:03.795 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:03.795 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.796 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:03.796 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "2400", 2020-07-16T13:30:03.796 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.796 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.796 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.797 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "ending time of day to automatically balance", 2020-07-16T13:30:03.797 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "This is a time of day in the format HHMM.", 2020-07-16T13:30:03.797 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.798 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.798 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.798 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "end_weekday": { 2020-07-16T13:30:03.799 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "end_weekday", 2020-07-16T13:30:03.799 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2020-07-16T13:30:03.799 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.799 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:03.799 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7", 2020-07-16T13:30:03.800 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0", 2020-07-16T13:30:03.800 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "7", 2020-07-16T13:30:03.800 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.800 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Restrict automatic balancing to days of the week earlier than this", 2020-07-16T13:30:03.800 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2020-07-16T13:30:03.801 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.801 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.801 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.801 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-07-16T13:30:03.802 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-07-16T13:30:03.802 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:03.802 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.802 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:03.802 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:03.803 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.803 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.803 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:30:03.803 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:30:03.803 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:30:03.804 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:30:03.804 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:30:03.804 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:30:03.804 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:30:03.804 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:30:03.804 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:03.805 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.805 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.805 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.805 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.805 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-07-16T13:30:03.806 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-07-16T13:30:03.806 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:03.806 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.806 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:03.806 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:03.807 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.807 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.807 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.807 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:03.807 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.808 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.808 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.808 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.808 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-07-16T13:30:03.809 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-07-16T13:30:03.810 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:03.810 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.811 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:03.811 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-07-16T13:30:03.811 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.812 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.812 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:30:03.812 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:30:03.812 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:30:03.813 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:30:03.813 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:30:03.813 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:30:03.814 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:30:03.814 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:30:03.814 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:03.814 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.815 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.815 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.815 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.816 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-07-16T13:30:03.816 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-07-16T13:30:03.816 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:03.817 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.817 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:03.817 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:03.818 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.818 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.818 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.818 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:03.819 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.819 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.819 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.820 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.821 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_score": { 2020-07-16T13:30:03.821 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "min_score", 2020-07-16T13:30:03.821 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2020-07-16T13:30:03.821 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.821 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:03.822 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2020-07-16T13:30:03.822 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.822 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.822 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.823 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "minimum score, below which no optimization is attempted", 2020-07-16T13:30:03.823 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.823 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.823 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.823 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.824 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mode": { 2020-07-16T13:30:03.824 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mode", 2020-07-16T13:30:03.824 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:03.824 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.824 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:03.825 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "none", 2020-07-16T13:30:03.825 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.825 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.825 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:30:03.825 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush-compat", 2020-07-16T13:30:03.825 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "none", 2020-07-16T13:30:03.826 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap" 2020-07-16T13:30:03.826 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:30:03.826 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Balancer mode", 2020-07-16T13:30:03.826 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.826 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.827 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.827 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.827 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pool_ids": { 2020-07-16T13:30:03.827 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pool_ids", 2020-07-16T13:30:03.827 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:03.827 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.828 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:03.828 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:03.828 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.828 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.828 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.829 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "pools which the automatic balancing will be limited to", 2020-07-16T13:30:03.829 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.829 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.829 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.829 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.830 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2020-07-16T13:30:03.830 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2020-07-16T13:30:03.830 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2020-07-16T13:30:03.830 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.830 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:03.830 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2020-07-16T13:30:03.831 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.831 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.831 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.831 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to wake up and attempt optimization", 2020-07-16T13:30:03.831 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.832 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.832 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.832 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.832 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap_max_deviation": { 2020-07-16T13:30:03.832 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "upmap_max_deviation", 2020-07-16T13:30:03.832 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-07-16T13:30:03.833 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.833 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:03.833 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2020-07-16T13:30:03.834 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "1", 2020-07-16T13:30:03.834 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.834 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.834 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "deviation below which no optimization is attempted", 2020-07-16T13:30:03.834 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2020-07-16T13:30:03.835 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.835 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.835 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.835 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap_max_optimizations": { 2020-07-16T13:30:03.835 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "upmap_max_optimizations", 2020-07-16T13:30:03.835 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2020-07-16T13:30:03.836 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.836 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:03.836 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2020-07-16T13:30:03.836 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.836 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.837 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.837 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "maximum upmap optimizations to make per attempt", 2020-07-16T13:30:03.837 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.837 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.837 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.838 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:30:03.838 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:30:03.838 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.838 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:30:03.839 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "cephadm", 2020-07-16T13:30:03.839 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-07-16T13:30:03.839 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-07-16T13:30:03.839 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-07-16T13:30:03.839 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "allow_ptrace": { 2020-07-16T13:30:03.839 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "allow_ptrace", 2020-07-16T13:30:03.840 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:03.840 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.840 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:03.840 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:03.840 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.841 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.841 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.841 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "allow SYS_PTRACE capability on ceph containers", 2020-07-16T13:30:03.841 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2020-07-16T13:30:03.841 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.842 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.842 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.842 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "container_image_base": { 2020-07-16T13:30:03.842 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "container_image_base", 2020-07-16T13:30:03.842 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:03.842 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.843 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:03.843 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "ceph/ceph", 2020-07-16T13:30:03.843 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.843 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.843 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.844 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Container image name, without the tag", 2020-07-16T13:30:03.844 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.844 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.844 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.844 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.844 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "daemon_cache_timeout": { 2020-07-16T13:30:03.845 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "daemon_cache_timeout", 2020-07-16T13:30:03.845 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2020-07-16T13:30:03.845 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.845 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:03.845 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2020-07-16T13:30:03.846 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.846 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.846 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.846 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "seconds to cache service (daemon) inventory", 2020-07-16T13:30:03.846 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.847 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.847 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.847 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.847 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "device_cache_timeout": { 2020-07-16T13:30:03.847 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "device_cache_timeout", 2020-07-16T13:30:03.848 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2020-07-16T13:30:03.848 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.848 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:03.848 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1800", 2020-07-16T13:30:03.848 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.849 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.849 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.849 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "seconds to cache device inventory", 2020-07-16T13:30:03.849 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.849 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.850 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.850 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.850 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "host_check_interval": { 2020-07-16T13:30:03.850 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "host_check_interval", 2020-07-16T13:30:03.850 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2020-07-16T13:30:03.851 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.851 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:03.851 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2020-07-16T13:30:03.851 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.851 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.852 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.852 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to perform a host check", 2020-07-16T13:30:03.852 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.852 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.852 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.853 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.853 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-07-16T13:30:03.853 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-07-16T13:30:03.853 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:03.853 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.854 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:03.854 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:03.854 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.854 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.854 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:30:03.855 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:30:03.855 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:30:03.855 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:30:03.855 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:30:03.855 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:30:03.856 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:30:03.856 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:30:03.856 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:03.856 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.856 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.856 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.857 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.857 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-07-16T13:30:03.857 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-07-16T13:30:03.857 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:03.857 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.858 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:03.858 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-07-16T13:30:03.858 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.858 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.858 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.858 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "log to the \"cephadm\" cluster log channel\"", 2020-07-16T13:30:03.859 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.859 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.859 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.859 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.859 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-07-16T13:30:03.860 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-07-16T13:30:03.860 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:03.860 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.860 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:03.860 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-07-16T13:30:03.860 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.861 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.861 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:30:03.861 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:30:03.862 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:30:03.862 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:30:03.862 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:30:03.862 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:30:03.863 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:30:03.863 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:30:03.863 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:03.864 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.864 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.864 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.865 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.865 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-07-16T13:30:03.865 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-07-16T13:30:03.866 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:03.866 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.866 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:03.867 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:03.867 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.867 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.867 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.868 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:03.868 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.868 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.868 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.869 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.869 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mode": { 2020-07-16T13:30:03.869 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mode", 2020-07-16T13:30:03.869 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:03.870 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.870 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:03.870 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "root", 2020-07-16T13:30:03.871 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.871 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.871 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:30:03.871 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm-package", 2020-07-16T13:30:03.872 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "root" 2020-07-16T13:30:03.872 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:30:03.872 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "mode for remote execution of cephadm", 2020-07-16T13:30:03.872 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.873 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.873 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.873 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.873 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssh_config_file": { 2020-07-16T13:30:03.874 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssh_config_file", 2020-07-16T13:30:03.874 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:03.874 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.874 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:03.874 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2020-07-16T13:30:03.875 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.875 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.875 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.875 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "customized SSH config file to connect to managed hosts", 2020-07-16T13:30:03.875 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.876 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.876 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.876 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.876 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_failed_host_check": { 2020-07-16T13:30:03.876 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_failed_host_check", 2020-07-16T13:30:03.876 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:03.877 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.877 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:03.877 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-07-16T13:30:03.877 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.877 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.878 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.878 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if the host check fails", 2020-07-16T13:30:03.878 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.878 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.879 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.879 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.879 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_stray_daemons": { 2020-07-16T13:30:03.879 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_stray_daemons", 2020-07-16T13:30:03.879 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:03.880 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.880 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:03.880 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-07-16T13:30:03.880 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.880 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.880 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.881 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2020-07-16T13:30:03.881 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.881 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.881 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.882 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.882 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_stray_hosts": { 2020-07-16T13:30:03.882 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_stray_hosts", 2020-07-16T13:30:03.882 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:03.882 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.883 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:03.883 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-07-16T13:30:03.883 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.883 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.884 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.884 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2020-07-16T13:30:03.884 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.884 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.884 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.885 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:30:03.885 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:30:03.885 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.885 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:30:03.885 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crash", 2020-07-16T13:30:03.886 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-07-16T13:30:03.886 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-07-16T13:30:03.886 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-07-16T13:30:03.886 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-07-16T13:30:03.886 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-07-16T13:30:03.887 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:03.887 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.887 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:03.887 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:03.887 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.888 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.888 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:30:03.888 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:30:03.888 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:30:03.888 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:30:03.889 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:30:03.889 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:30:03.889 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:30:03.889 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:30:03.889 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:03.889 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.890 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.890 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.890 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.890 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-07-16T13:30:03.890 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-07-16T13:30:03.891 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:03.891 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.891 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:03.891 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:03.891 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.891 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.892 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.892 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:03.892 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.892 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.892 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.893 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.893 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-07-16T13:30:03.893 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-07-16T13:30:03.893 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:03.893 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.893 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:03.894 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-07-16T13:30:03.894 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.894 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.894 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:30:03.894 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:30:03.895 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:30:03.895 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:30:03.895 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:30:03.895 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:30:03.895 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:30:03.896 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:30:03.896 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:03.896 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.896 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.896 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.896 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.897 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-07-16T13:30:03.897 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-07-16T13:30:03.897 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:03.898 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.898 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:03.898 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:03.898 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.899 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.899 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.899 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:03.900 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.900 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.900 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.901 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.901 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "retain_interval": { 2020-07-16T13:30:03.901 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "retain_interval", 2020-07-16T13:30:03.902 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2020-07-16T13:30:03.902 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.902 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:03.903 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "31536000", 2020-07-16T13:30:03.903 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.903 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.904 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.904 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how long to retain crashes before pruning them", 2020-07-16T13:30:03.904 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.905 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.905 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.905 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.905 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_recent_interval": { 2020-07-16T13:30:03.906 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_recent_interval", 2020-07-16T13:30:03.906 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2020-07-16T13:30:03.906 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.906 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:03.907 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1209600", 2020-07-16T13:30:03.907 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.907 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.908 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.908 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "time interval in which to warn about recent crashes", 2020-07-16T13:30:03.908 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.909 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.909 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.909 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:30:03.909 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:30:03.909 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.910 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:30:03.910 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "dashboard", 2020-07-16T13:30:03.910 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-07-16T13:30:03.910 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-07-16T13:30:03.910 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-07-16T13:30:03.911 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ALERTMANAGER_API_HOST": { 2020-07-16T13:30:03.911 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ALERTMANAGER_API_HOST", 2020-07-16T13:30:03.911 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:03.911 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.911 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:03.911 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:03.912 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.912 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.912 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.912 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:03.912 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.913 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.913 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.913 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.913 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "AUDIT_API_ENABLED": { 2020-07-16T13:30:03.913 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "AUDIT_API_ENABLED", 2020-07-16T13:30:03.914 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:03.914 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.914 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:03.914 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:03.914 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.914 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.915 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.915 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:03.915 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.915 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.915 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.916 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.916 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "AUDIT_API_LOG_PAYLOAD": { 2020-07-16T13:30:03.916 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "AUDIT_API_LOG_PAYLOAD", 2020-07-16T13:30:03.916 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:03.916 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.916 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:03.917 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-07-16T13:30:03.917 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.917 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.917 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.917 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:03.918 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.918 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.918 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.918 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.918 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ENABLE_BROWSABLE_API": { 2020-07-16T13:30:03.919 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ENABLE_BROWSABLE_API", 2020-07-16T13:30:03.919 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:03.919 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.919 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:03.919 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-07-16T13:30:03.919 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.920 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.920 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.920 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:03.920 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.921 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.921 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.921 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.921 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_cephfs": { 2020-07-16T13:30:03.921 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_cephfs", 2020-07-16T13:30:03.922 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:03.922 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.927 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:03.928 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-07-16T13:30:03.928 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.928 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.929 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.929 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:03.929 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.930 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.930 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.930 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.931 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_iscsi": { 2020-07-16T13:30:03.931 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_iscsi", 2020-07-16T13:30:03.931 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:03.932 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.933 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:03.933 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-07-16T13:30:03.933 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.934 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.934 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.934 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:03.935 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.935 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.935 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.935 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.935 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_mirroring": { 2020-07-16T13:30:03.936 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_mirroring", 2020-07-16T13:30:03.936 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:03.936 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.937 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:03.937 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-07-16T13:30:03.937 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.937 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.937 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.938 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:03.938 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.938 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.938 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.939 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.939 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_nfs": { 2020-07-16T13:30:03.939 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_nfs", 2020-07-16T13:30:03.939 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:03.939 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.940 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:03.940 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-07-16T13:30:03.940 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.940 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.940 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.940 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:03.941 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.941 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.941 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.941 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.941 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_rbd": { 2020-07-16T13:30:03.942 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_rbd", 2020-07-16T13:30:03.942 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:03.942 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.942 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:03.942 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-07-16T13:30:03.943 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.943 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.943 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.943 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:03.944 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.944 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.944 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.944 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.945 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_rgw": { 2020-07-16T13:30:03.945 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_rgw", 2020-07-16T13:30:03.945 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:03.945 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.945 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:03.945 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-07-16T13:30:03.946 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.946 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.946 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.946 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:03.946 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.947 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.947 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.947 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.947 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2020-07-16T13:30:03.947 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2020-07-16T13:30:03.948 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:03.948 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.948 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:03.948 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:03.948 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.948 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.949 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.949 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:03.949 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.950 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.950 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.950 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.950 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_PASSWORD": { 2020-07-16T13:30:03.950 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_PASSWORD", 2020-07-16T13:30:03.950 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:03.951 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.951 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:03.951 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2020-07-16T13:30:03.951 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.951 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.952 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.952 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:03.952 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.952 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.952 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.952 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.953 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_SSL_VERIFY": { 2020-07-16T13:30:03.953 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_SSL_VERIFY", 2020-07-16T13:30:03.953 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:03.953 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.953 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:03.954 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-07-16T13:30:03.954 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.954 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.954 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.954 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:03.955 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.955 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.955 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.955 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.955 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_URL": { 2020-07-16T13:30:03.955 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_URL", 2020-07-16T13:30:03.956 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:03.956 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.956 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:03.956 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:03.956 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.957 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.957 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.957 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:03.957 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.957 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.957 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.958 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.958 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_USERNAME": { 2020-07-16T13:30:03.958 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_USERNAME", 2020-07-16T13:30:03.958 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:03.958 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.959 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:03.959 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2020-07-16T13:30:03.959 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.959 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.959 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.959 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:03.960 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.960 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.960 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.960 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.960 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_UPDATE_DASHBOARDS": { 2020-07-16T13:30:03.961 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_UPDATE_DASHBOARDS", 2020-07-16T13:30:03.961 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:03.961 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.961 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:03.961 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:03.962 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.962 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.962 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.963 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:03.963 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.963 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.963 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.964 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.964 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ISCSI_API_SSL_VERIFICATION": { 2020-07-16T13:30:03.964 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ISCSI_API_SSL_VERIFICATION", 2020-07-16T13:30:03.964 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:03.964 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.965 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:03.965 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-07-16T13:30:03.965 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.965 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.966 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.966 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:03.966 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.966 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.967 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.967 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.967 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PROMETHEUS_API_HOST": { 2020-07-16T13:30:03.967 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PROMETHEUS_API_HOST", 2020-07-16T13:30:03.968 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:03.968 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.968 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:03.968 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:03.969 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.969 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.969 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.969 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:03.969 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.970 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.970 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.970 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.970 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2020-07-16T13:30:03.970 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2020-07-16T13:30:03.971 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:03.971 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.971 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:03.971 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:03.971 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.972 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.972 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.972 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:03.972 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.972 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.972 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.973 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.973 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2020-07-16T13:30:03.973 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2020-07-16T13:30:03.973 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:03.973 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.974 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:03.974 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:03.974 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.975 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.975 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.975 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:03.976 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.976 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.976 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.976 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.976 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2020-07-16T13:30:03.977 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2020-07-16T13:30:03.977 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:03.977 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.977 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:03.977 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-07-16T13:30:03.978 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.978 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.978 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.978 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:03.979 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.979 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.979 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.979 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.979 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2020-07-16T13:30:03.980 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2020-07-16T13:30:03.980 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:03.980 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.980 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:03.980 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-07-16T13:30:03.980 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.981 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.981 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.981 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:03.981 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.981 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.982 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.982 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.982 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2020-07-16T13:30:03.982 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2020-07-16T13:30:03.982 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:03.983 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.983 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:03.983 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:03.983 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.983 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.983 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.984 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:03.984 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.984 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.984 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.984 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.985 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2020-07-16T13:30:03.985 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2020-07-16T13:30:03.985 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:03.985 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.985 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:03.985 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:03.986 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.986 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.987 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.987 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:03.987 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.987 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.988 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.988 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.988 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2020-07-16T13:30:03.988 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2020-07-16T13:30:03.988 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:03.989 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.989 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:03.989 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:03.989 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.989 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.990 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.990 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:03.990 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.990 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.990 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.990 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.991 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_ENABLED": { 2020-07-16T13:30:03.991 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_ENABLED", 2020-07-16T13:30:03.991 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:03.991 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.991 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:03.992 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-07-16T13:30:03.992 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.992 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.992 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.992 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:03.992 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.993 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.993 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.993 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.993 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_EXCLUSION_LIST": { 2020-07-16T13:30:03.993 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_EXCLUSION_LIST", 2020-07-16T13:30:03.994 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:03.994 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.994 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:03.994 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2020-07-16T13:30:03.994 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.994 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.995 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.995 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:03.995 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.995 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.995 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.996 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.996 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_MIN_COMPLEXITY": { 2020-07-16T13:30:03.996 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_MIN_COMPLEXITY", 2020-07-16T13:30:03.996 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-07-16T13:30:03.996 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.996 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:03.997 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2020-07-16T13:30:03.997 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:03.997 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:03.997 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:03.997 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:03.998 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:03.998 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:03.998 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:03.998 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:03.998 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_MIN_LENGTH": { 2020-07-16T13:30:03.999 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_MIN_LENGTH", 2020-07-16T13:30:03.999 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-07-16T13:30:03.999 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:03.999 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:03.999 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8", 2020-07-16T13:30:03.999 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.000 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.000 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.000 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.000 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.000 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.000 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.001 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.001 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "REST_REQUESTS_TIMEOUT": { 2020-07-16T13:30:04.001 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "REST_REQUESTS_TIMEOUT", 2020-07-16T13:30:04.001 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-07-16T13:30:04.001 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.002 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.002 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "45", 2020-07-16T13:30:04.002 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.002 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.002 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.002 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.003 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.003 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.003 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.003 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.003 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_ACCESS_KEY": { 2020-07-16T13:30:04.004 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_ACCESS_KEY", 2020-07-16T13:30:04.004 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.004 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.004 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.004 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:04.004 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.005 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.005 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.005 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.005 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.005 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.006 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.006 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.006 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_ADMIN_RESOURCE": { 2020-07-16T13:30:04.006 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_ADMIN_RESOURCE", 2020-07-16T13:30:04.006 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.006 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.007 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.007 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2020-07-16T13:30:04.007 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.007 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.007 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.008 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.008 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.008 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.008 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.008 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.009 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_HOST": { 2020-07-16T13:30:04.009 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_HOST", 2020-07-16T13:30:04.009 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.009 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.009 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.009 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:04.010 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.010 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.010 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.010 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.010 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.011 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.011 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.011 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.011 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_PORT": { 2020-07-16T13:30:04.011 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_PORT", 2020-07-16T13:30:04.011 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-07-16T13:30:04.012 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.012 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.012 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "80", 2020-07-16T13:30:04.012 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.012 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.013 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.013 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.013 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.013 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.013 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.013 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.014 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SCHEME": { 2020-07-16T13:30:04.014 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SCHEME", 2020-07-16T13:30:04.014 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.014 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.014 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.015 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "http", 2020-07-16T13:30:04.015 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.015 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.015 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.016 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.016 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.016 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.017 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.017 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.017 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SECRET_KEY": { 2020-07-16T13:30:04.017 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SECRET_KEY", 2020-07-16T13:30:04.018 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.019 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.019 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.019 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:04.019 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.020 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.020 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.020 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.020 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.020 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.021 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.021 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.021 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SSL_VERIFY": { 2020-07-16T13:30:04.021 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SSL_VERIFY", 2020-07-16T13:30:04.021 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:04.022 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.022 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.022 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-07-16T13:30:04.022 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.022 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.023 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.023 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.023 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.023 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.023 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.024 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.024 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_USER_ID": { 2020-07-16T13:30:04.024 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_USER_ID", 2020-07-16T13:30:04.024 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.024 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.025 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.025 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:04.025 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.025 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.025 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.026 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.026 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.026 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.026 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.026 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.027 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_SPAN": { 2020-07-16T13:30:04.028 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_SPAN", 2020-07-16T13:30:04.028 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-07-16T13:30:04.028 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.028 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.029 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2020-07-16T13:30:04.029 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.029 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.029 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.029 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.030 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.030 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.030 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.030 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.030 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_WARNING_1": { 2020-07-16T13:30:04.031 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_WARNING_1", 2020-07-16T13:30:04.031 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-07-16T13:30:04.031 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.031 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.031 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2020-07-16T13:30:04.031 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.032 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.032 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.032 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.032 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.032 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.033 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.033 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.033 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_WARNING_2": { 2020-07-16T13:30:04.033 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_WARNING_2", 2020-07-16T13:30:04.033 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-07-16T13:30:04.034 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.034 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.034 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2020-07-16T13:30:04.034 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.034 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.035 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.035 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.035 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.035 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.035 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.036 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.036 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crt_file": { 2020-07-16T13:30:04.036 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crt_file", 2020-07-16T13:30:04.036 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.036 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.036 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.037 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:04.037 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.037 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.038 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.039 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.039 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.039 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.039 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.039 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.040 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug": { 2020-07-16T13:30:04.040 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "debug", 2020-07-16T13:30:04.040 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:04.040 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.040 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.041 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:04.041 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.041 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.041 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.041 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Enable/disable debug options", 2020-07-16T13:30:04.042 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.042 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.042 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.042 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.043 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "jwt_token_ttl": { 2020-07-16T13:30:04.043 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "jwt_token_ttl", 2020-07-16T13:30:04.043 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-07-16T13:30:04.043 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.043 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.044 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "28800", 2020-07-16T13:30:04.044 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.044 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.044 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.044 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.045 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.045 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.045 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.045 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.045 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "key_file": { 2020-07-16T13:30:04.046 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "key_file", 2020-07-16T13:30:04.046 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.046 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.046 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.046 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:04.047 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.047 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.047 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.047 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.047 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.048 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.048 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.048 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.048 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-07-16T13:30:04.048 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-07-16T13:30:04.048 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.049 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.049 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.049 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:04.049 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.050 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.050 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:30:04.050 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:30:04.051 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:30:04.051 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:30:04.051 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:30:04.052 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:30:04.052 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:30:04.052 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:30:04.053 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.053 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.053 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.054 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.054 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.054 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-07-16T13:30:04.054 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-07-16T13:30:04.055 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:04.055 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.056 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.056 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:04.057 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.057 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.057 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.058 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.058 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.058 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.059 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.059 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.059 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-07-16T13:30:04.060 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-07-16T13:30:04.060 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.060 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.061 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.061 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-07-16T13:30:04.062 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.062 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.062 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:30:04.062 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:30:04.063 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:30:04.063 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:30:04.064 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:30:04.064 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:30:04.064 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:30:04.064 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:30:04.065 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.065 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.065 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.066 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.066 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.066 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-07-16T13:30:04.067 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-07-16T13:30:04.067 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:04.067 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.068 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.068 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:04.068 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.069 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.069 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.069 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.070 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.070 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.071 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.071 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.071 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "password": { 2020-07-16T13:30:04.072 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "password", 2020-07-16T13:30:04.072 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.072 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.073 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.073 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:04.073 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.074 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.074 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.074 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.075 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.075 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.075 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.076 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.076 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2020-07-16T13:30:04.076 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2020-07-16T13:30:04.077 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.077 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.077 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.078 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "::", 2020-07-16T13:30:04.078 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.078 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.079 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.079 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.079 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.080 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.080 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.080 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.080 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2020-07-16T13:30:04.081 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2020-07-16T13:30:04.081 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-07-16T13:30:04.081 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.082 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.082 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8080", 2020-07-16T13:30:04.082 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.083 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.083 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.083 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.084 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.084 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.084 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.085 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.085 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl": { 2020-07-16T13:30:04.085 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl", 2020-07-16T13:30:04.086 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:04.086 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.086 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.087 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-07-16T13:30:04.087 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.087 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.087 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.088 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.088 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.088 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.089 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.089 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.089 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl_server_port": { 2020-07-16T13:30:04.090 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl_server_port", 2020-07-16T13:30:04.090 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-07-16T13:30:04.090 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.091 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.091 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8443", 2020-07-16T13:30:04.092 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.092 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.092 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.093 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.093 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.093 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.094 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.094 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.094 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standby_behaviour": { 2020-07-16T13:30:04.094 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "standby_behaviour", 2020-07-16T13:30:04.095 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.095 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.095 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.096 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "redirect", 2020-07-16T13:30:04.096 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.096 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.097 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:30:04.097 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:30:04.097 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "redirect" 2020-07-16T13:30:04.098 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:30:04.098 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.098 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.099 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.099 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.099 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.100 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standby_error_status_code": { 2020-07-16T13:30:04.100 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "standby_error_status_code", 2020-07-16T13:30:04.100 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-07-16T13:30:04.100 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.101 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.101 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "500", 2020-07-16T13:30:04.102 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "400", 2020-07-16T13:30:04.102 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "599", 2020-07-16T13:30:04.102 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.102 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.103 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.103 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.104 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.104 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.104 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "url_prefix": { 2020-07-16T13:30:04.105 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "url_prefix", 2020-07-16T13:30:04.105 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.105 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.106 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.106 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:04.106 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.107 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.107 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.107 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.108 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.108 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.108 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.109 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.109 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "username": { 2020-07-16T13:30:04.110 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "username", 2020-07-16T13:30:04.110 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.110 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.110 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.110 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:04.111 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.111 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.111 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.111 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.111 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.112 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.112 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.112 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:30:04.112 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:30:04.112 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.112 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:30:04.113 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "devicehealth", 2020-07-16T13:30:04.113 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-07-16T13:30:04.113 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-07-16T13:30:04.113 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-07-16T13:30:04.113 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enable_monitoring": { 2020-07-16T13:30:04.114 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "enable_monitoring", 2020-07-16T13:30:04.114 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:04.114 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.114 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.114 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-07-16T13:30:04.115 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.115 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.115 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.115 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "monitor device health metrics", 2020-07-16T13:30:04.115 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.116 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.116 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.116 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.116 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-07-16T13:30:04.117 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-07-16T13:30:04.117 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.117 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.117 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.117 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:04.118 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.118 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.118 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:30:04.118 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:30:04.118 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:30:04.119 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:30:04.119 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:30:04.119 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:30:04.119 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:30:04.119 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:30:04.120 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.120 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.120 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.120 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.120 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.121 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-07-16T13:30:04.121 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-07-16T13:30:04.121 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:04.121 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.121 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.121 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:04.122 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.122 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.122 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.122 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.122 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.123 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.123 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.123 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.123 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-07-16T13:30:04.123 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-07-16T13:30:04.124 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.124 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.124 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.124 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-07-16T13:30:04.124 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.124 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.125 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:30:04.125 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:30:04.125 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:30:04.125 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:30:04.125 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:30:04.126 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:30:04.126 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:30:04.126 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:30:04.126 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.126 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.127 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.127 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.127 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.127 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-07-16T13:30:04.127 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-07-16T13:30:04.127 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:04.128 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.128 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.128 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:04.129 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.129 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.129 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.129 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.129 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.130 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.130 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.130 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.130 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mark_out_threshold": { 2020-07-16T13:30:04.130 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mark_out_threshold", 2020-07-16T13:30:04.131 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2020-07-16T13:30:04.131 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.131 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.131 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "2419200", 2020-07-16T13:30:04.131 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.131 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.132 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.132 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "automatically mark OSD if it may fail before this long", 2020-07-16T13:30:04.132 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.132 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.132 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.133 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.133 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pool_name": { 2020-07-16T13:30:04.133 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pool_name", 2020-07-16T13:30:04.133 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.133 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.134 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.134 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "device_health_metrics", 2020-07-16T13:30:04.134 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.134 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.134 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.135 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "name of pool in which to store device health metrics", 2020-07-16T13:30:04.135 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.135 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.135 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.135 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.136 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "retention_period": { 2020-07-16T13:30:04.136 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "retention_period", 2020-07-16T13:30:04.136 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2020-07-16T13:30:04.136 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.136 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.137 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "15552000", 2020-07-16T13:30:04.137 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.137 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.137 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.138 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how long to retain device health metrics", 2020-07-16T13:30:04.139 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.139 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.139 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.140 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.140 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "scrape_frequency": { 2020-07-16T13:30:04.140 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "scrape_frequency", 2020-07-16T13:30:04.140 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2020-07-16T13:30:04.140 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.141 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.141 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "86400", 2020-07-16T13:30:04.141 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.141 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.141 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.142 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to scrape device health metrics", 2020-07-16T13:30:04.142 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.142 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.142 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.142 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.143 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "self_heal": { 2020-07-16T13:30:04.143 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "self_heal", 2020-07-16T13:30:04.143 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:04.143 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.143 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.144 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-07-16T13:30:04.144 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.144 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.144 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.144 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "preemptively heal cluster around devices that may fail", 2020-07-16T13:30:04.144 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.145 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.145 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.145 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.145 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2020-07-16T13:30:04.145 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2020-07-16T13:30:04.146 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2020-07-16T13:30:04.146 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.146 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.146 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2020-07-16T13:30:04.146 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.147 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.147 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.147 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to wake up and check device health", 2020-07-16T13:30:04.147 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.147 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.147 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.148 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.148 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_threshold": { 2020-07-16T13:30:04.148 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_threshold", 2020-07-16T13:30:04.148 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2020-07-16T13:30:04.148 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.149 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.149 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7257600", 2020-07-16T13:30:04.149 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.149 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.149 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.149 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise health warning if OSD may fail before this long", 2020-07-16T13:30:04.150 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.150 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.150 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.151 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:30:04.151 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:30:04.151 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.151 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:30:04.151 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "diskprediction_local", 2020-07-16T13:30:04.152 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-07-16T13:30:04.152 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-07-16T13:30:04.152 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-07-16T13:30:04.152 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-07-16T13:30:04.152 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-07-16T13:30:04.153 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.153 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.153 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.153 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:04.153 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.154 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.154 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:30:04.154 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:30:04.154 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:30:04.154 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:30:04.154 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:30:04.155 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:30:04.155 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:30:04.155 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:30:04.155 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.155 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.156 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.156 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.156 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.156 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-07-16T13:30:04.156 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-07-16T13:30:04.156 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:04.157 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.157 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.157 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:04.157 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.157 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.158 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.158 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.158 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.158 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.159 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.159 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.159 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-07-16T13:30:04.160 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-07-16T13:30:04.160 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.160 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.160 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.161 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-07-16T13:30:04.161 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.161 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.161 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:30:04.161 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:30:04.161 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:30:04.162 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:30:04.162 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:30:04.162 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:30:04.162 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:30:04.162 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:30:04.163 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.163 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.163 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.163 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.163 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.164 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-07-16T13:30:04.164 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-07-16T13:30:04.164 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:04.164 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.164 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.164 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:04.165 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.165 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.166 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.166 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.167 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.167 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.167 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.167 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.168 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "predict_interval": { 2020-07-16T13:30:04.168 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "predict_interval", 2020-07-16T13:30:04.168 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.168 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.169 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.169 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "86400", 2020-07-16T13:30:04.169 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.170 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.170 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.170 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.170 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.171 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.171 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.171 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.171 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "predictor_model": { 2020-07-16T13:30:04.172 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "predictor_model", 2020-07-16T13:30:04.172 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.172 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.172 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.173 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "prophetstor", 2020-07-16T13:30:04.173 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.173 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.174 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.174 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.174 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.174 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.175 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.175 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.175 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2020-07-16T13:30:04.175 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2020-07-16T13:30:04.176 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.176 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.176 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.176 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2020-07-16T13:30:04.177 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.177 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.177 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.178 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.178 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.178 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.178 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.179 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:30:04.179 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:30:04.179 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.179 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:30:04.180 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "influx", 2020-07-16T13:30:04.180 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": false, 2020-07-16T13:30:04.180 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "influxdb python module not found", 2020-07-16T13:30:04.180 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-07-16T13:30:04.181 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "batch_size": { 2020-07-16T13:30:04.181 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "batch_size", 2020-07-16T13:30:04.181 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.182 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.182 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.182 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5000", 2020-07-16T13:30:04.183 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.183 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.183 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.183 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.184 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.184 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.184 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.184 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.185 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "database": { 2020-07-16T13:30:04.185 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "database", 2020-07-16T13:30:04.185 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.185 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.186 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.186 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "ceph", 2020-07-16T13:30:04.186 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.186 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.187 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.187 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.187 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.187 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.188 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.188 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.188 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "hostname": { 2020-07-16T13:30:04.189 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "hostname", 2020-07-16T13:30:04.189 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.189 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.189 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.190 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2020-07-16T13:30:04.190 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.190 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.190 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.190 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.190 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.191 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.191 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.191 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.192 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2020-07-16T13:30:04.192 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2020-07-16T13:30:04.192 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.193 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.193 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.193 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "30", 2020-07-16T13:30:04.193 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.194 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.194 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.194 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.194 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.194 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.195 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.195 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.195 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-07-16T13:30:04.195 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-07-16T13:30:04.195 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.196 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.196 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.196 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:04.196 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.196 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.197 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:30:04.197 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:30:04.197 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:30:04.197 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:30:04.197 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:30:04.197 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:30:04.198 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:30:04.198 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:30:04.198 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.199 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.199 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.199 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.200 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.200 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-07-16T13:30:04.200 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-07-16T13:30:04.200 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:04.201 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.201 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.201 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:04.202 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.202 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.202 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.202 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.202 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.203 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.203 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.203 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.203 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-07-16T13:30:04.204 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-07-16T13:30:04.204 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.204 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.204 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.205 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-07-16T13:30:04.205 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.205 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.205 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:30:04.205 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:30:04.206 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:30:04.206 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:30:04.206 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:30:04.206 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:30:04.206 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:30:04.207 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:30:04.207 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.207 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.207 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.207 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.208 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.208 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-07-16T13:30:04.208 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-07-16T13:30:04.208 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:04.208 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.209 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.209 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:04.209 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.209 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.210 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.210 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.210 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.210 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.211 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.211 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.211 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "password": { 2020-07-16T13:30:04.211 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "password", 2020-07-16T13:30:04.212 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.212 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.212 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.212 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2020-07-16T13:30:04.212 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.213 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.213 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.213 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.213 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.213 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.214 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.214 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.214 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "port": { 2020-07-16T13:30:04.214 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "port", 2020-07-16T13:30:04.215 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.215 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.215 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.215 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8086", 2020-07-16T13:30:04.215 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.216 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.216 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.216 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.216 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.217 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.217 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.217 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.217 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl": { 2020-07-16T13:30:04.217 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl", 2020-07-16T13:30:04.218 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.218 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.218 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.218 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "false", 2020-07-16T13:30:04.219 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.219 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.219 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.219 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.220 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.220 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.220 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.220 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.221 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "threads": { 2020-07-16T13:30:04.221 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "threads", 2020-07-16T13:30:04.221 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.221 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.222 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.222 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2020-07-16T13:30:04.222 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.222 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.223 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.223 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.223 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.223 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.224 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.224 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.224 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "username": { 2020-07-16T13:30:04.225 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "username", 2020-07-16T13:30:04.225 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.225 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.225 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.226 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2020-07-16T13:30:04.226 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.226 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.226 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.226 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.226 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.227 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.227 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.227 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.227 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "verify_ssl": { 2020-07-16T13:30:04.227 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "verify_ssl", 2020-07-16T13:30:04.228 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.228 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.228 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.229 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "true", 2020-07-16T13:30:04.229 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.229 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.229 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.229 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.230 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.230 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.230 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.230 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:30:04.230 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:30:04.231 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.231 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:30:04.231 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "insights", 2020-07-16T13:30:04.231 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-07-16T13:30:04.232 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-07-16T13:30:04.232 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-07-16T13:30:04.232 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-07-16T13:30:04.232 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-07-16T13:30:04.232 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.233 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.233 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.233 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:04.233 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.233 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.234 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:30:04.234 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:30:04.234 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:30:04.234 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:30:04.234 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:30:04.234 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:30:04.235 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:30:04.235 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:30:04.235 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.235 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.235 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.236 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.236 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.236 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-07-16T13:30:04.236 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-07-16T13:30:04.236 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:04.237 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.237 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.237 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:04.237 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.237 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.238 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.238 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.238 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.238 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.238 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.239 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.239 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-07-16T13:30:04.239 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-07-16T13:30:04.239 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.239 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.239 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.240 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-07-16T13:30:04.240 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.240 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.240 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:30:04.240 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:30:04.241 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:30:04.241 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:30:04.241 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:30:04.241 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:30:04.241 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:30:04.241 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:30:04.242 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.242 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.242 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.242 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.242 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.243 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-07-16T13:30:04.244 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-07-16T13:30:04.244 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:04.244 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.244 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.244 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:04.245 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.245 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.245 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.245 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.245 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.246 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.246 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.246 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:30:04.246 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:30:04.246 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.246 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:30:04.247 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "iostat", 2020-07-16T13:30:04.247 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-07-16T13:30:04.247 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-07-16T13:30:04.247 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-07-16T13:30:04.247 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-07-16T13:30:04.248 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-07-16T13:30:04.248 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.248 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.248 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.248 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:04.248 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.249 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.249 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:30:04.249 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:30:04.249 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:30:04.249 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:30:04.250 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:30:04.250 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:30:04.250 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:30:04.250 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:30:04.250 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.251 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.251 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.251 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.251 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.251 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-07-16T13:30:04.251 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-07-16T13:30:04.252 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:04.252 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.252 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.252 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:04.252 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.253 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.253 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.253 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.253 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.253 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.253 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.254 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.254 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-07-16T13:30:04.254 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-07-16T13:30:04.254 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.254 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.255 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.255 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-07-16T13:30:04.255 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.255 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.255 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:30:04.255 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:30:04.256 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:30:04.256 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:30:04.256 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:30:04.256 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:30:04.256 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:30:04.257 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:30:04.257 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.257 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.257 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.257 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.258 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.258 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-07-16T13:30:04.258 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-07-16T13:30:04.258 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:04.259 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.259 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.259 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:04.259 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.259 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.259 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.260 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.260 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.260 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.260 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.260 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:30:04.261 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:30:04.261 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.261 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:30:04.261 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "k8sevents", 2020-07-16T13:30:04.261 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-07-16T13:30:04.262 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-07-16T13:30:04.262 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-07-16T13:30:04.262 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ceph_event_retention_days": { 2020-07-16T13:30:04.262 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ceph_event_retention_days", 2020-07-16T13:30:04.262 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-07-16T13:30:04.262 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.263 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.263 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7", 2020-07-16T13:30:04.263 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.263 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.263 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.264 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Days to hold ceph event information within local cache", 2020-07-16T13:30:04.264 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.264 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.264 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.264 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.264 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "config_check_secs": { 2020-07-16T13:30:04.265 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "config_check_secs", 2020-07-16T13:30:04.265 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-07-16T13:30:04.265 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.265 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.265 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2020-07-16T13:30:04.266 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "10", 2020-07-16T13:30:04.266 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.266 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.266 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "interval (secs) to check for cluster configuration changes", 2020-07-16T13:30:04.266 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.267 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.267 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.267 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.267 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-07-16T13:30:04.267 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-07-16T13:30:04.267 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.268 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.268 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.268 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:04.268 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.268 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.269 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:30:04.269 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:30:04.269 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:30:04.269 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:30:04.269 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:30:04.269 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:30:04.270 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:30:04.270 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:30:04.270 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.270 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.270 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.271 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.271 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.271 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-07-16T13:30:04.271 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-07-16T13:30:04.271 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:04.271 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.272 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.272 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:04.272 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.272 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.272 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.273 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.273 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.273 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.273 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.273 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.273 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-07-16T13:30:04.274 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-07-16T13:30:04.274 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.274 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.274 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.274 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-07-16T13:30:04.275 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.275 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.275 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:30:04.275 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:30:04.275 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:30:04.275 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:30:04.276 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:30:04.276 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:30:04.276 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:30:04.276 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:30:04.276 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.277 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.277 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.277 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.277 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.277 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-07-16T13:30:04.277 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-07-16T13:30:04.278 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:04.278 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.278 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.278 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:04.278 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.279 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.279 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.279 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.279 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.279 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.279 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.280 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:30:04.280 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:30:04.280 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.280 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:30:04.280 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "localpool", 2020-07-16T13:30:04.281 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-07-16T13:30:04.281 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-07-16T13:30:04.281 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-07-16T13:30:04.281 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "failure_domain": { 2020-07-16T13:30:04.281 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "failure_domain", 2020-07-16T13:30:04.282 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.282 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.282 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.282 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "host", 2020-07-16T13:30:04.282 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.282 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.283 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.283 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "failure domain for any created local pool", 2020-07-16T13:30:04.283 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.283 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.283 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.284 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.284 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-07-16T13:30:04.284 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-07-16T13:30:04.284 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.284 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.284 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.285 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:04.285 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.285 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.285 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:30:04.285 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:30:04.286 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:30:04.286 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:30:04.286 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:30:04.286 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:30:04.286 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:30:04.286 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:30:04.287 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.287 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.287 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.287 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.287 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.288 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-07-16T13:30:04.288 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-07-16T13:30:04.288 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:04.288 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.288 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.288 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:04.289 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.289 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.289 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.289 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.289 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.290 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.290 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.290 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.290 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-07-16T13:30:04.290 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-07-16T13:30:04.290 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.291 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.291 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.291 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-07-16T13:30:04.291 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.291 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.292 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:30:04.292 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:30:04.292 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:30:04.292 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:30:04.292 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:30:04.292 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:30:04.293 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:30:04.293 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:30:04.293 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.293 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.293 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.294 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.294 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.294 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-07-16T13:30:04.294 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-07-16T13:30:04.294 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:04.294 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.295 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.295 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:04.295 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.295 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.295 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.296 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.296 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.296 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.296 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.296 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.296 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_size": { 2020-07-16T13:30:04.297 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "min_size", 2020-07-16T13:30:04.297 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-07-16T13:30:04.297 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.297 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.297 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:04.298 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.298 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.298 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.298 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default min_size for any created local pool", 2020-07-16T13:30:04.298 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.299 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.299 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.299 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.299 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_rep": { 2020-07-16T13:30:04.299 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "num_rep", 2020-07-16T13:30:04.300 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-07-16T13:30:04.300 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.300 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.300 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "3", 2020-07-16T13:30:04.300 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.301 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.301 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.301 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default replica count for any created local pool", 2020-07-16T13:30:04.301 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.301 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.302 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.302 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.302 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pg_num": { 2020-07-16T13:30:04.302 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pg_num", 2020-07-16T13:30:04.302 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-07-16T13:30:04.302 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.303 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.303 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "128", 2020-07-16T13:30:04.303 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.303 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.303 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.304 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default pg_num for any created local pool", 2020-07-16T13:30:04.304 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.304 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.304 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.304 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.305 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "prefix": { 2020-07-16T13:30:04.305 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "prefix", 2020-07-16T13:30:04.305 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.305 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.305 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.305 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:04.306 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.306 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.306 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.306 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "name prefix for any created local pool", 2020-07-16T13:30:04.306 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.307 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.307 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.307 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.307 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "subtree": { 2020-07-16T13:30:04.307 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "subtree", 2020-07-16T13:30:04.307 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.308 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.308 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.308 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "rack", 2020-07-16T13:30:04.308 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.308 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.309 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.309 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "CRUSH level for which to create a local pool", 2020-07-16T13:30:04.309 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.309 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.309 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.309 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:30:04.310 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:30:04.310 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.310 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:30:04.310 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "orchestrator", 2020-07-16T13:30:04.310 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-07-16T13:30:04.311 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-07-16T13:30:04.311 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-07-16T13:30:04.311 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-07-16T13:30:04.311 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-07-16T13:30:04.312 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.312 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.312 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.312 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:04.312 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.313 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.313 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:30:04.313 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:30:04.313 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:30:04.313 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:30:04.313 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:30:04.314 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:30:04.314 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:30:04.314 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:30:04.314 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.314 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.315 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.315 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.315 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.315 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-07-16T13:30:04.315 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-07-16T13:30:04.315 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:04.316 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.316 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.316 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:04.316 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.316 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.317 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.317 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.317 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.317 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.317 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.317 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.318 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-07-16T13:30:04.318 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-07-16T13:30:04.318 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.318 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.318 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.319 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-07-16T13:30:04.319 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.319 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.319 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:30:04.319 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:30:04.320 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:30:04.320 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:30:04.320 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:30:04.320 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:30:04.320 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:30:04.320 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:30:04.321 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.321 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.321 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.321 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.321 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.322 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-07-16T13:30:04.322 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-07-16T13:30:04.322 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:04.322 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.322 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.322 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:04.323 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.323 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.323 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.323 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.323 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.324 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.324 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.324 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.324 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator": { 2020-07-16T13:30:04.324 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "orchestrator", 2020-07-16T13:30:04.324 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.325 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.325 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.325 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2020-07-16T13:30:04.325 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.325 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.326 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:30:04.326 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm", 2020-07-16T13:30:04.326 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rook", 2020-07-16T13:30:04.326 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "test_orchestrator" 2020-07-16T13:30:04.326 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:30:04.327 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Orchestrator backend", 2020-07-16T13:30:04.327 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.327 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.327 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.327 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:30:04.327 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:30:04.328 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.328 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:30:04.328 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "osd_support", 2020-07-16T13:30:04.328 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-07-16T13:30:04.328 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-07-16T13:30:04.329 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-07-16T13:30:04.329 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-07-16T13:30:04.329 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-07-16T13:30:04.329 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.329 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.329 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.330 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:04.330 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.330 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.330 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:30:04.330 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:30:04.331 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:30:04.331 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:30:04.331 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:30:04.331 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:30:04.336 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:30:04.336 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:30:04.336 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.337 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.337 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.337 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.338 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.338 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-07-16T13:30:04.338 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-07-16T13:30:04.339 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:04.339 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.339 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.340 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:04.341 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.341 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.341 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.342 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.342 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.342 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.343 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.343 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.343 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-07-16T13:30:04.343 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-07-16T13:30:04.344 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.344 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.344 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.345 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-07-16T13:30:04.345 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.345 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.346 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:30:04.346 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:30:04.346 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:30:04.347 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:30:04.347 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:30:04.347 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:30:04.348 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:30:04.348 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:30:04.348 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.349 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.349 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.349 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.350 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.350 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-07-16T13:30:04.351 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-07-16T13:30:04.351 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:04.351 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.352 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.352 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:04.352 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.353 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.353 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.353 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.354 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.354 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.354 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.354 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:30:04.355 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:30:04.355 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.355 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:30:04.356 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pg_autoscaler", 2020-07-16T13:30:04.356 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-07-16T13:30:04.356 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-07-16T13:30:04.356 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-07-16T13:30:04.357 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-07-16T13:30:04.357 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-07-16T13:30:04.357 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.358 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.358 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.358 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:04.358 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.359 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.359 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:30:04.359 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:30:04.359 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:30:04.360 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:30:04.360 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:30:04.360 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:30:04.361 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:30:04.361 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:30:04.362 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.362 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.362 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.363 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.363 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.363 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-07-16T13:30:04.364 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-07-16T13:30:04.364 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:04.364 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.365 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.365 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:04.365 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.366 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.366 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.366 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.367 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.367 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.367 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.367 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.368 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-07-16T13:30:04.368 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-07-16T13:30:04.368 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.369 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.369 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.369 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-07-16T13:30:04.370 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.370 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.370 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:30:04.371 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:30:04.371 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:30:04.372 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:30:04.372 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:30:04.372 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:30:04.372 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:30:04.373 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:30:04.373 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.373 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.374 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.374 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.374 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.374 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-07-16T13:30:04.374 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-07-16T13:30:04.375 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:04.375 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.375 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.375 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:04.375 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.375 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.376 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.376 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.376 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.376 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.376 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.377 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.377 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2020-07-16T13:30:04.378 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2020-07-16T13:30:04.378 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.378 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.379 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.379 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2020-07-16T13:30:04.379 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.379 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.380 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.380 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.380 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.380 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.380 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.381 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:30:04.381 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:30:04.381 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.382 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:30:04.382 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "progress", 2020-07-16T13:30:04.382 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-07-16T13:30:04.383 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-07-16T13:30:04.383 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-07-16T13:30:04.383 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-07-16T13:30:04.384 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-07-16T13:30:04.384 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.384 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.385 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.385 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:04.385 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.386 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.386 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:30:04.386 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:30:04.386 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:30:04.387 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:30:04.387 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:30:04.387 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:30:04.388 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:30:04.388 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:30:04.388 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.389 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.389 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.389 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.390 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.391 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-07-16T13:30:04.391 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-07-16T13:30:04.391 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:04.391 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.392 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.392 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:04.392 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.393 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.393 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.393 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.394 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.394 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.394 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.394 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.395 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-07-16T13:30:04.395 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-07-16T13:30:04.395 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.396 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.396 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.397 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-07-16T13:30:04.397 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.397 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.398 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:30:04.398 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:30:04.398 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:30:04.399 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:30:04.399 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:30:04.399 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:30:04.400 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:30:04.400 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:30:04.400 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.401 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.401 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.401 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.402 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.402 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-07-16T13:30:04.402 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-07-16T13:30:04.403 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:04.403 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.403 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.404 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:04.404 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.404 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.405 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.405 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.405 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.405 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.406 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.406 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.406 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max_completed_events": { 2020-07-16T13:30:04.406 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "max_completed_events", 2020-07-16T13:30:04.406 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-07-16T13:30:04.407 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.407 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.407 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "50", 2020-07-16T13:30:04.407 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.407 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.408 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.408 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "number of past completed events to remember", 2020-07-16T13:30:04.408 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.408 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.408 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.409 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.409 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "persist_interval": { 2020-07-16T13:30:04.409 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "persist_interval", 2020-07-16T13:30:04.409 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2020-07-16T13:30:04.409 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.409 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.410 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2020-07-16T13:30:04.410 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.410 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.410 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.410 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to persist completed events", 2020-07-16T13:30:04.411 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.411 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.411 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.411 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:30:04.411 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:30:04.412 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.412 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:30:04.412 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "prometheus", 2020-07-16T13:30:04.412 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-07-16T13:30:04.412 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-07-16T13:30:04.412 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-07-16T13:30:04.413 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-07-16T13:30:04.413 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-07-16T13:30:04.413 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.413 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.413 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.414 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:04.414 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.414 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.414 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:30:04.414 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:30:04.415 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:30:04.415 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:30:04.415 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:30:04.415 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:30:04.416 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:30:04.416 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:30:04.416 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.416 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.416 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.416 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.417 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.417 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-07-16T13:30:04.417 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-07-16T13:30:04.417 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:04.417 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.418 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.418 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:04.418 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.418 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.418 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.418 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.419 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.419 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.419 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.419 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.419 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-07-16T13:30:04.420 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-07-16T13:30:04.420 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.420 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.420 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.420 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-07-16T13:30:04.420 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.421 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.421 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:30:04.421 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:30:04.421 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:30:04.421 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:30:04.422 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:30:04.422 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:30:04.422 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:30:04.422 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:30:04.422 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.422 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.423 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.423 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.423 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.423 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-07-16T13:30:04.423 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-07-16T13:30:04.424 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:04.424 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.424 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.424 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:04.424 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.425 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.425 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.425 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.425 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.425 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.425 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.426 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.426 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_stats_pools": { 2020-07-16T13:30:04.426 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_stats_pools", 2020-07-16T13:30:04.426 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.426 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.427 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.427 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:04.427 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.427 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.427 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.427 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.428 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.428 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.430 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.430 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.430 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_stats_pools_refresh_interval": { 2020-07-16T13:30:04.430 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_stats_pools_refresh_interval", 2020-07-16T13:30:04.431 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.431 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.431 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.431 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:04.431 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.432 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.432 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.432 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.432 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.432 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.433 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.433 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.433 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "scrape_interval": { 2020-07-16T13:30:04.433 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "scrape_interval", 2020-07-16T13:30:04.433 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.433 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.434 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.434 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:04.434 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.434 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.434 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.435 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.435 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.435 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.435 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.435 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.436 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2020-07-16T13:30:04.436 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2020-07-16T13:30:04.436 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.436 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.436 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.437 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:04.437 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.437 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.437 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.437 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.438 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.438 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.438 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.438 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.438 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2020-07-16T13:30:04.438 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2020-07-16T13:30:04.439 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.439 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.439 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.439 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:04.439 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.440 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.440 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.440 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.440 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.440 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.440 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.441 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:30:04.441 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:30:04.441 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.441 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:30:04.441 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_support", 2020-07-16T13:30:04.442 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-07-16T13:30:04.442 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-07-16T13:30:04.442 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-07-16T13:30:04.442 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-07-16T13:30:04.442 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-07-16T13:30:04.443 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.443 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.443 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.443 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:04.443 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.443 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.444 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:30:04.444 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:30:04.444 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:30:04.444 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:30:04.444 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:30:04.445 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:30:04.445 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:30:04.445 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:30:04.445 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.445 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.445 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.446 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.446 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.446 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-07-16T13:30:04.446 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-07-16T13:30:04.446 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:04.447 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.447 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.447 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:04.447 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.447 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.448 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.448 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.448 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.448 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.449 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.449 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.449 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-07-16T13:30:04.449 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-07-16T13:30:04.449 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.450 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.450 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.450 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-07-16T13:30:04.450 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.450 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.450 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:30:04.451 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:30:04.451 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:30:04.451 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:30:04.451 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:30:04.451 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:30:04.452 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:30:04.452 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:30:04.452 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.452 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.452 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.453 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.453 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.453 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-07-16T13:30:04.453 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-07-16T13:30:04.453 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:04.454 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.454 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.454 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:04.454 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.454 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.454 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.455 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.455 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.455 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.455 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.455 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.456 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mirror_snapshot_schedule": { 2020-07-16T13:30:04.456 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mirror_snapshot_schedule", 2020-07-16T13:30:04.456 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.456 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.456 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.456 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:04.457 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.457 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.457 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.457 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.457 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.458 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.458 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.458 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.458 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "trash_purge_schedule": { 2020-07-16T13:30:04.458 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "trash_purge_schedule", 2020-07-16T13:30:04.458 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.459 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.459 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.459 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:04.459 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.459 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.460 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.460 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.460 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.460 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.460 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.461 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:30:04.461 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:30:04.461 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.461 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:30:04.462 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "restful", 2020-07-16T13:30:04.462 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-07-16T13:30:04.462 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-07-16T13:30:04.462 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-07-16T13:30:04.462 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "key_file": { 2020-07-16T13:30:04.463 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "key_file", 2020-07-16T13:30:04.463 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.463 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.464 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.465 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:04.466 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.466 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.466 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.466 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.467 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.467 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.467 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.467 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.467 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-07-16T13:30:04.468 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-07-16T13:30:04.468 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.468 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.468 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.468 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:04.469 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.469 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.469 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:30:04.469 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:30:04.470 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:30:04.470 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:30:04.470 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:30:04.470 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:30:04.471 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:30:04.471 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:30:04.471 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.471 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.471 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.472 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.472 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.472 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-07-16T13:30:04.472 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-07-16T13:30:04.472 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:04.473 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.473 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.473 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:04.473 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.473 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.474 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.474 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.474 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.475 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.475 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.475 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.475 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-07-16T13:30:04.475 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-07-16T13:30:04.476 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.476 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.476 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.476 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-07-16T13:30:04.476 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.477 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.477 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:30:04.477 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:30:04.477 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:30:04.477 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:30:04.478 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:30:04.478 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:30:04.478 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:30:04.478 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:30:04.478 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.479 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.479 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.479 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.479 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.479 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-07-16T13:30:04.480 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-07-16T13:30:04.480 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:04.480 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.480 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.480 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:04.481 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.481 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.481 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.481 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.481 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.482 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.482 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.482 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.482 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2020-07-16T13:30:04.482 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2020-07-16T13:30:04.483 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.483 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.483 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.483 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:04.483 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.484 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.484 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.484 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.484 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.484 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.485 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.485 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.485 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2020-07-16T13:30:04.485 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2020-07-16T13:30:04.485 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.486 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.486 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.486 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:04.486 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.486 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.487 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.487 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.487 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.487 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.487 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.488 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:30:04.488 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:30:04.488 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.488 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:30:04.488 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rook", 2020-07-16T13:30:04.489 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-07-16T13:30:04.489 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-07-16T13:30:04.489 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-07-16T13:30:04.489 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-07-16T13:30:04.489 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-07-16T13:30:04.490 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.490 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.490 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.490 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:04.490 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.491 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.491 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:30:04.491 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:30:04.491 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:30:04.492 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:30:04.492 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:30:04.492 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:30:04.492 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:30:04.492 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:30:04.493 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.493 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.493 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.493 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.493 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.494 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-07-16T13:30:04.494 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-07-16T13:30:04.494 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:04.494 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.494 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.495 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:04.495 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.495 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.495 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.495 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.496 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.496 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.496 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.496 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.497 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-07-16T13:30:04.497 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-07-16T13:30:04.497 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.497 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.497 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.498 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-07-16T13:30:04.498 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.498 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.498 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:30:04.498 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:30:04.500 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:30:04.500 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:30:04.500 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:30:04.500 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:30:04.501 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:30:04.501 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:30:04.501 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.501 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.502 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.502 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.502 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.502 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-07-16T13:30:04.503 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-07-16T13:30:04.503 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:04.503 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.503 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.503 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:04.504 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.504 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.504 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.505 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.505 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.505 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.506 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.506 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:30:04.506 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:30:04.507 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.507 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:30:04.507 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "selftest", 2020-07-16T13:30:04.507 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-07-16T13:30:04.508 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-07-16T13:30:04.508 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-07-16T13:30:04.508 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-07-16T13:30:04.509 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-07-16T13:30:04.509 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.509 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.509 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.510 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:04.510 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.510 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.511 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:30:04.511 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:30:04.511 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:30:04.512 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:30:04.512 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:30:04.512 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:30:04.512 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:30:04.513 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:30:04.513 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.513 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.514 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.514 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.514 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.515 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-07-16T13:30:04.515 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-07-16T13:30:04.515 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:04.516 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.516 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.516 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:04.517 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.517 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.517 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.518 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.518 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.518 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.519 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.519 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.519 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-07-16T13:30:04.520 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-07-16T13:30:04.520 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.520 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.521 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.521 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-07-16T13:30:04.521 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.521 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.522 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:30:04.522 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:30:04.522 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:30:04.522 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:30:04.522 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:30:04.523 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:30:04.523 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:30:04.523 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:30:04.523 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.523 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.524 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.524 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.524 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.524 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-07-16T13:30:04.524 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-07-16T13:30:04.525 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:04.525 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.525 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.525 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:04.525 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.526 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.526 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.526 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.526 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.526 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.527 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.527 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.527 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "roption1": { 2020-07-16T13:30:04.527 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "roption1", 2020-07-16T13:30:04.527 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.528 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.528 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.528 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:04.528 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.528 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.529 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.529 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.529 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.529 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.529 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.530 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.530 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "roption2": { 2020-07-16T13:30:04.530 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "roption2", 2020-07-16T13:30:04.530 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.530 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.531 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.531 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "xyz", 2020-07-16T13:30:04.531 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.532 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.532 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.532 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.532 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.532 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.533 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.533 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.533 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption1": { 2020-07-16T13:30:04.533 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption1", 2020-07-16T13:30:04.533 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.534 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.534 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.539 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:04.540 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.540 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.540 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.540 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.541 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.541 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.541 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.542 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.542 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption2": { 2020-07-16T13:30:04.542 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption2", 2020-07-16T13:30:04.542 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-07-16T13:30:04.542 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.543 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.543 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:04.543 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.543 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.544 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.544 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.544 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.545 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.545 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.545 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.546 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption3": { 2020-07-16T13:30:04.546 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption3", 2020-07-16T13:30:04.546 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2020-07-16T13:30:04.546 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.547 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.547 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:04.547 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.547 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.547 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.548 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.548 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.548 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.548 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.549 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.549 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption4": { 2020-07-16T13:30:04.549 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption4", 2020-07-16T13:30:04.549 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.550 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.550 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.550 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:04.550 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.550 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.551 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.551 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.551 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.551 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.551 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.551 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.552 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption5": { 2020-07-16T13:30:04.552 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption5", 2020-07-16T13:30:04.552 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:04.552 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.553 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.553 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:04.553 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.553 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.554 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.554 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.554 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.554 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.555 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.555 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.555 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption6": { 2020-07-16T13:30:04.555 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption6", 2020-07-16T13:30:04.555 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:04.556 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.556 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.556 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-07-16T13:30:04.556 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.556 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.557 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.557 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.557 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.557 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.557 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.558 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.558 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testkey": { 2020-07-16T13:30:04.558 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testkey", 2020-07-16T13:30:04.558 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.558 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.559 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.559 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:04.559 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.559 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.560 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.560 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.560 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.560 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.561 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.561 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.561 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testlkey": { 2020-07-16T13:30:04.562 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testlkey", 2020-07-16T13:30:04.562 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.562 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.562 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.563 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:04.563 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.563 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.564 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.564 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.564 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.564 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.565 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.565 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.566 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testnewline": { 2020-07-16T13:30:04.566 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testnewline", 2020-07-16T13:30:04.566 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.566 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.567 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.567 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:04.567 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.567 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.567 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.568 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.568 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.568 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.568 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.568 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:30:04.569 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:30:04.569 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.569 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:30:04.569 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "status", 2020-07-16T13:30:04.569 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-07-16T13:30:04.570 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-07-16T13:30:04.570 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-07-16T13:30:04.570 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-07-16T13:30:04.570 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-07-16T13:30:04.570 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.571 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.571 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.571 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:04.571 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.571 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.571 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:30:04.572 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:30:04.572 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:30:04.572 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:30:04.572 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:30:04.572 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:30:04.573 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:30:04.573 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:30:04.573 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.573 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.573 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.574 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.574 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.574 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-07-16T13:30:04.574 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-07-16T13:30:04.574 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:04.574 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.575 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.575 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:04.575 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.575 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.575 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.576 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.576 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.576 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.576 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.576 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.576 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-07-16T13:30:04.577 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-07-16T13:30:04.577 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.577 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.577 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.577 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-07-16T13:30:04.578 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.578 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.578 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:30:04.578 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:30:04.578 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:30:04.578 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:30:04.579 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:30:04.579 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:30:04.579 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:30:04.579 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:30:04.579 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.580 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.580 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.580 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.580 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.580 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-07-16T13:30:04.580 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-07-16T13:30:04.581 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:04.581 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.581 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.581 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:04.581 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.582 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.582 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.582 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.582 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.582 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.583 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.583 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:30:04.583 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:30:04.583 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.583 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:30:04.583 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "telegraf", 2020-07-16T13:30:04.584 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-07-16T13:30:04.584 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-07-16T13:30:04.584 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-07-16T13:30:04.584 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "address": { 2020-07-16T13:30:04.584 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "address", 2020-07-16T13:30:04.585 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.585 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.585 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.585 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "unixgram:///tmp/telegraf.sock", 2020-07-16T13:30:04.585 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.585 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.586 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.586 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.586 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.586 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.586 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.587 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.587 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2020-07-16T13:30:04.587 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2020-07-16T13:30:04.587 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2020-07-16T13:30:04.587 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.587 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.588 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "15", 2020-07-16T13:30:04.588 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.588 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.588 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.588 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.589 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.589 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.589 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.589 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.589 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-07-16T13:30:04.589 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-07-16T13:30:04.590 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.590 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.590 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.590 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:04.590 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.591 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.591 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:30:04.591 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:30:04.591 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:30:04.591 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:30:04.591 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:30:04.592 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:30:04.592 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:30:04.592 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:30:04.592 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.592 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.593 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.593 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.593 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.593 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-07-16T13:30:04.593 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-07-16T13:30:04.594 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:04.594 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.594 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.594 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:04.594 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.594 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.595 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.595 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.595 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.595 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.595 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.595 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.596 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-07-16T13:30:04.596 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-07-16T13:30:04.596 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.596 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.596 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.597 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-07-16T13:30:04.597 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.597 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.597 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:30:04.597 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:30:04.598 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:30:04.598 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:30:04.598 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:30:04.598 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:30:04.598 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:30:04.598 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:30:04.599 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.599 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.599 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.599 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.599 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.600 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-07-16T13:30:04.600 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-07-16T13:30:04.600 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:04.600 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.600 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.600 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:04.601 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.601 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.601 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.601 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.601 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.602 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.602 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.602 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:30:04.602 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:30:04.602 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.602 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:30:04.603 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "telemetry", 2020-07-16T13:30:04.603 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-07-16T13:30:04.603 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-07-16T13:30:04.603 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-07-16T13:30:04.603 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_basic": { 2020-07-16T13:30:04.604 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_basic", 2020-07-16T13:30:04.604 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:04.604 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.604 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.604 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-07-16T13:30:04.604 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.605 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.605 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.605 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Share basic cluster information (size, version)", 2020-07-16T13:30:04.605 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.605 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.606 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.606 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.606 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_crash": { 2020-07-16T13:30:04.606 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_crash", 2020-07-16T13:30:04.606 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:04.606 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.607 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.607 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-07-16T13:30:04.607 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.607 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.607 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.607 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.608 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.608 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.608 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.608 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.608 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_device": { 2020-07-16T13:30:04.609 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_device", 2020-07-16T13:30:04.609 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:04.609 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.609 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.609 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2020-07-16T13:30:04.610 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.610 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.610 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.610 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.610 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.610 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.611 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.611 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.611 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_ident": { 2020-07-16T13:30:04.611 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_ident", 2020-07-16T13:30:04.611 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:04.612 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.612 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.612 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:04.612 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.612 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.612 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.613 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.613 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.613 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.613 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.613 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.614 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "contact": { 2020-07-16T13:30:04.614 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "contact", 2020-07-16T13:30:04.614 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.614 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.614 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.614 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2020-07-16T13:30:04.615 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.615 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.615 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.615 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.615 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.616 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.616 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.616 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.616 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "description": { 2020-07-16T13:30:04.616 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "description", 2020-07-16T13:30:04.616 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.617 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.617 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.617 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2020-07-16T13:30:04.617 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.617 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.618 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.618 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.618 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.618 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.618 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.618 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.619 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "device_url": { 2020-07-16T13:30:04.619 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "device_url", 2020-07-16T13:30:04.619 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.619 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.619 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.620 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "https://telemetry.ceph.com/device", 2020-07-16T13:30:04.620 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.620 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.620 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.620 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.620 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.621 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.621 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.621 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.621 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enabled": { 2020-07-16T13:30:04.621 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "enabled", 2020-07-16T13:30:04.622 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:04.622 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.622 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.622 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:04.622 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.622 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.623 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.623 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.623 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.623 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.623 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.624 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.624 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2020-07-16T13:30:04.624 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2020-07-16T13:30:04.624 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-07-16T13:30:04.624 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.624 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.625 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "24", 2020-07-16T13:30:04.625 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "8", 2020-07-16T13:30:04.625 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.625 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.625 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.626 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.626 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.626 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.626 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.626 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "last_opt_revision": { 2020-07-16T13:30:04.626 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "last_opt_revision", 2020-07-16T13:30:04.627 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-07-16T13:30:04.627 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.627 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.627 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1", 2020-07-16T13:30:04.627 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.628 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.628 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.628 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.628 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.628 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.628 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.629 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.629 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "leaderboard": { 2020-07-16T13:30:04.629 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "leaderboard", 2020-07-16T13:30:04.629 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:04.629 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.630 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.630 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:04.630 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.630 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.630 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.630 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.631 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.631 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.631 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.631 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.631 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-07-16T13:30:04.632 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-07-16T13:30:04.632 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.632 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.632 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.632 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:04.632 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.633 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.633 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:30:04.633 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:30:04.633 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:30:04.633 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:30:04.634 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:30:04.634 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:30:04.634 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:30:04.634 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:30:04.634 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.634 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.635 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.635 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.635 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.635 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-07-16T13:30:04.635 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-07-16T13:30:04.636 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:04.636 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.636 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.636 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:04.636 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.636 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.637 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.637 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.637 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.637 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.637 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.638 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.638 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-07-16T13:30:04.638 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-07-16T13:30:04.638 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.638 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.638 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.639 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-07-16T13:30:04.639 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.639 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.639 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:30:04.639 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:30:04.640 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:30:04.640 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:30:04.640 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:30:04.640 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:30:04.640 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:30:04.640 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:30:04.641 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.641 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.641 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.641 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.641 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.642 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-07-16T13:30:04.642 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-07-16T13:30:04.642 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:04.642 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.642 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.642 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:04.643 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.643 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.643 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.643 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.643 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.644 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.644 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.644 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.644 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "organization": { 2020-07-16T13:30:04.644 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "organization", 2020-07-16T13:30:04.644 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.645 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.645 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.645 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2020-07-16T13:30:04.645 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.645 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.646 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.646 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.646 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.646 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.646 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.646 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.647 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "proxy": { 2020-07-16T13:30:04.647 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "proxy", 2020-07-16T13:30:04.647 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.647 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.647 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.648 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2020-07-16T13:30:04.648 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.648 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.648 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.648 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.648 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.649 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.649 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.649 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.649 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "url": { 2020-07-16T13:30:04.649 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "url", 2020-07-16T13:30:04.650 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.650 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.650 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.650 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "https://telemetry.ceph.com/report", 2020-07-16T13:30:04.650 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.650 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.651 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.651 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.651 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.651 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.651 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.652 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:30:04.652 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:30:04.652 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.652 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:30:04.652 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "test_orchestrator", 2020-07-16T13:30:04.652 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-07-16T13:30:04.653 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-07-16T13:30:04.653 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-07-16T13:30:04.653 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-07-16T13:30:04.653 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-07-16T13:30:04.653 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.654 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.654 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.654 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:04.654 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.654 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.654 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:30:04.655 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:30:04.655 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:30:04.655 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:30:04.655 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:30:04.655 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:30:04.656 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:30:04.656 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:30:04.656 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.656 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.656 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.656 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.657 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.657 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-07-16T13:30:04.657 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-07-16T13:30:04.657 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:04.657 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.658 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.658 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:04.658 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.658 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.658 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.658 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.659 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.659 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.659 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.659 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.659 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-07-16T13:30:04.660 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-07-16T13:30:04.660 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.660 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.660 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.660 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-07-16T13:30:04.660 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.661 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.661 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:30:04.661 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:30:04.661 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:30:04.661 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:30:04.662 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:30:04.662 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:30:04.662 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:30:04.662 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:30:04.662 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.662 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.663 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.663 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.663 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.663 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-07-16T13:30:04.663 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-07-16T13:30:04.664 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:04.664 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.664 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.664 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:04.664 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.664 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.665 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.665 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.665 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.665 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.665 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.666 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:30:04.666 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:30:04.666 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.666 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:30:04.666 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "volumes", 2020-07-16T13:30:04.666 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-07-16T13:30:04.667 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-07-16T13:30:04.667 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-07-16T13:30:04.667 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-07-16T13:30:04.667 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-07-16T13:30:04.667 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.668 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.668 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.668 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:04.668 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.668 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.668 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:30:04.669 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:30:04.669 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:30:04.669 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:30:04.669 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:30:04.669 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:30:04.670 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:30:04.670 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:30:04.670 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.670 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.670 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.670 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.671 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.671 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-07-16T13:30:04.671 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-07-16T13:30:04.671 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:04.671 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.672 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.672 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:04.672 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.672 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.672 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.672 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.673 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.673 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.673 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.673 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.673 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-07-16T13:30:04.674 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-07-16T13:30:04.674 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.674 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.674 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.674 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-07-16T13:30:04.674 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.675 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.675 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:30:04.676 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:30:04.676 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:30:04.676 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:30:04.676 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:30:04.677 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:30:04.677 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:30:04.677 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:30:04.677 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.677 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.677 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.678 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.678 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.678 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-07-16T13:30:04.678 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-07-16T13:30:04.678 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:04.679 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.679 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.679 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:04.679 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.679 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.679 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.680 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.680 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.680 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.680 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.680 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:30:04.681 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:30:04.681 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.681 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:30:04.681 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix", 2020-07-16T13:30:04.681 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2020-07-16T13:30:04.681 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2020-07-16T13:30:04.682 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2020-07-16T13:30:04.682 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "discovery_interval": { 2020-07-16T13:30:04.682 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "discovery_interval", 2020-07-16T13:30:04.682 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.682 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.683 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.683 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "100", 2020-07-16T13:30:04.683 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.683 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.683 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.683 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.684 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.684 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.684 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.684 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.684 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "identifier": { 2020-07-16T13:30:04.685 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "identifier", 2020-07-16T13:30:04.685 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.685 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.685 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.685 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:04.686 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.686 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.686 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.686 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.686 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.686 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.687 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.687 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.687 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2020-07-16T13:30:04.687 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2020-07-16T13:30:04.687 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2020-07-16T13:30:04.688 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.688 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.688 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2020-07-16T13:30:04.688 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.688 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.688 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.689 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.689 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.689 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.689 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.689 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.690 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2020-07-16T13:30:04.690 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2020-07-16T13:30:04.690 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.690 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.690 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.690 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2020-07-16T13:30:04.691 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.691 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.691 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:30:04.691 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:30:04.691 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:30:04.691 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:30:04.692 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:30:04.692 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:30:04.692 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:30:04.692 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:30:04.692 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.693 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.693 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.693 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.693 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.693 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2020-07-16T13:30:04.693 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-07-16T13:30:04.694 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:04.694 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.694 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.694 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:04.694 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.695 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.695 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.695 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.695 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.695 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.695 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.696 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.696 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-07-16T13:30:04.696 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-07-16T13:30:04.696 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.696 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.697 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.697 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2020-07-16T13:30:04.697 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.697 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.697 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2020-07-16T13:30:04.698 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2020-07-16T13:30:04.698 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2020-07-16T13:30:04.698 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2020-07-16T13:30:04.698 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2020-07-16T13:30:04.698 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2020-07-16T13:30:04.698 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2020-07-16T13:30:04.699 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:30:04.699 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.699 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.699 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.699 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.700 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.700 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2020-07-16T13:30:04.700 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2020-07-16T13:30:04.700 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2020-07-16T13:30:04.700 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.700 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2020-07-16T13:30:04.701 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2020-07-16T13:30:04.701 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.701 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.701 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.701 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.702 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.702 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.702 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.702 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.702 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_host": { 2020-07-16T13:30:04.702 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_host", 2020-07-16T13:30:04.703 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.703 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.703 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.703 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2020-07-16T13:30:04.703 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.704 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.704 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.704 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.704 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.704 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.704 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.705 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.705 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_port": { 2020-07-16T13:30:04.705 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_port", 2020-07-16T13:30:04.705 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2020-07-16T13:30:04.705 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.706 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.706 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10051", 2020-07-16T13:30:04.706 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.706 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.706 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.706 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.707 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.707 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.707 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.707 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.707 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_sender": { 2020-07-16T13:30:04.708 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_sender", 2020-07-16T13:30:04.708 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2020-07-16T13:30:04.708 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2020-07-16T13:30:04.708 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2020-07-16T13:30:04.708 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "/usr/bin/zabbix_sender", 2020-07-16T13:30:04.708 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2020-07-16T13:30:04.709 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2020-07-16T13:30:04.709 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2020-07-16T13:30:04.709 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2020-07-16T13:30:04.709 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2020-07-16T13:30:04.709 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2020-07-16T13:30:04.710 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2020-07-16T13:30:04.710 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:30:04.710 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:30:04.710 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:30:04.710 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:30:04.710 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {}, 2020-07-16T13:30:04.711 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "always_on_modules": { 2020-07-16T13:30:04.711 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nautilus": [ 2020-07-16T13:30:04.711 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "balancer", 2020-07-16T13:30:04.711 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crash", 2020-07-16T13:30:04.711 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "devicehealth", 2020-07-16T13:30:04.712 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator_cli", 2020-07-16T13:30:04.712 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress", 2020-07-16T13:30:04.712 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_support", 2020-07-16T13:30:04.712 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status", 2020-07-16T13:30:04.712 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "volumes" 2020-07-16T13:30:04.712 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:30:04.713 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "octopus": [ 2020-07-16T13:30:04.713 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "balancer", 2020-07-16T13:30:04.713 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crash", 2020-07-16T13:30:04.713 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "devicehealth", 2020-07-16T13:30:04.713 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator", 2020-07-16T13:30:04.714 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_support", 2020-07-16T13:30:04.714 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pg_autoscaler", 2020-07-16T13:30:04.714 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress", 2020-07-16T13:30:04.714 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_support", 2020-07-16T13:30:04.714 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status", 2020-07-16T13:30:04.714 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "telemetry", 2020-07-16T13:30:04.715 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "volumes" 2020-07-16T13:30:04.715 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2020-07-16T13:30:04.715 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "last_failure_osd_epoch": 4, 2020-07-16T13:30:04.715 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_clients": [ 2020-07-16T13:30:04.715 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:30:04.716 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2020-07-16T13:30:04.716 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:30:04.716 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2020-07-16T13:30:04.716 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.132:0", 2020-07-16T13:30:04.716 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 3369903850 2020-07-16T13:30:04.716 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:30:04.717 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2020-07-16T13:30:04.717 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.717 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:30:04.717 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2020-07-16T13:30:04.717 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:30:04.718 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2020-07-16T13:30:04.718 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.132:0", 2020-07-16T13:30:04.718 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 3322785803 2020-07-16T13:30:04.718 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:30:04.718 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2020-07-16T13:30:04.718 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2020-07-16T13:30:04.719 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:30:04.719 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2020-07-16T13:30:04.719 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:30:04.719 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2020-07-16T13:30:04.719 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.132:0", 2020-07-16T13:30:04.720 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 33794564 2020-07-16T13:30:04.720 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:30:04.720 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2020-07-16T13:30:04.720 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:30:04.720 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2020-07-16T13:30:04.720 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:30:04.721 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:30:04.722 INFO:teuthology.orchestra.run.smithi132.stderr:INFO:cephadm:Waiting for the mgr to restart... 2020-07-16T13:30:04.722 INFO:teuthology.orchestra.run.smithi132.stderr:INFO:cephadm:Waiting for Mgr epoch 9... 2020-07-16T13:30:04.722 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi132', '-v', '/var/log/ceph/4c8ed362-c768-11ea-a06f-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmp4bxmt8sq:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmprctwzzoo:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'tell', 'mgr', 'mgr_status'] 2020-07-16T13:30:04.722 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi132 -v /var/log/ceph/4c8ed362-c768-11ea-a06f-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp4bxmt8sq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmprctwzzoo:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 tell mgr mgr_status 2020-07-16T13:30:04.723 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:03 smithi132 bash[23299]: audit 2020-07-16T13:30:03.385021+0000 mon.a (mon.0) 70 : audit [DBG] from='client.? 172.21.15.132:0/2351869550' entity='client.admin' cmd=[{"prefix": "mgr dump"}]: dispatch 2020-07-16T13:30:06.029 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:30:05 smithi132 bash[23536]: Warning: Permanently added 'smithi132,172.21.15.132' (ECDSA) to the list of known hosts. 2020-07-16T13:30:06.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:05 smithi132 bash[23299]: cluster 2020-07-16T13:30:05.628839+0000 mon.a (mon.0) 71 : cluster [INF] Active manager daemon y restarted 2020-07-16T13:30:06.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:05 smithi132 bash[23299]: cluster 2020-07-16T13:30:05.629403+0000 mon.a (mon.0) 72 : cluster [INF] Activating manager daemon y 2020-07-16T13:30:06.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:05 smithi132 bash[23299]: cluster 2020-07-16T13:30:05.633485+0000 mon.a (mon.0) 73 : cluster [DBG] osdmap e5: 0 total, 0 up, 0 in 2020-07-16T13:30:06.702 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2020-07-16T13:30:06.702 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mgrmap_epoch": 11, 2020-07-16T13:30:06.703 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "initialized": true 2020-07-16T13:30:06.703 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2020-07-16T13:30:07.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:06 smithi132 bash[23299]: cluster 2020-07-16T13:30:05.684500+0000 mon.a (mon.0) 74 : cluster [DBG] mgrmap e10: y(active, starting, since 0.0552052s) 2020-07-16T13:30:07.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:06 smithi132 bash[23299]: audit 2020-07-16T13:30:05.686785+0000 mon.a (mon.0) 75 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2020-07-16T13:30:07.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:06 smithi132 bash[23299]: audit 2020-07-16T13:30:05.687439+0000 mon.a (mon.0) 76 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2020-07-16T13:30:07.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:06 smithi132 bash[23299]: audit 2020-07-16T13:30:05.687576+0000 mon.a (mon.0) 77 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2020-07-16T13:30:07.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:06 smithi132 bash[23299]: audit 2020-07-16T13:30:05.687709+0000 mon.a (mon.0) 78 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2020-07-16T13:30:07.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:06 smithi132 bash[23299]: audit 2020-07-16T13:30:05.687970+0000 mon.a (mon.0) 79 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2020-07-16T13:30:07.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:06 smithi132 bash[23299]: audit 2020-07-16T13:30:05.689859+0000 mon.a (mon.0) 80 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi132"}]: dispatch 2020-07-16T13:30:07.031 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:06 smithi132 bash[23299]: audit 2020-07-16T13:30:05.690123+0000 mon.a (mon.0) 81 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2020-07-16T13:30:07.031 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:06 smithi132 bash[23299]: audit 2020-07-16T13:30:05.690328+0000 mon.a (mon.0) 82 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2020-07-16T13:30:07.031 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:06 smithi132 bash[23299]: audit 2020-07-16T13:30:05.690523+0000 mon.a (mon.0) 83 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2020-07-16T13:30:07.031 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:06 smithi132 bash[23299]: audit 2020-07-16T13:30:05.690728+0000 mon.a (mon.0) 84 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2020-07-16T13:30:07.031 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:06 smithi132 bash[23299]: audit 2020-07-16T13:30:05.690913+0000 mon.a (mon.0) 85 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2020-07-16T13:30:07.032 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:06 smithi132 bash[23299]: cluster 2020-07-16T13:30:05.692312+0000 mon.a (mon.0) 86 : cluster [INF] Manager daemon y is now available 2020-07-16T13:30:07.032 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:06 smithi132 bash[23299]: audit 2020-07-16T13:30:05.715133+0000 mon.a (mon.0) 87 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2020-07-16T13:30:07.032 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:06 smithi132 bash[23299]: audit 2020-07-16T13:30:06.230634+0000 mon.a (mon.0) 88 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2020-07-16T13:30:07.032 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:06 smithi132 bash[23299]: audit 2020-07-16T13:30:06.230949+0000 mon.a (mon.0) 89 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:30:07.254 INFO:teuthology.orchestra.run.smithi132.stderr:INFO:cephadm:Generating a dashboard self-signed certificate... 2020-07-16T13:30:07.255 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi132', '-v', '/var/log/ceph/4c8ed362-c768-11ea-a06f-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmp4bxmt8sq:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmprctwzzoo:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'dashboard', 'create-self-signed-cert'] 2020-07-16T13:30:07.255 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi132 -v /var/log/ceph/4c8ed362-c768-11ea-a06f-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp4bxmt8sq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmprctwzzoo:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 dashboard create-self-signed-cert 2020-07-16T13:30:07.967 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:07 smithi132 bash[23299]: cluster 2020-07-16T13:30:06.692314+0000 mon.a (mon.0) 90 : cluster [DBG] mgrmap e11: y(active, since 1.06302s) 2020-07-16T13:30:07.968 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:07 smithi132 bash[23299]: audit 2020-07-16T13:30:07.270400+0000 mon.a (mon.0) 91 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:30:07.269793\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:30:07.269889\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2020-07-16T13:30:07.269974\", \"networks\": {}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:30:07.968 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:07 smithi132 bash[23299]: audit 2020-07-16T13:30:07.272238+0000 mon.a (mon.0) 92 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:30:07.269793\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:30:07.269889\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2020-07-16T13:30:07.269974\", \"networks\": {}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:30:07.968 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:07 smithi132 bash[23299]: audit 2020-07-16T13:30:07.272727+0000 mon.a (mon.0) 93 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:30:08.119 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout Self-signed certificate created 2020-07-16T13:30:08.833 INFO:teuthology.orchestra.run.smithi132.stderr:INFO:cephadm:Creating initial admin user... 2020-07-16T13:30:08.833 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi132', '-v', '/var/log/ceph/4c8ed362-c768-11ea-a06f-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmp4bxmt8sq:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmprctwzzoo:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'dashboard', 'ac-user-create', 'admin', 'pa1ms678bm', 'administrator', '--force-password', '--pwd-update-required'] 2020-07-16T13:30:08.833 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi132 -v /var/log/ceph/4c8ed362-c768-11ea-a06f-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp4bxmt8sq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmprctwzzoo:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 dashboard ac-user-create admin pa1ms678bm administrator --force-password --pwd-update-required 2020-07-16T13:30:08.984 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:08 smithi132 bash[23299]: audit 2020-07-16T13:30:08.110830+0000 mon.a (mon.0) 94 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/dashboard/crt","val":"-----BEGIN CERTIFICATE-----\nMIIC0DCCAbgCEQDx5rKAs6xJ2qBGgX7bO4kwMA0GCSqGSIb3DQEBDQUAMCYxCzAJ\nBgNVBAoMAklUMRcwFQYDVQQDDA5jZXBoLWRhc2hib2FyZDAeFw0yMDA3MTYxMzMw\nMDhaFw0zMDA3MTQxMzMwMDhaMCYxCzAJBgNVBAoMAklUMRcwFQYDVQQDDA5jZXBo\nLWRhc2hib2FyZDCCASIwDQYJKoZIhvcNAQEBBQADggEPADCCAQoCggEBAO+qZPiW\nNy6ztAjDn8cTUSxC5VAVs0VdyfTZ912XvEZ8PWdZsoHBXWqR5Ns0Mogycrv4o6cL\nZqeT7YV/GXsbmxi1u/ZpLTNU4OEOJq+lHt4YQeePycEAGXZwd798oCuVNWPFuNRu\n4KjnR/jE/+CRniFlNB212/KAwU3zaufQHiSJhkAzEObVGTASXmGibfysoo/uDJbq\nmCIbICTQfBuMSyxtOD8SWYeYOlYl018Ln6+hq31cVaf4eb4FNZdQnY85Z/LZPu4B\n62+gIwfE7+hCfWv5vDSHWbW8Abwj2CJ6UXg7EH0q/abqitnYwoHvM2mXQzahyQRw\n6U7xCTVb65MfTasCAwEAATANBgkqhkiG9w0BAQ0FAAOCAQEAQoyxuZJmT35OxWiR\n7gJ0+8XIEo+PG3yPCluSekQm2CfQg7WO0dZ7SZ4SIn92475KfpAib7VTJYGCprMX\noD52bVyRkiSW3FdfgV2IFL7DgEcI1nrGGqiwpE2NnlO3odiEIuf4xVpAYn1/XGeJ\nRZa+5Dw1mQedii93NqOA4nO+4EPueec6khLSFhQ/ZNLjctXB8TnYmjbmAF9i0qF6\njSkost2LzZC0ZF96CDrBq63nGinf3jTng5Ubkxa75Vd84BUppBywVkQpD2fHiIy7\nILcFGeXEQFkpE8nboLkQvyM26S/JKmiTRM6UKDg4LD70kxQMtvqpi7Dbq25A71hn\nu3ga4A==\n-----END CERTIFICATE-----\n"}]: dispatch 2020-07-16T13:30:08.985 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:08 smithi132 bash[23299]: audit 2020-07-16T13:30:08.112557+0000 mon.a (mon.0) 95 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/dashboard/crt","val":"-----BEGIN CERTIFICATE-----\nMIIC0DCCAbgCEQDx5rKAs6xJ2qBGgX7bO4kwMA0GCSqGSIb3DQEBDQUAMCYxCzAJ\nBgNVBAoMAklUMRcwFQYDVQQDDA5jZXBoLWRhc2hib2FyZDAeFw0yMDA3MTYxMzMw\nMDhaFw0zMDA3MTQxMzMwMDhaMCYxCzAJBgNVBAoMAklUMRcwFQYDVQQDDA5jZXBo\nLWRhc2hib2FyZDCCASIwDQYJKoZIhvcNAQEBBQADggEPADCCAQoCggEBAO+qZPiW\nNy6ztAjDn8cTUSxC5VAVs0VdyfTZ912XvEZ8PWdZsoHBXWqR5Ns0Mogycrv4o6cL\nZqeT7YV/GXsbmxi1u/ZpLTNU4OEOJq+lHt4YQeePycEAGXZwd798oCuVNWPFuNRu\n4KjnR/jE/+CRniFlNB212/KAwU3zaufQHiSJhkAzEObVGTASXmGibfysoo/uDJbq\nmCIbICTQfBuMSyxtOD8SWYeYOlYl018Ln6+hq31cVaf4eb4FNZdQnY85Z/LZPu4B\n62+gIwfE7+hCfWv5vDSHWbW8Abwj2CJ6UXg7EH0q/abqitnYwoHvM2mXQzahyQRw\n6U7xCTVb65MfTasCAwEAATANBgkqhkiG9w0BAQ0FAAOCAQEAQoyxuZJmT35OxWiR\n7gJ0+8XIEo+PG3yPCluSekQm2CfQg7WO0dZ7SZ4SIn92475KfpAib7VTJYGCprMX\noD52bVyRkiSW3FdfgV2IFL7DgEcI1nrGGqiwpE2NnlO3odiEIuf4xVpAYn1/XGeJ\nRZa+5Dw1mQedii93NqOA4nO+4EPueec6khLSFhQ/ZNLjctXB8TnYmjbmAF9i0qF6\njSkost2LzZC0ZF96CDrBq63nGinf3jTng5Ubkxa75Vd84BUppBywVkQpD2fHiIy7\nILcFGeXEQFkpE8nboLkQvyM26S/JKmiTRM6UKDg4LD70kxQMtvqpi7Dbq25A71hn\nu3ga4A==\n-----END CERTIFICATE-----\n"}]': finished 2020-07-16T13:30:08.985 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:08 smithi132 bash[23299]: audit 2020-07-16T13:30:08.112881+0000 mon.a (mon.0) 96 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/dashboard/key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvAIBADANBgkqhkiG9w0BAQEFAASCBKYwggSiAgEAAoIBAQDvqmT4ljcus7QI\nw5/HE1EsQuVQFbNFXcn02fddl7xGfD1nWbKBwV1qkeTbNDKIMnK7+KOnC2ank+2F\nfxl7G5sYtbv2aS0zVODhDiavpR7eGEHnj8nBABl2cHe/fKArlTVjxbjUbuCo50f4\nxP/gkZ4hZTQdtdvygMFN82rn0B4kiYZAMxDm1RkwEl5hom38rKKP7gyW6pgiGyAk\n0HwbjEssbTg/ElmHmDpWJdNfC5+voat9XFWn+Hm+BTWXUJ2POWfy2T7uAetvoCMH\nxO/oQn1r+bw0h1m1vAG8I9gielF4OxB9Kv2m6orZ2MKB7zNpl0M2ockEcOlO8Qk1\nW+uTH02rAgMBAAECggEAFMsd04uE4iJpPlFqrWT5p/Nt3dLkKOKIQRwgIBioFx10\nXmEj4aobJsHdrz8KG1L1LWXXHQkaMPPeqbRrS4kLncs2sZxSdZ+pmx0VMiwLT42f\nOi35fSs7ClGbshtn8iAR78QZ0ySDjWPzlJvS73Ly20bijKlYmeOd4dt6rP4bf2Pc\nKz2DOHy1Ox2rBI49LCxeKmmXSAKCmXQvUj8LkjxWWKgGgBIU9BysGZq2rG0PXB6C\naCL6iW2O2xIrIPHrzV23pKzog0mLfkkTAWBm4JnE9nqQwL8W6P9LOZPegCtQsoQ2\nYd20qWLEguW2VEvInFmPgNlq+oVqZbb7UEfGC5ueEQKBgQD72Iyn3w38AdeD8fPp\n7oOxTDbC6NAQChHZMyTax84W97r/3l1FImY9zwC1KianrJot+A+YCgnMVKluAaBA\nyIl+Z+i2h+WBqrX0l4pciqObmm/IfCN1BZ3tbZPNZwO2Eej0My3wuj7byr9PhNgN\nLER1/xrOXPaolk0ie9XwWiutdQKBgQDznmmEw7TY7xE/AdwATMMs7gDedB+jBOlG\np4vaLahi/CF29IlFdiQFEd5rah+ZI/3r+kv9cOe7KQUOfZl1B8/VQ8dUEtDrcVOo\nKPB04pbMMkTr6tKqPo+G5VcKGajQQ5y3y2FWcVVstdqhz+HkOuJuYVtnnL6OYTva\nJso4qVgKnwKBgHO9zs6rpTqnAgvim21sL1vBIf2rj0t/xToj1hEx+FX33hoPcKAA\nMiq/wpx/1aoDmgv8T/ZYzq34TrF+z85WG1JboMiaZfCUqvDQ4EatdIljjXH/EzCJ\nt03RqTah3EPFsWDhUICsp4zNfeSmscBEEuaDqici9D0AbkylyumeFyqtAoGAIn0k\ntxT1v1ho+qCKwsgbQXsYSGXsLKn/VG9XzzVzhz/mhO6tmFXXV5hmApLtkkKUKhov\nM9wOEmMGQjzpwrWuaKTFzVM0nIBYtY/GKuYBLztWooeF93AP5asGHXnwejt4LlTu\nnMxCqbc9EndZpXPopnPF+u8n0wRU8tdW/ZqLykUCgYAY020y95MouJRL1ngYunl3\ngfklEpwmhondwtmQD2tqp9JDY5cCT3DGHXChBKHoLImujwXBlOwTOpNJGfmAuAgr\nqY6WMjqTp+lLesrGAxU2vTMFppDNGs3F003fg0VJROoNq1Y7AnGBwqMGyWVLhV+t\nklXXBjhbyxnBa8mvQXVtDw==\n-----END PRIVATE KEY-----\n"}]: dispatch 2020-07-16T13:30:08.985 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:08 smithi132 bash[23299]: audit 2020-07-16T13:30:08.114164+0000 mon.a (mon.0) 97 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/dashboard/key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvAIBADANBgkqhkiG9w0BAQEFAASCBKYwggSiAgEAAoIBAQDvqmT4ljcus7QI\nw5/HE1EsQuVQFbNFXcn02fddl7xGfD1nWbKBwV1qkeTbNDKIMnK7+KOnC2ank+2F\nfxl7G5sYtbv2aS0zVODhDiavpR7eGEHnj8nBABl2cHe/fKArlTVjxbjUbuCo50f4\nxP/gkZ4hZTQdtdvygMFN82rn0B4kiYZAMxDm1RkwEl5hom38rKKP7gyW6pgiGyAk\n0HwbjEssbTg/ElmHmDpWJdNfC5+voat9XFWn+Hm+BTWXUJ2POWfy2T7uAetvoCMH\nxO/oQn1r+bw0h1m1vAG8I9gielF4OxB9Kv2m6orZ2MKB7zNpl0M2ockEcOlO8Qk1\nW+uTH02rAgMBAAECggEAFMsd04uE4iJpPlFqrWT5p/Nt3dLkKOKIQRwgIBioFx10\nXmEj4aobJsHdrz8KG1L1LWXXHQkaMPPeqbRrS4kLncs2sZxSdZ+pmx0VMiwLT42f\nOi35fSs7ClGbshtn8iAR78QZ0ySDjWPzlJvS73Ly20bijKlYmeOd4dt6rP4bf2Pc\nKz2DOHy1Ox2rBI49LCxeKmmXSAKCmXQvUj8LkjxWWKgGgBIU9BysGZq2rG0PXB6C\naCL6iW2O2xIrIPHrzV23pKzog0mLfkkTAWBm4JnE9nqQwL8W6P9LOZPegCtQsoQ2\nYd20qWLEguW2VEvInFmPgNlq+oVqZbb7UEfGC5ueEQKBgQD72Iyn3w38AdeD8fPp\n7oOxTDbC6NAQChHZMyTax84W97r/3l1FImY9zwC1KianrJot+A+YCgnMVKluAaBA\nyIl+Z+i2h+WBqrX0l4pciqObmm/IfCN1BZ3tbZPNZwO2Eej0My3wuj7byr9PhNgN\nLER1/xrOXPaolk0ie9XwWiutdQKBgQDznmmEw7TY7xE/AdwATMMs7gDedB+jBOlG\np4vaLahi/CF29IlFdiQFEd5rah+ZI/3r+kv9cOe7KQUOfZl1B8/VQ8dUEtDrcVOo\nKPB04pbMMkTr6tKqPo+G5VcKGajQQ5y3y2FWcVVstdqhz+HkOuJuYVtnnL6OYTva\nJso4qVgKnwKBgHO9zs6rpTqnAgvim21sL1vBIf2rj0t/xToj1hEx+FX33hoPcKAA\nMiq/wpx/1aoDmgv8T/ZYzq34TrF+z85WG1JboMiaZfCUqvDQ4EatdIljjXH/EzCJ\nt03RqTah3EPFsWDhUICsp4zNfeSmscBEEuaDqici9D0AbkylyumeFyqtAoGAIn0k\ntxT1v1ho+qCKwsgbQXsYSGXsLKn/VG9XzzVzhz/mhO6tmFXXV5hmApLtkkKUKhov\nM9wOEmMGQjzpwrWuaKTFzVM0nIBYtY/GKuYBLztWooeF93AP5asGHXnwejt4LlTu\nnMxCqbc9EndZpXPopnPF+u8n0wRU8tdW/ZqLykUCgYAY020y95MouJRL1ngYunl3\ngfklEpwmhondwtmQD2tqp9JDY5cCT3DGHXChBKHoLImujwXBlOwTOpNJGfmAuAgr\nqY6WMjqTp+lLesrGAxU2vTMFppDNGs3F003fg0VJROoNq1Y7AnGBwqMGyWVLhV+t\nklXXBjhbyxnBa8mvQXVtDw==\n-----END PRIVATE KEY-----\n"}]': finished 2020-07-16T13:30:08.985 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:08 smithi132 bash[23299]: cluster 2020-07-16T13:30:08.273869+0000 mon.a (mon.0) 98 : cluster [DBG] mgrmap e12: y(active, since 2s) 2020-07-16T13:30:09.866 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:09 smithi132 bash[23299]: audit 2020-07-16T13:30:07.998658+0000 mgr.y (mgr.14140) 1 : audit [DBG] from='client.14153 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:30:10.071 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout {"username": "admin", "password": "$2b$12$JRQdWph.8ilth77eLQd.xuOIEyht2kZ23fqdBE4wdQk.FgajQqXxK", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1594906210, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2020-07-16T13:30:10.749 INFO:teuthology.orchestra.run.smithi132.stderr:INFO:cephadm:Fetching dashboard port number... 2020-07-16T13:30:10.750 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi132', '-v', '/var/log/ceph/4c8ed362-c768-11ea-a06f-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmp4bxmt8sq:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmprctwzzoo:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'config', 'get', 'mgr', 'mgr/dashboard/ssl_server_port'] 2020-07-16T13:30:10.750 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi132 -v /var/log/ceph/4c8ed362-c768-11ea-a06f-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp4bxmt8sq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmprctwzzoo:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 config get mgr mgr/dashboard/ssl_server_port 2020-07-16T13:30:10.966 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:10 smithi132 bash[23299]: audit 2020-07-16T13:30:09.845161+0000 mgr.y (mgr.14140) 2 : audit [DBG] from='client.14155 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "password": "pa1ms678bm", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:30:10.967 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:10 smithi132 bash[23299]: audit 2020-07-16T13:30:10.068478+0000 mon.a (mon.0) 99 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/dashboard/accessdb_v2","val":"{\"users\": {\"admin\": {\"username\": \"admin\", \"password\": \"$2b$12$JRQdWph.8ilth77eLQd.xuOIEyht2kZ23fqdBE4wdQk.FgajQqXxK\", \"roles\": [\"administrator\"], \"name\": null, \"email\": null, \"lastUpdate\": 1594906210, \"enabled\": true, \"pwdExpirationDate\": null, \"pwdUpdateRequired\": true}}, \"roles\": {}, \"version\": 2}"}]: dispatch 2020-07-16T13:30:10.967 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:10 smithi132 bash[23299]: audit 2020-07-16T13:30:10.070168+0000 mon.a (mon.0) 100 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/dashboard/accessdb_v2","val":"{\"users\": {\"admin\": {\"username\": \"admin\", \"password\": \"$2b$12$JRQdWph.8ilth77eLQd.xuOIEyht2kZ23fqdBE4wdQk.FgajQqXxK\", \"roles\": [\"administrator\"], \"name\": null, \"email\": null, \"lastUpdate\": 1594906210, \"enabled\": true, \"pwdExpirationDate\": null, \"pwdUpdateRequired\": true}}, \"roles\": {}, \"version\": 2}"}]': finished 2020-07-16T13:30:10.967 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:10 smithi132 bash[23299]: audit 2020-07-16T13:30:10.442492+0000 mon.a (mon.0) 101 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:30:10.967 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:10 smithi132 bash[23299]: audit 2020-07-16T13:30:10.632135+0000 mon.a (mon.0) 102 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:30:07.269793\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:30:07.269889\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2020-07-16T13:30:07.269974\", \"last_device_update\": \"2020-07-16T13:30:10.631612\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:30:10.968 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:10 smithi132 bash[23299]: audit 2020-07-16T13:30:10.633897+0000 mon.a (mon.0) 103 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:30:07.269793\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:30:07.269889\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2020-07-16T13:30:07.269974\", \"last_device_update\": \"2020-07-16T13:30:10.631612\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:30:11.461 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 8443 2020-07-16T13:30:11.779 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:11 smithi132 bash[23299]: audit 2020-07-16T13:30:11.460315+0000 mon.a (mon.0) 104 : audit [DBG] from='client.? 172.21.15.132:0/2391084720' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2020-07-16T13:30:12.024 INFO:teuthology.orchestra.run.smithi132.stderr:INFO:cephadm:Ceph Dashboard is now available at: 2020-07-16T13:30:12.024 INFO:teuthology.orchestra.run.smithi132.stderr: 2020-07-16T13:30:12.024 INFO:teuthology.orchestra.run.smithi132.stderr: URL: https://smithi132:8443/ 2020-07-16T13:30:12.024 INFO:teuthology.orchestra.run.smithi132.stderr: User: admin 2020-07-16T13:30:12.025 INFO:teuthology.orchestra.run.smithi132.stderr: Password: pa1ms678bm 2020-07-16T13:30:12.025 INFO:teuthology.orchestra.run.smithi132.stderr: 2020-07-16T13:30:12.025 INFO:teuthology.orchestra.run.smithi132.stderr:INFO:cephadm:You can access the Ceph CLI with: 2020-07-16T13:30:12.025 INFO:teuthology.orchestra.run.smithi132.stderr: 2020-07-16T13:30:12.025 INFO:teuthology.orchestra.run.smithi132.stderr: sudo /home/ubuntu/cephtest/cephadm shell --fsid 4c8ed362-c768-11ea-a06f-001a4aab830c -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2020-07-16T13:30:12.026 INFO:teuthology.orchestra.run.smithi132.stderr: 2020-07-16T13:30:12.026 INFO:teuthology.orchestra.run.smithi132.stderr:INFO:cephadm:Please consider enabling telemetry to help improve Ceph: 2020-07-16T13:30:12.026 INFO:teuthology.orchestra.run.smithi132.stderr: 2020-07-16T13:30:12.026 INFO:teuthology.orchestra.run.smithi132.stderr: ceph telemetry on 2020-07-16T13:30:12.026 INFO:teuthology.orchestra.run.smithi132.stderr: 2020-07-16T13:30:12.027 INFO:teuthology.orchestra.run.smithi132.stderr:For more information see: 2020-07-16T13:30:12.027 INFO:teuthology.orchestra.run.smithi132.stderr: 2020-07-16T13:30:12.027 INFO:teuthology.orchestra.run.smithi132.stderr: https://docs.ceph.com/docs/master/mgr/telemetry/ 2020-07-16T13:30:12.027 INFO:teuthology.orchestra.run.smithi132.stderr: 2020-07-16T13:30:12.027 INFO:teuthology.orchestra.run.smithi132.stderr:INFO:cephadm:Bootstrap complete. 2020-07-16T13:30:12.027 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:Releasing lock 140405967361080 on /run/cephadm/4c8ed362-c768-11ea-a06f-001a4aab830c.lock 2020-07-16T13:30:12.028 INFO:teuthology.orchestra.run.smithi132.stderr:DEBUG:cephadm:Lock 140405967361080 released on /run/cephadm/4c8ed362-c768-11ea-a06f-001a4aab830c.lock 2020-07-16T13:30:12.054 INFO:tasks.cephadm:Fetching config... 2020-07-16T13:30:12.072 DEBUG:teuthology.orchestra.remote:smithi132:/etc/ceph/ceph.conf is 177B 2020-07-16T13:30:12.125 INFO:tasks.cephadm:Fetching client.admin keyring... 2020-07-16T13:30:12.170 DEBUG:teuthology.orchestra.remote:smithi132:/etc/ceph/ceph.client.admin.keyring is 63B 2020-07-16T13:30:12.219 INFO:tasks.cephadm:Fetching mon keyring... 2020-07-16T13:30:12.220 INFO:teuthology.orchestra.run.smithi132:> mktemp 2020-07-16T13:30:12.233 INFO:teuthology.orchestra.run.smithi132.stdout:/tmp/tmp.b3qHsWkasB 2020-07-16T13:30:12.234 INFO:teuthology.orchestra.run.smithi132:> sudo cp /var/lib/ceph/4c8ed362-c768-11ea-a06f-001a4aab830c/mon.a/keyring /tmp/tmp.b3qHsWkasB 2020-07-16T13:30:12.300 INFO:teuthology.orchestra.run.smithi132:> sudo chmod 0666 /tmp/tmp.b3qHsWkasB 2020-07-16T13:30:12.433 DEBUG:teuthology.orchestra.remote:smithi132:/tmp/tmp.b3qHsWkasB is 77B 2020-07-16T13:30:12.485 INFO:teuthology.orchestra.run.smithi132:> rm -fr /tmp/tmp.b3qHsWkasB 2020-07-16T13:30:12.500 INFO:tasks.cephadm:Fetching pub ssh key... 2020-07-16T13:30:12.561 DEBUG:teuthology.orchestra.remote:smithi132:/home/ubuntu/cephtest/ceph.pub is 595B 2020-07-16T13:30:12.609 INFO:tasks.cephadm:Installing pub ssh key for root users... 2020-07-16T13:30:12.610 INFO:teuthology.orchestra.run.smithi132:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4r0/6Ta9O0mr+qAFaealOC7xhtTdophd2u53NyW4ej98GZ0Aw7wvo7qtSu5nbxd/jCXfiWEXsJA5v1oONH+lY0L+Wq2CualnHo8c9t9IuWGBLfw7vBhWZahuNM8KKgvqTN8mgtKZw+/tBBj49Z04GfKUXSEROHFs6FjSXzDtBhFcaZznUTZUeKTPCByWSUrWmIoyvkTmqeRft1y/+vyEW/lHCZYCskFGtEnruiq56aS7Qe4X8IhavAhN1Xg/UKFJrzW+9CFLhBDPGROyAIW4kgpf+n9axV+QZuex0y55uJNMfDzR2/Yhr2fQCHHcMpHzcV4eL1+Iag2xZobKKJ2AqvZ2dF6dLHIL1RMxmYse4DAlLJRHYAYhBYxOUFdFZzRDonGV14fwwIUFrtz7gvfI5UKUp2x8cubq/K9WtfEQviTVrE8ITq+R7FHNVaLgmkMYV6GR9nGhtlr7wy4O09DQzLvylzfFt809s6Pjb8JYLeiKCJX0hPuwf8GdzplMbQQ8= ceph-4c8ed362-c768-11ea-a06f-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2020-07-16T13:30:12.649 INFO:teuthology.orchestra.run.smithi132.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4r0/6Ta9O0mr+qAFaealOC7xhtTdophd2u53NyW4ej98GZ0Aw7wvo7qtSu5nbxd/jCXfiWEXsJA5v1oONH+lY0L+Wq2CualnHo8c9t9IuWGBLfw7vBhWZahuNM8KKgvqTN8mgtKZw+/tBBj49Z04GfKUXSEROHFs6FjSXzDtBhFcaZznUTZUeKTPCByWSUrWmIoyvkTmqeRft1y/+vyEW/lHCZYCskFGtEnruiq56aS7Qe4X8IhavAhN1Xg/UKFJrzW+9CFLhBDPGROyAIW4kgpf+n9axV+QZuex0y55uJNMfDzR2/Yhr2fQCHHcMpHzcV4eL1+Iag2xZobKKJ2AqvZ2dF6dLHIL1RMxmYse4DAlLJRHYAYhBYxOUFdFZzRDonGV14fwwIUFrtz7gvfI5UKUp2x8cubq/K9WtfEQviTVrE8ITq+R7FHNVaLgmkMYV6GR9nGhtlr7wy4O09DQzLvylzfFt809s6Pjb8JYLeiKCJX0hPuwf8GdzplMbQQ8= ceph-4c8ed362-c768-11ea-a06f-001a4aab830c 2020-07-16T13:30:12.663 INFO:teuthology.orchestra.run.smithi188:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4r0/6Ta9O0mr+qAFaealOC7xhtTdophd2u53NyW4ej98GZ0Aw7wvo7qtSu5nbxd/jCXfiWEXsJA5v1oONH+lY0L+Wq2CualnHo8c9t9IuWGBLfw7vBhWZahuNM8KKgvqTN8mgtKZw+/tBBj49Z04GfKUXSEROHFs6FjSXzDtBhFcaZznUTZUeKTPCByWSUrWmIoyvkTmqeRft1y/+vyEW/lHCZYCskFGtEnruiq56aS7Qe4X8IhavAhN1Xg/UKFJrzW+9CFLhBDPGROyAIW4kgpf+n9axV+QZuex0y55uJNMfDzR2/Yhr2fQCHHcMpHzcV4eL1+Iag2xZobKKJ2AqvZ2dF6dLHIL1RMxmYse4DAlLJRHYAYhBYxOUFdFZzRDonGV14fwwIUFrtz7gvfI5UKUp2x8cubq/K9WtfEQviTVrE8ITq+R7FHNVaLgmkMYV6GR9nGhtlr7wy4O09DQzLvylzfFt809s6Pjb8JYLeiKCJX0hPuwf8GdzplMbQQ8= ceph-4c8ed362-c768-11ea-a06f-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2020-07-16T13:30:12.714 INFO:teuthology.orchestra.run.smithi188.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4r0/6Ta9O0mr+qAFaealOC7xhtTdophd2u53NyW4ej98GZ0Aw7wvo7qtSu5nbxd/jCXfiWEXsJA5v1oONH+lY0L+Wq2CualnHo8c9t9IuWGBLfw7vBhWZahuNM8KKgvqTN8mgtKZw+/tBBj49Z04GfKUXSEROHFs6FjSXzDtBhFcaZznUTZUeKTPCByWSUrWmIoyvkTmqeRft1y/+vyEW/lHCZYCskFGtEnruiq56aS7Qe4X8IhavAhN1Xg/UKFJrzW+9CFLhBDPGROyAIW4kgpf+n9axV+QZuex0y55uJNMfDzR2/Yhr2fQCHHcMpHzcV4eL1+Iag2xZobKKJ2AqvZ2dF6dLHIL1RMxmYse4DAlLJRHYAYhBYxOUFdFZzRDonGV14fwwIUFrtz7gvfI5UKUp2x8cubq/K9WtfEQviTVrE8ITq+R7FHNVaLgmkMYV6GR9nGhtlr7wy4O09DQzLvylzfFt809s6Pjb8JYLeiKCJX0hPuwf8GdzplMbQQ8= ceph-4c8ed362-c768-11ea-a06f-001a4aab830c 2020-07-16T13:30:12.730 INFO:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4c8ed362-c768-11ea-a06f-001a4aab830c -- ceph config set mgr mgr/cephadm/allow_ptrace true 2020-07-16T13:30:13.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:12 smithi132 bash[23299]: cluster 2020-07-16T13:30:11.701421+0000 mon.a (mon.0) 105 : cluster [DBG] mgrmap e13: y(active, since 6s) 2020-07-16T13:30:15.012 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:14 smithi132 bash[23299]: audit 2020-07-16T13:30:14.511118+0000 mon.a (mon.0) 106 : audit [INF] from='client.? 172.21.15.132:0/2492392565' entity='client.admin' cmd=[{"prefix": "config set", "who": "mgr", "name": "mgr/cephadm/allow_ptrace", "value": "true"}]: dispatch 2020-07-16T13:30:15.013 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:14 smithi132 bash[23299]: audit 2020-07-16T13:30:14.513655+0000 mon.a (mon.0) 107 : audit [INF] from='client.? 172.21.15.132:0/2492392565' entity='client.admin' cmd='[{"prefix": "config set", "who": "mgr", "name": "mgr/cephadm/allow_ptrace", "value": "true"}]': finished 2020-07-16T13:30:15.026 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi188 2020-07-16T13:30:15.027 INFO:teuthology.orchestra.run.smithi188:> cat > /etc/ceph/ceph.conf 2020-07-16T13:30:15.071 INFO:teuthology.orchestra.run.smithi188:> cat > /etc/ceph/ceph.client.admin.keyring 2020-07-16T13:30:15.156 INFO:tasks.cephadm:Adding host smithi188 to orchestrator... 2020-07-16T13:30:15.157 INFO:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4c8ed362-c768-11ea-a06f-001a4aab830c -- ceph orch host add smithi188 2020-07-16T13:30:27.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:26 smithi132 bash[23299]: cluster 2020-07-16T13:30:25.688902+0000 mgr.y (mgr.14140) 3 : cluster [DBG] pgmap v3: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:30:29.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:28 smithi132 bash[23299]: cluster 2020-07-16T13:30:27.689322+0000 mgr.y (mgr.14140) 4 : cluster [DBG] pgmap v4: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:30:31.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:30 smithi132 bash[23299]: cluster 2020-07-16T13:30:29.689626+0000 mgr.y (mgr.14140) 5 : cluster [DBG] pgmap v5: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:30:33.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:32 smithi132 bash[23299]: cluster 2020-07-16T13:30:31.689992+0000 mgr.y (mgr.14140) 6 : cluster [DBG] pgmap v6: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:30:35.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:34 smithi132 bash[23299]: cluster 2020-07-16T13:30:33.690296+0000 mgr.y (mgr.14140) 7 : cluster [DBG] pgmap v7: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:30:37.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:36 smithi132 bash[23299]: cluster 2020-07-16T13:30:35.690527+0000 mgr.y (mgr.14140) 8 : cluster [DBG] pgmap v8: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:30:39.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:38 smithi132 bash[23299]: cluster 2020-07-16T13:30:37.690884+0000 mgr.y (mgr.14140) 9 : cluster [DBG] pgmap v9: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:30:41.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:40 smithi132 bash[23299]: cluster 2020-07-16T13:30:39.691262+0000 mgr.y (mgr.14140) 10 : cluster [DBG] pgmap v10: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:30:43.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:42 smithi132 bash[23299]: cluster 2020-07-16T13:30:41.691530+0000 mgr.y (mgr.14140) 11 : cluster [DBG] pgmap v11: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:30:45.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:44 smithi132 bash[23299]: cluster 2020-07-16T13:30:43.691772+0000 mgr.y (mgr.14140) 12 : cluster [DBG] pgmap v12: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:30:46.750 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:30:46 smithi132 bash[23536]: Warning: Permanently added 'smithi188,172.21.15.188' (ECDSA) to the list of known hosts. 2020-07-16T13:30:47.031 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:46 smithi132 bash[23299]: cluster 2020-07-16T13:30:45.692122+0000 mgr.y (mgr.14140) 13 : cluster [DBG] pgmap v13: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:30:47.284 INFO:teuthology.orchestra.run.smithi188.stdout:Added host 'smithi188' 2020-07-16T13:30:47.929 INFO:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4c8ed362-c768-11ea-a06f-001a4aab830c -- ceph orch host ls --format=json 2020-07-16T13:30:48.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:47 smithi132 bash[23299]: audit 2020-07-16T13:30:46.278386+0000 mgr.y (mgr.14140) 14 : audit [DBG] from='client.14161 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi188", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:30:48.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:47 smithi132 bash[23299]: audit 2020-07-16T13:30:46.783478+0000 mon.a (mon.0) 108 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi132\": {\"hostname\": \"smithi132\", \"addr\": \"smithi132\", \"labels\": [], \"status\": \"\"}, \"smithi188\": {\"hostname\": \"smithi188\", \"addr\": \"smithi188\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2020-07-16T13:30:48.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:47 smithi132 bash[23299]: audit 2020-07-16T13:30:46.787483+0000 mon.a (mon.0) 109 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi132\": {\"hostname\": \"smithi132\", \"addr\": \"smithi132\", \"labels\": [], \"status\": \"\"}, \"smithi188\": {\"hostname\": \"smithi188\", \"addr\": \"smithi188\", \"labels\": [], \"status\": \"\"}}"}]': finished 2020-07-16T13:30:48.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:47 smithi132 bash[23299]: cephadm 2020-07-16T13:30:46.787884+0000 mgr.y (mgr.14140) 15 : cephadm [INF] Added host smithi188 2020-07-16T13:30:48.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:47 smithi132 bash[23299]: audit 2020-07-16T13:30:46.990133+0000 mon.a (mon.0) 110 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"networks\": {}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:30:48.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:47 smithi132 bash[23299]: audit 2020-07-16T13:30:46.994673+0000 mon.a (mon.0) 111 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"networks\": {}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:30:48.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:47 smithi132 bash[23299]: audit 2020-07-16T13:30:46.995267+0000 mon.a (mon.0) 112 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:30:48.031 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:47 smithi132 bash[23299]: audit 2020-07-16T13:30:47.172763+0000 mon.a (mon.0) 113 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2020-07-16T13:30:47.172431\", \"networks\": {}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:30:48.031 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:47 smithi132 bash[23299]: audit 2020-07-16T13:30:47.177226+0000 mon.a (mon.0) 114 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2020-07-16T13:30:47.172431\", \"networks\": {}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:30:48.031 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:47 smithi132 bash[23299]: audit 2020-07-16T13:30:47.177751+0000 mon.a (mon.0) 115 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:30:49.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:48 smithi132 bash[23299]: cluster 2020-07-16T13:30:47.692521+0000 mgr.y (mgr.14140) 16 : cluster [DBG] pgmap v14: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:30:50.363 INFO:teuthology.orchestra.run.smithi188.stdout: 2020-07-16T13:30:50.364 INFO:teuthology.orchestra.run.smithi188.stdout:[{"addr": "smithi132", "hostname": "smithi132", "labels": [], "status": ""}, {"addr": "smithi188", "hostname": "smithi188", "labels": [], "status": ""}] 2020-07-16T13:30:50.826 INFO:tasks.cephadm:Setting crush tunables to default 2020-07-16T13:30:50.827 INFO:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4c8ed362-c768-11ea-a06f-001a4aab830c -- ceph osd crush tunables default 2020-07-16T13:30:50.859 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:50 smithi132 bash[23299]: cluster 2020-07-16T13:30:49.692845+0000 mgr.y (mgr.14140) 17 : cluster [DBG] pgmap v15: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:30:52.013 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:51 smithi132 bash[23299]: audit 2020-07-16T13:30:50.361177+0000 mgr.y (mgr.14140) 18 : audit [DBG] from='client.14163 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2020-07-16T13:30:52.014 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:51 smithi132 bash[23299]: audit 2020-07-16T13:30:51.302368+0000 mon.a (mon.0) 116 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:30:52.014 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:51 smithi132 bash[23299]: audit 2020-07-16T13:30:51.484046+0000 mon.a (mon.0) 117 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2020-07-16T13:30:47.172431\", \"last_device_update\": \"2020-07-16T13:30:51.483581\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:30:52.014 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:51 smithi132 bash[23299]: audit 2020-07-16T13:30:51.485804+0000 mon.a (mon.0) 118 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2020-07-16T13:30:47.172431\", \"last_device_update\": \"2020-07-16T13:30:51.483581\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:30:53.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:52 smithi132 bash[23299]: cluster 2020-07-16T13:30:51.693146+0000 mgr.y (mgr.14140) 19 : cluster [DBG] pgmap v16: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:30:53.571 INFO:teuthology.orchestra.run.smithi132.stderr:adjusted tunables profile to default 2020-07-16T13:30:54.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:53 smithi132 bash[23299]: audit 2020-07-16T13:30:52.576207+0000 mon.a (mon.0) 119 : audit [INF] from='client.? 172.21.15.132:0/2201731242' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2020-07-16T13:30:54.070 INFO:tasks.cephadm:Adding mon.c on smithi132 2020-07-16T13:30:54.071 INFO:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4c8ed362-c768-11ea-a06f-001a4aab830c -- ceph orch daemon add mon 'smithi132:[v2:172.21.15.132:3301,v1:172.21.15.132:6790]=c' 2020-07-16T13:30:54.752 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:54 smithi132 bash[23299]: audit 2020-07-16T13:30:53.567194+0000 mon.a (mon.0) 120 : audit [INF] from='client.? 172.21.15.132:0/2201731242' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2020-07-16T13:30:54.753 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:54 smithi132 bash[23299]: cluster 2020-07-16T13:30:53.567247+0000 mon.a (mon.0) 121 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2020-07-16T13:30:54.753 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:54 smithi132 bash[23299]: cluster 2020-07-16T13:30:53.693462+0000 mgr.y (mgr.14140) 20 : cluster [DBG] pgmap v18: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:30:57.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:56 smithi132 bash[23299]: cluster 2020-07-16T13:30:55.693720+0000 mgr.y (mgr.14140) 21 : cluster [DBG] pgmap v19: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:30:57.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:56 smithi132 bash[23299]: audit 2020-07-16T13:30:55.872133+0000 mgr.y (mgr.14140) 22 : audit [DBG] from='client.14167 -' entity='client.admin' cmd=[{"prefix": "orch daemon add", "daemon_type": "mon", "placement": "smithi132:[v2:172.21.15.132:3301,v1:172.21.15.132:6790]=c", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:30:57.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:56 smithi132 bash[23299]: audit 2020-07-16T13:30:55.873642+0000 mon.a (mon.0) 122 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2020-07-16T13:30:57.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:56 smithi132 bash[23299]: audit 2020-07-16T13:30:55.874211+0000 mon.a (mon.0) 123 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:30:57.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:56 smithi132 bash[23299]: cephadm 2020-07-16T13:30:55.874629+0000 mgr.y (mgr.14140) 23 : cephadm [INF] Deploying daemon mon.c on smithi132 2020-07-16T13:30:57.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:56 smithi132 bash[23299]: audit 2020-07-16T13:30:55.874816+0000 mon.a (mon.0) 124 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.c", "key": "container_image"}]: dispatch 2020-07-16T13:30:58.879 INFO:teuthology.orchestra.run.smithi132.stdout:Deployed mon.c on host 'smithi132' 2020-07-16T13:30:59.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:58 smithi132 bash[23299]: cluster 2020-07-16T13:30:57.693986+0000 mgr.y (mgr.14140) 24 : cluster [DBG] pgmap v20: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:30:59.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:58 smithi132 bash[23299]: audit 2020-07-16T13:30:58.493468+0000 mon.a (mon.0) 125 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:30:07.269793\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:30:07.269889\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}}, \"last_device_update\": \"2020-07-16T13:30:10.631612\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:30:59.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:58 smithi132 bash[23299]: audit 2020-07-16T13:30:58.493862+0000 mon.a (mon.0) 126 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:30:59.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:30:58 smithi132 bash[23299]: audit 2020-07-16T13:30:58.495532+0000 mon.a (mon.0) 127 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:30:07.269793\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:30:07.269889\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}}, \"last_device_update\": \"2020-07-16T13:30:10.631612\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:30:59.601 INFO:teuthology.orchestra.run.smithi132:mon.c> sudo journalctl -f -n 0 -u ceph-4c8ed362-c768-11ea-a06f-001a4aab830c@mon.c.service 2020-07-16T13:30:59.604 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2020-07-16T13:30:59.605 INFO:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4c8ed362-c768-11ea-a06f-001a4aab830c -- ceph mon dump -f json 2020-07-16T13:30:59.640 INFO:journalctl@ceph.mon.c.smithi132.stdout:-- Logs begin at Thu 2020-07-16 13:22:27 UTC. -- 2020-07-16T13:31:04.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:03 smithi132 bash[23299]: cluster 2020-07-16T13:30:58.908296+0000 mon.a (mon.0) 128 : cluster [INF] mon.a calling monitor election 2020-07-16T13:31:04.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:03 smithi132 bash[23299]: cluster 2020-07-16T13:30:59.694252+0000 mgr.y (mgr.14140) 25 : cluster [DBG] pgmap v21: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:31:04.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:03 smithi132 bash[23299]: audit 2020-07-16T13:30:59.762449+0000 mon.a (mon.0) 129 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:30:59.761726\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:30:59.761808\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:30:59.761838\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}}, \"last_daemon_update\": \"2020-07-16T13:30:59.761913\", \"last_device_update\": \"2020-07-16T13:30:10.631612\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:31:04.282 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:03 smithi132 bash[23299]: cluster 2020-07-16T13:31:00.906675+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2020-07-16T13:31:04.282 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:03 smithi132 bash[23299]: cluster 2020-07-16T13:31:01.694694+0000 mgr.y (mgr.14140) 26 : cluster [DBG] pgmap v22: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:31:04.282 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:03 smithi132 bash[23299]: cluster 2020-07-16T13:31:03.694977+0000 mgr.y (mgr.14140) 27 : cluster [DBG] pgmap v23: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:31:04.283 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:03 smithi132 bash[23299]: cluster 2020-07-16T13:31:03.911222+0000 mon.a (mon.0) 130 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2020-07-16T13:31:04.283 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:03 smithi132 bash[23299]: cluster 2020-07-16T13:31:03.916455+0000 mon.a (mon.0) 131 : cluster [DBG] monmap e2: 2 mons at {a=[v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0],c=[v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0]} 2020-07-16T13:31:04.283 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:03 smithi132 bash[23299]: cluster 2020-07-16T13:31:03.916524+0000 mon.a (mon.0) 132 : cluster [DBG] fsmap 2020-07-16T13:31:04.284 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:03 smithi132 bash[23299]: cluster 2020-07-16T13:31:03.916555+0000 mon.a (mon.0) 133 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2020-07-16T13:31:04.284 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:03 smithi132 bash[23299]: cluster 2020-07-16T13:31:03.916778+0000 mon.a (mon.0) 134 : cluster [DBG] mgrmap e13: y(active, since 58s) 2020-07-16T13:31:04.284 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:03 smithi132 bash[23299]: audit 2020-07-16T13:31:03.918076+0000 mon.a (mon.0) 135 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:30:59.761726\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:30:59.761808\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:30:59.761838\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}}, \"last_daemon_update\": \"2020-07-16T13:30:59.761913\", \"last_device_update\": \"2020-07-16T13:30:10.631612\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:31:04.285 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:03 smithi132 bash[23299]: cluster 2020-07-16T13:31:03.924923+0000 mon.a (mon.0) 136 : cluster [INF] overall HEALTH_OK 2020-07-16T13:31:04.285 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:03 smithi132 bash[23299]: audit 2020-07-16T13:31:03.930431+0000 mon.a (mon.0) 137 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:30:59.761726\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:30:59.761808\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:30:59.761838\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}}, \"last_daemon_update\": \"2020-07-16T13:30:59.761913\", \"last_device_update\": \"2020-07-16T13:30:10.631612\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:31:04.286 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:03 smithi132 bash[27079]: cluster 2020-07-16T13:30:58.908296+0000 mon.a (mon.0) 128 : cluster [INF] mon.a calling monitor election 2020-07-16T13:31:04.286 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:03 smithi132 bash[27079]: cluster 2020-07-16T13:30:59.694252+0000 mgr.y (mgr.14140) 25 : cluster [DBG] pgmap v21: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:31:04.286 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:03 smithi132 bash[27079]: audit 2020-07-16T13:30:59.762449+0000 mon.a (mon.0) 129 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:30:59.761726\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:30:59.761808\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:30:59.761838\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}}, \"last_daemon_update\": \"2020-07-16T13:30:59.761913\", \"last_device_update\": \"2020-07-16T13:30:10.631612\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:31:04.287 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:03 smithi132 bash[27079]: cluster 2020-07-16T13:31:00.906675+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2020-07-16T13:31:04.287 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:03 smithi132 bash[27079]: cluster 2020-07-16T13:31:01.694694+0000 mgr.y (mgr.14140) 26 : cluster [DBG] pgmap v22: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:31:04.287 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:03 smithi132 bash[27079]: cluster 2020-07-16T13:31:03.694977+0000 mgr.y (mgr.14140) 27 : cluster [DBG] pgmap v23: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:31:04.288 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:03 smithi132 bash[27079]: cluster 2020-07-16T13:31:03.911222+0000 mon.a (mon.0) 130 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2020-07-16T13:31:04.288 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:03 smithi132 bash[27079]: cluster 2020-07-16T13:31:03.916455+0000 mon.a (mon.0) 131 : cluster [DBG] monmap e2: 2 mons at {a=[v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0],c=[v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0]} 2020-07-16T13:31:04.288 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:03 smithi132 bash[27079]: cluster 2020-07-16T13:31:03.916524+0000 mon.a (mon.0) 132 : cluster [DBG] fsmap 2020-07-16T13:31:04.289 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:03 smithi132 bash[27079]: cluster 2020-07-16T13:31:03.916555+0000 mon.a (mon.0) 133 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2020-07-16T13:31:04.289 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:03 smithi132 bash[27079]: cluster 2020-07-16T13:31:03.916778+0000 mon.a (mon.0) 134 : cluster [DBG] mgrmap e13: y(active, since 58s) 2020-07-16T13:31:04.289 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:03 smithi132 bash[27079]: audit 2020-07-16T13:31:03.918076+0000 mon.a (mon.0) 135 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:30:59.761726\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:30:59.761808\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:30:59.761838\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}}, \"last_daemon_update\": \"2020-07-16T13:30:59.761913\", \"last_device_update\": \"2020-07-16T13:30:10.631612\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:31:04.290 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:03 smithi132 bash[27079]: cluster 2020-07-16T13:31:03.924923+0000 mon.a (mon.0) 136 : cluster [INF] overall HEALTH_OK 2020-07-16T13:31:04.290 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:03 smithi132 bash[27079]: audit 2020-07-16T13:31:03.930431+0000 mon.a (mon.0) 137 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:30:59.761726\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:30:59.761808\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:30:59.761838\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}}, \"last_daemon_update\": \"2020-07-16T13:30:59.761913\", \"last_device_update\": \"2020-07-16T13:30:10.631612\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:31:05.476 INFO:teuthology.orchestra.run.smithi132.stdout: 2020-07-16T13:31:05.477 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":2,"fsid":"4c8ed362-c768-11ea-a06f-001a4aab830c","modified":"2020-07-16T13:30:58.905987Z","created":"2020-07-16T13:29:31.760388Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:3300","nonce":0},{"type":"v1","addr":"172.21.15.132:6789","nonce":0}]},"addr":"172.21.15.132:6789/0","public_addr":"172.21.15.132:6789/0","priority":0,"weight":0},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:3301","nonce":0},{"type":"v1","addr":"172.21.15.132:6790","nonce":0}]},"addr":"172.21.15.132:6790/0","public_addr":"172.21.15.132:6790/0","priority":0,"weight":0}],"quorum":[0,1]} 2020-07-16T13:31:05.478 INFO:teuthology.orchestra.run.smithi132.stderr:dumped monmap epoch 2 2020-07-16T13:31:05.779 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:05 smithi132 bash[23299]: audit 2020-07-16T13:31:05.474730+0000 mon.a (mon.0) 138 : audit [DBG] from='client.? 172.21.15.132:0/837205786' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2020-07-16T13:31:05.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:05 smithi132 bash[27079]: audit 2020-07-16T13:31:05.474730+0000 mon.a (mon.0) 138 : audit [DBG] from='client.? 172.21.15.132:0/837205786' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2020-07-16T13:31:06.043 INFO:tasks.cephadm:Adding mon.b on smithi188 2020-07-16T13:31:06.043 INFO:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4c8ed362-c768-11ea-a06f-001a4aab830c -- ceph orch daemon add mon smithi188:172.21.15.188=b 2020-07-16T13:31:07.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:06 smithi132 bash[23299]: cluster 2020-07-16T13:31:05.695303+0000 mgr.y (mgr.14140) 28 : cluster [DBG] pgmap v24: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:31:07.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:06 smithi132 bash[27079]: cluster 2020-07-16T13:31:05.695303+0000 mgr.y (mgr.14140) 28 : cluster [DBG] pgmap v24: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:31:08.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:07 smithi132 bash[23299]: cluster 2020-07-16T13:31:06.559118+0000 mon.a (mon.0) 139 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2020-07-16T13:31:08.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:07 smithi132 bash[27079]: cluster 2020-07-16T13:31:06.559118+0000 mon.a (mon.0) 139 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2020-07-16T13:31:09.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:08 smithi132 bash[23299]: cluster 2020-07-16T13:31:07.695579+0000 mgr.y (mgr.14140) 29 : cluster [DBG] pgmap v25: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:31:09.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:08 smithi132 bash[23299]: audit 2020-07-16T13:31:07.882767+0000 mgr.y (mgr.14140) 30 : audit [DBG] from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch daemon add", "daemon_type": "mon", "placement": "smithi188:172.21.15.188=b", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:31:09.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:08 smithi132 bash[23299]: audit 2020-07-16T13:31:07.884221+0000 mon.a (mon.0) 140 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2020-07-16T13:31:09.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:08 smithi132 bash[23299]: audit 2020-07-16T13:31:07.885016+0000 mon.a (mon.0) 141 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:31:09.031 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:08 smithi132 bash[23299]: cephadm 2020-07-16T13:31:07.885596+0000 mgr.y (mgr.14140) 31 : cephadm [INF] Deploying daemon mon.b on smithi188 2020-07-16T13:31:09.031 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:08 smithi132 bash[23299]: audit 2020-07-16T13:31:07.885896+0000 mon.a (mon.0) 142 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2020-07-16T13:31:09.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:08 smithi132 bash[27079]: cluster 2020-07-16T13:31:07.695579+0000 mgr.y (mgr.14140) 29 : cluster [DBG] pgmap v25: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:31:09.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:08 smithi132 bash[27079]: audit 2020-07-16T13:31:07.882767+0000 mgr.y (mgr.14140) 30 : audit [DBG] from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch daemon add", "daemon_type": "mon", "placement": "smithi188:172.21.15.188=b", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:31:09.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:08 smithi132 bash[27079]: audit 2020-07-16T13:31:07.884221+0000 mon.a (mon.0) 140 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2020-07-16T13:31:09.033 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:08 smithi132 bash[27079]: audit 2020-07-16T13:31:07.885016+0000 mon.a (mon.0) 141 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:31:09.033 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:08 smithi132 bash[27079]: cephadm 2020-07-16T13:31:07.885596+0000 mgr.y (mgr.14140) 31 : cephadm [INF] Deploying daemon mon.b on smithi188 2020-07-16T13:31:09.033 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:08 smithi132 bash[27079]: audit 2020-07-16T13:31:07.885896+0000 mon.a (mon.0) 142 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2020-07-16T13:31:10.891 INFO:teuthology.orchestra.run.smithi188.stdout:Deployed mon.b on host 'smithi188' 2020-07-16T13:31:11.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:10 smithi132 bash[23299]: cluster 2020-07-16T13:31:09.695987+0000 mgr.y (mgr.14140) 32 : cluster [DBG] pgmap v26: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:31:11.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:10 smithi132 bash[23299]: audit 2020-07-16T13:31:10.518448+0000 mon.a (mon.0) 143 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}}, \"last_device_update\": \"2020-07-16T13:30:51.483581\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:31:11.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:10 smithi132 bash[23299]: audit 2020-07-16T13:31:10.518869+0000 mon.a (mon.0) 144 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:31:11.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:10 smithi132 bash[23299]: audit 2020-07-16T13:31:10.521172+0000 mon.a (mon.0) 145 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}}, \"last_device_update\": \"2020-07-16T13:30:51.483581\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:31:11.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:10 smithi132 bash[27079]: cluster 2020-07-16T13:31:09.695987+0000 mgr.y (mgr.14140) 32 : cluster [DBG] pgmap v26: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:31:11.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:10 smithi132 bash[27079]: audit 2020-07-16T13:31:10.518448+0000 mon.a (mon.0) 143 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}}, \"last_device_update\": \"2020-07-16T13:30:51.483581\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:31:11.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:10 smithi132 bash[27079]: audit 2020-07-16T13:31:10.518869+0000 mon.a (mon.0) 144 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:31:11.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:10 smithi132 bash[27079]: audit 2020-07-16T13:31:10.521172+0000 mon.a (mon.0) 145 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}}, \"last_device_update\": \"2020-07-16T13:30:51.483581\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:31:11.519 INFO:teuthology.orchestra.run.smithi188:mon.b> sudo journalctl -f -n 0 -u ceph-4c8ed362-c768-11ea-a06f-001a4aab830c@mon.b.service 2020-07-16T13:31:11.522 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2020-07-16T13:31:11.523 INFO:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4c8ed362-c768-11ea-a06f-001a4aab830c -- ceph mon dump -f json 2020-07-16T13:31:11.552 INFO:journalctl@ceph.mon.b.smithi188.stdout:-- Logs begin at Thu 2020-07-16 13:22:28 UTC. -- 2020-07-16T13:31:16.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:16 smithi132 bash[23299]: cluster 2020-07-16T13:31:10.921635+0000 mon.a (mon.0) 146 : cluster [INF] mon.a calling monitor election 2020-07-16T13:31:16.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:16 smithi132 bash[23299]: cluster 2020-07-16T13:31:10.927008+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2020-07-16T13:31:16.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:16 smithi132 bash[23299]: audit 2020-07-16T13:31:11.510177+0000 mon.a (mon.0) 147 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:11.509497\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}}, \"last_daemon_update\": \"2020-07-16T13:31:11.509636\", \"last_device_update\": \"2020-07-16T13:30:51.483581\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:31:16.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:16 smithi132 bash[23299]: cluster 2020-07-16T13:31:11.696353+0000 mgr.y (mgr.14140) 33 : cluster [DBG] pgmap v27: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:31:16.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:16 smithi132 bash[23299]: cluster 2020-07-16T13:31:12.916844+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2020-07-16T13:31:16.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:16 smithi132 bash[23299]: cluster 2020-07-16T13:31:13.696742+0000 mgr.y (mgr.14140) 34 : cluster [DBG] pgmap v28: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:31:16.282 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:16 smithi132 bash[23299]: cluster 2020-07-16T13:31:15.697169+0000 mgr.y (mgr.14140) 35 : cluster [DBG] pgmap v29: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:31:16.282 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:16 smithi132 bash[23299]: cluster 2020-07-16T13:31:15.931795+0000 mon.a (mon.0) 148 : cluster [INF] mon.a calling monitor election 2020-07-16T13:31:16.282 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:16 smithi132 bash[23299]: cluster 2020-07-16T13:31:15.942091+0000 mon.a (mon.0) 149 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2020-07-16T13:31:16.282 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:16 smithi132 bash[23299]: cluster 2020-07-16T13:31:15.947318+0000 mon.a (mon.0) 150 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0],b=[v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0],c=[v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0]} 2020-07-16T13:31:16.282 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:16 smithi132 bash[23299]: cluster 2020-07-16T13:31:15.947377+0000 mon.a (mon.0) 151 : cluster [DBG] fsmap 2020-07-16T13:31:16.283 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:16 smithi132 bash[23299]: cluster 2020-07-16T13:31:15.947411+0000 mon.a (mon.0) 152 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2020-07-16T13:31:16.283 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:16 smithi132 bash[23299]: cluster 2020-07-16T13:31:15.947621+0000 mon.a (mon.0) 153 : cluster [DBG] mgrmap e13: y(active, since 70s) 2020-07-16T13:31:16.285 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:16 smithi132 bash[23299]: audit 2020-07-16T13:31:15.948171+0000 mon.a (mon.0) 154 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:11.509497\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}}, \"last_daemon_update\": \"2020-07-16T13:31:11.509636\", \"last_device_update\": \"2020-07-16T13:30:51.483581\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:31:16.285 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:16 smithi132 bash[23299]: cluster 2020-07-16T13:31:15.952533+0000 mon.a (mon.0) 155 : cluster [WRN] overall HEALTH_WARN Reduced data availability: 1 pg inactive 2020-07-16T13:31:16.285 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:16 smithi132 bash[23299]: audit 2020-07-16T13:31:15.954618+0000 mon.a (mon.0) 156 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:11.509497\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}}, \"last_daemon_update\": \"2020-07-16T13:31:11.509636\", \"last_device_update\": \"2020-07-16T13:30:51.483581\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:31:16.286 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:16 smithi132 bash[27079]: cluster 2020-07-16T13:31:10.921635+0000 mon.a (mon.0) 146 : cluster [INF] mon.a calling monitor election 2020-07-16T13:31:16.286 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:16 smithi132 bash[27079]: cluster 2020-07-16T13:31:10.927008+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2020-07-16T13:31:16.286 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:16 smithi132 bash[27079]: audit 2020-07-16T13:31:11.510177+0000 mon.a (mon.0) 147 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:11.509497\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}}, \"last_daemon_update\": \"2020-07-16T13:31:11.509636\", \"last_device_update\": \"2020-07-16T13:30:51.483581\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:31:16.286 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:16 smithi132 bash[27079]: cluster 2020-07-16T13:31:11.696353+0000 mgr.y (mgr.14140) 33 : cluster [DBG] pgmap v27: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:31:16.287 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:16 smithi132 bash[27079]: cluster 2020-07-16T13:31:12.916844+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2020-07-16T13:31:16.287 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:16 smithi132 bash[27079]: cluster 2020-07-16T13:31:13.696742+0000 mgr.y (mgr.14140) 34 : cluster [DBG] pgmap v28: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:31:16.287 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:16 smithi132 bash[27079]: cluster 2020-07-16T13:31:15.697169+0000 mgr.y (mgr.14140) 35 : cluster [DBG] pgmap v29: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:31:16.287 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:16 smithi132 bash[27079]: cluster 2020-07-16T13:31:15.931795+0000 mon.a (mon.0) 148 : cluster [INF] mon.a calling monitor election 2020-07-16T13:31:16.287 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:16 smithi132 bash[27079]: cluster 2020-07-16T13:31:15.942091+0000 mon.a (mon.0) 149 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2020-07-16T13:31:16.288 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:16 smithi132 bash[27079]: cluster 2020-07-16T13:31:15.947318+0000 mon.a (mon.0) 150 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0],b=[v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0],c=[v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0]} 2020-07-16T13:31:16.288 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:16 smithi132 bash[27079]: cluster 2020-07-16T13:31:15.947377+0000 mon.a (mon.0) 151 : cluster [DBG] fsmap 2020-07-16T13:31:16.288 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:16 smithi132 bash[27079]: cluster 2020-07-16T13:31:15.947411+0000 mon.a (mon.0) 152 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2020-07-16T13:31:16.288 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:16 smithi132 bash[27079]: cluster 2020-07-16T13:31:15.947621+0000 mon.a (mon.0) 153 : cluster [DBG] mgrmap e13: y(active, since 70s) 2020-07-16T13:31:16.289 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:16 smithi132 bash[27079]: audit 2020-07-16T13:31:15.948171+0000 mon.a (mon.0) 154 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:11.509497\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}}, \"last_daemon_update\": \"2020-07-16T13:31:11.509636\", \"last_device_update\": \"2020-07-16T13:30:51.483581\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:31:16.289 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:16 smithi132 bash[27079]: cluster 2020-07-16T13:31:15.952533+0000 mon.a (mon.0) 155 : cluster [WRN] overall HEALTH_WARN Reduced data availability: 1 pg inactive 2020-07-16T13:31:16.289 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:16 smithi132 bash[27079]: audit 2020-07-16T13:31:15.954618+0000 mon.a (mon.0) 156 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:11.509497\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}}, \"last_daemon_update\": \"2020-07-16T13:31:11.509636\", \"last_device_update\": \"2020-07-16T13:30:51.483581\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:31:16.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:16 smithi188 bash[23329]: cluster 2020-07-16T13:31:10.921635+0000 mon.a (mon.0) 146 : cluster [INF] mon.a calling monitor election 2020-07-16T13:31:16.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:16 smithi188 bash[23329]: cluster 2020-07-16T13:31:10.927008+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2020-07-16T13:31:16.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:16 smithi188 bash[23329]: audit 2020-07-16T13:31:11.510177+0000 mon.a (mon.0) 147 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:11.509497\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}}, \"last_daemon_update\": \"2020-07-16T13:31:11.509636\", \"last_device_update\": \"2020-07-16T13:30:51.483581\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:31:16.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:16 smithi188 bash[23329]: cluster 2020-07-16T13:31:11.696353+0000 mgr.y (mgr.14140) 33 : cluster [DBG] pgmap v27: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:31:16.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:16 smithi188 bash[23329]: cluster 2020-07-16T13:31:12.916844+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2020-07-16T13:31:16.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:16 smithi188 bash[23329]: cluster 2020-07-16T13:31:13.696742+0000 mgr.y (mgr.14140) 34 : cluster [DBG] pgmap v28: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:31:16.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:16 smithi188 bash[23329]: cluster 2020-07-16T13:31:15.697169+0000 mgr.y (mgr.14140) 35 : cluster [DBG] pgmap v29: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:31:16.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:16 smithi188 bash[23329]: cluster 2020-07-16T13:31:15.931795+0000 mon.a (mon.0) 148 : cluster [INF] mon.a calling monitor election 2020-07-16T13:31:16.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:16 smithi188 bash[23329]: cluster 2020-07-16T13:31:15.942091+0000 mon.a (mon.0) 149 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2020-07-16T13:31:16.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:16 smithi188 bash[23329]: cluster 2020-07-16T13:31:15.947318+0000 mon.a (mon.0) 150 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0],b=[v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0],c=[v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0]} 2020-07-16T13:31:16.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:16 smithi188 bash[23329]: cluster 2020-07-16T13:31:15.947377+0000 mon.a (mon.0) 151 : cluster [DBG] fsmap 2020-07-16T13:31:16.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:16 smithi188 bash[23329]: cluster 2020-07-16T13:31:15.947411+0000 mon.a (mon.0) 152 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2020-07-16T13:31:16.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:16 smithi188 bash[23329]: cluster 2020-07-16T13:31:15.947621+0000 mon.a (mon.0) 153 : cluster [DBG] mgrmap e13: y(active, since 70s) 2020-07-16T13:31:16.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:16 smithi188 bash[23329]: audit 2020-07-16T13:31:15.948171+0000 mon.a (mon.0) 154 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:11.509497\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}}, \"last_daemon_update\": \"2020-07-16T13:31:11.509636\", \"last_device_update\": \"2020-07-16T13:30:51.483581\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:31:16.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:16 smithi188 bash[23329]: cluster 2020-07-16T13:31:15.952533+0000 mon.a (mon.0) 155 : cluster [WRN] overall HEALTH_WARN Reduced data availability: 1 pg inactive 2020-07-16T13:31:16.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:16 smithi188 bash[23329]: audit 2020-07-16T13:31:15.954618+0000 mon.a (mon.0) 156 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:11.509497\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}}, \"last_daemon_update\": \"2020-07-16T13:31:11.509636\", \"last_device_update\": \"2020-07-16T13:30:51.483581\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:31:17.175 INFO:teuthology.orchestra.run.smithi188.stdout: 2020-07-16T13:31:17.175 INFO:teuthology.orchestra.run.smithi188.stdout:{"epoch":3,"fsid":"4c8ed362-c768-11ea-a06f-001a4aab830c","modified":"2020-07-16T13:31:10.915906Z","created":"2020-07-16T13:29:31.760388Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:3300","nonce":0},{"type":"v1","addr":"172.21.15.132:6789","nonce":0}]},"addr":"172.21.15.132:6789/0","public_addr":"172.21.15.132:6789/0","priority":0,"weight":0},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:3301","nonce":0},{"type":"v1","addr":"172.21.15.132:6790","nonce":0}]},"addr":"172.21.15.132:6790/0","public_addr":"172.21.15.132:6790/0","priority":0,"weight":0},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:3300","nonce":0},{"type":"v1","addr":"172.21.15.188:6789","nonce":0}]},"addr":"172.21.15.188:6789/0","public_addr":"172.21.15.188:6789/0","priority":0,"weight":0}],"quorum":[0,1,2]} 2020-07-16T13:31:17.176 INFO:teuthology.orchestra.run.smithi188.stderr:dumped monmap epoch 3 2020-07-16T13:31:17.529 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:17 smithi132 bash[23299]: audit 2020-07-16T13:31:17.173252+0000 mon.a (mon.0) 157 : audit [DBG] from='client.? 172.21.15.188:0/2186248281' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2020-07-16T13:31:17.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:17 smithi132 bash[27079]: audit 2020-07-16T13:31:17.173252+0000 mon.a (mon.0) 157 : audit [DBG] from='client.? 172.21.15.188:0/2186248281' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2020-07-16T13:31:17.628 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:17 smithi188 bash[23329]: audit 2020-07-16T13:31:17.173252+0000 mon.a (mon.0) 157 : audit [DBG] from='client.? 172.21.15.188:0/2186248281' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2020-07-16T13:31:17.643 INFO:tasks.cephadm:Generating final ceph.conf file... 2020-07-16T13:31:17.644 INFO:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4c8ed362-c768-11ea-a06f-001a4aab830c -- ceph config generate-minimal-conf 2020-07-16T13:31:18.336 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:18 smithi188 bash[23329]: cluster 2020-07-16T13:31:17.697470+0000 mgr.y (mgr.14140) 36 : cluster [DBG] pgmap v30: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:31:18.529 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:18 smithi132 bash[23299]: cluster 2020-07-16T13:31:17.697470+0000 mgr.y (mgr.14140) 36 : cluster [DBG] pgmap v30: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:31:18.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:18 smithi132 bash[27079]: cluster 2020-07-16T13:31:17.697470+0000 mgr.y (mgr.14140) 36 : cluster [DBG] pgmap v30: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:31:19.386 INFO:teuthology.orchestra.run.smithi188.stdout:# minimal ceph.conf for 4c8ed362-c768-11ea-a06f-001a4aab830c 2020-07-16T13:31:19.387 INFO:teuthology.orchestra.run.smithi188.stdout:[global] 2020-07-16T13:31:19.387 INFO:teuthology.orchestra.run.smithi188.stdout: fsid = 4c8ed362-c768-11ea-a06f-001a4aab830c 2020-07-16T13:31:19.387 INFO:teuthology.orchestra.run.smithi188.stdout: mon_host = [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] 2020-07-16T13:31:19.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:19 smithi188 bash[23329]: audit 2020-07-16T13:31:19.385093+0000 mon.a (mon.0) 158 : audit [DBG] from='client.? 172.21.15.188:0/3437289329' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:31:19.779 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:19 smithi132 bash[23299]: audit 2020-07-16T13:31:19.385093+0000 mon.a (mon.0) 158 : audit [DBG] from='client.? 172.21.15.188:0/3437289329' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:31:19.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:19 smithi132 bash[27079]: audit 2020-07-16T13:31:19.385093+0000 mon.a (mon.0) 158 : audit [DBG] from='client.? 172.21.15.188:0/3437289329' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:31:19.818 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2020-07-16T13:31:19.818 INFO:teuthology.orchestra.run.smithi132:> sudo sh -c 'cat > /etc/ceph/ceph.conf' 2020-07-16T13:31:19.866 INFO:teuthology.orchestra.run.smithi132:> sudo sh -c 'cat > /etc/ceph/ceph.client.admin.keyring' 2020-07-16T13:31:19.951 INFO:teuthology.orchestra.run.smithi188:> sudo sh -c 'cat > /etc/ceph/ceph.conf' 2020-07-16T13:31:19.997 INFO:teuthology.orchestra.run.smithi188:> sudo sh -c 'cat > /etc/ceph/ceph.client.admin.keyring' 2020-07-16T13:31:20.082 INFO:tasks.cephadm:Adding mgr.x on smithi188 2020-07-16T13:31:20.083 INFO:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4c8ed362-c768-11ea-a06f-001a4aab830c -- ceph orch apply mgr '2;smithi188=x' 2020-07-16T13:31:20.813 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:20 smithi188 bash[23329]: cluster 2020-07-16T13:31:19.697816+0000 mgr.y (mgr.14140) 37 : cluster [DBG] pgmap v31: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:31:21.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:20 smithi132 bash[23299]: cluster 2020-07-16T13:31:19.697816+0000 mgr.y (mgr.14140) 37 : cluster [DBG] pgmap v31: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:31:21.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:20 smithi132 bash[27079]: cluster 2020-07-16T13:31:19.697816+0000 mgr.y (mgr.14140) 37 : cluster [DBG] pgmap v31: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:31:21.857 INFO:teuthology.orchestra.run.smithi188.stdout:Scheduled mgr update... 2020-07-16T13:31:22.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:21 smithi188 bash[23329]: audit 2020-07-16T13:31:21.852359+0000 mon.a (mon.0) 159 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2020-07-16T13:31:21.851997\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi188\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]: dispatch 2020-07-16T13:31:22.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:21 smithi188 bash[23329]: audit 2020-07-16T13:31:21.855076+0000 mon.a (mon.0) 160 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2020-07-16T13:31:21.851997\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi188\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]': finished 2020-07-16T13:31:22.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:21 smithi188 bash[23329]: audit 2020-07-16T13:31:21.856962+0000 mon.a (mon.0) 161 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2020-07-16T13:31:22.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:21 smithi188 bash[23329]: audit 2020-07-16T13:31:21.859836+0000 mon.a (mon.0) 162 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2020-07-16T13:31:22.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:21 smithi188 bash[23329]: audit 2020-07-16T13:31:21.860623+0000 mon.a (mon.0) 163 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:31:22.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:21 smithi188 bash[23329]: audit 2020-07-16T13:31:21.861719+0000 mon.a (mon.0) 164 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2020-07-16T13:31:22.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:21 smithi132 bash[23299]: audit 2020-07-16T13:31:21.852359+0000 mon.a (mon.0) 159 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2020-07-16T13:31:21.851997\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi188\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]: dispatch 2020-07-16T13:31:22.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:21 smithi132 bash[23299]: audit 2020-07-16T13:31:21.855076+0000 mon.a (mon.0) 160 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2020-07-16T13:31:21.851997\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi188\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]': finished 2020-07-16T13:31:22.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:21 smithi132 bash[23299]: audit 2020-07-16T13:31:21.856962+0000 mon.a (mon.0) 161 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2020-07-16T13:31:22.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:21 smithi132 bash[23299]: audit 2020-07-16T13:31:21.859836+0000 mon.a (mon.0) 162 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2020-07-16T13:31:22.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:21 smithi132 bash[23299]: audit 2020-07-16T13:31:21.860623+0000 mon.a (mon.0) 163 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:31:22.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:21 smithi132 bash[23299]: audit 2020-07-16T13:31:21.861719+0000 mon.a (mon.0) 164 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2020-07-16T13:31:22.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:21 smithi132 bash[27079]: audit 2020-07-16T13:31:21.852359+0000 mon.a (mon.0) 159 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2020-07-16T13:31:21.851997\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi188\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]: dispatch 2020-07-16T13:31:22.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:21 smithi132 bash[27079]: audit 2020-07-16T13:31:21.855076+0000 mon.a (mon.0) 160 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2020-07-16T13:31:21.851997\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi188\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]': finished 2020-07-16T13:31:22.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:21 smithi132 bash[27079]: audit 2020-07-16T13:31:21.856962+0000 mon.a (mon.0) 161 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2020-07-16T13:31:22.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:21 smithi132 bash[27079]: audit 2020-07-16T13:31:21.859836+0000 mon.a (mon.0) 162 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2020-07-16T13:31:22.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:21 smithi132 bash[27079]: audit 2020-07-16T13:31:21.860623+0000 mon.a (mon.0) 163 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:31:22.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:21 smithi132 bash[27079]: audit 2020-07-16T13:31:21.861719+0000 mon.a (mon.0) 164 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2020-07-16T13:31:22.365 INFO:teuthology.orchestra.run.smithi188:mgr.x> sudo journalctl -f -n 0 -u ceph-4c8ed362-c768-11ea-a06f-001a4aab830c@mgr.x.service 2020-07-16T13:31:22.368 INFO:tasks.cephadm:Deploying OSDs... 2020-07-16T13:31:22.389 DEBUG:teuthology.orchestra.remote:smithi132:/scratch_devs is 72B 2020-07-16T13:31:22.398 INFO:journalctl@ceph.mgr.x.smithi188.stdout:-- Logs begin at Thu 2020-07-16 13:22:28 UTC. -- 2020-07-16T13:31:22.443 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2020-07-16T13:31:22.444 INFO:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-07-16T13:31:22.462 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2020-07-16T13:31:22.462 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-07-16T13:31:22.463 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 6h/6d Inode: 97980 Links: 1 2020-07-16T13:31:22.463 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-07-16T13:31:22.463 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2020-07-16T13:31:22.463 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2020-07-16 13:30:58.381915585 +0000 2020-07-16T13:31:22.463 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2020-07-16 13:28:40.599585782 +0000 2020-07-16T13:31:22.464 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2020-07-16 13:28:40.599585782 +0000 2020-07-16T13:31:22.464 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: - 2020-07-16T13:31:22.475 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2020-07-16T13:31:22.475 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2020-07-16T13:31:22.475 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000252818 s, 2.0 MB/s 2020-07-16T13:31:22.478 INFO:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-07-16T13:31:22.534 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2020-07-16T13:31:22.534 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-07-16T13:31:22.534 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 6h/6d Inode: 99101 Links: 1 2020-07-16T13:31:22.535 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-07-16T13:31:22.535 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2020-07-16T13:31:22.535 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2020-07-16 13:30:58.381915585 +0000 2020-07-16T13:31:22.535 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2020-07-16 13:28:40.935577273 +0000 2020-07-16T13:31:22.535 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2020-07-16 13:28:40.935577273 +0000 2020-07-16T13:31:22.536 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: - 2020-07-16T13:31:22.548 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2020-07-16T13:31:22.548 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2020-07-16T13:31:22.548 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000220415 s, 2.3 MB/s 2020-07-16T13:31:22.551 INFO:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-07-16T13:31:22.606 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-07-16T13:31:22.607 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-07-16T13:31:22.607 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 6h/6d Inode: 99139 Links: 1 2020-07-16T13:31:22.608 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-07-16T13:31:22.608 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2020-07-16T13:31:22.608 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2020-07-16 13:30:58.381915585 +0000 2020-07-16T13:31:22.609 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2020-07-16 13:28:41.287568360 +0000 2020-07-16T13:31:22.609 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2020-07-16 13:28:41.287568360 +0000 2020-07-16T13:31:22.609 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: - 2020-07-16T13:31:22.621 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2020-07-16T13:31:22.621 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2020-07-16T13:31:22.622 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000221893 s, 2.3 MB/s 2020-07-16T13:31:22.623 INFO:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-07-16T13:31:22.677 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2020-07-16T13:31:22.678 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-07-16T13:31:22.678 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 6h/6d Inode: 102615 Links: 1 2020-07-16T13:31:22.678 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-07-16T13:31:22.678 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2020-07-16T13:31:22.678 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2020-07-16 13:30:58.381915585 +0000 2020-07-16T13:31:22.679 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2020-07-16 13:28:41.630559674 +0000 2020-07-16T13:31:22.679 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2020-07-16 13:28:41.630559674 +0000 2020-07-16T13:31:22.679 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: - 2020-07-16T13:31:22.691 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2020-07-16T13:31:22.691 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2020-07-16T13:31:22.691 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000296156 s, 1.7 MB/s 2020-07-16T13:31:22.710 DEBUG:teuthology.orchestra.remote:smithi188:/scratch_devs is 72B 2020-07-16T13:31:22.760 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2020-07-16T13:31:22.760 INFO:teuthology.orchestra.run.smithi188:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-07-16T13:31:22.774 INFO:teuthology.orchestra.run.smithi188.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2020-07-16T13:31:22.775 INFO:teuthology.orchestra.run.smithi188.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-07-16T13:31:22.775 INFO:teuthology.orchestra.run.smithi188.stdout:Device: 6h/6d Inode: 96241 Links: 1 2020-07-16T13:31:22.775 INFO:teuthology.orchestra.run.smithi188.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-07-16T13:31:22.775 INFO:teuthology.orchestra.run.smithi188.stdout:Context: system_u:object_r:device_t:s0 2020-07-16T13:31:22.775 INFO:teuthology.orchestra.run.smithi188.stdout:Access: 2020-07-16 13:31:10.411757269 +0000 2020-07-16T13:31:22.776 INFO:teuthology.orchestra.run.smithi188.stdout:Modify: 2020-07-16 13:28:40.626697670 +0000 2020-07-16T13:31:22.776 INFO:teuthology.orchestra.run.smithi188.stdout:Change: 2020-07-16 13:28:40.626697670 +0000 2020-07-16T13:31:22.776 INFO:teuthology.orchestra.run.smithi188.stdout: Birth: - 2020-07-16T13:31:22.789 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records in 2020-07-16T13:31:22.789 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records out 2020-07-16T13:31:22.789 INFO:teuthology.orchestra.run.smithi188.stderr:512 bytes copied, 0.000231953 s, 2.2 MB/s 2020-07-16T13:31:22.792 INFO:teuthology.orchestra.run.smithi188:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-07-16T13:31:22.847 INFO:teuthology.orchestra.run.smithi188.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2020-07-16T13:31:22.847 INFO:teuthology.orchestra.run.smithi188.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-07-16T13:31:22.847 INFO:teuthology.orchestra.run.smithi188.stdout:Device: 6h/6d Inode: 100800 Links: 1 2020-07-16T13:31:22.848 INFO:teuthology.orchestra.run.smithi188.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-07-16T13:31:22.848 INFO:teuthology.orchestra.run.smithi188.stdout:Context: system_u:object_r:device_t:s0 2020-07-16T13:31:22.848 INFO:teuthology.orchestra.run.smithi188.stdout:Access: 2020-07-16 13:31:10.411757269 +0000 2020-07-16T13:31:22.849 INFO:teuthology.orchestra.run.smithi188.stdout:Modify: 2020-07-16 13:28:41.051689628 +0000 2020-07-16T13:31:22.849 INFO:teuthology.orchestra.run.smithi188.stdout:Change: 2020-07-16 13:28:41.051689628 +0000 2020-07-16T13:31:22.849 INFO:teuthology.orchestra.run.smithi188.stdout: Birth: - 2020-07-16T13:31:22.861 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records in 2020-07-16T13:31:22.862 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records out 2020-07-16T13:31:22.862 INFO:teuthology.orchestra.run.smithi188.stderr:512 bytes copied, 0.000248188 s, 2.1 MB/s 2020-07-16T13:31:22.874 INFO:teuthology.orchestra.run.smithi188:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-07-16T13:31:22.934 INFO:teuthology.orchestra.run.smithi188.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-07-16T13:31:22.934 INFO:teuthology.orchestra.run.smithi188.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-07-16T13:31:22.935 INFO:teuthology.orchestra.run.smithi188.stdout:Device: 6h/6d Inode: 103505 Links: 1 2020-07-16T13:31:22.935 INFO:teuthology.orchestra.run.smithi188.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-07-16T13:31:22.935 INFO:teuthology.orchestra.run.smithi188.stdout:Context: system_u:object_r:device_t:s0 2020-07-16T13:31:22.936 INFO:teuthology.orchestra.run.smithi188.stdout:Access: 2020-07-16 13:31:10.412757250 +0000 2020-07-16T13:31:22.937 INFO:teuthology.orchestra.run.smithi188.stdout:Modify: 2020-07-16 13:28:41.405682930 +0000 2020-07-16T13:31:22.937 INFO:teuthology.orchestra.run.smithi188.stdout:Change: 2020-07-16 13:28:41.405682930 +0000 2020-07-16T13:31:22.937 INFO:teuthology.orchestra.run.smithi188.stdout: Birth: - 2020-07-16T13:31:22.938 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records in 2020-07-16T13:31:22.939 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records out 2020-07-16T13:31:22.939 INFO:teuthology.orchestra.run.smithi188.stderr:512 bytes copied, 0.000207731 s, 2.5 MB/s 2020-07-16T13:31:22.941 INFO:teuthology.orchestra.run.smithi188:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-07-16T13:31:22.995 INFO:teuthology.orchestra.run.smithi188.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2020-07-16T13:31:22.995 INFO:teuthology.orchestra.run.smithi188.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-07-16T13:31:22.996 INFO:teuthology.orchestra.run.smithi188.stdout:Device: 6h/6d Inode: 103565 Links: 1 2020-07-16T13:31:22.996 INFO:teuthology.orchestra.run.smithi188.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-07-16T13:31:22.996 INFO:teuthology.orchestra.run.smithi188.stdout:Context: system_u:object_r:device_t:s0 2020-07-16T13:31:22.996 INFO:teuthology.orchestra.run.smithi188.stdout:Access: 2020-07-16 13:31:10.412757250 +0000 2020-07-16T13:31:22.997 INFO:teuthology.orchestra.run.smithi188.stdout:Modify: 2020-07-16 13:28:41.749676421 +0000 2020-07-16T13:31:22.997 INFO:teuthology.orchestra.run.smithi188.stdout:Change: 2020-07-16 13:28:41.749676421 +0000 2020-07-16T13:31:22.997 INFO:teuthology.orchestra.run.smithi188.stdout: Birth: - 2020-07-16T13:31:23.008 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records in 2020-07-16T13:31:23.009 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records out 2020-07-16T13:31:23.009 INFO:teuthology.orchestra.run.smithi188.stderr:512 bytes copied, 0.000160123 s, 3.2 MB/s 2020-07-16T13:31:23.011 INFO:tasks.cephadm:Deploying osd.0 on smithi132 with /dev/vg_nvme/lv_4... 2020-07-16T13:31:23.012 INFO:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4c8ed362-c768-11ea-a06f-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2020-07-16T13:31:23.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:22 smithi188 bash[23329]: cluster 2020-07-16T13:31:21.698238+0000 mgr.y (mgr.14140) 38 : cluster [DBG] pgmap v32: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:31:23.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:22 smithi188 bash[23329]: audit 2020-07-16T13:31:21.851389+0000 mgr.y (mgr.14140) 39 : audit [DBG] from='client.34103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi188=x", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:31:23.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:22 smithi188 bash[23329]: cephadm 2020-07-16T13:31:21.851985+0000 mgr.y (mgr.14140) 40 : cephadm [INF] Saving service mgr spec with placement count:2 smithi188=x 2020-07-16T13:31:23.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:22 smithi188 bash[23329]: cephadm 2020-07-16T13:31:21.861230+0000 mgr.y (mgr.14140) 41 : cephadm [INF] Deploying daemon mgr.x on smithi188 2020-07-16T13:31:23.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:22 smithi132 bash[23299]: cluster 2020-07-16T13:31:21.698238+0000 mgr.y (mgr.14140) 38 : cluster [DBG] pgmap v32: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:31:23.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:22 smithi132 bash[23299]: audit 2020-07-16T13:31:21.851389+0000 mgr.y (mgr.14140) 39 : audit [DBG] from='client.34103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi188=x", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:31:23.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:22 smithi132 bash[23299]: cephadm 2020-07-16T13:31:21.851985+0000 mgr.y (mgr.14140) 40 : cephadm [INF] Saving service mgr spec with placement count:2 smithi188=x 2020-07-16T13:31:23.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:22 smithi132 bash[23299]: cephadm 2020-07-16T13:31:21.861230+0000 mgr.y (mgr.14140) 41 : cephadm [INF] Deploying daemon mgr.x on smithi188 2020-07-16T13:31:23.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:22 smithi132 bash[27079]: cluster 2020-07-16T13:31:21.698238+0000 mgr.y (mgr.14140) 38 : cluster [DBG] pgmap v32: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:31:23.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:22 smithi132 bash[27079]: audit 2020-07-16T13:31:21.851389+0000 mgr.y (mgr.14140) 39 : audit [DBG] from='client.34103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi188=x", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:31:23.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:22 smithi132 bash[27079]: cephadm 2020-07-16T13:31:21.851985+0000 mgr.y (mgr.14140) 40 : cephadm [INF] Saving service mgr spec with placement count:2 smithi188=x 2020-07-16T13:31:23.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:22 smithi132 bash[27079]: cephadm 2020-07-16T13:31:21.861230+0000 mgr.y (mgr.14140) 41 : cephadm [INF] Deploying daemon mgr.x on smithi188 2020-07-16T13:31:23.671 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Jul 16 13:31:23 smithi188 podman[24344]: Error: no container with name or ID ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mgr.x found: no such container 2020-07-16T13:31:23.671 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Jul 16 13:31:23 smithi188 systemd[1]: Started Ceph mgr.x for 4c8ed362-c768-11ea-a06f-001a4aab830c. 2020-07-16T13:31:24.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:23 smithi132 bash[23299]: audit 2020-07-16T13:31:23.583295+0000 mon.a (mon.0) 165 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:11.509497\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}}, \"last_device_update\": \"2020-07-16T13:30:51.483581\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:31:24.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:23 smithi132 bash[23299]: audit 2020-07-16T13:31:23.585931+0000 mon.a (mon.0) 166 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:11.509497\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}}, \"last_device_update\": \"2020-07-16T13:30:51.483581\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:31:24.031 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:23 smithi132 bash[23299]: audit 2020-07-16T13:31:23.586564+0000 mon.a (mon.0) 167 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:31:24.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:23 smithi132 bash[27079]: audit 2020-07-16T13:31:23.583295+0000 mon.a (mon.0) 165 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:11.509497\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}}, \"last_device_update\": \"2020-07-16T13:30:51.483581\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:31:24.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:23 smithi132 bash[27079]: audit 2020-07-16T13:31:23.585931+0000 mon.a (mon.0) 166 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:11.509497\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}}, \"last_device_update\": \"2020-07-16T13:30:51.483581\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:31:24.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:23 smithi132 bash[27079]: audit 2020-07-16T13:31:23.586564+0000 mon.a (mon.0) 167 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:31:24.102 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Jul 16 13:31:23 smithi188 podman[24362]: 2020-07-16 13:31:23.79199103 +0000 UTC m=+0.221673078 container create 476cdb85d918b6264a6b36f79d09caec2afb7be95491ca25d0eb75c74f55a4a2 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mgr.x) 2020-07-16T13:31:24.102 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Jul 16 13:31:24 smithi188 podman[24362]: 2020-07-16 13:31:24.100250987 +0000 UTC m=+0.529933038 container init 476cdb85d918b6264a6b36f79d09caec2afb7be95491ca25d0eb75c74f55a4a2 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mgr.x) 2020-07-16T13:31:24.103 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:23 smithi188 bash[23329]: audit 2020-07-16T13:31:23.583295+0000 mon.a (mon.0) 165 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:11.509497\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}}, \"last_device_update\": \"2020-07-16T13:30:51.483581\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:31:24.103 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:23 smithi188 bash[23329]: audit 2020-07-16T13:31:23.585931+0000 mon.a (mon.0) 166 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:11.509497\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}}, \"last_device_update\": \"2020-07-16T13:30:51.483581\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:31:24.103 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:23 smithi188 bash[23329]: audit 2020-07-16T13:31:23.586564+0000 mon.a (mon.0) 167 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:31:24.420 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Jul 16 13:31:24 smithi188 podman[24362]: 2020-07-16 13:31:24.133537653 +0000 UTC m=+0.563219714 container start 476cdb85d918b6264a6b36f79d09caec2afb7be95491ca25d0eb75c74f55a4a2 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mgr.x) 2020-07-16T13:31:24.421 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Jul 16 13:31:24 smithi188 podman[24362]: 2020-07-16 13:31:24.133616139 +0000 UTC m=+0.563298216 container attach 476cdb85d918b6264a6b36f79d09caec2afb7be95491ca25d0eb75c74f55a4a2 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mgr.x) 2020-07-16T13:31:24.421 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Jul 16 13:31:24 smithi188 bash[24360]: debug 2020-07-16T13:31:24.124+0000 7f533fda8040 1 -- 172.21.15.188:0/905582035 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55afd0a48c00 msgr2=0x55afd0a67a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T13:31:24.421 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Jul 16 13:31:24 smithi188 bash[24360]: debug 2020-07-16T13:31:24.124+0000 7f533fda8040 1 --2- 172.21.15.188:0/905582035 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55afd0a48c00 0x55afd0a67a80 secure :-1 s=READY pgs=7 cs=0 l=1 rx=0x55afd0ab3140 tx=0x55afd0ab57c0).stop 2020-07-16T13:31:25.027 INFO:teuthology.orchestra.run.smithi132.stderr:--> Zapping: /dev/vg_nvme/lv_4 2020-07-16T13:31:25.027 INFO:teuthology.orchestra.run.smithi132.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2020-07-16T13:31:25.028 INFO:teuthology.orchestra.run.smithi132.stderr: stderr: 10+0 records in 2020-07-16T13:31:25.028 INFO:teuthology.orchestra.run.smithi132.stderr:10+0 records out 2020-07-16T13:31:25.028 INFO:teuthology.orchestra.run.smithi132.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0126223 s, 831 MB/s 2020-07-16T13:31:25.028 INFO:teuthology.orchestra.run.smithi132.stderr:--> Zapping successful for: 2020-07-16T13:31:25.098 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:24 smithi132 bash[23299]: cluster 2020-07-16T13:31:23.698538+0000 mgr.y (mgr.14140) 42 : cluster [DBG] pgmap v33: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:31:25.098 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:24 smithi132 bash[23299]: audit 2020-07-16T13:31:24.169332+0000 mon.a (mon.0) 168 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:24.168707\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:24.168796\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}}, \"last_daemon_update\": \"2020-07-16T13:31:24.168865\", \"last_device_update\": \"2020-07-16T13:30:51.483581\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:31:25.098 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:24 smithi132 bash[23299]: audit 2020-07-16T13:31:24.171825+0000 mon.a (mon.0) 169 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:24.168707\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:24.168796\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}}, \"last_daemon_update\": \"2020-07-16T13:31:24.168865\", \"last_device_update\": \"2020-07-16T13:30:51.483581\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:31:25.099 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:24 smithi132 bash[23299]: audit 2020-07-16T13:31:24.172904+0000 mon.a (mon.0) 170 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2020-07-16T13:31:25.099 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:24 smithi132 bash[23299]: audit 2020-07-16T13:31:24.173530+0000 mon.a (mon.0) 171 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:31:25.099 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:24 smithi132 bash[23299]: audit 2020-07-16T13:31:24.174299+0000 mon.a (mon.0) 172 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2020-07-16T13:31:25.099 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:24 smithi132 bash[27079]: cluster 2020-07-16T13:31:23.698538+0000 mgr.y (mgr.14140) 42 : cluster [DBG] pgmap v33: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:31:25.099 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:24 smithi132 bash[27079]: audit 2020-07-16T13:31:24.169332+0000 mon.a (mon.0) 168 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:24.168707\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:24.168796\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}}, \"last_daemon_update\": \"2020-07-16T13:31:24.168865\", \"last_device_update\": \"2020-07-16T13:30:51.483581\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:31:25.100 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:24 smithi132 bash[27079]: audit 2020-07-16T13:31:24.171825+0000 mon.a (mon.0) 169 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:24.168707\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:24.168796\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}}, \"last_daemon_update\": \"2020-07-16T13:31:24.168865\", \"last_device_update\": \"2020-07-16T13:30:51.483581\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:31:25.100 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:24 smithi132 bash[27079]: audit 2020-07-16T13:31:24.172904+0000 mon.a (mon.0) 170 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2020-07-16T13:31:25.100 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:24 smithi132 bash[27079]: audit 2020-07-16T13:31:24.173530+0000 mon.a (mon.0) 171 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:31:25.100 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:24 smithi132 bash[27079]: audit 2020-07-16T13:31:24.174299+0000 mon.a (mon.0) 172 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2020-07-16T13:31:25.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:24 smithi188 bash[23329]: cluster 2020-07-16T13:31:23.698538+0000 mgr.y (mgr.14140) 42 : cluster [DBG] pgmap v33: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:31:25.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:24 smithi188 bash[23329]: audit 2020-07-16T13:31:24.169332+0000 mon.a (mon.0) 168 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:24.168707\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:24.168796\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}}, \"last_daemon_update\": \"2020-07-16T13:31:24.168865\", \"last_device_update\": \"2020-07-16T13:30:51.483581\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:31:25.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:24 smithi188 bash[23329]: audit 2020-07-16T13:31:24.171825+0000 mon.a (mon.0) 169 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:24.168707\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:24.168796\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}}, \"last_daemon_update\": \"2020-07-16T13:31:24.168865\", \"last_device_update\": \"2020-07-16T13:30:51.483581\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:31:25.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:24 smithi188 bash[23329]: audit 2020-07-16T13:31:24.172904+0000 mon.a (mon.0) 170 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2020-07-16T13:31:25.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:24 smithi188 bash[23329]: audit 2020-07-16T13:31:24.173530+0000 mon.a (mon.0) 171 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:31:25.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:24 smithi188 bash[23329]: audit 2020-07-16T13:31:24.174299+0000 mon.a (mon.0) 172 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2020-07-16T13:31:25.704 INFO:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4c8ed362-c768-11ea-a06f-001a4aab830c -- ceph orch daemon add osd smithi132:vg_nvme/lv_4 2020-07-16T13:31:25.957 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:25 smithi132 bash[23299]: cephadm 2020-07-16T13:31:24.172719+0000 mgr.y (mgr.14140) 43 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2020-07-16T13:31:25.958 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:25 smithi132 bash[23299]: cephadm 2020-07-16T13:31:24.174007+0000 mgr.y (mgr.14140) 44 : cephadm [INF] Reconfiguring daemon mgr.y on smithi132 2020-07-16T13:31:25.958 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:25 smithi132 bash[27079]: cephadm 2020-07-16T13:31:24.172719+0000 mgr.y (mgr.14140) 43 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2020-07-16T13:31:25.958 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:25 smithi132 bash[27079]: cephadm 2020-07-16T13:31:24.174007+0000 mgr.y (mgr.14140) 44 : cephadm [INF] Reconfiguring daemon mgr.y on smithi132 2020-07-16T13:31:26.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:25 smithi188 bash[23329]: cephadm 2020-07-16T13:31:24.172719+0000 mgr.y (mgr.14140) 43 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2020-07-16T13:31:26.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:25 smithi188 bash[23329]: cephadm 2020-07-16T13:31:24.174007+0000 mgr.y (mgr.14140) 44 : cephadm [INF] Reconfiguring daemon mgr.y on smithi132 2020-07-16T13:31:27.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:26 smithi188 bash[23329]: cluster 2020-07-16T13:31:25.698816+0000 mgr.y (mgr.14140) 45 : cluster [DBG] pgmap v34: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:31:27.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:26 smithi188 bash[23329]: audit 2020-07-16T13:31:25.989359+0000 mon.a (mon.0) 173 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:30:59.761726\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:30:59.761838\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}}, \"last_device_update\": \"2020-07-16T13:30:10.631612\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:31:27.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:26 smithi188 bash[23329]: audit 2020-07-16T13:31:25.992210+0000 mon.a (mon.0) 174 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:30:59.761726\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:30:59.761838\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}}, \"last_device_update\": \"2020-07-16T13:30:10.631612\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:31:27.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:26 smithi188 bash[23329]: audit 2020-07-16T13:31:25.992776+0000 mon.a (mon.0) 175 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:31:27.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:26 smithi132 bash[27079]: cluster 2020-07-16T13:31:25.698816+0000 mgr.y (mgr.14140) 45 : cluster [DBG] pgmap v34: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:31:27.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:26 smithi132 bash[27079]: audit 2020-07-16T13:31:25.989359+0000 mon.a (mon.0) 173 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:30:59.761726\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:30:59.761838\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}}, \"last_device_update\": \"2020-07-16T13:30:10.631612\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:31:27.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:26 smithi132 bash[27079]: audit 2020-07-16T13:31:25.992210+0000 mon.a (mon.0) 174 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:30:59.761726\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:30:59.761838\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}}, \"last_device_update\": \"2020-07-16T13:30:10.631612\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:31:27.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:26 smithi132 bash[27079]: audit 2020-07-16T13:31:25.992776+0000 mon.a (mon.0) 175 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:31:27.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:26 smithi132 bash[23299]: cluster 2020-07-16T13:31:25.698816+0000 mgr.y (mgr.14140) 45 : cluster [DBG] pgmap v34: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:31:27.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:26 smithi132 bash[23299]: audit 2020-07-16T13:31:25.989359+0000 mon.a (mon.0) 173 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:30:59.761726\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:30:59.761838\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}}, \"last_device_update\": \"2020-07-16T13:30:10.631612\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:31:27.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:26 smithi132 bash[23299]: audit 2020-07-16T13:31:25.992210+0000 mon.a (mon.0) 174 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:30:59.761726\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:30:59.761838\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}}, \"last_device_update\": \"2020-07-16T13:30:10.631612\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:31:27.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:26 smithi132 bash[23299]: audit 2020-07-16T13:31:25.992776+0000 mon.a (mon.0) 175 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:31:28.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:27 smithi188 bash[23329]: audit 2020-07-16T13:31:27.319429+0000 mon.a (mon.0) 176 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:27.318656\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:27.318746\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:27.318778\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}}, \"last_daemon_update\": \"2020-07-16T13:31:27.318851\", \"last_device_update\": \"2020-07-16T13:30:10.631612\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:31:28.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:27 smithi188 bash[23329]: audit 2020-07-16T13:31:27.321974+0000 mon.a (mon.0) 177 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:27.318656\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:27.318746\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:27.318778\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}}, \"last_daemon_update\": \"2020-07-16T13:31:27.318851\", \"last_device_update\": \"2020-07-16T13:30:10.631612\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:31:28.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:27 smithi188 bash[23329]: cluster 2020-07-16T13:31:27.618860+0000 mon.a (mon.0) 178 : cluster [DBG] Standby manager daemon x started 2020-07-16T13:31:28.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:27 smithi188 bash[23329]: audit 2020-07-16T13:31:27.619764+0000 mon.b (mon.2) 2 : audit [DBG] from='mgr.? 172.21.15.188:0/1233951704' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2020-07-16T13:31:28.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:27 smithi188 bash[23329]: audit 2020-07-16T13:31:27.620810+0000 mon.b (mon.2) 3 : audit [DBG] from='mgr.? 172.21.15.188:0/1233951704' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2020-07-16T13:31:28.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:27 smithi188 bash[23329]: audit 2020-07-16T13:31:27.718747+0000 mon.a (mon.0) 179 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-07-16T13:31:28.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:27 smithi188 bash[23329]: audit 2020-07-16T13:31:27.719285+0000 mon.a (mon.0) 180 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:31:28.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:27 smithi188 bash[23329]: audit 2020-07-16T13:31:27.719899+0000 mon.a (mon.0) 181 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:31:28.177 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:27 smithi132 bash[23299]: audit 2020-07-16T13:31:27.319429+0000 mon.a (mon.0) 176 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:27.318656\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:27.318746\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:27.318778\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}}, \"last_daemon_update\": \"2020-07-16T13:31:27.318851\", \"last_device_update\": \"2020-07-16T13:30:10.631612\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:31:28.178 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:27 smithi132 bash[23299]: audit 2020-07-16T13:31:27.321974+0000 mon.a (mon.0) 177 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:27.318656\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:27.318746\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:27.318778\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}}, \"last_daemon_update\": \"2020-07-16T13:31:27.318851\", \"last_device_update\": \"2020-07-16T13:30:10.631612\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:31:28.178 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:27 smithi132 bash[23299]: cluster 2020-07-16T13:31:27.618860+0000 mon.a (mon.0) 178 : cluster [DBG] Standby manager daemon x started 2020-07-16T13:31:28.178 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:27 smithi132 bash[23299]: audit 2020-07-16T13:31:27.619764+0000 mon.b (mon.2) 2 : audit [DBG] from='mgr.? 172.21.15.188:0/1233951704' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2020-07-16T13:31:28.178 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:27 smithi132 bash[23299]: audit 2020-07-16T13:31:27.620810+0000 mon.b (mon.2) 3 : audit [DBG] from='mgr.? 172.21.15.188:0/1233951704' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2020-07-16T13:31:28.179 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:27 smithi132 bash[23299]: audit 2020-07-16T13:31:27.718747+0000 mon.a (mon.0) 179 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-07-16T13:31:28.179 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:27 smithi132 bash[23299]: audit 2020-07-16T13:31:27.719285+0000 mon.a (mon.0) 180 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:31:28.179 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:27 smithi132 bash[23299]: audit 2020-07-16T13:31:27.719899+0000 mon.a (mon.0) 181 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:31:28.179 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:27 smithi132 bash[27079]: audit 2020-07-16T13:31:27.319429+0000 mon.a (mon.0) 176 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:27.318656\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:27.318746\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:27.318778\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}}, \"last_daemon_update\": \"2020-07-16T13:31:27.318851\", \"last_device_update\": \"2020-07-16T13:30:10.631612\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:31:28.180 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:27 smithi132 bash[27079]: audit 2020-07-16T13:31:27.321974+0000 mon.a (mon.0) 177 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:27.318656\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:27.318746\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:27.318778\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}}, \"last_daemon_update\": \"2020-07-16T13:31:27.318851\", \"last_device_update\": \"2020-07-16T13:30:10.631612\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:31:28.180 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:27 smithi132 bash[27079]: cluster 2020-07-16T13:31:27.618860+0000 mon.a (mon.0) 178 : cluster [DBG] Standby manager daemon x started 2020-07-16T13:31:28.180 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:27 smithi132 bash[27079]: audit 2020-07-16T13:31:27.619764+0000 mon.b (mon.2) 2 : audit [DBG] from='mgr.? 172.21.15.188:0/1233951704' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2020-07-16T13:31:28.180 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:27 smithi132 bash[27079]: audit 2020-07-16T13:31:27.620810+0000 mon.b (mon.2) 3 : audit [DBG] from='mgr.? 172.21.15.188:0/1233951704' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2020-07-16T13:31:28.180 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:27 smithi132 bash[27079]: audit 2020-07-16T13:31:27.718747+0000 mon.a (mon.0) 179 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-07-16T13:31:28.181 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:27 smithi132 bash[27079]: audit 2020-07-16T13:31:27.719285+0000 mon.a (mon.0) 180 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:31:28.181 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:27 smithi132 bash[27079]: audit 2020-07-16T13:31:27.719899+0000 mon.a (mon.0) 181 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:31:29.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:28 smithi188 bash[23329]: cluster 2020-07-16T13:31:27.699079+0000 mgr.y (mgr.14140) 46 : cluster [DBG] pgmap v35: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:31:29.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:28 smithi188 bash[23329]: audit 2020-07-16T13:31:27.717674+0000 mgr.y (mgr.14140) 47 : audit [DBG] from='client.14199 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi132:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:31:29.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:28 smithi188 bash[23329]: cephadm 2020-07-16T13:31:27.718499+0000 mgr.y (mgr.14140) 48 : cephadm [INF] Applying osd on host smithi132... 2020-07-16T13:31:29.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:28 smithi188 bash[23329]: cluster 2020-07-16T13:31:28.329399+0000 mon.a (mon.0) 182 : cluster [DBG] mgrmap e14: y(active, since 82s), standbys: x 2020-07-16T13:31:29.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:28 smithi188 bash[23329]: audit 2020-07-16T13:31:28.329510+0000 mon.a (mon.0) 183 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2020-07-16T13:31:29.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:28 smithi132 bash[23299]: cluster 2020-07-16T13:31:27.699079+0000 mgr.y (mgr.14140) 46 : cluster [DBG] pgmap v35: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:31:29.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:28 smithi132 bash[23299]: audit 2020-07-16T13:31:27.717674+0000 mgr.y (mgr.14140) 47 : audit [DBG] from='client.14199 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi132:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:31:29.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:28 smithi132 bash[23299]: cephadm 2020-07-16T13:31:27.718499+0000 mgr.y (mgr.14140) 48 : cephadm [INF] Applying osd on host smithi132... 2020-07-16T13:31:29.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:28 smithi132 bash[23299]: cluster 2020-07-16T13:31:28.329399+0000 mon.a (mon.0) 182 : cluster [DBG] mgrmap e14: y(active, since 82s), standbys: x 2020-07-16T13:31:29.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:28 smithi132 bash[23299]: audit 2020-07-16T13:31:28.329510+0000 mon.a (mon.0) 183 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2020-07-16T13:31:29.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:28 smithi132 bash[27079]: cluster 2020-07-16T13:31:27.699079+0000 mgr.y (mgr.14140) 46 : cluster [DBG] pgmap v35: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:31:29.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:28 smithi132 bash[27079]: audit 2020-07-16T13:31:27.717674+0000 mgr.y (mgr.14140) 47 : audit [DBG] from='client.14199 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi132:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:31:29.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:28 smithi132 bash[27079]: cephadm 2020-07-16T13:31:27.718499+0000 mgr.y (mgr.14140) 48 : cephadm [INF] Applying osd on host smithi132... 2020-07-16T13:31:29.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:28 smithi132 bash[27079]: cluster 2020-07-16T13:31:28.329399+0000 mon.a (mon.0) 182 : cluster [DBG] mgrmap e14: y(active, since 82s), standbys: x 2020-07-16T13:31:29.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:28 smithi132 bash[27079]: audit 2020-07-16T13:31:28.329510+0000 mon.a (mon.0) 183 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2020-07-16T13:31:30.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:30 smithi188 bash[23329]: cluster 2020-07-16T13:31:29.699547+0000 mgr.y (mgr.14140) 49 : cluster [DBG] pgmap v36: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:31:30.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:30 smithi188 bash[23329]: audit 2020-07-16T13:31:29.964186+0000 mon.c (mon.1) 3 : audit [INF] from='client.? 172.21.15.132:0/1277811038' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "882744a6-1a4e-4c33-86ea-b3ae0c9db141"}]: dispatch 2020-07-16T13:31:30.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:30 smithi188 bash[23329]: audit 2020-07-16T13:31:29.964444+0000 mon.a (mon.0) 184 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "882744a6-1a4e-4c33-86ea-b3ae0c9db141"}]: dispatch 2020-07-16T13:31:30.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:30 smithi188 bash[23329]: audit 2020-07-16T13:31:29.970200+0000 mon.a (mon.0) 185 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "882744a6-1a4e-4c33-86ea-b3ae0c9db141"}]': finished 2020-07-16T13:31:30.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:30 smithi188 bash[23329]: cluster 2020-07-16T13:31:29.970248+0000 mon.a (mon.0) 186 : cluster [DBG] osdmap e7: 1 total, 0 up, 0 in 2020-07-16T13:31:30.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:30 smithi188 bash[23329]: audit 2020-07-16T13:31:29.970367+0000 mon.a (mon.0) 187 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-07-16T13:31:31.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:30 smithi132 bash[23299]: cluster 2020-07-16T13:31:29.699547+0000 mgr.y (mgr.14140) 49 : cluster [DBG] pgmap v36: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:31:31.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:30 smithi132 bash[23299]: audit 2020-07-16T13:31:29.964186+0000 mon.c (mon.1) 3 : audit [INF] from='client.? 172.21.15.132:0/1277811038' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "882744a6-1a4e-4c33-86ea-b3ae0c9db141"}]: dispatch 2020-07-16T13:31:31.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:30 smithi132 bash[23299]: audit 2020-07-16T13:31:29.964444+0000 mon.a (mon.0) 184 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "882744a6-1a4e-4c33-86ea-b3ae0c9db141"}]: dispatch 2020-07-16T13:31:31.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:30 smithi132 bash[23299]: audit 2020-07-16T13:31:29.970200+0000 mon.a (mon.0) 185 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "882744a6-1a4e-4c33-86ea-b3ae0c9db141"}]': finished 2020-07-16T13:31:31.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:30 smithi132 bash[23299]: cluster 2020-07-16T13:31:29.970248+0000 mon.a (mon.0) 186 : cluster [DBG] osdmap e7: 1 total, 0 up, 0 in 2020-07-16T13:31:31.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:30 smithi132 bash[23299]: audit 2020-07-16T13:31:29.970367+0000 mon.a (mon.0) 187 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-07-16T13:31:31.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:30 smithi132 bash[27079]: cluster 2020-07-16T13:31:29.699547+0000 mgr.y (mgr.14140) 49 : cluster [DBG] pgmap v36: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:31:31.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:30 smithi132 bash[27079]: audit 2020-07-16T13:31:29.964186+0000 mon.c (mon.1) 3 : audit [INF] from='client.? 172.21.15.132:0/1277811038' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "882744a6-1a4e-4c33-86ea-b3ae0c9db141"}]: dispatch 2020-07-16T13:31:31.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:30 smithi132 bash[27079]: audit 2020-07-16T13:31:29.964444+0000 mon.a (mon.0) 184 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "882744a6-1a4e-4c33-86ea-b3ae0c9db141"}]: dispatch 2020-07-16T13:31:31.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:30 smithi132 bash[27079]: audit 2020-07-16T13:31:29.970200+0000 mon.a (mon.0) 185 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "882744a6-1a4e-4c33-86ea-b3ae0c9db141"}]': finished 2020-07-16T13:31:31.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:30 smithi132 bash[27079]: cluster 2020-07-16T13:31:29.970248+0000 mon.a (mon.0) 186 : cluster [DBG] osdmap e7: 1 total, 0 up, 0 in 2020-07-16T13:31:31.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:30 smithi132 bash[27079]: audit 2020-07-16T13:31:29.970367+0000 mon.a (mon.0) 187 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-07-16T13:31:32.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:31 smithi132 bash[23299]: audit 2020-07-16T13:31:31.661916+0000 mon.a (mon.0) 188 : audit [DBG] from='client.? 172.21.15.132:0/3239547892' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-07-16T13:31:32.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:31 smithi132 bash[27079]: audit 2020-07-16T13:31:31.661916+0000 mon.a (mon.0) 188 : audit [DBG] from='client.? 172.21.15.132:0/3239547892' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-07-16T13:31:32.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:31 smithi188 bash[23329]: audit 2020-07-16T13:31:31.661916+0000 mon.a (mon.0) 188 : audit [DBG] from='client.? 172.21.15.132:0/3239547892' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-07-16T13:31:33.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:32 smithi132 bash[23299]: cluster 2020-07-16T13:31:31.699875+0000 mgr.y (mgr.14140) 50 : cluster [DBG] pgmap v38: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:31:33.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:32 smithi132 bash[27079]: cluster 2020-07-16T13:31:31.699875+0000 mgr.y (mgr.14140) 50 : cluster [DBG] pgmap v38: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:31:33.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:32 smithi188 bash[23329]: cluster 2020-07-16T13:31:31.699875+0000 mgr.y (mgr.14140) 50 : cluster [DBG] pgmap v38: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:31:35.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:34 smithi132 bash[23299]: cluster 2020-07-16T13:31:33.700353+0000 mgr.y (mgr.14140) 51 : cluster [DBG] pgmap v39: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:31:35.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:34 smithi132 bash[23299]: audit 2020-07-16T13:31:34.063921+0000 mon.a (mon.0) 189 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:31:35.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:34 smithi132 bash[27079]: cluster 2020-07-16T13:31:33.700353+0000 mgr.y (mgr.14140) 51 : cluster [DBG] pgmap v39: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:31:35.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:34 smithi132 bash[27079]: audit 2020-07-16T13:31:34.063921+0000 mon.a (mon.0) 189 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:31:35.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:34 smithi188 bash[23329]: cluster 2020-07-16T13:31:33.700353+0000 mgr.y (mgr.14140) 51 : cluster [DBG] pgmap v39: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:31:35.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:34 smithi188 bash[23329]: audit 2020-07-16T13:31:34.063921+0000 mon.a (mon.0) 189 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:31:36.912 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:36 smithi132 bash[23299]: cluster 2020-07-16T13:31:35.700669+0000 mgr.y (mgr.14140) 52 : cluster [DBG] pgmap v40: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:31:36.912 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:36 smithi132 bash[23299]: audit 2020-07-16T13:31:36.217556+0000 mon.a (mon.0) 190 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2020-07-16T13:31:36.912 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:36 smithi132 bash[23299]: audit 2020-07-16T13:31:36.218100+0000 mon.a (mon.0) 191 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:31:36.912 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:36 smithi132 bash[23299]: audit 2020-07-16T13:31:36.218674+0000 mon.a (mon.0) 192 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.0", "key": "container_image"}]: dispatch 2020-07-16T13:31:36.913 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:36 smithi132 bash[27079]: cluster 2020-07-16T13:31:35.700669+0000 mgr.y (mgr.14140) 52 : cluster [DBG] pgmap v40: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:31:36.913 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:36 smithi132 bash[27079]: audit 2020-07-16T13:31:36.217556+0000 mon.a (mon.0) 190 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2020-07-16T13:31:36.913 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:36 smithi132 bash[27079]: audit 2020-07-16T13:31:36.218100+0000 mon.a (mon.0) 191 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:31:36.913 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:36 smithi132 bash[27079]: audit 2020-07-16T13:31:36.218674+0000 mon.a (mon.0) 192 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.0", "key": "container_image"}]: dispatch 2020-07-16T13:31:37.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:36 smithi188 bash[23329]: cluster 2020-07-16T13:31:35.700669+0000 mgr.y (mgr.14140) 52 : cluster [DBG] pgmap v40: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:31:37.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:36 smithi188 bash[23329]: audit 2020-07-16T13:31:36.217556+0000 mon.a (mon.0) 190 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2020-07-16T13:31:37.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:36 smithi188 bash[23329]: audit 2020-07-16T13:31:36.218100+0000 mon.a (mon.0) 191 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:31:37.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:36 smithi188 bash[23329]: audit 2020-07-16T13:31:36.218674+0000 mon.a (mon.0) 192 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.0", "key": "container_image"}]: dispatch 2020-07-16T13:31:37.596 INFO:teuthology.orchestra.run.smithi132.stdout:Created osd(s) 0 on host 'smithi132' 2020-07-16T13:31:37.929 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:37 smithi132 bash[27079]: cephadm 2020-07-16T13:31:36.218493+0000 mgr.y (mgr.14140) 53 : cephadm [INF] Deploying daemon osd.0 on smithi132 2020-07-16T13:31:37.930 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:37 smithi132 bash[27079]: audit 2020-07-16T13:31:37.589705+0000 mon.a (mon.0) 193 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:27.318656\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:27.318746\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:27.318778\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}}, \"last_device_update\": \"2020-07-16T13:30:10.631612\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:31:37.930 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:37 smithi132 bash[27079]: audit 2020-07-16T13:31:37.590330+0000 mon.a (mon.0) 194 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:31:37.930 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:37 smithi132 bash[27079]: audit 2020-07-16T13:31:37.592670+0000 mon.a (mon.0) 195 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:27.318656\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:27.318746\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:27.318778\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}}, \"last_device_update\": \"2020-07-16T13:30:10.631612\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:31:37.931 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:37 smithi132 bash[23299]: cephadm 2020-07-16T13:31:36.218493+0000 mgr.y (mgr.14140) 53 : cephadm [INF] Deploying daemon osd.0 on smithi132 2020-07-16T13:31:37.931 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:37 smithi132 bash[23299]: audit 2020-07-16T13:31:37.589705+0000 mon.a (mon.0) 193 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:27.318656\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:27.318746\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:27.318778\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}}, \"last_device_update\": \"2020-07-16T13:30:10.631612\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:31:37.931 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:37 smithi132 bash[23299]: audit 2020-07-16T13:31:37.590330+0000 mon.a (mon.0) 194 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:31:37.932 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:37 smithi132 bash[23299]: audit 2020-07-16T13:31:37.592670+0000 mon.a (mon.0) 195 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:27.318656\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:27.318746\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:27.318778\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}}, \"last_device_update\": \"2020-07-16T13:30:10.631612\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:31:38.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:37 smithi188 bash[23329]: cephadm 2020-07-16T13:31:36.218493+0000 mgr.y (mgr.14140) 53 : cephadm [INF] Deploying daemon osd.0 on smithi132 2020-07-16T13:31:38.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:37 smithi188 bash[23329]: audit 2020-07-16T13:31:37.589705+0000 mon.a (mon.0) 193 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:27.318656\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:27.318746\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:27.318778\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}}, \"last_device_update\": \"2020-07-16T13:30:10.631612\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:31:38.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:37 smithi188 bash[23329]: audit 2020-07-16T13:31:37.590330+0000 mon.a (mon.0) 194 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:31:38.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:37 smithi188 bash[23329]: audit 2020-07-16T13:31:37.592670+0000 mon.a (mon.0) 195 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:27.318656\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:27.318746\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:27.318778\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}}, \"last_device_update\": \"2020-07-16T13:30:10.631612\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:31:38.223 INFO:teuthology.orchestra.run.smithi132:osd.0> sudo journalctl -f -n 0 -u ceph-4c8ed362-c768-11ea-a06f-001a4aab830c@osd.0.service 2020-07-16T13:31:38.226 INFO:tasks.cephadm:Deploying osd.1 on smithi132 with /dev/vg_nvme/lv_3... 2020-07-16T13:31:38.227 INFO:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4c8ed362-c768-11ea-a06f-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2020-07-16T13:31:38.263 INFO:journalctl@ceph.osd.0.smithi132.stdout:-- Logs begin at Thu 2020-07-16 13:22:27 UTC. -- 2020-07-16T13:31:38.765 INFO:journalctl@ceph.osd.0.smithi132.stdout:Jul 16 13:31:38 smithi132 bash[28832]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2020-07-16T13:31:38.766 INFO:journalctl@ceph.osd.0.smithi132.stdout:Jul 16 13:31:38 smithi132 bash[28832]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-0 --no-mon-config 2020-07-16T13:31:38.766 INFO:journalctl@ceph.osd.0.smithi132.stdout:Jul 16 13:31:38 smithi132 bash[28832]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0/block 2020-07-16T13:31:38.766 INFO:journalctl@ceph.osd.0.smithi132.stdout:Jul 16 13:31:38 smithi132 bash[28832]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-0/block 2020-07-16T13:31:38.767 INFO:journalctl@ceph.osd.0.smithi132.stdout:Jul 16 13:31:38 smithi132 bash[28832]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2020-07-16T13:31:38.767 INFO:journalctl@ceph.osd.0.smithi132.stdout:Jul 16 13:31:38 smithi132 bash[28832]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2020-07-16T13:31:38.767 INFO:journalctl@ceph.osd.0.smithi132.stdout:Jul 16 13:31:38 smithi132 bash[28832]: --> ceph-volume lvm activate successful for osd ID: 0 2020-07-16T13:31:38.767 INFO:journalctl@ceph.osd.0.smithi132.stdout:Jul 16 13:31:38 smithi132 podman[28834]: 2020-07-16 13:31:38.608296769 +0000 UTC m=+1.035521791 container died 931255c80828fe69eac6ee5e398d84ca3ffba2de21235daa9c41a453e5740fc7 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.0-activate) 2020-07-16T13:31:38.767 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:38 smithi132 bash[23299]: cluster 2020-07-16T13:31:37.700942+0000 mgr.y (mgr.14140) 54 : cluster [DBG] pgmap v41: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:31:39.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:38 smithi132 bash[27079]: cluster 2020-07-16T13:31:37.700942+0000 mgr.y (mgr.14140) 54 : cluster [DBG] pgmap v41: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:31:39.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:38 smithi188 bash[23329]: cluster 2020-07-16T13:31:37.700942+0000 mgr.y (mgr.14140) 54 : cluster [DBG] pgmap v41: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:31:39.428 INFO:journalctl@ceph.osd.0.smithi132.stdout:Jul 16 13:31:39 smithi132 podman[28834]: 2020-07-16 13:31:39.193171279 +0000 UTC m=+1.620396302 container remove 931255c80828fe69eac6ee5e398d84ca3ffba2de21235daa9c41a453e5740fc7 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.0-activate) 2020-07-16T13:31:39.767 INFO:journalctl@ceph.osd.0.smithi132.stdout:Jul 16 13:31:39 smithi132 podman[29137]: 2020-07-16 13:31:39.469657703 +0000 UTC m=+0.261463410 container create 440f85c650d20182619b45dffd9d7463ed0b4dc6e338c23347aac9e4d881fad9 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.0) 2020-07-16T13:31:39.767 INFO:journalctl@ceph.osd.0.smithi132.stdout:Jul 16 13:31:39 smithi132 podman[29137]: 2020-07-16 13:31:39.610749501 +0000 UTC m=+0.402555209 container init 440f85c650d20182619b45dffd9d7463ed0b4dc6e338c23347aac9e4d881fad9 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.0) 2020-07-16T13:31:40.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:39 smithi132 bash[23299]: audit 2020-07-16T13:31:39.443518+0000 mon.a (mon.0) 196 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442778\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442854\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442885\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442913\", \"created\": \"2020-07-16T13:31:37.557928\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}}, \"last_daemon_update\": \"2020-07-16T13:31:39.442972\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:31:40.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:39 smithi132 bash[23299]: audit 2020-07-16T13:31:39.446512+0000 mon.a (mon.0) 197 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442778\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442854\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442885\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442913\", \"created\": \"2020-07-16T13:31:37.557928\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}}, \"last_daemon_update\": \"2020-07-16T13:31:39.442972\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:31:40.031 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:39 smithi132 bash[23299]: audit 2020-07-16T13:31:39.446973+0000 mon.a (mon.0) 198 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:31:40.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:39 smithi132 bash[27079]: audit 2020-07-16T13:31:39.443518+0000 mon.a (mon.0) 196 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442778\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442854\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442885\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442913\", \"created\": \"2020-07-16T13:31:37.557928\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}}, \"last_daemon_update\": \"2020-07-16T13:31:39.442972\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:31:40.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:39 smithi132 bash[27079]: audit 2020-07-16T13:31:39.446512+0000 mon.a (mon.0) 197 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442778\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442854\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442885\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442913\", \"created\": \"2020-07-16T13:31:37.557928\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}}, \"last_daemon_update\": \"2020-07-16T13:31:39.442972\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:31:40.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:39 smithi132 bash[27079]: audit 2020-07-16T13:31:39.446973+0000 mon.a (mon.0) 198 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:31:40.032 INFO:journalctl@ceph.osd.0.smithi132.stdout:Jul 16 13:31:39 smithi132 podman[29137]: 2020-07-16 13:31:39.866907056 +0000 UTC m=+0.658712832 container start 440f85c650d20182619b45dffd9d7463ed0b4dc6e338c23347aac9e4d881fad9 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.0) 2020-07-16T13:31:40.032 INFO:journalctl@ceph.osd.0.smithi132.stdout:Jul 16 13:31:39 smithi132 podman[29137]: 2020-07-16 13:31:39.867381013 +0000 UTC m=+0.659186742 container attach 440f85c650d20182619b45dffd9d7463ed0b4dc6e338c23347aac9e4d881fad9 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.0) 2020-07-16T13:31:40.032 INFO:journalctl@ceph.osd.0.smithi132.stdout:Jul 16 13:31:39 smithi132 bash[28832]: debug 2020-07-16T13:31:39.643+0000 7f09a2690ec0 1 -- 172.21.15.132:0/1817294451 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f8578cc00 msgr2=0x559f85789680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T13:31:40.033 INFO:journalctl@ceph.osd.0.smithi132.stdout:Jul 16 13:31:39 smithi132 bash[28832]: debug 2020-07-16T13:31:39.643+0000 7f099c6dd700 20 -- 172.21.15.132:0/1817294451 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f8578cc00 msgr2=0x559f85789680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).process 2020-07-16T13:31:40.033 INFO:journalctl@ceph.osd.0.smithi132.stdout:Jul 16 13:31:39 smithi132 bash[28832]: debug 2020-07-16T13:31:39.643+0000 7f099c6dd700 20 -- 172.21.15.132:0/1817294451 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f8578cc00 msgr2=0x559f85789680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read continue len=32 2020-07-16T13:31:40.033 INFO:journalctl@ceph.osd.0.smithi132.stdout:Jul 16 13:31:39 smithi132 bash[28832]: debug 2020-07-16T13:31:39.643+0000 7f099c6dd700 20 --2- 172.21.15.132:0/1817294451 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f8578cc00 0x559f85789680 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x559f8571fd10 tx=0x559f863f8aa0).handle_read_frame_preamble_main r=0 2020-07-16T13:31:40.033 INFO:journalctl@ceph.osd.0.smithi132.stdout:Jul 16 13:31:39 smithi132 bash[28832]: debug 2020-07-16T13:31:39.643+0000 7f099c6dd700 10 --2- 172.21.15.132:0/1817294451 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f8578cc00 0x559f85789680 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x559f8571fd10 tx=0x559f863f8aa0).handle_read_frame_preamble_main got encrypted preamble. after decrypt premable.length()=32 2020-07-16T13:31:40.033 INFO:journalctl@ceph.osd.0.smithi132.stdout:Jul 16 13:31:39 smithi132 bash[28832]: debug 2020-07-16T13:31:39.643+0000 7f099c6dd700 10 --2- 172.21.15.132:0/1817294451 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f8578cc00 0x559f85789680 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x559f8571fd10 tx=0x559f863f8aa0).handle_read_frame_preamble_main got new segment: len=41 align=8 2020-07-16T13:31:40.034 INFO:journalctl@ceph.osd.0.smithi132.stdout:Jul 16 13:31:39 smithi132 bash[28832]: debug 2020-07-16T13:31:39.643+0000 7f099c6dd700 10 --2- 172.21.15.132:0/1817294451 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f8578cc00 0x559f85789680 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x559f8571fd10 tx=0x559f863f8aa0).handle_read_frame_preamble_main got new segment: len=194 align=8 2020-07-16T13:31:40.034 INFO:journalctl@ceph.osd.0.smithi132.stdout:Jul 16 13:31:39 smithi132 bash[28832]: debug 2020-07-16T13:31:39.643+0000 7f099c6dd700 20 --2- 172.21.15.132:0/1817294451 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f8578cc00 0x559f85789680 secure :-1 s=THROTTLE_MESSAGE pgs=92 cs=0 l=1 rx=0x559f8571fd10 tx=0x559f863f8aa0).throttle_message 2020-07-16T13:31:40.034 INFO:journalctl@ceph.osd.0.smithi132.stdout:Jul 16 13:31:39 smithi132 bash[28832]: debug 2020-07-16T13:31:39.643+0000 7f099c6dd700 20 --2- 172.21.15.132:0/1817294451 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f8578cc00 0x559f85789680 secure :-1 s=THROTTLE_BYTES pgs=92 cs=0 l=1 rx=0x559f8571fd10 tx=0x559f863f8aa0).throttle_bytes 2020-07-16T13:31:40.034 INFO:journalctl@ceph.osd.0.smithi132.stdout:Jul 16 13:31:39 smithi132 bash[28832]: debug 2020-07-16T13:31:39.643+0000 7f099c6dd700 20 --2- 172.21.15.132:0/1817294451 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f8578cc00 0x559f85789680 secure :-1 s=THROTTLE_DISPATCH_QUEUE pgs=92 cs=0 l=1 rx=0x559f8571fd10 tx=0x559f863f8aa0).throttle_dispatch_queue 2020-07-16T13:31:40.034 INFO:journalctl@ceph.osd.0.smithi132.stdout:Jul 16 13:31:39 smithi132 bash[28832]: debug 2020-07-16T13:31:39.643+0000 7f099c6dd700 20 --2- 172.21.15.132:0/1817294451 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f8578cc00 0x559f85789680 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x559f8571fd10 tx=0x559f863f8aa0).read_frame_segment 2020-07-16T13:31:40.035 INFO:journalctl@ceph.osd.0.smithi132.stdout:Jul 16 13:31:39 smithi132 bash[28832]: debug 2020-07-16T13:31:39.643+0000 7f099c6dd700 20 -- 172.21.15.132:0/1817294451 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f8578cc00 msgr2=0x559f85789680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=48 2020-07-16T13:31:40.035 INFO:journalctl@ceph.osd.0.smithi132.stdout:Jul 16 13:31:39 smithi132 bash[28832]: debug 2020-07-16T13:31:39.643+0000 7f099c6dd700 20 --2- 172.21.15.132:0/1817294451 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f8578cc00 0x559f85789680 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x559f8571fd10 tx=0x559f863f8aa0).handle_read_frame_segment r=0 2020-07-16T13:31:40.035 INFO:journalctl@ceph.osd.0.smithi132.stdout:Jul 16 13:31:39 smithi132 bash[28832]: debug 2020-07-16T13:31:39.643+0000 7f099c6dd700 20 --2- 172.21.15.132:0/1817294451 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f8578cc00 0x559f85789680 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x559f8571fd10 tx=0x559f863f8aa0).handle_read_frame_segment unpadded new_seg.length()=41 2020-07-16T13:31:40.035 INFO:journalctl@ceph.osd.0.smithi132.stdout:Jul 16 13:31:39 smithi132 bash[28832]: debug 2020-07-16T13:31:39.643+0000 7f099c6dd700 20 --2- 172.21.15.132:0/1817294451 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f8578cc00 0x559f85789680 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x559f8571fd10 tx=0x559f863f8aa0).read_frame_segment 2020-07-16T13:31:40.035 INFO:journalctl@ceph.osd.0.smithi132.stdout:Jul 16 13:31:39 smithi132 bash[28832]: debug 2020-07-16T13:31:39.643+0000 7f099c6dd700 20 -- 172.21.15.132:0/1817294451 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f8578cc00 msgr2=0x559f85789680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=208 2020-07-16T13:31:40.036 INFO:journalctl@ceph.osd.0.smithi132.stdout:Jul 16 13:31:39 smithi132 bash[28832]: debug 2020-07-16T13:31:39.643+0000 7f099c6dd700 20 --2- 172.21.15.132:0/1817294451 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f8578cc00 0x559f85789680 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x559f8571fd10 tx=0x559f863f8aa0).handle_read_frame_segment r=0 2020-07-16T13:31:40.036 INFO:journalctl@ceph.osd.0.smithi132.stdout:Jul 16 13:31:39 smithi132 bash[28832]: debug 2020-07-16T13:31:39.643+0000 7f099c6dd700 20 --2- 172.21.15.132:0/1817294451 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f8578cc00 0x559f85789680 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x559f8571fd10 tx=0x559f863f8aa0).handle_read_frame_segment unpadded new_seg.length()=194 2020-07-16T13:31:40.036 INFO:journalctl@ceph.osd.0.smithi132.stdout:Jul 16 13:31:39 smithi132 bash[28832]: debug 2020-07-16T13:31:39.643+0000 7f099c6dd700 20 -- 172.21.15.132:0/1817294451 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f8578cc00 msgr2=0x559f85789680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=32 2020-07-16T13:31:40.036 INFO:journalctl@ceph.osd.0.smithi132.stdout:Jul 16 13:31:39 smithi132 bash[28832]: debug 2020-07-16T13:31:39.643+0000 7f099c6dd700 20 --2- 172.21.15.132:0/1817294451 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f8578cc00 0x559f85789680 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x559f8571fd10 tx=0x559f863f8aa0).handle_read_frame_epilogue_main r=0 2020-07-16T13:31:40.036 INFO:journalctl@ceph.osd.0.smithi132.stdout:Jul 16 13:31:39 smithi132 bash[28832]: debug 2020-07-16T13:31:39.643+0000 7f099c6dd700 1 --2- 172.21.15.132:0/1817294451 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f8578cc00 0x559f85789680 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x559f8571fd10 tx=0x559f863f8aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-07-16T13:31:40.037 INFO:journalctl@ceph.osd.0.smithi132.stdout:Jul 16 13:31:39 smithi132 bash[28832]: debug 2020-07-16T13:31:39.643+0000 7f099c6dd700 10 --2- 172.21.15.132:0/1817294451 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f8578cc00 0x559f85789680 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x559f8571fd10 tx=0x559f863f8aa0).handle_read_frame_dispatch tag=17 2020-07-16T13:31:40.037 INFO:journalctl@ceph.osd.0.smithi132.stdout:Jul 16 13:31:39 smithi132 bash[28832]: debug 2020-07-16T13:31:39.643+0000 7f099c6dd700 20 --2- 172.21.15.132:0/1817294451 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f8578cc00 0x559f85789680 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x559f8571fd10 tx=0x559f863f8aa0).handle_message 2020-07-16T13:31:40.037 INFO:journalctl@ceph.osd.0.smithi132.stdout:Jul 16 13:31:39 smithi132 bash[28832]: debug 2020-07-16T13:31:39.643+0000 7f099c6dd700 5 --2- 172.21.15.132:0/1817294451 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f8578cc00 0x559f85789680 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x559f8571fd10 tx=0x559f863f8aa0).handle_message got 194 + 0 + 0 byte message. envelope type=18 src mon.0 off 0 2020-07-16T13:31:40.037 INFO:journalctl@ceph.osd.0.smithi132.stdout:Jul 16 13:31:39 smithi132 bash[28832]: debug 2020-07-16T13:31:39.643+0000 7f099c6dd700 5 --2- 172.21.15.132:0/1817294451 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f8578cc00 0x559f85789680 secure :-1 s=READ_MESSAGE_COMPLETE pgs=92 cs=0 l=1 rx=0x559f8571fd10 tx=0x559f863f8aa0).handle_message received message m=0x559f857244e0 seq=4 from=mon.0 type=18 auth_reply(proto 2 0 (0) Success) v1 2020-07-16T13:31:40.037 INFO:journalctl@ceph.osd.0.smithi132.stdout:Jul 16 13:31:39 smithi132 bash[28832]: debug 2020-07-16T13:31:39.643+0000 7f099c6dd700 20 -- 172.21.15.132:0/1817294451 queue 0x559f857244e0 prio 196 2020-07-16T13:31:40.038 INFO:journalctl@ceph.osd.0.smithi132.stdout:Jul 16 13:31:39 smithi132 bash[28832]: debug 2020-07-16T13:31:39.643+0000 7f099c6dd700 20 --2- 172.21.15.132:0/1817294451 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f8578cc00 0x559f85789680 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x559f8571fd10 tx=0x559f863f8aa0).read_frame 2020-07-16T13:31:40.038 INFO:journalctl@ceph.osd.0.smithi132.stdout:Jul 16 13:31:39 smithi132 bash[28832]: debug 2020-07-16T13:31:39.643+0000 7f099c6dd700 20 -- 172.21.15.132:0/1817294451 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f8578cc00 msgr2=0x559f85789680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=32 2020-07-16T13:31:40.038 INFO:journalctl@ceph.osd.0.smithi132.stdout:Jul 16 13:31:39 smithi132 bash[28832]: debug 2020-07-16T13:31:39.643+0000 7f099b6db700 1 -- 172.21.15.132:0/1817294451 <== mon.0 v2:172.21.15.132:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x559f857244e0 con 0x559f8578cc00 2020-07-16T13:31:40.038 INFO:journalctl@ceph.osd.0.smithi132.stdout:Jul 16 13:31:39 smithi132 bash[28832]: debug 2020-07-16T13:31:39.643+0000 7f09a2690ec0 1 --2- 172.21.15.132:0/1817294451 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f8578cc00 0x559f85789680 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x559f8571fd10 tx=0x559f863f8aa0).stop 2020-07-16T13:31:40.038 INFO:journalctl@ceph.osd.0.smithi132.stdout:Jul 16 13:31:39 smithi132 bash[28832]: debug 2020-07-16T13:31:39.643+0000 7f09a2690ec0 5 --2- 172.21.15.132:0/1817294451 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f8578cc00 0x559f85789680 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x559f8571fd10 tx=0x559f863f8aa0).reset_recv_state 2020-07-16T13:31:40.039 INFO:journalctl@ceph.osd.0.smithi132.stdout:Jul 16 13:31:39 smithi132 bash[28832]: debug 2020-07-16T13:31:39.643+0000 7f09a2690ec0 20 Event(0x559f85731040 nevent=5000 time_id=3).wakeup 2020-07-16T13:31:40.039 INFO:journalctl@ceph.osd.0.smithi132.stdout:Jul 16 13:31:39 smithi132 bash[28832]: debug 2020-07-16T13:31:39.643+0000 7f09a2690ec0 10 --2- 172.21.15.132:0/1817294451 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f8578cc00 0x559f85789680 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x559f8571fd10 tx=0x559f863f8aa0).discard_out_queue started 2020-07-16T13:31:40.039 INFO:journalctl@ceph.osd.0.smithi132.stdout:Jul 16 13:31:39 smithi132 bash[28832]: debug 2020-07-16T13:31:39.643+0000 7f099c6dd700 5 --2- 172.21.15.132:0/1817294451 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f8578cc00 0x559f85789680 secure :-1 s=CLOSED pgs=92 cs=0 l=1 rx=0x559f8571fd10 tx=0x559f863f8aa0).reset_recv_state (warped) reseting crypto handlers 2020-07-16T13:31:40.039 INFO:journalctl@ceph.osd.0.smithi132.stdout:Jul 16 13:31:39 smithi132 bash[28832]: debug 2020-07-16T13:31:39.643+0000 7f099c6dd700 5 --2- 172.21.15.132:0/1817294451 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f8578cc00 0x559f85789680 secure :-1 s=CLOSED pgs=92 cs=0 l=1 rx=0x559f8571fd10 tx=0x559f863f8aa0).reset_security 2020-07-16T13:31:40.039 INFO:journalctl@ceph.osd.0.smithi132.stdout:Jul 16 13:31:39 smithi132 bash[28832]: debug 2020-07-16T13:31:39.643+0000 7f099c6dd700 20 EpollDriver.del_event del event fd=14 cur_mask=1 delmask=3 to 8 2020-07-16T13:31:40.040 INFO:journalctl@ceph.osd.0.smithi132.stdout:Jul 16 13:31:39 smithi132 bash[28832]: debug 2020-07-16T13:31:39.643+0000 7f099b6db700 10 -- 172.21.15.132:0/1817294451 dispatch_throttle_release 194 to dispatch throttler 194/104857600 2020-07-16T13:31:40.040 INFO:journalctl@ceph.osd.0.smithi132.stdout:Jul 16 13:31:39 smithi132 bash[28832]: debug 2020-07-16T13:31:39.643+0000 7f099b6db700 20 -- 172.21.15.132:0/1817294451 done calling dispatch on 0x559f857244e0 2020-07-16T13:31:40.040 INFO:journalctl@ceph.osd.0.smithi132.stdout:Jul 16 13:31:39 smithi132 bash[28832]: debug 2020-07-16T13:31:39.909+0000 7f09a2690ec0 -1 Falling back to public interface 2020-07-16T13:31:40.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:39 smithi188 bash[23329]: audit 2020-07-16T13:31:39.443518+0000 mon.a (mon.0) 196 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442778\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442854\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442885\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442913\", \"created\": \"2020-07-16T13:31:37.557928\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}}, \"last_daemon_update\": \"2020-07-16T13:31:39.442972\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:31:40.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:39 smithi188 bash[23329]: audit 2020-07-16T13:31:39.446512+0000 mon.a (mon.0) 197 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442778\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442854\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442885\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442913\", \"created\": \"2020-07-16T13:31:37.557928\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}}, \"last_daemon_update\": \"2020-07-16T13:31:39.442972\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:31:40.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:39 smithi188 bash[23329]: audit 2020-07-16T13:31:39.446973+0000 mon.a (mon.0) 198 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:31:40.715 INFO:journalctl@ceph.osd.0.smithi132.stdout:Jul 16 13:31:40 smithi132 bash[28832]: debug 2020-07-16T13:31:40.461+0000 7f09a2690ec0 -1 osd.0 0 log_to_monitors {default=true} 2020-07-16T13:31:41.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:40 smithi132 bash[27079]: cluster 2020-07-16T13:31:39.701401+0000 mgr.y (mgr.14140) 55 : cluster [DBG] pgmap v42: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:31:41.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:40 smithi132 bash[27079]: audit 2020-07-16T13:31:40.465439+0000 mon.c (mon.1) 4 : audit [INF] from='osd.0 [v2:172.21.15.132:6802/498701893,v1:172.21.15.132:6803/498701893]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2020-07-16T13:31:41.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:40 smithi132 bash[27079]: audit 2020-07-16T13:31:40.465720+0000 mon.a (mon.0) 199 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2020-07-16T13:31:41.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:40 smithi132 bash[23299]: cluster 2020-07-16T13:31:39.701401+0000 mgr.y (mgr.14140) 55 : cluster [DBG] pgmap v42: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:31:41.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:40 smithi132 bash[23299]: audit 2020-07-16T13:31:40.465439+0000 mon.c (mon.1) 4 : audit [INF] from='osd.0 [v2:172.21.15.132:6802/498701893,v1:172.21.15.132:6803/498701893]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2020-07-16T13:31:41.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:40 smithi132 bash[23299]: audit 2020-07-16T13:31:40.465720+0000 mon.a (mon.0) 199 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2020-07-16T13:31:41.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:40 smithi188 bash[23329]: cluster 2020-07-16T13:31:39.701401+0000 mgr.y (mgr.14140) 55 : cluster [DBG] pgmap v42: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:31:41.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:40 smithi188 bash[23329]: audit 2020-07-16T13:31:40.465439+0000 mon.c (mon.1) 4 : audit [INF] from='osd.0 [v2:172.21.15.132:6802/498701893,v1:172.21.15.132:6803/498701893]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2020-07-16T13:31:41.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:40 smithi188 bash[23329]: audit 2020-07-16T13:31:40.465720+0000 mon.a (mon.0) 199 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2020-07-16T13:31:41.228 INFO:teuthology.orchestra.run.smithi132.stderr:--> Zapping: /dev/vg_nvme/lv_3 2020-07-16T13:31:41.228 INFO:teuthology.orchestra.run.smithi132.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2020-07-16T13:31:41.229 INFO:teuthology.orchestra.run.smithi132.stderr: stderr: 10+0 records in 2020-07-16T13:31:41.229 INFO:teuthology.orchestra.run.smithi132.stderr:10+0 records out 2020-07-16T13:31:41.229 INFO:teuthology.orchestra.run.smithi132.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0117018 s, 896 MB/s 2020-07-16T13:31:41.230 INFO:teuthology.orchestra.run.smithi132.stderr: stderr: 2020-07-16T13:31:41.230 INFO:teuthology.orchestra.run.smithi132.stderr:--> Zapping successful for: 2020-07-16T13:31:41.658 INFO:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4c8ed362-c768-11ea-a06f-001a4aab830c -- ceph orch daemon add osd smithi132:vg_nvme/lv_3 2020-07-16T13:31:41.928 INFO:journalctl@ceph.osd.0.smithi132.stdout:Jul 16 13:31:41 smithi132 bash[28832]: debug 2020-07-16T13:31:41.777+0000 7f098743d700 -1 osd.0 0 waiting for initial osdmap 2020-07-16T13:31:41.929 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:41 smithi132 bash[23299]: audit 2020-07-16T13:31:40.773729+0000 mon.a (mon.0) 200 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2020-07-16T13:31:41.929 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:41 smithi132 bash[23299]: cluster 2020-07-16T13:31:40.773771+0000 mon.a (mon.0) 201 : cluster [DBG] osdmap e8: 1 total, 0 up, 0 in 2020-07-16T13:31:41.929 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:41 smithi132 bash[23299]: audit 2020-07-16T13:31:40.774271+0000 mon.a (mon.0) 202 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-07-16T13:31:41.930 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:41 smithi132 bash[23299]: audit 2020-07-16T13:31:40.774377+0000 mon.c (mon.1) 5 : audit [INF] from='osd.0 [v2:172.21.15.132:6802/498701893,v1:172.21.15.132:6803/498701893]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]: dispatch 2020-07-16T13:31:41.930 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:41 smithi132 bash[23299]: audit 2020-07-16T13:31:40.774719+0000 mon.a (mon.0) 203 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]: dispatch 2020-07-16T13:31:41.930 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:41 smithi132 bash[23299]: audit 2020-07-16T13:31:41.774095+0000 mon.a (mon.0) 204 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]': finished 2020-07-16T13:31:41.931 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:41 smithi132 bash[23299]: cluster 2020-07-16T13:31:41.774137+0000 mon.a (mon.0) 205 : cluster [DBG] osdmap e9: 1 total, 0 up, 0 in 2020-07-16T13:31:41.931 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:41 smithi132 bash[23299]: audit 2020-07-16T13:31:41.774242+0000 mon.a (mon.0) 206 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-07-16T13:31:41.931 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:41 smithi132 bash[27079]: audit 2020-07-16T13:31:40.773729+0000 mon.a (mon.0) 200 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2020-07-16T13:31:41.931 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:41 smithi132 bash[27079]: cluster 2020-07-16T13:31:40.773771+0000 mon.a (mon.0) 201 : cluster [DBG] osdmap e8: 1 total, 0 up, 0 in 2020-07-16T13:31:41.931 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:41 smithi132 bash[27079]: audit 2020-07-16T13:31:40.774271+0000 mon.a (mon.0) 202 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-07-16T13:31:41.932 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:41 smithi132 bash[27079]: audit 2020-07-16T13:31:40.774377+0000 mon.c (mon.1) 5 : audit [INF] from='osd.0 [v2:172.21.15.132:6802/498701893,v1:172.21.15.132:6803/498701893]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]: dispatch 2020-07-16T13:31:41.932 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:41 smithi132 bash[27079]: audit 2020-07-16T13:31:40.774719+0000 mon.a (mon.0) 203 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]: dispatch 2020-07-16T13:31:41.932 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:41 smithi132 bash[27079]: audit 2020-07-16T13:31:41.774095+0000 mon.a (mon.0) 204 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]': finished 2020-07-16T13:31:41.932 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:41 smithi132 bash[27079]: cluster 2020-07-16T13:31:41.774137+0000 mon.a (mon.0) 205 : cluster [DBG] osdmap e9: 1 total, 0 up, 0 in 2020-07-16T13:31:41.932 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:41 smithi132 bash[27079]: audit 2020-07-16T13:31:41.774242+0000 mon.a (mon.0) 206 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-07-16T13:31:42.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:41 smithi188 bash[23329]: audit 2020-07-16T13:31:40.773729+0000 mon.a (mon.0) 200 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2020-07-16T13:31:42.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:41 smithi188 bash[23329]: cluster 2020-07-16T13:31:40.773771+0000 mon.a (mon.0) 201 : cluster [DBG] osdmap e8: 1 total, 0 up, 0 in 2020-07-16T13:31:42.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:41 smithi188 bash[23329]: audit 2020-07-16T13:31:40.774271+0000 mon.a (mon.0) 202 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-07-16T13:31:42.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:41 smithi188 bash[23329]: audit 2020-07-16T13:31:40.774377+0000 mon.c (mon.1) 5 : audit [INF] from='osd.0 [v2:172.21.15.132:6802/498701893,v1:172.21.15.132:6803/498701893]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]: dispatch 2020-07-16T13:31:42.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:41 smithi188 bash[23329]: audit 2020-07-16T13:31:40.774719+0000 mon.a (mon.0) 203 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]: dispatch 2020-07-16T13:31:42.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:41 smithi188 bash[23329]: audit 2020-07-16T13:31:41.774095+0000 mon.a (mon.0) 204 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]': finished 2020-07-16T13:31:42.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:41 smithi188 bash[23329]: cluster 2020-07-16T13:31:41.774137+0000 mon.a (mon.0) 205 : cluster [DBG] osdmap e9: 1 total, 0 up, 0 in 2020-07-16T13:31:42.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:41 smithi188 bash[23329]: audit 2020-07-16T13:31:41.774242+0000 mon.a (mon.0) 206 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-07-16T13:31:43.066 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:42 smithi132 bash[23299]: cluster 2020-07-16T13:31:41.485237+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2020-07-16T13:31:43.066 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:42 smithi132 bash[23299]: cluster 2020-07-16T13:31:41.485294+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2020-07-16T13:31:43.067 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:42 smithi132 bash[23299]: cluster 2020-07-16T13:31:41.701718+0000 mgr.y (mgr.14140) 56 : cluster [DBG] pgmap v44: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:31:43.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:42 smithi132 bash[27079]: cluster 2020-07-16T13:31:41.485237+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2020-07-16T13:31:43.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:42 smithi132 bash[27079]: cluster 2020-07-16T13:31:41.485294+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2020-07-16T13:31:43.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:42 smithi132 bash[27079]: cluster 2020-07-16T13:31:41.701718+0000 mgr.y (mgr.14140) 56 : cluster [DBG] pgmap v44: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:31:43.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:42 smithi188 bash[23329]: cluster 2020-07-16T13:31:41.485237+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2020-07-16T13:31:43.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:42 smithi188 bash[23329]: cluster 2020-07-16T13:31:41.485294+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2020-07-16T13:31:43.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:42 smithi188 bash[23329]: cluster 2020-07-16T13:31:41.701718+0000 mgr.y (mgr.14140) 56 : cluster [DBG] pgmap v44: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:31:44.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:43 smithi132 bash[23299]: cluster 2020-07-16T13:31:42.792085+0000 mon.a (mon.0) 207 : cluster [INF] osd.0 [v2:172.21.15.132:6802/498701893,v1:172.21.15.132:6803/498701893] boot 2020-07-16T13:31:44.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:43 smithi132 bash[23299]: cluster 2020-07-16T13:31:42.792126+0000 mon.a (mon.0) 208 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2020-07-16T13:31:44.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:43 smithi132 bash[23299]: audit 2020-07-16T13:31:42.792599+0000 mon.a (mon.0) 209 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-07-16T13:31:44.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:43 smithi132 bash[23299]: audit 2020-07-16T13:31:43.347559+0000 mon.a (mon.0) 210 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:31:44.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:43 smithi132 bash[23299]: audit 2020-07-16T13:31:43.534759+0000 mon.a (mon.0) 211 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442778\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442854\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442885\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442913\", \"created\": \"2020-07-16T13:31:37.557928\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}}, \"last_daemon_update\": \"2020-07-16T13:31:39.442972\", \"last_device_update\": \"2020-07-16T13:31:43.534151\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:31:44.031 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:43 smithi132 bash[23299]: audit 2020-07-16T13:31:43.537444+0000 mon.a (mon.0) 212 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442778\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442854\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442885\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442913\", \"created\": \"2020-07-16T13:31:37.557928\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}}, \"last_daemon_update\": \"2020-07-16T13:31:39.442972\", \"last_device_update\": \"2020-07-16T13:31:43.534151\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:31:44.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:43 smithi132 bash[27079]: cluster 2020-07-16T13:31:42.792085+0000 mon.a (mon.0) 207 : cluster [INF] osd.0 [v2:172.21.15.132:6802/498701893,v1:172.21.15.132:6803/498701893] boot 2020-07-16T13:31:44.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:43 smithi132 bash[27079]: cluster 2020-07-16T13:31:42.792126+0000 mon.a (mon.0) 208 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2020-07-16T13:31:44.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:43 smithi132 bash[27079]: audit 2020-07-16T13:31:42.792599+0000 mon.a (mon.0) 209 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-07-16T13:31:44.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:43 smithi132 bash[27079]: audit 2020-07-16T13:31:43.347559+0000 mon.a (mon.0) 210 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:31:44.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:43 smithi132 bash[27079]: audit 2020-07-16T13:31:43.534759+0000 mon.a (mon.0) 211 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442778\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442854\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442885\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442913\", \"created\": \"2020-07-16T13:31:37.557928\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}}, \"last_daemon_update\": \"2020-07-16T13:31:39.442972\", \"last_device_update\": \"2020-07-16T13:31:43.534151\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:31:44.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:43 smithi132 bash[27079]: audit 2020-07-16T13:31:43.537444+0000 mon.a (mon.0) 212 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442778\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442854\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442885\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442913\", \"created\": \"2020-07-16T13:31:37.557928\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}}, \"last_daemon_update\": \"2020-07-16T13:31:39.442972\", \"last_device_update\": \"2020-07-16T13:31:43.534151\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:31:44.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:43 smithi188 bash[23329]: cluster 2020-07-16T13:31:42.792085+0000 mon.a (mon.0) 207 : cluster [INF] osd.0 [v2:172.21.15.132:6802/498701893,v1:172.21.15.132:6803/498701893] boot 2020-07-16T13:31:44.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:43 smithi188 bash[23329]: cluster 2020-07-16T13:31:42.792126+0000 mon.a (mon.0) 208 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2020-07-16T13:31:44.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:43 smithi188 bash[23329]: audit 2020-07-16T13:31:42.792599+0000 mon.a (mon.0) 209 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-07-16T13:31:44.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:43 smithi188 bash[23329]: audit 2020-07-16T13:31:43.347559+0000 mon.a (mon.0) 210 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:31:44.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:43 smithi188 bash[23329]: audit 2020-07-16T13:31:43.534759+0000 mon.a (mon.0) 211 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442778\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442854\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442885\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442913\", \"created\": \"2020-07-16T13:31:37.557928\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}}, \"last_daemon_update\": \"2020-07-16T13:31:39.442972\", \"last_device_update\": \"2020-07-16T13:31:43.534151\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:31:44.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:43 smithi188 bash[23329]: audit 2020-07-16T13:31:43.537444+0000 mon.a (mon.0) 212 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442778\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442854\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442885\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442913\", \"created\": \"2020-07-16T13:31:37.557928\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}}, \"last_daemon_update\": \"2020-07-16T13:31:39.442972\", \"last_device_update\": \"2020-07-16T13:31:43.534151\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:31:45.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:44 smithi132 bash[23299]: cluster 2020-07-16T13:31:43.702012+0000 mgr.y (mgr.14140) 57 : cluster [DBG] pgmap v47: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:31:45.031 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:44 smithi132 bash[23299]: cluster 2020-07-16T13:31:43.793713+0000 mon.a (mon.0) 213 : cluster [DBG] osdmap e11: 1 total, 1 up, 1 in 2020-07-16T13:31:45.031 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:44 smithi132 bash[23299]: audit 2020-07-16T13:31:43.934489+0000 mgr.y (mgr.14140) 58 : audit [DBG] from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi132:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:31:45.032 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:44 smithi132 bash[23299]: cephadm 2020-07-16T13:31:43.935068+0000 mgr.y (mgr.14140) 59 : cephadm [INF] Applying osd on host smithi132... 2020-07-16T13:31:45.032 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:44 smithi132 bash[23299]: audit 2020-07-16T13:31:43.935331+0000 mon.a (mon.0) 214 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-07-16T13:31:45.032 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:44 smithi132 bash[23299]: audit 2020-07-16T13:31:43.935828+0000 mon.a (mon.0) 215 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:31:45.033 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:44 smithi132 bash[23299]: audit 2020-07-16T13:31:43.936458+0000 mon.a (mon.0) 216 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:31:45.033 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:44 smithi132 bash[23299]: cluster 2020-07-16T13:31:44.795944+0000 mon.a (mon.0) 217 : cluster [DBG] osdmap e12: 1 total, 1 up, 1 in 2020-07-16T13:31:45.033 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:44 smithi132 bash[27079]: cluster 2020-07-16T13:31:43.702012+0000 mgr.y (mgr.14140) 57 : cluster [DBG] pgmap v47: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:31:45.033 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:44 smithi132 bash[27079]: cluster 2020-07-16T13:31:43.793713+0000 mon.a (mon.0) 213 : cluster [DBG] osdmap e11: 1 total, 1 up, 1 in 2020-07-16T13:31:45.034 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:44 smithi132 bash[27079]: audit 2020-07-16T13:31:43.934489+0000 mgr.y (mgr.14140) 58 : audit [DBG] from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi132:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:31:45.034 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:44 smithi132 bash[27079]: cephadm 2020-07-16T13:31:43.935068+0000 mgr.y (mgr.14140) 59 : cephadm [INF] Applying osd on host smithi132... 2020-07-16T13:31:45.034 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:44 smithi132 bash[27079]: audit 2020-07-16T13:31:43.935331+0000 mon.a (mon.0) 214 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-07-16T13:31:45.034 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:44 smithi132 bash[27079]: audit 2020-07-16T13:31:43.935828+0000 mon.a (mon.0) 215 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:31:45.035 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:44 smithi132 bash[27079]: audit 2020-07-16T13:31:43.936458+0000 mon.a (mon.0) 216 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:31:45.035 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:44 smithi132 bash[27079]: cluster 2020-07-16T13:31:44.795944+0000 mon.a (mon.0) 217 : cluster [DBG] osdmap e12: 1 total, 1 up, 1 in 2020-07-16T13:31:45.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:44 smithi188 bash[23329]: cluster 2020-07-16T13:31:43.702012+0000 mgr.y (mgr.14140) 57 : cluster [DBG] pgmap v47: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-07-16T13:31:45.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:44 smithi188 bash[23329]: cluster 2020-07-16T13:31:43.793713+0000 mon.a (mon.0) 213 : cluster [DBG] osdmap e11: 1 total, 1 up, 1 in 2020-07-16T13:31:45.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:44 smithi188 bash[23329]: audit 2020-07-16T13:31:43.934489+0000 mgr.y (mgr.14140) 58 : audit [DBG] from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi132:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:31:45.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:44 smithi188 bash[23329]: cephadm 2020-07-16T13:31:43.935068+0000 mgr.y (mgr.14140) 59 : cephadm [INF] Applying osd on host smithi132... 2020-07-16T13:31:45.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:44 smithi188 bash[23329]: audit 2020-07-16T13:31:43.935331+0000 mon.a (mon.0) 214 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-07-16T13:31:45.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:44 smithi188 bash[23329]: audit 2020-07-16T13:31:43.935828+0000 mon.a (mon.0) 215 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:31:45.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:44 smithi188 bash[23329]: audit 2020-07-16T13:31:43.936458+0000 mon.a (mon.0) 216 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:31:45.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:44 smithi188 bash[23329]: cluster 2020-07-16T13:31:44.795944+0000 mon.a (mon.0) 217 : cluster [DBG] osdmap e12: 1 total, 1 up, 1 in 2020-07-16T13:31:46.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:45 smithi188 bash[23329]: cluster 2020-07-16T13:31:45.801655+0000 mon.a (mon.0) 218 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2020-07-16T13:31:46.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:45 smithi132 bash[23299]: cluster 2020-07-16T13:31:45.801655+0000 mon.a (mon.0) 218 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2020-07-16T13:31:46.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:45 smithi132 bash[27079]: cluster 2020-07-16T13:31:45.801655+0000 mon.a (mon.0) 218 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2020-07-16T13:31:47.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:46 smithi188 bash[23329]: cluster 2020-07-16T13:31:45.702313+0000 mgr.y (mgr.14140) 60 : cluster [DBG] pgmap v50: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 88 GiB / 89 GiB avail 2020-07-16T13:31:47.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:46 smithi188 bash[23329]: audit 2020-07-16T13:31:46.055230+0000 mon.c (mon.1) 6 : audit [INF] from='client.? 172.21.15.132:0/3590649625' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "39ea8fcd-c323-4683-9f7c-4f373a4e4f67"}]: dispatch 2020-07-16T13:31:47.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:46 smithi188 bash[23329]: audit 2020-07-16T13:31:46.055536+0000 mon.a (mon.0) 219 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "39ea8fcd-c323-4683-9f7c-4f373a4e4f67"}]: dispatch 2020-07-16T13:31:47.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:46 smithi188 bash[23329]: audit 2020-07-16T13:31:46.059062+0000 mon.a (mon.0) 220 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "39ea8fcd-c323-4683-9f7c-4f373a4e4f67"}]': finished 2020-07-16T13:31:47.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:46 smithi188 bash[23329]: cluster 2020-07-16T13:31:46.059109+0000 mon.a (mon.0) 221 : cluster [DBG] osdmap e13: 2 total, 1 up, 1 in 2020-07-16T13:31:47.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:46 smithi188 bash[23329]: audit 2020-07-16T13:31:46.059233+0000 mon.a (mon.0) 222 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2020-07-16T13:31:47.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:46 smithi132 bash[23299]: cluster 2020-07-16T13:31:45.702313+0000 mgr.y (mgr.14140) 60 : cluster [DBG] pgmap v50: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 88 GiB / 89 GiB avail 2020-07-16T13:31:47.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:46 smithi132 bash[23299]: audit 2020-07-16T13:31:46.055230+0000 mon.c (mon.1) 6 : audit [INF] from='client.? 172.21.15.132:0/3590649625' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "39ea8fcd-c323-4683-9f7c-4f373a4e4f67"}]: dispatch 2020-07-16T13:31:47.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:46 smithi132 bash[23299]: audit 2020-07-16T13:31:46.055536+0000 mon.a (mon.0) 219 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "39ea8fcd-c323-4683-9f7c-4f373a4e4f67"}]: dispatch 2020-07-16T13:31:47.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:46 smithi132 bash[23299]: audit 2020-07-16T13:31:46.059062+0000 mon.a (mon.0) 220 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "39ea8fcd-c323-4683-9f7c-4f373a4e4f67"}]': finished 2020-07-16T13:31:47.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:46 smithi132 bash[23299]: cluster 2020-07-16T13:31:46.059109+0000 mon.a (mon.0) 221 : cluster [DBG] osdmap e13: 2 total, 1 up, 1 in 2020-07-16T13:31:47.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:46 smithi132 bash[23299]: audit 2020-07-16T13:31:46.059233+0000 mon.a (mon.0) 222 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2020-07-16T13:31:47.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:46 smithi132 bash[27079]: cluster 2020-07-16T13:31:45.702313+0000 mgr.y (mgr.14140) 60 : cluster [DBG] pgmap v50: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 88 GiB / 89 GiB avail 2020-07-16T13:31:47.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:46 smithi132 bash[27079]: audit 2020-07-16T13:31:46.055230+0000 mon.c (mon.1) 6 : audit [INF] from='client.? 172.21.15.132:0/3590649625' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "39ea8fcd-c323-4683-9f7c-4f373a4e4f67"}]: dispatch 2020-07-16T13:31:47.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:46 smithi132 bash[27079]: audit 2020-07-16T13:31:46.055536+0000 mon.a (mon.0) 219 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "39ea8fcd-c323-4683-9f7c-4f373a4e4f67"}]: dispatch 2020-07-16T13:31:47.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:46 smithi132 bash[27079]: audit 2020-07-16T13:31:46.059062+0000 mon.a (mon.0) 220 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "39ea8fcd-c323-4683-9f7c-4f373a4e4f67"}]': finished 2020-07-16T13:31:47.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:46 smithi132 bash[27079]: cluster 2020-07-16T13:31:46.059109+0000 mon.a (mon.0) 221 : cluster [DBG] osdmap e13: 2 total, 1 up, 1 in 2020-07-16T13:31:47.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:46 smithi132 bash[27079]: audit 2020-07-16T13:31:46.059233+0000 mon.a (mon.0) 222 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2020-07-16T13:31:48.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:47 smithi188 bash[23329]: audit 2020-07-16T13:31:47.738634+0000 mon.c (mon.1) 7 : audit [DBG] from='client.? 172.21.15.132:0/3330743790' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-07-16T13:31:48.283 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:47 smithi132 bash[23299]: audit 2020-07-16T13:31:47.738634+0000 mon.c (mon.1) 7 : audit [DBG] from='client.? 172.21.15.132:0/3330743790' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-07-16T13:31:48.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:47 smithi132 bash[27079]: audit 2020-07-16T13:31:47.738634+0000 mon.c (mon.1) 7 : audit [DBG] from='client.? 172.21.15.132:0/3330743790' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-07-16T13:31:49.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:48 smithi188 bash[23329]: cluster 2020-07-16T13:31:47.702726+0000 mgr.y (mgr.14140) 61 : cluster [DBG] pgmap v52: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 88 GiB / 89 GiB avail 2020-07-16T13:31:49.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:48 smithi132 bash[23299]: cluster 2020-07-16T13:31:47.702726+0000 mgr.y (mgr.14140) 61 : cluster [DBG] pgmap v52: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 88 GiB / 89 GiB avail 2020-07-16T13:31:49.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:48 smithi132 bash[27079]: cluster 2020-07-16T13:31:47.702726+0000 mgr.y (mgr.14140) 61 : cluster [DBG] pgmap v52: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 88 GiB / 89 GiB avail 2020-07-16T13:31:50.851 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:50 smithi132 bash[23299]: cluster 2020-07-16T13:31:49.703136+0000 mgr.y (mgr.14140) 62 : cluster [DBG] pgmap v53: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2020-07-16T13:31:50.852 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:50 smithi132 bash[23299]: audit 2020-07-16T13:31:50.149203+0000 mon.a (mon.0) 223 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:31:50.852 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:50 smithi132 bash[27079]: cluster 2020-07-16T13:31:49.703136+0000 mgr.y (mgr.14140) 62 : cluster [DBG] pgmap v53: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2020-07-16T13:31:50.852 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:50 smithi132 bash[27079]: audit 2020-07-16T13:31:50.149203+0000 mon.a (mon.0) 223 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:31:50.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:50 smithi188 bash[23329]: cluster 2020-07-16T13:31:49.703136+0000 mgr.y (mgr.14140) 62 : cluster [DBG] pgmap v53: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2020-07-16T13:31:50.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:50 smithi188 bash[23329]: audit 2020-07-16T13:31:50.149203+0000 mon.a (mon.0) 223 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:31:53.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:52 smithi132 bash[27079]: cluster 2020-07-16T13:31:51.703425+0000 mgr.y (mgr.14140) 63 : cluster [DBG] pgmap v54: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2020-07-16T13:31:53.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:52 smithi132 bash[27079]: audit 2020-07-16T13:31:52.414264+0000 mon.a (mon.0) 224 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2020-07-16T13:31:53.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:52 smithi132 bash[27079]: audit 2020-07-16T13:31:52.414827+0000 mon.a (mon.0) 225 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:31:53.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:52 smithi132 bash[27079]: audit 2020-07-16T13:31:52.415367+0000 mon.a (mon.0) 226 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2020-07-16T13:31:53.031 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:52 smithi132 bash[23299]: cluster 2020-07-16T13:31:51.703425+0000 mgr.y (mgr.14140) 63 : cluster [DBG] pgmap v54: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2020-07-16T13:31:53.031 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:52 smithi132 bash[23299]: audit 2020-07-16T13:31:52.414264+0000 mon.a (mon.0) 224 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2020-07-16T13:31:53.031 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:52 smithi132 bash[23299]: audit 2020-07-16T13:31:52.414827+0000 mon.a (mon.0) 225 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:31:53.032 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:52 smithi132 bash[23299]: audit 2020-07-16T13:31:52.415367+0000 mon.a (mon.0) 226 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2020-07-16T13:31:53.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:52 smithi188 bash[23329]: cluster 2020-07-16T13:31:51.703425+0000 mgr.y (mgr.14140) 63 : cluster [DBG] pgmap v54: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2020-07-16T13:31:53.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:52 smithi188 bash[23329]: audit 2020-07-16T13:31:52.414264+0000 mon.a (mon.0) 224 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2020-07-16T13:31:53.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:52 smithi188 bash[23329]: audit 2020-07-16T13:31:52.414827+0000 mon.a (mon.0) 225 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:31:53.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:52 smithi188 bash[23329]: audit 2020-07-16T13:31:52.415367+0000 mon.a (mon.0) 226 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2020-07-16T13:31:53.814 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:53 smithi132 bash[27079]: cephadm 2020-07-16T13:31:52.415197+0000 mgr.y (mgr.14140) 64 : cephadm [INF] Deploying daemon osd.1 on smithi132 2020-07-16T13:31:53.814 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:53 smithi132 bash[23299]: cephadm 2020-07-16T13:31:52.415197+0000 mgr.y (mgr.14140) 64 : cephadm [INF] Deploying daemon osd.1 on smithi132 2020-07-16T13:31:53.858 INFO:teuthology.orchestra.run.smithi132.stdout:Created osd(s) 1 on host 'smithi132' 2020-07-16T13:31:54.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:53 smithi188 bash[23329]: cephadm 2020-07-16T13:31:52.415197+0000 mgr.y (mgr.14140) 64 : cephadm [INF] Deploying daemon osd.1 on smithi132 2020-07-16T13:31:54.577 INFO:teuthology.orchestra.run.smithi132:osd.1> sudo journalctl -f -n 0 -u ceph-4c8ed362-c768-11ea-a06f-001a4aab830c@osd.1.service 2020-07-16T13:31:54.579 INFO:tasks.cephadm:Deploying osd.2 on smithi132 with /dev/vg_nvme/lv_2... 2020-07-16T13:31:54.580 INFO:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4c8ed362-c768-11ea-a06f-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2020-07-16T13:31:54.614 INFO:journalctl@ceph.osd.1.smithi132.stdout:-- Logs begin at Thu 2020-07-16 13:22:27 UTC. -- 2020-07-16T13:31:54.823 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:54 smithi132 bash[27079]: cluster 2020-07-16T13:31:53.703770+0000 mgr.y (mgr.14140) 65 : cluster [DBG] pgmap v55: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2020-07-16T13:31:54.823 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:54 smithi132 bash[27079]: audit 2020-07-16T13:31:53.849249+0000 mon.a (mon.0) 227 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442778\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442854\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442885\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442913\", \"created\": \"2020-07-16T13:31:37.557928\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}}, \"last_device_update\": \"2020-07-16T13:31:43.534151\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:31:54.824 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:54 smithi132 bash[27079]: audit 2020-07-16T13:31:53.849795+0000 mon.a (mon.0) 228 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:31:54.824 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:54 smithi132 bash[27079]: audit 2020-07-16T13:31:53.854900+0000 mon.a (mon.0) 229 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442778\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442854\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442885\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442913\", \"created\": \"2020-07-16T13:31:37.557928\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}}, \"last_device_update\": \"2020-07-16T13:31:43.534151\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:31:54.824 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:54 smithi132 bash[27079]: cluster 2020-07-16T13:31:54.563949+0000 mon.a (mon.0) 230 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2020-07-16T13:31:54.825 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:54 smithi132 bash[23299]: cluster 2020-07-16T13:31:53.703770+0000 mgr.y (mgr.14140) 65 : cluster [DBG] pgmap v55: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2020-07-16T13:31:54.825 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:54 smithi132 bash[23299]: audit 2020-07-16T13:31:53.849249+0000 mon.a (mon.0) 227 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442778\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442854\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442885\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442913\", \"created\": \"2020-07-16T13:31:37.557928\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}}, \"last_device_update\": \"2020-07-16T13:31:43.534151\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:31:54.825 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:54 smithi132 bash[23299]: audit 2020-07-16T13:31:53.849795+0000 mon.a (mon.0) 228 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:31:54.825 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:54 smithi132 bash[23299]: audit 2020-07-16T13:31:53.854900+0000 mon.a (mon.0) 229 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442778\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442854\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442885\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442913\", \"created\": \"2020-07-16T13:31:37.557928\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}}, \"last_device_update\": \"2020-07-16T13:31:43.534151\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:31:54.826 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:54 smithi132 bash[23299]: cluster 2020-07-16T13:31:54.563949+0000 mon.a (mon.0) 230 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2020-07-16T13:31:55.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:54 smithi188 bash[23329]: cluster 2020-07-16T13:31:53.703770+0000 mgr.y (mgr.14140) 65 : cluster [DBG] pgmap v55: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2020-07-16T13:31:55.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:54 smithi188 bash[23329]: audit 2020-07-16T13:31:53.849249+0000 mon.a (mon.0) 227 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442778\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442854\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442885\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442913\", \"created\": \"2020-07-16T13:31:37.557928\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}}, \"last_device_update\": \"2020-07-16T13:31:43.534151\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:31:55.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:54 smithi188 bash[23329]: audit 2020-07-16T13:31:53.849795+0000 mon.a (mon.0) 228 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:31:55.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:54 smithi188 bash[23329]: audit 2020-07-16T13:31:53.854900+0000 mon.a (mon.0) 229 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442778\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442854\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442885\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:39.442913\", \"created\": \"2020-07-16T13:31:37.557928\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}}, \"last_device_update\": \"2020-07-16T13:31:43.534151\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:31:55.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:54 smithi188 bash[23329]: cluster 2020-07-16T13:31:54.563949+0000 mon.a (mon.0) 230 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2020-07-16T13:31:55.274 INFO:journalctl@ceph.osd.1.smithi132.stdout:Jul 16 13:31:54 smithi132 bash[30441]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2020-07-16T13:31:55.275 INFO:journalctl@ceph.osd.1.smithi132.stdout:Jul 16 13:31:54 smithi132 bash[30441]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-1 --no-mon-config 2020-07-16T13:31:55.275 INFO:journalctl@ceph.osd.1.smithi132.stdout:Jul 16 13:31:54 smithi132 bash[30441]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1/block 2020-07-16T13:31:55.275 INFO:journalctl@ceph.osd.1.smithi132.stdout:Jul 16 13:31:54 smithi132 bash[30441]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-1/block 2020-07-16T13:31:55.276 INFO:journalctl@ceph.osd.1.smithi132.stdout:Jul 16 13:31:54 smithi132 bash[30441]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2020-07-16T13:31:55.276 INFO:journalctl@ceph.osd.1.smithi132.stdout:Jul 16 13:31:54 smithi132 bash[30441]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2020-07-16T13:31:55.276 INFO:journalctl@ceph.osd.1.smithi132.stdout:Jul 16 13:31:54 smithi132 bash[30441]: --> ceph-volume lvm activate successful for osd ID: 1 2020-07-16T13:31:55.277 INFO:journalctl@ceph.osd.1.smithi132.stdout:Jul 16 13:31:54 smithi132 podman[30443]: 2020-07-16 13:31:54.949369611 +0000 UTC m=+1.115937178 container died a329753f3badaa7a94fc03334c5381d2fdafdeec80f0017097f4c4258a53143b (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.1-activate) 2020-07-16T13:31:56.386 INFO:journalctl@ceph.osd.1.smithi132.stdout:Jul 16 13:31:56 smithi132 podman[30769]: 2020-07-16 13:31:56.129440198 +0000 UTC m=+0.564621686 container create b7c66d3e8979c5c65db2355ddc91de3bb53ceff18a2bb0bc77ebf75c22985b64 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.1) 2020-07-16T13:31:56.668 INFO:journalctl@ceph.osd.1.smithi132.stdout:Jul 16 13:31:56 smithi132 podman[30769]: 2020-07-16 13:31:56.416525097 +0000 UTC m=+0.851706490 container init b7c66d3e8979c5c65db2355ddc91de3bb53ceff18a2bb0bc77ebf75c22985b64 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.1) 2020-07-16T13:31:56.668 INFO:journalctl@ceph.osd.1.smithi132.stdout:Jul 16 13:31:56 smithi132 podman[30769]: 2020-07-16 13:31:56.458130629 +0000 UTC m=+0.893312025 container start b7c66d3e8979c5c65db2355ddc91de3bb53ceff18a2bb0bc77ebf75c22985b64 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.1) 2020-07-16T13:31:56.669 INFO:journalctl@ceph.osd.1.smithi132.stdout:Jul 16 13:31:56 smithi132 podman[30769]: 2020-07-16 13:31:56.458191239 +0000 UTC m=+0.893372633 container attach b7c66d3e8979c5c65db2355ddc91de3bb53ceff18a2bb0bc77ebf75c22985b64 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.1) 2020-07-16T13:31:56.934 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:56 smithi132 bash[27079]: cluster 2020-07-16T13:31:55.704149+0000 mgr.y (mgr.14140) 66 : cluster [DBG] pgmap v56: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2020-07-16T13:31:56.935 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:56 smithi132 bash[27079]: audit 2020-07-16T13:31:55.768943+0000 mon.a (mon.0) 231 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768146\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768221\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768253\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768281\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768309\", \"created\": \"2020-07-16T13:31:53.818518\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}}, \"last_daemon_update\": \"2020-07-16T13:31:55.768397\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:31:56.935 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:56 smithi132 bash[27079]: audit 2020-07-16T13:31:55.773505+0000 mon.a (mon.0) 232 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768146\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768221\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768253\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768281\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768309\", \"created\": \"2020-07-16T13:31:53.818518\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}}, \"last_daemon_update\": \"2020-07-16T13:31:55.768397\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:31:56.935 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:56 smithi132 bash[27079]: audit 2020-07-16T13:31:55.773992+0000 mon.a (mon.0) 233 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:31:56.935 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:56 smithi132 bash[23299]: cluster 2020-07-16T13:31:55.704149+0000 mgr.y (mgr.14140) 66 : cluster [DBG] pgmap v56: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2020-07-16T13:31:56.936 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:56 smithi132 bash[23299]: audit 2020-07-16T13:31:55.768943+0000 mon.a (mon.0) 231 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768146\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768221\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768253\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768281\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768309\", \"created\": \"2020-07-16T13:31:53.818518\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}}, \"last_daemon_update\": \"2020-07-16T13:31:55.768397\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:31:56.936 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:56 smithi132 bash[23299]: audit 2020-07-16T13:31:55.773505+0000 mon.a (mon.0) 232 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768146\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768221\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768253\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768281\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768309\", \"created\": \"2020-07-16T13:31:53.818518\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}}, \"last_daemon_update\": \"2020-07-16T13:31:55.768397\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:31:56.936 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:56 smithi132 bash[23299]: audit 2020-07-16T13:31:55.773992+0000 mon.a (mon.0) 233 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:31:57.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:56 smithi188 bash[23329]: cluster 2020-07-16T13:31:55.704149+0000 mgr.y (mgr.14140) 66 : cluster [DBG] pgmap v56: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2020-07-16T13:31:57.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:56 smithi188 bash[23329]: audit 2020-07-16T13:31:55.768943+0000 mon.a (mon.0) 231 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768146\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768221\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768253\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768281\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768309\", \"created\": \"2020-07-16T13:31:53.818518\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}}, \"last_daemon_update\": \"2020-07-16T13:31:55.768397\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:31:57.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:56 smithi188 bash[23329]: audit 2020-07-16T13:31:55.773505+0000 mon.a (mon.0) 232 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768146\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768221\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768253\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768281\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768309\", \"created\": \"2020-07-16T13:31:53.818518\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}}, \"last_daemon_update\": \"2020-07-16T13:31:55.768397\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:31:57.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:56 smithi188 bash[23329]: audit 2020-07-16T13:31:55.773992+0000 mon.a (mon.0) 233 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:31:57.279 INFO:journalctl@ceph.osd.1.smithi132.stdout:Jul 16 13:31:56 smithi132 bash[30441]: debug 2020-07-16T13:31:56.964+0000 7f7662d9cec0 -1 Falling back to public interface 2020-07-16T13:31:57.513 INFO:teuthology.orchestra.run.smithi132.stderr:--> Zapping: /dev/vg_nvme/lv_2 2020-07-16T13:31:57.513 INFO:teuthology.orchestra.run.smithi132.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2020-07-16T13:31:57.514 INFO:teuthology.orchestra.run.smithi132.stderr: stderr: 10+0 records in 2020-07-16T13:31:57.514 INFO:teuthology.orchestra.run.smithi132.stderr:10+0 records out 2020-07-16T13:31:57.514 INFO:teuthology.orchestra.run.smithi132.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0152097 s, 689 MB/s 2020-07-16T13:31:57.514 INFO:teuthology.orchestra.run.smithi132.stderr: stderr: 2020-07-16T13:31:57.514 INFO:teuthology.orchestra.run.smithi132.stderr:--> Zapping successful for: 2020-07-16T13:31:57.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:57 smithi132 bash[27079]: audit 2020-07-16T13:31:57.529247+0000 mon.a (mon.0) 234 : audit [INF] from='osd.1 [v2:172.21.15.132:6810/1723454267,v1:172.21.15.132:6811/1723454267]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2020-07-16T13:31:57.779 INFO:journalctl@ceph.osd.1.smithi132.stdout:Jul 16 13:31:57 smithi132 bash[30441]: debug 2020-07-16T13:31:57.524+0000 7f7662d9cec0 -1 osd.1 0 log_to_monitors {default=true} 2020-07-16T13:31:57.780 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:57 smithi132 bash[23299]: audit 2020-07-16T13:31:57.529247+0000 mon.a (mon.0) 234 : audit [INF] from='osd.1 [v2:172.21.15.132:6810/1723454267,v1:172.21.15.132:6811/1723454267]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2020-07-16T13:31:58.097 INFO:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4c8ed362-c768-11ea-a06f-001a4aab830c -- ceph orch daemon add osd smithi132:vg_nvme/lv_2 2020-07-16T13:31:58.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:57 smithi188 bash[23329]: audit 2020-07-16T13:31:57.529247+0000 mon.a (mon.0) 234 : audit [INF] from='osd.1 [v2:172.21.15.132:6810/1723454267,v1:172.21.15.132:6811/1723454267]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2020-07-16T13:31:59.161 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:58 smithi132 bash[23299]: cluster 2020-07-16T13:31:57.704501+0000 mgr.y (mgr.14140) 67 : cluster [DBG] pgmap v57: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2020-07-16T13:31:59.162 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:58 smithi132 bash[23299]: audit 2020-07-16T13:31:57.779807+0000 mon.a (mon.0) 235 : audit [INF] from='osd.1 [v2:172.21.15.132:6810/1723454267,v1:172.21.15.132:6811/1723454267]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2020-07-16T13:31:59.162 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:58 smithi132 bash[23299]: cluster 2020-07-16T13:31:57.779850+0000 mon.a (mon.0) 236 : cluster [DBG] osdmap e14: 2 total, 1 up, 1 in 2020-07-16T13:31:59.162 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:58 smithi132 bash[23299]: audit 2020-07-16T13:31:57.779986+0000 mon.a (mon.0) 237 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2020-07-16T13:31:59.162 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:58 smithi132 bash[23299]: audit 2020-07-16T13:31:57.780318+0000 mon.a (mon.0) 238 : audit [INF] from='osd.1 [v2:172.21.15.132:6810/1723454267,v1:172.21.15.132:6811/1723454267]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]: dispatch 2020-07-16T13:31:59.163 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:58 smithi132 bash[23299]: cluster 2020-07-16T13:31:58.520286+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2020-07-16T13:31:59.163 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:58 smithi132 bash[23299]: cluster 2020-07-16T13:31:58.520338+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2020-07-16T13:31:59.163 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:58 smithi132 bash[27079]: cluster 2020-07-16T13:31:57.704501+0000 mgr.y (mgr.14140) 67 : cluster [DBG] pgmap v57: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2020-07-16T13:31:59.163 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:58 smithi132 bash[27079]: audit 2020-07-16T13:31:57.779807+0000 mon.a (mon.0) 235 : audit [INF] from='osd.1 [v2:172.21.15.132:6810/1723454267,v1:172.21.15.132:6811/1723454267]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2020-07-16T13:31:59.164 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:58 smithi132 bash[27079]: cluster 2020-07-16T13:31:57.779850+0000 mon.a (mon.0) 236 : cluster [DBG] osdmap e14: 2 total, 1 up, 1 in 2020-07-16T13:31:59.164 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:58 smithi132 bash[27079]: audit 2020-07-16T13:31:57.779986+0000 mon.a (mon.0) 237 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2020-07-16T13:31:59.164 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:58 smithi132 bash[27079]: audit 2020-07-16T13:31:57.780318+0000 mon.a (mon.0) 238 : audit [INF] from='osd.1 [v2:172.21.15.132:6810/1723454267,v1:172.21.15.132:6811/1723454267]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]: dispatch 2020-07-16T13:31:59.164 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:58 smithi132 bash[27079]: cluster 2020-07-16T13:31:58.520286+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2020-07-16T13:31:59.164 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:58 smithi132 bash[27079]: cluster 2020-07-16T13:31:58.520338+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2020-07-16T13:31:59.165 INFO:journalctl@ceph.osd.1.smithi132.stdout:Jul 16 13:31:58 smithi132 bash[30441]: debug 2020-07-16T13:31:58.784+0000 7f764bb51700 -1 osd.1 0 waiting for initial osdmap 2020-07-16T13:31:59.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:58 smithi188 bash[23329]: cluster 2020-07-16T13:31:57.704501+0000 mgr.y (mgr.14140) 67 : cluster [DBG] pgmap v57: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2020-07-16T13:31:59.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:58 smithi188 bash[23329]: audit 2020-07-16T13:31:57.779807+0000 mon.a (mon.0) 235 : audit [INF] from='osd.1 [v2:172.21.15.132:6810/1723454267,v1:172.21.15.132:6811/1723454267]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2020-07-16T13:31:59.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:58 smithi188 bash[23329]: cluster 2020-07-16T13:31:57.779850+0000 mon.a (mon.0) 236 : cluster [DBG] osdmap e14: 2 total, 1 up, 1 in 2020-07-16T13:31:59.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:58 smithi188 bash[23329]: audit 2020-07-16T13:31:57.779986+0000 mon.a (mon.0) 237 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2020-07-16T13:31:59.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:58 smithi188 bash[23329]: audit 2020-07-16T13:31:57.780318+0000 mon.a (mon.0) 238 : audit [INF] from='osd.1 [v2:172.21.15.132:6810/1723454267,v1:172.21.15.132:6811/1723454267]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]: dispatch 2020-07-16T13:31:59.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:58 smithi188 bash[23329]: cluster 2020-07-16T13:31:58.520286+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2020-07-16T13:31:59.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:58 smithi188 bash[23329]: cluster 2020-07-16T13:31:58.520338+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2020-07-16T13:31:59.931 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:59 smithi132 bash[23299]: audit 2020-07-16T13:31:58.780535+0000 mon.a (mon.0) 239 : audit [INF] from='osd.1 [v2:172.21.15.132:6810/1723454267,v1:172.21.15.132:6811/1723454267]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]': finished 2020-07-16T13:31:59.931 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:59 smithi132 bash[23299]: cluster 2020-07-16T13:31:58.780581+0000 mon.a (mon.0) 240 : cluster [DBG] osdmap e15: 2 total, 1 up, 1 in 2020-07-16T13:31:59.931 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:31:59 smithi132 bash[23299]: audit 2020-07-16T13:31:58.781071+0000 mon.a (mon.0) 241 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2020-07-16T13:31:59.932 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:59 smithi132 bash[27079]: audit 2020-07-16T13:31:58.780535+0000 mon.a (mon.0) 239 : audit [INF] from='osd.1 [v2:172.21.15.132:6810/1723454267,v1:172.21.15.132:6811/1723454267]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]': finished 2020-07-16T13:31:59.932 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:59 smithi132 bash[27079]: cluster 2020-07-16T13:31:58.780581+0000 mon.a (mon.0) 240 : cluster [DBG] osdmap e15: 2 total, 1 up, 1 in 2020-07-16T13:31:59.932 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:31:59 smithi132 bash[27079]: audit 2020-07-16T13:31:58.781071+0000 mon.a (mon.0) 241 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2020-07-16T13:32:00.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:59 smithi188 bash[23329]: audit 2020-07-16T13:31:58.780535+0000 mon.a (mon.0) 239 : audit [INF] from='osd.1 [v2:172.21.15.132:6810/1723454267,v1:172.21.15.132:6811/1723454267]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]': finished 2020-07-16T13:32:00.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:59 smithi188 bash[23329]: cluster 2020-07-16T13:31:58.780581+0000 mon.a (mon.0) 240 : cluster [DBG] osdmap e15: 2 total, 1 up, 1 in 2020-07-16T13:32:00.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:31:59 smithi188 bash[23329]: audit 2020-07-16T13:31:58.781071+0000 mon.a (mon.0) 241 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2020-07-16T13:32:01.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:00 smithi188 bash[23329]: cluster 2020-07-16T13:31:59.704849+0000 mgr.y (mgr.14140) 68 : cluster [DBG] pgmap v60: 1 pgs: 1 undersized+peered; 0 B data, 128 KiB used, 88 GiB / 89 GiB avail 2020-07-16T13:32:01.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:00 smithi188 bash[23329]: cluster 2020-07-16T13:31:59.786530+0000 mon.a (mon.0) 242 : cluster [INF] osd.1 [v2:172.21.15.132:6810/1723454267,v1:172.21.15.132:6811/1723454267] boot 2020-07-16T13:32:01.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:00 smithi188 bash[23329]: cluster 2020-07-16T13:31:59.786572+0000 mon.a (mon.0) 243 : cluster [DBG] osdmap e16: 2 total, 2 up, 2 in 2020-07-16T13:32:01.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:00 smithi188 bash[23329]: audit 2020-07-16T13:31:59.787010+0000 mon.a (mon.0) 244 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2020-07-16T13:32:01.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:00 smithi188 bash[23329]: audit 2020-07-16T13:31:59.945320+0000 mon.a (mon.0) 245 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:32:01.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:00 smithi188 bash[23329]: audit 2020-07-16T13:32:00.137657+0000 mon.a (mon.0) 246 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768146\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768221\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768253\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768281\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768309\", \"created\": \"2020-07-16T13:31:53.818518\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}}, \"last_daemon_update\": \"2020-07-16T13:31:55.768397\", \"last_device_update\": \"2020-07-16T13:32:00.136767\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:32:01.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:00 smithi188 bash[23329]: audit 2020-07-16T13:32:00.140578+0000 mon.a (mon.0) 247 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768146\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768221\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768253\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768281\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768309\", \"created\": \"2020-07-16T13:31:53.818518\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}}, \"last_daemon_update\": \"2020-07-16T13:31:55.768397\", \"last_device_update\": \"2020-07-16T13:32:00.136767\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:32:01.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:00 smithi188 bash[23329]: audit 2020-07-16T13:32:00.509265+0000 mon.a (mon.0) 248 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-07-16T13:32:01.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:00 smithi188 bash[23329]: audit 2020-07-16T13:32:00.509778+0000 mon.a (mon.0) 249 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:32:01.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:00 smithi188 bash[23329]: audit 2020-07-16T13:32:00.510450+0000 mon.a (mon.0) 250 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:32:01.226 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:00 smithi132 bash[23299]: cluster 2020-07-16T13:31:59.704849+0000 mgr.y (mgr.14140) 68 : cluster [DBG] pgmap v60: 1 pgs: 1 undersized+peered; 0 B data, 128 KiB used, 88 GiB / 89 GiB avail 2020-07-16T13:32:01.226 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:00 smithi132 bash[23299]: cluster 2020-07-16T13:31:59.786530+0000 mon.a (mon.0) 242 : cluster [INF] osd.1 [v2:172.21.15.132:6810/1723454267,v1:172.21.15.132:6811/1723454267] boot 2020-07-16T13:32:01.226 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:00 smithi132 bash[23299]: cluster 2020-07-16T13:31:59.786572+0000 mon.a (mon.0) 243 : cluster [DBG] osdmap e16: 2 total, 2 up, 2 in 2020-07-16T13:32:01.226 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:00 smithi132 bash[23299]: audit 2020-07-16T13:31:59.787010+0000 mon.a (mon.0) 244 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2020-07-16T13:32:01.227 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:00 smithi132 bash[23299]: audit 2020-07-16T13:31:59.945320+0000 mon.a (mon.0) 245 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:32:01.227 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:00 smithi132 bash[23299]: audit 2020-07-16T13:32:00.137657+0000 mon.a (mon.0) 246 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768146\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768221\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768253\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768281\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768309\", \"created\": \"2020-07-16T13:31:53.818518\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}}, \"last_daemon_update\": \"2020-07-16T13:31:55.768397\", \"last_device_update\": \"2020-07-16T13:32:00.136767\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:32:01.227 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:00 smithi132 bash[23299]: audit 2020-07-16T13:32:00.140578+0000 mon.a (mon.0) 247 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768146\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768221\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768253\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768281\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768309\", \"created\": \"2020-07-16T13:31:53.818518\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}}, \"last_daemon_update\": \"2020-07-16T13:31:55.768397\", \"last_device_update\": \"2020-07-16T13:32:00.136767\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:32:01.228 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:00 smithi132 bash[23299]: audit 2020-07-16T13:32:00.509265+0000 mon.a (mon.0) 248 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-07-16T13:32:01.228 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:00 smithi132 bash[23299]: audit 2020-07-16T13:32:00.509778+0000 mon.a (mon.0) 249 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:32:01.228 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:00 smithi132 bash[23299]: audit 2020-07-16T13:32:00.510450+0000 mon.a (mon.0) 250 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:32:01.229 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:00 smithi132 bash[27079]: cluster 2020-07-16T13:31:59.704849+0000 mgr.y (mgr.14140) 68 : cluster [DBG] pgmap v60: 1 pgs: 1 undersized+peered; 0 B data, 128 KiB used, 88 GiB / 89 GiB avail 2020-07-16T13:32:01.229 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:00 smithi132 bash[27079]: cluster 2020-07-16T13:31:59.786530+0000 mon.a (mon.0) 242 : cluster [INF] osd.1 [v2:172.21.15.132:6810/1723454267,v1:172.21.15.132:6811/1723454267] boot 2020-07-16T13:32:01.229 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:00 smithi132 bash[27079]: cluster 2020-07-16T13:31:59.786572+0000 mon.a (mon.0) 243 : cluster [DBG] osdmap e16: 2 total, 2 up, 2 in 2020-07-16T13:32:01.229 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:00 smithi132 bash[27079]: audit 2020-07-16T13:31:59.787010+0000 mon.a (mon.0) 244 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2020-07-16T13:32:01.234 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:00 smithi132 bash[27079]: audit 2020-07-16T13:31:59.945320+0000 mon.a (mon.0) 245 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:32:01.235 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:00 smithi132 bash[27079]: audit 2020-07-16T13:32:00.137657+0000 mon.a (mon.0) 246 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768146\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768221\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768253\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768281\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768309\", \"created\": \"2020-07-16T13:31:53.818518\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}}, \"last_daemon_update\": \"2020-07-16T13:31:55.768397\", \"last_device_update\": \"2020-07-16T13:32:00.136767\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:32:01.235 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:00 smithi132 bash[27079]: audit 2020-07-16T13:32:00.140578+0000 mon.a (mon.0) 247 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768146\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768221\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768253\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768281\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768309\", \"created\": \"2020-07-16T13:31:53.818518\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}}, \"last_daemon_update\": \"2020-07-16T13:31:55.768397\", \"last_device_update\": \"2020-07-16T13:32:00.136767\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:32:01.236 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:00 smithi132 bash[27079]: audit 2020-07-16T13:32:00.509265+0000 mon.a (mon.0) 248 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-07-16T13:32:01.236 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:00 smithi132 bash[27079]: audit 2020-07-16T13:32:00.509778+0000 mon.a (mon.0) 249 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:32:01.236 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:00 smithi132 bash[27079]: audit 2020-07-16T13:32:00.510450+0000 mon.a (mon.0) 250 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:32:02.050 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:01 smithi132 bash[23299]: audit 2020-07-16T13:32:00.508487+0000 mgr.y (mgr.14140) 69 : audit [DBG] from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi132:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:32:02.050 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:01 smithi132 bash[23299]: cephadm 2020-07-16T13:32:00.509014+0000 mgr.y (mgr.14140) 70 : cephadm [INF] Applying osd on host smithi132... 2020-07-16T13:32:02.051 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:01 smithi132 bash[23299]: cluster 2020-07-16T13:32:00.798120+0000 mon.a (mon.0) 251 : cluster [DBG] osdmap e17: 2 total, 2 up, 2 in 2020-07-16T13:32:02.051 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:01 smithi132 bash[23299]: audit 2020-07-16T13:32:00.801311+0000 mon.a (mon.0) 252 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20200716-133005"}]: dispatch 2020-07-16T13:32:02.051 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:01 smithi132 bash[23299]: audit 2020-07-16T13:32:00.803897+0000 mon.a (mon.0) 253 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20200716-133005"}]': finished 2020-07-16T13:32:02.052 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:01 smithi132 bash[27079]: audit 2020-07-16T13:32:00.508487+0000 mgr.y (mgr.14140) 69 : audit [DBG] from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi132:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:32:02.052 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:01 smithi132 bash[27079]: cephadm 2020-07-16T13:32:00.509014+0000 mgr.y (mgr.14140) 70 : cephadm [INF] Applying osd on host smithi132... 2020-07-16T13:32:02.052 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:01 smithi132 bash[27079]: cluster 2020-07-16T13:32:00.798120+0000 mon.a (mon.0) 251 : cluster [DBG] osdmap e17: 2 total, 2 up, 2 in 2020-07-16T13:32:02.052 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:01 smithi132 bash[27079]: audit 2020-07-16T13:32:00.801311+0000 mon.a (mon.0) 252 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20200716-133005"}]: dispatch 2020-07-16T13:32:02.052 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:01 smithi132 bash[27079]: audit 2020-07-16T13:32:00.803897+0000 mon.a (mon.0) 253 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20200716-133005"}]': finished 2020-07-16T13:32:02.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:01 smithi188 bash[23329]: audit 2020-07-16T13:32:00.508487+0000 mgr.y (mgr.14140) 69 : audit [DBG] from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi132:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:32:02.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:01 smithi188 bash[23329]: cephadm 2020-07-16T13:32:00.509014+0000 mgr.y (mgr.14140) 70 : cephadm [INF] Applying osd on host smithi132... 2020-07-16T13:32:02.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:01 smithi188 bash[23329]: cluster 2020-07-16T13:32:00.798120+0000 mon.a (mon.0) 251 : cluster [DBG] osdmap e17: 2 total, 2 up, 2 in 2020-07-16T13:32:02.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:01 smithi188 bash[23329]: audit 2020-07-16T13:32:00.801311+0000 mon.a (mon.0) 252 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20200716-133005"}]: dispatch 2020-07-16T13:32:02.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:01 smithi188 bash[23329]: audit 2020-07-16T13:32:00.803897+0000 mon.a (mon.0) 253 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20200716-133005"}]': finished 2020-07-16T13:32:03.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:02 smithi188 bash[23329]: cluster 2020-07-16T13:32:01.705184+0000 mgr.y (mgr.14140) 71 : cluster [DBG] pgmap v63: 1 pgs: 1 undersized+peered; 0 B data, 272 KiB used, 177 GiB / 179 GiB avail 2020-07-16T13:32:03.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:02 smithi188 bash[23329]: audit 2020-07-16T13:32:02.718863+0000 mon.c (mon.1) 8 : audit [INF] from='client.? 172.21.15.132:0/3717504738' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "79e0e8c0-9b49-4a93-9185-918c9a5cd4d0"}]: dispatch 2020-07-16T13:32:03.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:02 smithi188 bash[23329]: audit 2020-07-16T13:32:02.719162+0000 mon.a (mon.0) 254 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "79e0e8c0-9b49-4a93-9185-918c9a5cd4d0"}]: dispatch 2020-07-16T13:32:03.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:02 smithi188 bash[23329]: audit 2020-07-16T13:32:02.724308+0000 mon.a (mon.0) 255 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "79e0e8c0-9b49-4a93-9185-918c9a5cd4d0"}]': finished 2020-07-16T13:32:03.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:02 smithi188 bash[23329]: cluster 2020-07-16T13:32:02.724346+0000 mon.a (mon.0) 256 : cluster [DBG] osdmap e18: 3 total, 2 up, 2 in 2020-07-16T13:32:03.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:02 smithi188 bash[23329]: audit 2020-07-16T13:32:02.724431+0000 mon.a (mon.0) 257 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-07-16T13:32:03.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:02 smithi132 bash[23299]: cluster 2020-07-16T13:32:01.705184+0000 mgr.y (mgr.14140) 71 : cluster [DBG] pgmap v63: 1 pgs: 1 undersized+peered; 0 B data, 272 KiB used, 177 GiB / 179 GiB avail 2020-07-16T13:32:03.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:02 smithi132 bash[23299]: audit 2020-07-16T13:32:02.718863+0000 mon.c (mon.1) 8 : audit [INF] from='client.? 172.21.15.132:0/3717504738' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "79e0e8c0-9b49-4a93-9185-918c9a5cd4d0"}]: dispatch 2020-07-16T13:32:03.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:02 smithi132 bash[23299]: audit 2020-07-16T13:32:02.719162+0000 mon.a (mon.0) 254 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "79e0e8c0-9b49-4a93-9185-918c9a5cd4d0"}]: dispatch 2020-07-16T13:32:03.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:02 smithi132 bash[23299]: audit 2020-07-16T13:32:02.724308+0000 mon.a (mon.0) 255 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "79e0e8c0-9b49-4a93-9185-918c9a5cd4d0"}]': finished 2020-07-16T13:32:03.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:02 smithi132 bash[23299]: cluster 2020-07-16T13:32:02.724346+0000 mon.a (mon.0) 256 : cluster [DBG] osdmap e18: 3 total, 2 up, 2 in 2020-07-16T13:32:03.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:02 smithi132 bash[23299]: audit 2020-07-16T13:32:02.724431+0000 mon.a (mon.0) 257 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-07-16T13:32:03.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:02 smithi132 bash[27079]: cluster 2020-07-16T13:32:01.705184+0000 mgr.y (mgr.14140) 71 : cluster [DBG] pgmap v63: 1 pgs: 1 undersized+peered; 0 B data, 272 KiB used, 177 GiB / 179 GiB avail 2020-07-16T13:32:03.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:02 smithi132 bash[27079]: audit 2020-07-16T13:32:02.718863+0000 mon.c (mon.1) 8 : audit [INF] from='client.? 172.21.15.132:0/3717504738' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "79e0e8c0-9b49-4a93-9185-918c9a5cd4d0"}]: dispatch 2020-07-16T13:32:03.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:02 smithi132 bash[27079]: audit 2020-07-16T13:32:02.719162+0000 mon.a (mon.0) 254 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "79e0e8c0-9b49-4a93-9185-918c9a5cd4d0"}]: dispatch 2020-07-16T13:32:03.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:02 smithi132 bash[27079]: audit 2020-07-16T13:32:02.724308+0000 mon.a (mon.0) 255 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "79e0e8c0-9b49-4a93-9185-918c9a5cd4d0"}]': finished 2020-07-16T13:32:03.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:02 smithi132 bash[27079]: cluster 2020-07-16T13:32:02.724346+0000 mon.a (mon.0) 256 : cluster [DBG] osdmap e18: 3 total, 2 up, 2 in 2020-07-16T13:32:03.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:02 smithi132 bash[27079]: audit 2020-07-16T13:32:02.724431+0000 mon.a (mon.0) 257 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-07-16T13:32:05.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:04 smithi188 bash[23329]: cluster 2020-07-16T13:32:03.705488+0000 mgr.y (mgr.14140) 72 : cluster [DBG] pgmap v65: 1 pgs: 1 undersized+peered; 0 B data, 272 KiB used, 177 GiB / 179 GiB avail 2020-07-16T13:32:05.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:04 smithi188 bash[23329]: audit 2020-07-16T13:32:04.434695+0000 mon.a (mon.0) 258 : audit [DBG] from='client.? 172.21.15.132:0/3987816458' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-07-16T13:32:05.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:04 smithi132 bash[23299]: cluster 2020-07-16T13:32:03.705488+0000 mgr.y (mgr.14140) 72 : cluster [DBG] pgmap v65: 1 pgs: 1 undersized+peered; 0 B data, 272 KiB used, 177 GiB / 179 GiB avail 2020-07-16T13:32:05.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:04 smithi132 bash[23299]: audit 2020-07-16T13:32:04.434695+0000 mon.a (mon.0) 258 : audit [DBG] from='client.? 172.21.15.132:0/3987816458' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-07-16T13:32:05.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:04 smithi132 bash[27079]: cluster 2020-07-16T13:32:03.705488+0000 mgr.y (mgr.14140) 72 : cluster [DBG] pgmap v65: 1 pgs: 1 undersized+peered; 0 B data, 272 KiB used, 177 GiB / 179 GiB avail 2020-07-16T13:32:05.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:04 smithi132 bash[27079]: audit 2020-07-16T13:32:04.434695+0000 mon.a (mon.0) 258 : audit [DBG] from='client.? 172.21.15.132:0/3987816458' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-07-16T13:32:07.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:06 smithi188 bash[23329]: cluster 2020-07-16T13:32:05.705878+0000 mgr.y (mgr.14140) 73 : cluster [DBG] pgmap v66: 1 pgs: 1 undersized+peered; 0 B data, 304 KiB used, 177 GiB / 179 GiB avail 2020-07-16T13:32:07.217 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:06 smithi132 bash[27079]: cluster 2020-07-16T13:32:05.705878+0000 mgr.y (mgr.14140) 73 : cluster [DBG] pgmap v66: 1 pgs: 1 undersized+peered; 0 B data, 304 KiB used, 177 GiB / 179 GiB avail 2020-07-16T13:32:07.218 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:06 smithi132 bash[23299]: cluster 2020-07-16T13:32:05.705878+0000 mgr.y (mgr.14140) 73 : cluster [DBG] pgmap v66: 1 pgs: 1 undersized+peered; 0 B data, 304 KiB used, 177 GiB / 179 GiB avail 2020-07-16T13:32:08.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:07 smithi188 bash[23329]: audit 2020-07-16T13:32:06.867748+0000 mon.a (mon.0) 259 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:32:08.257 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:07 smithi132 bash[23299]: audit 2020-07-16T13:32:06.867748+0000 mon.a (mon.0) 259 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:32:08.258 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:07 smithi132 bash[27079]: audit 2020-07-16T13:32:06.867748+0000 mon.a (mon.0) 259 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:32:09.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:08 smithi132 bash[27079]: cluster 2020-07-16T13:32:07.706241+0000 mgr.y (mgr.14140) 74 : cluster [DBG] pgmap v67: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2020-07-16T13:32:09.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:08 smithi132 bash[27079]: cluster 2020-07-16T13:32:07.810884+0000 mon.a (mon.0) 260 : cluster [WRN] Health check failed: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2020-07-16T13:32:09.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:08 smithi132 bash[27079]: cluster 2020-07-16T13:32:07.810947+0000 mon.a (mon.0) 261 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2020-07-16T13:32:09.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:08 smithi132 bash[23299]: cluster 2020-07-16T13:32:07.706241+0000 mgr.y (mgr.14140) 74 : cluster [DBG] pgmap v67: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2020-07-16T13:32:09.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:08 smithi132 bash[23299]: cluster 2020-07-16T13:32:07.810884+0000 mon.a (mon.0) 260 : cluster [WRN] Health check failed: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2020-07-16T13:32:09.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:08 smithi132 bash[23299]: cluster 2020-07-16T13:32:07.810947+0000 mon.a (mon.0) 261 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2020-07-16T13:32:09.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:08 smithi188 bash[23329]: cluster 2020-07-16T13:32:07.706241+0000 mgr.y (mgr.14140) 74 : cluster [DBG] pgmap v67: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2020-07-16T13:32:09.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:08 smithi188 bash[23329]: cluster 2020-07-16T13:32:07.810884+0000 mon.a (mon.0) 260 : cluster [WRN] Health check failed: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2020-07-16T13:32:09.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:08 smithi188 bash[23329]: cluster 2020-07-16T13:32:07.810947+0000 mon.a (mon.0) 261 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2020-07-16T13:32:09.907 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:09 smithi132 bash[23299]: audit 2020-07-16T13:32:09.243473+0000 mon.a (mon.0) 262 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2020-07-16T13:32:09.907 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:09 smithi132 bash[23299]: audit 2020-07-16T13:32:09.244035+0000 mon.a (mon.0) 263 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:32:09.908 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:09 smithi132 bash[23299]: audit 2020-07-16T13:32:09.244646+0000 mon.a (mon.0) 264 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.2", "key": "container_image"}]: dispatch 2020-07-16T13:32:09.908 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:09 smithi132 bash[27079]: audit 2020-07-16T13:32:09.243473+0000 mon.a (mon.0) 262 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2020-07-16T13:32:09.908 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:09 smithi132 bash[27079]: audit 2020-07-16T13:32:09.244035+0000 mon.a (mon.0) 263 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:32:09.909 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:09 smithi132 bash[27079]: audit 2020-07-16T13:32:09.244646+0000 mon.a (mon.0) 264 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.2", "key": "container_image"}]: dispatch 2020-07-16T13:32:10.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:09 smithi188 bash[23329]: audit 2020-07-16T13:32:09.243473+0000 mon.a (mon.0) 262 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2020-07-16T13:32:10.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:09 smithi188 bash[23329]: audit 2020-07-16T13:32:09.244035+0000 mon.a (mon.0) 263 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:32:10.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:09 smithi188 bash[23329]: audit 2020-07-16T13:32:09.244646+0000 mon.a (mon.0) 264 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.2", "key": "container_image"}]: dispatch 2020-07-16T13:32:10.732 INFO:teuthology.orchestra.run.smithi132.stdout:Created osd(s) 2 on host 'smithi132' 2020-07-16T13:32:11.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:10 smithi132 bash[23299]: cephadm 2020-07-16T13:32:09.244458+0000 mgr.y (mgr.14140) 75 : cephadm [INF] Deploying daemon osd.2 on smithi132 2020-07-16T13:32:11.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:10 smithi132 bash[23299]: cluster 2020-07-16T13:32:09.706531+0000 mgr.y (mgr.14140) 76 : cluster [DBG] pgmap v68: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2020-07-16T13:32:11.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:10 smithi132 bash[23299]: audit 2020-07-16T13:32:10.723720+0000 mon.a (mon.0) 265 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768146\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768221\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768253\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768281\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768309\", \"created\": \"2020-07-16T13:31:53.818518\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}}, \"last_device_update\": \"2020-07-16T13:32:00.136767\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:32:11.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:10 smithi132 bash[23299]: audit 2020-07-16T13:32:10.724170+0000 mon.a (mon.0) 266 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:32:11.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:10 smithi132 bash[23299]: audit 2020-07-16T13:32:10.727608+0000 mon.a (mon.0) 267 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768146\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768221\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768253\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768281\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768309\", \"created\": \"2020-07-16T13:31:53.818518\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}}, \"last_device_update\": \"2020-07-16T13:32:00.136767\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:32:11.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:10 smithi132 bash[27079]: cephadm 2020-07-16T13:32:09.244458+0000 mgr.y (mgr.14140) 75 : cephadm [INF] Deploying daemon osd.2 on smithi132 2020-07-16T13:32:11.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:10 smithi132 bash[27079]: cluster 2020-07-16T13:32:09.706531+0000 mgr.y (mgr.14140) 76 : cluster [DBG] pgmap v68: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2020-07-16T13:32:11.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:10 smithi132 bash[27079]: audit 2020-07-16T13:32:10.723720+0000 mon.a (mon.0) 265 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768146\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768221\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768253\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768281\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768309\", \"created\": \"2020-07-16T13:31:53.818518\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}}, \"last_device_update\": \"2020-07-16T13:32:00.136767\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:32:11.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:10 smithi132 bash[27079]: audit 2020-07-16T13:32:10.724170+0000 mon.a (mon.0) 266 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:32:11.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:10 smithi132 bash[27079]: audit 2020-07-16T13:32:10.727608+0000 mon.a (mon.0) 267 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768146\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768221\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768253\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768281\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768309\", \"created\": \"2020-07-16T13:31:53.818518\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}}, \"last_device_update\": \"2020-07-16T13:32:00.136767\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:32:11.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:10 smithi188 bash[23329]: cephadm 2020-07-16T13:32:09.244458+0000 mgr.y (mgr.14140) 75 : cephadm [INF] Deploying daemon osd.2 on smithi132 2020-07-16T13:32:11.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:10 smithi188 bash[23329]: cluster 2020-07-16T13:32:09.706531+0000 mgr.y (mgr.14140) 76 : cluster [DBG] pgmap v68: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2020-07-16T13:32:11.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:10 smithi188 bash[23329]: audit 2020-07-16T13:32:10.723720+0000 mon.a (mon.0) 265 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768146\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768221\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768253\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768281\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768309\", \"created\": \"2020-07-16T13:31:53.818518\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}}, \"last_device_update\": \"2020-07-16T13:32:00.136767\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:32:11.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:10 smithi188 bash[23329]: audit 2020-07-16T13:32:10.724170+0000 mon.a (mon.0) 266 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:32:11.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:10 smithi188 bash[23329]: audit 2020-07-16T13:32:10.727608+0000 mon.a (mon.0) 267 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768146\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768221\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768253\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768281\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:55.768309\", \"created\": \"2020-07-16T13:31:53.818518\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}}, \"last_device_update\": \"2020-07-16T13:32:00.136767\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:32:11.428 INFO:teuthology.orchestra.run.smithi132:osd.2> sudo journalctl -f -n 0 -u ceph-4c8ed362-c768-11ea-a06f-001a4aab830c@osd.2.service 2020-07-16T13:32:11.432 INFO:tasks.cephadm:Deploying osd.3 on smithi132 with /dev/vg_nvme/lv_1... 2020-07-16T13:32:11.432 INFO:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4c8ed362-c768-11ea-a06f-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2020-07-16T13:32:11.466 INFO:journalctl@ceph.osd.2.smithi132.stdout:-- Logs begin at Thu 2020-07-16 13:22:27 UTC. -- 2020-07-16T13:32:11.724 INFO:journalctl@ceph.osd.2.smithi132.stdout:Jul 16 13:32:11 smithi132 podman[32087]: 2020-07-16 13:32:11.480750626 +0000 UTC m=+0.770974268 container start d04c90bdfd52284d8e69b02dfe654f241ae30c511873b4821eed375084205743 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.2-activate) 2020-07-16T13:32:11.725 INFO:journalctl@ceph.osd.2.smithi132.stdout:Jul 16 13:32:11 smithi132 podman[32087]: 2020-07-16 13:32:11.480823836 +0000 UTC m=+0.771047481 container attach d04c90bdfd52284d8e69b02dfe654f241ae30c511873b4821eed375084205743 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.2-activate) 2020-07-16T13:32:12.029 INFO:journalctl@ceph.osd.2.smithi132.stdout:Jul 16 13:32:11 smithi132 bash[32085]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2020-07-16T13:32:12.029 INFO:journalctl@ceph.osd.2.smithi132.stdout:Jul 16 13:32:11 smithi132 bash[32085]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-2 --no-mon-config 2020-07-16T13:32:12.029 INFO:journalctl@ceph.osd.2.smithi132.stdout:Jul 16 13:32:11 smithi132 bash[32085]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2/block 2020-07-16T13:32:12.030 INFO:journalctl@ceph.osd.2.smithi132.stdout:Jul 16 13:32:11 smithi132 bash[32085]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-2/block 2020-07-16T13:32:12.030 INFO:journalctl@ceph.osd.2.smithi132.stdout:Jul 16 13:32:11 smithi132 bash[32085]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2020-07-16T13:32:12.030 INFO:journalctl@ceph.osd.2.smithi132.stdout:Jul 16 13:32:11 smithi132 bash[32085]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2020-07-16T13:32:12.030 INFO:journalctl@ceph.osd.2.smithi132.stdout:Jul 16 13:32:11 smithi132 bash[32085]: --> ceph-volume lvm activate successful for osd ID: 2 2020-07-16T13:32:12.031 INFO:journalctl@ceph.osd.2.smithi132.stdout:Jul 16 13:32:11 smithi132 podman[32087]: 2020-07-16 13:32:11.845431329 +0000 UTC m=+1.135654994 container died d04c90bdfd52284d8e69b02dfe654f241ae30c511873b4821eed375084205743 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.2-activate) 2020-07-16T13:32:12.633 INFO:journalctl@ceph.osd.2.smithi132.stdout:Jul 16 13:32:12 smithi132 podman[32087]: 2020-07-16 13:32:12.402123511 +0000 UTC m=+1.692347193 container remove d04c90bdfd52284d8e69b02dfe654f241ae30c511873b4821eed375084205743 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.2-activate) 2020-07-16T13:32:13.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:12 smithi132 bash[23299]: cluster 2020-07-16T13:32:11.706895+0000 mgr.y (mgr.14140) 77 : cluster [DBG] pgmap v69: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2020-07-16T13:32:13.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:12 smithi132 bash[27079]: cluster 2020-07-16T13:32:11.706895+0000 mgr.y (mgr.14140) 77 : cluster [DBG] pgmap v69: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2020-07-16T13:32:13.030 INFO:journalctl@ceph.osd.2.smithi132.stdout:Jul 16 13:32:12 smithi132 podman[32386]: 2020-07-16 13:32:12.680595364 +0000 UTC m=+0.263329142 container create 781335bb03928fc22d4c6186037f15cf3ef9e1bf5e723288ae18c7625a8aa781 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.2) 2020-07-16T13:32:13.030 INFO:journalctl@ceph.osd.2.smithi132.stdout:Jul 16 13:32:13 smithi132 podman[32386]: 2020-07-16 13:32:13.027370772 +0000 UTC m=+0.610104553 container init 781335bb03928fc22d4c6186037f15cf3ef9e1bf5e723288ae18c7625a8aa781 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.2) 2020-07-16T13:32:13.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:12 smithi188 bash[23329]: cluster 2020-07-16T13:32:11.706895+0000 mgr.y (mgr.14140) 77 : cluster [DBG] pgmap v69: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2020-07-16T13:32:13.279 INFO:journalctl@ceph.osd.2.smithi132.stdout:Jul 16 13:32:13 smithi132 podman[32386]: 2020-07-16 13:32:13.147460776 +0000 UTC m=+0.730194561 container start 781335bb03928fc22d4c6186037f15cf3ef9e1bf5e723288ae18c7625a8aa781 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.2) 2020-07-16T13:32:13.279 INFO:journalctl@ceph.osd.2.smithi132.stdout:Jul 16 13:32:13 smithi132 podman[32386]: 2020-07-16 13:32:13.147580468 +0000 UTC m=+0.730314267 container attach 781335bb03928fc22d4c6186037f15cf3ef9e1bf5e723288ae18c7625a8aa781 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.2) 2020-07-16T13:32:13.631 INFO:journalctl@ceph.osd.2.smithi132.stdout:Jul 16 13:32:13 smithi132 bash[32085]: debug 2020-07-16T13:32:13.582+0000 7f94d641eec0 -1 Falling back to public interface 2020-07-16T13:32:13.908 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:13 smithi132 bash[27079]: audit 2020-07-16T13:32:13.396059+0000 mon.a (mon.0) 268 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395057\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395143\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395175\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395203\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395231\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395258\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}}, \"last_daemon_update\": \"2020-07-16T13:32:13.395329\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:32:13.909 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:13 smithi132 bash[27079]: audit 2020-07-16T13:32:13.399135+0000 mon.a (mon.0) 269 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395057\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395143\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395175\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395203\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395231\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395258\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}}, \"last_daemon_update\": \"2020-07-16T13:32:13.395329\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:32:13.909 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:13 smithi132 bash[27079]: audit 2020-07-16T13:32:13.399888+0000 mon.a (mon.0) 270 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:32:13.909 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:13 smithi132 bash[23299]: audit 2020-07-16T13:32:13.396059+0000 mon.a (mon.0) 268 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395057\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395143\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395175\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395203\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395231\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395258\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}}, \"last_daemon_update\": \"2020-07-16T13:32:13.395329\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:32:13.910 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:13 smithi132 bash[23299]: audit 2020-07-16T13:32:13.399135+0000 mon.a (mon.0) 269 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395057\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395143\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395175\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395203\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395231\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395258\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}}, \"last_daemon_update\": \"2020-07-16T13:32:13.395329\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:32:13.910 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:13 smithi132 bash[23299]: audit 2020-07-16T13:32:13.399888+0000 mon.a (mon.0) 270 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:32:14.162 INFO:teuthology.orchestra.run.smithi132.stderr:--> Zapping: /dev/vg_nvme/lv_1 2020-07-16T13:32:14.162 INFO:teuthology.orchestra.run.smithi132.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2020-07-16T13:32:14.163 INFO:teuthology.orchestra.run.smithi132.stderr: stderr: 10+0 records in 2020-07-16T13:32:14.163 INFO:teuthology.orchestra.run.smithi132.stderr:10+0 records out 2020-07-16T13:32:14.163 INFO:teuthology.orchestra.run.smithi132.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.011938 s, 878 MB/s 2020-07-16T13:32:14.163 INFO:teuthology.orchestra.run.smithi132.stderr: stderr: 2020-07-16T13:32:14.163 INFO:teuthology.orchestra.run.smithi132.stderr:--> Zapping successful for: 2020-07-16T13:32:14.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:13 smithi188 bash[23329]: audit 2020-07-16T13:32:13.396059+0000 mon.a (mon.0) 268 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395057\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395143\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395175\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395203\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395231\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395258\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}}, \"last_daemon_update\": \"2020-07-16T13:32:13.395329\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:32:14.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:13 smithi188 bash[23329]: audit 2020-07-16T13:32:13.399135+0000 mon.a (mon.0) 269 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395057\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395143\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395175\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395203\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395231\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395258\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}}, \"last_daemon_update\": \"2020-07-16T13:32:13.395329\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:32:14.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:13 smithi188 bash[23329]: audit 2020-07-16T13:32:13.399888+0000 mon.a (mon.0) 270 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:32:14.216 INFO:journalctl@ceph.osd.2.smithi132.stdout:Jul 16 13:32:14 smithi132 bash[32085]: debug 2020-07-16T13:32:14.142+0000 7f94d641eec0 -1 osd.2 0 log_to_monitors {default=true} 2020-07-16T13:32:14.871 INFO:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4c8ed362-c768-11ea-a06f-001a4aab830c -- ceph orch daemon add osd smithi132:vg_nvme/lv_1 2020-07-16T13:32:15.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:14 smithi188 bash[23329]: cluster 2020-07-16T13:32:13.707184+0000 mgr.y (mgr.14140) 78 : cluster [DBG] pgmap v70: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2020-07-16T13:32:15.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:14 smithi188 bash[23329]: audit 2020-07-16T13:32:14.145361+0000 mon.a (mon.0) 271 : audit [INF] from='osd.2 [v2:172.21.15.132:6818/2489969657,v1:172.21.15.132:6819/2489969657]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2020-07-16T13:32:15.225 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:14 smithi132 bash[27079]: cluster 2020-07-16T13:32:13.707184+0000 mgr.y (mgr.14140) 78 : cluster [DBG] pgmap v70: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2020-07-16T13:32:15.225 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:14 smithi132 bash[27079]: audit 2020-07-16T13:32:14.145361+0000 mon.a (mon.0) 271 : audit [INF] from='osd.2 [v2:172.21.15.132:6818/2489969657,v1:172.21.15.132:6819/2489969657]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2020-07-16T13:32:15.225 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:14 smithi132 bash[23299]: cluster 2020-07-16T13:32:13.707184+0000 mgr.y (mgr.14140) 78 : cluster [DBG] pgmap v70: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2020-07-16T13:32:15.226 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:14 smithi132 bash[23299]: audit 2020-07-16T13:32:14.145361+0000 mon.a (mon.0) 271 : audit [INF] from='osd.2 [v2:172.21.15.132:6818/2489969657,v1:172.21.15.132:6819/2489969657]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2020-07-16T13:32:16.029 INFO:journalctl@ceph.osd.2.smithi132.stdout:Jul 16 13:32:15 smithi132 bash[32085]: debug 2020-07-16T13:32:15.840+0000 7f94bf1d3700 -1 osd.2 0 waiting for initial osdmap 2020-07-16T13:32:16.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:15 smithi132 bash[23299]: audit 2020-07-16T13:32:14.831397+0000 mon.a (mon.0) 272 : audit [INF] from='osd.2 [v2:172.21.15.132:6818/2489969657,v1:172.21.15.132:6819/2489969657]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2020-07-16T13:32:16.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:15 smithi132 bash[23299]: cluster 2020-07-16T13:32:14.831428+0000 mon.a (mon.0) 273 : cluster [DBG] osdmap e19: 3 total, 2 up, 2 in 2020-07-16T13:32:16.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:15 smithi132 bash[23299]: audit 2020-07-16T13:32:14.831947+0000 mon.a (mon.0) 274 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-07-16T13:32:16.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:15 smithi132 bash[23299]: audit 2020-07-16T13:32:14.832245+0000 mon.a (mon.0) 275 : audit [INF] from='osd.2 [v2:172.21.15.132:6818/2489969657,v1:172.21.15.132:6819/2489969657]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]: dispatch 2020-07-16T13:32:16.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:15 smithi132 bash[23299]: cluster 2020-07-16T13:32:15.095098+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2020-07-16T13:32:16.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:15 smithi132 bash[23299]: cluster 2020-07-16T13:32:15.095158+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2020-07-16T13:32:16.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:15 smithi132 bash[27079]: audit 2020-07-16T13:32:14.831397+0000 mon.a (mon.0) 272 : audit [INF] from='osd.2 [v2:172.21.15.132:6818/2489969657,v1:172.21.15.132:6819/2489969657]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2020-07-16T13:32:16.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:15 smithi132 bash[27079]: cluster 2020-07-16T13:32:14.831428+0000 mon.a (mon.0) 273 : cluster [DBG] osdmap e19: 3 total, 2 up, 2 in 2020-07-16T13:32:16.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:15 smithi132 bash[27079]: audit 2020-07-16T13:32:14.831947+0000 mon.a (mon.0) 274 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-07-16T13:32:16.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:15 smithi132 bash[27079]: audit 2020-07-16T13:32:14.832245+0000 mon.a (mon.0) 275 : audit [INF] from='osd.2 [v2:172.21.15.132:6818/2489969657,v1:172.21.15.132:6819/2489969657]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]: dispatch 2020-07-16T13:32:16.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:15 smithi132 bash[27079]: cluster 2020-07-16T13:32:15.095098+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2020-07-16T13:32:16.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:15 smithi132 bash[27079]: cluster 2020-07-16T13:32:15.095158+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2020-07-16T13:32:16.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:15 smithi188 bash[23329]: audit 2020-07-16T13:32:14.831397+0000 mon.a (mon.0) 272 : audit [INF] from='osd.2 [v2:172.21.15.132:6818/2489969657,v1:172.21.15.132:6819/2489969657]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2020-07-16T13:32:16.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:15 smithi188 bash[23329]: cluster 2020-07-16T13:32:14.831428+0000 mon.a (mon.0) 273 : cluster [DBG] osdmap e19: 3 total, 2 up, 2 in 2020-07-16T13:32:16.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:15 smithi188 bash[23329]: audit 2020-07-16T13:32:14.831947+0000 mon.a (mon.0) 274 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-07-16T13:32:16.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:15 smithi188 bash[23329]: audit 2020-07-16T13:32:14.832245+0000 mon.a (mon.0) 275 : audit [INF] from='osd.2 [v2:172.21.15.132:6818/2489969657,v1:172.21.15.132:6819/2489969657]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]: dispatch 2020-07-16T13:32:16.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:15 smithi188 bash[23329]: cluster 2020-07-16T13:32:15.095098+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2020-07-16T13:32:16.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:15 smithi188 bash[23329]: cluster 2020-07-16T13:32:15.095158+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2020-07-16T13:32:17.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:16 smithi132 bash[23299]: cluster 2020-07-16T13:32:15.707484+0000 mgr.y (mgr.14140) 79 : cluster [DBG] pgmap v72: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2020-07-16T13:32:17.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:16 smithi132 bash[23299]: audit 2020-07-16T13:32:15.837940+0000 mon.a (mon.0) 276 : audit [INF] from='osd.2 [v2:172.21.15.132:6818/2489969657,v1:172.21.15.132:6819/2489969657]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]': finished 2020-07-16T13:32:17.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:16 smithi132 bash[23299]: cluster 2020-07-16T13:32:15.837999+0000 mon.a (mon.0) 277 : cluster [DBG] osdmap e20: 3 total, 2 up, 2 in 2020-07-16T13:32:17.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:16 smithi132 bash[23299]: audit 2020-07-16T13:32:15.838765+0000 mon.a (mon.0) 278 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-07-16T13:32:17.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:16 smithi132 bash[27079]: cluster 2020-07-16T13:32:15.707484+0000 mgr.y (mgr.14140) 79 : cluster [DBG] pgmap v72: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2020-07-16T13:32:17.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:16 smithi132 bash[27079]: audit 2020-07-16T13:32:15.837940+0000 mon.a (mon.0) 276 : audit [INF] from='osd.2 [v2:172.21.15.132:6818/2489969657,v1:172.21.15.132:6819/2489969657]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]': finished 2020-07-16T13:32:17.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:16 smithi132 bash[27079]: cluster 2020-07-16T13:32:15.837999+0000 mon.a (mon.0) 277 : cluster [DBG] osdmap e20: 3 total, 2 up, 2 in 2020-07-16T13:32:17.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:16 smithi132 bash[27079]: audit 2020-07-16T13:32:15.838765+0000 mon.a (mon.0) 278 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-07-16T13:32:17.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:16 smithi188 bash[23329]: cluster 2020-07-16T13:32:15.707484+0000 mgr.y (mgr.14140) 79 : cluster [DBG] pgmap v72: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2020-07-16T13:32:17.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:16 smithi188 bash[23329]: audit 2020-07-16T13:32:15.837940+0000 mon.a (mon.0) 276 : audit [INF] from='osd.2 [v2:172.21.15.132:6818/2489969657,v1:172.21.15.132:6819/2489969657]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]': finished 2020-07-16T13:32:17.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:16 smithi188 bash[23329]: cluster 2020-07-16T13:32:15.837999+0000 mon.a (mon.0) 277 : cluster [DBG] osdmap e20: 3 total, 2 up, 2 in 2020-07-16T13:32:17.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:16 smithi188 bash[23329]: audit 2020-07-16T13:32:15.838765+0000 mon.a (mon.0) 278 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-07-16T13:32:18.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:17 smithi132 bash[27079]: cluster 2020-07-16T13:32:16.852641+0000 mon.a (mon.0) 279 : cluster [INF] osd.2 [v2:172.21.15.132:6818/2489969657,v1:172.21.15.132:6819/2489969657] boot 2020-07-16T13:32:18.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:17 smithi132 bash[27079]: cluster 2020-07-16T13:32:16.852684+0000 mon.a (mon.0) 280 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2020-07-16T13:32:18.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:17 smithi132 bash[27079]: audit 2020-07-16T13:32:16.852849+0000 mon.a (mon.0) 281 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-07-16T13:32:18.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:17 smithi132 bash[27079]: audit 2020-07-16T13:32:17.363901+0000 mon.a (mon.0) 282 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-07-16T13:32:18.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:17 smithi132 bash[27079]: audit 2020-07-16T13:32:17.364519+0000 mon.a (mon.0) 283 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:32:18.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:17 smithi132 bash[27079]: audit 2020-07-16T13:32:17.365340+0000 mon.a (mon.0) 284 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:32:18.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:17 smithi132 bash[27079]: audit 2020-07-16T13:32:17.385980+0000 mon.a (mon.0) 285 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:32:18.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:17 smithi132 bash[27079]: audit 2020-07-16T13:32:17.579154+0000 mon.a (mon.0) 286 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395057\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395143\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395175\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395203\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395231\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395258\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}}, \"last_daemon_update\": \"2020-07-16T13:32:13.395329\", \"last_device_update\": \"2020-07-16T13:32:17.578399\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:32:18.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:17 smithi132 bash[27079]: audit 2020-07-16T13:32:17.582008+0000 mon.a (mon.0) 287 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395057\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395143\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395175\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395203\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395231\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395258\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}}, \"last_daemon_update\": \"2020-07-16T13:32:13.395329\", \"last_device_update\": \"2020-07-16T13:32:17.578399\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:32:18.032 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:17 smithi132 bash[23299]: cluster 2020-07-16T13:32:16.852641+0000 mon.a (mon.0) 279 : cluster [INF] osd.2 [v2:172.21.15.132:6818/2489969657,v1:172.21.15.132:6819/2489969657] boot 2020-07-16T13:32:18.032 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:17 smithi132 bash[23299]: cluster 2020-07-16T13:32:16.852684+0000 mon.a (mon.0) 280 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2020-07-16T13:32:18.032 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:17 smithi132 bash[23299]: audit 2020-07-16T13:32:16.852849+0000 mon.a (mon.0) 281 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-07-16T13:32:18.032 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:17 smithi132 bash[23299]: audit 2020-07-16T13:32:17.363901+0000 mon.a (mon.0) 282 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-07-16T13:32:18.032 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:17 smithi132 bash[23299]: audit 2020-07-16T13:32:17.364519+0000 mon.a (mon.0) 283 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:32:18.033 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:17 smithi132 bash[23299]: audit 2020-07-16T13:32:17.365340+0000 mon.a (mon.0) 284 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:32:18.033 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:17 smithi132 bash[23299]: audit 2020-07-16T13:32:17.385980+0000 mon.a (mon.0) 285 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:32:18.033 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:17 smithi132 bash[23299]: audit 2020-07-16T13:32:17.579154+0000 mon.a (mon.0) 286 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395057\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395143\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395175\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395203\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395231\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395258\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}}, \"last_daemon_update\": \"2020-07-16T13:32:13.395329\", \"last_device_update\": \"2020-07-16T13:32:17.578399\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:32:18.033 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:17 smithi132 bash[23299]: audit 2020-07-16T13:32:17.582008+0000 mon.a (mon.0) 287 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395057\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395143\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395175\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395203\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395231\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395258\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}}, \"last_daemon_update\": \"2020-07-16T13:32:13.395329\", \"last_device_update\": \"2020-07-16T13:32:17.578399\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:32:18.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:17 smithi188 bash[23329]: cluster 2020-07-16T13:32:16.852641+0000 mon.a (mon.0) 279 : cluster [INF] osd.2 [v2:172.21.15.132:6818/2489969657,v1:172.21.15.132:6819/2489969657] boot 2020-07-16T13:32:18.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:17 smithi188 bash[23329]: cluster 2020-07-16T13:32:16.852684+0000 mon.a (mon.0) 280 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2020-07-16T13:32:18.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:17 smithi188 bash[23329]: audit 2020-07-16T13:32:16.852849+0000 mon.a (mon.0) 281 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-07-16T13:32:18.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:17 smithi188 bash[23329]: audit 2020-07-16T13:32:17.363901+0000 mon.a (mon.0) 282 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-07-16T13:32:18.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:17 smithi188 bash[23329]: audit 2020-07-16T13:32:17.364519+0000 mon.a (mon.0) 283 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:32:18.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:17 smithi188 bash[23329]: audit 2020-07-16T13:32:17.365340+0000 mon.a (mon.0) 284 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:32:18.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:17 smithi188 bash[23329]: audit 2020-07-16T13:32:17.385980+0000 mon.a (mon.0) 285 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:32:18.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:17 smithi188 bash[23329]: audit 2020-07-16T13:32:17.579154+0000 mon.a (mon.0) 286 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395057\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395143\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395175\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395203\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395231\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395258\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}}, \"last_daemon_update\": \"2020-07-16T13:32:13.395329\", \"last_device_update\": \"2020-07-16T13:32:17.578399\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:32:18.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:17 smithi188 bash[23329]: audit 2020-07-16T13:32:17.582008+0000 mon.a (mon.0) 287 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395057\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395143\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395175\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395203\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395231\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395258\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}}, \"last_daemon_update\": \"2020-07-16T13:32:13.395329\", \"last_device_update\": \"2020-07-16T13:32:17.578399\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:32:19.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:18 smithi188 bash[23329]: audit 2020-07-16T13:32:17.363033+0000 mgr.y (mgr.14140) 80 : audit [DBG] from='client.24196 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi132:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:32:19.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:18 smithi188 bash[23329]: cephadm 2020-07-16T13:32:17.363646+0000 mgr.y (mgr.14140) 81 : cephadm [INF] Applying osd on host smithi132... 2020-07-16T13:32:19.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:18 smithi188 bash[23329]: cluster 2020-07-16T13:32:17.707936+0000 mgr.y (mgr.14140) 82 : cluster [DBG] pgmap v75: 1 pgs: 1 active+undersized+degraded; 0 B data, 328 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2020-07-16T13:32:19.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:18 smithi188 bash[23329]: cluster 2020-07-16T13:32:17.853487+0000 mon.a (mon.0) 288 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2020-07-16T13:32:19.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:18 smithi132 bash[23299]: audit 2020-07-16T13:32:17.363033+0000 mgr.y (mgr.14140) 80 : audit [DBG] from='client.24196 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi132:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:32:19.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:18 smithi132 bash[23299]: cephadm 2020-07-16T13:32:17.363646+0000 mgr.y (mgr.14140) 81 : cephadm [INF] Applying osd on host smithi132... 2020-07-16T13:32:19.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:18 smithi132 bash[23299]: cluster 2020-07-16T13:32:17.707936+0000 mgr.y (mgr.14140) 82 : cluster [DBG] pgmap v75: 1 pgs: 1 active+undersized+degraded; 0 B data, 328 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2020-07-16T13:32:19.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:18 smithi132 bash[23299]: cluster 2020-07-16T13:32:17.853487+0000 mon.a (mon.0) 288 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2020-07-16T13:32:19.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:18 smithi132 bash[27079]: audit 2020-07-16T13:32:17.363033+0000 mgr.y (mgr.14140) 80 : audit [DBG] from='client.24196 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi132:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:32:19.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:18 smithi132 bash[27079]: cephadm 2020-07-16T13:32:17.363646+0000 mgr.y (mgr.14140) 81 : cephadm [INF] Applying osd on host smithi132... 2020-07-16T13:32:19.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:18 smithi132 bash[27079]: cluster 2020-07-16T13:32:17.707936+0000 mgr.y (mgr.14140) 82 : cluster [DBG] pgmap v75: 1 pgs: 1 active+undersized+degraded; 0 B data, 328 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2020-07-16T13:32:19.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:18 smithi132 bash[27079]: cluster 2020-07-16T13:32:17.853487+0000 mon.a (mon.0) 288 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2020-07-16T13:32:20.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:19 smithi188 bash[23329]: audit 2020-07-16T13:32:19.529747+0000 mon.c (mon.1) 9 : audit [INF] from='client.? 172.21.15.132:0/2207477479' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "72a90982-aa5f-4c26-9afe-50294c5c503b"}]: dispatch 2020-07-16T13:32:20.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:19 smithi188 bash[23329]: audit 2020-07-16T13:32:19.530076+0000 mon.a (mon.0) 289 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "72a90982-aa5f-4c26-9afe-50294c5c503b"}]: dispatch 2020-07-16T13:32:20.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:19 smithi188 bash[23329]: audit 2020-07-16T13:32:19.534381+0000 mon.a (mon.0) 290 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "72a90982-aa5f-4c26-9afe-50294c5c503b"}]': finished 2020-07-16T13:32:20.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:19 smithi188 bash[23329]: cluster 2020-07-16T13:32:19.534433+0000 mon.a (mon.0) 291 : cluster [DBG] osdmap e23: 4 total, 3 up, 3 in 2020-07-16T13:32:20.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:19 smithi188 bash[23329]: audit 2020-07-16T13:32:19.534555+0000 mon.a (mon.0) 292 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-07-16T13:32:20.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:19 smithi132 bash[23299]: audit 2020-07-16T13:32:19.529747+0000 mon.c (mon.1) 9 : audit [INF] from='client.? 172.21.15.132:0/2207477479' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "72a90982-aa5f-4c26-9afe-50294c5c503b"}]: dispatch 2020-07-16T13:32:20.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:19 smithi132 bash[23299]: audit 2020-07-16T13:32:19.530076+0000 mon.a (mon.0) 289 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "72a90982-aa5f-4c26-9afe-50294c5c503b"}]: dispatch 2020-07-16T13:32:20.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:19 smithi132 bash[23299]: audit 2020-07-16T13:32:19.534381+0000 mon.a (mon.0) 290 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "72a90982-aa5f-4c26-9afe-50294c5c503b"}]': finished 2020-07-16T13:32:20.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:19 smithi132 bash[23299]: cluster 2020-07-16T13:32:19.534433+0000 mon.a (mon.0) 291 : cluster [DBG] osdmap e23: 4 total, 3 up, 3 in 2020-07-16T13:32:20.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:19 smithi132 bash[23299]: audit 2020-07-16T13:32:19.534555+0000 mon.a (mon.0) 292 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-07-16T13:32:20.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:19 smithi132 bash[27079]: audit 2020-07-16T13:32:19.529747+0000 mon.c (mon.1) 9 : audit [INF] from='client.? 172.21.15.132:0/2207477479' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "72a90982-aa5f-4c26-9afe-50294c5c503b"}]: dispatch 2020-07-16T13:32:20.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:19 smithi132 bash[27079]: audit 2020-07-16T13:32:19.530076+0000 mon.a (mon.0) 289 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "72a90982-aa5f-4c26-9afe-50294c5c503b"}]: dispatch 2020-07-16T13:32:20.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:19 smithi132 bash[27079]: audit 2020-07-16T13:32:19.534381+0000 mon.a (mon.0) 290 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "72a90982-aa5f-4c26-9afe-50294c5c503b"}]': finished 2020-07-16T13:32:20.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:19 smithi132 bash[27079]: cluster 2020-07-16T13:32:19.534433+0000 mon.a (mon.0) 291 : cluster [DBG] osdmap e23: 4 total, 3 up, 3 in 2020-07-16T13:32:20.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:19 smithi132 bash[27079]: audit 2020-07-16T13:32:19.534555+0000 mon.a (mon.0) 292 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-07-16T13:32:21.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:20 smithi188 bash[23329]: cluster 2020-07-16T13:32:19.708385+0000 mgr.y (mgr.14140) 83 : cluster [DBG] pgmap v78: 1 pgs: 1 active+undersized+degraded; 0 B data, 544 KiB used, 265 GiB / 268 GiB avail; 1/3 objects degraded (33.333%) 2020-07-16T13:32:21.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:20 smithi132 bash[23299]: cluster 2020-07-16T13:32:19.708385+0000 mgr.y (mgr.14140) 83 : cluster [DBG] pgmap v78: 1 pgs: 1 active+undersized+degraded; 0 B data, 544 KiB used, 265 GiB / 268 GiB avail; 1/3 objects degraded (33.333%) 2020-07-16T13:32:21.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:20 smithi132 bash[27079]: cluster 2020-07-16T13:32:19.708385+0000 mgr.y (mgr.14140) 83 : cluster [DBG] pgmap v78: 1 pgs: 1 active+undersized+degraded; 0 B data, 544 KiB used, 265 GiB / 268 GiB avail; 1/3 objects degraded (33.333%) 2020-07-16T13:32:22.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:21 smithi188 bash[23329]: audit 2020-07-16T13:32:21.247900+0000 mon.c (mon.1) 10 : audit [DBG] from='client.? 172.21.15.132:0/1821721516' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-07-16T13:32:22.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:21 smithi132 bash[23299]: audit 2020-07-16T13:32:21.247900+0000 mon.c (mon.1) 10 : audit [DBG] from='client.? 172.21.15.132:0/1821721516' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-07-16T13:32:22.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:21 smithi132 bash[27079]: audit 2020-07-16T13:32:21.247900+0000 mon.c (mon.1) 10 : audit [DBG] from='client.? 172.21.15.132:0/1821721516' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-07-16T13:32:23.161 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:22 smithi132 bash[23299]: cluster 2020-07-16T13:32:21.708930+0000 mgr.y (mgr.14140) 84 : cluster [DBG] pgmap v79: 1 pgs: 1 active+clean; 0 B data, 576 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2020-07-16T13:32:23.162 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:22 smithi132 bash[23299]: cluster 2020-07-16T13:32:21.860698+0000 mon.a (mon.0) 293 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded) 2020-07-16T13:32:23.162 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:22 smithi132 bash[23299]: cluster 2020-07-16T13:32:21.860732+0000 mon.a (mon.0) 294 : cluster [INF] Cluster is now healthy 2020-07-16T13:32:23.162 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:22 smithi132 bash[27079]: cluster 2020-07-16T13:32:21.708930+0000 mgr.y (mgr.14140) 84 : cluster [DBG] pgmap v79: 1 pgs: 1 active+clean; 0 B data, 576 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2020-07-16T13:32:23.163 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:22 smithi132 bash[27079]: cluster 2020-07-16T13:32:21.860698+0000 mon.a (mon.0) 293 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded) 2020-07-16T13:32:23.163 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:22 smithi132 bash[27079]: cluster 2020-07-16T13:32:21.860732+0000 mon.a (mon.0) 294 : cluster [INF] Cluster is now healthy 2020-07-16T13:32:23.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:22 smithi188 bash[23329]: cluster 2020-07-16T13:32:21.708930+0000 mgr.y (mgr.14140) 84 : cluster [DBG] pgmap v79: 1 pgs: 1 active+clean; 0 B data, 576 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2020-07-16T13:32:23.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:22 smithi188 bash[23329]: cluster 2020-07-16T13:32:21.860698+0000 mon.a (mon.0) 293 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded) 2020-07-16T13:32:23.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:22 smithi188 bash[23329]: cluster 2020-07-16T13:32:21.860732+0000 mon.a (mon.0) 294 : cluster [INF] Cluster is now healthy 2020-07-16T13:32:24.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:23 smithi188 bash[23329]: audit 2020-07-16T13:32:23.629023+0000 mon.a (mon.0) 295 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:32:24.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:23 smithi132 bash[23299]: audit 2020-07-16T13:32:23.629023+0000 mon.a (mon.0) 295 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:32:24.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:23 smithi132 bash[27079]: audit 2020-07-16T13:32:23.629023+0000 mon.a (mon.0) 295 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:32:25.021 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:24 smithi132 bash[23299]: cluster 2020-07-16T13:32:23.709268+0000 mgr.y (mgr.14140) 85 : cluster [DBG] pgmap v80: 1 pgs: 1 active+clean; 0 B data, 592 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2020-07-16T13:32:25.021 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:24 smithi132 bash[27079]: cluster 2020-07-16T13:32:23.709268+0000 mgr.y (mgr.14140) 85 : cluster [DBG] pgmap v80: 1 pgs: 1 active+clean; 0 B data, 592 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2020-07-16T13:32:25.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:24 smithi188 bash[23329]: cluster 2020-07-16T13:32:23.709268+0000 mgr.y (mgr.14140) 85 : cluster [DBG] pgmap v80: 1 pgs: 1 active+clean; 0 B data, 592 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2020-07-16T13:32:27.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:26 smithi188 bash[23329]: cluster 2020-07-16T13:32:25.709689+0000 mgr.y (mgr.14140) 86 : cluster [DBG] pgmap v81: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2020-07-16T13:32:27.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:26 smithi188 bash[23329]: audit 2020-07-16T13:32:25.895069+0000 mon.a (mon.0) 296 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2020-07-16T13:32:27.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:26 smithi188 bash[23329]: audit 2020-07-16T13:32:25.895642+0000 mon.a (mon.0) 297 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:32:27.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:26 smithi188 bash[23329]: cephadm 2020-07-16T13:32:25.896033+0000 mgr.y (mgr.14140) 87 : cephadm [INF] Deploying daemon osd.3 on smithi132 2020-07-16T13:32:27.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:26 smithi188 bash[23329]: audit 2020-07-16T13:32:25.896223+0000 mon.a (mon.0) 298 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.3", "key": "container_image"}]: dispatch 2020-07-16T13:32:27.209 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:26 smithi132 bash[27079]: cluster 2020-07-16T13:32:25.709689+0000 mgr.y (mgr.14140) 86 : cluster [DBG] pgmap v81: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2020-07-16T13:32:27.209 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:26 smithi132 bash[27079]: audit 2020-07-16T13:32:25.895069+0000 mon.a (mon.0) 296 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2020-07-16T13:32:27.210 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:26 smithi132 bash[27079]: audit 2020-07-16T13:32:25.895642+0000 mon.a (mon.0) 297 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:32:27.210 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:26 smithi132 bash[27079]: cephadm 2020-07-16T13:32:25.896033+0000 mgr.y (mgr.14140) 87 : cephadm [INF] Deploying daemon osd.3 on smithi132 2020-07-16T13:32:27.210 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:26 smithi132 bash[27079]: audit 2020-07-16T13:32:25.896223+0000 mon.a (mon.0) 298 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.3", "key": "container_image"}]: dispatch 2020-07-16T13:32:27.210 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:26 smithi132 bash[23299]: cluster 2020-07-16T13:32:25.709689+0000 mgr.y (mgr.14140) 86 : cluster [DBG] pgmap v81: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2020-07-16T13:32:27.210 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:26 smithi132 bash[23299]: audit 2020-07-16T13:32:25.895069+0000 mon.a (mon.0) 296 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2020-07-16T13:32:27.211 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:26 smithi132 bash[23299]: audit 2020-07-16T13:32:25.895642+0000 mon.a (mon.0) 297 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:32:27.211 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:26 smithi132 bash[23299]: cephadm 2020-07-16T13:32:25.896033+0000 mgr.y (mgr.14140) 87 : cephadm [INF] Deploying daemon osd.3 on smithi132 2020-07-16T13:32:27.211 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:26 smithi132 bash[23299]: audit 2020-07-16T13:32:25.896223+0000 mon.a (mon.0) 298 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.3", "key": "container_image"}]: dispatch 2020-07-16T13:32:27.386 INFO:teuthology.orchestra.run.smithi132.stdout:Created osd(s) 3 on host 'smithi132' 2020-07-16T13:32:28.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:27 smithi132 bash[23299]: audit 2020-07-16T13:32:27.379214+0000 mon.a (mon.0) 299 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395057\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395143\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395175\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395203\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395231\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395258\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"hostname\": \"smithi132\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}}, \"last_device_update\": \"2020-07-16T13:32:17.578399\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:32:28.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:27 smithi132 bash[23299]: audit 2020-07-16T13:32:27.379806+0000 mon.a (mon.0) 300 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:32:28.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:27 smithi132 bash[23299]: audit 2020-07-16T13:32:27.382646+0000 mon.a (mon.0) 301 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395057\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395143\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395175\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395203\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395231\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395258\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"hostname\": \"smithi132\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}}, \"last_device_update\": \"2020-07-16T13:32:17.578399\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:32:28.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:27 smithi132 bash[27079]: audit 2020-07-16T13:32:27.379214+0000 mon.a (mon.0) 299 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395057\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395143\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395175\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395203\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395231\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395258\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"hostname\": \"smithi132\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}}, \"last_device_update\": \"2020-07-16T13:32:17.578399\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:32:28.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:27 smithi132 bash[27079]: audit 2020-07-16T13:32:27.379806+0000 mon.a (mon.0) 300 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:32:28.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:27 smithi132 bash[27079]: audit 2020-07-16T13:32:27.382646+0000 mon.a (mon.0) 301 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395057\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395143\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395175\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395203\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395231\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395258\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"hostname\": \"smithi132\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}}, \"last_device_update\": \"2020-07-16T13:32:17.578399\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:32:28.124 INFO:teuthology.orchestra.run.smithi132:osd.3> sudo journalctl -f -n 0 -u ceph-4c8ed362-c768-11ea-a06f-001a4aab830c@osd.3.service 2020-07-16T13:32:28.127 INFO:tasks.cephadm:Deploying osd.4 on smithi188 with /dev/vg_nvme/lv_4... 2020-07-16T13:32:28.127 INFO:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4c8ed362-c768-11ea-a06f-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2020-07-16T13:32:28.160 INFO:journalctl@ceph.osd.3.smithi132.stdout:-- Logs begin at Thu 2020-07-16 13:22:27 UTC. -- 2020-07-16T13:32:28.162 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:27 smithi188 bash[23329]: audit 2020-07-16T13:32:27.379214+0000 mon.a (mon.0) 299 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395057\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395143\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395175\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395203\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395231\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395258\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"hostname\": \"smithi132\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}}, \"last_device_update\": \"2020-07-16T13:32:17.578399\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:32:28.163 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:27 smithi188 bash[23329]: audit 2020-07-16T13:32:27.379806+0000 mon.a (mon.0) 300 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:32:28.163 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:27 smithi188 bash[23329]: audit 2020-07-16T13:32:27.382646+0000 mon.a (mon.0) 301 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395057\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395143\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395175\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395203\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395231\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:13.395258\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"hostname\": \"smithi132\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}}, \"last_device_update\": \"2020-07-16T13:32:17.578399\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:32:28.779 INFO:journalctl@ceph.osd.3.smithi132.stdout:Jul 16 13:32:28 smithi132 bash[1313]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2020-07-16T13:32:28.779 INFO:journalctl@ceph.osd.3.smithi132.stdout:Jul 16 13:32:28 smithi132 bash[1313]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-3 --no-mon-config 2020-07-16T13:32:28.779 INFO:journalctl@ceph.osd.3.smithi132.stdout:Jul 16 13:32:28 smithi132 bash[1313]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3/block 2020-07-16T13:32:28.780 INFO:journalctl@ceph.osd.3.smithi132.stdout:Jul 16 13:32:28 smithi132 bash[1313]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-3/block 2020-07-16T13:32:28.780 INFO:journalctl@ceph.osd.3.smithi132.stdout:Jul 16 13:32:28 smithi132 bash[1313]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2020-07-16T13:32:28.780 INFO:journalctl@ceph.osd.3.smithi132.stdout:Jul 16 13:32:28 smithi132 bash[1313]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2020-07-16T13:32:28.780 INFO:journalctl@ceph.osd.3.smithi132.stdout:Jul 16 13:32:28 smithi132 bash[1313]: --> ceph-volume lvm activate successful for osd ID: 3 2020-07-16T13:32:28.780 INFO:journalctl@ceph.osd.3.smithi132.stdout:Jul 16 13:32:28 smithi132 podman[1315]: 2020-07-16 13:32:28.358355646 +0000 UTC m=+0.996095597 container died c693a4ce55199e2cb33323eb15b566dae111490a58a4c781da48adf99418ebde (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.3-activate) 2020-07-16T13:32:29.095 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:28 smithi132 bash[23299]: cluster 2020-07-16T13:32:27.710103+0000 mgr.y (mgr.14140) 88 : cluster [DBG] pgmap v82: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2020-07-16T13:32:29.096 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:28 smithi132 bash[27079]: cluster 2020-07-16T13:32:27.710103+0000 mgr.y (mgr.14140) 88 : cluster [DBG] pgmap v82: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2020-07-16T13:32:29.096 INFO:journalctl@ceph.osd.3.smithi132.stdout:Jul 16 13:32:28 smithi132 podman[1315]: 2020-07-16 13:32:28.816634367 +0000 UTC m=+1.454374332 container remove c693a4ce55199e2cb33323eb15b566dae111490a58a4c781da48adf99418ebde (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.3-activate) 2020-07-16T13:32:29.097 INFO:journalctl@ceph.osd.3.smithi132.stdout:Jul 16 13:32:29 smithi132 podman[1584]: 2020-07-16 13:32:29.044621695 +0000 UTC m=+0.214113815 container create cba1b711fd955172183cfc416160fdd9165fc33dda66d2a708e341305fbaaa0f (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.3) 2020-07-16T13:32:29.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:28 smithi188 bash[23329]: cluster 2020-07-16T13:32:27.710103+0000 mgr.y (mgr.14140) 88 : cluster [DBG] pgmap v82: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2020-07-16T13:32:29.529 INFO:journalctl@ceph.osd.3.smithi132.stdout:Jul 16 13:32:29 smithi132 podman[1584]: 2020-07-16 13:32:29.177969436 +0000 UTC m=+0.347461588 container init cba1b711fd955172183cfc416160fdd9165fc33dda66d2a708e341305fbaaa0f (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.3) 2020-07-16T13:32:29.529 INFO:journalctl@ceph.osd.3.smithi132.stdout:Jul 16 13:32:29 smithi132 podman[1584]: 2020-07-16 13:32:29.277944841 +0000 UTC m=+0.447436987 container start cba1b711fd955172183cfc416160fdd9165fc33dda66d2a708e341305fbaaa0f (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.3) 2020-07-16T13:32:29.529 INFO:journalctl@ceph.osd.3.smithi132.stdout:Jul 16 13:32:29 smithi132 podman[1584]: 2020-07-16 13:32:29.278012436 +0000 UTC m=+0.447504569 container attach cba1b711fd955172183cfc416160fdd9165fc33dda66d2a708e341305fbaaa0f (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.3) 2020-07-16T13:32:29.529 INFO:journalctl@ceph.osd.3.smithi132.stdout:Jul 16 13:32:29 smithi132 bash[1313]: debug 2020-07-16T13:32:29.201+0000 7f3419d13ec0 1 -- 172.21.15.132:0/2962203052 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563be738cc00 msgr2=0x563be7389680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T13:32:29.530 INFO:journalctl@ceph.osd.3.smithi132.stdout:Jul 16 13:32:29 smithi132 bash[1313]: debug 2020-07-16T13:32:29.201+0000 7f3419d13ec0 1 --2- 172.21.15.132:0/2962203052 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563be738cc00 0x563be7389680 secure :-1 s=READY pgs=100 cs=0 l=1 rx=0x563be731fd70 tx=0x563be7ff8aa0).stop 2020-07-16T13:32:29.530 INFO:journalctl@ceph.osd.3.smithi132.stdout:Jul 16 13:32:29 smithi132 bash[1313]: debug 2020-07-16T13:32:29.201+0000 7f3419d13ec0 5 --2- 172.21.15.132:0/2962203052 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563be738cc00 0x563be7389680 secure :-1 s=READY pgs=100 cs=0 l=1 rx=0x563be731fd70 tx=0x563be7ff8aa0).reset_recv_state 2020-07-16T13:32:29.530 INFO:journalctl@ceph.osd.3.smithi132.stdout:Jul 16 13:32:29 smithi132 bash[1313]: debug 2020-07-16T13:32:29.201+0000 7f3419d13ec0 20 Event(0x563be7331040 nevent=5000 time_id=3).wakeup 2020-07-16T13:32:29.530 INFO:journalctl@ceph.osd.3.smithi132.stdout:Jul 16 13:32:29 smithi132 bash[1313]: debug 2020-07-16T13:32:29.201+0000 7f3419d13ec0 10 --2- 172.21.15.132:0/2962203052 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563be738cc00 0x563be7389680 secure :-1 s=READY pgs=100 cs=0 l=1 rx=0x563be731fd70 tx=0x563be7ff8aa0).discard_out_queue started 2020-07-16T13:32:29.530 INFO:journalctl@ceph.osd.3.smithi132.stdout:Jul 16 13:32:29 smithi132 bash[1313]: debug 2020-07-16T13:32:29.201+0000 7f3413d60700 5 --2- 172.21.15.132:0/2962203052 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563be738cc00 0x563be7389680 secure :-1 s=CLOSED pgs=100 cs=0 l=1 rx=0x563be731fd70 tx=0x563be7ff8aa0).reset_recv_state (warped) reseting crypto handlers 2020-07-16T13:32:29.531 INFO:journalctl@ceph.osd.3.smithi132.stdout:Jul 16 13:32:29 smithi132 bash[1313]: debug 2020-07-16T13:32:29.201+0000 7f3413d60700 5 --2- 172.21.15.132:0/2962203052 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563be738cc00 0x563be7389680 secure :-1 s=CLOSED pgs=100 cs=0 l=1 rx=0x563be731fd70 tx=0x563be7ff8aa0).reset_security 2020-07-16T13:32:29.531 INFO:journalctl@ceph.osd.3.smithi132.stdout:Jul 16 13:32:29 smithi132 bash[1313]: debug 2020-07-16T13:32:29.201+0000 7f3413d60700 20 EpollDriver.del_event del event fd=14 cur_mask=1 delmask=3 to 8 2020-07-16T13:32:30.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:29 smithi132 bash[23299]: audit 2020-07-16T13:32:29.338567+0000 mon.a (mon.0) 302 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337592\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337665\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337696\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337723\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337749\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337776\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337802\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}}, \"last_daemon_update\": \"2020-07-16T13:32:29.337871\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:32:30.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:29 smithi132 bash[23299]: audit 2020-07-16T13:32:29.343768+0000 mon.a (mon.0) 303 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337592\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337665\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337696\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337723\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337749\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337776\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337802\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}}, \"last_daemon_update\": \"2020-07-16T13:32:29.337871\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:32:30.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:29 smithi132 bash[23299]: audit 2020-07-16T13:32:29.344290+0000 mon.a (mon.0) 304 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:32:30.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:29 smithi132 bash[27079]: audit 2020-07-16T13:32:29.338567+0000 mon.a (mon.0) 302 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337592\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337665\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337696\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337723\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337749\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337776\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337802\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}}, \"last_daemon_update\": \"2020-07-16T13:32:29.337871\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:32:30.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:29 smithi132 bash[27079]: audit 2020-07-16T13:32:29.343768+0000 mon.a (mon.0) 303 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337592\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337665\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337696\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337723\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337749\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337776\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337802\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}}, \"last_daemon_update\": \"2020-07-16T13:32:29.337871\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:32:30.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:29 smithi132 bash[27079]: audit 2020-07-16T13:32:29.344290+0000 mon.a (mon.0) 304 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:32:30.032 INFO:journalctl@ceph.osd.3.smithi132.stdout:Jul 16 13:32:29 smithi132 bash[1313]: debug 2020-07-16T13:32:29.718+0000 7f3419d13ec0 -1 Falling back to public interface 2020-07-16T13:32:30.097 INFO:teuthology.orchestra.run.smithi188.stderr:--> Zapping: /dev/vg_nvme/lv_4 2020-07-16T13:32:30.097 INFO:teuthology.orchestra.run.smithi188.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2020-07-16T13:32:30.097 INFO:teuthology.orchestra.run.smithi188.stderr: stderr: 10+0 records in 2020-07-16T13:32:30.098 INFO:teuthology.orchestra.run.smithi188.stderr:10+0 records out 2020-07-16T13:32:30.098 INFO:teuthology.orchestra.run.smithi188.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0126224 s, 831 MB/s 2020-07-16T13:32:30.098 INFO:teuthology.orchestra.run.smithi188.stderr:--> Zapping successful for: 2020-07-16T13:32:30.158 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:29 smithi188 bash[23329]: audit 2020-07-16T13:32:29.338567+0000 mon.a (mon.0) 302 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337592\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337665\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337696\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337723\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337749\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337776\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337802\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}}, \"last_daemon_update\": \"2020-07-16T13:32:29.337871\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:32:30.158 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:29 smithi188 bash[23329]: audit 2020-07-16T13:32:29.343768+0000 mon.a (mon.0) 303 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337592\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337665\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337696\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337723\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337749\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337776\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337802\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}}, \"last_daemon_update\": \"2020-07-16T13:32:29.337871\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:32:30.158 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:29 smithi188 bash[23329]: audit 2020-07-16T13:32:29.344290+0000 mon.a (mon.0) 304 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:32:30.529 INFO:journalctl@ceph.osd.3.smithi132.stdout:Jul 16 13:32:30 smithi132 bash[1313]: debug 2020-07-16T13:32:30.279+0000 7f3419d13ec0 -1 osd.3 0 log_to_monitors {default=true} 2020-07-16T13:32:30.572 INFO:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4c8ed362-c768-11ea-a06f-001a4aab830c -- ceph orch daemon add osd smithi188:vg_nvme/lv_4 2020-07-16T13:32:30.929 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:30 smithi132 bash[27079]: cluster 2020-07-16T13:32:29.710419+0000 mgr.y (mgr.14140) 89 : cluster [DBG] pgmap v83: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2020-07-16T13:32:30.929 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:30 smithi132 bash[27079]: audit 2020-07-16T13:32:30.282958+0000 mon.a (mon.0) 305 : audit [INF] from='osd.3 [v2:172.21.15.132:6826/3154069775,v1:172.21.15.132:6827/3154069775]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2020-07-16T13:32:30.930 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:30 smithi132 bash[23299]: cluster 2020-07-16T13:32:29.710419+0000 mgr.y (mgr.14140) 89 : cluster [DBG] pgmap v83: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2020-07-16T13:32:30.930 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:30 smithi132 bash[23299]: audit 2020-07-16T13:32:30.282958+0000 mon.a (mon.0) 305 : audit [INF] from='osd.3 [v2:172.21.15.132:6826/3154069775,v1:172.21.15.132:6827/3154069775]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2020-07-16T13:32:31.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:30 smithi188 bash[23329]: cluster 2020-07-16T13:32:29.710419+0000 mgr.y (mgr.14140) 89 : cluster [DBG] pgmap v83: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2020-07-16T13:32:31.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:30 smithi188 bash[23329]: audit 2020-07-16T13:32:30.282958+0000 mon.a (mon.0) 305 : audit [INF] from='osd.3 [v2:172.21.15.132:6826/3154069775,v1:172.21.15.132:6827/3154069775]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2020-07-16T13:32:31.993 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:31 smithi132 bash[23299]: audit 2020-07-16T13:32:30.903172+0000 mon.a (mon.0) 306 : audit [INF] from='osd.3 [v2:172.21.15.132:6826/3154069775,v1:172.21.15.132:6827/3154069775]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2020-07-16T13:32:31.993 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:31 smithi132 bash[23299]: cluster 2020-07-16T13:32:30.903217+0000 mon.a (mon.0) 307 : cluster [DBG] osdmap e24: 4 total, 3 up, 3 in 2020-07-16T13:32:31.993 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:31 smithi132 bash[23299]: audit 2020-07-16T13:32:30.903341+0000 mon.a (mon.0) 308 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-07-16T13:32:31.994 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:31 smithi132 bash[23299]: audit 2020-07-16T13:32:30.903841+0000 mon.a (mon.0) 309 : audit [INF] from='osd.3 [v2:172.21.15.132:6826/3154069775,v1:172.21.15.132:6827/3154069775]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]: dispatch 2020-07-16T13:32:31.994 INFO:journalctl@ceph.osd.3.smithi132.stdout:Jul 16 13:32:31 smithi132 bash[1313]: debug 2020-07-16T13:32:31.910+0000 7f33feac0700 -1 osd.3 0 waiting for initial osdmap 2020-07-16T13:32:32.026 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:31 smithi188 bash[23329]: audit 2020-07-16T13:32:30.903172+0000 mon.a (mon.0) 306 : audit [INF] from='osd.3 [v2:172.21.15.132:6826/3154069775,v1:172.21.15.132:6827/3154069775]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2020-07-16T13:32:32.027 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:31 smithi188 bash[23329]: cluster 2020-07-16T13:32:30.903217+0000 mon.a (mon.0) 307 : cluster [DBG] osdmap e24: 4 total, 3 up, 3 in 2020-07-16T13:32:32.027 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:31 smithi188 bash[23329]: audit 2020-07-16T13:32:30.903341+0000 mon.a (mon.0) 308 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-07-16T13:32:32.027 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:31 smithi188 bash[23329]: audit 2020-07-16T13:32:30.903841+0000 mon.a (mon.0) 309 : audit [INF] from='osd.3 [v2:172.21.15.132:6826/3154069775,v1:172.21.15.132:6827/3154069775]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]: dispatch 2020-07-16T13:32:32.262 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:31 smithi132 bash[27079]: audit 2020-07-16T13:32:30.903172+0000 mon.a (mon.0) 306 : audit [INF] from='osd.3 [v2:172.21.15.132:6826/3154069775,v1:172.21.15.132:6827/3154069775]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2020-07-16T13:32:32.263 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:31 smithi132 bash[27079]: cluster 2020-07-16T13:32:30.903217+0000 mon.a (mon.0) 307 : cluster [DBG] osdmap e24: 4 total, 3 up, 3 in 2020-07-16T13:32:32.263 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:31 smithi132 bash[27079]: audit 2020-07-16T13:32:30.903341+0000 mon.a (mon.0) 308 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-07-16T13:32:32.263 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:31 smithi132 bash[27079]: audit 2020-07-16T13:32:30.903841+0000 mon.a (mon.0) 309 : audit [INF] from='osd.3 [v2:172.21.15.132:6826/3154069775,v1:172.21.15.132:6827/3154069775]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]: dispatch 2020-07-16T13:32:33.077 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:32 smithi188 bash[23329]: cluster 2020-07-16T13:32:31.313207+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2020-07-16T13:32:33.078 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:32 smithi188 bash[23329]: cluster 2020-07-16T13:32:31.313249+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2020-07-16T13:32:33.078 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:32 smithi188 bash[23329]: cluster 2020-07-16T13:32:31.710858+0000 mgr.y (mgr.14140) 90 : cluster [DBG] pgmap v85: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail 2020-07-16T13:32:33.078 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:32 smithi188 bash[23329]: audit 2020-07-16T13:32:31.908644+0000 mon.a (mon.0) 310 : audit [INF] from='osd.3 [v2:172.21.15.132:6826/3154069775,v1:172.21.15.132:6827/3154069775]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]': finished 2020-07-16T13:32:33.078 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:32 smithi188 bash[23329]: cluster 2020-07-16T13:32:31.908676+0000 mon.a (mon.0) 311 : cluster [DBG] osdmap e25: 4 total, 3 up, 3 in 2020-07-16T13:32:33.078 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:32 smithi188 bash[23329]: audit 2020-07-16T13:32:31.908935+0000 mon.a (mon.0) 312 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-07-16T13:32:33.079 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:32 smithi188 bash[23329]: audit 2020-07-16T13:32:32.275873+0000 mon.a (mon.0) 313 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:32:33.079 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:32 smithi188 bash[23329]: audit 2020-07-16T13:32:32.369516+0000 mon.a (mon.0) 314 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-07-16T13:32:33.079 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:32 smithi188 bash[23329]: audit 2020-07-16T13:32:32.370132+0000 mon.a (mon.0) 315 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:32:33.079 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:32 smithi188 bash[23329]: audit 2020-07-16T13:32:32.370913+0000 mon.a (mon.0) 316 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:32:33.080 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:32 smithi188 bash[23329]: audit 2020-07-16T13:32:32.461763+0000 mon.a (mon.0) 317 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337592\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337665\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337696\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337723\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337749\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337776\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337802\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}}, \"last_daemon_update\": \"2020-07-16T13:32:29.337871\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:32:33.080 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:32 smithi188 bash[23329]: audit 2020-07-16T13:32:32.464607+0000 mon.a (mon.0) 318 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337592\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337665\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337696\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337723\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337749\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337776\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337802\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}}, \"last_daemon_update\": \"2020-07-16T13:32:29.337871\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:32:33.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:32 smithi132 bash[27079]: cluster 2020-07-16T13:32:31.313207+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2020-07-16T13:32:33.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:32 smithi132 bash[27079]: cluster 2020-07-16T13:32:31.313249+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2020-07-16T13:32:33.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:32 smithi132 bash[27079]: cluster 2020-07-16T13:32:31.710858+0000 mgr.y (mgr.14140) 90 : cluster [DBG] pgmap v85: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail 2020-07-16T13:32:33.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:32 smithi132 bash[27079]: audit 2020-07-16T13:32:31.908644+0000 mon.a (mon.0) 310 : audit [INF] from='osd.3 [v2:172.21.15.132:6826/3154069775,v1:172.21.15.132:6827/3154069775]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]': finished 2020-07-16T13:32:33.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:32 smithi132 bash[27079]: cluster 2020-07-16T13:32:31.908676+0000 mon.a (mon.0) 311 : cluster [DBG] osdmap e25: 4 total, 3 up, 3 in 2020-07-16T13:32:33.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:32 smithi132 bash[27079]: audit 2020-07-16T13:32:31.908935+0000 mon.a (mon.0) 312 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-07-16T13:32:33.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:32 smithi132 bash[27079]: audit 2020-07-16T13:32:32.275873+0000 mon.a (mon.0) 313 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:32:33.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:32 smithi132 bash[27079]: audit 2020-07-16T13:32:32.369516+0000 mon.a (mon.0) 314 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-07-16T13:32:33.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:32 smithi132 bash[27079]: audit 2020-07-16T13:32:32.370132+0000 mon.a (mon.0) 315 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:32:33.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:32 smithi132 bash[27079]: audit 2020-07-16T13:32:32.370913+0000 mon.a (mon.0) 316 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:32:33.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:32 smithi132 bash[27079]: audit 2020-07-16T13:32:32.461763+0000 mon.a (mon.0) 317 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337592\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337665\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337696\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337723\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337749\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337776\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337802\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}}, \"last_daemon_update\": \"2020-07-16T13:32:29.337871\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:32:33.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:32 smithi132 bash[27079]: audit 2020-07-16T13:32:32.464607+0000 mon.a (mon.0) 318 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337592\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337665\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337696\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337723\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337749\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337776\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337802\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}}, \"last_daemon_update\": \"2020-07-16T13:32:29.337871\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:32:33.282 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:32 smithi132 bash[23299]: cluster 2020-07-16T13:32:31.313207+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2020-07-16T13:32:33.283 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:32 smithi132 bash[23299]: cluster 2020-07-16T13:32:31.313249+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2020-07-16T13:32:33.283 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:32 smithi132 bash[23299]: cluster 2020-07-16T13:32:31.710858+0000 mgr.y (mgr.14140) 90 : cluster [DBG] pgmap v85: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail 2020-07-16T13:32:33.284 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:32 smithi132 bash[23299]: audit 2020-07-16T13:32:31.908644+0000 mon.a (mon.0) 310 : audit [INF] from='osd.3 [v2:172.21.15.132:6826/3154069775,v1:172.21.15.132:6827/3154069775]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]': finished 2020-07-16T13:32:33.284 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:32 smithi132 bash[23299]: cluster 2020-07-16T13:32:31.908676+0000 mon.a (mon.0) 311 : cluster [DBG] osdmap e25: 4 total, 3 up, 3 in 2020-07-16T13:32:33.284 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:32 smithi132 bash[23299]: audit 2020-07-16T13:32:31.908935+0000 mon.a (mon.0) 312 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-07-16T13:32:33.284 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:32 smithi132 bash[23299]: audit 2020-07-16T13:32:32.275873+0000 mon.a (mon.0) 313 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:32:33.285 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:32 smithi132 bash[23299]: audit 2020-07-16T13:32:32.369516+0000 mon.a (mon.0) 314 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-07-16T13:32:33.285 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:32 smithi132 bash[23299]: audit 2020-07-16T13:32:32.370132+0000 mon.a (mon.0) 315 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:32:33.285 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:32 smithi132 bash[23299]: audit 2020-07-16T13:32:32.370913+0000 mon.a (mon.0) 316 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:32:33.285 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:32 smithi132 bash[23299]: audit 2020-07-16T13:32:32.461763+0000 mon.a (mon.0) 317 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337592\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337665\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337696\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337723\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337749\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337776\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337802\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}}, \"last_daemon_update\": \"2020-07-16T13:32:29.337871\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:32:33.286 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:32 smithi132 bash[23299]: audit 2020-07-16T13:32:32.464607+0000 mon.a (mon.0) 318 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337592\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337665\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337696\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337723\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337749\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337776\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337802\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}}, \"last_daemon_update\": \"2020-07-16T13:32:29.337871\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:32:34.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:33 smithi188 bash[23329]: audit 2020-07-16T13:32:32.368485+0000 mgr.y (mgr.14140) 91 : audit [DBG] from='client.34175 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:32:34.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:33 smithi188 bash[23329]: cephadm 2020-07-16T13:32:32.369249+0000 mgr.y (mgr.14140) 92 : cephadm [INF] Applying osd on host smithi188... 2020-07-16T13:32:34.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:33 smithi188 bash[23329]: cluster 2020-07-16T13:32:32.911402+0000 mon.a (mon.0) 319 : cluster [INF] osd.3 [v2:172.21.15.132:6826/3154069775,v1:172.21.15.132:6827/3154069775] boot 2020-07-16T13:32:34.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:33 smithi188 bash[23329]: cluster 2020-07-16T13:32:32.911441+0000 mon.a (mon.0) 320 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2020-07-16T13:32:34.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:33 smithi188 bash[23329]: audit 2020-07-16T13:32:32.912153+0000 mon.a (mon.0) 321 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-07-16T13:32:34.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:33 smithi132 bash[23299]: audit 2020-07-16T13:32:32.368485+0000 mgr.y (mgr.14140) 91 : audit [DBG] from='client.34175 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:32:34.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:33 smithi132 bash[23299]: cephadm 2020-07-16T13:32:32.369249+0000 mgr.y (mgr.14140) 92 : cephadm [INF] Applying osd on host smithi188... 2020-07-16T13:32:34.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:33 smithi132 bash[23299]: cluster 2020-07-16T13:32:32.911402+0000 mon.a (mon.0) 319 : cluster [INF] osd.3 [v2:172.21.15.132:6826/3154069775,v1:172.21.15.132:6827/3154069775] boot 2020-07-16T13:32:34.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:33 smithi132 bash[23299]: cluster 2020-07-16T13:32:32.911441+0000 mon.a (mon.0) 320 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2020-07-16T13:32:34.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:33 smithi132 bash[23299]: audit 2020-07-16T13:32:32.912153+0000 mon.a (mon.0) 321 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-07-16T13:32:34.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:33 smithi132 bash[27079]: audit 2020-07-16T13:32:32.368485+0000 mgr.y (mgr.14140) 91 : audit [DBG] from='client.34175 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:32:34.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:33 smithi132 bash[27079]: cephadm 2020-07-16T13:32:32.369249+0000 mgr.y (mgr.14140) 92 : cephadm [INF] Applying osd on host smithi188... 2020-07-16T13:32:34.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:33 smithi132 bash[27079]: cluster 2020-07-16T13:32:32.911402+0000 mon.a (mon.0) 319 : cluster [INF] osd.3 [v2:172.21.15.132:6826/3154069775,v1:172.21.15.132:6827/3154069775] boot 2020-07-16T13:32:34.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:33 smithi132 bash[27079]: cluster 2020-07-16T13:32:32.911441+0000 mon.a (mon.0) 320 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2020-07-16T13:32:34.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:33 smithi132 bash[27079]: audit 2020-07-16T13:32:32.912153+0000 mon.a (mon.0) 321 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-07-16T13:32:35.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:34 smithi132 bash[23299]: cluster 2020-07-16T13:32:33.711368+0000 mgr.y (mgr.14140) 93 : cluster [DBG] pgmap v88: 1 pgs: 1 active+clean; 0 B data, 832 KiB used, 354 GiB / 358 GiB avail 2020-07-16T13:32:35.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:34 smithi132 bash[23299]: cluster 2020-07-16T13:32:33.921834+0000 mon.a (mon.0) 322 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2020-07-16T13:32:35.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:34 smithi132 bash[23299]: audit 2020-07-16T13:32:34.552346+0000 mon.b (mon.2) 4 : audit [INF] from='client.? 172.21.15.188:0/1362412076' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "78d29045-b36d-4f75-b245-d0f79869b999"}]: dispatch 2020-07-16T13:32:35.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:34 smithi132 bash[23299]: audit 2020-07-16T13:32:34.552884+0000 mon.a (mon.0) 323 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "78d29045-b36d-4f75-b245-d0f79869b999"}]: dispatch 2020-07-16T13:32:35.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:34 smithi132 bash[23299]: audit 2020-07-16T13:32:34.557201+0000 mon.a (mon.0) 324 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "78d29045-b36d-4f75-b245-d0f79869b999"}]': finished 2020-07-16T13:32:35.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:34 smithi132 bash[23299]: cluster 2020-07-16T13:32:34.557250+0000 mon.a (mon.0) 325 : cluster [DBG] osdmap e28: 5 total, 4 up, 4 in 2020-07-16T13:32:35.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:34 smithi132 bash[23299]: audit 2020-07-16T13:32:34.557393+0000 mon.a (mon.0) 326 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-07-16T13:32:35.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:34 smithi132 bash[27079]: cluster 2020-07-16T13:32:33.711368+0000 mgr.y (mgr.14140) 93 : cluster [DBG] pgmap v88: 1 pgs: 1 active+clean; 0 B data, 832 KiB used, 354 GiB / 358 GiB avail 2020-07-16T13:32:35.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:34 smithi132 bash[27079]: cluster 2020-07-16T13:32:33.921834+0000 mon.a (mon.0) 322 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2020-07-16T13:32:35.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:34 smithi132 bash[27079]: audit 2020-07-16T13:32:34.552346+0000 mon.b (mon.2) 4 : audit [INF] from='client.? 172.21.15.188:0/1362412076' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "78d29045-b36d-4f75-b245-d0f79869b999"}]: dispatch 2020-07-16T13:32:35.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:34 smithi132 bash[27079]: audit 2020-07-16T13:32:34.552884+0000 mon.a (mon.0) 323 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "78d29045-b36d-4f75-b245-d0f79869b999"}]: dispatch 2020-07-16T13:32:35.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:34 smithi132 bash[27079]: audit 2020-07-16T13:32:34.557201+0000 mon.a (mon.0) 324 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "78d29045-b36d-4f75-b245-d0f79869b999"}]': finished 2020-07-16T13:32:35.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:34 smithi132 bash[27079]: cluster 2020-07-16T13:32:34.557250+0000 mon.a (mon.0) 325 : cluster [DBG] osdmap e28: 5 total, 4 up, 4 in 2020-07-16T13:32:35.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:34 smithi132 bash[27079]: audit 2020-07-16T13:32:34.557393+0000 mon.a (mon.0) 326 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-07-16T13:32:35.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:34 smithi188 bash[23329]: cluster 2020-07-16T13:32:33.711368+0000 mgr.y (mgr.14140) 93 : cluster [DBG] pgmap v88: 1 pgs: 1 active+clean; 0 B data, 832 KiB used, 354 GiB / 358 GiB avail 2020-07-16T13:32:35.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:34 smithi188 bash[23329]: cluster 2020-07-16T13:32:33.921834+0000 mon.a (mon.0) 322 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2020-07-16T13:32:35.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:34 smithi188 bash[23329]: audit 2020-07-16T13:32:34.552346+0000 mon.b (mon.2) 4 : audit [INF] from='client.? 172.21.15.188:0/1362412076' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "78d29045-b36d-4f75-b245-d0f79869b999"}]: dispatch 2020-07-16T13:32:35.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:34 smithi188 bash[23329]: audit 2020-07-16T13:32:34.552884+0000 mon.a (mon.0) 323 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "78d29045-b36d-4f75-b245-d0f79869b999"}]: dispatch 2020-07-16T13:32:35.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:34 smithi188 bash[23329]: audit 2020-07-16T13:32:34.557201+0000 mon.a (mon.0) 324 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "78d29045-b36d-4f75-b245-d0f79869b999"}]': finished 2020-07-16T13:32:35.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:34 smithi188 bash[23329]: cluster 2020-07-16T13:32:34.557250+0000 mon.a (mon.0) 325 : cluster [DBG] osdmap e28: 5 total, 4 up, 4 in 2020-07-16T13:32:35.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:34 smithi188 bash[23329]: audit 2020-07-16T13:32:34.557393+0000 mon.a (mon.0) 326 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-07-16T13:32:37.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:36 smithi132 bash[23299]: cluster 2020-07-16T13:32:35.711759+0000 mgr.y (mgr.14140) 94 : cluster [DBG] pgmap v91: 1 pgs: 1 active+clean; 0 B data, 856 KiB used, 354 GiB / 358 GiB avail 2020-07-16T13:32:37.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:36 smithi132 bash[23299]: audit 2020-07-16T13:32:36.223174+0000 mon.b (mon.2) 5 : audit [DBG] from='client.? 172.21.15.188:0/2522261034' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-07-16T13:32:37.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:36 smithi132 bash[27079]: cluster 2020-07-16T13:32:35.711759+0000 mgr.y (mgr.14140) 94 : cluster [DBG] pgmap v91: 1 pgs: 1 active+clean; 0 B data, 856 KiB used, 354 GiB / 358 GiB avail 2020-07-16T13:32:37.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:36 smithi132 bash[27079]: audit 2020-07-16T13:32:36.223174+0000 mon.b (mon.2) 5 : audit [DBG] from='client.? 172.21.15.188:0/2522261034' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-07-16T13:32:37.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:36 smithi188 bash[23329]: cluster 2020-07-16T13:32:35.711759+0000 mgr.y (mgr.14140) 94 : cluster [DBG] pgmap v91: 1 pgs: 1 active+clean; 0 B data, 856 KiB used, 354 GiB / 358 GiB avail 2020-07-16T13:32:37.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:36 smithi188 bash[23329]: audit 2020-07-16T13:32:36.223174+0000 mon.b (mon.2) 5 : audit [DBG] from='client.? 172.21.15.188:0/2522261034' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-07-16T13:32:39.275 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:38 smithi188 bash[23329]: cluster 2020-07-16T13:32:37.712268+0000 mgr.y (mgr.14140) 95 : cluster [DBG] pgmap v92: 1 pgs: 1 active+clean; 0 B data, 896 KiB used, 354 GiB / 358 GiB avail 2020-07-16T13:32:39.276 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:38 smithi188 bash[23329]: audit 2020-07-16T13:32:38.585947+0000 mon.a (mon.0) 327 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:32:39.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:38 smithi132 bash[27079]: cluster 2020-07-16T13:32:37.712268+0000 mgr.y (mgr.14140) 95 : cluster [DBG] pgmap v92: 1 pgs: 1 active+clean; 0 B data, 896 KiB used, 354 GiB / 358 GiB avail 2020-07-16T13:32:39.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:38 smithi132 bash[27079]: audit 2020-07-16T13:32:38.585947+0000 mon.a (mon.0) 327 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:32:39.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:38 smithi132 bash[23299]: cluster 2020-07-16T13:32:37.712268+0000 mgr.y (mgr.14140) 95 : cluster [DBG] pgmap v92: 1 pgs: 1 active+clean; 0 B data, 896 KiB used, 354 GiB / 358 GiB avail 2020-07-16T13:32:39.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:38 smithi132 bash[23299]: audit 2020-07-16T13:32:38.585947+0000 mon.a (mon.0) 327 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:32:40.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:40 smithi188 bash[23329]: cluster 2020-07-16T13:32:39.712756+0000 mgr.y (mgr.14140) 96 : cluster [DBG] pgmap v93: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2020-07-16T13:32:41.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:40 smithi132 bash[23299]: cluster 2020-07-16T13:32:39.712756+0000 mgr.y (mgr.14140) 96 : cluster [DBG] pgmap v93: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2020-07-16T13:32:41.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:40 smithi132 bash[27079]: cluster 2020-07-16T13:32:39.712756+0000 mgr.y (mgr.14140) 96 : cluster [DBG] pgmap v93: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2020-07-16T13:32:41.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:41 smithi188 bash[23329]: audit 2020-07-16T13:32:40.817546+0000 mon.a (mon.0) 328 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2020-07-16T13:32:41.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:41 smithi188 bash[23329]: audit 2020-07-16T13:32:40.818351+0000 mon.a (mon.0) 329 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:32:41.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:41 smithi188 bash[23329]: cephadm 2020-07-16T13:32:40.818897+0000 mgr.y (mgr.14140) 97 : cephadm [INF] Deploying daemon osd.4 on smithi188 2020-07-16T13:32:41.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:41 smithi188 bash[23329]: audit 2020-07-16T13:32:40.819173+0000 mon.a (mon.0) 330 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.4", "key": "container_image"}]: dispatch 2020-07-16T13:32:42.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:41 smithi132 bash[27079]: audit 2020-07-16T13:32:40.817546+0000 mon.a (mon.0) 328 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2020-07-16T13:32:42.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:41 smithi132 bash[27079]: audit 2020-07-16T13:32:40.818351+0000 mon.a (mon.0) 329 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:32:42.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:41 smithi132 bash[27079]: cephadm 2020-07-16T13:32:40.818897+0000 mgr.y (mgr.14140) 97 : cephadm [INF] Deploying daemon osd.4 on smithi188 2020-07-16T13:32:42.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:41 smithi132 bash[27079]: audit 2020-07-16T13:32:40.819173+0000 mon.a (mon.0) 330 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.4", "key": "container_image"}]: dispatch 2020-07-16T13:32:42.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:41 smithi132 bash[23299]: audit 2020-07-16T13:32:40.817546+0000 mon.a (mon.0) 328 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2020-07-16T13:32:42.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:41 smithi132 bash[23299]: audit 2020-07-16T13:32:40.818351+0000 mon.a (mon.0) 329 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:32:42.031 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:41 smithi132 bash[23299]: cephadm 2020-07-16T13:32:40.818897+0000 mgr.y (mgr.14140) 97 : cephadm [INF] Deploying daemon osd.4 on smithi188 2020-07-16T13:32:42.031 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:41 smithi132 bash[23299]: audit 2020-07-16T13:32:40.819173+0000 mon.a (mon.0) 330 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.4", "key": "container_image"}]: dispatch 2020-07-16T13:32:42.264 INFO:teuthology.orchestra.run.smithi188.stdout:Created osd(s) 4 on host 'smithi188' 2020-07-16T13:32:42.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:42 smithi188 bash[23329]: cluster 2020-07-16T13:32:41.713132+0000 mgr.y (mgr.14140) 98 : cluster [DBG] pgmap v94: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2020-07-16T13:32:42.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:42 smithi188 bash[23329]: audit 2020-07-16T13:32:42.256045+0000 mon.a (mon.0) 331 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:24.168707\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:24.168796\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:40.817244\"}}, \"last_device_update\": \"2020-07-16T13:30:51.483581\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:32:42.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:42 smithi188 bash[23329]: audit 2020-07-16T13:32:42.256522+0000 mon.a (mon.0) 332 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:32:42.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:42 smithi188 bash[23329]: audit 2020-07-16T13:32:42.259505+0000 mon.a (mon.0) 333 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:24.168707\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:24.168796\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:40.817244\"}}, \"last_device_update\": \"2020-07-16T13:30:51.483581\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:32:42.946 INFO:teuthology.orchestra.run.smithi188:osd.4> sudo journalctl -f -n 0 -u ceph-4c8ed362-c768-11ea-a06f-001a4aab830c@osd.4.service 2020-07-16T13:32:42.949 INFO:tasks.cephadm:Deploying osd.5 on smithi188 with /dev/vg_nvme/lv_3... 2020-07-16T13:32:42.950 INFO:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4c8ed362-c768-11ea-a06f-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2020-07-16T13:32:42.982 INFO:journalctl@ceph.osd.4.smithi188.stdout:-- Logs begin at Thu 2020-07-16 13:22:28 UTC. -- 2020-07-16T13:32:43.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:42 smithi132 bash[23299]: cluster 2020-07-16T13:32:41.713132+0000 mgr.y (mgr.14140) 98 : cluster [DBG] pgmap v94: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2020-07-16T13:32:43.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:42 smithi132 bash[23299]: audit 2020-07-16T13:32:42.256045+0000 mon.a (mon.0) 331 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:24.168707\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:24.168796\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:40.817244\"}}, \"last_device_update\": \"2020-07-16T13:30:51.483581\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:32:43.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:42 smithi132 bash[23299]: audit 2020-07-16T13:32:42.256522+0000 mon.a (mon.0) 332 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:32:43.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:42 smithi132 bash[23299]: audit 2020-07-16T13:32:42.259505+0000 mon.a (mon.0) 333 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:24.168707\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:24.168796\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:40.817244\"}}, \"last_device_update\": \"2020-07-16T13:30:51.483581\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:32:43.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:42 smithi132 bash[27079]: cluster 2020-07-16T13:32:41.713132+0000 mgr.y (mgr.14140) 98 : cluster [DBG] pgmap v94: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2020-07-16T13:32:43.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:42 smithi132 bash[27079]: audit 2020-07-16T13:32:42.256045+0000 mon.a (mon.0) 331 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:24.168707\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:24.168796\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:40.817244\"}}, \"last_device_update\": \"2020-07-16T13:30:51.483581\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:32:43.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:42 smithi132 bash[27079]: audit 2020-07-16T13:32:42.256522+0000 mon.a (mon.0) 332 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:32:43.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:42 smithi132 bash[27079]: audit 2020-07-16T13:32:42.259505+0000 mon.a (mon.0) 333 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:24.168707\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:31:24.168796\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:40.817244\"}}, \"last_device_update\": \"2020-07-16T13:30:51.483581\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:32:43.385 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:32:43 smithi188 podman[25549]: 2020-07-16 13:32:43.130392013 +0000 UTC m=+0.890429028 container init a1e22da7a3f6483bfe2680507662131d1065e6ed041bc37b1f55a6be59e91fa6 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.4-activate) 2020-07-16T13:32:43.386 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:32:43 smithi188 podman[25549]: 2020-07-16 13:32:43.173636896 +0000 UTC m=+0.933673926 container start a1e22da7a3f6483bfe2680507662131d1065e6ed041bc37b1f55a6be59e91fa6 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.4-activate) 2020-07-16T13:32:43.386 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:32:43 smithi188 podman[25549]: 2020-07-16 13:32:43.173698846 +0000 UTC m=+0.933735905 container attach a1e22da7a3f6483bfe2680507662131d1065e6ed041bc37b1f55a6be59e91fa6 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.4-activate) 2020-07-16T13:32:43.677 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:43 smithi188 bash[23329]: audit 2020-07-16T13:32:43.482864+0000 mon.a (mon.0) 334 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:43.482022\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:43.482130\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:43.482166\", \"created\": \"2020-07-16T13:32:42.226001\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:40.817244\"}}, \"last_daemon_update\": \"2020-07-16T13:32:43.482243\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:32:43.678 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:43 smithi188 bash[23329]: audit 2020-07-16T13:32:43.486594+0000 mon.a (mon.0) 335 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:43.482022\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:43.482130\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:43.482166\", \"created\": \"2020-07-16T13:32:42.226001\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:40.817244\"}}, \"last_daemon_update\": \"2020-07-16T13:32:43.482243\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:32:43.678 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:43 smithi188 bash[23329]: audit 2020-07-16T13:32:43.487309+0000 mon.a (mon.0) 336 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:32:43.678 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:32:43 smithi188 bash[25547]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2020-07-16T13:32:43.678 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:32:43 smithi188 bash[25547]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-4 --no-mon-config 2020-07-16T13:32:43.679 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:32:43 smithi188 bash[25547]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-4/block 2020-07-16T13:32:43.679 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:32:43 smithi188 bash[25547]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-4/block 2020-07-16T13:32:43.679 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:32:43 smithi188 bash[25547]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2020-07-16T13:32:43.679 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:32:43 smithi188 bash[25547]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2020-07-16T13:32:43.680 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:32:43 smithi188 bash[25547]: --> ceph-volume lvm activate successful for osd ID: 4 2020-07-16T13:32:43.680 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:32:43 smithi188 podman[25549]: 2020-07-16 13:32:43.480505788 +0000 UTC m=+1.240542819 container died a1e22da7a3f6483bfe2680507662131d1065e6ed041bc37b1f55a6be59e91fa6 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.4-activate) 2020-07-16T13:32:44.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:43 smithi132 bash[23299]: audit 2020-07-16T13:32:43.482864+0000 mon.a (mon.0) 334 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:43.482022\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:43.482130\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:43.482166\", \"created\": \"2020-07-16T13:32:42.226001\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:40.817244\"}}, \"last_daemon_update\": \"2020-07-16T13:32:43.482243\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:32:44.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:43 smithi132 bash[23299]: audit 2020-07-16T13:32:43.486594+0000 mon.a (mon.0) 335 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:43.482022\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:43.482130\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:43.482166\", \"created\": \"2020-07-16T13:32:42.226001\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:40.817244\"}}, \"last_daemon_update\": \"2020-07-16T13:32:43.482243\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:32:44.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:43 smithi132 bash[23299]: audit 2020-07-16T13:32:43.487309+0000 mon.a (mon.0) 336 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:32:44.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:43 smithi132 bash[27079]: audit 2020-07-16T13:32:43.482864+0000 mon.a (mon.0) 334 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:43.482022\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:43.482130\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:43.482166\", \"created\": \"2020-07-16T13:32:42.226001\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:40.817244\"}}, \"last_daemon_update\": \"2020-07-16T13:32:43.482243\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:32:44.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:43 smithi132 bash[27079]: audit 2020-07-16T13:32:43.486594+0000 mon.a (mon.0) 335 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:43.482022\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:43.482130\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:43.482166\", \"created\": \"2020-07-16T13:32:42.226001\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:40.817244\"}}, \"last_daemon_update\": \"2020-07-16T13:32:43.482243\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:32:44.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:43 smithi132 bash[27079]: audit 2020-07-16T13:32:43.487309+0000 mon.a (mon.0) 336 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:32:44.421 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:32:44 smithi188 podman[25549]: 2020-07-16 13:32:44.123951511 +0000 UTC m=+1.883988550 container remove a1e22da7a3f6483bfe2680507662131d1065e6ed041bc37b1f55a6be59e91fa6 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.4-activate) 2020-07-16T13:32:44.717 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:44 smithi188 bash[23329]: cluster 2020-07-16T13:32:43.713540+0000 mgr.y (mgr.14140) 99 : cluster [DBG] pgmap v95: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2020-07-16T13:32:45.007 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:32:44 smithi188 podman[25881]: 2020-07-16 13:32:44.716125101 +0000 UTC m=+0.578472299 container create 1354c34f860863903e75d162daf1362fd3611bb0d5dafb7afe2a4b1469312ba4 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.4) 2020-07-16T13:32:45.007 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:32:44 smithi188 podman[25881]: 2020-07-16 13:32:44.949386458 +0000 UTC m=+0.811733580 container init 1354c34f860863903e75d162daf1362fd3611bb0d5dafb7afe2a4b1469312ba4 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.4) 2020-07-16T13:32:45.008 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:32:45 smithi188 podman[25881]: 2020-07-16 13:32:45.006480809 +0000 UTC m=+0.868827939 container start 1354c34f860863903e75d162daf1362fd3611bb0d5dafb7afe2a4b1469312ba4 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.4) 2020-07-16T13:32:45.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:44 smithi132 bash[23299]: cluster 2020-07-16T13:32:43.713540+0000 mgr.y (mgr.14140) 99 : cluster [DBG] pgmap v95: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2020-07-16T13:32:45.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:44 smithi132 bash[27079]: cluster 2020-07-16T13:32:43.713540+0000 mgr.y (mgr.14140) 99 : cluster [DBG] pgmap v95: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2020-07-16T13:32:45.266 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:32:45 smithi188 podman[25881]: 2020-07-16 13:32:45.006550298 +0000 UTC m=+0.868897437 container attach 1354c34f860863903e75d162daf1362fd3611bb0d5dafb7afe2a4b1469312ba4 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.4) 2020-07-16T13:32:45.266 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:32:45 smithi188 bash[25547]: debug 2020-07-16T13:32:45.243+0000 7f8d5cfd8ec0 -1 Falling back to public interface 2020-07-16T13:32:45.830 INFO:teuthology.orchestra.run.smithi188.stderr:--> Zapping: /dev/vg_nvme/lv_3 2020-07-16T13:32:45.830 INFO:teuthology.orchestra.run.smithi188.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2020-07-16T13:32:45.831 INFO:teuthology.orchestra.run.smithi188.stderr: stderr: 10+0 records in 2020-07-16T13:32:45.831 INFO:teuthology.orchestra.run.smithi188.stderr:10+0 records out 2020-07-16T13:32:45.831 INFO:teuthology.orchestra.run.smithi188.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0119802 s, 875 MB/s 2020-07-16T13:32:45.831 INFO:teuthology.orchestra.run.smithi188.stderr:--> Zapping successful for: 2020-07-16T13:32:46.171 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:32:45 smithi188 bash[25547]: debug 2020-07-16T13:32:45.803+0000 7f8d5cfd8ec0 -1 osd.4 0 log_to_monitors {default=true} 2020-07-16T13:32:46.276 INFO:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4c8ed362-c768-11ea-a06f-001a4aab830c -- ceph orch daemon add osd smithi188:vg_nvme/lv_3 2020-07-16T13:32:46.853 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:46 smithi188 bash[23329]: cluster 2020-07-16T13:32:45.713912+0000 mgr.y (mgr.14140) 100 : cluster [DBG] pgmap v96: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2020-07-16T13:32:46.854 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:46 smithi188 bash[23329]: audit 2020-07-16T13:32:45.807748+0000 mon.b (mon.2) 6 : audit [INF] from='osd.4 [v2:172.21.15.188:6800/3950304101,v1:172.21.15.188:6801/3950304101]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2020-07-16T13:32:46.854 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:46 smithi188 bash[23329]: audit 2020-07-16T13:32:45.808116+0000 mon.a (mon.0) 337 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2020-07-16T13:32:47.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:46 smithi132 bash[27079]: cluster 2020-07-16T13:32:45.713912+0000 mgr.y (mgr.14140) 100 : cluster [DBG] pgmap v96: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2020-07-16T13:32:47.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:46 smithi132 bash[27079]: audit 2020-07-16T13:32:45.807748+0000 mon.b (mon.2) 6 : audit [INF] from='osd.4 [v2:172.21.15.188:6800/3950304101,v1:172.21.15.188:6801/3950304101]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2020-07-16T13:32:47.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:46 smithi132 bash[27079]: audit 2020-07-16T13:32:45.808116+0000 mon.a (mon.0) 337 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2020-07-16T13:32:47.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:46 smithi132 bash[23299]: cluster 2020-07-16T13:32:45.713912+0000 mgr.y (mgr.14140) 100 : cluster [DBG] pgmap v96: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2020-07-16T13:32:47.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:46 smithi132 bash[23299]: audit 2020-07-16T13:32:45.807748+0000 mon.b (mon.2) 6 : audit [INF] from='osd.4 [v2:172.21.15.188:6800/3950304101,v1:172.21.15.188:6801/3950304101]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2020-07-16T13:32:47.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:46 smithi132 bash[23299]: audit 2020-07-16T13:32:45.808116+0000 mon.a (mon.0) 337 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2020-07-16T13:32:48.138 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:32:47 smithi188 bash[25547]: debug 2020-07-16T13:32:47.790+0000 7f8d45d8d700 -1 osd.4 0 waiting for initial osdmap 2020-07-16T13:32:48.139 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:47 smithi188 bash[23329]: cluster 2020-07-16T13:32:46.769366+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2020-07-16T13:32:48.139 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:47 smithi188 bash[23329]: cluster 2020-07-16T13:32:46.769405+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2020-07-16T13:32:48.139 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:47 smithi188 bash[23329]: audit 2020-07-16T13:32:46.780728+0000 mon.a (mon.0) 338 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2020-07-16T13:32:48.139 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:47 smithi188 bash[23329]: cluster 2020-07-16T13:32:46.780769+0000 mon.a (mon.0) 339 : cluster [DBG] osdmap e29: 5 total, 4 up, 4 in 2020-07-16T13:32:48.139 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:47 smithi188 bash[23329]: audit 2020-07-16T13:32:46.780906+0000 mon.a (mon.0) 340 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-07-16T13:32:48.140 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:47 smithi188 bash[23329]: audit 2020-07-16T13:32:46.781507+0000 mon.b (mon.2) 7 : audit [INF] from='osd.4 [v2:172.21.15.188:6800/3950304101,v1:172.21.15.188:6801/3950304101]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2020-07-16T13:32:48.140 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:47 smithi188 bash[23329]: audit 2020-07-16T13:32:46.781839+0000 mon.a (mon.0) 341 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2020-07-16T13:32:48.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:47 smithi132 bash[23299]: cluster 2020-07-16T13:32:46.769366+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2020-07-16T13:32:48.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:47 smithi132 bash[23299]: cluster 2020-07-16T13:32:46.769405+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2020-07-16T13:32:48.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:47 smithi132 bash[23299]: audit 2020-07-16T13:32:46.780728+0000 mon.a (mon.0) 338 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2020-07-16T13:32:48.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:47 smithi132 bash[23299]: cluster 2020-07-16T13:32:46.780769+0000 mon.a (mon.0) 339 : cluster [DBG] osdmap e29: 5 total, 4 up, 4 in 2020-07-16T13:32:48.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:47 smithi132 bash[23299]: audit 2020-07-16T13:32:46.780906+0000 mon.a (mon.0) 340 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-07-16T13:32:48.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:47 smithi132 bash[23299]: audit 2020-07-16T13:32:46.781507+0000 mon.b (mon.2) 7 : audit [INF] from='osd.4 [v2:172.21.15.188:6800/3950304101,v1:172.21.15.188:6801/3950304101]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2020-07-16T13:32:48.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:47 smithi132 bash[23299]: audit 2020-07-16T13:32:46.781839+0000 mon.a (mon.0) 341 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2020-07-16T13:32:48.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:47 smithi132 bash[27079]: cluster 2020-07-16T13:32:46.769366+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2020-07-16T13:32:48.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:47 smithi132 bash[27079]: cluster 2020-07-16T13:32:46.769405+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2020-07-16T13:32:48.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:47 smithi132 bash[27079]: audit 2020-07-16T13:32:46.780728+0000 mon.a (mon.0) 338 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2020-07-16T13:32:48.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:47 smithi132 bash[27079]: cluster 2020-07-16T13:32:46.780769+0000 mon.a (mon.0) 339 : cluster [DBG] osdmap e29: 5 total, 4 up, 4 in 2020-07-16T13:32:48.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:47 smithi132 bash[27079]: audit 2020-07-16T13:32:46.780906+0000 mon.a (mon.0) 340 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-07-16T13:32:48.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:47 smithi132 bash[27079]: audit 2020-07-16T13:32:46.781507+0000 mon.b (mon.2) 7 : audit [INF] from='osd.4 [v2:172.21.15.188:6800/3950304101,v1:172.21.15.188:6801/3950304101]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2020-07-16T13:32:48.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:47 smithi132 bash[27079]: audit 2020-07-16T13:32:46.781839+0000 mon.a (mon.0) 341 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2020-07-16T13:32:49.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:48 smithi188 bash[23329]: cluster 2020-07-16T13:32:47.714268+0000 mgr.y (mgr.14140) 101 : cluster [DBG] pgmap v98: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2020-07-16T13:32:49.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:48 smithi188 bash[23329]: audit 2020-07-16T13:32:47.781983+0000 mon.a (mon.0) 342 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]': finished 2020-07-16T13:32:49.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:48 smithi188 bash[23329]: cluster 2020-07-16T13:32:47.782035+0000 mon.a (mon.0) 343 : cluster [DBG] osdmap e30: 5 total, 4 up, 4 in 2020-07-16T13:32:49.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:48 smithi188 bash[23329]: audit 2020-07-16T13:32:47.782871+0000 mon.a (mon.0) 344 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-07-16T13:32:49.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:48 smithi188 bash[23329]: audit 2020-07-16T13:32:47.941868+0000 mon.a (mon.0) 345 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:32:49.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:48 smithi188 bash[23329]: audit 2020-07-16T13:32:48.132179+0000 mon.a (mon.0) 346 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:43.482022\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:43.482130\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:43.482166\", \"created\": \"2020-07-16T13:32:42.226001\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:40.817244\"}}, \"last_daemon_update\": \"2020-07-16T13:32:43.482243\", \"last_device_update\": \"2020-07-16T13:32:48.131615\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:32:49.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:48 smithi188 bash[23329]: audit 2020-07-16T13:32:48.135476+0000 mon.a (mon.0) 347 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:43.482022\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:43.482130\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:43.482166\", \"created\": \"2020-07-16T13:32:42.226001\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:40.817244\"}}, \"last_daemon_update\": \"2020-07-16T13:32:43.482243\", \"last_device_update\": \"2020-07-16T13:32:48.131615\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:32:49.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:48 smithi188 bash[23329]: audit 2020-07-16T13:32:48.527787+0000 mon.a (mon.0) 348 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-07-16T13:32:49.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:48 smithi188 bash[23329]: audit 2020-07-16T13:32:48.528554+0000 mon.a (mon.0) 349 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:32:49.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:48 smithi188 bash[23329]: audit 2020-07-16T13:32:48.529660+0000 mon.a (mon.0) 350 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:32:49.286 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:48 smithi132 bash[27079]: cluster 2020-07-16T13:32:47.714268+0000 mgr.y (mgr.14140) 101 : cluster [DBG] pgmap v98: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2020-07-16T13:32:49.286 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:48 smithi132 bash[27079]: audit 2020-07-16T13:32:47.781983+0000 mon.a (mon.0) 342 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]': finished 2020-07-16T13:32:49.286 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:48 smithi132 bash[27079]: cluster 2020-07-16T13:32:47.782035+0000 mon.a (mon.0) 343 : cluster [DBG] osdmap e30: 5 total, 4 up, 4 in 2020-07-16T13:32:49.287 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:48 smithi132 bash[27079]: audit 2020-07-16T13:32:47.782871+0000 mon.a (mon.0) 344 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-07-16T13:32:49.287 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:48 smithi132 bash[27079]: audit 2020-07-16T13:32:47.941868+0000 mon.a (mon.0) 345 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:32:49.287 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:48 smithi132 bash[27079]: audit 2020-07-16T13:32:48.132179+0000 mon.a (mon.0) 346 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:43.482022\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:43.482130\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:43.482166\", \"created\": \"2020-07-16T13:32:42.226001\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:40.817244\"}}, \"last_daemon_update\": \"2020-07-16T13:32:43.482243\", \"last_device_update\": \"2020-07-16T13:32:48.131615\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:32:49.287 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:48 smithi132 bash[27079]: audit 2020-07-16T13:32:48.135476+0000 mon.a (mon.0) 347 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:43.482022\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:43.482130\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:43.482166\", \"created\": \"2020-07-16T13:32:42.226001\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:40.817244\"}}, \"last_daemon_update\": \"2020-07-16T13:32:43.482243\", \"last_device_update\": \"2020-07-16T13:32:48.131615\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:32:49.287 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:48 smithi132 bash[27079]: audit 2020-07-16T13:32:48.527787+0000 mon.a (mon.0) 348 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-07-16T13:32:49.288 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:48 smithi132 bash[27079]: audit 2020-07-16T13:32:48.528554+0000 mon.a (mon.0) 349 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:32:49.288 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:48 smithi132 bash[27079]: audit 2020-07-16T13:32:48.529660+0000 mon.a (mon.0) 350 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:32:49.288 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:48 smithi132 bash[23299]: cluster 2020-07-16T13:32:47.714268+0000 mgr.y (mgr.14140) 101 : cluster [DBG] pgmap v98: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2020-07-16T13:32:49.288 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:48 smithi132 bash[23299]: audit 2020-07-16T13:32:47.781983+0000 mon.a (mon.0) 342 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]': finished 2020-07-16T13:32:49.289 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:48 smithi132 bash[23299]: cluster 2020-07-16T13:32:47.782035+0000 mon.a (mon.0) 343 : cluster [DBG] osdmap e30: 5 total, 4 up, 4 in 2020-07-16T13:32:49.289 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:48 smithi132 bash[23299]: audit 2020-07-16T13:32:47.782871+0000 mon.a (mon.0) 344 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-07-16T13:32:49.289 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:48 smithi132 bash[23299]: audit 2020-07-16T13:32:47.941868+0000 mon.a (mon.0) 345 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:32:49.289 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:48 smithi132 bash[23299]: audit 2020-07-16T13:32:48.132179+0000 mon.a (mon.0) 346 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:43.482022\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:43.482130\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:43.482166\", \"created\": \"2020-07-16T13:32:42.226001\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:40.817244\"}}, \"last_daemon_update\": \"2020-07-16T13:32:43.482243\", \"last_device_update\": \"2020-07-16T13:32:48.131615\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:32:49.289 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:48 smithi132 bash[23299]: audit 2020-07-16T13:32:48.135476+0000 mon.a (mon.0) 347 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:43.482022\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:43.482130\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:43.482166\", \"created\": \"2020-07-16T13:32:42.226001\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:40.817244\"}}, \"last_daemon_update\": \"2020-07-16T13:32:43.482243\", \"last_device_update\": \"2020-07-16T13:32:48.131615\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:32:49.290 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:48 smithi132 bash[23299]: audit 2020-07-16T13:32:48.527787+0000 mon.a (mon.0) 348 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-07-16T13:32:49.290 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:48 smithi132 bash[23299]: audit 2020-07-16T13:32:48.528554+0000 mon.a (mon.0) 349 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:32:49.290 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:48 smithi132 bash[23299]: audit 2020-07-16T13:32:48.529660+0000 mon.a (mon.0) 350 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:32:50.023 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:49 smithi188 bash[23329]: audit 2020-07-16T13:32:48.526732+0000 mgr.y (mgr.14140) 102 : audit [DBG] from='client.34202 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:32:50.024 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:49 smithi188 bash[23329]: cephadm 2020-07-16T13:32:48.527471+0000 mgr.y (mgr.14140) 103 : cephadm [INF] Applying osd on host smithi188... 2020-07-16T13:32:50.024 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:49 smithi188 bash[23329]: cluster 2020-07-16T13:32:48.789409+0000 mon.a (mon.0) 351 : cluster [INF] osd.4 [v2:172.21.15.188:6800/3950304101,v1:172.21.15.188:6801/3950304101] boot 2020-07-16T13:32:50.024 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:49 smithi188 bash[23329]: cluster 2020-07-16T13:32:48.789486+0000 mon.a (mon.0) 352 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2020-07-16T13:32:50.025 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:49 smithi188 bash[23329]: audit 2020-07-16T13:32:48.789631+0000 mon.a (mon.0) 353 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-07-16T13:32:50.025 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:49 smithi188 bash[23329]: cluster 2020-07-16T13:32:49.789743+0000 mon.a (mon.0) 354 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2020-07-16T13:32:50.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:49 smithi132 bash[27079]: audit 2020-07-16T13:32:48.526732+0000 mgr.y (mgr.14140) 102 : audit [DBG] from='client.34202 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:32:50.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:49 smithi132 bash[27079]: cephadm 2020-07-16T13:32:48.527471+0000 mgr.y (mgr.14140) 103 : cephadm [INF] Applying osd on host smithi188... 2020-07-16T13:32:50.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:49 smithi132 bash[27079]: cluster 2020-07-16T13:32:48.789409+0000 mon.a (mon.0) 351 : cluster [INF] osd.4 [v2:172.21.15.188:6800/3950304101,v1:172.21.15.188:6801/3950304101] boot 2020-07-16T13:32:50.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:49 smithi132 bash[27079]: cluster 2020-07-16T13:32:48.789486+0000 mon.a (mon.0) 352 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2020-07-16T13:32:50.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:49 smithi132 bash[27079]: audit 2020-07-16T13:32:48.789631+0000 mon.a (mon.0) 353 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-07-16T13:32:50.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:49 smithi132 bash[27079]: cluster 2020-07-16T13:32:49.789743+0000 mon.a (mon.0) 354 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2020-07-16T13:32:50.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:49 smithi132 bash[23299]: audit 2020-07-16T13:32:48.526732+0000 mgr.y (mgr.14140) 102 : audit [DBG] from='client.34202 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:32:50.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:49 smithi132 bash[23299]: cephadm 2020-07-16T13:32:48.527471+0000 mgr.y (mgr.14140) 103 : cephadm [INF] Applying osd on host smithi188... 2020-07-16T13:32:50.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:49 smithi132 bash[23299]: cluster 2020-07-16T13:32:48.789409+0000 mon.a (mon.0) 351 : cluster [INF] osd.4 [v2:172.21.15.188:6800/3950304101,v1:172.21.15.188:6801/3950304101] boot 2020-07-16T13:32:50.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:49 smithi132 bash[23299]: cluster 2020-07-16T13:32:48.789486+0000 mon.a (mon.0) 352 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2020-07-16T13:32:50.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:49 smithi132 bash[23299]: audit 2020-07-16T13:32:48.789631+0000 mon.a (mon.0) 353 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-07-16T13:32:50.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:49 smithi132 bash[23299]: cluster 2020-07-16T13:32:49.789743+0000 mon.a (mon.0) 354 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2020-07-16T13:32:51.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:50 smithi188 bash[23329]: cluster 2020-07-16T13:32:49.714835+0000 mgr.y (mgr.14140) 104 : cluster [DBG] pgmap v101: 1 pgs: 1 active+clean; 0 B data, 1.2 MiB used, 442 GiB / 447 GiB avail 2020-07-16T13:32:51.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:50 smithi188 bash[23329]: audit 2020-07-16T13:32:50.628318+0000 mon.b (mon.2) 8 : audit [INF] from='client.? 172.21.15.188:0/1630435119' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "04a15200-6710-4b02-9351-c321c8619514"}]: dispatch 2020-07-16T13:32:51.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:50 smithi188 bash[23329]: audit 2020-07-16T13:32:50.628823+0000 mon.a (mon.0) 355 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "04a15200-6710-4b02-9351-c321c8619514"}]: dispatch 2020-07-16T13:32:51.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:50 smithi188 bash[23329]: audit 2020-07-16T13:32:50.633134+0000 mon.a (mon.0) 356 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "04a15200-6710-4b02-9351-c321c8619514"}]': finished 2020-07-16T13:32:51.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:50 smithi188 bash[23329]: cluster 2020-07-16T13:32:50.633179+0000 mon.a (mon.0) 357 : cluster [DBG] osdmap e33: 6 total, 5 up, 5 in 2020-07-16T13:32:51.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:50 smithi188 bash[23329]: audit 2020-07-16T13:32:50.633330+0000 mon.a (mon.0) 358 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-07-16T13:32:51.284 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:50 smithi132 bash[27079]: cluster 2020-07-16T13:32:49.714835+0000 mgr.y (mgr.14140) 104 : cluster [DBG] pgmap v101: 1 pgs: 1 active+clean; 0 B data, 1.2 MiB used, 442 GiB / 447 GiB avail 2020-07-16T13:32:51.284 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:50 smithi132 bash[27079]: audit 2020-07-16T13:32:50.628318+0000 mon.b (mon.2) 8 : audit [INF] from='client.? 172.21.15.188:0/1630435119' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "04a15200-6710-4b02-9351-c321c8619514"}]: dispatch 2020-07-16T13:32:51.284 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:50 smithi132 bash[27079]: audit 2020-07-16T13:32:50.628823+0000 mon.a (mon.0) 355 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "04a15200-6710-4b02-9351-c321c8619514"}]: dispatch 2020-07-16T13:32:51.284 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:50 smithi132 bash[27079]: audit 2020-07-16T13:32:50.633134+0000 mon.a (mon.0) 356 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "04a15200-6710-4b02-9351-c321c8619514"}]': finished 2020-07-16T13:32:51.285 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:50 smithi132 bash[27079]: cluster 2020-07-16T13:32:50.633179+0000 mon.a (mon.0) 357 : cluster [DBG] osdmap e33: 6 total, 5 up, 5 in 2020-07-16T13:32:51.285 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:50 smithi132 bash[27079]: audit 2020-07-16T13:32:50.633330+0000 mon.a (mon.0) 358 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-07-16T13:32:51.285 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:50 smithi132 bash[23299]: cluster 2020-07-16T13:32:49.714835+0000 mgr.y (mgr.14140) 104 : cluster [DBG] pgmap v101: 1 pgs: 1 active+clean; 0 B data, 1.2 MiB used, 442 GiB / 447 GiB avail 2020-07-16T13:32:51.285 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:50 smithi132 bash[23299]: audit 2020-07-16T13:32:50.628318+0000 mon.b (mon.2) 8 : audit [INF] from='client.? 172.21.15.188:0/1630435119' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "04a15200-6710-4b02-9351-c321c8619514"}]: dispatch 2020-07-16T13:32:51.285 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:50 smithi132 bash[23299]: audit 2020-07-16T13:32:50.628823+0000 mon.a (mon.0) 355 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "04a15200-6710-4b02-9351-c321c8619514"}]: dispatch 2020-07-16T13:32:51.286 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:50 smithi132 bash[23299]: audit 2020-07-16T13:32:50.633134+0000 mon.a (mon.0) 356 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "04a15200-6710-4b02-9351-c321c8619514"}]': finished 2020-07-16T13:32:51.286 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:50 smithi132 bash[23299]: cluster 2020-07-16T13:32:50.633179+0000 mon.a (mon.0) 357 : cluster [DBG] osdmap e33: 6 total, 5 up, 5 in 2020-07-16T13:32:51.286 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:50 smithi132 bash[23299]: audit 2020-07-16T13:32:50.633330+0000 mon.a (mon.0) 358 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-07-16T13:32:53.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:52 smithi188 bash[23329]: cluster 2020-07-16T13:32:51.715227+0000 mgr.y (mgr.14140) 105 : cluster [DBG] pgmap v104: 1 pgs: 1 active+clean; 0 B data, 1.2 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2020-07-16T13:32:53.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:52 smithi188 bash[23329]: audit 2020-07-16T13:32:52.368504+0000 mon.b (mon.2) 9 : audit [DBG] from='client.? 172.21.15.188:0/1046355240' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-07-16T13:32:53.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:52 smithi132 bash[23299]: cluster 2020-07-16T13:32:51.715227+0000 mgr.y (mgr.14140) 105 : cluster [DBG] pgmap v104: 1 pgs: 1 active+clean; 0 B data, 1.2 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2020-07-16T13:32:53.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:52 smithi132 bash[23299]: audit 2020-07-16T13:32:52.368504+0000 mon.b (mon.2) 9 : audit [DBG] from='client.? 172.21.15.188:0/1046355240' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-07-16T13:32:53.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:52 smithi132 bash[27079]: cluster 2020-07-16T13:32:51.715227+0000 mgr.y (mgr.14140) 105 : cluster [DBG] pgmap v104: 1 pgs: 1 active+clean; 0 B data, 1.2 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2020-07-16T13:32:53.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:52 smithi132 bash[27079]: audit 2020-07-16T13:32:52.368504+0000 mon.b (mon.2) 9 : audit [DBG] from='client.? 172.21.15.188:0/1046355240' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-07-16T13:32:55.155 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:54 smithi188 bash[23329]: cluster 2020-07-16T13:32:53.715598+0000 mgr.y (mgr.14140) 106 : cluster [DBG] pgmap v105: 1 pgs: 1 active+clean; 0 B data, 1.3 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2020-07-16T13:32:55.156 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:54 smithi188 bash[23329]: audit 2020-07-16T13:32:54.730270+0000 mon.a (mon.0) 359 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:32:55.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:54 smithi132 bash[23299]: cluster 2020-07-16T13:32:53.715598+0000 mgr.y (mgr.14140) 106 : cluster [DBG] pgmap v105: 1 pgs: 1 active+clean; 0 B data, 1.3 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2020-07-16T13:32:55.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:54 smithi132 bash[23299]: audit 2020-07-16T13:32:54.730270+0000 mon.a (mon.0) 359 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:32:55.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:54 smithi132 bash[27079]: cluster 2020-07-16T13:32:53.715598+0000 mgr.y (mgr.14140) 106 : cluster [DBG] pgmap v105: 1 pgs: 1 active+clean; 0 B data, 1.3 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2020-07-16T13:32:55.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:54 smithi132 bash[27079]: audit 2020-07-16T13:32:54.730270+0000 mon.a (mon.0) 359 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:32:57.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:56 smithi188 bash[23329]: cluster 2020-07-16T13:32:55.716046+0000 mgr.y (mgr.14140) 107 : cluster [DBG] pgmap v106: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2020-07-16T13:32:57.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:56 smithi132 bash[23299]: cluster 2020-07-16T13:32:55.716046+0000 mgr.y (mgr.14140) 107 : cluster [DBG] pgmap v106: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2020-07-16T13:32:57.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:56 smithi132 bash[27079]: cluster 2020-07-16T13:32:55.716046+0000 mgr.y (mgr.14140) 107 : cluster [DBG] pgmap v106: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2020-07-16T13:32:58.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:57 smithi188 bash[23329]: audit 2020-07-16T13:32:57.062851+0000 mon.a (mon.0) 360 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2020-07-16T13:32:58.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:57 smithi188 bash[23329]: audit 2020-07-16T13:32:57.063667+0000 mon.a (mon.0) 361 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:32:58.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:57 smithi188 bash[23329]: audit 2020-07-16T13:32:57.064490+0000 mon.a (mon.0) 362 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.4", "key": "container_image"}]: dispatch 2020-07-16T13:32:58.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:57 smithi132 bash[23299]: audit 2020-07-16T13:32:57.062851+0000 mon.a (mon.0) 360 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2020-07-16T13:32:58.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:57 smithi132 bash[23299]: audit 2020-07-16T13:32:57.063667+0000 mon.a (mon.0) 361 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:32:58.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:57 smithi132 bash[23299]: audit 2020-07-16T13:32:57.064490+0000 mon.a (mon.0) 362 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.4", "key": "container_image"}]: dispatch 2020-07-16T13:32:58.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:57 smithi132 bash[27079]: audit 2020-07-16T13:32:57.062851+0000 mon.a (mon.0) 360 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2020-07-16T13:32:58.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:57 smithi132 bash[27079]: audit 2020-07-16T13:32:57.063667+0000 mon.a (mon.0) 361 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:32:58.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:57 smithi132 bash[27079]: audit 2020-07-16T13:32:57.064490+0000 mon.a (mon.0) 362 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.4", "key": "container_image"}]: dispatch 2020-07-16T13:32:58.617 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:32:58 smithi188 systemd[1]: Stopping Ceph osd.4 for 4c8ed362-c768-11ea-a06f-001a4aab830c... 2020-07-16T13:32:58.617 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:32:58 smithi188 bash[25547]: debug 2020-07-16T13:32:58.377+0000 7f8d54820700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2020-07-16T13:32:58.618 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:32:58 smithi188 bash[25547]: debug 2020-07-16T13:32:58.377+0000 7f8d54820700 -1 osd.4 33 *** Got signal Terminated *** 2020-07-16T13:32:58.618 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:32:58 smithi188 bash[25547]: debug 2020-07-16T13:32:58.377+0000 7f8d54820700 -1 osd.4 33 *** Immediate shutdown (osd_fast_shutdown=true) *** 2020-07-16T13:32:58.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:58 smithi188 bash[23329]: cephadm 2020-07-16T13:32:57.064220+0000 mgr.y (mgr.14140) 108 : cephadm [INF] Deploying daemon osd.4 on smithi188 2020-07-16T13:32:58.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:58 smithi188 bash[23329]: cluster 2020-07-16T13:32:57.716479+0000 mgr.y (mgr.14140) 109 : cluster [DBG] pgmap v107: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2020-07-16T13:32:58.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:58 smithi188 bash[23329]: cluster 2020-07-16T13:32:58.416821+0000 mon.a (mon.0) 363 : cluster [DBG] osd.4 reported immediately failed by osd.3 2020-07-16T13:32:58.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:58 smithi188 bash[23329]: cluster 2020-07-16T13:32:58.417017+0000 mon.a (mon.0) 364 : cluster [INF] osd.4 failed (root=default,host=smithi188) (connection refused reported by osd.3) 2020-07-16T13:32:58.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:58 smithi188 bash[23329]: cluster 2020-07-16T13:32:58.417204+0000 mon.a (mon.0) 365 : cluster [DBG] osd.4 reported immediately failed by osd.2 2020-07-16T13:32:58.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:58 smithi188 bash[23329]: cluster 2020-07-16T13:32:58.417302+0000 mon.a (mon.0) 366 : cluster [DBG] osd.4 reported immediately failed by osd.3 2020-07-16T13:32:58.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:58 smithi188 bash[23329]: cluster 2020-07-16T13:32:58.417456+0000 mon.a (mon.0) 367 : cluster [DBG] osd.4 reported immediately failed by osd.0 2020-07-16T13:32:58.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:58 smithi188 bash[23329]: cluster 2020-07-16T13:32:58.417526+0000 mon.a (mon.0) 368 : cluster [DBG] osd.4 reported immediately failed by osd.1 2020-07-16T13:32:58.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:58 smithi188 bash[23329]: cluster 2020-07-16T13:32:58.417692+0000 mon.a (mon.0) 369 : cluster [DBG] osd.4 reported immediately failed by osd.2 2020-07-16T13:32:58.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:58 smithi188 bash[23329]: cluster 2020-07-16T13:32:58.417834+0000 mon.a (mon.0) 370 : cluster [DBG] osd.4 reported immediately failed by osd.0 2020-07-16T13:32:58.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:58 smithi188 bash[23329]: cluster 2020-07-16T13:32:58.417963+0000 mon.a (mon.0) 371 : cluster [DBG] osd.4 reported immediately failed by osd.1 2020-07-16T13:32:58.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:58 smithi188 bash[23329]: cluster 2020-07-16T13:32:58.418111+0000 mon.a (mon.0) 372 : cluster [DBG] osd.4 reported immediately failed by osd.0 2020-07-16T13:32:58.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:58 smithi188 bash[23329]: cluster 2020-07-16T13:32:58.617673+0000 mon.a (mon.0) 373 : cluster [DBG] osd.4 reported immediately failed by osd.2 2020-07-16T13:32:58.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:58 smithi188 bash[23329]: cluster 2020-07-16T13:32:58.617863+0000 mon.a (mon.0) 374 : cluster [DBG] osd.4 reported immediately failed by osd.1 2020-07-16T13:32:58.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:58 smithi188 bash[23329]: cluster 2020-07-16T13:32:58.617921+0000 mon.a (mon.0) 375 : cluster [DBG] osd.4 reported immediately failed by osd.2 2020-07-16T13:32:58.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:58 smithi188 bash[23329]: cluster 2020-07-16T13:32:58.618088+0000 mon.a (mon.0) 376 : cluster [DBG] osd.4 reported immediately failed by osd.3 2020-07-16T13:32:58.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:58 smithi188 bash[23329]: cluster 2020-07-16T13:32:58.618236+0000 mon.a (mon.0) 377 : cluster [DBG] osd.4 reported immediately failed by osd.0 2020-07-16T13:32:58.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:58 smithi188 bash[23329]: cluster 2020-07-16T13:32:58.618342+0000 mon.a (mon.0) 378 : cluster [DBG] osd.4 reported immediately failed by osd.1 2020-07-16T13:32:58.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:58 smithi188 bash[23329]: cluster 2020-07-16T13:32:58.618448+0000 mon.a (mon.0) 379 : cluster [DBG] osd.4 reported immediately failed by osd.3 2020-07-16T13:32:58.925 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:58 smithi188 bash[23329]: cluster 2020-07-16T13:32:58.618578+0000 mon.a (mon.0) 380 : cluster [DBG] osd.4 reported immediately failed by osd.0 2020-07-16T13:32:58.925 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:58 smithi188 bash[23329]: cluster 2020-07-16T13:32:58.618706+0000 mon.a (mon.0) 381 : cluster [DBG] osd.4 reported immediately failed by osd.0 2020-07-16T13:32:58.925 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:32:58 smithi188 podman[27072]: 2020-07-16 13:32:58.615433217 +0000 UTC m=+0.269473872 container died 1354c34f860863903e75d162daf1362fd3611bb0d5dafb7afe2a4b1469312ba4 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.4) 2020-07-16T13:32:58.925 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:32:58 smithi188 podman[27072]: 2020-07-16 13:32:58.645088414 +0000 UTC m=+0.299128993 container stop 1354c34f860863903e75d162daf1362fd3611bb0d5dafb7afe2a4b1469312ba4 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.4) 2020-07-16T13:32:58.925 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:32:58 smithi188 podman[27072]: 1354c34f860863903e75d162daf1362fd3611bb0d5dafb7afe2a4b1469312ba4 2020-07-16T13:32:59.271 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:32:59 smithi188 podman[27111]: 2020-07-16 13:32:59.186668642 +0000 UTC m=+0.523853965 container create 47f1154a50b05129fa3bae076358e8f4b8347e80497003e2467d1a0c2b57ce3f (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.4-deactivate) 2020-07-16T13:32:59.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:58 smithi132 bash[23299]: cephadm 2020-07-16T13:32:57.064220+0000 mgr.y (mgr.14140) 108 : cephadm [INF] Deploying daemon osd.4 on smithi188 2020-07-16T13:32:59.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:58 smithi132 bash[23299]: cluster 2020-07-16T13:32:57.716479+0000 mgr.y (mgr.14140) 109 : cluster [DBG] pgmap v107: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2020-07-16T13:32:59.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:58 smithi132 bash[23299]: cluster 2020-07-16T13:32:58.416821+0000 mon.a (mon.0) 363 : cluster [DBG] osd.4 reported immediately failed by osd.3 2020-07-16T13:32:59.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:58 smithi132 bash[23299]: cluster 2020-07-16T13:32:58.417017+0000 mon.a (mon.0) 364 : cluster [INF] osd.4 failed (root=default,host=smithi188) (connection refused reported by osd.3) 2020-07-16T13:32:59.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:58 smithi132 bash[23299]: cluster 2020-07-16T13:32:58.417204+0000 mon.a (mon.0) 365 : cluster [DBG] osd.4 reported immediately failed by osd.2 2020-07-16T13:32:59.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:58 smithi132 bash[23299]: cluster 2020-07-16T13:32:58.417302+0000 mon.a (mon.0) 366 : cluster [DBG] osd.4 reported immediately failed by osd.3 2020-07-16T13:32:59.282 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:58 smithi132 bash[23299]: cluster 2020-07-16T13:32:58.417456+0000 mon.a (mon.0) 367 : cluster [DBG] osd.4 reported immediately failed by osd.0 2020-07-16T13:32:59.282 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:58 smithi132 bash[23299]: cluster 2020-07-16T13:32:58.417526+0000 mon.a (mon.0) 368 : cluster [DBG] osd.4 reported immediately failed by osd.1 2020-07-16T13:32:59.282 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:58 smithi132 bash[23299]: cluster 2020-07-16T13:32:58.417692+0000 mon.a (mon.0) 369 : cluster [DBG] osd.4 reported immediately failed by osd.2 2020-07-16T13:32:59.283 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:58 smithi132 bash[23299]: cluster 2020-07-16T13:32:58.417834+0000 mon.a (mon.0) 370 : cluster [DBG] osd.4 reported immediately failed by osd.0 2020-07-16T13:32:59.283 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:58 smithi132 bash[23299]: cluster 2020-07-16T13:32:58.417963+0000 mon.a (mon.0) 371 : cluster [DBG] osd.4 reported immediately failed by osd.1 2020-07-16T13:32:59.283 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:58 smithi132 bash[23299]: cluster 2020-07-16T13:32:58.418111+0000 mon.a (mon.0) 372 : cluster [DBG] osd.4 reported immediately failed by osd.0 2020-07-16T13:32:59.284 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:58 smithi132 bash[23299]: cluster 2020-07-16T13:32:58.617673+0000 mon.a (mon.0) 373 : cluster [DBG] osd.4 reported immediately failed by osd.2 2020-07-16T13:32:59.284 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:58 smithi132 bash[23299]: cluster 2020-07-16T13:32:58.617863+0000 mon.a (mon.0) 374 : cluster [DBG] osd.4 reported immediately failed by osd.1 2020-07-16T13:32:59.284 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:58 smithi132 bash[23299]: cluster 2020-07-16T13:32:58.617921+0000 mon.a (mon.0) 375 : cluster [DBG] osd.4 reported immediately failed by osd.2 2020-07-16T13:32:59.284 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:58 smithi132 bash[23299]: cluster 2020-07-16T13:32:58.618088+0000 mon.a (mon.0) 376 : cluster [DBG] osd.4 reported immediately failed by osd.3 2020-07-16T13:32:59.285 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:58 smithi132 bash[23299]: cluster 2020-07-16T13:32:58.618236+0000 mon.a (mon.0) 377 : cluster [DBG] osd.4 reported immediately failed by osd.0 2020-07-16T13:32:59.285 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:58 smithi132 bash[23299]: cluster 2020-07-16T13:32:58.618342+0000 mon.a (mon.0) 378 : cluster [DBG] osd.4 reported immediately failed by osd.1 2020-07-16T13:32:59.285 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:58 smithi132 bash[23299]: cluster 2020-07-16T13:32:58.618448+0000 mon.a (mon.0) 379 : cluster [DBG] osd.4 reported immediately failed by osd.3 2020-07-16T13:32:59.286 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:58 smithi132 bash[23299]: cluster 2020-07-16T13:32:58.618578+0000 mon.a (mon.0) 380 : cluster [DBG] osd.4 reported immediately failed by osd.0 2020-07-16T13:32:59.286 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:58 smithi132 bash[23299]: cluster 2020-07-16T13:32:58.618706+0000 mon.a (mon.0) 381 : cluster [DBG] osd.4 reported immediately failed by osd.0 2020-07-16T13:32:59.286 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:58 smithi132 bash[27079]: cephadm 2020-07-16T13:32:57.064220+0000 mgr.y (mgr.14140) 108 : cephadm [INF] Deploying daemon osd.4 on smithi188 2020-07-16T13:32:59.286 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:58 smithi132 bash[27079]: cluster 2020-07-16T13:32:57.716479+0000 mgr.y (mgr.14140) 109 : cluster [DBG] pgmap v107: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2020-07-16T13:32:59.287 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:58 smithi132 bash[27079]: cluster 2020-07-16T13:32:58.416821+0000 mon.a (mon.0) 363 : cluster [DBG] osd.4 reported immediately failed by osd.3 2020-07-16T13:32:59.287 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:58 smithi132 bash[27079]: cluster 2020-07-16T13:32:58.417017+0000 mon.a (mon.0) 364 : cluster [INF] osd.4 failed (root=default,host=smithi188) (connection refused reported by osd.3) 2020-07-16T13:32:59.287 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:58 smithi132 bash[27079]: cluster 2020-07-16T13:32:58.417204+0000 mon.a (mon.0) 365 : cluster [DBG] osd.4 reported immediately failed by osd.2 2020-07-16T13:32:59.287 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:58 smithi132 bash[27079]: cluster 2020-07-16T13:32:58.417302+0000 mon.a (mon.0) 366 : cluster [DBG] osd.4 reported immediately failed by osd.3 2020-07-16T13:32:59.288 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:58 smithi132 bash[27079]: cluster 2020-07-16T13:32:58.417456+0000 mon.a (mon.0) 367 : cluster [DBG] osd.4 reported immediately failed by osd.0 2020-07-16T13:32:59.288 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:58 smithi132 bash[27079]: cluster 2020-07-16T13:32:58.417526+0000 mon.a (mon.0) 368 : cluster [DBG] osd.4 reported immediately failed by osd.1 2020-07-16T13:32:59.288 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:58 smithi132 bash[27079]: cluster 2020-07-16T13:32:58.417692+0000 mon.a (mon.0) 369 : cluster [DBG] osd.4 reported immediately failed by osd.2 2020-07-16T13:32:59.288 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:58 smithi132 bash[27079]: cluster 2020-07-16T13:32:58.417834+0000 mon.a (mon.0) 370 : cluster [DBG] osd.4 reported immediately failed by osd.0 2020-07-16T13:32:59.289 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:58 smithi132 bash[27079]: cluster 2020-07-16T13:32:58.417963+0000 mon.a (mon.0) 371 : cluster [DBG] osd.4 reported immediately failed by osd.1 2020-07-16T13:32:59.289 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:58 smithi132 bash[27079]: cluster 2020-07-16T13:32:58.418111+0000 mon.a (mon.0) 372 : cluster [DBG] osd.4 reported immediately failed by osd.0 2020-07-16T13:32:59.299 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:58 smithi132 bash[27079]: cluster 2020-07-16T13:32:58.617673+0000 mon.a (mon.0) 373 : cluster [DBG] osd.4 reported immediately failed by osd.2 2020-07-16T13:32:59.299 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:58 smithi132 bash[27079]: cluster 2020-07-16T13:32:58.617863+0000 mon.a (mon.0) 374 : cluster [DBG] osd.4 reported immediately failed by osd.1 2020-07-16T13:32:59.299 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:58 smithi132 bash[27079]: cluster 2020-07-16T13:32:58.617921+0000 mon.a (mon.0) 375 : cluster [DBG] osd.4 reported immediately failed by osd.2 2020-07-16T13:32:59.299 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:58 smithi132 bash[27079]: cluster 2020-07-16T13:32:58.618088+0000 mon.a (mon.0) 376 : cluster [DBG] osd.4 reported immediately failed by osd.3 2020-07-16T13:32:59.300 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:58 smithi132 bash[27079]: cluster 2020-07-16T13:32:58.618236+0000 mon.a (mon.0) 377 : cluster [DBG] osd.4 reported immediately failed by osd.0 2020-07-16T13:32:59.300 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:58 smithi132 bash[27079]: cluster 2020-07-16T13:32:58.618342+0000 mon.a (mon.0) 378 : cluster [DBG] osd.4 reported immediately failed by osd.1 2020-07-16T13:32:59.300 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:58 smithi132 bash[27079]: cluster 2020-07-16T13:32:58.618448+0000 mon.a (mon.0) 379 : cluster [DBG] osd.4 reported immediately failed by osd.3 2020-07-16T13:32:59.300 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:58 smithi132 bash[27079]: cluster 2020-07-16T13:32:58.618578+0000 mon.a (mon.0) 380 : cluster [DBG] osd.4 reported immediately failed by osd.0 2020-07-16T13:32:59.300 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:58 smithi132 bash[27079]: cluster 2020-07-16T13:32:58.618706+0000 mon.a (mon.0) 381 : cluster [DBG] osd.4 reported immediately failed by osd.0 2020-07-16T13:32:59.597 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:32:59 smithi188 podman[27111]: 2020-07-16 13:32:59.330865501 +0000 UTC m=+0.668050814 container init 47f1154a50b05129fa3bae076358e8f4b8347e80497003e2467d1a0c2b57ce3f (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.4-deactivate) 2020-07-16T13:32:59.598 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:32:59 smithi188 podman[27111]: 2020-07-16 13:32:59.369902931 +0000 UTC m=+0.707088249 container start 47f1154a50b05129fa3bae076358e8f4b8347e80497003e2467d1a0c2b57ce3f (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.4-deactivate) 2020-07-16T13:32:59.598 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:32:59 smithi188 podman[27111]: 2020-07-16 13:32:59.369978254 +0000 UTC m=+0.707163593 container attach 47f1154a50b05129fa3bae076358e8f4b8347e80497003e2467d1a0c2b57ce3f (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.4-deactivate) 2020-07-16T13:32:59.598 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:32:59 smithi188 podman[27111]: 2020-07-16 13:32:59.596470845 +0000 UTC m=+0.933656154 container died 47f1154a50b05129fa3bae076358e8f4b8347e80497003e2467d1a0c2b57ce3f (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.4-deactivate) 2020-07-16T13:32:59.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:59 smithi188 bash[23329]: cluster 2020-07-16T13:32:58.817462+0000 mon.a (mon.0) 382 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2020-07-16T13:32:59.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:59 smithi188 bash[23329]: cluster 2020-07-16T13:32:58.817513+0000 mon.a (mon.0) 383 : cluster [WRN] Health check failed: 1 host (1 osds) down (OSD_HOST_DOWN) 2020-07-16T13:32:59.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:59 smithi188 bash[23329]: cluster 2020-07-16T13:32:58.822896+0000 mon.a (mon.0) 384 : cluster [DBG] osdmap e34: 6 total, 4 up, 5 in 2020-07-16T13:32:59.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:59 smithi188 bash[23329]: audit 2020-07-16T13:32:58.823465+0000 mon.a (mon.0) 385 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-07-16T13:32:59.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:59 smithi188 bash[23329]: cluster 2020-07-16T13:32:59.823176+0000 mon.a (mon.0) 386 : cluster [DBG] osdmap e35: 6 total, 4 up, 5 in 2020-07-16T13:32:59.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:32:59 smithi188 bash[23329]: audit 2020-07-16T13:32:59.823382+0000 mon.a (mon.0) 387 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-07-16T13:33:00.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:59 smithi132 bash[23299]: cluster 2020-07-16T13:32:58.817462+0000 mon.a (mon.0) 382 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2020-07-16T13:33:00.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:59 smithi132 bash[23299]: cluster 2020-07-16T13:32:58.817513+0000 mon.a (mon.0) 383 : cluster [WRN] Health check failed: 1 host (1 osds) down (OSD_HOST_DOWN) 2020-07-16T13:33:00.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:59 smithi132 bash[23299]: cluster 2020-07-16T13:32:58.822896+0000 mon.a (mon.0) 384 : cluster [DBG] osdmap e34: 6 total, 4 up, 5 in 2020-07-16T13:33:00.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:59 smithi132 bash[23299]: audit 2020-07-16T13:32:58.823465+0000 mon.a (mon.0) 385 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-07-16T13:33:00.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:59 smithi132 bash[23299]: cluster 2020-07-16T13:32:59.823176+0000 mon.a (mon.0) 386 : cluster [DBG] osdmap e35: 6 total, 4 up, 5 in 2020-07-16T13:33:00.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:32:59 smithi132 bash[23299]: audit 2020-07-16T13:32:59.823382+0000 mon.a (mon.0) 387 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-07-16T13:33:00.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:59 smithi132 bash[27079]: cluster 2020-07-16T13:32:58.817462+0000 mon.a (mon.0) 382 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2020-07-16T13:33:00.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:59 smithi132 bash[27079]: cluster 2020-07-16T13:32:58.817513+0000 mon.a (mon.0) 383 : cluster [WRN] Health check failed: 1 host (1 osds) down (OSD_HOST_DOWN) 2020-07-16T13:33:00.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:59 smithi132 bash[27079]: cluster 2020-07-16T13:32:58.822896+0000 mon.a (mon.0) 384 : cluster [DBG] osdmap e34: 6 total, 4 up, 5 in 2020-07-16T13:33:00.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:59 smithi132 bash[27079]: audit 2020-07-16T13:32:58.823465+0000 mon.a (mon.0) 385 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-07-16T13:33:00.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:59 smithi132 bash[27079]: cluster 2020-07-16T13:32:59.823176+0000 mon.a (mon.0) 386 : cluster [DBG] osdmap e35: 6 total, 4 up, 5 in 2020-07-16T13:33:00.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:32:59 smithi132 bash[27079]: audit 2020-07-16T13:32:59.823382+0000 mon.a (mon.0) 387 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-07-16T13:33:00.420 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:00 smithi188 podman[27111]: 2020-07-16 13:33:00.071398356 +0000 UTC m=+1.408583675 container remove 47f1154a50b05129fa3bae076358e8f4b8347e80497003e2467d1a0c2b57ce3f (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.4-deactivate) 2020-07-16T13:33:00.421 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:00 smithi188 systemd[1]: Stopped Ceph osd.4 for 4c8ed362-c768-11ea-a06f-001a4aab830c. 2020-07-16T13:33:00.421 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:00 smithi188 systemd[1]: Starting Ceph osd.4 for 4c8ed362-c768-11ea-a06f-001a4aab830c... 2020-07-16T13:33:00.421 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:00 smithi188 podman[27215]: Error: no container with name or ID ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.4 found: no such container 2020-07-16T13:33:00.422 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:00 smithi188 systemd[1]: Started Ceph osd.4 for 4c8ed362-c768-11ea-a06f-001a4aab830c. 2020-07-16T13:33:00.825 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:00 smithi188 podman[27230]: 2020-07-16 13:33:00.469566033 +0000 UTC m=+0.240030661 container create 9699f0aa62c892ce2670a70282f6a8a49d7dccd737ddaa99a0ceabc12a1d43d5 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.4-activate) 2020-07-16T13:33:00.826 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:00 smithi188 podman[27230]: 2020-07-16 13:33:00.620848692 +0000 UTC m=+0.391313389 container init 9699f0aa62c892ce2670a70282f6a8a49d7dccd737ddaa99a0ceabc12a1d43d5 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.4-activate) 2020-07-16T13:33:00.826 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:00 smithi188 podman[27230]: 2020-07-16 13:33:00.666658472 +0000 UTC m=+0.437123090 container start 9699f0aa62c892ce2670a70282f6a8a49d7dccd737ddaa99a0ceabc12a1d43d5 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.4-activate) 2020-07-16T13:33:00.827 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:00 smithi188 podman[27230]: 2020-07-16 13:33:00.666725748 +0000 UTC m=+0.437190386 container attach 9699f0aa62c892ce2670a70282f6a8a49d7dccd737ddaa99a0ceabc12a1d43d5 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.4-activate) 2020-07-16T13:33:01.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:00 smithi188 bash[23329]: cluster 2020-07-16T13:32:59.716835+0000 mgr.y (mgr.14140) 110 : cluster [DBG] pgmap v109: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2020-07-16T13:33:01.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:00 smithi188 bash[23329]: audit 2020-07-16T13:33:00.244961+0000 mon.a (mon.0) 388 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:43.482022\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:43.482130\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}}, \"last_device_update\": \"2020-07-16T13:32:48.131615\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:33:01.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:00 smithi188 bash[23329]: audit 2020-07-16T13:33:00.245434+0000 mon.a (mon.0) 389 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:33:01.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:00 smithi188 bash[23329]: audit 2020-07-16T13:33:00.248664+0000 mon.a (mon.0) 390 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:43.482022\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:43.482130\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}}, \"last_device_update\": \"2020-07-16T13:32:48.131615\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:33:01.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:00 smithi188 bash[23329]: audit 2020-07-16T13:33:00.249591+0000 mon.a (mon.0) 391 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2020-07-16T13:33:01.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:00 smithi188 bash[23329]: audit 2020-07-16T13:33:00.250836+0000 mon.a (mon.0) 392 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:33:01.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:00 smithi188 bash[23329]: audit 2020-07-16T13:33:00.251725+0000 mon.a (mon.0) 393 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.5", "key": "container_image"}]: dispatch 2020-07-16T13:33:01.173 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:00 smithi188 bash[27228]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2020-07-16T13:33:01.173 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:00 smithi188 bash[27228]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-4 --no-mon-config 2020-07-16T13:33:01.173 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:00 smithi188 bash[27228]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-4/block 2020-07-16T13:33:01.173 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:00 smithi188 bash[27228]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-4/block 2020-07-16T13:33:01.173 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:00 smithi188 bash[27228]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2020-07-16T13:33:01.174 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:00 smithi188 bash[27228]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2020-07-16T13:33:01.174 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:00 smithi188 bash[27228]: --> ceph-volume lvm activate successful for osd ID: 4 2020-07-16T13:33:01.174 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:01 smithi188 podman[27230]: 2020-07-16 13:33:01.004536587 +0000 UTC m=+0.775001213 container died 9699f0aa62c892ce2670a70282f6a8a49d7dccd737ddaa99a0ceabc12a1d43d5 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.4-activate) 2020-07-16T13:33:01.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:00 smithi132 bash[23299]: cluster 2020-07-16T13:32:59.716835+0000 mgr.y (mgr.14140) 110 : cluster [DBG] pgmap v109: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2020-07-16T13:33:01.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:00 smithi132 bash[23299]: audit 2020-07-16T13:33:00.244961+0000 mon.a (mon.0) 388 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:43.482022\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:43.482130\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}}, \"last_device_update\": \"2020-07-16T13:32:48.131615\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:33:01.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:00 smithi132 bash[23299]: audit 2020-07-16T13:33:00.245434+0000 mon.a (mon.0) 389 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:33:01.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:00 smithi132 bash[23299]: audit 2020-07-16T13:33:00.248664+0000 mon.a (mon.0) 390 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:43.482022\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:43.482130\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}}, \"last_device_update\": \"2020-07-16T13:32:48.131615\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:33:01.282 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:00 smithi132 bash[23299]: audit 2020-07-16T13:33:00.249591+0000 mon.a (mon.0) 391 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2020-07-16T13:33:01.282 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:00 smithi132 bash[23299]: audit 2020-07-16T13:33:00.250836+0000 mon.a (mon.0) 392 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:33:01.282 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:00 smithi132 bash[23299]: audit 2020-07-16T13:33:00.251725+0000 mon.a (mon.0) 393 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.5", "key": "container_image"}]: dispatch 2020-07-16T13:33:01.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:00 smithi132 bash[27079]: cluster 2020-07-16T13:32:59.716835+0000 mgr.y (mgr.14140) 110 : cluster [DBG] pgmap v109: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2020-07-16T13:33:01.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:00 smithi132 bash[27079]: audit 2020-07-16T13:33:00.244961+0000 mon.a (mon.0) 388 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:43.482022\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:43.482130\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}}, \"last_device_update\": \"2020-07-16T13:32:48.131615\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:33:01.284 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:00 smithi132 bash[27079]: audit 2020-07-16T13:33:00.245434+0000 mon.a (mon.0) 389 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:33:01.284 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:00 smithi132 bash[27079]: audit 2020-07-16T13:33:00.248664+0000 mon.a (mon.0) 390 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:43.482022\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:43.482130\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}}, \"last_device_update\": \"2020-07-16T13:32:48.131615\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:33:01.284 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:00 smithi132 bash[27079]: audit 2020-07-16T13:33:00.249591+0000 mon.a (mon.0) 391 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2020-07-16T13:33:01.285 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:00 smithi132 bash[27079]: audit 2020-07-16T13:33:00.250836+0000 mon.a (mon.0) 392 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:33:01.285 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:00 smithi132 bash[27079]: audit 2020-07-16T13:33:00.251725+0000 mon.a (mon.0) 393 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.5", "key": "container_image"}]: dispatch 2020-07-16T13:33:01.990 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:01 smithi188 bash[23329]: cephadm 2020-07-16T13:33:00.251442+0000 mgr.y (mgr.14140) 111 : cephadm [INF] Deploying daemon osd.5 on smithi188 2020-07-16T13:33:02.251 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:02 smithi188 podman[27505]: 2020-07-16 13:33:02.202511319 +0000 UTC m=+0.344761194 container create 58eb7519ce634ae6eb6d2bb18f8c4052b2fc28dec0965a46fea32802efad80a9 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.4) 2020-07-16T13:33:02.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:01 smithi132 bash[27079]: cephadm 2020-07-16T13:33:00.251442+0000 mgr.y (mgr.14140) 111 : cephadm [INF] Deploying daemon osd.5 on smithi188 2020-07-16T13:33:02.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:01 smithi132 bash[23299]: cephadm 2020-07-16T13:33:00.251442+0000 mgr.y (mgr.14140) 111 : cephadm [INF] Deploying daemon osd.5 on smithi188 2020-07-16T13:33:02.303 INFO:teuthology.orchestra.run.smithi188.stdout:Created osd(s) 4,5 on host 'smithi188' 2020-07-16T13:33:02.671 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:02 smithi188 podman[27505]: 2020-07-16 13:33:02.335828679 +0000 UTC m=+0.478078553 container init 58eb7519ce634ae6eb6d2bb18f8c4052b2fc28dec0965a46fea32802efad80a9 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.4) 2020-07-16T13:33:02.671 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:02 smithi188 podman[27505]: 2020-07-16 13:33:02.394189911 +0000 UTC m=+0.536439780 container start 58eb7519ce634ae6eb6d2bb18f8c4052b2fc28dec0965a46fea32802efad80a9 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.4) 2020-07-16T13:33:02.671 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:02 smithi188 podman[27505]: 2020-07-16 13:33:02.394327832 +0000 UTC m=+0.536577722 container attach 58eb7519ce634ae6eb6d2bb18f8c4052b2fc28dec0965a46fea32802efad80a9 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.4) 2020-07-16T13:33:02.672 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:02 smithi188 bash[27228]: debug 2020-07-16T13:33:02.366+0000 7f2e7bbfe700 10 -- 172.21.15.188:0/3758435408 dispatch_throttle_release 383 to dispatch throttler 383/104857600 2020-07-16T13:33:02.672 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:02 smithi188 bash[27228]: debug 2020-07-16T13:33:02.366+0000 7f2e7bbfe700 20 -- 172.21.15.188:0/3758435408 done calling dispatch on 0x557ff17be420 2020-07-16T13:33:02.672 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:02 smithi188 bash[27228]: debug 2020-07-16T13:33:02.366+0000 7f2e7c3ff700 20 -- 172.21.15.188:0/3758435408 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557ff1833000 msgr2=0x557ff182fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).process 2020-07-16T13:33:02.672 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:02 smithi188 bash[27228]: debug 2020-07-16T13:33:02.366+0000 7f2e82bb3ec0 1 -- 172.21.15.188:0/3758435408 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557ff1833000 msgr2=0x557ff182fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T13:33:02.673 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:02 smithi188 bash[27228]: debug 2020-07-16T13:33:02.366+0000 7f2e7c3ff700 20 -- 172.21.15.188:0/3758435408 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557ff1833000 msgr2=0x557ff182fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read continue len=32 2020-07-16T13:33:02.673 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:02 smithi188 bash[27228]: debug 2020-07-16T13:33:02.366+0000 7f2e7c3ff700 20 --2- 172.21.15.188:0/3758435408 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557ff1833000 0x557ff182fb00 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x557ff17c5d10 tx=0x557ff249eaa0).handle_read_frame_preamble_main r=0 2020-07-16T13:33:02.673 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:02 smithi188 bash[27228]: debug 2020-07-16T13:33:02.366+0000 7f2e7c3ff700 10 --2- 172.21.15.188:0/3758435408 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557ff1833000 0x557ff182fb00 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x557ff17c5d10 tx=0x557ff249eaa0).handle_read_frame_preamble_main got encrypted preamble. after decrypt premable.length()=32 2020-07-16T13:33:02.673 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:02 smithi188 bash[27228]: debug 2020-07-16T13:33:02.366+0000 7f2e7c3ff700 10 --2- 172.21.15.188:0/3758435408 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557ff1833000 0x557ff182fb00 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x557ff17c5d10 tx=0x557ff249eaa0).handle_read_frame_preamble_main got new segment: len=41 align=8 2020-07-16T13:33:02.673 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:02 smithi188 bash[27228]: debug 2020-07-16T13:33:02.366+0000 7f2e7c3ff700 10 --2- 172.21.15.188:0/3758435408 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557ff1833000 0x557ff182fb00 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x557ff17c5d10 tx=0x557ff249eaa0).handle_read_frame_preamble_main got new segment: len=194 align=8 2020-07-16T13:33:02.674 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:02 smithi188 bash[27228]: debug 2020-07-16T13:33:02.366+0000 7f2e7c3ff700 20 --2- 172.21.15.188:0/3758435408 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557ff1833000 0x557ff182fb00 secure :-1 s=THROTTLE_MESSAGE pgs=25 cs=0 l=1 rx=0x557ff17c5d10 tx=0x557ff249eaa0).throttle_message 2020-07-16T13:33:02.674 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:02 smithi188 bash[27228]: debug 2020-07-16T13:33:02.366+0000 7f2e7c3ff700 20 --2- 172.21.15.188:0/3758435408 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557ff1833000 0x557ff182fb00 secure :-1 s=THROTTLE_BYTES pgs=25 cs=0 l=1 rx=0x557ff17c5d10 tx=0x557ff249eaa0).throttle_bytes 2020-07-16T13:33:02.674 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:02 smithi188 bash[27228]: debug 2020-07-16T13:33:02.366+0000 7f2e7c3ff700 20 --2- 172.21.15.188:0/3758435408 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557ff1833000 0x557ff182fb00 secure :-1 s=THROTTLE_DISPATCH_QUEUE pgs=25 cs=0 l=1 rx=0x557ff17c5d10 tx=0x557ff249eaa0).throttle_dispatch_queue 2020-07-16T13:33:02.674 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:02 smithi188 bash[27228]: debug 2020-07-16T13:33:02.366+0000 7f2e7c3ff700 20 --2- 172.21.15.188:0/3758435408 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557ff1833000 0x557ff182fb00 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x557ff17c5d10 tx=0x557ff249eaa0).read_frame_segment 2020-07-16T13:33:02.674 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:02 smithi188 bash[27228]: debug 2020-07-16T13:33:02.366+0000 7f2e7c3ff700 20 -- 172.21.15.188:0/3758435408 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557ff1833000 msgr2=0x557ff182fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=48 2020-07-16T13:33:02.675 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:02 smithi188 bash[27228]: debug 2020-07-16T13:33:02.366+0000 7f2e7c3ff700 20 --2- 172.21.15.188:0/3758435408 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557ff1833000 0x557ff182fb00 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x557ff17c5d10 tx=0x557ff249eaa0).handle_read_frame_segment r=0 2020-07-16T13:33:02.675 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:02 smithi188 bash[27228]: debug 2020-07-16T13:33:02.366+0000 7f2e7c3ff700 20 --2- 172.21.15.188:0/3758435408 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557ff1833000 0x557ff182fb00 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x557ff17c5d10 tx=0x557ff249eaa0).handle_read_frame_segment unpadded new_seg.length()=41 2020-07-16T13:33:02.675 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:02 smithi188 bash[27228]: debug 2020-07-16T13:33:02.366+0000 7f2e7c3ff700 20 --2- 172.21.15.188:0/3758435408 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557ff1833000 0x557ff182fb00 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x557ff17c5d10 tx=0x557ff249eaa0).read_frame_segment 2020-07-16T13:33:02.675 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:02 smithi188 bash[27228]: debug 2020-07-16T13:33:02.366+0000 7f2e7c3ff700 20 -- 172.21.15.188:0/3758435408 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557ff1833000 msgr2=0x557ff182fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=208 2020-07-16T13:33:02.675 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:02 smithi188 bash[27228]: debug 2020-07-16T13:33:02.366+0000 7f2e7c3ff700 20 --2- 172.21.15.188:0/3758435408 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557ff1833000 0x557ff182fb00 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x557ff17c5d10 tx=0x557ff249eaa0).handle_read_frame_segment r=0 2020-07-16T13:33:02.676 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:02 smithi188 bash[27228]: debug 2020-07-16T13:33:02.366+0000 7f2e7c3ff700 20 --2- 172.21.15.188:0/3758435408 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557ff1833000 0x557ff182fb00 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x557ff17c5d10 tx=0x557ff249eaa0).handle_read_frame_segment unpadded new_seg.length()=194 2020-07-16T13:33:02.676 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:02 smithi188 bash[27228]: debug 2020-07-16T13:33:02.366+0000 7f2e7c3ff700 20 -- 172.21.15.188:0/3758435408 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557ff1833000 msgr2=0x557ff182fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=32 2020-07-16T13:33:02.676 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:02 smithi188 bash[27228]: debug 2020-07-16T13:33:02.366+0000 7f2e7c3ff700 20 --2- 172.21.15.188:0/3758435408 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557ff1833000 0x557ff182fb00 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x557ff17c5d10 tx=0x557ff249eaa0).handle_read_frame_epilogue_main r=0 2020-07-16T13:33:02.676 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:02 smithi188 bash[27228]: debug 2020-07-16T13:33:02.366+0000 7f2e7c3ff700 1 --2- 172.21.15.188:0/3758435408 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557ff1833000 0x557ff182fb00 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x557ff17c5d10 tx=0x557ff249eaa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-07-16T13:33:02.676 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:02 smithi188 bash[27228]: debug 2020-07-16T13:33:02.366+0000 7f2e7c3ff700 10 --2- 172.21.15.188:0/3758435408 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557ff1833000 0x557ff182fb00 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x557ff17c5d10 tx=0x557ff249eaa0).handle_read_frame_dispatch tag=17 2020-07-16T13:33:02.677 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:02 smithi188 bash[27228]: debug 2020-07-16T13:33:02.366+0000 7f2e7c3ff700 20 --2- 172.21.15.188:0/3758435408 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557ff1833000 0x557ff182fb00 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x557ff17c5d10 tx=0x557ff249eaa0).handle_message 2020-07-16T13:33:02.677 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:02 smithi188 bash[27228]: debug 2020-07-16T13:33:02.366+0000 7f2e7c3ff700 5 --2- 172.21.15.188:0/3758435408 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557ff1833000 0x557ff182fb00 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x557ff17c5d10 tx=0x557ff249eaa0).handle_message got 194 + 0 + 0 byte message. envelope type=18 src mon.2 off 0 2020-07-16T13:33:02.677 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:02 smithi188 bash[27228]: debug 2020-07-16T13:33:02.366+0000 7f2e7c3ff700 5 --2- 172.21.15.188:0/3758435408 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557ff1833000 0x557ff182fb00 secure :-1 s=READ_MESSAGE_COMPLETE pgs=25 cs=0 l=1 rx=0x557ff17c5d10 tx=0x557ff249eaa0).handle_message received message m=0x557ff17ca4e0 seq=4 from=mon.2 type=18 auth_reply(proto 2 0 (0) Success) v1 2020-07-16T13:33:02.677 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:02 smithi188 bash[27228]: debug 2020-07-16T13:33:02.366+0000 7f2e7c3ff700 20 -- 172.21.15.188:0/3758435408 queue 0x557ff17ca4e0 prio 196 2020-07-16T13:33:02.677 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:02 smithi188 bash[27228]: debug 2020-07-16T13:33:02.366+0000 7f2e7c3ff700 20 --2- 172.21.15.188:0/3758435408 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557ff1833000 0x557ff182fb00 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x557ff17c5d10 tx=0x557ff249eaa0).read_frame 2020-07-16T13:33:02.678 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:02 smithi188 bash[27228]: debug 2020-07-16T13:33:02.366+0000 7f2e7c3ff700 20 -- 172.21.15.188:0/3758435408 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557ff1833000 msgr2=0x557ff182fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=32 2020-07-16T13:33:02.678 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:02 smithi188 bash[27228]: debug 2020-07-16T13:33:02.366+0000 7f2e7bbfe700 1 -- 172.21.15.188:0/3758435408 <== mon.2 v2:172.21.15.188:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x557ff17ca4e0 con 0x557ff1833000 2020-07-16T13:33:02.678 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:02 smithi188 bash[27228]: debug 2020-07-16T13:33:02.366+0000 7f2e82bb3ec0 1 --2- 172.21.15.188:0/3758435408 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557ff1833000 0x557ff182fb00 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x557ff17c5d10 tx=0x557ff249eaa0).stop 2020-07-16T13:33:02.678 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:02 smithi188 bash[27228]: debug 2020-07-16T13:33:02.366+0000 7f2e82bb3ec0 5 --2- 172.21.15.188:0/3758435408 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557ff1833000 0x557ff182fb00 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x557ff17c5d10 tx=0x557ff249eaa0).reset_recv_state 2020-07-16T13:33:02.679 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:02 smithi188 bash[27228]: debug 2020-07-16T13:33:02.366+0000 7f2e82bb3ec0 20 Event(0x557ff17d7280 nevent=5000 time_id=3).wakeup 2020-07-16T13:33:02.679 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:02 smithi188 bash[27228]: debug 2020-07-16T13:33:02.366+0000 7f2e82bb3ec0 10 --2- 172.21.15.188:0/3758435408 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557ff1833000 0x557ff182fb00 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x557ff17c5d10 tx=0x557ff249eaa0).discard_out_queue started 2020-07-16T13:33:02.679 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:02 smithi188 bash[27228]: debug 2020-07-16T13:33:02.366+0000 7f2e82bb3ec0 20 Event(0x557ff17d7280 nevent=5000 time_id=3).wakeup 2020-07-16T13:33:02.679 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:02 smithi188 bash[27228]: debug 2020-07-16T13:33:02.366+0000 7f2e7c3ff700 5 --2- 172.21.15.188:0/3758435408 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557ff1833000 0x557ff182fb00 secure :-1 s=CLOSED pgs=25 cs=0 l=1 rx=0x557ff17c5d10 tx=0x557ff249eaa0).reset_recv_state (warped) reseting crypto handlers 2020-07-16T13:33:02.679 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:02 smithi188 bash[27228]: debug 2020-07-16T13:33:02.366+0000 7f2e7c3ff700 5 --2- 172.21.15.188:0/3758435408 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557ff1833000 0x557ff182fb00 secure :-1 s=CLOSED pgs=25 cs=0 l=1 rx=0x557ff17c5d10 tx=0x557ff249eaa0).reset_security 2020-07-16T13:33:02.680 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:02 smithi188 bash[27228]: debug 2020-07-16T13:33:02.366+0000 7f2e7bbfe700 10 -- 172.21.15.188:0/3758435408 dispatch_throttle_release 194 to dispatch throttler 194/104857600 2020-07-16T13:33:02.680 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:02 smithi188 bash[27228]: debug 2020-07-16T13:33:02.366+0000 7f2e7bbfe700 20 -- 172.21.15.188:0/3758435408 done calling dispatch on 0x557ff17ca4e0 2020-07-16T13:33:02.680 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:02 smithi188 bash[27228]: debug 2020-07-16T13:33:02.366+0000 7f2e7c3ff700 20 EpollDriver.del_event del event fd=16 cur_mask=1 delmask=3 to 11 2020-07-16T13:33:03.123 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:02 smithi188 bash[27228]: debug 2020-07-16T13:33:02.883+0000 7f2e82bb3ec0 -1 Falling back to public interface 2020-07-16T13:33:03.123 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:02 smithi188 bash[23329]: cluster 2020-07-16T13:33:01.717259+0000 mgr.y (mgr.14140) 112 : cluster [DBG] pgmap v111: 1 pgs: 1 active+undersized+degraded; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail; 1/3 objects degraded (33.333%) 2020-07-16T13:33:03.124 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:02 smithi188 bash[23329]: cluster 2020-07-16T13:33:01.828114+0000 mon.a (mon.0) 394 : cluster [WRN] Health check failed: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2020-07-16T13:33:03.124 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:02 smithi188 bash[23329]: audit 2020-07-16T13:33:01.864524+0000 mon.a (mon.0) 395 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:01.863703\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:01.863797\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:01.863832\", \"created\": \"2020-07-16T13:32:42.226001\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}}, \"last_daemon_update\": \"2020-07-16T13:33:01.863905\", \"last_device_update\": \"2020-07-16T13:32:48.131615\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:33:03.125 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:02 smithi188 bash[23329]: audit 2020-07-16T13:33:01.869678+0000 mon.a (mon.0) 396 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:01.863703\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:01.863797\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:01.863832\", \"created\": \"2020-07-16T13:32:42.226001\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}}, \"last_daemon_update\": \"2020-07-16T13:33:01.863905\", \"last_device_update\": \"2020-07-16T13:32:48.131615\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:33:03.125 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:02 smithi188 bash[23329]: audit 2020-07-16T13:33:02.293900+0000 mon.a (mon.0) 397 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:01.863703\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:01.863797\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:01.863832\", \"created\": \"2020-07-16T13:32:42.226001\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}}, \"last_device_update\": \"2020-07-16T13:32:48.131615\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:33:03.125 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:02 smithi188 bash[23329]: audit 2020-07-16T13:33:02.294370+0000 mon.a (mon.0) 398 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:33:03.128 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:02 smithi188 bash[23329]: audit 2020-07-16T13:33:02.299689+0000 mon.a (mon.0) 399 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:01.863703\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:01.863797\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:01.863832\", \"created\": \"2020-07-16T13:32:42.226001\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}}, \"last_device_update\": \"2020-07-16T13:32:48.131615\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:33:03.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:02 smithi132 bash[23299]: cluster 2020-07-16T13:33:01.717259+0000 mgr.y (mgr.14140) 112 : cluster [DBG] pgmap v111: 1 pgs: 1 active+undersized+degraded; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail; 1/3 objects degraded (33.333%) 2020-07-16T13:33:03.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:02 smithi132 bash[23299]: cluster 2020-07-16T13:33:01.828114+0000 mon.a (mon.0) 394 : cluster [WRN] Health check failed: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2020-07-16T13:33:03.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:02 smithi132 bash[23299]: audit 2020-07-16T13:33:01.864524+0000 mon.a (mon.0) 395 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:01.863703\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:01.863797\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:01.863832\", \"created\": \"2020-07-16T13:32:42.226001\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}}, \"last_daemon_update\": \"2020-07-16T13:33:01.863905\", \"last_device_update\": \"2020-07-16T13:32:48.131615\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:33:03.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:02 smithi132 bash[23299]: audit 2020-07-16T13:33:01.869678+0000 mon.a (mon.0) 396 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:01.863703\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:01.863797\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:01.863832\", \"created\": \"2020-07-16T13:32:42.226001\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}}, \"last_daemon_update\": \"2020-07-16T13:33:01.863905\", \"last_device_update\": \"2020-07-16T13:32:48.131615\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:33:03.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:02 smithi132 bash[23299]: audit 2020-07-16T13:33:02.293900+0000 mon.a (mon.0) 397 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:01.863703\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:01.863797\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:01.863832\", \"created\": \"2020-07-16T13:32:42.226001\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}}, \"last_device_update\": \"2020-07-16T13:32:48.131615\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:33:03.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:02 smithi132 bash[23299]: audit 2020-07-16T13:33:02.294370+0000 mon.a (mon.0) 398 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:33:03.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:02 smithi132 bash[23299]: audit 2020-07-16T13:33:02.299689+0000 mon.a (mon.0) 399 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:01.863703\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:01.863797\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:01.863832\", \"created\": \"2020-07-16T13:32:42.226001\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}}, \"last_device_update\": \"2020-07-16T13:32:48.131615\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:33:03.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:02 smithi132 bash[27079]: cluster 2020-07-16T13:33:01.717259+0000 mgr.y (mgr.14140) 112 : cluster [DBG] pgmap v111: 1 pgs: 1 active+undersized+degraded; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail; 1/3 objects degraded (33.333%) 2020-07-16T13:33:03.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:02 smithi132 bash[27079]: cluster 2020-07-16T13:33:01.828114+0000 mon.a (mon.0) 394 : cluster [WRN] Health check failed: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2020-07-16T13:33:03.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:02 smithi132 bash[27079]: audit 2020-07-16T13:33:01.864524+0000 mon.a (mon.0) 395 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:01.863703\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:01.863797\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:01.863832\", \"created\": \"2020-07-16T13:32:42.226001\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}}, \"last_daemon_update\": \"2020-07-16T13:33:01.863905\", \"last_device_update\": \"2020-07-16T13:32:48.131615\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:33:03.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:02 smithi132 bash[27079]: audit 2020-07-16T13:33:01.869678+0000 mon.a (mon.0) 396 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:01.863703\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:01.863797\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:01.863832\", \"created\": \"2020-07-16T13:32:42.226001\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}}, \"last_daemon_update\": \"2020-07-16T13:33:01.863905\", \"last_device_update\": \"2020-07-16T13:32:48.131615\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:33:03.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:02 smithi132 bash[27079]: audit 2020-07-16T13:33:02.293900+0000 mon.a (mon.0) 397 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:01.863703\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:01.863797\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:01.863832\", \"created\": \"2020-07-16T13:32:42.226001\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}}, \"last_device_update\": \"2020-07-16T13:32:48.131615\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:33:03.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:02 smithi132 bash[27079]: audit 2020-07-16T13:33:02.294370+0000 mon.a (mon.0) 398 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:33:03.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:02 smithi132 bash[27079]: audit 2020-07-16T13:33:02.299689+0000 mon.a (mon.0) 399 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:01.863703\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:01.863797\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:01.863832\", \"created\": \"2020-07-16T13:32:42.226001\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}}, \"last_device_update\": \"2020-07-16T13:32:48.131615\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:33:03.286 INFO:teuthology.orchestra.run.smithi188:osd.5> sudo journalctl -f -n 0 -u ceph-4c8ed362-c768-11ea-a06f-001a4aab830c@osd.5.service 2020-07-16T13:33:03.289 INFO:tasks.cephadm:Deploying osd.6 on smithi188 with /dev/vg_nvme/lv_2... 2020-07-16T13:33:03.290 INFO:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4c8ed362-c768-11ea-a06f-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2020-07-16T13:33:03.321 INFO:journalctl@ceph.osd.5.smithi188.stdout:-- Logs begin at Thu 2020-07-16 13:22:28 UTC. -- 2020-07-16T13:33:03.420 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 16 13:33:03 smithi188 podman[27608]: 2020-07-16 13:33:03.327270958 +0000 UTC m=+1.049394424 container start 1e4f4ad930d13720536f8c95dc418a4124777481337cb61318a240b2461b7a9a (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.5-activate) 2020-07-16T13:33:03.421 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 16 13:33:03 smithi188 podman[27608]: 2020-07-16 13:33:03.327394218 +0000 UTC m=+1.049517697 container attach 1e4f4ad930d13720536f8c95dc418a4124777481337cb61318a240b2461b7a9a (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.5-activate) 2020-07-16T13:33:03.852 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 16 13:33:03 smithi188 bash[27598]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2020-07-16T13:33:03.852 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 16 13:33:03 smithi188 bash[27598]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-5 --no-mon-config 2020-07-16T13:33:03.852 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 16 13:33:03 smithi188 bash[27598]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5/block 2020-07-16T13:33:03.853 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 16 13:33:03 smithi188 bash[27598]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-5/block 2020-07-16T13:33:03.853 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 16 13:33:03 smithi188 bash[27598]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2020-07-16T13:33:03.853 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 16 13:33:03 smithi188 bash[27598]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2020-07-16T13:33:03.854 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 16 13:33:03 smithi188 bash[27598]: --> ceph-volume lvm activate successful for osd ID: 5 2020-07-16T13:33:03.854 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 16 13:33:03 smithi188 podman[27608]: 2020-07-16 13:33:03.577557384 +0000 UTC m=+1.299680851 container died 1e4f4ad930d13720536f8c95dc418a4124777481337cb61318a240b2461b7a9a (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.5-activate) 2020-07-16T13:33:03.855 INFO:journalctl@ceph.osd.4.smithi188.stdout:Jul 16 13:33:03 smithi188 bash[27228]: debug 2020-07-16T13:33:03.445+0000 7f2e82bb3ec0 -1 osd.4 33 log_to_monitors {default=true} 2020-07-16T13:33:04.113 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:03 smithi188 bash[23329]: audit 2020-07-16T13:33:03.452000+0000 mon.b (mon.2) 10 : audit [INF] from='osd.4 [v2:172.21.15.188:6800/213465511,v1:172.21.15.188:6801/213465511]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2020-07-16T13:33:04.114 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:03 smithi188 bash[23329]: audit 2020-07-16T13:33:03.453285+0000 mon.a (mon.0) 400 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2020-07-16T13:33:04.114 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:03 smithi188 bash[23329]: audit 2020-07-16T13:33:03.454002+0000 mon.b (mon.2) 11 : audit [INF] from='osd.4 [v2:172.21.15.188:6800/213465511,v1:172.21.15.188:6801/213465511]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2020-07-16T13:33:04.114 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:03 smithi188 bash[23329]: audit 2020-07-16T13:33:03.454315+0000 mon.a (mon.0) 401 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2020-07-16T13:33:04.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:03 smithi132 bash[23299]: audit 2020-07-16T13:33:03.452000+0000 mon.b (mon.2) 10 : audit [INF] from='osd.4 [v2:172.21.15.188:6800/213465511,v1:172.21.15.188:6801/213465511]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2020-07-16T13:33:04.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:03 smithi132 bash[23299]: audit 2020-07-16T13:33:03.453285+0000 mon.a (mon.0) 400 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2020-07-16T13:33:04.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:03 smithi132 bash[23299]: audit 2020-07-16T13:33:03.454002+0000 mon.b (mon.2) 11 : audit [INF] from='osd.4 [v2:172.21.15.188:6800/213465511,v1:172.21.15.188:6801/213465511]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2020-07-16T13:33:04.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:03 smithi132 bash[23299]: audit 2020-07-16T13:33:03.454315+0000 mon.a (mon.0) 401 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2020-07-16T13:33:04.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:03 smithi132 bash[27079]: audit 2020-07-16T13:33:03.452000+0000 mon.b (mon.2) 10 : audit [INF] from='osd.4 [v2:172.21.15.188:6800/213465511,v1:172.21.15.188:6801/213465511]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2020-07-16T13:33:04.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:03 smithi132 bash[27079]: audit 2020-07-16T13:33:03.453285+0000 mon.a (mon.0) 400 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2020-07-16T13:33:04.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:03 smithi132 bash[27079]: audit 2020-07-16T13:33:03.454002+0000 mon.b (mon.2) 11 : audit [INF] from='osd.4 [v2:172.21.15.188:6800/213465511,v1:172.21.15.188:6801/213465511]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2020-07-16T13:33:04.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:03 smithi132 bash[27079]: audit 2020-07-16T13:33:03.454315+0000 mon.a (mon.0) 401 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2020-07-16T13:33:04.378 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 16 13:33:04 smithi188 podman[27608]: 2020-07-16 13:33:04.112122677 +0000 UTC m=+1.834246126 container remove 1e4f4ad930d13720536f8c95dc418a4124777481337cb61318a240b2461b7a9a (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.5-activate) 2020-07-16T13:33:04.670 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 16 13:33:04 smithi188 podman[28034]: 2020-07-16 13:33:04.45198348 +0000 UTC m=+0.324439507 container create 53df92e732ccae6793d40c6b23c39849376888966dc97ccaace9e72d742488d9 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.5) 2020-07-16T13:33:05.103 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 16 13:33:04 smithi188 podman[28034]: 2020-07-16 13:33:04.748958409 +0000 UTC m=+0.621414446 container init 53df92e732ccae6793d40c6b23c39849376888966dc97ccaace9e72d742488d9 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.5) 2020-07-16T13:33:05.103 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 16 13:33:04 smithi188 podman[28034]: 2020-07-16 13:33:04.836560453 +0000 UTC m=+0.709016580 container start 53df92e732ccae6793d40c6b23c39849376888966dc97ccaace9e72d742488d9 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.5) 2020-07-16T13:33:05.104 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 16 13:33:04 smithi188 podman[28034]: 2020-07-16 13:33:04.836682961 +0000 UTC m=+0.709139168 container attach 53df92e732ccae6793d40c6b23c39849376888966dc97ccaace9e72d742488d9 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.5) 2020-07-16T13:33:05.104 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:04 smithi188 bash[23329]: cluster 2020-07-16T13:33:03.717720+0000 mgr.y (mgr.14140) 113 : cluster [DBG] pgmap v112: 1 pgs: 1 active+undersized+degraded; 0 B data, 1.5 MiB used, 442 GiB / 447 GiB avail; 1/3 objects degraded (33.333%) 2020-07-16T13:33:05.105 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:04 smithi188 bash[23329]: cluster 2020-07-16T13:33:03.840125+0000 mon.a (mon.0) 402 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2020-07-16T13:33:05.105 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:04 smithi188 bash[23329]: cluster 2020-07-16T13:33:03.840156+0000 mon.a (mon.0) 403 : cluster [INF] Health check cleared: OSD_HOST_DOWN (was: 1 host (1 osds) down) 2020-07-16T13:33:05.105 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:04 smithi188 bash[23329]: cluster 2020-07-16T13:33:03.844951+0000 mon.a (mon.0) 404 : cluster [INF] osd.4 [v2:172.21.15.188:6800/213465511,v1:172.21.15.188:6801/213465511] boot 2020-07-16T13:33:05.106 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:04 smithi188 bash[23329]: cluster 2020-07-16T13:33:03.845076+0000 mon.a (mon.0) 405 : cluster [DBG] osdmap e36: 6 total, 5 up, 5 in 2020-07-16T13:33:05.106 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:04 smithi188 bash[23329]: audit 2020-07-16T13:33:03.845693+0000 mon.a (mon.0) 406 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-07-16T13:33:05.106 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:04 smithi188 bash[23329]: audit 2020-07-16T13:33:03.846135+0000 mon.a (mon.0) 407 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-07-16T13:33:05.107 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:04 smithi188 bash[23329]: audit 2020-07-16T13:33:04.338765+0000 mon.a (mon.0) 408 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.337908\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.338001\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.338038\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.338071\", \"created\": \"2020-07-16T13:33:02.260617\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}}, \"last_daemon_update\": \"2020-07-16T13:33:04.338159\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:33:05.107 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:04 smithi188 bash[23329]: audit 2020-07-16T13:33:04.342274+0000 mon.a (mon.0) 409 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.337908\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.338001\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.338038\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.338071\", \"created\": \"2020-07-16T13:33:02.260617\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}}, \"last_daemon_update\": \"2020-07-16T13:33:04.338159\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:33:05.107 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:04 smithi188 bash[23329]: audit 2020-07-16T13:33:04.343022+0000 mon.a (mon.0) 410 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:33:05.108 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:04 smithi188 bash[23329]: cluster 2020-07-16T13:33:04.848474+0000 mon.a (mon.0) 411 : cluster [DBG] osdmap e37: 6 total, 5 up, 5 in 2020-07-16T13:33:05.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:04 smithi132 bash[23299]: cluster 2020-07-16T13:33:03.717720+0000 mgr.y (mgr.14140) 113 : cluster [DBG] pgmap v112: 1 pgs: 1 active+undersized+degraded; 0 B data, 1.5 MiB used, 442 GiB / 447 GiB avail; 1/3 objects degraded (33.333%) 2020-07-16T13:33:05.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:04 smithi132 bash[23299]: cluster 2020-07-16T13:33:03.840125+0000 mon.a (mon.0) 402 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2020-07-16T13:33:05.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:04 smithi132 bash[23299]: cluster 2020-07-16T13:33:03.840156+0000 mon.a (mon.0) 403 : cluster [INF] Health check cleared: OSD_HOST_DOWN (was: 1 host (1 osds) down) 2020-07-16T13:33:05.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:04 smithi132 bash[23299]: cluster 2020-07-16T13:33:03.844951+0000 mon.a (mon.0) 404 : cluster [INF] osd.4 [v2:172.21.15.188:6800/213465511,v1:172.21.15.188:6801/213465511] boot 2020-07-16T13:33:05.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:04 smithi132 bash[23299]: cluster 2020-07-16T13:33:03.845076+0000 mon.a (mon.0) 405 : cluster [DBG] osdmap e36: 6 total, 5 up, 5 in 2020-07-16T13:33:05.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:04 smithi132 bash[23299]: audit 2020-07-16T13:33:03.845693+0000 mon.a (mon.0) 406 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-07-16T13:33:05.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:04 smithi132 bash[23299]: audit 2020-07-16T13:33:03.846135+0000 mon.a (mon.0) 407 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-07-16T13:33:05.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:04 smithi132 bash[23299]: audit 2020-07-16T13:33:04.338765+0000 mon.a (mon.0) 408 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.337908\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.338001\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.338038\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.338071\", \"created\": \"2020-07-16T13:33:02.260617\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}}, \"last_daemon_update\": \"2020-07-16T13:33:04.338159\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:33:05.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:04 smithi132 bash[23299]: audit 2020-07-16T13:33:04.342274+0000 mon.a (mon.0) 409 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.337908\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.338001\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.338038\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.338071\", \"created\": \"2020-07-16T13:33:02.260617\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}}, \"last_daemon_update\": \"2020-07-16T13:33:04.338159\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:33:05.283 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:04 smithi132 bash[23299]: audit 2020-07-16T13:33:04.343022+0000 mon.a (mon.0) 410 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:33:05.283 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:04 smithi132 bash[23299]: cluster 2020-07-16T13:33:04.848474+0000 mon.a (mon.0) 411 : cluster [DBG] osdmap e37: 6 total, 5 up, 5 in 2020-07-16T13:33:05.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:04 smithi132 bash[27079]: cluster 2020-07-16T13:33:03.717720+0000 mgr.y (mgr.14140) 113 : cluster [DBG] pgmap v112: 1 pgs: 1 active+undersized+degraded; 0 B data, 1.5 MiB used, 442 GiB / 447 GiB avail; 1/3 objects degraded (33.333%) 2020-07-16T13:33:05.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:04 smithi132 bash[27079]: cluster 2020-07-16T13:33:03.840125+0000 mon.a (mon.0) 402 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2020-07-16T13:33:05.284 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:04 smithi132 bash[27079]: cluster 2020-07-16T13:33:03.840156+0000 mon.a (mon.0) 403 : cluster [INF] Health check cleared: OSD_HOST_DOWN (was: 1 host (1 osds) down) 2020-07-16T13:33:05.284 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:04 smithi132 bash[27079]: cluster 2020-07-16T13:33:03.844951+0000 mon.a (mon.0) 404 : cluster [INF] osd.4 [v2:172.21.15.188:6800/213465511,v1:172.21.15.188:6801/213465511] boot 2020-07-16T13:33:05.284 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:04 smithi132 bash[27079]: cluster 2020-07-16T13:33:03.845076+0000 mon.a (mon.0) 405 : cluster [DBG] osdmap e36: 6 total, 5 up, 5 in 2020-07-16T13:33:05.284 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:04 smithi132 bash[27079]: audit 2020-07-16T13:33:03.845693+0000 mon.a (mon.0) 406 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-07-16T13:33:05.285 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:04 smithi132 bash[27079]: audit 2020-07-16T13:33:03.846135+0000 mon.a (mon.0) 407 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-07-16T13:33:05.285 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:04 smithi132 bash[27079]: audit 2020-07-16T13:33:04.338765+0000 mon.a (mon.0) 408 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.337908\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.338001\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.338038\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.338071\", \"created\": \"2020-07-16T13:33:02.260617\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}}, \"last_daemon_update\": \"2020-07-16T13:33:04.338159\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:33:05.285 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:04 smithi132 bash[27079]: audit 2020-07-16T13:33:04.342274+0000 mon.a (mon.0) 409 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.337908\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.338001\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.338038\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.338071\", \"created\": \"2020-07-16T13:33:02.260617\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}}, \"last_daemon_update\": \"2020-07-16T13:33:04.338159\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:33:05.285 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:04 smithi132 bash[27079]: audit 2020-07-16T13:33:04.343022+0000 mon.a (mon.0) 410 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:33:05.286 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:04 smithi132 bash[27079]: cluster 2020-07-16T13:33:04.848474+0000 mon.a (mon.0) 411 : cluster [DBG] osdmap e37: 6 total, 5 up, 5 in 2020-07-16T13:33:05.408 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 16 13:33:05 smithi188 bash[27598]: debug 2020-07-16T13:33:05.314+0000 7fcb5c887ec0 -1 Falling back to public interface 2020-07-16T13:33:06.147 INFO:teuthology.orchestra.run.smithi188.stderr:--> Zapping: /dev/vg_nvme/lv_2 2020-07-16T13:33:06.148 INFO:teuthology.orchestra.run.smithi188.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2020-07-16T13:33:06.148 INFO:teuthology.orchestra.run.smithi188.stderr: stderr: 10+0 records in 2020-07-16T13:33:06.148 INFO:teuthology.orchestra.run.smithi188.stderr:10+0 records out 2020-07-16T13:33:06.149 INFO:teuthology.orchestra.run.smithi188.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0122496 s, 856 MB/s 2020-07-16T13:33:06.149 INFO:teuthology.orchestra.run.smithi188.stderr:--> Zapping successful for: 2020-07-16T13:33:06.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:05 smithi188 bash[23329]: audit 2020-07-16T13:33:04.848668+0000 mon.a (mon.0) 412 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-07-16T13:33:06.175 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 16 13:33:05 smithi188 bash[27598]: debug 2020-07-16T13:33:05.868+0000 7fcb5c887ec0 -1 osd.5 0 log_to_monitors {default=true} 2020-07-16T13:33:06.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:05 smithi132 bash[23299]: audit 2020-07-16T13:33:04.848668+0000 mon.a (mon.0) 412 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-07-16T13:33:06.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:05 smithi132 bash[27079]: audit 2020-07-16T13:33:04.848668+0000 mon.a (mon.0) 412 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-07-16T13:33:06.774 INFO:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4c8ed362-c768-11ea-a06f-001a4aab830c -- ceph orch daemon add osd smithi188:vg_nvme/lv_2 2020-07-16T13:33:07.144 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:06 smithi188 bash[23329]: cluster 2020-07-16T13:33:05.718107+0000 mgr.y (mgr.14140) 114 : cluster [DBG] pgmap v115: 1 pgs: 1 active+undersized+degraded; 0 B data, 1.5 MiB used, 442 GiB / 447 GiB avail; 1/3 objects degraded (33.333%) 2020-07-16T13:33:07.144 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:06 smithi188 bash[23329]: audit 2020-07-16T13:33:05.873595+0000 mon.b (mon.2) 12 : audit [INF] from='osd.5 [v2:172.21.15.188:6808/3799292735,v1:172.21.15.188:6809/3799292735]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2020-07-16T13:33:07.145 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:06 smithi188 bash[23329]: audit 2020-07-16T13:33:05.873950+0000 mon.a (mon.0) 413 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2020-07-16T13:33:07.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:06 smithi132 bash[23299]: cluster 2020-07-16T13:33:05.718107+0000 mgr.y (mgr.14140) 114 : cluster [DBG] pgmap v115: 1 pgs: 1 active+undersized+degraded; 0 B data, 1.5 MiB used, 442 GiB / 447 GiB avail; 1/3 objects degraded (33.333%) 2020-07-16T13:33:07.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:06 smithi132 bash[23299]: audit 2020-07-16T13:33:05.873595+0000 mon.b (mon.2) 12 : audit [INF] from='osd.5 [v2:172.21.15.188:6808/3799292735,v1:172.21.15.188:6809/3799292735]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2020-07-16T13:33:07.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:06 smithi132 bash[23299]: audit 2020-07-16T13:33:05.873950+0000 mon.a (mon.0) 413 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2020-07-16T13:33:07.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:06 smithi132 bash[27079]: cluster 2020-07-16T13:33:05.718107+0000 mgr.y (mgr.14140) 114 : cluster [DBG] pgmap v115: 1 pgs: 1 active+undersized+degraded; 0 B data, 1.5 MiB used, 442 GiB / 447 GiB avail; 1/3 objects degraded (33.333%) 2020-07-16T13:33:07.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:06 smithi132 bash[27079]: audit 2020-07-16T13:33:05.873595+0000 mon.b (mon.2) 12 : audit [INF] from='osd.5 [v2:172.21.15.188:6808/3799292735,v1:172.21.15.188:6809/3799292735]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2020-07-16T13:33:07.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:06 smithi132 bash[27079]: audit 2020-07-16T13:33:05.873950+0000 mon.a (mon.0) 413 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2020-07-16T13:33:08.149 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 16 13:33:07 smithi188 bash[27598]: debug 2020-07-16T13:33:07.864+0000 7fcb4563c700 -1 osd.5 0 waiting for initial osdmap 2020-07-16T13:33:08.150 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:07 smithi188 bash[23329]: audit 2020-07-16T13:33:06.865020+0000 mon.a (mon.0) 414 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2020-07-16T13:33:08.150 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:07 smithi188 bash[23329]: cluster 2020-07-16T13:33:06.865100+0000 mon.a (mon.0) 415 : cluster [DBG] osdmap e38: 6 total, 5 up, 5 in 2020-07-16T13:33:08.150 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:07 smithi188 bash[23329]: audit 2020-07-16T13:33:06.865669+0000 mon.a (mon.0) 416 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-07-16T13:33:08.151 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:07 smithi188 bash[23329]: audit 2020-07-16T13:33:06.865745+0000 mon.b (mon.2) 13 : audit [INF] from='osd.5 [v2:172.21.15.188:6808/3799292735,v1:172.21.15.188:6809/3799292735]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2020-07-16T13:33:08.151 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:07 smithi188 bash[23329]: audit 2020-07-16T13:33:06.866158+0000 mon.a (mon.0) 417 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2020-07-16T13:33:08.152 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:07 smithi188 bash[23329]: audit 2020-07-16T13:33:07.863525+0000 mon.a (mon.0) 418 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]': finished 2020-07-16T13:33:08.152 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:07 smithi188 bash[23329]: cluster 2020-07-16T13:33:07.863599+0000 mon.a (mon.0) 419 : cluster [DBG] osdmap e39: 6 total, 5 up, 5 in 2020-07-16T13:33:08.152 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:07 smithi188 bash[23329]: audit 2020-07-16T13:33:07.863738+0000 mon.a (mon.0) 420 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-07-16T13:33:08.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:07 smithi132 bash[27079]: audit 2020-07-16T13:33:06.865020+0000 mon.a (mon.0) 414 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2020-07-16T13:33:08.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:07 smithi132 bash[27079]: cluster 2020-07-16T13:33:06.865100+0000 mon.a (mon.0) 415 : cluster [DBG] osdmap e38: 6 total, 5 up, 5 in 2020-07-16T13:33:08.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:07 smithi132 bash[27079]: audit 2020-07-16T13:33:06.865669+0000 mon.a (mon.0) 416 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-07-16T13:33:08.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:07 smithi132 bash[27079]: audit 2020-07-16T13:33:06.865745+0000 mon.b (mon.2) 13 : audit [INF] from='osd.5 [v2:172.21.15.188:6808/3799292735,v1:172.21.15.188:6809/3799292735]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2020-07-16T13:33:08.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:07 smithi132 bash[27079]: audit 2020-07-16T13:33:06.866158+0000 mon.a (mon.0) 417 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2020-07-16T13:33:08.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:07 smithi132 bash[27079]: audit 2020-07-16T13:33:07.863525+0000 mon.a (mon.0) 418 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]': finished 2020-07-16T13:33:08.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:07 smithi132 bash[27079]: cluster 2020-07-16T13:33:07.863599+0000 mon.a (mon.0) 419 : cluster [DBG] osdmap e39: 6 total, 5 up, 5 in 2020-07-16T13:33:08.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:07 smithi132 bash[27079]: audit 2020-07-16T13:33:07.863738+0000 mon.a (mon.0) 420 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-07-16T13:33:08.282 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:07 smithi132 bash[23299]: audit 2020-07-16T13:33:06.865020+0000 mon.a (mon.0) 414 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2020-07-16T13:33:08.282 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:07 smithi132 bash[23299]: cluster 2020-07-16T13:33:06.865100+0000 mon.a (mon.0) 415 : cluster [DBG] osdmap e38: 6 total, 5 up, 5 in 2020-07-16T13:33:08.283 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:07 smithi132 bash[23299]: audit 2020-07-16T13:33:06.865669+0000 mon.a (mon.0) 416 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-07-16T13:33:08.283 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:07 smithi132 bash[23299]: audit 2020-07-16T13:33:06.865745+0000 mon.b (mon.2) 13 : audit [INF] from='osd.5 [v2:172.21.15.188:6808/3799292735,v1:172.21.15.188:6809/3799292735]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2020-07-16T13:33:08.284 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:07 smithi132 bash[23299]: audit 2020-07-16T13:33:06.866158+0000 mon.a (mon.0) 417 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2020-07-16T13:33:08.284 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:07 smithi132 bash[23299]: audit 2020-07-16T13:33:07.863525+0000 mon.a (mon.0) 418 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]': finished 2020-07-16T13:33:08.284 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:07 smithi132 bash[23299]: cluster 2020-07-16T13:33:07.863599+0000 mon.a (mon.0) 419 : cluster [DBG] osdmap e39: 6 total, 5 up, 5 in 2020-07-16T13:33:08.285 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:07 smithi132 bash[23299]: audit 2020-07-16T13:33:07.863738+0000 mon.a (mon.0) 420 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-07-16T13:33:09.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:08 smithi188 bash[23329]: cluster 2020-07-16T13:33:06.873862+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2020-07-16T13:33:09.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:08 smithi188 bash[23329]: cluster 2020-07-16T13:33:06.873902+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2020-07-16T13:33:09.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:08 smithi188 bash[23329]: cluster 2020-07-16T13:33:07.718425+0000 mgr.y (mgr.14140) 115 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 1.5 MiB used, 442 GiB / 447 GiB avail 2020-07-16T13:33:09.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:08 smithi188 bash[23329]: cluster 2020-07-16T13:33:07.869068+0000 mon.a (mon.0) 421 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded) 2020-07-16T13:33:09.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:08 smithi188 bash[23329]: cluster 2020-07-16T13:33:07.869114+0000 mon.a (mon.0) 422 : cluster [INF] Cluster is now healthy 2020-07-16T13:33:09.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:08 smithi188 bash[23329]: audit 2020-07-16T13:33:08.164758+0000 mon.a (mon.0) 423 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:33:09.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:08 smithi188 bash[23329]: audit 2020-07-16T13:33:08.356609+0000 mon.a (mon.0) 424 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.337908\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.338001\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.338038\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.338071\", \"created\": \"2020-07-16T13:33:02.260617\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}}, \"last_daemon_update\": \"2020-07-16T13:33:04.338159\", \"last_device_update\": \"2020-07-16T13:33:08.355969\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:33:09.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:08 smithi188 bash[23329]: audit 2020-07-16T13:33:08.362509+0000 mon.a (mon.0) 425 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.337908\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.338001\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.338038\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.338071\", \"created\": \"2020-07-16T13:33:02.260617\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}}, \"last_daemon_update\": \"2020-07-16T13:33:04.338159\", \"last_device_update\": \"2020-07-16T13:33:08.355969\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:33:09.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:08 smithi132 bash[23299]: cluster 2020-07-16T13:33:06.873862+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2020-07-16T13:33:09.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:08 smithi132 bash[23299]: cluster 2020-07-16T13:33:06.873902+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2020-07-16T13:33:09.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:08 smithi132 bash[23299]: cluster 2020-07-16T13:33:07.718425+0000 mgr.y (mgr.14140) 115 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 1.5 MiB used, 442 GiB / 447 GiB avail 2020-07-16T13:33:09.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:08 smithi132 bash[23299]: cluster 2020-07-16T13:33:07.869068+0000 mon.a (mon.0) 421 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded) 2020-07-16T13:33:09.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:08 smithi132 bash[23299]: cluster 2020-07-16T13:33:07.869114+0000 mon.a (mon.0) 422 : cluster [INF] Cluster is now healthy 2020-07-16T13:33:09.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:08 smithi132 bash[23299]: audit 2020-07-16T13:33:08.164758+0000 mon.a (mon.0) 423 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:33:09.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:08 smithi132 bash[23299]: audit 2020-07-16T13:33:08.356609+0000 mon.a (mon.0) 424 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.337908\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.338001\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.338038\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.338071\", \"created\": \"2020-07-16T13:33:02.260617\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}}, \"last_daemon_update\": \"2020-07-16T13:33:04.338159\", \"last_device_update\": \"2020-07-16T13:33:08.355969\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:33:09.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:08 smithi132 bash[23299]: audit 2020-07-16T13:33:08.362509+0000 mon.a (mon.0) 425 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.337908\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.338001\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.338038\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.338071\", \"created\": \"2020-07-16T13:33:02.260617\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}}, \"last_daemon_update\": \"2020-07-16T13:33:04.338159\", \"last_device_update\": \"2020-07-16T13:33:08.355969\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:33:09.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:08 smithi132 bash[27079]: cluster 2020-07-16T13:33:06.873862+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2020-07-16T13:33:09.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:08 smithi132 bash[27079]: cluster 2020-07-16T13:33:06.873902+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2020-07-16T13:33:09.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:08 smithi132 bash[27079]: cluster 2020-07-16T13:33:07.718425+0000 mgr.y (mgr.14140) 115 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 1.5 MiB used, 442 GiB / 447 GiB avail 2020-07-16T13:33:09.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:08 smithi132 bash[27079]: cluster 2020-07-16T13:33:07.869068+0000 mon.a (mon.0) 421 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded) 2020-07-16T13:33:09.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:08 smithi132 bash[27079]: cluster 2020-07-16T13:33:07.869114+0000 mon.a (mon.0) 422 : cluster [INF] Cluster is now healthy 2020-07-16T13:33:09.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:08 smithi132 bash[27079]: audit 2020-07-16T13:33:08.164758+0000 mon.a (mon.0) 423 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:33:09.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:08 smithi132 bash[27079]: audit 2020-07-16T13:33:08.356609+0000 mon.a (mon.0) 424 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.337908\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.338001\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.338038\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.338071\", \"created\": \"2020-07-16T13:33:02.260617\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}}, \"last_daemon_update\": \"2020-07-16T13:33:04.338159\", \"last_device_update\": \"2020-07-16T13:33:08.355969\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:33:09.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:08 smithi132 bash[27079]: audit 2020-07-16T13:33:08.362509+0000 mon.a (mon.0) 425 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.337908\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.338001\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.338038\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.338071\", \"created\": \"2020-07-16T13:33:02.260617\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}}, \"last_daemon_update\": \"2020-07-16T13:33:04.338159\", \"last_device_update\": \"2020-07-16T13:33:08.355969\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:33:10.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:09 smithi188 bash[23329]: cluster 2020-07-16T13:33:08.874232+0000 mon.a (mon.0) 426 : cluster [INF] osd.5 [v2:172.21.15.188:6808/3799292735,v1:172.21.15.188:6809/3799292735] boot 2020-07-16T13:33:10.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:09 smithi188 bash[23329]: cluster 2020-07-16T13:33:08.874327+0000 mon.a (mon.0) 427 : cluster [DBG] osdmap e40: 6 total, 6 up, 6 in 2020-07-16T13:33:10.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:09 smithi188 bash[23329]: audit 2020-07-16T13:33:08.874835+0000 mon.a (mon.0) 428 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-07-16T13:33:10.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:09 smithi188 bash[23329]: audit 2020-07-16T13:33:09.109174+0000 mon.a (mon.0) 429 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-07-16T13:33:10.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:09 smithi188 bash[23329]: audit 2020-07-16T13:33:09.109985+0000 mon.a (mon.0) 430 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:33:10.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:09 smithi188 bash[23329]: audit 2020-07-16T13:33:09.111184+0000 mon.a (mon.0) 431 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:33:10.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:09 smithi132 bash[23299]: cluster 2020-07-16T13:33:08.874232+0000 mon.a (mon.0) 426 : cluster [INF] osd.5 [v2:172.21.15.188:6808/3799292735,v1:172.21.15.188:6809/3799292735] boot 2020-07-16T13:33:10.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:09 smithi132 bash[23299]: cluster 2020-07-16T13:33:08.874327+0000 mon.a (mon.0) 427 : cluster [DBG] osdmap e40: 6 total, 6 up, 6 in 2020-07-16T13:33:10.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:09 smithi132 bash[23299]: audit 2020-07-16T13:33:08.874835+0000 mon.a (mon.0) 428 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-07-16T13:33:10.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:09 smithi132 bash[23299]: audit 2020-07-16T13:33:09.109174+0000 mon.a (mon.0) 429 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-07-16T13:33:10.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:09 smithi132 bash[23299]: audit 2020-07-16T13:33:09.109985+0000 mon.a (mon.0) 430 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:33:10.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:09 smithi132 bash[23299]: audit 2020-07-16T13:33:09.111184+0000 mon.a (mon.0) 431 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:33:10.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:09 smithi132 bash[27079]: cluster 2020-07-16T13:33:08.874232+0000 mon.a (mon.0) 426 : cluster [INF] osd.5 [v2:172.21.15.188:6808/3799292735,v1:172.21.15.188:6809/3799292735] boot 2020-07-16T13:33:10.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:09 smithi132 bash[27079]: cluster 2020-07-16T13:33:08.874327+0000 mon.a (mon.0) 427 : cluster [DBG] osdmap e40: 6 total, 6 up, 6 in 2020-07-16T13:33:10.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:09 smithi132 bash[27079]: audit 2020-07-16T13:33:08.874835+0000 mon.a (mon.0) 428 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-07-16T13:33:10.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:09 smithi132 bash[27079]: audit 2020-07-16T13:33:09.109174+0000 mon.a (mon.0) 429 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-07-16T13:33:10.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:09 smithi132 bash[27079]: audit 2020-07-16T13:33:09.109985+0000 mon.a (mon.0) 430 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:33:10.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:09 smithi132 bash[27079]: audit 2020-07-16T13:33:09.111184+0000 mon.a (mon.0) 431 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:33:11.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:10 smithi188 bash[23329]: audit 2020-07-16T13:33:09.108143+0000 mgr.y (mgr.14140) 116 : audit [DBG] from='client.34235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:33:11.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:10 smithi188 bash[23329]: cephadm 2020-07-16T13:33:09.108834+0000 mgr.y (mgr.14140) 117 : cephadm [INF] Applying osd on host smithi188... 2020-07-16T13:33:11.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:10 smithi188 bash[23329]: cluster 2020-07-16T13:33:09.718990+0000 mgr.y (mgr.14140) 118 : cluster [DBG] pgmap v120: 1 pgs: 1 peering; 0 B data, 1.7 MiB used, 442 GiB / 447 GiB avail 2020-07-16T13:33:11.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:10 smithi188 bash[23329]: cluster 2020-07-16T13:33:09.882962+0000 mon.a (mon.0) 432 : cluster [DBG] osdmap e41: 6 total, 6 up, 6 in 2020-07-16T13:33:11.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:10 smithi188 bash[23329]: cluster 2020-07-16T13:33:10.579769+0000 mon.a (mon.0) 433 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2020-07-16T13:33:11.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:10 smithi132 bash[27079]: audit 2020-07-16T13:33:09.108143+0000 mgr.y (mgr.14140) 116 : audit [DBG] from='client.34235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:33:11.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:10 smithi132 bash[27079]: cephadm 2020-07-16T13:33:09.108834+0000 mgr.y (mgr.14140) 117 : cephadm [INF] Applying osd on host smithi188... 2020-07-16T13:33:11.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:10 smithi132 bash[27079]: cluster 2020-07-16T13:33:09.718990+0000 mgr.y (mgr.14140) 118 : cluster [DBG] pgmap v120: 1 pgs: 1 peering; 0 B data, 1.7 MiB used, 442 GiB / 447 GiB avail 2020-07-16T13:33:11.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:10 smithi132 bash[27079]: cluster 2020-07-16T13:33:09.882962+0000 mon.a (mon.0) 432 : cluster [DBG] osdmap e41: 6 total, 6 up, 6 in 2020-07-16T13:33:11.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:10 smithi132 bash[27079]: cluster 2020-07-16T13:33:10.579769+0000 mon.a (mon.0) 433 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2020-07-16T13:33:11.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:10 smithi132 bash[23299]: audit 2020-07-16T13:33:09.108143+0000 mgr.y (mgr.14140) 116 : audit [DBG] from='client.34235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:33:11.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:10 smithi132 bash[23299]: cephadm 2020-07-16T13:33:09.108834+0000 mgr.y (mgr.14140) 117 : cephadm [INF] Applying osd on host smithi188... 2020-07-16T13:33:11.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:10 smithi132 bash[23299]: cluster 2020-07-16T13:33:09.718990+0000 mgr.y (mgr.14140) 118 : cluster [DBG] pgmap v120: 1 pgs: 1 peering; 0 B data, 1.7 MiB used, 442 GiB / 447 GiB avail 2020-07-16T13:33:11.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:10 smithi132 bash[23299]: cluster 2020-07-16T13:33:09.882962+0000 mon.a (mon.0) 432 : cluster [DBG] osdmap e41: 6 total, 6 up, 6 in 2020-07-16T13:33:11.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:10 smithi132 bash[23299]: cluster 2020-07-16T13:33:10.579769+0000 mon.a (mon.0) 433 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2020-07-16T13:33:12.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:11 smithi188 bash[23329]: audit 2020-07-16T13:33:11.374521+0000 mon.b (mon.2) 14 : audit [INF] from='client.? 172.21.15.188:0/3055470315' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a7c2ccf5-4bf1-49ad-b927-a5dec96c641f"}]: dispatch 2020-07-16T13:33:12.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:11 smithi188 bash[23329]: audit 2020-07-16T13:33:11.375095+0000 mon.a (mon.0) 434 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a7c2ccf5-4bf1-49ad-b927-a5dec96c641f"}]: dispatch 2020-07-16T13:33:12.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:11 smithi188 bash[23329]: audit 2020-07-16T13:33:11.381439+0000 mon.a (mon.0) 435 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a7c2ccf5-4bf1-49ad-b927-a5dec96c641f"}]': finished 2020-07-16T13:33:12.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:11 smithi188 bash[23329]: cluster 2020-07-16T13:33:11.381511+0000 mon.a (mon.0) 436 : cluster [DBG] osdmap e42: 7 total, 6 up, 6 in 2020-07-16T13:33:12.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:11 smithi188 bash[23329]: audit 2020-07-16T13:33:11.381651+0000 mon.a (mon.0) 437 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2020-07-16T13:33:12.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:11 smithi132 bash[27079]: audit 2020-07-16T13:33:11.374521+0000 mon.b (mon.2) 14 : audit [INF] from='client.? 172.21.15.188:0/3055470315' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a7c2ccf5-4bf1-49ad-b927-a5dec96c641f"}]: dispatch 2020-07-16T13:33:12.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:11 smithi132 bash[27079]: audit 2020-07-16T13:33:11.375095+0000 mon.a (mon.0) 434 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a7c2ccf5-4bf1-49ad-b927-a5dec96c641f"}]: dispatch 2020-07-16T13:33:12.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:11 smithi132 bash[27079]: audit 2020-07-16T13:33:11.381439+0000 mon.a (mon.0) 435 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a7c2ccf5-4bf1-49ad-b927-a5dec96c641f"}]': finished 2020-07-16T13:33:12.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:11 smithi132 bash[27079]: cluster 2020-07-16T13:33:11.381511+0000 mon.a (mon.0) 436 : cluster [DBG] osdmap e42: 7 total, 6 up, 6 in 2020-07-16T13:33:12.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:11 smithi132 bash[27079]: audit 2020-07-16T13:33:11.381651+0000 mon.a (mon.0) 437 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2020-07-16T13:33:12.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:11 smithi132 bash[23299]: audit 2020-07-16T13:33:11.374521+0000 mon.b (mon.2) 14 : audit [INF] from='client.? 172.21.15.188:0/3055470315' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a7c2ccf5-4bf1-49ad-b927-a5dec96c641f"}]: dispatch 2020-07-16T13:33:12.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:11 smithi132 bash[23299]: audit 2020-07-16T13:33:11.375095+0000 mon.a (mon.0) 434 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a7c2ccf5-4bf1-49ad-b927-a5dec96c641f"}]: dispatch 2020-07-16T13:33:12.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:11 smithi132 bash[23299]: audit 2020-07-16T13:33:11.381439+0000 mon.a (mon.0) 435 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a7c2ccf5-4bf1-49ad-b927-a5dec96c641f"}]': finished 2020-07-16T13:33:12.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:11 smithi132 bash[23299]: cluster 2020-07-16T13:33:11.381511+0000 mon.a (mon.0) 436 : cluster [DBG] osdmap e42: 7 total, 6 up, 6 in 2020-07-16T13:33:12.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:11 smithi132 bash[23299]: audit 2020-07-16T13:33:11.381651+0000 mon.a (mon.0) 437 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2020-07-16T13:33:13.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:12 smithi188 bash[23329]: cluster 2020-07-16T13:33:11.719515+0000 mgr.y (mgr.14140) 119 : cluster [DBG] pgmap v123: 1 pgs: 1 peering; 0 B data, 2.1 MiB used, 530 GiB / 536 GiB avail 2020-07-16T13:33:13.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:12 smithi132 bash[27079]: cluster 2020-07-16T13:33:11.719515+0000 mgr.y (mgr.14140) 119 : cluster [DBG] pgmap v123: 1 pgs: 1 peering; 0 B data, 2.1 MiB used, 530 GiB / 536 GiB avail 2020-07-16T13:33:13.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:12 smithi132 bash[23299]: cluster 2020-07-16T13:33:11.719515+0000 mgr.y (mgr.14140) 119 : cluster [DBG] pgmap v123: 1 pgs: 1 peering; 0 B data, 2.1 MiB used, 530 GiB / 536 GiB avail 2020-07-16T13:33:14.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:13 smithi188 bash[23329]: audit 2020-07-16T13:33:13.070228+0000 mon.b (mon.2) 15 : audit [DBG] from='client.? 172.21.15.188:0/4237579479' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-07-16T13:33:14.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:13 smithi132 bash[23299]: audit 2020-07-16T13:33:13.070228+0000 mon.b (mon.2) 15 : audit [DBG] from='client.? 172.21.15.188:0/4237579479' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-07-16T13:33:14.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:13 smithi132 bash[27079]: audit 2020-07-16T13:33:13.070228+0000 mon.b (mon.2) 15 : audit [DBG] from='client.? 172.21.15.188:0/4237579479' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-07-16T13:33:15.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:14 smithi188 bash[23329]: cluster 2020-07-16T13:33:13.720052+0000 mgr.y (mgr.14140) 120 : cluster [DBG] pgmap v124: 1 pgs: 1 peering; 0 B data, 2.2 MiB used, 530 GiB / 536 GiB avail 2020-07-16T13:33:15.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:14 smithi132 bash[23299]: cluster 2020-07-16T13:33:13.720052+0000 mgr.y (mgr.14140) 120 : cluster [DBG] pgmap v124: 1 pgs: 1 peering; 0 B data, 2.2 MiB used, 530 GiB / 536 GiB avail 2020-07-16T13:33:15.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:14 smithi132 bash[27079]: cluster 2020-07-16T13:33:13.720052+0000 mgr.y (mgr.14140) 120 : cluster [DBG] pgmap v124: 1 pgs: 1 peering; 0 B data, 2.2 MiB used, 530 GiB / 536 GiB avail 2020-07-16T13:33:16.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:15 smithi188 bash[23329]: audit 2020-07-16T13:33:15.560499+0000 mon.a (mon.0) 438 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:33:16.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:15 smithi132 bash[23299]: audit 2020-07-16T13:33:15.560499+0000 mon.a (mon.0) 438 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:33:16.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:15 smithi132 bash[27079]: audit 2020-07-16T13:33:15.560499+0000 mon.a (mon.0) 438 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:33:17.074 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:16 smithi188 bash[23329]: cluster 2020-07-16T13:33:15.720566+0000 mgr.y (mgr.14140) 121 : cluster [DBG] pgmap v125: 1 pgs: 1 active+clean; 0 B data, 2.3 MiB used, 530 GiB / 536 GiB avail 2020-07-16T13:33:17.075 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:16 smithi188 bash[23329]: cluster 2020-07-16T13:33:15.904033+0000 mon.a (mon.0) 439 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2020-07-16T13:33:17.075 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:16 smithi188 bash[23329]: cluster 2020-07-16T13:33:15.904096+0000 mon.a (mon.0) 440 : cluster [INF] Cluster is now healthy 2020-07-16T13:33:17.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:16 smithi132 bash[27079]: cluster 2020-07-16T13:33:15.720566+0000 mgr.y (mgr.14140) 121 : cluster [DBG] pgmap v125: 1 pgs: 1 active+clean; 0 B data, 2.3 MiB used, 530 GiB / 536 GiB avail 2020-07-16T13:33:17.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:16 smithi132 bash[27079]: cluster 2020-07-16T13:33:15.904033+0000 mon.a (mon.0) 439 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2020-07-16T13:33:17.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:16 smithi132 bash[27079]: cluster 2020-07-16T13:33:15.904096+0000 mon.a (mon.0) 440 : cluster [INF] Cluster is now healthy 2020-07-16T13:33:17.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:16 smithi132 bash[23299]: cluster 2020-07-16T13:33:15.720566+0000 mgr.y (mgr.14140) 121 : cluster [DBG] pgmap v125: 1 pgs: 1 active+clean; 0 B data, 2.3 MiB used, 530 GiB / 536 GiB avail 2020-07-16T13:33:17.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:16 smithi132 bash[23299]: cluster 2020-07-16T13:33:15.904033+0000 mon.a (mon.0) 439 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2020-07-16T13:33:17.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:16 smithi132 bash[23299]: cluster 2020-07-16T13:33:15.904096+0000 mon.a (mon.0) 440 : cluster [INF] Cluster is now healthy 2020-07-16T13:33:19.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:18 smithi188 bash[23329]: cluster 2020-07-16T13:33:17.721093+0000 mgr.y (mgr.14140) 122 : cluster [DBG] pgmap v126: 1 pgs: 1 active+clean; 0 B data, 2.3 MiB used, 530 GiB / 536 GiB avail 2020-07-16T13:33:19.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:18 smithi188 bash[23329]: audit 2020-07-16T13:33:17.968894+0000 mon.a (mon.0) 441 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2020-07-16T13:33:19.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:18 smithi188 bash[23329]: audit 2020-07-16T13:33:17.969708+0000 mon.a (mon.0) 442 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:33:19.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:18 smithi188 bash[23329]: audit 2020-07-16T13:33:17.970555+0000 mon.a (mon.0) 443 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.6", "key": "container_image"}]: dispatch 2020-07-16T13:33:19.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:18 smithi132 bash[27079]: cluster 2020-07-16T13:33:17.721093+0000 mgr.y (mgr.14140) 122 : cluster [DBG] pgmap v126: 1 pgs: 1 active+clean; 0 B data, 2.3 MiB used, 530 GiB / 536 GiB avail 2020-07-16T13:33:19.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:18 smithi132 bash[27079]: audit 2020-07-16T13:33:17.968894+0000 mon.a (mon.0) 441 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2020-07-16T13:33:19.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:18 smithi132 bash[27079]: audit 2020-07-16T13:33:17.969708+0000 mon.a (mon.0) 442 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:33:19.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:18 smithi132 bash[27079]: audit 2020-07-16T13:33:17.970555+0000 mon.a (mon.0) 443 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.6", "key": "container_image"}]: dispatch 2020-07-16T13:33:19.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:18 smithi132 bash[23299]: cluster 2020-07-16T13:33:17.721093+0000 mgr.y (mgr.14140) 122 : cluster [DBG] pgmap v126: 1 pgs: 1 active+clean; 0 B data, 2.3 MiB used, 530 GiB / 536 GiB avail 2020-07-16T13:33:19.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:18 smithi132 bash[23299]: audit 2020-07-16T13:33:17.968894+0000 mon.a (mon.0) 441 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2020-07-16T13:33:19.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:18 smithi132 bash[23299]: audit 2020-07-16T13:33:17.969708+0000 mon.a (mon.0) 442 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:33:19.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:18 smithi132 bash[23299]: audit 2020-07-16T13:33:17.970555+0000 mon.a (mon.0) 443 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.6", "key": "container_image"}]: dispatch 2020-07-16T13:33:19.490 INFO:teuthology.orchestra.run.smithi188.stdout:Created osd(s) 6 on host 'smithi188' 2020-07-16T13:33:20.122 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:19 smithi188 bash[23329]: cephadm 2020-07-16T13:33:17.970254+0000 mgr.y (mgr.14140) 123 : cephadm [INF] Deploying daemon osd.6 on smithi188 2020-07-16T13:33:20.122 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:19 smithi188 bash[23329]: audit 2020-07-16T13:33:19.483004+0000 mon.a (mon.0) 444 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.337908\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.338001\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.338038\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.338071\", \"created\": \"2020-07-16T13:33:02.260617\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}}, \"last_device_update\": \"2020-07-16T13:33:08.355969\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:33:20.123 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:19 smithi188 bash[23329]: audit 2020-07-16T13:33:19.483500+0000 mon.a (mon.0) 445 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:33:20.123 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:19 smithi188 bash[23329]: audit 2020-07-16T13:33:19.486714+0000 mon.a (mon.0) 446 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.337908\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.338001\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.338038\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.338071\", \"created\": \"2020-07-16T13:33:02.260617\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}}, \"last_device_update\": \"2020-07-16T13:33:08.355969\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:33:20.210 INFO:teuthology.orchestra.run.smithi188:osd.6> sudo journalctl -f -n 0 -u ceph-4c8ed362-c768-11ea-a06f-001a4aab830c@osd.6.service 2020-07-16T13:33:20.214 INFO:tasks.cephadm:Deploying osd.7 on smithi188 with /dev/vg_nvme/lv_1... 2020-07-16T13:33:20.214 INFO:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4c8ed362-c768-11ea-a06f-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2020-07-16T13:33:20.255 INFO:journalctl@ceph.osd.6.smithi188.stdout:-- Logs begin at Thu 2020-07-16 13:22:28 UTC. -- 2020-07-16T13:33:20.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:19 smithi132 bash[23299]: cephadm 2020-07-16T13:33:17.970254+0000 mgr.y (mgr.14140) 123 : cephadm [INF] Deploying daemon osd.6 on smithi188 2020-07-16T13:33:20.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:19 smithi132 bash[23299]: audit 2020-07-16T13:33:19.483004+0000 mon.a (mon.0) 444 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.337908\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.338001\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.338038\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.338071\", \"created\": \"2020-07-16T13:33:02.260617\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}}, \"last_device_update\": \"2020-07-16T13:33:08.355969\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:33:20.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:19 smithi132 bash[23299]: audit 2020-07-16T13:33:19.483500+0000 mon.a (mon.0) 445 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:33:20.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:19 smithi132 bash[23299]: audit 2020-07-16T13:33:19.486714+0000 mon.a (mon.0) 446 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.337908\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.338001\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.338038\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.338071\", \"created\": \"2020-07-16T13:33:02.260617\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}}, \"last_device_update\": \"2020-07-16T13:33:08.355969\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:33:20.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:19 smithi132 bash[27079]: cephadm 2020-07-16T13:33:17.970254+0000 mgr.y (mgr.14140) 123 : cephadm [INF] Deploying daemon osd.6 on smithi188 2020-07-16T13:33:20.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:19 smithi132 bash[27079]: audit 2020-07-16T13:33:19.483004+0000 mon.a (mon.0) 444 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.337908\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.338001\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.338038\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.338071\", \"created\": \"2020-07-16T13:33:02.260617\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}}, \"last_device_update\": \"2020-07-16T13:33:08.355969\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:33:20.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:19 smithi132 bash[27079]: audit 2020-07-16T13:33:19.483500+0000 mon.a (mon.0) 445 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:33:20.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:19 smithi132 bash[27079]: audit 2020-07-16T13:33:19.486714+0000 mon.a (mon.0) 446 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.337908\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.338001\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.338038\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:04.338071\", \"created\": \"2020-07-16T13:33:02.260617\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}}, \"last_device_update\": \"2020-07-16T13:33:08.355969\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:33:20.920 INFO:journalctl@ceph.osd.6.smithi188.stdout:Jul 16 13:33:20 smithi188 bash[29338]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2020-07-16T13:33:20.921 INFO:journalctl@ceph.osd.6.smithi188.stdout:Jul 16 13:33:20 smithi188 bash[29338]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-6 --no-mon-config 2020-07-16T13:33:20.921 INFO:journalctl@ceph.osd.6.smithi188.stdout:Jul 16 13:33:20 smithi188 bash[29338]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6/block 2020-07-16T13:33:20.921 INFO:journalctl@ceph.osd.6.smithi188.stdout:Jul 16 13:33:20 smithi188 bash[29338]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-6/block 2020-07-16T13:33:20.921 INFO:journalctl@ceph.osd.6.smithi188.stdout:Jul 16 13:33:20 smithi188 bash[29338]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2020-07-16T13:33:20.922 INFO:journalctl@ceph.osd.6.smithi188.stdout:Jul 16 13:33:20 smithi188 bash[29338]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2020-07-16T13:33:20.922 INFO:journalctl@ceph.osd.6.smithi188.stdout:Jul 16 13:33:20 smithi188 bash[29338]: --> ceph-volume lvm activate successful for osd ID: 6 2020-07-16T13:33:20.922 INFO:journalctl@ceph.osd.6.smithi188.stdout:Jul 16 13:33:20 smithi188 podman[29340]: 2020-07-16 13:33:20.56061001 +0000 UTC m=+1.091580232 container died dc652bc7fc3cb203e4aba209eb40091d42f75177aebaf7347bad7e280dc9b977 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.6-activate) 2020-07-16T13:33:21.178 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:20 smithi188 bash[23329]: cluster 2020-07-16T13:33:19.721496+0000 mgr.y (mgr.14140) 124 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 0 B data, 2.3 MiB used, 530 GiB / 536 GiB avail 2020-07-16T13:33:21.178 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:20 smithi188 bash[23329]: audit 2020-07-16T13:33:20.721726+0000 mon.a (mon.0) 447 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"5e2adad3-9b83-4d34-a30d-85ad0922bece\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1594906388.872921, \"finished_at\": 1594906399.4932332}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2020-07-16T13:33:21.179 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:20 smithi188 bash[23329]: audit 2020-07-16T13:33:20.724945+0000 mon.a (mon.0) 448 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"5e2adad3-9b83-4d34-a30d-85ad0922bece\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1594906388.872921, \"finished_at\": 1594906399.4932332}], \"version\": 2, \"compat_version\": 2}"}]': finished 2020-07-16T13:33:21.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:20 smithi132 bash[27079]: cluster 2020-07-16T13:33:19.721496+0000 mgr.y (mgr.14140) 124 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 0 B data, 2.3 MiB used, 530 GiB / 536 GiB avail 2020-07-16T13:33:21.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:20 smithi132 bash[27079]: audit 2020-07-16T13:33:20.721726+0000 mon.a (mon.0) 447 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"5e2adad3-9b83-4d34-a30d-85ad0922bece\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1594906388.872921, \"finished_at\": 1594906399.4932332}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2020-07-16T13:33:21.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:20 smithi132 bash[27079]: audit 2020-07-16T13:33:20.724945+0000 mon.a (mon.0) 448 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"5e2adad3-9b83-4d34-a30d-85ad0922bece\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1594906388.872921, \"finished_at\": 1594906399.4932332}], \"version\": 2, \"compat_version\": 2}"}]': finished 2020-07-16T13:33:21.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:20 smithi132 bash[23299]: cluster 2020-07-16T13:33:19.721496+0000 mgr.y (mgr.14140) 124 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 0 B data, 2.3 MiB used, 530 GiB / 536 GiB avail 2020-07-16T13:33:21.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:20 smithi132 bash[23299]: audit 2020-07-16T13:33:20.721726+0000 mon.a (mon.0) 447 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"5e2adad3-9b83-4d34-a30d-85ad0922bece\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1594906388.872921, \"finished_at\": 1594906399.4932332}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2020-07-16T13:33:21.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:20 smithi132 bash[23299]: audit 2020-07-16T13:33:20.724945+0000 mon.a (mon.0) 448 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"5e2adad3-9b83-4d34-a30d-85ad0922bece\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1594906388.872921, \"finished_at\": 1594906399.4932332}], \"version\": 2, \"compat_version\": 2}"}]': finished 2020-07-16T13:33:21.446 INFO:journalctl@ceph.osd.6.smithi188.stdout:Jul 16 13:33:21 smithi188 podman[29340]: 2020-07-16 13:33:21.177421011 +0000 UTC m=+1.708391238 container remove dc652bc7fc3cb203e4aba209eb40091d42f75177aebaf7347bad7e280dc9b977 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.6-activate) 2020-07-16T13:33:21.862 INFO:journalctl@ceph.osd.6.smithi188.stdout:Jul 16 13:33:21 smithi188 podman[29639]: 2020-07-16 13:33:21.448058602 +0000 UTC m=+0.253175037 container create 7981505d5f0b6957abe2b76850b7493489a7082eff5393d3428ae808f8f9eea0 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.6) 2020-07-16T13:33:21.862 INFO:journalctl@ceph.osd.6.smithi188.stdout:Jul 16 13:33:21 smithi188 podman[29639]: 2020-07-16 13:33:21.8611405 +0000 UTC m=+0.666256926 container init 7981505d5f0b6957abe2b76850b7493489a7082eff5393d3428ae808f8f9eea0 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.6) 2020-07-16T13:33:22.126 INFO:journalctl@ceph.osd.6.smithi188.stdout:Jul 16 13:33:21 smithi188 podman[29639]: 2020-07-16 13:33:21.998278795 +0000 UTC m=+0.803395219 container start 7981505d5f0b6957abe2b76850b7493489a7082eff5393d3428ae808f8f9eea0 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.6) 2020-07-16T13:33:22.126 INFO:journalctl@ceph.osd.6.smithi188.stdout:Jul 16 13:33:21 smithi188 podman[29639]: 2020-07-16 13:33:21.998366387 +0000 UTC m=+0.803482833 container attach 7981505d5f0b6957abe2b76850b7493489a7082eff5393d3428ae808f8f9eea0 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.6) 2020-07-16T13:33:22.127 INFO:journalctl@ceph.osd.6.smithi188.stdout:Jul 16 13:33:21 smithi188 bash[29338]: debug 2020-07-16T13:33:21.889+0000 7f23b57c2ec0 10 --2- 172.21.15.188:0/1270175227 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56019b661400 0x56019b65df80 secure :-1 s=READY pgs=36 cs=0 l=1 rx=0x56019b5f3d10 tx=0x56019c2ccaa0).discard_out_queue started 2020-07-16T13:33:22.127 INFO:journalctl@ceph.osd.6.smithi188.stdout:Jul 16 13:33:21 smithi188 bash[29338]: debug 2020-07-16T13:33:21.889+0000 7f23b0010700 5 --2- 172.21.15.188:0/1270175227 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56019b661400 0x56019b65df80 secure :-1 s=READY pgs=36 cs=0 l=1 rx=0x56019b5f3d10 tx=0x56019c2ccaa0).reset_recv_state (warped) reseting crypto handlers 2020-07-16T13:33:22.127 INFO:journalctl@ceph.osd.6.smithi188.stdout:Jul 16 13:33:21 smithi188 bash[29338]: debug 2020-07-16T13:33:21.889+0000 7f23b57c2ec0 20 Event(0x56019b604e00 nevent=5000 time_id=3).wakeup 2020-07-16T13:33:22.127 INFO:journalctl@ceph.osd.6.smithi188.stdout:Jul 16 13:33:21 smithi188 bash[29338]: debug 2020-07-16T13:33:21.889+0000 7f23b0010700 5 --2- 172.21.15.188:0/1270175227 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56019b661400 0x56019b65df80 secure :-1 s=CLOSED pgs=36 cs=0 l=1 rx=0x56019b5f3d10 tx=0x56019c2ccaa0).reset_security 2020-07-16T13:33:22.127 INFO:journalctl@ceph.osd.6.smithi188.stdout:Jul 16 13:33:21 smithi188 bash[29338]: debug 2020-07-16T13:33:21.889+0000 7f23b0010700 20 EpollDriver.del_event del event fd=16 cur_mask=1 delmask=3 to 5 2020-07-16T13:33:22.670 INFO:journalctl@ceph.osd.6.smithi188.stdout:Jul 16 13:33:22 smithi188 bash[29338]: debug 2020-07-16T13:33:22.407+0000 7f23b57c2ec0 -1 Falling back to public interface 2020-07-16T13:33:22.924 INFO:teuthology.orchestra.run.smithi188.stderr:--> Zapping: /dev/vg_nvme/lv_1 2020-07-16T13:33:22.924 INFO:teuthology.orchestra.run.smithi188.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2020-07-16T13:33:22.925 INFO:teuthology.orchestra.run.smithi188.stderr: stderr: 10+0 records in 2020-07-16T13:33:22.925 INFO:teuthology.orchestra.run.smithi188.stderr:10+0 records out 2020-07-16T13:33:22.925 INFO:teuthology.orchestra.run.smithi188.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0111056 s, 944 MB/s 2020-07-16T13:33:22.925 INFO:teuthology.orchestra.run.smithi188.stderr: stderr: 2020-07-16T13:33:22.925 INFO:teuthology.orchestra.run.smithi188.stderr:--> Zapping successful for: 2020-07-16T13:33:22.971 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:22 smithi188 bash[23329]: cluster 2020-07-16T13:33:21.721842+0000 mgr.y (mgr.14140) 125 : cluster [DBG] pgmap v128: 1 pgs: 1 active+clean; 0 B data, 2.3 MiB used, 530 GiB / 536 GiB avail 2020-07-16T13:33:22.972 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:22 smithi188 bash[23329]: audit 2020-07-16T13:33:22.146895+0000 mon.a (mon.0) 449 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.145935\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146028\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146063\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146110\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146143\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}}, \"last_daemon_update\": \"2020-07-16T13:33:22.146231\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:33:22.972 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:22 smithi188 bash[23329]: audit 2020-07-16T13:33:22.149963+0000 mon.a (mon.0) 450 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.145935\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146028\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146063\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146110\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146143\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}}, \"last_daemon_update\": \"2020-07-16T13:33:22.146231\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:33:22.972 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:22 smithi188 bash[23329]: audit 2020-07-16T13:33:22.150657+0000 mon.a (mon.0) 451 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:33:23.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:22 smithi132 bash[23299]: cluster 2020-07-16T13:33:21.721842+0000 mgr.y (mgr.14140) 125 : cluster [DBG] pgmap v128: 1 pgs: 1 active+clean; 0 B data, 2.3 MiB used, 530 GiB / 536 GiB avail 2020-07-16T13:33:23.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:22 smithi132 bash[23299]: audit 2020-07-16T13:33:22.146895+0000 mon.a (mon.0) 449 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.145935\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146028\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146063\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146110\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146143\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}}, \"last_daemon_update\": \"2020-07-16T13:33:22.146231\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:33:23.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:22 smithi132 bash[23299]: audit 2020-07-16T13:33:22.149963+0000 mon.a (mon.0) 450 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.145935\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146028\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146063\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146110\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146143\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}}, \"last_daemon_update\": \"2020-07-16T13:33:22.146231\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:33:23.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:22 smithi132 bash[23299]: audit 2020-07-16T13:33:22.150657+0000 mon.a (mon.0) 451 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:33:23.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:22 smithi132 bash[27079]: cluster 2020-07-16T13:33:21.721842+0000 mgr.y (mgr.14140) 125 : cluster [DBG] pgmap v128: 1 pgs: 1 active+clean; 0 B data, 2.3 MiB used, 530 GiB / 536 GiB avail 2020-07-16T13:33:23.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:22 smithi132 bash[27079]: audit 2020-07-16T13:33:22.146895+0000 mon.a (mon.0) 449 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.145935\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146028\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146063\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146110\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146143\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}}, \"last_daemon_update\": \"2020-07-16T13:33:22.146231\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:33:23.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:22 smithi132 bash[27079]: audit 2020-07-16T13:33:22.149963+0000 mon.a (mon.0) 450 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.145935\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146028\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146063\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146110\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146143\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}}, \"last_daemon_update\": \"2020-07-16T13:33:22.146231\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:33:23.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:22 smithi132 bash[27079]: audit 2020-07-16T13:33:22.150657+0000 mon.a (mon.0) 451 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:33:23.421 INFO:journalctl@ceph.osd.6.smithi188.stdout:Jul 16 13:33:22 smithi188 bash[29338]: debug 2020-07-16T13:33:22.970+0000 7f23b57c2ec0 -1 osd.6 0 log_to_monitors {default=true} 2020-07-16T13:33:23.893 INFO:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4c8ed362-c768-11ea-a06f-001a4aab830c -- ceph orch daemon add osd smithi188:vg_nvme/lv_1 2020-07-16T13:33:24.127 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:23 smithi188 bash[23329]: audit 2020-07-16T13:33:22.973884+0000 mon.b (mon.2) 16 : audit [INF] from='osd.6 [v2:172.21.15.188:6816/135312866,v1:172.21.15.188:6817/135312866]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2020-07-16T13:33:24.127 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:23 smithi188 bash[23329]: audit 2020-07-16T13:33:22.974391+0000 mon.a (mon.0) 452 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2020-07-16T13:33:24.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:23 smithi132 bash[23299]: audit 2020-07-16T13:33:22.973884+0000 mon.b (mon.2) 16 : audit [INF] from='osd.6 [v2:172.21.15.188:6816/135312866,v1:172.21.15.188:6817/135312866]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2020-07-16T13:33:24.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:23 smithi132 bash[23299]: audit 2020-07-16T13:33:22.974391+0000 mon.a (mon.0) 452 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2020-07-16T13:33:24.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:23 smithi132 bash[27079]: audit 2020-07-16T13:33:22.973884+0000 mon.b (mon.2) 16 : audit [INF] from='osd.6 [v2:172.21.15.188:6816/135312866,v1:172.21.15.188:6817/135312866]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2020-07-16T13:33:24.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:23 smithi132 bash[27079]: audit 2020-07-16T13:33:22.974391+0000 mon.a (mon.0) 452 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2020-07-16T13:33:24.955 INFO:journalctl@ceph.osd.6.smithi188.stdout:Jul 16 13:33:24 smithi188 bash[29338]: debug 2020-07-16T13:33:24.943+0000 7f239a56f700 -1 osd.6 0 waiting for initial osdmap 2020-07-16T13:33:24.955 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:24 smithi188 bash[23329]: cluster 2020-07-16T13:33:23.722266+0000 mgr.y (mgr.14140) 126 : cluster [DBG] pgmap v129: 1 pgs: 1 active+clean; 0 B data, 2.3 MiB used, 530 GiB / 536 GiB avail 2020-07-16T13:33:24.955 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:24 smithi188 bash[23329]: audit 2020-07-16T13:33:23.933532+0000 mon.a (mon.0) 453 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2020-07-16T13:33:24.956 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:24 smithi188 bash[23329]: cluster 2020-07-16T13:33:23.933603+0000 mon.a (mon.0) 454 : cluster [DBG] osdmap e43: 7 total, 6 up, 6 in 2020-07-16T13:33:24.956 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:24 smithi188 bash[23329]: audit 2020-07-16T13:33:23.934003+0000 mon.a (mon.0) 455 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2020-07-16T13:33:24.956 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:24 smithi188 bash[23329]: audit 2020-07-16T13:33:23.936835+0000 mon.b (mon.2) 17 : audit [INF] from='osd.6 [v2:172.21.15.188:6816/135312866,v1:172.21.15.188:6817/135312866]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2020-07-16T13:33:24.956 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:24 smithi188 bash[23329]: audit 2020-07-16T13:33:23.937201+0000 mon.a (mon.0) 456 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2020-07-16T13:33:25.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:24 smithi132 bash[23299]: cluster 2020-07-16T13:33:23.722266+0000 mgr.y (mgr.14140) 126 : cluster [DBG] pgmap v129: 1 pgs: 1 active+clean; 0 B data, 2.3 MiB used, 530 GiB / 536 GiB avail 2020-07-16T13:33:25.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:24 smithi132 bash[23299]: audit 2020-07-16T13:33:23.933532+0000 mon.a (mon.0) 453 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2020-07-16T13:33:25.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:24 smithi132 bash[23299]: cluster 2020-07-16T13:33:23.933603+0000 mon.a (mon.0) 454 : cluster [DBG] osdmap e43: 7 total, 6 up, 6 in 2020-07-16T13:33:25.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:24 smithi132 bash[23299]: audit 2020-07-16T13:33:23.934003+0000 mon.a (mon.0) 455 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2020-07-16T13:33:25.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:24 smithi132 bash[23299]: audit 2020-07-16T13:33:23.936835+0000 mon.b (mon.2) 17 : audit [INF] from='osd.6 [v2:172.21.15.188:6816/135312866,v1:172.21.15.188:6817/135312866]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2020-07-16T13:33:25.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:24 smithi132 bash[23299]: audit 2020-07-16T13:33:23.937201+0000 mon.a (mon.0) 456 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2020-07-16T13:33:25.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:24 smithi132 bash[27079]: cluster 2020-07-16T13:33:23.722266+0000 mgr.y (mgr.14140) 126 : cluster [DBG] pgmap v129: 1 pgs: 1 active+clean; 0 B data, 2.3 MiB used, 530 GiB / 536 GiB avail 2020-07-16T13:33:25.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:24 smithi132 bash[27079]: audit 2020-07-16T13:33:23.933532+0000 mon.a (mon.0) 453 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2020-07-16T13:33:25.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:24 smithi132 bash[27079]: cluster 2020-07-16T13:33:23.933603+0000 mon.a (mon.0) 454 : cluster [DBG] osdmap e43: 7 total, 6 up, 6 in 2020-07-16T13:33:25.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:24 smithi132 bash[27079]: audit 2020-07-16T13:33:23.934003+0000 mon.a (mon.0) 455 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2020-07-16T13:33:25.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:24 smithi132 bash[27079]: audit 2020-07-16T13:33:23.936835+0000 mon.b (mon.2) 17 : audit [INF] from='osd.6 [v2:172.21.15.188:6816/135312866,v1:172.21.15.188:6817/135312866]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2020-07-16T13:33:25.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:24 smithi132 bash[27079]: audit 2020-07-16T13:33:23.937201+0000 mon.a (mon.0) 456 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2020-07-16T13:33:26.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:25 smithi188 bash[23329]: cluster 2020-07-16T13:33:24.013031+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2020-07-16T13:33:26.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:25 smithi188 bash[23329]: cluster 2020-07-16T13:33:24.013072+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2020-07-16T13:33:26.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:25 smithi188 bash[23329]: audit 2020-07-16T13:33:24.934702+0000 mon.a (mon.0) 457 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]': finished 2020-07-16T13:33:26.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:25 smithi188 bash[23329]: cluster 2020-07-16T13:33:24.934763+0000 mon.a (mon.0) 458 : cluster [DBG] osdmap e44: 7 total, 6 up, 6 in 2020-07-16T13:33:26.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:25 smithi188 bash[23329]: audit 2020-07-16T13:33:24.935461+0000 mon.a (mon.0) 459 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2020-07-16T13:33:26.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:25 smithi188 bash[23329]: audit 2020-07-16T13:33:25.584544+0000 mon.a (mon.0) 460 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:33:26.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:25 smithi188 bash[23329]: audit 2020-07-16T13:33:25.774988+0000 mon.a (mon.0) 461 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.145935\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146028\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146063\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146110\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146143\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}}, \"last_daemon_update\": \"2020-07-16T13:33:22.146231\", \"last_device_update\": \"2020-07-16T13:33:25.774351\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:33:26.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:25 smithi188 bash[23329]: audit 2020-07-16T13:33:25.779117+0000 mon.a (mon.0) 462 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.145935\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146028\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146063\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146110\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146143\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}}, \"last_daemon_update\": \"2020-07-16T13:33:22.146231\", \"last_device_update\": \"2020-07-16T13:33:25.774351\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:33:26.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:25 smithi188 bash[23329]: cluster 2020-07-16T13:33:25.935533+0000 mon.a (mon.0) 463 : cluster [INF] osd.6 [v2:172.21.15.188:6816/135312866,v1:172.21.15.188:6817/135312866] boot 2020-07-16T13:33:26.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:25 smithi188 bash[23329]: cluster 2020-07-16T13:33:25.935580+0000 mon.a (mon.0) 464 : cluster [DBG] osdmap e45: 7 total, 7 up, 7 in 2020-07-16T13:33:26.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:25 smithi188 bash[23329]: audit 2020-07-16T13:33:25.936329+0000 mon.a (mon.0) 465 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2020-07-16T13:33:26.283 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:25 smithi132 bash[23299]: cluster 2020-07-16T13:33:24.013031+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2020-07-16T13:33:26.283 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:25 smithi132 bash[23299]: cluster 2020-07-16T13:33:24.013072+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2020-07-16T13:33:26.283 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:25 smithi132 bash[23299]: audit 2020-07-16T13:33:24.934702+0000 mon.a (mon.0) 457 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]': finished 2020-07-16T13:33:26.283 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:25 smithi132 bash[23299]: cluster 2020-07-16T13:33:24.934763+0000 mon.a (mon.0) 458 : cluster [DBG] osdmap e44: 7 total, 6 up, 6 in 2020-07-16T13:33:26.284 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:25 smithi132 bash[23299]: audit 2020-07-16T13:33:24.935461+0000 mon.a (mon.0) 459 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2020-07-16T13:33:26.284 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:25 smithi132 bash[23299]: audit 2020-07-16T13:33:25.584544+0000 mon.a (mon.0) 460 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:33:26.284 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:25 smithi132 bash[23299]: audit 2020-07-16T13:33:25.774988+0000 mon.a (mon.0) 461 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.145935\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146028\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146063\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146110\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146143\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}}, \"last_daemon_update\": \"2020-07-16T13:33:22.146231\", \"last_device_update\": \"2020-07-16T13:33:25.774351\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:33:26.284 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:25 smithi132 bash[23299]: audit 2020-07-16T13:33:25.779117+0000 mon.a (mon.0) 462 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.145935\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146028\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146063\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146110\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146143\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}}, \"last_daemon_update\": \"2020-07-16T13:33:22.146231\", \"last_device_update\": \"2020-07-16T13:33:25.774351\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:33:26.285 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:25 smithi132 bash[23299]: cluster 2020-07-16T13:33:25.935533+0000 mon.a (mon.0) 463 : cluster [INF] osd.6 [v2:172.21.15.188:6816/135312866,v1:172.21.15.188:6817/135312866] boot 2020-07-16T13:33:26.285 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:25 smithi132 bash[23299]: cluster 2020-07-16T13:33:25.935580+0000 mon.a (mon.0) 464 : cluster [DBG] osdmap e45: 7 total, 7 up, 7 in 2020-07-16T13:33:26.285 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:25 smithi132 bash[23299]: audit 2020-07-16T13:33:25.936329+0000 mon.a (mon.0) 465 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2020-07-16T13:33:26.285 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:25 smithi132 bash[27079]: cluster 2020-07-16T13:33:24.013031+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2020-07-16T13:33:26.286 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:25 smithi132 bash[27079]: cluster 2020-07-16T13:33:24.013072+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2020-07-16T13:33:26.286 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:25 smithi132 bash[27079]: audit 2020-07-16T13:33:24.934702+0000 mon.a (mon.0) 457 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]': finished 2020-07-16T13:33:26.286 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:25 smithi132 bash[27079]: cluster 2020-07-16T13:33:24.934763+0000 mon.a (mon.0) 458 : cluster [DBG] osdmap e44: 7 total, 6 up, 6 in 2020-07-16T13:33:26.286 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:25 smithi132 bash[27079]: audit 2020-07-16T13:33:24.935461+0000 mon.a (mon.0) 459 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2020-07-16T13:33:26.287 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:25 smithi132 bash[27079]: audit 2020-07-16T13:33:25.584544+0000 mon.a (mon.0) 460 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:33:26.287 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:25 smithi132 bash[27079]: audit 2020-07-16T13:33:25.774988+0000 mon.a (mon.0) 461 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.145935\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146028\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146063\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146110\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146143\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}}, \"last_daemon_update\": \"2020-07-16T13:33:22.146231\", \"last_device_update\": \"2020-07-16T13:33:25.774351\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:33:26.287 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:25 smithi132 bash[27079]: audit 2020-07-16T13:33:25.779117+0000 mon.a (mon.0) 462 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.145935\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146028\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146063\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146110\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146143\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}}, \"last_daemon_update\": \"2020-07-16T13:33:22.146231\", \"last_device_update\": \"2020-07-16T13:33:25.774351\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:33:26.287 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:25 smithi132 bash[27079]: cluster 2020-07-16T13:33:25.935533+0000 mon.a (mon.0) 463 : cluster [INF] osd.6 [v2:172.21.15.188:6816/135312866,v1:172.21.15.188:6817/135312866] boot 2020-07-16T13:33:26.288 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:25 smithi132 bash[27079]: cluster 2020-07-16T13:33:25.935580+0000 mon.a (mon.0) 464 : cluster [DBG] osdmap e45: 7 total, 7 up, 7 in 2020-07-16T13:33:26.288 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:25 smithi132 bash[27079]: audit 2020-07-16T13:33:25.936329+0000 mon.a (mon.0) 465 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2020-07-16T13:33:27.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:26 smithi132 bash[27079]: cluster 2020-07-16T13:33:25.722650+0000 mgr.y (mgr.14140) 127 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 2.3 MiB used, 530 GiB / 536 GiB avail 2020-07-16T13:33:27.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:26 smithi132 bash[27079]: audit 2020-07-16T13:33:26.185788+0000 mon.a (mon.0) 466 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-07-16T13:33:27.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:26 smithi132 bash[27079]: audit 2020-07-16T13:33:26.186575+0000 mon.a (mon.0) 467 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:33:27.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:26 smithi132 bash[27079]: audit 2020-07-16T13:33:26.187750+0000 mon.a (mon.0) 468 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:33:27.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:26 smithi132 bash[23299]: cluster 2020-07-16T13:33:25.722650+0000 mgr.y (mgr.14140) 127 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 2.3 MiB used, 530 GiB / 536 GiB avail 2020-07-16T13:33:27.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:26 smithi132 bash[23299]: audit 2020-07-16T13:33:26.185788+0000 mon.a (mon.0) 466 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-07-16T13:33:27.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:26 smithi132 bash[23299]: audit 2020-07-16T13:33:26.186575+0000 mon.a (mon.0) 467 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:33:27.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:26 smithi132 bash[23299]: audit 2020-07-16T13:33:26.187750+0000 mon.a (mon.0) 468 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:33:27.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:26 smithi188 bash[23329]: cluster 2020-07-16T13:33:25.722650+0000 mgr.y (mgr.14140) 127 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 2.3 MiB used, 530 GiB / 536 GiB avail 2020-07-16T13:33:27.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:26 smithi188 bash[23329]: audit 2020-07-16T13:33:26.185788+0000 mon.a (mon.0) 466 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-07-16T13:33:27.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:26 smithi188 bash[23329]: audit 2020-07-16T13:33:26.186575+0000 mon.a (mon.0) 467 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:33:27.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:26 smithi188 bash[23329]: audit 2020-07-16T13:33:26.187750+0000 mon.a (mon.0) 468 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:33:28.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:27 smithi188 bash[23329]: audit 2020-07-16T13:33:26.184691+0000 mgr.y (mgr.14140) 128 : audit [DBG] from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:33:28.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:27 smithi188 bash[23329]: cephadm 2020-07-16T13:33:26.185491+0000 mgr.y (mgr.14140) 129 : cephadm [INF] Applying osd on host smithi188... 2020-07-16T13:33:28.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:27 smithi188 bash[23329]: cluster 2020-07-16T13:33:26.957029+0000 mon.a (mon.0) 469 : cluster [DBG] osdmap e46: 7 total, 7 up, 7 in 2020-07-16T13:33:28.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:27 smithi132 bash[23299]: audit 2020-07-16T13:33:26.184691+0000 mgr.y (mgr.14140) 128 : audit [DBG] from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:33:28.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:27 smithi132 bash[23299]: cephadm 2020-07-16T13:33:26.185491+0000 mgr.y (mgr.14140) 129 : cephadm [INF] Applying osd on host smithi188... 2020-07-16T13:33:28.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:27 smithi132 bash[23299]: cluster 2020-07-16T13:33:26.957029+0000 mon.a (mon.0) 469 : cluster [DBG] osdmap e46: 7 total, 7 up, 7 in 2020-07-16T13:33:28.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:27 smithi132 bash[27079]: audit 2020-07-16T13:33:26.184691+0000 mgr.y (mgr.14140) 128 : audit [DBG] from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:33:28.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:27 smithi132 bash[27079]: cephadm 2020-07-16T13:33:26.185491+0000 mgr.y (mgr.14140) 129 : cephadm [INF] Applying osd on host smithi188... 2020-07-16T13:33:28.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:27 smithi132 bash[27079]: cluster 2020-07-16T13:33:26.957029+0000 mon.a (mon.0) 469 : cluster [DBG] osdmap e46: 7 total, 7 up, 7 in 2020-07-16T13:33:29.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:28 smithi132 bash[27079]: cluster 2020-07-16T13:33:27.723054+0000 mgr.y (mgr.14140) 130 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 2.7 MiB used, 619 GiB / 626 GiB avail 2020-07-16T13:33:29.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:28 smithi132 bash[27079]: audit 2020-07-16T13:33:28.443590+0000 mon.b (mon.2) 18 : audit [INF] from='client.? 172.21.15.188:0/3162790050' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077"}]: dispatch 2020-07-16T13:33:29.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:28 smithi132 bash[27079]: audit 2020-07-16T13:33:28.444143+0000 mon.a (mon.0) 470 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077"}]: dispatch 2020-07-16T13:33:29.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:28 smithi132 bash[27079]: audit 2020-07-16T13:33:28.449008+0000 mon.a (mon.0) 471 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077"}]': finished 2020-07-16T13:33:29.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:28 smithi132 bash[27079]: cluster 2020-07-16T13:33:28.449060+0000 mon.a (mon.0) 472 : cluster [DBG] osdmap e47: 8 total, 7 up, 7 in 2020-07-16T13:33:29.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:28 smithi132 bash[27079]: audit 2020-07-16T13:33:28.449194+0000 mon.a (mon.0) 473 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2020-07-16T13:33:29.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:28 smithi132 bash[23299]: cluster 2020-07-16T13:33:27.723054+0000 mgr.y (mgr.14140) 130 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 2.7 MiB used, 619 GiB / 626 GiB avail 2020-07-16T13:33:29.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:28 smithi132 bash[23299]: audit 2020-07-16T13:33:28.443590+0000 mon.b (mon.2) 18 : audit [INF] from='client.? 172.21.15.188:0/3162790050' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077"}]: dispatch 2020-07-16T13:33:29.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:28 smithi132 bash[23299]: audit 2020-07-16T13:33:28.444143+0000 mon.a (mon.0) 470 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077"}]: dispatch 2020-07-16T13:33:29.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:28 smithi132 bash[23299]: audit 2020-07-16T13:33:28.449008+0000 mon.a (mon.0) 471 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077"}]': finished 2020-07-16T13:33:29.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:28 smithi132 bash[23299]: cluster 2020-07-16T13:33:28.449060+0000 mon.a (mon.0) 472 : cluster [DBG] osdmap e47: 8 total, 7 up, 7 in 2020-07-16T13:33:29.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:28 smithi132 bash[23299]: audit 2020-07-16T13:33:28.449194+0000 mon.a (mon.0) 473 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2020-07-16T13:33:29.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:28 smithi188 bash[23329]: cluster 2020-07-16T13:33:27.723054+0000 mgr.y (mgr.14140) 130 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 2.7 MiB used, 619 GiB / 626 GiB avail 2020-07-16T13:33:29.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:28 smithi188 bash[23329]: audit 2020-07-16T13:33:28.443590+0000 mon.b (mon.2) 18 : audit [INF] from='client.? 172.21.15.188:0/3162790050' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077"}]: dispatch 2020-07-16T13:33:29.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:28 smithi188 bash[23329]: audit 2020-07-16T13:33:28.444143+0000 mon.a (mon.0) 470 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077"}]: dispatch 2020-07-16T13:33:29.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:28 smithi188 bash[23329]: audit 2020-07-16T13:33:28.449008+0000 mon.a (mon.0) 471 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077"}]': finished 2020-07-16T13:33:29.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:28 smithi188 bash[23329]: cluster 2020-07-16T13:33:28.449060+0000 mon.a (mon.0) 472 : cluster [DBG] osdmap e47: 8 total, 7 up, 7 in 2020-07-16T13:33:29.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:28 smithi188 bash[23329]: audit 2020-07-16T13:33:28.449194+0000 mon.a (mon.0) 473 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2020-07-16T13:33:30.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:30 smithi188 bash[23329]: cluster 2020-07-16T13:33:29.723579+0000 mgr.y (mgr.14140) 131 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 2.9 MiB used, 619 GiB / 626 GiB avail 2020-07-16T13:33:30.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:30 smithi188 bash[23329]: audit 2020-07-16T13:33:30.271433+0000 mon.b (mon.2) 19 : audit [DBG] from='client.? 172.21.15.188:0/3022348844' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-07-16T13:33:31.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:30 smithi132 bash[23299]: cluster 2020-07-16T13:33:29.723579+0000 mgr.y (mgr.14140) 131 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 2.9 MiB used, 619 GiB / 626 GiB avail 2020-07-16T13:33:31.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:30 smithi132 bash[23299]: audit 2020-07-16T13:33:30.271433+0000 mon.b (mon.2) 19 : audit [DBG] from='client.? 172.21.15.188:0/3022348844' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-07-16T13:33:31.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:30 smithi132 bash[27079]: cluster 2020-07-16T13:33:29.723579+0000 mgr.y (mgr.14140) 131 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 2.9 MiB used, 619 GiB / 626 GiB avail 2020-07-16T13:33:31.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:30 smithi132 bash[27079]: audit 2020-07-16T13:33:30.271433+0000 mon.b (mon.2) 19 : audit [DBG] from='client.? 172.21.15.188:0/3022348844' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-07-16T13:33:32.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:32 smithi188 bash[23329]: cluster 2020-07-16T13:33:31.724076+0000 mgr.y (mgr.14140) 132 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 3.0 MiB used, 619 GiB / 626 GiB avail 2020-07-16T13:33:32.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:32 smithi188 bash[23329]: audit 2020-07-16T13:33:32.676614+0000 mon.a (mon.0) 474 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:33:33.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:32 smithi132 bash[23299]: cluster 2020-07-16T13:33:31.724076+0000 mgr.y (mgr.14140) 132 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 3.0 MiB used, 619 GiB / 626 GiB avail 2020-07-16T13:33:33.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:32 smithi132 bash[23299]: audit 2020-07-16T13:33:32.676614+0000 mon.a (mon.0) 474 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:33:33.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:32 smithi132 bash[27079]: cluster 2020-07-16T13:33:31.724076+0000 mgr.y (mgr.14140) 132 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 3.0 MiB used, 619 GiB / 626 GiB avail 2020-07-16T13:33:33.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:32 smithi132 bash[27079]: audit 2020-07-16T13:33:32.676614+0000 mon.a (mon.0) 474 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:33:34.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:34 smithi188 bash[23329]: cluster 2020-07-16T13:33:33.724546+0000 mgr.y (mgr.14140) 133 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 0 B data, 3.1 MiB used, 619 GiB / 626 GiB avail 2020-07-16T13:33:35.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:34 smithi132 bash[23299]: cluster 2020-07-16T13:33:33.724546+0000 mgr.y (mgr.14140) 133 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 0 B data, 3.1 MiB used, 619 GiB / 626 GiB avail 2020-07-16T13:33:35.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:34 smithi132 bash[27079]: cluster 2020-07-16T13:33:33.724546+0000 mgr.y (mgr.14140) 133 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 0 B data, 3.1 MiB used, 619 GiB / 626 GiB avail 2020-07-16T13:33:35.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:35 smithi188 bash[23329]: audit 2020-07-16T13:33:35.192344+0000 mon.a (mon.0) 475 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2020-07-16T13:33:35.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:35 smithi188 bash[23329]: audit 2020-07-16T13:33:35.193126+0000 mon.a (mon.0) 476 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:33:35.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:35 smithi188 bash[23329]: audit 2020-07-16T13:33:35.193897+0000 mon.a (mon.0) 477 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.7", "key": "container_image"}]: dispatch 2020-07-16T13:33:36.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:35 smithi132 bash[23299]: audit 2020-07-16T13:33:35.192344+0000 mon.a (mon.0) 475 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2020-07-16T13:33:36.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:35 smithi132 bash[23299]: audit 2020-07-16T13:33:35.193126+0000 mon.a (mon.0) 476 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:33:36.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:35 smithi132 bash[23299]: audit 2020-07-16T13:33:35.193897+0000 mon.a (mon.0) 477 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.7", "key": "container_image"}]: dispatch 2020-07-16T13:33:36.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:35 smithi132 bash[27079]: audit 2020-07-16T13:33:35.192344+0000 mon.a (mon.0) 475 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2020-07-16T13:33:36.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:35 smithi132 bash[27079]: audit 2020-07-16T13:33:35.193126+0000 mon.a (mon.0) 476 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:33:36.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:35 smithi132 bash[27079]: audit 2020-07-16T13:33:35.193897+0000 mon.a (mon.0) 477 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.7", "key": "container_image"}]: dispatch 2020-07-16T13:33:36.677 INFO:teuthology.orchestra.run.smithi188.stdout:Created osd(s) 7 on host 'smithi188' 2020-07-16T13:33:36.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:36 smithi188 bash[23329]: cephadm 2020-07-16T13:33:35.193654+0000 mgr.y (mgr.14140) 134 : cephadm [INF] Deploying daemon osd.7 on smithi188 2020-07-16T13:33:36.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:36 smithi188 bash[23329]: cluster 2020-07-16T13:33:35.724936+0000 mgr.y (mgr.14140) 135 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 0 B data, 3.1 MiB used, 619 GiB / 626 GiB avail 2020-07-16T13:33:36.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:36 smithi188 bash[23329]: audit 2020-07-16T13:33:36.670092+0000 mon.a (mon.0) 478 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.145935\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146028\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146063\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146110\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146143\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}}, \"last_device_update\": \"2020-07-16T13:33:25.774351\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:33:36.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:36 smithi188 bash[23329]: audit 2020-07-16T13:33:36.670591+0000 mon.a (mon.0) 479 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:33:36.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:36 smithi188 bash[23329]: audit 2020-07-16T13:33:36.673781+0000 mon.a (mon.0) 480 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.145935\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146028\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146063\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146110\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146143\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}}, \"last_device_update\": \"2020-07-16T13:33:25.774351\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:33:37.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:36 smithi132 bash[23299]: cephadm 2020-07-16T13:33:35.193654+0000 mgr.y (mgr.14140) 134 : cephadm [INF] Deploying daemon osd.7 on smithi188 2020-07-16T13:33:37.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:36 smithi132 bash[23299]: cluster 2020-07-16T13:33:35.724936+0000 mgr.y (mgr.14140) 135 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 0 B data, 3.1 MiB used, 619 GiB / 626 GiB avail 2020-07-16T13:33:37.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:36 smithi132 bash[23299]: audit 2020-07-16T13:33:36.670092+0000 mon.a (mon.0) 478 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.145935\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146028\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146063\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146110\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146143\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}}, \"last_device_update\": \"2020-07-16T13:33:25.774351\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:33:37.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:36 smithi132 bash[23299]: audit 2020-07-16T13:33:36.670591+0000 mon.a (mon.0) 479 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:33:37.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:36 smithi132 bash[23299]: audit 2020-07-16T13:33:36.673781+0000 mon.a (mon.0) 480 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.145935\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146028\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146063\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146110\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146143\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}}, \"last_device_update\": \"2020-07-16T13:33:25.774351\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:33:37.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:36 smithi132 bash[27079]: cephadm 2020-07-16T13:33:35.193654+0000 mgr.y (mgr.14140) 134 : cephadm [INF] Deploying daemon osd.7 on smithi188 2020-07-16T13:33:37.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:36 smithi132 bash[27079]: cluster 2020-07-16T13:33:35.724936+0000 mgr.y (mgr.14140) 135 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 0 B data, 3.1 MiB used, 619 GiB / 626 GiB avail 2020-07-16T13:33:37.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:36 smithi132 bash[27079]: audit 2020-07-16T13:33:36.670092+0000 mon.a (mon.0) 478 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.145935\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146028\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146063\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146110\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146143\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}}, \"last_device_update\": \"2020-07-16T13:33:25.774351\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:33:37.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:36 smithi132 bash[27079]: audit 2020-07-16T13:33:36.670591+0000 mon.a (mon.0) 479 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:33:37.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:36 smithi132 bash[27079]: audit 2020-07-16T13:33:36.673781+0000 mon.a (mon.0) 480 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.145935\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146028\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146063\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146110\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:22.146143\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}}, \"last_device_update\": \"2020-07-16T13:33:25.774351\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:33:37.383 INFO:teuthology.orchestra.run.smithi188:osd.7> sudo journalctl -f -n 0 -u ceph-4c8ed362-c768-11ea-a06f-001a4aab830c@osd.7.service 2020-07-16T13:33:37.386 INFO:tasks.cephadm:Adding prometheus.a on smithi188 2020-07-16T13:33:37.387 INFO:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4c8ed362-c768-11ea-a06f-001a4aab830c -- ceph orch apply prometheus '1;smithi188=a' 2020-07-16T13:33:37.421 INFO:journalctl@ceph.osd.7.smithi188.stdout:-- Logs begin at Thu 2020-07-16 13:22:28 UTC. -- 2020-07-16T13:33:37.654 INFO:journalctl@ceph.osd.7.smithi188.stdout:Jul 16 13:33:37 smithi188 podman[30992]: 2020-07-16 13:33:37.461058713 +0000 UTC m=+0.805388836 container start 6566d1060d4a0155502de7911edd31981b0b5dcb3f22a0b7a1c083ddff6ea624 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.7-activate) 2020-07-16T13:33:37.655 INFO:journalctl@ceph.osd.7.smithi188.stdout:Jul 16 13:33:37 smithi188 podman[30992]: 2020-07-16 13:33:37.461220045 +0000 UTC m=+0.805550164 container attach 6566d1060d4a0155502de7911edd31981b0b5dcb3f22a0b7a1c083ddff6ea624 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.7-activate) 2020-07-16T13:33:37.921 INFO:journalctl@ceph.osd.7.smithi188.stdout:Jul 16 13:33:37 smithi188 bash[30990]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2020-07-16T13:33:37.921 INFO:journalctl@ceph.osd.7.smithi188.stdout:Jul 16 13:33:37 smithi188 bash[30990]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-7 --no-mon-config 2020-07-16T13:33:37.921 INFO:journalctl@ceph.osd.7.smithi188.stdout:Jul 16 13:33:37 smithi188 bash[30990]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-7/block 2020-07-16T13:33:37.921 INFO:journalctl@ceph.osd.7.smithi188.stdout:Jul 16 13:33:37 smithi188 bash[30990]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-7/block 2020-07-16T13:33:37.922 INFO:journalctl@ceph.osd.7.smithi188.stdout:Jul 16 13:33:37 smithi188 bash[30990]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2020-07-16T13:33:37.922 INFO:journalctl@ceph.osd.7.smithi188.stdout:Jul 16 13:33:37 smithi188 bash[30990]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2020-07-16T13:33:37.922 INFO:journalctl@ceph.osd.7.smithi188.stdout:Jul 16 13:33:37 smithi188 bash[30990]: --> ceph-volume lvm activate successful for osd ID: 7 2020-07-16T13:33:37.922 INFO:journalctl@ceph.osd.7.smithi188.stdout:Jul 16 13:33:37 smithi188 podman[30992]: 2020-07-16 13:33:37.741759086 +0000 UTC m=+1.086089175 container died 6566d1060d4a0155502de7911edd31981b0b5dcb3f22a0b7a1c083ddff6ea624 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.7-activate) 2020-07-16T13:33:38.621 INFO:journalctl@ceph.osd.7.smithi188.stdout:Jul 16 13:33:38 smithi188 podman[30992]: 2020-07-16 13:33:38.369475002 +0000 UTC m=+1.713805104 container remove 6566d1060d4a0155502de7911edd31981b0b5dcb3f22a0b7a1c083ddff6ea624 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.7-activate) 2020-07-16T13:33:38.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:38 smithi188 bash[23329]: cluster 2020-07-16T13:33:37.725413+0000 mgr.y (mgr.14140) 136 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 3.1 MiB used, 619 GiB / 626 GiB avail 2020-07-16T13:33:38.922 INFO:journalctl@ceph.osd.7.smithi188.stdout:Jul 16 13:33:38 smithi188 podman[31289]: 2020-07-16 13:33:38.710768986 +0000 UTC m=+0.323909978 container create 5a270dcc2599a43349da2f4f18bd2cf36a9d89f9f402d98b3114ce28f64b02b5 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.7) 2020-07-16T13:33:39.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:38 smithi132 bash[23299]: cluster 2020-07-16T13:33:37.725413+0000 mgr.y (mgr.14140) 136 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 3.1 MiB used, 619 GiB / 626 GiB avail 2020-07-16T13:33:39.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:38 smithi132 bash[27079]: cluster 2020-07-16T13:33:37.725413+0000 mgr.y (mgr.14140) 136 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 3.1 MiB used, 619 GiB / 626 GiB avail 2020-07-16T13:33:39.390 INFO:journalctl@ceph.osd.7.smithi188.stdout:Jul 16 13:33:39 smithi188 podman[31289]: 2020-07-16 13:33:39.09372555 +0000 UTC m=+0.706866632 container init 5a270dcc2599a43349da2f4f18bd2cf36a9d89f9f402d98b3114ce28f64b02b5 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.7) 2020-07-16T13:33:39.391 INFO:journalctl@ceph.osd.7.smithi188.stdout:Jul 16 13:33:39 smithi188 podman[31289]: 2020-07-16 13:33:39.173841836 +0000 UTC m=+0.786982832 container start 5a270dcc2599a43349da2f4f18bd2cf36a9d89f9f402d98b3114ce28f64b02b5 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.7) 2020-07-16T13:33:39.391 INFO:journalctl@ceph.osd.7.smithi188.stdout:Jul 16 13:33:39 smithi188 podman[31289]: 2020-07-16 13:33:39.174039091 +0000 UTC m=+0.787180112 container attach 5a270dcc2599a43349da2f4f18bd2cf36a9d89f9f402d98b3114ce28f64b02b5 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-osd.7) 2020-07-16T13:33:39.661 INFO:journalctl@ceph.osd.7.smithi188.stdout:Jul 16 13:33:39 smithi188 bash[30990]: debug 2020-07-16T13:33:39.387+0000 7f1e2ae99ec0 -1 Falling back to public interface 2020-07-16T13:33:39.900 INFO:teuthology.orchestra.run.smithi188.stdout:Scheduled prometheus update... 2020-07-16T13:33:39.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:39 smithi188 bash[23329]: audit 2020-07-16T13:33:39.478693+0000 mon.a (mon.0) 481 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477621\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477715\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477749\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477780\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477810\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477840\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}}, \"last_daemon_update\": \"2020-07-16T13:33:39.477926\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:33:39.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:39 smithi188 bash[23329]: audit 2020-07-16T13:33:39.481949+0000 mon.a (mon.0) 482 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477621\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477715\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477749\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477780\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477810\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477840\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}}, \"last_daemon_update\": \"2020-07-16T13:33:39.477926\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:33:39.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:39 smithi188 bash[23329]: audit 2020-07-16T13:33:39.482666+0000 mon.a (mon.0) 483 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:33:40.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:39 smithi132 bash[23299]: audit 2020-07-16T13:33:39.478693+0000 mon.a (mon.0) 481 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477621\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477715\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477749\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477780\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477810\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477840\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}}, \"last_daemon_update\": \"2020-07-16T13:33:39.477926\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:33:40.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:39 smithi132 bash[23299]: audit 2020-07-16T13:33:39.481949+0000 mon.a (mon.0) 482 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477621\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477715\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477749\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477780\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477810\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477840\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}}, \"last_daemon_update\": \"2020-07-16T13:33:39.477926\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:33:40.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:39 smithi132 bash[23299]: audit 2020-07-16T13:33:39.482666+0000 mon.a (mon.0) 483 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:33:40.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:39 smithi132 bash[27079]: audit 2020-07-16T13:33:39.478693+0000 mon.a (mon.0) 481 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477621\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477715\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477749\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477780\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477810\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477840\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}}, \"last_daemon_update\": \"2020-07-16T13:33:39.477926\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:33:40.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:39 smithi132 bash[27079]: audit 2020-07-16T13:33:39.481949+0000 mon.a (mon.0) 482 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477621\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477715\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477749\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477780\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477810\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477840\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}}, \"last_daemon_update\": \"2020-07-16T13:33:39.477926\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:33:40.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:39 smithi132 bash[27079]: audit 2020-07-16T13:33:39.482666+0000 mon.a (mon.0) 483 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T13:33:40.420 INFO:journalctl@ceph.osd.7.smithi188.stdout:Jul 16 13:33:39 smithi188 bash[30990]: debug 2020-07-16T13:33:39.948+0000 7f1e2ae99ec0 -1 osd.7 0 log_to_monitors {default=true} 2020-07-16T13:33:40.802 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:40 smithi188 bash[23329]: cluster 2020-07-16T13:33:39.725836+0000 mgr.y (mgr.14140) 137 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 0 B data, 3.1 MiB used, 619 GiB / 626 GiB avail 2020-07-16T13:33:40.802 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:40 smithi188 bash[23329]: audit 2020-07-16T13:33:39.894164+0000 mgr.y (mgr.14140) 138 : audit [DBG] from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi188=a", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:33:40.802 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:40 smithi188 bash[23329]: cephadm 2020-07-16T13:33:39.894678+0000 mgr.y (mgr.14140) 139 : cephadm [INF] Saving service prometheus spec with placement count:1 smithi188=a 2020-07-16T13:33:40.802 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:40 smithi188 bash[23329]: audit 2020-07-16T13:33:39.895062+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2020-07-16T13:33:39.894690\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi188\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]: dispatch 2020-07-16T13:33:40.803 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:40 smithi188 bash[23329]: audit 2020-07-16T13:33:39.898237+0000 mon.a (mon.0) 485 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2020-07-16T13:33:39.894690\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi188\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]': finished 2020-07-16T13:33:40.803 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:40 smithi188 bash[23329]: audit 2020-07-16T13:33:39.952740+0000 mon.b (mon.2) 20 : audit [INF] from='osd.7 [v2:172.21.15.188:6824/21822620,v1:172.21.15.188:6825/21822620]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2020-07-16T13:33:40.803 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:40 smithi188 bash[23329]: audit 2020-07-16T13:33:39.953138+0000 mon.a (mon.0) 486 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2020-07-16T13:33:40.814 INFO:teuthology.orchestra.run.smithi188:prometheus.a> sudo journalctl -f -n 0 -u ceph-4c8ed362-c768-11ea-a06f-001a4aab830c@prometheus.a.service 2020-07-16T13:33:40.817 INFO:tasks.cephadm:Adding node-exporter.a on smithi132 2020-07-16T13:33:40.818 INFO:tasks.cephadm:Adding node-exporter.b on smithi188 2020-07-16T13:33:40.818 INFO:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4c8ed362-c768-11ea-a06f-001a4aab830c -- ceph orch apply node-exporter '2;smithi132=a;smithi188=b' 2020-07-16T13:33:40.847 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:-- Logs begin at Thu 2020-07-16 13:22:28 UTC. -- 2020-07-16T13:33:41.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:40 smithi188 bash[23329]: audit 2020-07-16T13:33:40.726509+0000 mon.a (mon.0) 487 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"5e2adad3-9b83-4d34-a30d-85ad0922bece\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1594906388.872921, \"finished_at\": 1594906399.4932332}, {\"id\": \"ace15482-fa04-4a36-9283-4d6b57c4092c\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1594906405.9352872, \"finished_at\": 1594906416.6814024}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2020-07-16T13:33:41.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:40 smithi188 bash[23329]: audit 2020-07-16T13:33:40.729221+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"5e2adad3-9b83-4d34-a30d-85ad0922bece\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1594906388.872921, \"finished_at\": 1594906399.4932332}, {\"id\": \"ace15482-fa04-4a36-9283-4d6b57c4092c\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1594906405.9352872, \"finished_at\": 1594906416.6814024}], \"version\": 2, \"compat_version\": 2}"}]': finished 2020-07-16T13:33:41.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:40 smithi132 bash[23299]: cluster 2020-07-16T13:33:39.725836+0000 mgr.y (mgr.14140) 137 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 0 B data, 3.1 MiB used, 619 GiB / 626 GiB avail 2020-07-16T13:33:41.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:40 smithi132 bash[23299]: audit 2020-07-16T13:33:39.894164+0000 mgr.y (mgr.14140) 138 : audit [DBG] from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi188=a", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:33:41.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:40 smithi132 bash[23299]: cephadm 2020-07-16T13:33:39.894678+0000 mgr.y (mgr.14140) 139 : cephadm [INF] Saving service prometheus spec with placement count:1 smithi188=a 2020-07-16T13:33:41.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:40 smithi132 bash[23299]: audit 2020-07-16T13:33:39.895062+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2020-07-16T13:33:39.894690\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi188\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]: dispatch 2020-07-16T13:33:41.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:40 smithi132 bash[23299]: audit 2020-07-16T13:33:39.898237+0000 mon.a (mon.0) 485 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2020-07-16T13:33:39.894690\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi188\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]': finished 2020-07-16T13:33:41.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:40 smithi132 bash[23299]: audit 2020-07-16T13:33:39.952740+0000 mon.b (mon.2) 20 : audit [INF] from='osd.7 [v2:172.21.15.188:6824/21822620,v1:172.21.15.188:6825/21822620]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2020-07-16T13:33:41.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:40 smithi132 bash[23299]: audit 2020-07-16T13:33:39.953138+0000 mon.a (mon.0) 486 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2020-07-16T13:33:41.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:40 smithi132 bash[23299]: audit 2020-07-16T13:33:40.726509+0000 mon.a (mon.0) 487 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"5e2adad3-9b83-4d34-a30d-85ad0922bece\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1594906388.872921, \"finished_at\": 1594906399.4932332}, {\"id\": \"ace15482-fa04-4a36-9283-4d6b57c4092c\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1594906405.9352872, \"finished_at\": 1594906416.6814024}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2020-07-16T13:33:41.282 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:40 smithi132 bash[23299]: audit 2020-07-16T13:33:40.729221+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"5e2adad3-9b83-4d34-a30d-85ad0922bece\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1594906388.872921, \"finished_at\": 1594906399.4932332}, {\"id\": \"ace15482-fa04-4a36-9283-4d6b57c4092c\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1594906405.9352872, \"finished_at\": 1594906416.6814024}], \"version\": 2, \"compat_version\": 2}"}]': finished 2020-07-16T13:33:41.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:40 smithi132 bash[27079]: cluster 2020-07-16T13:33:39.725836+0000 mgr.y (mgr.14140) 137 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 0 B data, 3.1 MiB used, 619 GiB / 626 GiB avail 2020-07-16T13:33:41.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:40 smithi132 bash[27079]: audit 2020-07-16T13:33:39.894164+0000 mgr.y (mgr.14140) 138 : audit [DBG] from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi188=a", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:33:41.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:40 smithi132 bash[27079]: cephadm 2020-07-16T13:33:39.894678+0000 mgr.y (mgr.14140) 139 : cephadm [INF] Saving service prometheus spec with placement count:1 smithi188=a 2020-07-16T13:33:41.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:40 smithi132 bash[27079]: audit 2020-07-16T13:33:39.895062+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2020-07-16T13:33:39.894690\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi188\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]: dispatch 2020-07-16T13:33:41.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:40 smithi132 bash[27079]: audit 2020-07-16T13:33:39.898237+0000 mon.a (mon.0) 485 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2020-07-16T13:33:39.894690\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi188\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]': finished 2020-07-16T13:33:41.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:40 smithi132 bash[27079]: audit 2020-07-16T13:33:39.952740+0000 mon.b (mon.2) 20 : audit [INF] from='osd.7 [v2:172.21.15.188:6824/21822620,v1:172.21.15.188:6825/21822620]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2020-07-16T13:33:41.284 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:40 smithi132 bash[27079]: audit 2020-07-16T13:33:39.953138+0000 mon.a (mon.0) 486 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2020-07-16T13:33:41.284 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:40 smithi132 bash[27079]: audit 2020-07-16T13:33:40.726509+0000 mon.a (mon.0) 487 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"5e2adad3-9b83-4d34-a30d-85ad0922bece\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1594906388.872921, \"finished_at\": 1594906399.4932332}, {\"id\": \"ace15482-fa04-4a36-9283-4d6b57c4092c\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1594906405.9352872, \"finished_at\": 1594906416.6814024}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2020-07-16T13:33:41.284 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:40 smithi132 bash[27079]: audit 2020-07-16T13:33:40.729221+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"5e2adad3-9b83-4d34-a30d-85ad0922bece\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1594906388.872921, \"finished_at\": 1594906399.4932332}, {\"id\": \"ace15482-fa04-4a36-9283-4d6b57c4092c\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1594906405.9352872, \"finished_at\": 1594906416.6814024}], \"version\": 2, \"compat_version\": 2}"}]': finished 2020-07-16T13:33:42.171 INFO:journalctl@ceph.osd.7.smithi188.stdout:Jul 16 13:33:41 smithi188 bash[30990]: debug 2020-07-16T13:33:41.904+0000 7f1e13c4e700 -1 osd.7 0 waiting for initial osdmap 2020-07-16T13:33:42.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:41 smithi188 bash[23329]: audit 2020-07-16T13:33:40.900390+0000 mon.a (mon.0) 489 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2020-07-16T13:33:42.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:41 smithi188 bash[23329]: cluster 2020-07-16T13:33:40.900437+0000 mon.a (mon.0) 490 : cluster [DBG] osdmap e48: 8 total, 7 up, 7 in 2020-07-16T13:33:42.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:41 smithi188 bash[23329]: audit 2020-07-16T13:33:40.900586+0000 mon.a (mon.0) 491 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2020-07-16T13:33:42.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:41 smithi188 bash[23329]: audit 2020-07-16T13:33:40.903050+0000 mon.b (mon.2) 21 : audit [INF] from='osd.7 [v2:172.21.15.188:6824/21822620,v1:172.21.15.188:6825/21822620]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2020-07-16T13:33:42.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:41 smithi188 bash[23329]: audit 2020-07-16T13:33:40.903464+0000 mon.a (mon.0) 492 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2020-07-16T13:33:42.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:41 smithi132 bash[23299]: audit 2020-07-16T13:33:40.900390+0000 mon.a (mon.0) 489 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2020-07-16T13:33:42.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:41 smithi132 bash[23299]: cluster 2020-07-16T13:33:40.900437+0000 mon.a (mon.0) 490 : cluster [DBG] osdmap e48: 8 total, 7 up, 7 in 2020-07-16T13:33:42.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:41 smithi132 bash[23299]: audit 2020-07-16T13:33:40.900586+0000 mon.a (mon.0) 491 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2020-07-16T13:33:42.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:41 smithi132 bash[23299]: audit 2020-07-16T13:33:40.903050+0000 mon.b (mon.2) 21 : audit [INF] from='osd.7 [v2:172.21.15.188:6824/21822620,v1:172.21.15.188:6825/21822620]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2020-07-16T13:33:42.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:41 smithi132 bash[23299]: audit 2020-07-16T13:33:40.903464+0000 mon.a (mon.0) 492 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2020-07-16T13:33:42.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:41 smithi132 bash[27079]: audit 2020-07-16T13:33:40.900390+0000 mon.a (mon.0) 489 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2020-07-16T13:33:42.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:41 smithi132 bash[27079]: cluster 2020-07-16T13:33:40.900437+0000 mon.a (mon.0) 490 : cluster [DBG] osdmap e48: 8 total, 7 up, 7 in 2020-07-16T13:33:42.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:41 smithi132 bash[27079]: audit 2020-07-16T13:33:40.900586+0000 mon.a (mon.0) 491 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2020-07-16T13:33:42.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:41 smithi132 bash[27079]: audit 2020-07-16T13:33:40.903050+0000 mon.b (mon.2) 21 : audit [INF] from='osd.7 [v2:172.21.15.188:6824/21822620,v1:172.21.15.188:6825/21822620]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2020-07-16T13:33:42.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:41 smithi132 bash[27079]: audit 2020-07-16T13:33:40.903464+0000 mon.a (mon.0) 492 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2020-07-16T13:33:43.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:42 smithi188 bash[23329]: cluster 2020-07-16T13:33:40.951902+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2020-07-16T13:33:43.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:42 smithi188 bash[23329]: cluster 2020-07-16T13:33:40.951939+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2020-07-16T13:33:43.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:42 smithi188 bash[23329]: cluster 2020-07-16T13:33:41.726304+0000 mgr.y (mgr.14140) 140 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 3.1 MiB used, 619 GiB / 626 GiB avail 2020-07-16T13:33:43.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:42 smithi188 bash[23329]: audit 2020-07-16T13:33:41.902493+0000 mon.a (mon.0) 493 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]': finished 2020-07-16T13:33:43.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:42 smithi188 bash[23329]: cluster 2020-07-16T13:33:41.902546+0000 mon.a (mon.0) 494 : cluster [DBG] osdmap e49: 8 total, 7 up, 7 in 2020-07-16T13:33:43.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:42 smithi188 bash[23329]: audit 2020-07-16T13:33:41.903291+0000 mon.a (mon.0) 495 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2020-07-16T13:33:43.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:42 smithi132 bash[23299]: cluster 2020-07-16T13:33:40.951902+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2020-07-16T13:33:43.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:42 smithi132 bash[23299]: cluster 2020-07-16T13:33:40.951939+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2020-07-16T13:33:43.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:42 smithi132 bash[23299]: cluster 2020-07-16T13:33:41.726304+0000 mgr.y (mgr.14140) 140 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 3.1 MiB used, 619 GiB / 626 GiB avail 2020-07-16T13:33:43.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:42 smithi132 bash[23299]: audit 2020-07-16T13:33:41.902493+0000 mon.a (mon.0) 493 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]': finished 2020-07-16T13:33:43.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:42 smithi132 bash[23299]: cluster 2020-07-16T13:33:41.902546+0000 mon.a (mon.0) 494 : cluster [DBG] osdmap e49: 8 total, 7 up, 7 in 2020-07-16T13:33:43.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:42 smithi132 bash[23299]: audit 2020-07-16T13:33:41.903291+0000 mon.a (mon.0) 495 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2020-07-16T13:33:43.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:42 smithi132 bash[27079]: cluster 2020-07-16T13:33:40.951902+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2020-07-16T13:33:43.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:42 smithi132 bash[27079]: cluster 2020-07-16T13:33:40.951939+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2020-07-16T13:33:43.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:42 smithi132 bash[27079]: cluster 2020-07-16T13:33:41.726304+0000 mgr.y (mgr.14140) 140 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 3.1 MiB used, 619 GiB / 626 GiB avail 2020-07-16T13:33:43.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:42 smithi132 bash[27079]: audit 2020-07-16T13:33:41.902493+0000 mon.a (mon.0) 493 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]': finished 2020-07-16T13:33:43.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:42 smithi132 bash[27079]: cluster 2020-07-16T13:33:41.902546+0000 mon.a (mon.0) 494 : cluster [DBG] osdmap e49: 8 total, 7 up, 7 in 2020-07-16T13:33:43.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:42 smithi132 bash[27079]: audit 2020-07-16T13:33:41.903291+0000 mon.a (mon.0) 495 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2020-07-16T13:33:43.428 INFO:teuthology.orchestra.run.smithi188.stdout:Scheduled node-exporter update... 2020-07-16T13:33:43.898 INFO:teuthology.orchestra.run.smithi132:node-exporter.a> sudo journalctl -f -n 0 -u ceph-4c8ed362-c768-11ea-a06f-001a4aab830c@node-exporter.a.service 2020-07-16T13:33:43.903 INFO:teuthology.orchestra.run.smithi188:node-exporter.b> sudo journalctl -f -n 0 -u ceph-4c8ed362-c768-11ea-a06f-001a4aab830c@node-exporter.b.service 2020-07-16T13:33:43.906 INFO:tasks.cephadm:Adding alertmanager.a on smithi132 2020-07-16T13:33:43.906 INFO:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4c8ed362-c768-11ea-a06f-001a4aab830c -- ceph orch apply alertmanager '1;smithi132=a' 2020-07-16T13:33:43.941 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:-- Logs begin at Thu 2020-07-16 13:22:28 UTC. -- 2020-07-16T13:33:43.942 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:-- Logs begin at Thu 2020-07-16 13:22:27 UTC. -- 2020-07-16T13:33:44.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:43 smithi188 bash[23329]: cluster 2020-07-16T13:33:42.905777+0000 mon.a (mon.0) 496 : cluster [INF] osd.7 [v2:172.21.15.188:6824/21822620,v1:172.21.15.188:6825/21822620] boot 2020-07-16T13:33:44.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:43 smithi188 bash[23329]: cluster 2020-07-16T13:33:42.905817+0000 mon.a (mon.0) 497 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2020-07-16T13:33:44.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:43 smithi188 bash[23329]: audit 2020-07-16T13:33:42.905977+0000 mon.a (mon.0) 498 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2020-07-16T13:33:44.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:43 smithi188 bash[23329]: audit 2020-07-16T13:33:43.335735+0000 mon.a (mon.0) 499 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:33:44.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:43 smithi188 bash[23329]: audit 2020-07-16T13:33:43.423451+0000 mon.a (mon.0) 500 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2020-07-16T13:33:43.423067\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi132\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"smithi188\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]: dispatch 2020-07-16T13:33:44.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:43 smithi188 bash[23329]: audit 2020-07-16T13:33:43.426496+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2020-07-16T13:33:43.423067\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi132\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"smithi188\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]': finished 2020-07-16T13:33:44.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:43 smithi188 bash[23329]: audit 2020-07-16T13:33:43.541009+0000 mon.a (mon.0) 502 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477621\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477715\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477749\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477780\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477810\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477840\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}}, \"last_daemon_update\": \"2020-07-16T13:33:39.477926\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:33:44.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:43 smithi188 bash[23329]: audit 2020-07-16T13:33:43.544735+0000 mon.a (mon.0) 503 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477621\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477715\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477749\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477780\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477810\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477840\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}}, \"last_daemon_update\": \"2020-07-16T13:33:39.477926\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:33:44.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:43 smithi132 bash[23299]: cluster 2020-07-16T13:33:42.905777+0000 mon.a (mon.0) 496 : cluster [INF] osd.7 [v2:172.21.15.188:6824/21822620,v1:172.21.15.188:6825/21822620] boot 2020-07-16T13:33:44.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:43 smithi132 bash[23299]: cluster 2020-07-16T13:33:42.905817+0000 mon.a (mon.0) 497 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2020-07-16T13:33:44.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:43 smithi132 bash[23299]: audit 2020-07-16T13:33:42.905977+0000 mon.a (mon.0) 498 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2020-07-16T13:33:44.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:43 smithi132 bash[23299]: audit 2020-07-16T13:33:43.335735+0000 mon.a (mon.0) 499 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:33:44.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:43 smithi132 bash[23299]: audit 2020-07-16T13:33:43.423451+0000 mon.a (mon.0) 500 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2020-07-16T13:33:43.423067\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi132\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"smithi188\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]: dispatch 2020-07-16T13:33:44.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:43 smithi132 bash[23299]: audit 2020-07-16T13:33:43.426496+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2020-07-16T13:33:43.423067\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi132\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"smithi188\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]': finished 2020-07-16T13:33:44.282 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:43 smithi132 bash[23299]: audit 2020-07-16T13:33:43.541009+0000 mon.a (mon.0) 502 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477621\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477715\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477749\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477780\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477810\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477840\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}}, \"last_daemon_update\": \"2020-07-16T13:33:39.477926\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:33:44.282 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:43 smithi132 bash[23299]: audit 2020-07-16T13:33:43.544735+0000 mon.a (mon.0) 503 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477621\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477715\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477749\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477780\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477810\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477840\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}}, \"last_daemon_update\": \"2020-07-16T13:33:39.477926\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:33:44.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:43 smithi132 bash[27079]: cluster 2020-07-16T13:33:42.905777+0000 mon.a (mon.0) 496 : cluster [INF] osd.7 [v2:172.21.15.188:6824/21822620,v1:172.21.15.188:6825/21822620] boot 2020-07-16T13:33:44.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:43 smithi132 bash[27079]: cluster 2020-07-16T13:33:42.905817+0000 mon.a (mon.0) 497 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2020-07-16T13:33:44.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:43 smithi132 bash[27079]: audit 2020-07-16T13:33:42.905977+0000 mon.a (mon.0) 498 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2020-07-16T13:33:44.284 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:43 smithi132 bash[27079]: audit 2020-07-16T13:33:43.335735+0000 mon.a (mon.0) 499 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:33:44.284 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:43 smithi132 bash[27079]: audit 2020-07-16T13:33:43.423451+0000 mon.a (mon.0) 500 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2020-07-16T13:33:43.423067\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi132\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"smithi188\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]: dispatch 2020-07-16T13:33:44.284 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:43 smithi132 bash[27079]: audit 2020-07-16T13:33:43.426496+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2020-07-16T13:33:43.423067\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi132\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"smithi188\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]': finished 2020-07-16T13:33:44.285 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:43 smithi132 bash[27079]: audit 2020-07-16T13:33:43.541009+0000 mon.a (mon.0) 502 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477621\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477715\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477749\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477780\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477810\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477840\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}}, \"last_daemon_update\": \"2020-07-16T13:33:39.477926\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:33:44.285 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:43 smithi132 bash[27079]: audit 2020-07-16T13:33:43.544735+0000 mon.a (mon.0) 503 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477621\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477715\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477749\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477780\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477810\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477840\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}}, \"last_daemon_update\": \"2020-07-16T13:33:39.477926\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:33:45.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:44 smithi188 bash[23329]: audit 2020-07-16T13:33:43.422498+0000 mgr.y (mgr.14140) 141 : audit [DBG] from='client.34295 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi132=a;smithi188=b", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:33:45.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:44 smithi188 bash[23329]: cephadm 2020-07-16T13:33:43.423054+0000 mgr.y (mgr.14140) 142 : cephadm [INF] Saving service node-exporter spec with placement count:2 smithi132=a,smithi188=b 2020-07-16T13:33:45.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:44 smithi188 bash[23329]: cephadm 2020-07-16T13:33:43.548286+0000 mgr.y (mgr.14140) 143 : cephadm [INF] Deploying daemon prometheus.a on smithi188 2020-07-16T13:33:45.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:44 smithi188 bash[23329]: cluster 2020-07-16T13:33:43.726858+0000 mgr.y (mgr.14140) 144 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:33:45.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:44 smithi188 bash[23329]: cluster 2020-07-16T13:33:43.912821+0000 mon.a (mon.0) 504 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2020-07-16T13:33:45.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:44 smithi132 bash[27079]: audit 2020-07-16T13:33:43.422498+0000 mgr.y (mgr.14140) 141 : audit [DBG] from='client.34295 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi132=a;smithi188=b", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:33:45.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:44 smithi132 bash[27079]: cephadm 2020-07-16T13:33:43.423054+0000 mgr.y (mgr.14140) 142 : cephadm [INF] Saving service node-exporter spec with placement count:2 smithi132=a,smithi188=b 2020-07-16T13:33:45.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:44 smithi132 bash[27079]: cephadm 2020-07-16T13:33:43.548286+0000 mgr.y (mgr.14140) 143 : cephadm [INF] Deploying daemon prometheus.a on smithi188 2020-07-16T13:33:45.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:44 smithi132 bash[27079]: cluster 2020-07-16T13:33:43.726858+0000 mgr.y (mgr.14140) 144 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:33:45.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:44 smithi132 bash[27079]: cluster 2020-07-16T13:33:43.912821+0000 mon.a (mon.0) 504 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2020-07-16T13:33:45.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:44 smithi132 bash[23299]: audit 2020-07-16T13:33:43.422498+0000 mgr.y (mgr.14140) 141 : audit [DBG] from='client.34295 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi132=a;smithi188=b", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:33:45.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:44 smithi132 bash[23299]: cephadm 2020-07-16T13:33:43.423054+0000 mgr.y (mgr.14140) 142 : cephadm [INF] Saving service node-exporter spec with placement count:2 smithi132=a,smithi188=b 2020-07-16T13:33:45.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:44 smithi132 bash[23299]: cephadm 2020-07-16T13:33:43.548286+0000 mgr.y (mgr.14140) 143 : cephadm [INF] Deploying daemon prometheus.a on smithi188 2020-07-16T13:33:45.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:44 smithi132 bash[23299]: cluster 2020-07-16T13:33:43.726858+0000 mgr.y (mgr.14140) 144 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:33:45.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:44 smithi132 bash[23299]: cluster 2020-07-16T13:33:43.912821+0000 mon.a (mon.0) 504 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2020-07-16T13:33:46.207 INFO:teuthology.orchestra.run.smithi188.stdout:Scheduled alertmanager update... 2020-07-16T13:33:47.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:46 smithi132 bash[27079]: cluster 2020-07-16T13:33:45.727243+0000 mgr.y (mgr.14140) 145 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 0 B data, 3.7 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:33:47.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:46 smithi132 bash[27079]: audit 2020-07-16T13:33:46.202134+0000 mon.a (mon.0) 505 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2020-07-16T13:33:46.201732\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi132\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]: dispatch 2020-07-16T13:33:47.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:46 smithi132 bash[27079]: audit 2020-07-16T13:33:46.205016+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2020-07-16T13:33:46.201732\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi132\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]': finished 2020-07-16T13:33:47.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:46 smithi132 bash[23299]: cluster 2020-07-16T13:33:45.727243+0000 mgr.y (mgr.14140) 145 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 0 B data, 3.7 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:33:47.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:46 smithi132 bash[23299]: audit 2020-07-16T13:33:46.202134+0000 mon.a (mon.0) 505 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2020-07-16T13:33:46.201732\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi132\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]: dispatch 2020-07-16T13:33:47.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:46 smithi132 bash[23299]: audit 2020-07-16T13:33:46.205016+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2020-07-16T13:33:46.201732\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi132\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]': finished 2020-07-16T13:33:47.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:46 smithi188 bash[23329]: cluster 2020-07-16T13:33:45.727243+0000 mgr.y (mgr.14140) 145 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 0 B data, 3.7 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:33:47.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:46 smithi188 bash[23329]: audit 2020-07-16T13:33:46.202134+0000 mon.a (mon.0) 505 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2020-07-16T13:33:46.201732\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi132\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]: dispatch 2020-07-16T13:33:47.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:46 smithi188 bash[23329]: audit 2020-07-16T13:33:46.205016+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2020-07-16T13:33:46.201732\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi132\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]': finished 2020-07-16T13:33:47.524 INFO:teuthology.orchestra.run.smithi132:alertmanager.a> sudo journalctl -f -n 0 -u ceph-4c8ed362-c768-11ea-a06f-001a4aab830c@alertmanager.a.service 2020-07-16T13:33:47.527 INFO:tasks.cephadm:Adding grafana.a on smithi188 2020-07-16T13:33:47.527 INFO:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4c8ed362-c768-11ea-a06f-001a4aab830c -- ceph orch apply grafana '1;smithi188=a' 2020-07-16T13:33:47.560 INFO:journalctl@ceph.alertmanager.a.smithi132.stdout:-- Logs begin at Thu 2020-07-16 13:22:27 UTC. -- 2020-07-16T13:33:47.928 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:47 smithi132 bash[23299]: audit 2020-07-16T13:33:46.201129+0000 mgr.y (mgr.14140) 146 : audit [DBG] from='client.34301 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi132=a", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:33:47.928 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:47 smithi132 bash[23299]: cephadm 2020-07-16T13:33:46.201720+0000 mgr.y (mgr.14140) 147 : cephadm [INF] Saving service alertmanager spec with placement count:1 smithi132=a 2020-07-16T13:33:48.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:47 smithi132 bash[27079]: audit 2020-07-16T13:33:46.201129+0000 mgr.y (mgr.14140) 146 : audit [DBG] from='client.34301 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi132=a", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:33:48.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:47 smithi132 bash[27079]: cephadm 2020-07-16T13:33:46.201720+0000 mgr.y (mgr.14140) 147 : cephadm [INF] Saving service alertmanager spec with placement count:1 smithi132=a 2020-07-16T13:33:48.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:47 smithi188 bash[23329]: audit 2020-07-16T13:33:46.201129+0000 mgr.y (mgr.14140) 146 : audit [DBG] from='client.34301 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi132=a", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:33:48.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:47 smithi188 bash[23329]: cephadm 2020-07-16T13:33:46.201720+0000 mgr.y (mgr.14140) 147 : cephadm [INF] Saving service alertmanager spec with placement count:1 smithi132=a 2020-07-16T13:33:49.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:48 smithi132 bash[23299]: cluster 2020-07-16T13:33:47.727635+0000 mgr.y (mgr.14140) 148 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:33:49.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:48 smithi132 bash[27079]: cluster 2020-07-16T13:33:47.727635+0000 mgr.y (mgr.14140) 148 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:33:49.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:48 smithi188 bash[23329]: cluster 2020-07-16T13:33:47.727635+0000 mgr.y (mgr.14140) 148 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:33:50.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:50 smithi188 bash[23329]: cluster 2020-07-16T13:33:49.728036+0000 mgr.y (mgr.14140) 149 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:33:51.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:50 smithi132 bash[27079]: cluster 2020-07-16T13:33:49.728036+0000 mgr.y (mgr.14140) 149 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:33:51.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:50 smithi132 bash[23299]: cluster 2020-07-16T13:33:49.728036+0000 mgr.y (mgr.14140) 149 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:33:53.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:52 smithi188 bash[23329]: cluster 2020-07-16T13:33:51.728634+0000 mgr.y (mgr.14140) 150 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:33:53.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:52 smithi132 bash[27079]: cluster 2020-07-16T13:33:51.728634+0000 mgr.y (mgr.14140) 150 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:33:53.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:52 smithi132 bash[23299]: cluster 2020-07-16T13:33:51.728634+0000 mgr.y (mgr.14140) 150 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:33:54.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:54 smithi188 bash[23329]: cluster 2020-07-16T13:33:53.729121+0000 mgr.y (mgr.14140) 151 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:33:54.933 INFO:teuthology.orchestra.run.smithi188.stdout:Scheduled grafana update... 2020-07-16T13:33:55.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:54 smithi132 bash[27079]: cluster 2020-07-16T13:33:53.729121+0000 mgr.y (mgr.14140) 151 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:33:55.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:54 smithi132 bash[23299]: cluster 2020-07-16T13:33:53.729121+0000 mgr.y (mgr.14140) 151 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:33:55.482 INFO:teuthology.orchestra.run.smithi188:grafana.a> sudo journalctl -f -n 0 -u ceph-4c8ed362-c768-11ea-a06f-001a4aab830c@grafana.a.service 2020-07-16T13:33:55.485 INFO:tasks.cephadm:Setting up client nodes... 2020-07-16T13:33:55.487 INFO:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4c8ed362-c768-11ea-a06f-001a4aab830c -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2020-07-16T13:33:55.518 INFO:journalctl@ceph.grafana.a.smithi188.stdout:-- Logs begin at Thu 2020-07-16 13:22:28 UTC. -- 2020-07-16T13:33:56.082 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:55 smithi188 bash[23329]: audit 2020-07-16T13:33:54.928069+0000 mgr.y (mgr.14140) 152 : audit [DBG] from='client.34307 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi188=a", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:33:56.083 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:55 smithi188 bash[23329]: cephadm 2020-07-16T13:33:54.928679+0000 mgr.y (mgr.14140) 153 : cephadm [INF] Saving service grafana spec with placement count:1 smithi188=a 2020-07-16T13:33:56.083 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:55 smithi188 bash[23329]: audit 2020-07-16T13:33:54.929057+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2020-07-16T13:33:54.928692\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi188\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]: dispatch 2020-07-16T13:33:56.084 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:55 smithi188 bash[23329]: audit 2020-07-16T13:33:54.931868+0000 mon.a (mon.0) 508 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2020-07-16T13:33:54.928692\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi188\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]': finished 2020-07-16T13:33:56.084 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:55 smithi188 bash[23329]: audit 2020-07-16T13:33:55.730146+0000 mon.a (mon.0) 509 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"5e2adad3-9b83-4d34-a30d-85ad0922bece\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1594906388.872921, \"finished_at\": 1594906399.4932332}, {\"id\": \"ace15482-fa04-4a36-9283-4d6b57c4092c\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1594906405.9352872, \"finished_at\": 1594906416.6814024}, {\"id\": \"2becc393-b947-4e5d-93e2-3290d4e6066b\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1594906422.905791, \"finished_at\": 1594906430.9113293}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2020-07-16T13:33:56.084 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:55 smithi188 bash[23329]: audit 2020-07-16T13:33:55.732901+0000 mon.a (mon.0) 510 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"5e2adad3-9b83-4d34-a30d-85ad0922bece\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1594906388.872921, \"finished_at\": 1594906399.4932332}, {\"id\": \"ace15482-fa04-4a36-9283-4d6b57c4092c\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1594906405.9352872, \"finished_at\": 1594906416.6814024}, {\"id\": \"2becc393-b947-4e5d-93e2-3290d4e6066b\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1594906422.905791, \"finished_at\": 1594906430.9113293}], \"version\": 2, \"compat_version\": 2}"}]': finished 2020-07-16T13:33:56.157 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:55 smithi132 bash[27079]: audit 2020-07-16T13:33:54.928069+0000 mgr.y (mgr.14140) 152 : audit [DBG] from='client.34307 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi188=a", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:33:56.157 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:55 smithi132 bash[27079]: cephadm 2020-07-16T13:33:54.928679+0000 mgr.y (mgr.14140) 153 : cephadm [INF] Saving service grafana spec with placement count:1 smithi188=a 2020-07-16T13:33:56.158 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:55 smithi132 bash[27079]: audit 2020-07-16T13:33:54.929057+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2020-07-16T13:33:54.928692\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi188\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]: dispatch 2020-07-16T13:33:56.158 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:55 smithi132 bash[27079]: audit 2020-07-16T13:33:54.931868+0000 mon.a (mon.0) 508 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2020-07-16T13:33:54.928692\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi188\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]': finished 2020-07-16T13:33:56.158 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:55 smithi132 bash[27079]: audit 2020-07-16T13:33:55.730146+0000 mon.a (mon.0) 509 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"5e2adad3-9b83-4d34-a30d-85ad0922bece\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1594906388.872921, \"finished_at\": 1594906399.4932332}, {\"id\": \"ace15482-fa04-4a36-9283-4d6b57c4092c\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1594906405.9352872, \"finished_at\": 1594906416.6814024}, {\"id\": \"2becc393-b947-4e5d-93e2-3290d4e6066b\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1594906422.905791, \"finished_at\": 1594906430.9113293}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2020-07-16T13:33:56.158 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:55 smithi132 bash[27079]: audit 2020-07-16T13:33:55.732901+0000 mon.a (mon.0) 510 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"5e2adad3-9b83-4d34-a30d-85ad0922bece\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1594906388.872921, \"finished_at\": 1594906399.4932332}, {\"id\": \"ace15482-fa04-4a36-9283-4d6b57c4092c\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1594906405.9352872, \"finished_at\": 1594906416.6814024}, {\"id\": \"2becc393-b947-4e5d-93e2-3290d4e6066b\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1594906422.905791, \"finished_at\": 1594906430.9113293}], \"version\": 2, \"compat_version\": 2}"}]': finished 2020-07-16T13:33:56.159 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:55 smithi132 bash[23299]: audit 2020-07-16T13:33:54.928069+0000 mgr.y (mgr.14140) 152 : audit [DBG] from='client.34307 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi188=a", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:33:56.159 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:55 smithi132 bash[23299]: cephadm 2020-07-16T13:33:54.928679+0000 mgr.y (mgr.14140) 153 : cephadm [INF] Saving service grafana spec with placement count:1 smithi188=a 2020-07-16T13:33:56.159 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:55 smithi132 bash[23299]: audit 2020-07-16T13:33:54.929057+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2020-07-16T13:33:54.928692\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi188\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]: dispatch 2020-07-16T13:33:56.159 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:55 smithi132 bash[23299]: audit 2020-07-16T13:33:54.931868+0000 mon.a (mon.0) 508 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2020-07-16T13:33:54.928692\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi188\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]': finished 2020-07-16T13:33:56.159 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:55 smithi132 bash[23299]: audit 2020-07-16T13:33:55.730146+0000 mon.a (mon.0) 509 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"5e2adad3-9b83-4d34-a30d-85ad0922bece\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1594906388.872921, \"finished_at\": 1594906399.4932332}, {\"id\": \"ace15482-fa04-4a36-9283-4d6b57c4092c\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1594906405.9352872, \"finished_at\": 1594906416.6814024}, {\"id\": \"2becc393-b947-4e5d-93e2-3290d4e6066b\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1594906422.905791, \"finished_at\": 1594906430.9113293}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2020-07-16T13:33:56.160 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:55 smithi132 bash[23299]: audit 2020-07-16T13:33:55.732901+0000 mon.a (mon.0) 510 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"5e2adad3-9b83-4d34-a30d-85ad0922bece\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1594906388.872921, \"finished_at\": 1594906399.4932332}, {\"id\": \"ace15482-fa04-4a36-9283-4d6b57c4092c\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1594906405.9352872, \"finished_at\": 1594906416.6814024}, {\"id\": \"2becc393-b947-4e5d-93e2-3290d4e6066b\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1594906422.905791, \"finished_at\": 1594906430.9113293}], \"version\": 2, \"compat_version\": 2}"}]': finished 2020-07-16T13:33:57.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:56 smithi132 bash[23299]: cluster 2020-07-16T13:33:55.729403+0000 mgr.y (mgr.14140) 154 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:33:57.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:56 smithi132 bash[27079]: cluster 2020-07-16T13:33:55.729403+0000 mgr.y (mgr.14140) 154 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:33:57.207 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:56 smithi188 bash[23329]: cluster 2020-07-16T13:33:55.729403+0000 mgr.y (mgr.14140) 154 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:33:57.207 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 13:33:56 smithi188 podman[308]: Error: no container with name or ID ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-prometheus.a found: no such container 2020-07-16T13:33:57.208 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 13:33:56 smithi188 systemd[1]: Started Ceph prometheus.a for 4c8ed362-c768-11ea-a06f-001a4aab830c. 2020-07-16T13:33:57.369 INFO:teuthology.orchestra.run.smithi132.stdout:[client.0] 2020-07-16T13:33:57.370 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBFVxBfnhzCFRAA6IjHabr+iRfq2d5GXLm7+Q== 2020-07-16T13:33:57.469 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Jul 16 13:33:57 smithi188 systemd[1]: Starting Ceph node-exporter.b for 4c8ed362-c768-11ea-a06f-001a4aab830c... 2020-07-16T13:33:57.469 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 13:33:57 smithi188 podman[328]: 2020-07-16 13:33:57.264760364 +0000 UTC m=+0.267304084 container create 55d17e2eaa72cbceaf083adb1b6c3deb261465f6100415ee25caa0096c9cb03a (image=docker.io/prom/prometheus:latest, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-prometheus.a) 2020-07-16T13:33:57.732 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Jul 16 13:33:57 smithi188 podman[414]: Error: no container with name or ID ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-node-exporter.b found: no such container 2020-07-16T13:33:57.732 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Jul 16 13:33:57 smithi188 systemd[1]: Started Ceph node-exporter.b for 4c8ed362-c768-11ea-a06f-001a4aab830c. 2020-07-16T13:33:57.733 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Jul 16 13:33:57 smithi188 bash[434]: Trying to pull registry.access.redhat.com/prom/node-exporter... 2020-07-16T13:33:57.733 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 13:33:57 smithi188 podman[328]: 2020-07-16 13:33:57.689647122 +0000 UTC m=+0.692190924 container init 55d17e2eaa72cbceaf083adb1b6c3deb261465f6100415ee25caa0096c9cb03a (image=docker.io/prom/prometheus:latest, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-prometheus.a) 2020-07-16T13:33:57.897 INFO:teuthology.orchestra.run.smithi132:> sudo sh -c 'cat > /etc/ceph/ceph.client.0.keyring' && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2020-07-16T13:33:57.957 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:57 smithi132 bash[23299]: audit 2020-07-16T13:33:57.017171+0000 mon.a (mon.0) 511 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477621\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477715\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477749\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477780\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477810\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477840\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"hostname\": \"smithi188\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:33:43.545910\"}}, \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:33:57.958 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:57 smithi132 bash[23299]: audit 2020-07-16T13:33:57.020106+0000 mon.a (mon.0) 512 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477621\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477715\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477749\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477780\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477810\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477840\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"hostname\": \"smithi188\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:33:43.545910\"}}, \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:33:57.958 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:57 smithi132 bash[23299]: audit 2020-07-16T13:33:57.020864+0000 mon.a (mon.0) 513 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2020-07-16T13:33:57.958 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:57 smithi132 bash[23299]: audit 2020-07-16T13:33:57.021380+0000 mon.a (mon.0) 514 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:33:57.959 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:57 smithi132 bash[23299]: audit 2020-07-16T13:33:57.364906+0000 mon.a (mon.0) 515 : audit [INF] from='client.? 172.21.15.132:0/556803040' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2020-07-16T13:33:57.959 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:57 smithi132 bash[23299]: audit 2020-07-16T13:33:57.368274+0000 mon.a (mon.0) 516 : audit [INF] from='client.? 172.21.15.132:0/556803040' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2020-07-16T13:33:57.959 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:57 smithi132 bash[23299]: audit 2020-07-16T13:33:57.513937+0000 mon.a (mon.0) 517 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477621\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477715\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477749\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477780\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477810\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477840\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"hostname\": \"smithi188\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"smithi188\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:33:43.545910\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}}, \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:33:57.959 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:57 smithi132 bash[23299]: audit 2020-07-16T13:33:57.516874+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477621\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477715\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477749\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477780\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477810\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477840\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"hostname\": \"smithi188\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"smithi188\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:33:43.545910\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}}, \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:33:57.960 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:57 smithi132 bash[23299]: audit 2020-07-16T13:33:57.517425+0000 mon.a (mon.0) 519 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2020-07-16T13:33:57.960 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:57 smithi132 bash[23299]: audit 2020-07-16T13:33:57.517929+0000 mon.a (mon.0) 520 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:33:57.960 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:Jul 16 13:33:57 smithi132 systemd[1]: Starting Ceph node-exporter.a for 4c8ed362-c768-11ea-a06f-001a4aab830c... 2020-07-16T13:33:57.960 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:57 smithi132 bash[27079]: audit 2020-07-16T13:33:57.017171+0000 mon.a (mon.0) 511 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477621\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477715\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477749\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477780\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477810\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477840\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"hostname\": \"smithi188\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:33:43.545910\"}}, \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:33:57.961 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:57 smithi132 bash[27079]: audit 2020-07-16T13:33:57.020106+0000 mon.a (mon.0) 512 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477621\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477715\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477749\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477780\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477810\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477840\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"hostname\": \"smithi188\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:33:43.545910\"}}, \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:33:57.961 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:57 smithi132 bash[27079]: audit 2020-07-16T13:33:57.020864+0000 mon.a (mon.0) 513 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2020-07-16T13:33:57.961 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:57 smithi132 bash[27079]: audit 2020-07-16T13:33:57.021380+0000 mon.a (mon.0) 514 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:33:57.961 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:57 smithi132 bash[27079]: audit 2020-07-16T13:33:57.364906+0000 mon.a (mon.0) 515 : audit [INF] from='client.? 172.21.15.132:0/556803040' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2020-07-16T13:33:57.962 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:57 smithi132 bash[27079]: audit 2020-07-16T13:33:57.368274+0000 mon.a (mon.0) 516 : audit [INF] from='client.? 172.21.15.132:0/556803040' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2020-07-16T13:33:57.962 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:57 smithi132 bash[27079]: audit 2020-07-16T13:33:57.513937+0000 mon.a (mon.0) 517 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477621\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477715\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477749\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477780\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477810\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477840\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"hostname\": \"smithi188\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"smithi188\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:33:43.545910\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}}, \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:33:57.962 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:57 smithi132 bash[27079]: audit 2020-07-16T13:33:57.516874+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477621\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477715\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477749\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477780\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477810\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477840\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"hostname\": \"smithi188\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"smithi188\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:33:43.545910\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}}, \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:33:57.962 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:57 smithi132 bash[27079]: audit 2020-07-16T13:33:57.517425+0000 mon.a (mon.0) 519 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2020-07-16T13:33:57.963 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:57 smithi132 bash[27079]: audit 2020-07-16T13:33:57.517929+0000 mon.a (mon.0) 520 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:33:57.964 INFO:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4c8ed362-c768-11ea-a06f-001a4aab830c -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2020-07-16T13:33:58.001 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Jul 16 13:33:57 smithi188 bash[434]: name unknown: Repo not found 2020-07-16T13:33:58.001 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Jul 16 13:33:57 smithi188 bash[434]: Trying to pull registry.redhat.io/prom/node-exporter... 2020-07-16T13:33:58.002 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:57 smithi188 bash[23329]: audit 2020-07-16T13:33:57.017171+0000 mon.a (mon.0) 511 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477621\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477715\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477749\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477780\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477810\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477840\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"hostname\": \"smithi188\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:33:43.545910\"}}, \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:33:58.003 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:57 smithi188 bash[23329]: audit 2020-07-16T13:33:57.020106+0000 mon.a (mon.0) 512 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477621\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477715\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477749\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477780\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477810\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477840\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"hostname\": \"smithi188\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:33:43.545910\"}}, \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:33:58.003 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:57 smithi188 bash[23329]: audit 2020-07-16T13:33:57.020864+0000 mon.a (mon.0) 513 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2020-07-16T13:33:58.003 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:57 smithi188 bash[23329]: audit 2020-07-16T13:33:57.021380+0000 mon.a (mon.0) 514 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:33:58.004 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:57 smithi188 bash[23329]: audit 2020-07-16T13:33:57.364906+0000 mon.a (mon.0) 515 : audit [INF] from='client.? 172.21.15.132:0/556803040' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2020-07-16T13:33:58.004 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:57 smithi188 bash[23329]: audit 2020-07-16T13:33:57.368274+0000 mon.a (mon.0) 516 : audit [INF] from='client.? 172.21.15.132:0/556803040' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2020-07-16T13:33:58.004 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:57 smithi188 bash[23329]: audit 2020-07-16T13:33:57.513937+0000 mon.a (mon.0) 517 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477621\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477715\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477749\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477780\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477810\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477840\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"hostname\": \"smithi188\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"smithi188\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:33:43.545910\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}}, \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:33:58.005 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:57 smithi188 bash[23329]: audit 2020-07-16T13:33:57.516874+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477621\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477715\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477749\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477780\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477810\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:39.477840\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"hostname\": \"smithi188\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"smithi188\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:33:43.545910\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}}, \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:33:58.005 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:57 smithi188 bash[23329]: audit 2020-07-16T13:33:57.517425+0000 mon.a (mon.0) 519 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2020-07-16T13:33:58.005 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:57 smithi188 bash[23329]: audit 2020-07-16T13:33:57.517929+0000 mon.a (mon.0) 520 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:33:58.006 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 13:33:57 smithi188 podman[328]: 2020-07-16 13:33:57.73136136 +0000 UTC m=+0.733905101 container start 55d17e2eaa72cbceaf083adb1b6c3deb261465f6100415ee25caa0096c9cb03a (image=docker.io/prom/prometheus:latest, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-prometheus.a) 2020-07-16T13:33:58.006 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 13:33:57 smithi188 bash[326]: level=info ts=2020-07-16T13:33:57.723Z caller=main.go:302 msg="No time or size retention was set so using the default time retention" duration=15d 2020-07-16T13:33:58.006 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 13:33:57 smithi188 bash[326]: level=info ts=2020-07-16T13:33:57.724Z caller=main.go:337 msg="Starting Prometheus" version="(version=2.19.2, branch=HEAD, revision=c448ada63d83002e9c1d2c9f84e09f55a61f0ff7)" 2020-07-16T13:33:58.007 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 13:33:57 smithi188 bash[326]: level=info ts=2020-07-16T13:33:57.724Z caller=main.go:338 build_context="(go=go1.14.4, user=root@dd72efe1549d, date=20200626-09:02:20)" 2020-07-16T13:33:58.010 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 13:33:57 smithi188 bash[326]: level=info ts=2020-07-16T13:33:57.724Z caller=main.go:339 host_details="(Linux 4.18.0-193.el8.x86_64 #1 SMP Fri Mar 27 14:35:58 UTC 2020 x86_64 smithi188 (none))" 2020-07-16T13:33:58.011 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 13:33:57 smithi188 bash[326]: level=info ts=2020-07-16T13:33:57.724Z caller=main.go:340 fd_limits="(soft=1048576, hard=1048576)" 2020-07-16T13:33:58.011 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 13:33:57 smithi188 bash[326]: level=info ts=2020-07-16T13:33:57.724Z caller=main.go:341 vm_limits="(soft=unlimited, hard=unlimited)" 2020-07-16T13:33:58.011 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 13:33:57 smithi188 bash[326]: level=info ts=2020-07-16T13:33:57.725Z caller=main.go:678 msg="Starting TSDB ..." 2020-07-16T13:33:58.012 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 13:33:57 smithi188 bash[326]: level=info ts=2020-07-16T13:33:57.725Z caller=web.go:524 component=web msg="Start listening for connections" address=:9095 2020-07-16T13:33:58.012 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 13:33:57 smithi188 bash[326]: level=info ts=2020-07-16T13:33:57.727Z caller=head.go:645 component=tsdb msg="Replaying WAL and on-disk memory mappable chunks if any, this may take a while" 2020-07-16T13:33:58.012 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 13:33:57 smithi188 bash[326]: level=info ts=2020-07-16T13:33:57.727Z caller=head.go:706 component=tsdb msg="WAL segment loaded" segment=0 maxSegment=0 2020-07-16T13:33:58.013 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 13:33:57 smithi188 bash[326]: level=info ts=2020-07-16T13:33:57.727Z caller=head.go:709 component=tsdb msg="WAL replay completed" duration=137.659µs 2020-07-16T13:33:58.013 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 13:33:57 smithi188 bash[326]: level=info ts=2020-07-16T13:33:57.727Z caller=main.go:694 fs_type=XFS_SUPER_MAGIC 2020-07-16T13:33:58.013 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 13:33:57 smithi188 bash[326]: level=info ts=2020-07-16T13:33:57.727Z caller=main.go:695 msg="TSDB started" 2020-07-16T13:33:58.014 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 13:33:57 smithi188 bash[326]: level=info ts=2020-07-16T13:33:57.727Z caller=main.go:799 msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2020-07-16T13:33:58.014 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 13:33:57 smithi188 bash[326]: level=info ts=2020-07-16T13:33:57.729Z caller=main.go:827 msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml 2020-07-16T13:33:58.014 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 13:33:57 smithi188 bash[326]: level=info ts=2020-07-16T13:33:57.729Z caller=main.go:646 msg="Server is ready to receive web requests." 2020-07-16T13:33:58.014 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 13:33:57 smithi188 podman[328]: 2020-07-16 13:33:57.731430852 +0000 UTC m=+0.733974617 container attach 55d17e2eaa72cbceaf083adb1b6c3deb261465f6100415ee25caa0096c9cb03a (image=docker.io/prom/prometheus:latest, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-prometheus.a) 2020-07-16T13:33:58.278 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:Jul 16 13:33:57 smithi132 podman[2353]: Error: no container with name or ID ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-node-exporter.a found: no such container 2020-07-16T13:33:58.278 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:Jul 16 13:33:57 smithi132 systemd[1]: Started Ceph node-exporter.a for 4c8ed362-c768-11ea-a06f-001a4aab830c. 2020-07-16T13:33:58.278 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:Jul 16 13:33:58 smithi132 bash[2372]: Trying to pull registry.access.redhat.com/prom/node-exporter... 2020-07-16T13:33:58.278 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:Jul 16 13:33:58 smithi132 bash[2372]: name unknown: Repo not found 2020-07-16T13:33:58.279 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:Jul 16 13:33:58 smithi132 bash[2372]: Trying to pull registry.redhat.io/prom/node-exporter... 2020-07-16T13:33:58.324 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Jul 16 13:33:58 smithi188 bash[434]: unable to retrieve auth token: invalid username/password: unauthorized: Please login to the Red Hat Registry using your Customer Portal credentials. Further instructions can be found here: https://access.redhat.com/RegistryAuthentication 2020-07-16T13:33:58.324 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Jul 16 13:33:58 smithi188 bash[434]: Trying to pull docker.io/prom/node-exporter... 2020-07-16T13:33:58.670 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Jul 16 13:33:58 smithi188 bash[434]: Getting image source signatures 2020-07-16T13:33:58.671 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Jul 16 13:33:58 smithi188 bash[434]: Copying blob sha256:ed1cd1c6cd7a382d8fabc8efa0f191ce6229151c1b45951d5fa882fdab0014cf 2020-07-16T13:33:58.671 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Jul 16 13:33:58 smithi188 bash[434]: Copying blob sha256:ff1bb132ce7ba2452bef4000e1a102a18041bd12b87e2be2d160ee2ca43f7adf 2020-07-16T13:33:58.671 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Jul 16 13:33:58 smithi188 bash[434]: Copying blob sha256:86fa074c6765dda1bcd90264d60cd541980e20eadeb0669031452c721a92f6b9 2020-07-16T13:33:58.942 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:Jul 16 13:33:58 smithi132 bash[2372]: unable to retrieve auth token: invalid username/password: unauthorized: Please login to the Red Hat Registry using your Customer Portal credentials. Further instructions can be found here: https://access.redhat.com/RegistryAuthentication 2020-07-16T13:33:58.943 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:Jul 16 13:33:58 smithi132 bash[2372]: Trying to pull docker.io/prom/node-exporter... 2020-07-16T13:33:59.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:58 smithi132 bash[23299]: cephadm 2020-07-16T13:33:57.021801+0000 mgr.y (mgr.14140) 155 : cephadm [INF] Deploying daemon node-exporter.b on smithi188 2020-07-16T13:33:59.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:58 smithi132 bash[23299]: cephadm 2020-07-16T13:33:57.518396+0000 mgr.y (mgr.14140) 156 : cephadm [INF] Deploying daemon node-exporter.a on smithi132 2020-07-16T13:33:59.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:58 smithi132 bash[23299]: cluster 2020-07-16T13:33:57.729701+0000 mgr.y (mgr.14140) 157 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:33:59.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:58 smithi132 bash[23299]: audit 2020-07-16T13:33:58.007128+0000 mon.a (mon.0) 521 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337592\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337665\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337696\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337723\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337749\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337776\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337802\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"hostname\": \"smithi132\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:33:59.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:58 smithi132 bash[23299]: audit 2020-07-16T13:33:58.012332+0000 mon.a (mon.0) 522 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337592\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337665\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337696\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337723\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337749\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337776\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337802\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"hostname\": \"smithi132\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:33:59.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:58 smithi132 bash[23299]: audit 2020-07-16T13:33:58.012964+0000 mon.a (mon.0) 523 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:33:59.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:58 smithi132 bash[27079]: cephadm 2020-07-16T13:33:57.021801+0000 mgr.y (mgr.14140) 155 : cephadm [INF] Deploying daemon node-exporter.b on smithi188 2020-07-16T13:33:59.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:58 smithi132 bash[27079]: cephadm 2020-07-16T13:33:57.518396+0000 mgr.y (mgr.14140) 156 : cephadm [INF] Deploying daemon node-exporter.a on smithi132 2020-07-16T13:33:59.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:58 smithi132 bash[27079]: cluster 2020-07-16T13:33:57.729701+0000 mgr.y (mgr.14140) 157 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:33:59.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:58 smithi132 bash[27079]: audit 2020-07-16T13:33:58.007128+0000 mon.a (mon.0) 521 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337592\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337665\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337696\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337723\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337749\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337776\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337802\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"hostname\": \"smithi132\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:33:59.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:58 smithi132 bash[27079]: audit 2020-07-16T13:33:58.012332+0000 mon.a (mon.0) 522 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337592\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337665\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337696\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337723\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337749\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337776\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337802\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"hostname\": \"smithi132\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:33:59.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:58 smithi132 bash[27079]: audit 2020-07-16T13:33:58.012964+0000 mon.a (mon.0) 523 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:33:59.283 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:Jul 16 13:33:58 smithi132 bash[2372]: Getting image source signatures 2020-07-16T13:33:59.284 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:Jul 16 13:33:59 smithi132 bash[2372]: Copying blob sha256:ff1bb132ce7ba2452bef4000e1a102a18041bd12b87e2be2d160ee2ca43f7adf 2020-07-16T13:33:59.284 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:Jul 16 13:33:59 smithi132 bash[2372]: Copying blob sha256:ed1cd1c6cd7a382d8fabc8efa0f191ce6229151c1b45951d5fa882fdab0014cf 2020-07-16T13:33:59.284 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:Jul 16 13:33:59 smithi132 bash[2372]: Copying blob sha256:86fa074c6765dda1bcd90264d60cd541980e20eadeb0669031452c721a92f6b9 2020-07-16T13:33:59.421 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Jul 16 13:33:58 smithi188 bash[434]: Copying config sha256:0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d 2020-07-16T13:33:59.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:58 smithi188 bash[23329]: cephadm 2020-07-16T13:33:57.021801+0000 mgr.y (mgr.14140) 155 : cephadm [INF] Deploying daemon node-exporter.b on smithi188 2020-07-16T13:33:59.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:58 smithi188 bash[23329]: cephadm 2020-07-16T13:33:57.518396+0000 mgr.y (mgr.14140) 156 : cephadm [INF] Deploying daemon node-exporter.a on smithi132 2020-07-16T13:33:59.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:58 smithi188 bash[23329]: cluster 2020-07-16T13:33:57.729701+0000 mgr.y (mgr.14140) 157 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:33:59.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:58 smithi188 bash[23329]: audit 2020-07-16T13:33:58.007128+0000 mon.a (mon.0) 521 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337592\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337665\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337696\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337723\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337749\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337776\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337802\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"hostname\": \"smithi132\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:33:59.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:58 smithi188 bash[23329]: audit 2020-07-16T13:33:58.012332+0000 mon.a (mon.0) 522 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337592\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337665\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337696\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337723\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337749\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337776\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:32:29.337802\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"hostname\": \"smithi132\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:33:59.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:58 smithi188 bash[23329]: audit 2020-07-16T13:33:58.012964+0000 mon.a (mon.0) 523 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:33:59.921 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Jul 16 13:33:59 smithi188 bash[434]: Writing manifest to image destination 2020-07-16T13:33:59.922 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Jul 16 13:33:59 smithi188 bash[434]: Storing signatures 2020-07-16T13:33:59.935 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:Jul 16 13:33:59 smithi132 bash[2372]: Copying config sha256:0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d 2020-07-16T13:34:00.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:59 smithi132 bash[27079]: audit 2020-07-16T13:33:59.061039+0000 mon.a (mon.0) 524 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.059946\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060034\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060063\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060113\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060142\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060170\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060198\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"hostname\": \"smithi132\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060225\", \"created\": \"2020-07-16T13:33:57.978389\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}}, \"last_daemon_update\": \"2020-07-16T13:33:59.060287\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:34:00.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:59 smithi132 bash[27079]: audit 2020-07-16T13:33:59.065947+0000 mon.a (mon.0) 525 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.059946\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060034\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060063\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060113\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060142\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060170\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060198\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"hostname\": \"smithi132\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060225\", \"created\": \"2020-07-16T13:33:57.978389\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}}, \"last_daemon_update\": \"2020-07-16T13:33:59.060287\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:34:00.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:33:59 smithi132 bash[27079]: audit 2020-07-16T13:33:59.066467+0000 mon.a (mon.0) 526 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:34:00.281 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:Jul 16 13:33:59 smithi132 bash[2372]: Writing manifest to image destination 2020-07-16T13:34:00.282 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:Jul 16 13:33:59 smithi132 bash[2372]: Storing signatures 2020-07-16T13:34:00.282 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:59 smithi132 bash[23299]: audit 2020-07-16T13:33:59.061039+0000 mon.a (mon.0) 524 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.059946\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060034\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060063\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060113\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060142\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060170\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060198\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"hostname\": \"smithi132\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060225\", \"created\": \"2020-07-16T13:33:57.978389\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}}, \"last_daemon_update\": \"2020-07-16T13:33:59.060287\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:34:00.283 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:59 smithi132 bash[23299]: audit 2020-07-16T13:33:59.065947+0000 mon.a (mon.0) 525 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.059946\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060034\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060063\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060113\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060142\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060170\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060198\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"hostname\": \"smithi132\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060225\", \"created\": \"2020-07-16T13:33:57.978389\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}}, \"last_daemon_update\": \"2020-07-16T13:33:59.060287\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:34:00.283 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:33:59 smithi132 bash[23299]: audit 2020-07-16T13:33:59.066467+0000 mon.a (mon.0) 526 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:34:00.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:59 smithi188 bash[23329]: audit 2020-07-16T13:33:59.061039+0000 mon.a (mon.0) 524 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.059946\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060034\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060063\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060113\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060142\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060170\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060198\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"hostname\": \"smithi132\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060225\", \"created\": \"2020-07-16T13:33:57.978389\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}}, \"last_daemon_update\": \"2020-07-16T13:33:59.060287\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:34:00.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:59 smithi188 bash[23329]: audit 2020-07-16T13:33:59.065947+0000 mon.a (mon.0) 525 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.059946\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060034\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060063\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060113\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060142\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060170\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060198\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"hostname\": \"smithi132\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060225\", \"created\": \"2020-07-16T13:33:57.978389\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}}, \"last_daemon_update\": \"2020-07-16T13:33:59.060287\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:34:00.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:33:59 smithi188 bash[23329]: audit 2020-07-16T13:33:59.066467+0000 mon.a (mon.0) 526 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:34:01.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:00 smithi132 bash[27079]: cluster 2020-07-16T13:33:59.730180+0000 mgr.y (mgr.14140) 158 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:01.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:00 smithi132 bash[23299]: cluster 2020-07-16T13:33:59.730180+0000 mgr.y (mgr.14140) 158 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:01.341 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:00 smithi188 bash[23329]: cluster 2020-07-16T13:33:59.730180+0000 mgr.y (mgr.14140) 158 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:01.548 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:Jul 16 13:34:01 smithi132 podman[2374]: 2020-07-16 13:34:01.283981251 +0000 UTC m=+3.290693019 image pull 2020-07-16T13:34:01.548 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:Jul 16 13:34:01 smithi132 podman[2374]: 2020-07-16 13:34:01.496949252 +0000 UTC m=+3.503661096 container create 3bf4a744ea1ecdbe0297545deb7dd6d09698ed3c31e172f9e8103d6f8135563d (image=docker.io/prom/node-exporter:latest, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-node-exporter.a) 2020-07-16T13:34:01.670 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Jul 16 13:34:01 smithi188 podman[436]: 2020-07-16 13:34:01.340302221 +0000 UTC m=+3.844559446 image pull 2020-07-16T13:34:01.806 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:Jul 16 13:34:01 smithi132 podman[2374]: 2020-07-16 13:34:01.805175635 +0000 UTC m=+3.811887388 container init 3bf4a744ea1ecdbe0297545deb7dd6d09698ed3c31e172f9e8103d6f8135563d (image=docker.io/prom/node-exporter:latest, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-node-exporter.a) 2020-07-16T13:34:02.123 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Jul 16 13:34:01 smithi188 podman[436]: 2020-07-16 13:34:01.772029266 +0000 UTC m=+4.276286468 container create 379b3ae3abda4b5457b43a25689efb02dcb25fc7c1886fccfadb8e244c97e91f (image=docker.io/prom/node-exporter:latest, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-node-exporter.b) 2020-07-16T13:34:02.123 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Jul 16 13:34:02 smithi188 podman[436]: 2020-07-16 13:34:02.121968129 +0000 UTC m=+4.626225349 container init 379b3ae3abda4b5457b43a25689efb02dcb25fc7c1886fccfadb8e244c97e91f (image=docker.io/prom/node-exporter:latest, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-node-exporter.b) 2020-07-16T13:34:02.231 INFO:teuthology.orchestra.run.smithi188.stdout:[client.1] 2020-07-16T13:34:02.231 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQBKVxBfL4p+DRAAc3B+ZAtZhZLg2CTJ5uOQVQ== 2020-07-16T13:34:02.279 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:Jul 16 13:34:01 smithi132 podman[2374]: 2020-07-16 13:34:01.855255893 +0000 UTC m=+3.861967652 container start 3bf4a744ea1ecdbe0297545deb7dd6d09698ed3c31e172f9e8103d6f8135563d (image=docker.io/prom/node-exporter:latest, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-node-exporter.a) 2020-07-16T13:34:02.280 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:Jul 16 13:34:01 smithi132 podman[2374]: 2020-07-16 13:34:01.855321646 +0000 UTC m=+3.862033439 container attach 3bf4a744ea1ecdbe0297545deb7dd6d09698ed3c31e172f9e8103d6f8135563d (image=docker.io/prom/node-exporter:latest, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-node-exporter.a) 2020-07-16T13:34:02.280 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:Jul 16 13:34:01 smithi132 bash[2372]: level=info ts=2020-07-16T13:34:01.814Z caller=node_exporter.go:177 msg="Starting node_exporter" version="(version=1.0.1, branch=HEAD, revision=3715be6ae899f2a9b9dbfd9c39f3e09a7bd4559f)" 2020-07-16T13:34:02.280 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:Jul 16 13:34:01 smithi132 bash[2372]: level=info ts=2020-07-16T13:34:01.814Z caller=node_exporter.go:178 msg="Build context" build_context="(go=go1.14.4, user=root@1f76dbbcfa55, date=20200616-12:44:12)" 2020-07-16T13:34:02.280 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:Jul 16 13:34:01 smithi132 bash[2372]: level=info ts=2020-07-16T13:34:01.814Z caller=node_exporter.go:105 msg="Enabled collectors" 2020-07-16T13:34:02.280 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:Jul 16 13:34:01 smithi132 bash[2372]: level=info ts=2020-07-16T13:34:01.814Z caller=node_exporter.go:112 collector=arp 2020-07-16T13:34:02.281 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:Jul 16 13:34:01 smithi132 bash[2372]: level=info ts=2020-07-16T13:34:01.814Z caller=node_exporter.go:112 collector=bcache 2020-07-16T13:34:02.281 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:Jul 16 13:34:01 smithi132 bash[2372]: level=info ts=2020-07-16T13:34:01.814Z caller=node_exporter.go:112 collector=bonding 2020-07-16T13:34:02.281 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:Jul 16 13:34:01 smithi132 bash[2372]: level=info ts=2020-07-16T13:34:01.814Z caller=node_exporter.go:112 collector=btrfs 2020-07-16T13:34:02.281 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:Jul 16 13:34:01 smithi132 bash[2372]: level=info ts=2020-07-16T13:34:01.814Z caller=node_exporter.go:112 collector=conntrack 2020-07-16T13:34:02.281 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:Jul 16 13:34:01 smithi132 bash[2372]: level=info ts=2020-07-16T13:34:01.814Z caller=node_exporter.go:112 collector=cpu 2020-07-16T13:34:02.282 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:Jul 16 13:34:01 smithi132 bash[2372]: level=info ts=2020-07-16T13:34:01.814Z caller=node_exporter.go:112 collector=cpufreq 2020-07-16T13:34:02.282 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:Jul 16 13:34:01 smithi132 bash[2372]: level=info ts=2020-07-16T13:34:01.814Z caller=node_exporter.go:112 collector=diskstats 2020-07-16T13:34:02.282 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:Jul 16 13:34:01 smithi132 bash[2372]: level=info ts=2020-07-16T13:34:01.814Z caller=node_exporter.go:112 collector=edac 2020-07-16T13:34:02.283 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:Jul 16 13:34:01 smithi132 bash[2372]: level=info ts=2020-07-16T13:34:01.814Z caller=node_exporter.go:112 collector=entropy 2020-07-16T13:34:02.283 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:Jul 16 13:34:01 smithi132 bash[2372]: level=info ts=2020-07-16T13:34:01.814Z caller=node_exporter.go:112 collector=filefd 2020-07-16T13:34:02.283 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:Jul 16 13:34:01 smithi132 bash[2372]: level=info ts=2020-07-16T13:34:01.814Z caller=node_exporter.go:112 collector=filesystem 2020-07-16T13:34:02.287 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:Jul 16 13:34:01 smithi132 bash[2372]: level=info ts=2020-07-16T13:34:01.814Z caller=node_exporter.go:112 collector=hwmon 2020-07-16T13:34:02.287 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:Jul 16 13:34:01 smithi132 bash[2372]: level=info ts=2020-07-16T13:34:01.814Z caller=node_exporter.go:112 collector=infiniband 2020-07-16T13:34:02.287 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:Jul 16 13:34:01 smithi132 bash[2372]: level=info ts=2020-07-16T13:34:01.814Z caller=node_exporter.go:112 collector=ipvs 2020-07-16T13:34:02.288 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:Jul 16 13:34:01 smithi132 bash[2372]: level=info ts=2020-07-16T13:34:01.814Z caller=node_exporter.go:112 collector=loadavg 2020-07-16T13:34:02.288 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:Jul 16 13:34:01 smithi132 bash[2372]: level=info ts=2020-07-16T13:34:01.814Z caller=node_exporter.go:112 collector=mdadm 2020-07-16T13:34:02.288 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:Jul 16 13:34:01 smithi132 bash[2372]: level=info ts=2020-07-16T13:34:01.814Z caller=node_exporter.go:112 collector=meminfo 2020-07-16T13:34:02.288 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:Jul 16 13:34:01 smithi132 bash[2372]: level=info ts=2020-07-16T13:34:01.814Z caller=node_exporter.go:112 collector=netclass 2020-07-16T13:34:02.288 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:Jul 16 13:34:01 smithi132 bash[2372]: level=info ts=2020-07-16T13:34:01.814Z caller=node_exporter.go:112 collector=netdev 2020-07-16T13:34:02.289 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:Jul 16 13:34:01 smithi132 bash[2372]: level=info ts=2020-07-16T13:34:01.814Z caller=node_exporter.go:112 collector=netstat 2020-07-16T13:34:02.289 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:Jul 16 13:34:01 smithi132 bash[2372]: level=info ts=2020-07-16T13:34:01.814Z caller=node_exporter.go:112 collector=nfs 2020-07-16T13:34:02.289 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:Jul 16 13:34:01 smithi132 bash[2372]: level=info ts=2020-07-16T13:34:01.814Z caller=node_exporter.go:112 collector=nfsd 2020-07-16T13:34:02.289 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:Jul 16 13:34:01 smithi132 bash[2372]: level=info ts=2020-07-16T13:34:01.814Z caller=node_exporter.go:112 collector=powersupplyclass 2020-07-16T13:34:02.290 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:Jul 16 13:34:01 smithi132 bash[2372]: level=info ts=2020-07-16T13:34:01.814Z caller=node_exporter.go:112 collector=pressure 2020-07-16T13:34:02.290 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:Jul 16 13:34:01 smithi132 bash[2372]: level=info ts=2020-07-16T13:34:01.814Z caller=node_exporter.go:112 collector=rapl 2020-07-16T13:34:02.290 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:Jul 16 13:34:01 smithi132 bash[2372]: level=info ts=2020-07-16T13:34:01.814Z caller=node_exporter.go:112 collector=schedstat 2020-07-16T13:34:02.291 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:Jul 16 13:34:01 smithi132 bash[2372]: level=info ts=2020-07-16T13:34:01.814Z caller=node_exporter.go:112 collector=sockstat 2020-07-16T13:34:02.291 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:Jul 16 13:34:01 smithi132 bash[2372]: level=info ts=2020-07-16T13:34:01.814Z caller=node_exporter.go:112 collector=softnet 2020-07-16T13:34:02.291 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:Jul 16 13:34:01 smithi132 bash[2372]: level=info ts=2020-07-16T13:34:01.814Z caller=node_exporter.go:112 collector=stat 2020-07-16T13:34:02.291 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:Jul 16 13:34:01 smithi132 bash[2372]: level=info ts=2020-07-16T13:34:01.814Z caller=node_exporter.go:112 collector=textfile 2020-07-16T13:34:02.292 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:Jul 16 13:34:01 smithi132 bash[2372]: level=info ts=2020-07-16T13:34:01.814Z caller=node_exporter.go:112 collector=thermal_zone 2020-07-16T13:34:02.292 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:Jul 16 13:34:01 smithi132 bash[2372]: level=info ts=2020-07-16T13:34:01.814Z caller=node_exporter.go:112 collector=time 2020-07-16T13:34:02.293 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:Jul 16 13:34:01 smithi132 bash[2372]: level=info ts=2020-07-16T13:34:01.814Z caller=node_exporter.go:112 collector=udp_queues 2020-07-16T13:34:02.293 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:Jul 16 13:34:01 smithi132 bash[2372]: level=info ts=2020-07-16T13:34:01.814Z caller=node_exporter.go:112 collector=uname 2020-07-16T13:34:02.293 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:Jul 16 13:34:01 smithi132 bash[2372]: level=info ts=2020-07-16T13:34:01.814Z caller=node_exporter.go:112 collector=vmstat 2020-07-16T13:34:02.293 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:Jul 16 13:34:01 smithi132 bash[2372]: level=info ts=2020-07-16T13:34:01.814Z caller=node_exporter.go:112 collector=xfs 2020-07-16T13:34:02.294 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:Jul 16 13:34:01 smithi132 bash[2372]: level=info ts=2020-07-16T13:34:01.815Z caller=node_exporter.go:112 collector=zfs 2020-07-16T13:34:02.294 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:Jul 16 13:34:01 smithi132 bash[2372]: level=info ts=2020-07-16T13:34:01.815Z caller=node_exporter.go:191 msg="Listening on" address=:9100 2020-07-16T13:34:02.294 INFO:journalctl@ceph.node-exporter.a.smithi132.stdout:Jul 16 13:34:01 smithi132 bash[2372]: level=info ts=2020-07-16T13:34:01.815Z caller=tls_config.go:170 msg="TLS is disabled and it cannot be enabled on the fly." http2=false 2020-07-16T13:34:02.421 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Jul 16 13:34:02 smithi188 podman[436]: 2020-07-16 13:34:02.205236292 +0000 UTC m=+4.709493493 container start 379b3ae3abda4b5457b43a25689efb02dcb25fc7c1886fccfadb8e244c97e91f (image=docker.io/prom/node-exporter:latest, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-node-exporter.b) 2020-07-16T13:34:02.421 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Jul 16 13:34:02 smithi188 podman[436]: 2020-07-16 13:34:02.20533565 +0000 UTC m=+4.709592875 container attach 379b3ae3abda4b5457b43a25689efb02dcb25fc7c1886fccfadb8e244c97e91f (image=docker.io/prom/node-exporter:latest, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-node-exporter.b) 2020-07-16T13:34:02.421 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Jul 16 13:34:02 smithi188 bash[434]: level=info ts=2020-07-16T13:34:02.132Z caller=node_exporter.go:177 msg="Starting node_exporter" version="(version=1.0.1, branch=HEAD, revision=3715be6ae899f2a9b9dbfd9c39f3e09a7bd4559f)" 2020-07-16T13:34:02.421 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Jul 16 13:34:02 smithi188 bash[434]: level=info ts=2020-07-16T13:34:02.132Z caller=node_exporter.go:178 msg="Build context" build_context="(go=go1.14.4, user=root@1f76dbbcfa55, date=20200616-12:44:12)" 2020-07-16T13:34:02.422 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Jul 16 13:34:02 smithi188 bash[434]: level=info ts=2020-07-16T13:34:02.132Z caller=node_exporter.go:105 msg="Enabled collectors" 2020-07-16T13:34:02.422 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Jul 16 13:34:02 smithi188 bash[434]: level=info ts=2020-07-16T13:34:02.132Z caller=node_exporter.go:112 collector=arp 2020-07-16T13:34:02.422 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Jul 16 13:34:02 smithi188 bash[434]: level=info ts=2020-07-16T13:34:02.132Z caller=node_exporter.go:112 collector=bcache 2020-07-16T13:34:02.422 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Jul 16 13:34:02 smithi188 bash[434]: level=info ts=2020-07-16T13:34:02.132Z caller=node_exporter.go:112 collector=bonding 2020-07-16T13:34:02.423 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Jul 16 13:34:02 smithi188 bash[434]: level=info ts=2020-07-16T13:34:02.132Z caller=node_exporter.go:112 collector=btrfs 2020-07-16T13:34:02.423 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Jul 16 13:34:02 smithi188 bash[434]: level=info ts=2020-07-16T13:34:02.132Z caller=node_exporter.go:112 collector=conntrack 2020-07-16T13:34:02.423 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Jul 16 13:34:02 smithi188 bash[434]: level=info ts=2020-07-16T13:34:02.132Z caller=node_exporter.go:112 collector=cpu 2020-07-16T13:34:02.423 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Jul 16 13:34:02 smithi188 bash[434]: level=info ts=2020-07-16T13:34:02.132Z caller=node_exporter.go:112 collector=cpufreq 2020-07-16T13:34:02.423 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Jul 16 13:34:02 smithi188 bash[434]: level=info ts=2020-07-16T13:34:02.132Z caller=node_exporter.go:112 collector=diskstats 2020-07-16T13:34:02.424 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Jul 16 13:34:02 smithi188 bash[434]: level=info ts=2020-07-16T13:34:02.132Z caller=node_exporter.go:112 collector=edac 2020-07-16T13:34:02.424 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Jul 16 13:34:02 smithi188 bash[434]: level=info ts=2020-07-16T13:34:02.132Z caller=node_exporter.go:112 collector=entropy 2020-07-16T13:34:02.424 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Jul 16 13:34:02 smithi188 bash[434]: level=info ts=2020-07-16T13:34:02.132Z caller=node_exporter.go:112 collector=filefd 2020-07-16T13:34:02.424 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Jul 16 13:34:02 smithi188 bash[434]: level=info ts=2020-07-16T13:34:02.132Z caller=node_exporter.go:112 collector=filesystem 2020-07-16T13:34:02.424 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Jul 16 13:34:02 smithi188 bash[434]: level=info ts=2020-07-16T13:34:02.132Z caller=node_exporter.go:112 collector=hwmon 2020-07-16T13:34:02.425 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Jul 16 13:34:02 smithi188 bash[434]: level=info ts=2020-07-16T13:34:02.132Z caller=node_exporter.go:112 collector=infiniband 2020-07-16T13:34:02.425 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Jul 16 13:34:02 smithi188 bash[434]: level=info ts=2020-07-16T13:34:02.132Z caller=node_exporter.go:112 collector=ipvs 2020-07-16T13:34:02.425 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Jul 16 13:34:02 smithi188 bash[434]: level=info ts=2020-07-16T13:34:02.132Z caller=node_exporter.go:112 collector=loadavg 2020-07-16T13:34:02.425 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Jul 16 13:34:02 smithi188 bash[434]: level=info ts=2020-07-16T13:34:02.132Z caller=node_exporter.go:112 collector=mdadm 2020-07-16T13:34:02.425 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Jul 16 13:34:02 smithi188 bash[434]: level=info ts=2020-07-16T13:34:02.132Z caller=node_exporter.go:112 collector=meminfo 2020-07-16T13:34:02.426 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Jul 16 13:34:02 smithi188 bash[434]: level=info ts=2020-07-16T13:34:02.132Z caller=node_exporter.go:112 collector=netclass 2020-07-16T13:34:02.426 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Jul 16 13:34:02 smithi188 bash[434]: level=info ts=2020-07-16T13:34:02.132Z caller=node_exporter.go:112 collector=netdev 2020-07-16T13:34:02.426 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Jul 16 13:34:02 smithi188 bash[434]: level=info ts=2020-07-16T13:34:02.132Z caller=node_exporter.go:112 collector=netstat 2020-07-16T13:34:02.426 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Jul 16 13:34:02 smithi188 bash[434]: level=info ts=2020-07-16T13:34:02.132Z caller=node_exporter.go:112 collector=nfs 2020-07-16T13:34:02.427 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Jul 16 13:34:02 smithi188 bash[434]: level=info ts=2020-07-16T13:34:02.133Z caller=node_exporter.go:112 collector=nfsd 2020-07-16T13:34:02.427 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Jul 16 13:34:02 smithi188 bash[434]: level=info ts=2020-07-16T13:34:02.133Z caller=node_exporter.go:112 collector=powersupplyclass 2020-07-16T13:34:02.427 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Jul 16 13:34:02 smithi188 bash[434]: level=info ts=2020-07-16T13:34:02.133Z caller=node_exporter.go:112 collector=pressure 2020-07-16T13:34:02.427 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Jul 16 13:34:02 smithi188 bash[434]: level=info ts=2020-07-16T13:34:02.133Z caller=node_exporter.go:112 collector=rapl 2020-07-16T13:34:02.427 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Jul 16 13:34:02 smithi188 bash[434]: level=info ts=2020-07-16T13:34:02.133Z caller=node_exporter.go:112 collector=schedstat 2020-07-16T13:34:02.428 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Jul 16 13:34:02 smithi188 bash[434]: level=info ts=2020-07-16T13:34:02.133Z caller=node_exporter.go:112 collector=sockstat 2020-07-16T13:34:02.430 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Jul 16 13:34:02 smithi188 bash[434]: level=info ts=2020-07-16T13:34:02.133Z caller=node_exporter.go:112 collector=softnet 2020-07-16T13:34:02.430 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Jul 16 13:34:02 smithi188 bash[434]: level=info ts=2020-07-16T13:34:02.133Z caller=node_exporter.go:112 collector=stat 2020-07-16T13:34:02.430 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Jul 16 13:34:02 smithi188 bash[434]: level=info ts=2020-07-16T13:34:02.133Z caller=node_exporter.go:112 collector=textfile 2020-07-16T13:34:02.430 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Jul 16 13:34:02 smithi188 bash[434]: level=info ts=2020-07-16T13:34:02.133Z caller=node_exporter.go:112 collector=thermal_zone 2020-07-16T13:34:02.430 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Jul 16 13:34:02 smithi188 bash[434]: level=info ts=2020-07-16T13:34:02.133Z caller=node_exporter.go:112 collector=time 2020-07-16T13:34:02.432 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Jul 16 13:34:02 smithi188 bash[434]: level=info ts=2020-07-16T13:34:02.133Z caller=node_exporter.go:112 collector=udp_queues 2020-07-16T13:34:02.432 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Jul 16 13:34:02 smithi188 bash[434]: level=info ts=2020-07-16T13:34:02.133Z caller=node_exporter.go:112 collector=uname 2020-07-16T13:34:02.432 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Jul 16 13:34:02 smithi188 bash[434]: level=info ts=2020-07-16T13:34:02.133Z caller=node_exporter.go:112 collector=vmstat 2020-07-16T13:34:02.432 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Jul 16 13:34:02 smithi188 bash[434]: level=info ts=2020-07-16T13:34:02.133Z caller=node_exporter.go:112 collector=xfs 2020-07-16T13:34:02.432 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Jul 16 13:34:02 smithi188 bash[434]: level=info ts=2020-07-16T13:34:02.133Z caller=node_exporter.go:112 collector=zfs 2020-07-16T13:34:02.433 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Jul 16 13:34:02 smithi188 bash[434]: level=info ts=2020-07-16T13:34:02.133Z caller=node_exporter.go:191 msg="Listening on" address=:9100 2020-07-16T13:34:02.433 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Jul 16 13:34:02 smithi188 bash[434]: level=info ts=2020-07-16T13:34:02.133Z caller=tls_config.go:170 msg="TLS is disabled and it cannot be enabled on the fly." http2=false 2020-07-16T13:34:03.029 INFO:teuthology.orchestra.run.smithi188:> sudo sh -c 'cat > /etc/ceph/ceph.client.1.keyring' && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2020-07-16T13:34:03.091 INFO:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 4c8ed362-c768-11ea-a06f-001a4aab830c -- ceph osd dump --format=json 2020-07-16T13:34:03.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:02 smithi132 bash[27079]: cluster 2020-07-16T13:34:01.730509+0000 mgr.y (mgr.14140) 159 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:03.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:02 smithi132 bash[27079]: audit 2020-07-16T13:34:02.226044+0000 mon.c (mon.1) 11 : audit [INF] from='client.? 172.21.15.188:0/2611658924' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2020-07-16T13:34:03.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:02 smithi132 bash[27079]: audit 2020-07-16T13:34:02.226281+0000 mon.a (mon.0) 527 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2020-07-16T13:34:03.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:02 smithi132 bash[27079]: audit 2020-07-16T13:34:02.229968+0000 mon.a (mon.0) 528 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2020-07-16T13:34:03.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:02 smithi132 bash[23299]: cluster 2020-07-16T13:34:01.730509+0000 mgr.y (mgr.14140) 159 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:03.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:02 smithi132 bash[23299]: audit 2020-07-16T13:34:02.226044+0000 mon.c (mon.1) 11 : audit [INF] from='client.? 172.21.15.188:0/2611658924' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2020-07-16T13:34:03.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:02 smithi132 bash[23299]: audit 2020-07-16T13:34:02.226281+0000 mon.a (mon.0) 527 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2020-07-16T13:34:03.282 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:02 smithi132 bash[23299]: audit 2020-07-16T13:34:02.229968+0000 mon.a (mon.0) 528 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2020-07-16T13:34:03.322 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:02 smithi188 bash[23329]: cluster 2020-07-16T13:34:01.730509+0000 mgr.y (mgr.14140) 159 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:03.323 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:02 smithi188 bash[23329]: audit 2020-07-16T13:34:02.226044+0000 mon.c (mon.1) 11 : audit [INF] from='client.? 172.21.15.188:0/2611658924' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2020-07-16T13:34:03.323 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:02 smithi188 bash[23329]: audit 2020-07-16T13:34:02.226281+0000 mon.a (mon.0) 527 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2020-07-16T13:34:03.323 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:02 smithi188 bash[23329]: audit 2020-07-16T13:34:02.229968+0000 mon.a (mon.0) 528 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2020-07-16T13:34:04.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:03 smithi132 bash[23299]: audit 2020-07-16T13:34:03.387100+0000 mon.a (mon.0) 529 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386072\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386152\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386184\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386212\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386240\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386267\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"hostname\": \"smithi188\", \"container_id\": \"55d17e2eaa72\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386296\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:33:57.033143\"}, \"node-exporter.b\": {\"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386323\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:33:43.545910\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}}, \"last_daemon_update\": \"2020-07-16T13:34:03.386395\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:34:04.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:03 smithi132 bash[23299]: audit 2020-07-16T13:34:03.392996+0000 mon.a (mon.0) 530 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386072\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386152\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386184\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386212\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386240\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386267\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"hostname\": \"smithi188\", \"container_id\": \"55d17e2eaa72\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386296\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:33:57.033143\"}, \"node-exporter.b\": {\"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386323\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:33:43.545910\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}}, \"last_daemon_update\": \"2020-07-16T13:34:03.386395\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:34:04.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:03 smithi132 bash[27079]: audit 2020-07-16T13:34:03.387100+0000 mon.a (mon.0) 529 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386072\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386152\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386184\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386212\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386240\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386267\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"hostname\": \"smithi188\", \"container_id\": \"55d17e2eaa72\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386296\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:33:57.033143\"}, \"node-exporter.b\": {\"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386323\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:33:43.545910\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}}, \"last_daemon_update\": \"2020-07-16T13:34:03.386395\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:34:04.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:03 smithi132 bash[27079]: audit 2020-07-16T13:34:03.392996+0000 mon.a (mon.0) 530 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386072\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386152\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386184\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386212\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386240\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386267\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"hostname\": \"smithi188\", \"container_id\": \"55d17e2eaa72\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386296\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:33:57.033143\"}, \"node-exporter.b\": {\"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386323\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:33:43.545910\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}}, \"last_daemon_update\": \"2020-07-16T13:34:03.386395\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:34:04.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:03 smithi188 bash[23329]: audit 2020-07-16T13:34:03.387100+0000 mon.a (mon.0) 529 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386072\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386152\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386184\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386212\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386240\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386267\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"hostname\": \"smithi188\", \"container_id\": \"55d17e2eaa72\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386296\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:33:57.033143\"}, \"node-exporter.b\": {\"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386323\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:33:43.545910\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}}, \"last_daemon_update\": \"2020-07-16T13:34:03.386395\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:34:04.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:03 smithi188 bash[23329]: audit 2020-07-16T13:34:03.392996+0000 mon.a (mon.0) 530 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386072\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386152\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386184\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386212\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386240\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386267\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"hostname\": \"smithi188\", \"container_id\": \"55d17e2eaa72\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386296\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:33:57.033143\"}, \"node-exporter.b\": {\"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386323\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:33:43.545910\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}}, \"last_daemon_update\": \"2020-07-16T13:34:03.386395\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:34:05.232 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:04 smithi132 bash[23299]: cephadm 2020-07-16T13:34:03.395756+0000 mgr.y (mgr.14140) 160 : cephadm [INF] Deploying daemon alertmanager.a on smithi132 2020-07-16T13:34:05.233 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:04 smithi132 bash[23299]: cluster 2020-07-16T13:34:03.730832+0000 mgr.y (mgr.14140) 161 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:05.233 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:04 smithi132 bash[27079]: cephadm 2020-07-16T13:34:03.395756+0000 mgr.y (mgr.14140) 160 : cephadm [INF] Deploying daemon alertmanager.a on smithi132 2020-07-16T13:34:05.234 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:04 smithi132 bash[27079]: cluster 2020-07-16T13:34:03.730832+0000 mgr.y (mgr.14140) 161 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:05.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:04 smithi188 bash[23329]: cephadm 2020-07-16T13:34:03.395756+0000 mgr.y (mgr.14140) 160 : cephadm [INF] Deploying daemon alertmanager.a on smithi132 2020-07-16T13:34:05.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:04 smithi188 bash[23329]: cluster 2020-07-16T13:34:03.730832+0000 mgr.y (mgr.14140) 161 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:05.554 INFO:teuthology.orchestra.run.smithi132.stdout: 2020-07-16T13:34:05.555 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":51,"fsid":"4c8ed362-c768-11ea-a06f-001a4aab830c","created":"2020-07-16T13:29:34.607108+0000","modified":"2020-07-16T13:33:43.908143+0000","last_up_change":"2020-07-16T13:33:42.899341+0000","last_in_change":"2020-07-16T13:33:42.899341+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-07-16T13:29:44.933278+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"882744a6-1a4e-4c33-86ea-b3ae0c9db141","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":498701893},{"type":"v1","addr":"172.21.15.132:6803","nonce":498701893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":498701893},{"type":"v1","addr":"172.21.15.132:6805","nonce":498701893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":498701893},{"type":"v1","addr":"172.21.15.132:6809","nonce":498701893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":498701893},{"type":"v1","addr":"172.21.15.132:6807","nonce":498701893}]},"public_addr":"172.21.15.132:6803/498701893","cluster_addr":"172.21.15.132:6805/498701893","heartbeat_back_addr":"172.21.15.132:6809/498701893","heartbeat_front_addr":"172.21.15.132:6807/498701893","state":["exists","up"]},{"osd":1,"uuid":"39ea8fcd-c323-4683-9f7c-4f373a4e4f67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":1723454267},{"type":"v1","addr":"172.21.15.132:6811","nonce":1723454267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":1723454267},{"type":"v1","addr":"172.21.15.132:6813","nonce":1723454267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":1723454267},{"type":"v1","addr":"172.21.15.132:6817","nonce":1723454267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":1723454267},{"type":"v1","addr":"172.21.15.132:6815","nonce":1723454267}]},"public_addr":"172.21.15.132:6811/1723454267","cluster_addr":"172.21.15.132:6813/1723454267","heartbeat_back_addr":"172.21.15.132:6817/1723454267","heartbeat_front_addr":"172.21.15.132:6815/1723454267","state":["exists","up"]},{"osd":2,"uuid":"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":2489969657},{"type":"v1","addr":"172.21.15.132:6819","nonce":2489969657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":2489969657},{"type":"v1","addr":"172.21.15.132:6821","nonce":2489969657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":2489969657},{"type":"v1","addr":"172.21.15.132:6825","nonce":2489969657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":2489969657},{"type":"v1","addr":"172.21.15.132:6823","nonce":2489969657}]},"public_addr":"172.21.15.132:6819/2489969657","cluster_addr":"172.21.15.132:6821/2489969657","heartbeat_back_addr":"172.21.15.132:6825/2489969657","heartbeat_front_addr":"172.21.15.132:6823/2489969657","state":["exists","up"]},{"osd":3,"uuid":"72a90982-aa5f-4c26-9afe-50294c5c503b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":3154069775},{"type":"v1","addr":"172.21.15.132:6827","nonce":3154069775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":3154069775},{"type":"v1","addr":"172.21.15.132:6829","nonce":3154069775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":3154069775},{"type":"v1","addr":"172.21.15.132:6833","nonce":3154069775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":3154069775},{"type":"v1","addr":"172.21.15.132:6831","nonce":3154069775}]},"public_addr":"172.21.15.132:6827/3154069775","cluster_addr":"172.21.15.132:6829/3154069775","heartbeat_back_addr":"172.21.15.132:6833/3154069775","heartbeat_front_addr":"172.21.15.132:6831/3154069775","state":["exists","up"]},{"osd":4,"uuid":"78d29045-b36d-4f75-b245-d0f79869b999","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":31,"last_clean_end":33,"up_from":36,"up_thru":0,"down_at":34,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":213465511},{"type":"v1","addr":"172.21.15.188:6801","nonce":213465511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":213465511},{"type":"v1","addr":"172.21.15.188:6803","nonce":213465511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":213465511},{"type":"v1","addr":"172.21.15.188:6807","nonce":213465511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":213465511},{"type":"v1","addr":"172.21.15.188:6805","nonce":213465511}]},"public_addr":"172.21.15.188:6801/213465511","cluster_addr":"172.21.15.188:6803/213465511","heartbeat_back_addr":"172.21.15.188:6807/213465511","heartbeat_front_addr":"172.21.15.188:6805/213465511","state":["exists","up"]},{"osd":5,"uuid":"04a15200-6710-4b02-9351-c321c8619514","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":3799292735},{"type":"v1","addr":"172.21.15.188:6809","nonce":3799292735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":3799292735},{"type":"v1","addr":"172.21.15.188:6811","nonce":3799292735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":3799292735},{"type":"v1","addr":"172.21.15.188:6815","nonce":3799292735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":3799292735},{"type":"v1","addr":"172.21.15.188:6813","nonce":3799292735}]},"public_addr":"172.21.15.188:6809/3799292735","cluster_addr":"172.21.15.188:6811/3799292735","heartbeat_back_addr":"172.21.15.188:6815/3799292735","heartbeat_front_addr":"172.21.15.188:6813/3799292735","state":["exists","up"]},{"osd":6,"uuid":"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":135312866},{"type":"v1","addr":"172.21.15.188:6817","nonce":135312866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":135312866},{"type":"v1","addr":"172.21.15.188:6819","nonce":135312866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":135312866},{"type":"v1","addr":"172.21.15.188:6823","nonce":135312866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":135312866},{"type":"v1","addr":"172.21.15.188:6821","nonce":135312866}]},"public_addr":"172.21.15.188:6817/135312866","cluster_addr":"172.21.15.188:6819/135312866","heartbeat_back_addr":"172.21.15.188:6823/135312866","heartbeat_front_addr":"172.21.15.188:6821/135312866","state":["exists","up"]},{"osd":7,"uuid":"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":21822620},{"type":"v1","addr":"172.21.15.188:6825","nonce":21822620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":21822620},{"type":"v1","addr":"172.21.15.188:6827","nonce":21822620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":21822620},{"type":"v1","addr":"172.21.15.188:6831","nonce":21822620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":21822620},{"type":"v1","addr":"172.21.15.188:6829","nonce":21822620}]},"public_addr":"172.21.15.188:6825/21822620","cluster_addr":"172.21.15.188:6827/21822620","heartbeat_back_addr":"172.21.15.188:6831/21822620","heartbeat_front_addr":"172.21.15.188:6829/21822620","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T13:31:41.485298+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T13:31:58.520342+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T13:32:15.095160+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T13:32:31.313251+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T13:32:46.769407+0000","dead_epoch":34},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T13:33:06.873905+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T13:33:24.013074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T13:33:40.951941+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.132:6800/2485003984":"2020-07-17T13:30:05.628867+0000","172.21.15.132:0/3322785803":"2020-07-17T13:30:05.628867+0000","172.21.15.132:0/33794564":"2020-07-17T13:30:05.628867+0000","172.21.15.132:6801/2485003984":"2020-07-17T13:30:05.628867+0000","172.21.15.132:6800/253269341":"2020-07-17T13:29:51.583848+0000","172.21.15.132:0/3369903850":"2020-07-17T13:30:05.628867+0000","172.21.15.132:0/4253611559":"2020-07-17T13:29:51.583848+0000","172.21.15.132:6801/253269341":"2020-07-17T13:29:51.583848+0000","172.21.15.132:0/4187674408":"2020-07-17T13:29:51.583848+0000","172.21.15.132:0/1086302082":"2020-07-17T13:29:51.583848+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-07-16T13:34:05.966 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:05 smithi132 bash[23299]: audit 2020-07-16T13:34:05.552373+0000 mon.c (mon.1) 12 : audit [DBG] from='client.? 172.21.15.132:0/1277462175' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2020-07-16T13:34:06.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:05 smithi132 bash[27079]: audit 2020-07-16T13:34:05.552373+0000 mon.c (mon.1) 12 : audit [DBG] from='client.? 172.21.15.132:0/1277462175' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2020-07-16T13:34:06.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:05 smithi188 bash[23329]: audit 2020-07-16T13:34:05.552373+0000 mon.c (mon.1) 12 : audit [DBG] from='client.? 172.21.15.132:0/1277462175' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2020-07-16T13:34:06.866 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-07-16T13:29:44.933278+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}] 2020-07-16T13:34:06.867 INFO:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 4c8ed362-c768-11ea-a06f-001a4aab830c -- ceph osd pool get device_health_metrics pg_num 2020-07-16T13:34:07.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:06 smithi132 bash[23299]: cluster 2020-07-16T13:34:05.731404+0000 mgr.y (mgr.14140) 162 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:07.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:06 smithi132 bash[27079]: cluster 2020-07-16T13:34:05.731404+0000 mgr.y (mgr.14140) 162 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:07.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:06 smithi188 bash[23329]: cluster 2020-07-16T13:34:05.731404+0000 mgr.y (mgr.14140) 162 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:09.014 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:08 smithi132 bash[23299]: cluster 2020-07-16T13:34:07.731880+0000 mgr.y (mgr.14140) 163 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:09.015 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:08 smithi132 bash[27079]: cluster 2020-07-16T13:34:07.731880+0000 mgr.y (mgr.14140) 163 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:09.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:08 smithi188 bash[23329]: cluster 2020-07-16T13:34:07.731880+0000 mgr.y (mgr.14140) 163 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:10.925 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:10 smithi188 bash[23329]: cluster 2020-07-16T13:34:09.732503+0000 mgr.y (mgr.14140) 164 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:10.967 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:10 smithi132 bash[23299]: cluster 2020-07-16T13:34:09.732503+0000 mgr.y (mgr.14140) 164 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:10.967 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:10 smithi132 bash[27079]: cluster 2020-07-16T13:34:09.732503+0000 mgr.y (mgr.14140) 164 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:11.546 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2020-07-16T13:34:11.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:11 smithi188 bash[23329]: audit 2020-07-16T13:34:11.540980+0000 mon.c (mon.1) 13 : audit [DBG] from='client.? 172.21.15.132:0/622226725' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2020-07-16T13:34:11.964 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:11 smithi132 bash[27079]: audit 2020-07-16T13:34:11.540980+0000 mon.c (mon.1) 13 : audit [DBG] from='client.? 172.21.15.132:0/622226725' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2020-07-16T13:34:11.965 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:11 smithi132 bash[23299]: audit 2020-07-16T13:34:11.540980+0000 mon.c (mon.1) 13 : audit [DBG] from='client.? 172.21.15.132:0/622226725' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2020-07-16T13:34:12.103 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2020-07-16T13:34:12.105 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2020-07-16T13:34:12.105 INFO:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 4c8ed362-c768-11ea-a06f-001a4aab830c -- ceph mgr dump --format=json 2020-07-16T13:34:12.765 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:12 smithi132 bash[27079]: cluster 2020-07-16T13:34:11.732762+0000 mgr.y (mgr.14140) 165 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:12.765 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:12 smithi132 bash[23299]: cluster 2020-07-16T13:34:11.732762+0000 mgr.y (mgr.14140) 165 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:12.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:12 smithi188 bash[23329]: cluster 2020-07-16T13:34:11.732762+0000 mgr.y (mgr.14140) 165 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:13.029 INFO:journalctl@ceph.alertmanager.a.smithi132.stdout:Jul 16 13:34:12 smithi132 podman[3453]: Error: no container with name or ID ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-alertmanager.a found: no such container 2020-07-16T13:34:13.029 INFO:journalctl@ceph.alertmanager.a.smithi132.stdout:Jul 16 13:34:12 smithi132 systemd[1]: Started Ceph alertmanager.a for 4c8ed362-c768-11ea-a06f-001a4aab830c. 2020-07-16T13:34:13.529 INFO:journalctl@ceph.alertmanager.a.smithi132.stdout:Jul 16 13:34:13 smithi132 podman[3473]: 2020-07-16 13:34:13.191501625 +0000 UTC m=+0.251687382 container create f3982ed084323ee8c7d96210dd7d0771cfee2683c07d09751299f34d40bd6e72 (image=docker.io/prom/alertmanager:latest, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-alertmanager.a) 2020-07-16T13:34:13.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:13 smithi188 bash[23329]: audit 2020-07-16T13:34:12.958399+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.059946\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060034\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060063\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060113\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060142\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060170\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060198\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"hostname\": \"smithi132\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060225\", \"created\": \"2020-07-16T13:33:57.978389\"}, \"alertmanager.a\": {\"hostname\": \"smithi132\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:34:03.394122\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:34:13.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:13 smithi188 bash[23329]: audit 2020-07-16T13:34:12.964640+0000 mon.a (mon.0) 532 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.059946\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060034\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060063\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060113\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060142\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060170\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060198\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"hostname\": \"smithi132\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060225\", \"created\": \"2020-07-16T13:33:57.978389\"}, \"alertmanager.a\": {\"hostname\": \"smithi132\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:34:03.394122\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:34:13.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:13 smithi188 bash[23329]: audit 2020-07-16T13:34:13.031341+0000 mon.a (mon.0) 533 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxjCCAa4CEQDMjtaHii9H5qvFY9tOw9RSMA0GCSqGSIb3DQEBDQUAMCExDTAL\nBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0wHhcNMjAwNzE2MTMzNDEzWhcN\nMzAwNzE0MTMzNDEzWjAhMQ0wCwYDVQQKDARDZXBoMRAwDgYDVQQDDAdjZXBoYWRt\nMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEArE2LJzDc8Bs7ZFHsMJk1\n5mbaQ2IwdiMjzXgM56L9x1EhwBqUeHps585kE9HTDg7Exd8UC3y37AXt32Bd+088\nVjbkMq9awF/W7xxniEfU+o8BlIlu1WuhSqIm/AdAUf86C/qCbHb7HmiG1jAPazW8\noq3mvXee1lvMETCNxs2Glw2Lrd1daX9dlgMm4yQ9j59gJ15LWa1F4gANWj3U4//w\nkbnxu30Xv/4dX5DlpbP2t8M/CUnJtSxbVaVbYLZkRmf1TkpSQK1JkwxvlKo95ZOD\nwK4jdoJBwU/H8F3OdEQZyluSmGsf2qgdprP8ouxqtTSps/DUeX6mzzjcwsr9CSZX\ntQIDAQABMA0GCSqGSIb3DQEBDQUAA4IBAQAgilH0VzmVfOUB55Hy0dnNH+Cuooam\nmqUcDKIvxoCX/gL24LHCbHlTt0tV6TvZpxBwb3Gt1YZ+nACoxRBT2CdKwxPC2Y4z\nqA/FJ1q53/bjzl/eM0o2a7dNZtp69cqCBZw+05VU7UzLTL4kcDYhcCkHrm9hoBxD\ngb4fHyWAWJPvoTPg1BpyN8agsMxsVNbMkuqjZPw2ONp4lr4rGs18go8mAtlhLLjU\nlqWBc+4PN0y1/VoZllqv79Kmr3ijX2iCx/fVcM70HoCwKw+4qtmUKAeuAtx79nnM\nDbHuzMMI/ougWHv5PHX4SOeZJnCzEOz02kCY+e8PMqMLfBl1ZsLkTH64\n-----END CERTIFICATE-----\n"}]: dispatch 2020-07-16T13:34:13.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:13 smithi188 bash[23329]: audit 2020-07-16T13:34:13.036335+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxjCCAa4CEQDMjtaHii9H5qvFY9tOw9RSMA0GCSqGSIb3DQEBDQUAMCExDTAL\nBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0wHhcNMjAwNzE2MTMzNDEzWhcN\nMzAwNzE0MTMzNDEzWjAhMQ0wCwYDVQQKDARDZXBoMRAwDgYDVQQDDAdjZXBoYWRt\nMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEArE2LJzDc8Bs7ZFHsMJk1\n5mbaQ2IwdiMjzXgM56L9x1EhwBqUeHps585kE9HTDg7Exd8UC3y37AXt32Bd+088\nVjbkMq9awF/W7xxniEfU+o8BlIlu1WuhSqIm/AdAUf86C/qCbHb7HmiG1jAPazW8\noq3mvXee1lvMETCNxs2Glw2Lrd1daX9dlgMm4yQ9j59gJ15LWa1F4gANWj3U4//w\nkbnxu30Xv/4dX5DlpbP2t8M/CUnJtSxbVaVbYLZkRmf1TkpSQK1JkwxvlKo95ZOD\nwK4jdoJBwU/H8F3OdEQZyluSmGsf2qgdprP8ouxqtTSps/DUeX6mzzjcwsr9CSZX\ntQIDAQABMA0GCSqGSIb3DQEBDQUAA4IBAQAgilH0VzmVfOUB55Hy0dnNH+Cuooam\nmqUcDKIvxoCX/gL24LHCbHlTt0tV6TvZpxBwb3Gt1YZ+nACoxRBT2CdKwxPC2Y4z\nqA/FJ1q53/bjzl/eM0o2a7dNZtp69cqCBZw+05VU7UzLTL4kcDYhcCkHrm9hoBxD\ngb4fHyWAWJPvoTPg1BpyN8agsMxsVNbMkuqjZPw2ONp4lr4rGs18go8mAtlhLLjU\nlqWBc+4PN0y1/VoZllqv79Kmr3ijX2iCx/fVcM70HoCwKw+4qtmUKAeuAtx79nnM\nDbHuzMMI/ougWHv5PHX4SOeZJnCzEOz02kCY+e8PMqMLfBl1ZsLkTH64\n-----END CERTIFICATE-----\n"}]': finished 2020-07-16T13:34:13.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:13 smithi188 bash[23329]: audit 2020-07-16T13:34:13.036759+0000 mon.a (mon.0) 535 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvQIBADANBgkqhkiG9w0BAQEFAASCBKcwggSjAgEAAoIBAQCsTYsnMNzwGztk\nUewwmTXmZtpDYjB2IyPNeAznov3HUSHAGpR4emznzmQT0dMODsTF3xQLfLfsBe3f\nYF37TzxWNuQyr1rAX9bvHGeIR9T6jwGUiW7Va6FKoib8B0BR/zoL+oJsdvseaIbW\nMA9rNbyirea9d57WW8wRMI3GzYaXDYut3V1pf12WAybjJD2Pn2AnXktZrUXiAA1a\nPdTj//CRufG7fRe//h1fkOWls/a3wz8JScm1LFtVpVtgtmRGZ/VOSlJArUmTDG+U\nqj3lk4PAriN2gkHBT8fwXc50RBnKW5KYax/aqB2ms/yi7Gq1NKmz8NR5fqbPONzC\nyv0JJle1AgMBAAECggEAUYSGV05Y2QgpOzc/BWcXByCWFtc3kkzhvW4UvOpyIoCR\n9S8eGzngmHMfCfl1XutB0VPPSfgBlBriBZK0JBfCtg9WO1yXFPjC2XGY0fMaIkjS\nOJIk67f2ITdCNm6/0YtszQoB9or8F9DgKimmwdQ0oMqhpfYYIdZgX6mXCf1mtcOd\n+z/OETkXNE9wfkksN01fSs0kHGgdiJgVrUGq8lKLksZtyx6XZ4Os6KsjTc6ve/na\nb5dmlPaHFDpGYHttgugNd7IK2HYqBepgqWB6Kd+rvKQthQPgXdPUEZ5FZUL6OuiZ\nbII8nWVF6ru/aLkBcvQEy9R2cDI7AMfJ+zsYt0y56QKBgQDZ1nqhAgTB0BJN0KJh\ncTCTQIU9hUjU4NC8HIBEJ5XqS3OUsJ2d7AUzzai0j1wh7Ly1X2hq8UyH4vLq0EF7\ni3ViPer2ee6FvUK+4LrMjgD4bDfgYXjW0mdMXzSA7w/fxt36cpAyR8GHg2oTdFSG\n5yRtOa9I+pLPMRhiTTCZ5zSQgwKBgQDKfO36iK1IfKauhU7UqulnbafnbJ+KrSdW\n4KVfS92/fTrZZ7SanzAlB7n0rNeQiibVabqc5nnsn7/oxa3x4Cva0JIQtFMt4Wje\nwmydVGMF88/98v36trrCXNACTspy70Wc3IYoaZYXc1ifajOa+7Wl+t1ohBWTuYPp\ntxFleWKRZwKBgEN/jOHk8Tpo0bMg6Z/N5eJKxL5qVUX5H1SadDgqF+7QUFELZNtx\nLa9+kz7XiRHN/C8rD/zLJg6ZCPIvc4rnjIjTbMHQyFLScSMaGWeWvMA9MBcrvLi7\n21wzx94HtWB+i3u2Ee4yg8oMs0qx6hse9g+OJz0yv1jJ+qdDCcM2e/gnAoGAHttI\n3KvlVC2CrQetiqT86oEAXDjmWxil7QxQxyPlh9/KjwTJteJaUNpLkSihtOoInu78\nvBo3LELv2MX/CuPxaufrylXgcxZth7yzFoqciHSuFnHoGEOuVB4WqLNfEIK75fqJ\nCzGD6NDwCWMCuDRxavi+ssWmEBvuKTh3kzIbPjMCgYEAtp2gU6PihRJ1/mTxZdLt\nbTGB4ZONrvVspdCHzS/q7WoViUqM32Q+UzjaiEQ+hE7nRnUhMGYr0Bd7ZprZS7j1\nfGrHWsJdrEP/faPx57rQKc2NeZTw2gd2idJu96m3QoULSz5QmRCA+9HgtatCUA/m\nr8Q6GI+OvHVkQMy83bDMPZs=\n-----END PRIVATE KEY-----\n"}]: dispatch 2020-07-16T13:34:13.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:13 smithi188 bash[23329]: audit 2020-07-16T13:34:13.041729+0000 mon.a (mon.0) 536 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvQIBADANBgkqhkiG9w0BAQEFAASCBKcwggSjAgEAAoIBAQCsTYsnMNzwGztk\nUewwmTXmZtpDYjB2IyPNeAznov3HUSHAGpR4emznzmQT0dMODsTF3xQLfLfsBe3f\nYF37TzxWNuQyr1rAX9bvHGeIR9T6jwGUiW7Va6FKoib8B0BR/zoL+oJsdvseaIbW\nMA9rNbyirea9d57WW8wRMI3GzYaXDYut3V1pf12WAybjJD2Pn2AnXktZrUXiAA1a\nPdTj//CRufG7fRe//h1fkOWls/a3wz8JScm1LFtVpVtgtmRGZ/VOSlJArUmTDG+U\nqj3lk4PAriN2gkHBT8fwXc50RBnKW5KYax/aqB2ms/yi7Gq1NKmz8NR5fqbPONzC\nyv0JJle1AgMBAAECggEAUYSGV05Y2QgpOzc/BWcXByCWFtc3kkzhvW4UvOpyIoCR\n9S8eGzngmHMfCfl1XutB0VPPSfgBlBriBZK0JBfCtg9WO1yXFPjC2XGY0fMaIkjS\nOJIk67f2ITdCNm6/0YtszQoB9or8F9DgKimmwdQ0oMqhpfYYIdZgX6mXCf1mtcOd\n+z/OETkXNE9wfkksN01fSs0kHGgdiJgVrUGq8lKLksZtyx6XZ4Os6KsjTc6ve/na\nb5dmlPaHFDpGYHttgugNd7IK2HYqBepgqWB6Kd+rvKQthQPgXdPUEZ5FZUL6OuiZ\nbII8nWVF6ru/aLkBcvQEy9R2cDI7AMfJ+zsYt0y56QKBgQDZ1nqhAgTB0BJN0KJh\ncTCTQIU9hUjU4NC8HIBEJ5XqS3OUsJ2d7AUzzai0j1wh7Ly1X2hq8UyH4vLq0EF7\ni3ViPer2ee6FvUK+4LrMjgD4bDfgYXjW0mdMXzSA7w/fxt36cpAyR8GHg2oTdFSG\n5yRtOa9I+pLPMRhiTTCZ5zSQgwKBgQDKfO36iK1IfKauhU7UqulnbafnbJ+KrSdW\n4KVfS92/fTrZZ7SanzAlB7n0rNeQiibVabqc5nnsn7/oxa3x4Cva0JIQtFMt4Wje\nwmydVGMF88/98v36trrCXNACTspy70Wc3IYoaZYXc1ifajOa+7Wl+t1ohBWTuYPp\ntxFleWKRZwKBgEN/jOHk8Tpo0bMg6Z/N5eJKxL5qVUX5H1SadDgqF+7QUFELZNtx\nLa9+kz7XiRHN/C8rD/zLJg6ZCPIvc4rnjIjTbMHQyFLScSMaGWeWvMA9MBcrvLi7\n21wzx94HtWB+i3u2Ee4yg8oMs0qx6hse9g+OJz0yv1jJ+qdDCcM2e/gnAoGAHttI\n3KvlVC2CrQetiqT86oEAXDjmWxil7QxQxyPlh9/KjwTJteJaUNpLkSihtOoInu78\nvBo3LELv2MX/CuPxaufrylXgcxZth7yzFoqciHSuFnHoGEOuVB4WqLNfEIK75fqJ\nCzGD6NDwCWMCuDRxavi+ssWmEBvuKTh3kzIbPjMCgYEAtp2gU6PihRJ1/mTxZdLt\nbTGB4ZONrvVspdCHzS/q7WoViUqM32Q+UzjaiEQ+hE7nRnUhMGYr0Bd7ZprZS7j1\nfGrHWsJdrEP/faPx57rQKc2NeZTw2gd2idJu96m3QoULSz5QmRCA+9HgtatCUA/m\nr8Q6GI+OvHVkQMy83bDMPZs=\n-----END PRIVATE KEY-----\n"}]': finished 2020-07-16T13:34:14.022 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:13 smithi132 bash[23299]: audit 2020-07-16T13:34:12.958399+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.059946\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060034\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060063\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060113\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060142\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060170\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060198\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"hostname\": \"smithi132\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060225\", \"created\": \"2020-07-16T13:33:57.978389\"}, \"alertmanager.a\": {\"hostname\": \"smithi132\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:34:03.394122\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:34:14.023 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:13 smithi132 bash[23299]: audit 2020-07-16T13:34:12.964640+0000 mon.a (mon.0) 532 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.059946\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060034\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060063\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060113\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060142\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060170\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060198\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"hostname\": \"smithi132\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060225\", \"created\": \"2020-07-16T13:33:57.978389\"}, \"alertmanager.a\": {\"hostname\": \"smithi132\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:34:03.394122\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:34:14.023 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:13 smithi132 bash[23299]: audit 2020-07-16T13:34:13.031341+0000 mon.a (mon.0) 533 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxjCCAa4CEQDMjtaHii9H5qvFY9tOw9RSMA0GCSqGSIb3DQEBDQUAMCExDTAL\nBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0wHhcNMjAwNzE2MTMzNDEzWhcN\nMzAwNzE0MTMzNDEzWjAhMQ0wCwYDVQQKDARDZXBoMRAwDgYDVQQDDAdjZXBoYWRt\nMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEArE2LJzDc8Bs7ZFHsMJk1\n5mbaQ2IwdiMjzXgM56L9x1EhwBqUeHps585kE9HTDg7Exd8UC3y37AXt32Bd+088\nVjbkMq9awF/W7xxniEfU+o8BlIlu1WuhSqIm/AdAUf86C/qCbHb7HmiG1jAPazW8\noq3mvXee1lvMETCNxs2Glw2Lrd1daX9dlgMm4yQ9j59gJ15LWa1F4gANWj3U4//w\nkbnxu30Xv/4dX5DlpbP2t8M/CUnJtSxbVaVbYLZkRmf1TkpSQK1JkwxvlKo95ZOD\nwK4jdoJBwU/H8F3OdEQZyluSmGsf2qgdprP8ouxqtTSps/DUeX6mzzjcwsr9CSZX\ntQIDAQABMA0GCSqGSIb3DQEBDQUAA4IBAQAgilH0VzmVfOUB55Hy0dnNH+Cuooam\nmqUcDKIvxoCX/gL24LHCbHlTt0tV6TvZpxBwb3Gt1YZ+nACoxRBT2CdKwxPC2Y4z\nqA/FJ1q53/bjzl/eM0o2a7dNZtp69cqCBZw+05VU7UzLTL4kcDYhcCkHrm9hoBxD\ngb4fHyWAWJPvoTPg1BpyN8agsMxsVNbMkuqjZPw2ONp4lr4rGs18go8mAtlhLLjU\nlqWBc+4PN0y1/VoZllqv79Kmr3ijX2iCx/fVcM70HoCwKw+4qtmUKAeuAtx79nnM\nDbHuzMMI/ougWHv5PHX4SOeZJnCzEOz02kCY+e8PMqMLfBl1ZsLkTH64\n-----END CERTIFICATE-----\n"}]: dispatch 2020-07-16T13:34:14.024 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:13 smithi132 bash[23299]: audit 2020-07-16T13:34:13.036335+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxjCCAa4CEQDMjtaHii9H5qvFY9tOw9RSMA0GCSqGSIb3DQEBDQUAMCExDTAL\nBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0wHhcNMjAwNzE2MTMzNDEzWhcN\nMzAwNzE0MTMzNDEzWjAhMQ0wCwYDVQQKDARDZXBoMRAwDgYDVQQDDAdjZXBoYWRt\nMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEArE2LJzDc8Bs7ZFHsMJk1\n5mbaQ2IwdiMjzXgM56L9x1EhwBqUeHps585kE9HTDg7Exd8UC3y37AXt32Bd+088\nVjbkMq9awF/W7xxniEfU+o8BlIlu1WuhSqIm/AdAUf86C/qCbHb7HmiG1jAPazW8\noq3mvXee1lvMETCNxs2Glw2Lrd1daX9dlgMm4yQ9j59gJ15LWa1F4gANWj3U4//w\nkbnxu30Xv/4dX5DlpbP2t8M/CUnJtSxbVaVbYLZkRmf1TkpSQK1JkwxvlKo95ZOD\nwK4jdoJBwU/H8F3OdEQZyluSmGsf2qgdprP8ouxqtTSps/DUeX6mzzjcwsr9CSZX\ntQIDAQABMA0GCSqGSIb3DQEBDQUAA4IBAQAgilH0VzmVfOUB55Hy0dnNH+Cuooam\nmqUcDKIvxoCX/gL24LHCbHlTt0tV6TvZpxBwb3Gt1YZ+nACoxRBT2CdKwxPC2Y4z\nqA/FJ1q53/bjzl/eM0o2a7dNZtp69cqCBZw+05VU7UzLTL4kcDYhcCkHrm9hoBxD\ngb4fHyWAWJPvoTPg1BpyN8agsMxsVNbMkuqjZPw2ONp4lr4rGs18go8mAtlhLLjU\nlqWBc+4PN0y1/VoZllqv79Kmr3ijX2iCx/fVcM70HoCwKw+4qtmUKAeuAtx79nnM\nDbHuzMMI/ougWHv5PHX4SOeZJnCzEOz02kCY+e8PMqMLfBl1ZsLkTH64\n-----END CERTIFICATE-----\n"}]': finished 2020-07-16T13:34:14.024 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:13 smithi132 bash[23299]: audit 2020-07-16T13:34:13.036759+0000 mon.a (mon.0) 535 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvQIBADANBgkqhkiG9w0BAQEFAASCBKcwggSjAgEAAoIBAQCsTYsnMNzwGztk\nUewwmTXmZtpDYjB2IyPNeAznov3HUSHAGpR4emznzmQT0dMODsTF3xQLfLfsBe3f\nYF37TzxWNuQyr1rAX9bvHGeIR9T6jwGUiW7Va6FKoib8B0BR/zoL+oJsdvseaIbW\nMA9rNbyirea9d57WW8wRMI3GzYaXDYut3V1pf12WAybjJD2Pn2AnXktZrUXiAA1a\nPdTj//CRufG7fRe//h1fkOWls/a3wz8JScm1LFtVpVtgtmRGZ/VOSlJArUmTDG+U\nqj3lk4PAriN2gkHBT8fwXc50RBnKW5KYax/aqB2ms/yi7Gq1NKmz8NR5fqbPONzC\nyv0JJle1AgMBAAECggEAUYSGV05Y2QgpOzc/BWcXByCWFtc3kkzhvW4UvOpyIoCR\n9S8eGzngmHMfCfl1XutB0VPPSfgBlBriBZK0JBfCtg9WO1yXFPjC2XGY0fMaIkjS\nOJIk67f2ITdCNm6/0YtszQoB9or8F9DgKimmwdQ0oMqhpfYYIdZgX6mXCf1mtcOd\n+z/OETkXNE9wfkksN01fSs0kHGgdiJgVrUGq8lKLksZtyx6XZ4Os6KsjTc6ve/na\nb5dmlPaHFDpGYHttgugNd7IK2HYqBepgqWB6Kd+rvKQthQPgXdPUEZ5FZUL6OuiZ\nbII8nWVF6ru/aLkBcvQEy9R2cDI7AMfJ+zsYt0y56QKBgQDZ1nqhAgTB0BJN0KJh\ncTCTQIU9hUjU4NC8HIBEJ5XqS3OUsJ2d7AUzzai0j1wh7Ly1X2hq8UyH4vLq0EF7\ni3ViPer2ee6FvUK+4LrMjgD4bDfgYXjW0mdMXzSA7w/fxt36cpAyR8GHg2oTdFSG\n5yRtOa9I+pLPMRhiTTCZ5zSQgwKBgQDKfO36iK1IfKauhU7UqulnbafnbJ+KrSdW\n4KVfS92/fTrZZ7SanzAlB7n0rNeQiibVabqc5nnsn7/oxa3x4Cva0JIQtFMt4Wje\nwmydVGMF88/98v36trrCXNACTspy70Wc3IYoaZYXc1ifajOa+7Wl+t1ohBWTuYPp\ntxFleWKRZwKBgEN/jOHk8Tpo0bMg6Z/N5eJKxL5qVUX5H1SadDgqF+7QUFELZNtx\nLa9+kz7XiRHN/C8rD/zLJg6ZCPIvc4rnjIjTbMHQyFLScSMaGWeWvMA9MBcrvLi7\n21wzx94HtWB+i3u2Ee4yg8oMs0qx6hse9g+OJz0yv1jJ+qdDCcM2e/gnAoGAHttI\n3KvlVC2CrQetiqT86oEAXDjmWxil7QxQxyPlh9/KjwTJteJaUNpLkSihtOoInu78\nvBo3LELv2MX/CuPxaufrylXgcxZth7yzFoqciHSuFnHoGEOuVB4WqLNfEIK75fqJ\nCzGD6NDwCWMCuDRxavi+ssWmEBvuKTh3kzIbPjMCgYEAtp2gU6PihRJ1/mTxZdLt\nbTGB4ZONrvVspdCHzS/q7WoViUqM32Q+UzjaiEQ+hE7nRnUhMGYr0Bd7ZprZS7j1\nfGrHWsJdrEP/faPx57rQKc2NeZTw2gd2idJu96m3QoULSz5QmRCA+9HgtatCUA/m\nr8Q6GI+OvHVkQMy83bDMPZs=\n-----END PRIVATE KEY-----\n"}]: dispatch 2020-07-16T13:34:14.024 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:13 smithi132 bash[23299]: audit 2020-07-16T13:34:13.041729+0000 mon.a (mon.0) 536 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvQIBADANBgkqhkiG9w0BAQEFAASCBKcwggSjAgEAAoIBAQCsTYsnMNzwGztk\nUewwmTXmZtpDYjB2IyPNeAznov3HUSHAGpR4emznzmQT0dMODsTF3xQLfLfsBe3f\nYF37TzxWNuQyr1rAX9bvHGeIR9T6jwGUiW7Va6FKoib8B0BR/zoL+oJsdvseaIbW\nMA9rNbyirea9d57WW8wRMI3GzYaXDYut3V1pf12WAybjJD2Pn2AnXktZrUXiAA1a\nPdTj//CRufG7fRe//h1fkOWls/a3wz8JScm1LFtVpVtgtmRGZ/VOSlJArUmTDG+U\nqj3lk4PAriN2gkHBT8fwXc50RBnKW5KYax/aqB2ms/yi7Gq1NKmz8NR5fqbPONzC\nyv0JJle1AgMBAAECggEAUYSGV05Y2QgpOzc/BWcXByCWFtc3kkzhvW4UvOpyIoCR\n9S8eGzngmHMfCfl1XutB0VPPSfgBlBriBZK0JBfCtg9WO1yXFPjC2XGY0fMaIkjS\nOJIk67f2ITdCNm6/0YtszQoB9or8F9DgKimmwdQ0oMqhpfYYIdZgX6mXCf1mtcOd\n+z/OETkXNE9wfkksN01fSs0kHGgdiJgVrUGq8lKLksZtyx6XZ4Os6KsjTc6ve/na\nb5dmlPaHFDpGYHttgugNd7IK2HYqBepgqWB6Kd+rvKQthQPgXdPUEZ5FZUL6OuiZ\nbII8nWVF6ru/aLkBcvQEy9R2cDI7AMfJ+zsYt0y56QKBgQDZ1nqhAgTB0BJN0KJh\ncTCTQIU9hUjU4NC8HIBEJ5XqS3OUsJ2d7AUzzai0j1wh7Ly1X2hq8UyH4vLq0EF7\ni3ViPer2ee6FvUK+4LrMjgD4bDfgYXjW0mdMXzSA7w/fxt36cpAyR8GHg2oTdFSG\n5yRtOa9I+pLPMRhiTTCZ5zSQgwKBgQDKfO36iK1IfKauhU7UqulnbafnbJ+KrSdW\n4KVfS92/fTrZZ7SanzAlB7n0rNeQiibVabqc5nnsn7/oxa3x4Cva0JIQtFMt4Wje\nwmydVGMF88/98v36trrCXNACTspy70Wc3IYoaZYXc1ifajOa+7Wl+t1ohBWTuYPp\ntxFleWKRZwKBgEN/jOHk8Tpo0bMg6Z/N5eJKxL5qVUX5H1SadDgqF+7QUFELZNtx\nLa9+kz7XiRHN/C8rD/zLJg6ZCPIvc4rnjIjTbMHQyFLScSMaGWeWvMA9MBcrvLi7\n21wzx94HtWB+i3u2Ee4yg8oMs0qx6hse9g+OJz0yv1jJ+qdDCcM2e/gnAoGAHttI\n3KvlVC2CrQetiqT86oEAXDjmWxil7QxQxyPlh9/KjwTJteJaUNpLkSihtOoInu78\nvBo3LELv2MX/CuPxaufrylXgcxZth7yzFoqciHSuFnHoGEOuVB4WqLNfEIK75fqJ\nCzGD6NDwCWMCuDRxavi+ssWmEBvuKTh3kzIbPjMCgYEAtp2gU6PihRJ1/mTxZdLt\nbTGB4ZONrvVspdCHzS/q7WoViUqM32Q+UzjaiEQ+hE7nRnUhMGYr0Bd7ZprZS7j1\nfGrHWsJdrEP/faPx57rQKc2NeZTw2gd2idJu96m3QoULSz5QmRCA+9HgtatCUA/m\nr8Q6GI+OvHVkQMy83bDMPZs=\n-----END PRIVATE KEY-----\n"}]': finished 2020-07-16T13:34:14.024 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:13 smithi132 bash[27079]: audit 2020-07-16T13:34:12.958399+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.059946\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060034\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060063\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060113\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060142\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060170\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060198\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"hostname\": \"smithi132\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060225\", \"created\": \"2020-07-16T13:33:57.978389\"}, \"alertmanager.a\": {\"hostname\": \"smithi132\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:34:03.394122\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:34:14.025 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:13 smithi132 bash[27079]: audit 2020-07-16T13:34:12.964640+0000 mon.a (mon.0) 532 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.059946\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060034\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060063\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060113\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060142\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060170\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060198\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"hostname\": \"smithi132\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:33:59.060225\", \"created\": \"2020-07-16T13:33:57.978389\"}, \"alertmanager.a\": {\"hostname\": \"smithi132\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:34:03.394122\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:34:14.025 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:13 smithi132 bash[27079]: audit 2020-07-16T13:34:13.031341+0000 mon.a (mon.0) 533 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxjCCAa4CEQDMjtaHii9H5qvFY9tOw9RSMA0GCSqGSIb3DQEBDQUAMCExDTAL\nBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0wHhcNMjAwNzE2MTMzNDEzWhcN\nMzAwNzE0MTMzNDEzWjAhMQ0wCwYDVQQKDARDZXBoMRAwDgYDVQQDDAdjZXBoYWRt\nMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEArE2LJzDc8Bs7ZFHsMJk1\n5mbaQ2IwdiMjzXgM56L9x1EhwBqUeHps585kE9HTDg7Exd8UC3y37AXt32Bd+088\nVjbkMq9awF/W7xxniEfU+o8BlIlu1WuhSqIm/AdAUf86C/qCbHb7HmiG1jAPazW8\noq3mvXee1lvMETCNxs2Glw2Lrd1daX9dlgMm4yQ9j59gJ15LWa1F4gANWj3U4//w\nkbnxu30Xv/4dX5DlpbP2t8M/CUnJtSxbVaVbYLZkRmf1TkpSQK1JkwxvlKo95ZOD\nwK4jdoJBwU/H8F3OdEQZyluSmGsf2qgdprP8ouxqtTSps/DUeX6mzzjcwsr9CSZX\ntQIDAQABMA0GCSqGSIb3DQEBDQUAA4IBAQAgilH0VzmVfOUB55Hy0dnNH+Cuooam\nmqUcDKIvxoCX/gL24LHCbHlTt0tV6TvZpxBwb3Gt1YZ+nACoxRBT2CdKwxPC2Y4z\nqA/FJ1q53/bjzl/eM0o2a7dNZtp69cqCBZw+05VU7UzLTL4kcDYhcCkHrm9hoBxD\ngb4fHyWAWJPvoTPg1BpyN8agsMxsVNbMkuqjZPw2ONp4lr4rGs18go8mAtlhLLjU\nlqWBc+4PN0y1/VoZllqv79Kmr3ijX2iCx/fVcM70HoCwKw+4qtmUKAeuAtx79nnM\nDbHuzMMI/ougWHv5PHX4SOeZJnCzEOz02kCY+e8PMqMLfBl1ZsLkTH64\n-----END CERTIFICATE-----\n"}]: dispatch 2020-07-16T13:34:14.025 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:13 smithi132 bash[27079]: audit 2020-07-16T13:34:13.036335+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxjCCAa4CEQDMjtaHii9H5qvFY9tOw9RSMA0GCSqGSIb3DQEBDQUAMCExDTAL\nBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0wHhcNMjAwNzE2MTMzNDEzWhcN\nMzAwNzE0MTMzNDEzWjAhMQ0wCwYDVQQKDARDZXBoMRAwDgYDVQQDDAdjZXBoYWRt\nMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEArE2LJzDc8Bs7ZFHsMJk1\n5mbaQ2IwdiMjzXgM56L9x1EhwBqUeHps585kE9HTDg7Exd8UC3y37AXt32Bd+088\nVjbkMq9awF/W7xxniEfU+o8BlIlu1WuhSqIm/AdAUf86C/qCbHb7HmiG1jAPazW8\noq3mvXee1lvMETCNxs2Glw2Lrd1daX9dlgMm4yQ9j59gJ15LWa1F4gANWj3U4//w\nkbnxu30Xv/4dX5DlpbP2t8M/CUnJtSxbVaVbYLZkRmf1TkpSQK1JkwxvlKo95ZOD\nwK4jdoJBwU/H8F3OdEQZyluSmGsf2qgdprP8ouxqtTSps/DUeX6mzzjcwsr9CSZX\ntQIDAQABMA0GCSqGSIb3DQEBDQUAA4IBAQAgilH0VzmVfOUB55Hy0dnNH+Cuooam\nmqUcDKIvxoCX/gL24LHCbHlTt0tV6TvZpxBwb3Gt1YZ+nACoxRBT2CdKwxPC2Y4z\nqA/FJ1q53/bjzl/eM0o2a7dNZtp69cqCBZw+05VU7UzLTL4kcDYhcCkHrm9hoBxD\ngb4fHyWAWJPvoTPg1BpyN8agsMxsVNbMkuqjZPw2ONp4lr4rGs18go8mAtlhLLjU\nlqWBc+4PN0y1/VoZllqv79Kmr3ijX2iCx/fVcM70HoCwKw+4qtmUKAeuAtx79nnM\nDbHuzMMI/ougWHv5PHX4SOeZJnCzEOz02kCY+e8PMqMLfBl1ZsLkTH64\n-----END CERTIFICATE-----\n"}]': finished 2020-07-16T13:34:14.026 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:13 smithi132 bash[27079]: audit 2020-07-16T13:34:13.036759+0000 mon.a (mon.0) 535 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvQIBADANBgkqhkiG9w0BAQEFAASCBKcwggSjAgEAAoIBAQCsTYsnMNzwGztk\nUewwmTXmZtpDYjB2IyPNeAznov3HUSHAGpR4emznzmQT0dMODsTF3xQLfLfsBe3f\nYF37TzxWNuQyr1rAX9bvHGeIR9T6jwGUiW7Va6FKoib8B0BR/zoL+oJsdvseaIbW\nMA9rNbyirea9d57WW8wRMI3GzYaXDYut3V1pf12WAybjJD2Pn2AnXktZrUXiAA1a\nPdTj//CRufG7fRe//h1fkOWls/a3wz8JScm1LFtVpVtgtmRGZ/VOSlJArUmTDG+U\nqj3lk4PAriN2gkHBT8fwXc50RBnKW5KYax/aqB2ms/yi7Gq1NKmz8NR5fqbPONzC\nyv0JJle1AgMBAAECggEAUYSGV05Y2QgpOzc/BWcXByCWFtc3kkzhvW4UvOpyIoCR\n9S8eGzngmHMfCfl1XutB0VPPSfgBlBriBZK0JBfCtg9WO1yXFPjC2XGY0fMaIkjS\nOJIk67f2ITdCNm6/0YtszQoB9or8F9DgKimmwdQ0oMqhpfYYIdZgX6mXCf1mtcOd\n+z/OETkXNE9wfkksN01fSs0kHGgdiJgVrUGq8lKLksZtyx6XZ4Os6KsjTc6ve/na\nb5dmlPaHFDpGYHttgugNd7IK2HYqBepgqWB6Kd+rvKQthQPgXdPUEZ5FZUL6OuiZ\nbII8nWVF6ru/aLkBcvQEy9R2cDI7AMfJ+zsYt0y56QKBgQDZ1nqhAgTB0BJN0KJh\ncTCTQIU9hUjU4NC8HIBEJ5XqS3OUsJ2d7AUzzai0j1wh7Ly1X2hq8UyH4vLq0EF7\ni3ViPer2ee6FvUK+4LrMjgD4bDfgYXjW0mdMXzSA7w/fxt36cpAyR8GHg2oTdFSG\n5yRtOa9I+pLPMRhiTTCZ5zSQgwKBgQDKfO36iK1IfKauhU7UqulnbafnbJ+KrSdW\n4KVfS92/fTrZZ7SanzAlB7n0rNeQiibVabqc5nnsn7/oxa3x4Cva0JIQtFMt4Wje\nwmydVGMF88/98v36trrCXNACTspy70Wc3IYoaZYXc1ifajOa+7Wl+t1ohBWTuYPp\ntxFleWKRZwKBgEN/jOHk8Tpo0bMg6Z/N5eJKxL5qVUX5H1SadDgqF+7QUFELZNtx\nLa9+kz7XiRHN/C8rD/zLJg6ZCPIvc4rnjIjTbMHQyFLScSMaGWeWvMA9MBcrvLi7\n21wzx94HtWB+i3u2Ee4yg8oMs0qx6hse9g+OJz0yv1jJ+qdDCcM2e/gnAoGAHttI\n3KvlVC2CrQetiqT86oEAXDjmWxil7QxQxyPlh9/KjwTJteJaUNpLkSihtOoInu78\nvBo3LELv2MX/CuPxaufrylXgcxZth7yzFoqciHSuFnHoGEOuVB4WqLNfEIK75fqJ\nCzGD6NDwCWMCuDRxavi+ssWmEBvuKTh3kzIbPjMCgYEAtp2gU6PihRJ1/mTxZdLt\nbTGB4ZONrvVspdCHzS/q7WoViUqM32Q+UzjaiEQ+hE7nRnUhMGYr0Bd7ZprZS7j1\nfGrHWsJdrEP/faPx57rQKc2NeZTw2gd2idJu96m3QoULSz5QmRCA+9HgtatCUA/m\nr8Q6GI+OvHVkQMy83bDMPZs=\n-----END PRIVATE KEY-----\n"}]: dispatch 2020-07-16T13:34:14.026 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:13 smithi132 bash[27079]: audit 2020-07-16T13:34:13.041729+0000 mon.a (mon.0) 536 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvQIBADANBgkqhkiG9w0BAQEFAASCBKcwggSjAgEAAoIBAQCsTYsnMNzwGztk\nUewwmTXmZtpDYjB2IyPNeAznov3HUSHAGpR4emznzmQT0dMODsTF3xQLfLfsBe3f\nYF37TzxWNuQyr1rAX9bvHGeIR9T6jwGUiW7Va6FKoib8B0BR/zoL+oJsdvseaIbW\nMA9rNbyirea9d57WW8wRMI3GzYaXDYut3V1pf12WAybjJD2Pn2AnXktZrUXiAA1a\nPdTj//CRufG7fRe//h1fkOWls/a3wz8JScm1LFtVpVtgtmRGZ/VOSlJArUmTDG+U\nqj3lk4PAriN2gkHBT8fwXc50RBnKW5KYax/aqB2ms/yi7Gq1NKmz8NR5fqbPONzC\nyv0JJle1AgMBAAECggEAUYSGV05Y2QgpOzc/BWcXByCWFtc3kkzhvW4UvOpyIoCR\n9S8eGzngmHMfCfl1XutB0VPPSfgBlBriBZK0JBfCtg9WO1yXFPjC2XGY0fMaIkjS\nOJIk67f2ITdCNm6/0YtszQoB9or8F9DgKimmwdQ0oMqhpfYYIdZgX6mXCf1mtcOd\n+z/OETkXNE9wfkksN01fSs0kHGgdiJgVrUGq8lKLksZtyx6XZ4Os6KsjTc6ve/na\nb5dmlPaHFDpGYHttgugNd7IK2HYqBepgqWB6Kd+rvKQthQPgXdPUEZ5FZUL6OuiZ\nbII8nWVF6ru/aLkBcvQEy9R2cDI7AMfJ+zsYt0y56QKBgQDZ1nqhAgTB0BJN0KJh\ncTCTQIU9hUjU4NC8HIBEJ5XqS3OUsJ2d7AUzzai0j1wh7Ly1X2hq8UyH4vLq0EF7\ni3ViPer2ee6FvUK+4LrMjgD4bDfgYXjW0mdMXzSA7w/fxt36cpAyR8GHg2oTdFSG\n5yRtOa9I+pLPMRhiTTCZ5zSQgwKBgQDKfO36iK1IfKauhU7UqulnbafnbJ+KrSdW\n4KVfS92/fTrZZ7SanzAlB7n0rNeQiibVabqc5nnsn7/oxa3x4Cva0JIQtFMt4Wje\nwmydVGMF88/98v36trrCXNACTspy70Wc3IYoaZYXc1ifajOa+7Wl+t1ohBWTuYPp\ntxFleWKRZwKBgEN/jOHk8Tpo0bMg6Z/N5eJKxL5qVUX5H1SadDgqF+7QUFELZNtx\nLa9+kz7XiRHN/C8rD/zLJg6ZCPIvc4rnjIjTbMHQyFLScSMaGWeWvMA9MBcrvLi7\n21wzx94HtWB+i3u2Ee4yg8oMs0qx6hse9g+OJz0yv1jJ+qdDCcM2e/gnAoGAHttI\n3KvlVC2CrQetiqT86oEAXDjmWxil7QxQxyPlh9/KjwTJteJaUNpLkSihtOoInu78\nvBo3LELv2MX/CuPxaufrylXgcxZth7yzFoqciHSuFnHoGEOuVB4WqLNfEIK75fqJ\nCzGD6NDwCWMCuDRxavi+ssWmEBvuKTh3kzIbPjMCgYEAtp2gU6PihRJ1/mTxZdLt\nbTGB4ZONrvVspdCHzS/q7WoViUqM32Q+UzjaiEQ+hE7nRnUhMGYr0Bd7ZprZS7j1\nfGrHWsJdrEP/faPx57rQKc2NeZTw2gd2idJu96m3QoULSz5QmRCA+9HgtatCUA/m\nr8Q6GI+OvHVkQMy83bDMPZs=\n-----END PRIVATE KEY-----\n"}]': finished 2020-07-16T13:34:14.026 INFO:journalctl@ceph.alertmanager.a.smithi132.stdout:Jul 16 13:34:13 smithi132 podman[3473]: 2020-07-16 13:34:13.687964637 +0000 UTC m=+0.748150488 container init f3982ed084323ee8c7d96210dd7d0771cfee2683c07d09751299f34d40bd6e72 (image=docker.io/prom/alertmanager:latest, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-alertmanager.a) 2020-07-16T13:34:14.026 INFO:journalctl@ceph.alertmanager.a.smithi132.stdout:Jul 16 13:34:13 smithi132 podman[3473]: 2020-07-16 13:34:13.729543597 +0000 UTC m=+0.789729363 container start f3982ed084323ee8c7d96210dd7d0771cfee2683c07d09751299f34d40bd6e72 (image=docker.io/prom/alertmanager:latest, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-alertmanager.a) 2020-07-16T13:34:14.026 INFO:journalctl@ceph.alertmanager.a.smithi132.stdout:Jul 16 13:34:13 smithi132 podman[3473]: 2020-07-16 13:34:13.729619999 +0000 UTC m=+0.789805771 container attach f3982ed084323ee8c7d96210dd7d0771cfee2683c07d09751299f34d40bd6e72 (image=docker.io/prom/alertmanager:latest, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-alertmanager.a) 2020-07-16T13:34:14.027 INFO:journalctl@ceph.alertmanager.a.smithi132.stdout:Jul 16 13:34:13 smithi132 bash[3471]: level=info ts=2020-07-16T13:34:13.715Z caller=main.go:216 msg="Starting Alertmanager" version="(version=0.21.0, branch=HEAD, revision=4c6c03ebfe21009c546e4d1e9b92c371d67c021d)" 2020-07-16T13:34:14.027 INFO:journalctl@ceph.alertmanager.a.smithi132.stdout:Jul 16 13:34:13 smithi132 bash[3471]: level=info ts=2020-07-16T13:34:13.715Z caller=main.go:217 build_context="(go=go1.14.4, user=root@dee35927357f, date=20200617-08:54:02)" 2020-07-16T13:34:14.027 INFO:journalctl@ceph.alertmanager.a.smithi132.stdout:Jul 16 13:34:13 smithi132 bash[3471]: level=info ts=2020-07-16T13:34:13.715Z caller=cluster.go:161 component=cluster msg="setting advertise address explicitly" addr=172.21.15.132 port=9094 2020-07-16T13:34:14.027 INFO:journalctl@ceph.alertmanager.a.smithi132.stdout:Jul 16 13:34:13 smithi132 bash[3471]: level=info ts=2020-07-16T13:34:13.716Z caller=cluster.go:623 component=cluster msg="Waiting for gossip to settle..." interval=2s 2020-07-16T13:34:14.028 INFO:journalctl@ceph.alertmanager.a.smithi132.stdout:Jul 16 13:34:13 smithi132 bash[3471]: level=info ts=2020-07-16T13:34:13.735Z caller=coordinator.go:119 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2020-07-16T13:34:14.028 INFO:journalctl@ceph.alertmanager.a.smithi132.stdout:Jul 16 13:34:13 smithi132 bash[3471]: level=info ts=2020-07-16T13:34:13.735Z caller=coordinator.go:131 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2020-07-16T13:34:14.028 INFO:journalctl@ceph.alertmanager.a.smithi132.stdout:Jul 16 13:34:13 smithi132 bash[3471]: level=info ts=2020-07-16T13:34:13.737Z caller=main.go:485 msg=Listening address=:9093 2020-07-16T13:34:14.439 INFO:teuthology.orchestra.run.smithi132.stdout: 2020-07-16T13:34:14.779 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:14 smithi132 bash[23299]: cephadm 2020-07-16T13:34:13.042175+0000 mgr.y (mgr.14140) 166 : cephadm [INF] Deploying daemon grafana.a on smithi188 2020-07-16T13:34:14.779 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:14 smithi132 bash[23299]: cluster 2020-07-16T13:34:13.733153+0000 mgr.y (mgr.14140) 167 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:14.780 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:14 smithi132 bash[23299]: audit 2020-07-16T13:34:14.433383+0000 mon.c (mon.1) 14 : audit [DBG] from='client.? 172.21.15.132:0/2961949522' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2020-07-16T13:34:14.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:14 smithi132 bash[27079]: cephadm 2020-07-16T13:34:13.042175+0000 mgr.y (mgr.14140) 166 : cephadm [INF] Deploying daemon grafana.a on smithi188 2020-07-16T13:34:14.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:14 smithi132 bash[27079]: cluster 2020-07-16T13:34:13.733153+0000 mgr.y (mgr.14140) 167 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:14.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:14 smithi132 bash[27079]: audit 2020-07-16T13:34:14.433383+0000 mon.c (mon.1) 14 : audit [DBG] from='client.? 172.21.15.132:0/2961949522' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2020-07-16T13:34:14.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:14 smithi188 bash[23329]: cephadm 2020-07-16T13:34:13.042175+0000 mgr.y (mgr.14140) 166 : cephadm [INF] Deploying daemon grafana.a on smithi188 2020-07-16T13:34:14.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:14 smithi188 bash[23329]: cluster 2020-07-16T13:34:13.733153+0000 mgr.y (mgr.14140) 167 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:14.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:14 smithi188 bash[23329]: audit 2020-07-16T13:34:14.433383+0000 mon.c (mon.1) 14 : audit [DBG] from='client.? 172.21.15.132:0/2961949522' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2020-07-16T13:34:15.023 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":14,"active_gid":14140,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2003123624},{"type":"v1","addr":"172.21.15.132:6801","nonce":2003123624}]},"active_addr":"172.21.15.132:6801/2003123624","active_change":"2020-07-16T13:30:05.629284+0000","active_mgr_features":4540138292836696063,"available":true,"standbys":[{"gid":34109,"name":"x","mgr_features":4540138292836696063,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://smithi132:8443/"},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","osd_support","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":5,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.132:0","nonce":325799022}]},{"addrvec":[{"type":"v2","addr":"172.21.15.132:0","nonce":1632489118}]},{"addrvec":[{"type":"v2","addr":"172.21.15.132:0","nonce":1814811756}]}]}} 2020-07-16T13:34:15.031 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2020-07-16T13:34:15.031 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2020-07-16T13:34:15.032 INFO:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 4c8ed362-c768-11ea-a06f-001a4aab830c -- ceph osd dump --format=json 2020-07-16T13:34:16.029 INFO:journalctl@ceph.alertmanager.a.smithi132.stdout:Jul 16 13:34:15 smithi132 bash[3471]: level=info ts=2020-07-16T13:34:15.716Z caller=cluster.go:648 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000064088s 2020-07-16T13:34:16.774 INFO:teuthology.orchestra.run.smithi132.stdout: 2020-07-16T13:34:16.775 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":51,"fsid":"4c8ed362-c768-11ea-a06f-001a4aab830c","created":"2020-07-16T13:29:34.607108+0000","modified":"2020-07-16T13:33:43.908143+0000","last_up_change":"2020-07-16T13:33:42.899341+0000","last_in_change":"2020-07-16T13:33:42.899341+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-07-16T13:29:44.933278+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"882744a6-1a4e-4c33-86ea-b3ae0c9db141","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":498701893},{"type":"v1","addr":"172.21.15.132:6803","nonce":498701893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":498701893},{"type":"v1","addr":"172.21.15.132:6805","nonce":498701893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":498701893},{"type":"v1","addr":"172.21.15.132:6809","nonce":498701893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":498701893},{"type":"v1","addr":"172.21.15.132:6807","nonce":498701893}]},"public_addr":"172.21.15.132:6803/498701893","cluster_addr":"172.21.15.132:6805/498701893","heartbeat_back_addr":"172.21.15.132:6809/498701893","heartbeat_front_addr":"172.21.15.132:6807/498701893","state":["exists","up"]},{"osd":1,"uuid":"39ea8fcd-c323-4683-9f7c-4f373a4e4f67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":1723454267},{"type":"v1","addr":"172.21.15.132:6811","nonce":1723454267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":1723454267},{"type":"v1","addr":"172.21.15.132:6813","nonce":1723454267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":1723454267},{"type":"v1","addr":"172.21.15.132:6817","nonce":1723454267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":1723454267},{"type":"v1","addr":"172.21.15.132:6815","nonce":1723454267}]},"public_addr":"172.21.15.132:6811/1723454267","cluster_addr":"172.21.15.132:6813/1723454267","heartbeat_back_addr":"172.21.15.132:6817/1723454267","heartbeat_front_addr":"172.21.15.132:6815/1723454267","state":["exists","up"]},{"osd":2,"uuid":"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":2489969657},{"type":"v1","addr":"172.21.15.132:6819","nonce":2489969657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":2489969657},{"type":"v1","addr":"172.21.15.132:6821","nonce":2489969657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":2489969657},{"type":"v1","addr":"172.21.15.132:6825","nonce":2489969657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":2489969657},{"type":"v1","addr":"172.21.15.132:6823","nonce":2489969657}]},"public_addr":"172.21.15.132:6819/2489969657","cluster_addr":"172.21.15.132:6821/2489969657","heartbeat_back_addr":"172.21.15.132:6825/2489969657","heartbeat_front_addr":"172.21.15.132:6823/2489969657","state":["exists","up"]},{"osd":3,"uuid":"72a90982-aa5f-4c26-9afe-50294c5c503b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":3154069775},{"type":"v1","addr":"172.21.15.132:6827","nonce":3154069775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":3154069775},{"type":"v1","addr":"172.21.15.132:6829","nonce":3154069775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":3154069775},{"type":"v1","addr":"172.21.15.132:6833","nonce":3154069775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":3154069775},{"type":"v1","addr":"172.21.15.132:6831","nonce":3154069775}]},"public_addr":"172.21.15.132:6827/3154069775","cluster_addr":"172.21.15.132:6829/3154069775","heartbeat_back_addr":"172.21.15.132:6833/3154069775","heartbeat_front_addr":"172.21.15.132:6831/3154069775","state":["exists","up"]},{"osd":4,"uuid":"78d29045-b36d-4f75-b245-d0f79869b999","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":31,"last_clean_end":33,"up_from":36,"up_thru":0,"down_at":34,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":213465511},{"type":"v1","addr":"172.21.15.188:6801","nonce":213465511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":213465511},{"type":"v1","addr":"172.21.15.188:6803","nonce":213465511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":213465511},{"type":"v1","addr":"172.21.15.188:6807","nonce":213465511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":213465511},{"type":"v1","addr":"172.21.15.188:6805","nonce":213465511}]},"public_addr":"172.21.15.188:6801/213465511","cluster_addr":"172.21.15.188:6803/213465511","heartbeat_back_addr":"172.21.15.188:6807/213465511","heartbeat_front_addr":"172.21.15.188:6805/213465511","state":["exists","up"]},{"osd":5,"uuid":"04a15200-6710-4b02-9351-c321c8619514","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":3799292735},{"type":"v1","addr":"172.21.15.188:6809","nonce":3799292735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":3799292735},{"type":"v1","addr":"172.21.15.188:6811","nonce":3799292735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":3799292735},{"type":"v1","addr":"172.21.15.188:6815","nonce":3799292735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":3799292735},{"type":"v1","addr":"172.21.15.188:6813","nonce":3799292735}]},"public_addr":"172.21.15.188:6809/3799292735","cluster_addr":"172.21.15.188:6811/3799292735","heartbeat_back_addr":"172.21.15.188:6815/3799292735","heartbeat_front_addr":"172.21.15.188:6813/3799292735","state":["exists","up"]},{"osd":6,"uuid":"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":135312866},{"type":"v1","addr":"172.21.15.188:6817","nonce":135312866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":135312866},{"type":"v1","addr":"172.21.15.188:6819","nonce":135312866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":135312866},{"type":"v1","addr":"172.21.15.188:6823","nonce":135312866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":135312866},{"type":"v1","addr":"172.21.15.188:6821","nonce":135312866}]},"public_addr":"172.21.15.188:6817/135312866","cluster_addr":"172.21.15.188:6819/135312866","heartbeat_back_addr":"172.21.15.188:6823/135312866","heartbeat_front_addr":"172.21.15.188:6821/135312866","state":["exists","up"]},{"osd":7,"uuid":"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":21822620},{"type":"v1","addr":"172.21.15.188:6825","nonce":21822620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":21822620},{"type":"v1","addr":"172.21.15.188:6827","nonce":21822620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":21822620},{"type":"v1","addr":"172.21.15.188:6831","nonce":21822620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":21822620},{"type":"v1","addr":"172.21.15.188:6829","nonce":21822620}]},"public_addr":"172.21.15.188:6825/21822620","cluster_addr":"172.21.15.188:6827/21822620","heartbeat_back_addr":"172.21.15.188:6831/21822620","heartbeat_front_addr":"172.21.15.188:6829/21822620","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T13:31:41.485298+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T13:31:58.520342+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T13:32:15.095160+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T13:32:31.313251+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T13:32:46.769407+0000","dead_epoch":34},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T13:33:06.873905+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T13:33:24.013074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T13:33:40.951941+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.132:6800/2485003984":"2020-07-17T13:30:05.628867+0000","172.21.15.132:0/3322785803":"2020-07-17T13:30:05.628867+0000","172.21.15.132:0/33794564":"2020-07-17T13:30:05.628867+0000","172.21.15.132:6801/2485003984":"2020-07-17T13:30:05.628867+0000","172.21.15.132:6800/253269341":"2020-07-17T13:29:51.583848+0000","172.21.15.132:0/3369903850":"2020-07-17T13:30:05.628867+0000","172.21.15.132:0/4253611559":"2020-07-17T13:29:51.583848+0000","172.21.15.132:6801/253269341":"2020-07-17T13:29:51.583848+0000","172.21.15.132:0/4187674408":"2020-07-17T13:29:51.583848+0000","172.21.15.132:0/1086302082":"2020-07-17T13:29:51.583848+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-07-16T13:34:17.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:16 smithi188 bash[23329]: cluster 2020-07-16T13:34:15.733452+0000 mgr.y (mgr.14140) 168 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:17.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:16 smithi188 bash[23329]: audit 2020-07-16T13:34:16.772345+0000 mon.a (mon.0) 537 : audit [DBG] from='client.? 172.21.15.132:0/4226080131' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2020-07-16T13:34:17.219 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:16 smithi132 bash[27079]: cluster 2020-07-16T13:34:15.733452+0000 mgr.y (mgr.14140) 168 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:17.220 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:16 smithi132 bash[27079]: audit 2020-07-16T13:34:16.772345+0000 mon.a (mon.0) 537 : audit [DBG] from='client.? 172.21.15.132:0/4226080131' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2020-07-16T13:34:17.220 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:16 smithi132 bash[23299]: cluster 2020-07-16T13:34:15.733452+0000 mgr.y (mgr.14140) 168 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:17.220 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:16 smithi132 bash[23299]: audit 2020-07-16T13:34:16.772345+0000 mon.a (mon.0) 537 : audit [DBG] from='client.? 172.21.15.132:0/4226080131' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2020-07-16T13:34:17.230 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2020-07-16T13:34:17.231 INFO:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 4c8ed362-c768-11ea-a06f-001a4aab830c -- ceph osd dump --format=json 2020-07-16T13:34:18.944 INFO:teuthology.orchestra.run.smithi132.stdout: 2020-07-16T13:34:18.944 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":51,"fsid":"4c8ed362-c768-11ea-a06f-001a4aab830c","created":"2020-07-16T13:29:34.607108+0000","modified":"2020-07-16T13:33:43.908143+0000","last_up_change":"2020-07-16T13:33:42.899341+0000","last_in_change":"2020-07-16T13:33:42.899341+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-07-16T13:29:44.933278+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"882744a6-1a4e-4c33-86ea-b3ae0c9db141","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":498701893},{"type":"v1","addr":"172.21.15.132:6803","nonce":498701893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":498701893},{"type":"v1","addr":"172.21.15.132:6805","nonce":498701893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":498701893},{"type":"v1","addr":"172.21.15.132:6809","nonce":498701893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":498701893},{"type":"v1","addr":"172.21.15.132:6807","nonce":498701893}]},"public_addr":"172.21.15.132:6803/498701893","cluster_addr":"172.21.15.132:6805/498701893","heartbeat_back_addr":"172.21.15.132:6809/498701893","heartbeat_front_addr":"172.21.15.132:6807/498701893","state":["exists","up"]},{"osd":1,"uuid":"39ea8fcd-c323-4683-9f7c-4f373a4e4f67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":1723454267},{"type":"v1","addr":"172.21.15.132:6811","nonce":1723454267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":1723454267},{"type":"v1","addr":"172.21.15.132:6813","nonce":1723454267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":1723454267},{"type":"v1","addr":"172.21.15.132:6817","nonce":1723454267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":1723454267},{"type":"v1","addr":"172.21.15.132:6815","nonce":1723454267}]},"public_addr":"172.21.15.132:6811/1723454267","cluster_addr":"172.21.15.132:6813/1723454267","heartbeat_back_addr":"172.21.15.132:6817/1723454267","heartbeat_front_addr":"172.21.15.132:6815/1723454267","state":["exists","up"]},{"osd":2,"uuid":"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":2489969657},{"type":"v1","addr":"172.21.15.132:6819","nonce":2489969657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":2489969657},{"type":"v1","addr":"172.21.15.132:6821","nonce":2489969657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":2489969657},{"type":"v1","addr":"172.21.15.132:6825","nonce":2489969657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":2489969657},{"type":"v1","addr":"172.21.15.132:6823","nonce":2489969657}]},"public_addr":"172.21.15.132:6819/2489969657","cluster_addr":"172.21.15.132:6821/2489969657","heartbeat_back_addr":"172.21.15.132:6825/2489969657","heartbeat_front_addr":"172.21.15.132:6823/2489969657","state":["exists","up"]},{"osd":3,"uuid":"72a90982-aa5f-4c26-9afe-50294c5c503b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":3154069775},{"type":"v1","addr":"172.21.15.132:6827","nonce":3154069775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":3154069775},{"type":"v1","addr":"172.21.15.132:6829","nonce":3154069775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":3154069775},{"type":"v1","addr":"172.21.15.132:6833","nonce":3154069775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":3154069775},{"type":"v1","addr":"172.21.15.132:6831","nonce":3154069775}]},"public_addr":"172.21.15.132:6827/3154069775","cluster_addr":"172.21.15.132:6829/3154069775","heartbeat_back_addr":"172.21.15.132:6833/3154069775","heartbeat_front_addr":"172.21.15.132:6831/3154069775","state":["exists","up"]},{"osd":4,"uuid":"78d29045-b36d-4f75-b245-d0f79869b999","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":31,"last_clean_end":33,"up_from":36,"up_thru":0,"down_at":34,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":213465511},{"type":"v1","addr":"172.21.15.188:6801","nonce":213465511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":213465511},{"type":"v1","addr":"172.21.15.188:6803","nonce":213465511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":213465511},{"type":"v1","addr":"172.21.15.188:6807","nonce":213465511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":213465511},{"type":"v1","addr":"172.21.15.188:6805","nonce":213465511}]},"public_addr":"172.21.15.188:6801/213465511","cluster_addr":"172.21.15.188:6803/213465511","heartbeat_back_addr":"172.21.15.188:6807/213465511","heartbeat_front_addr":"172.21.15.188:6805/213465511","state":["exists","up"]},{"osd":5,"uuid":"04a15200-6710-4b02-9351-c321c8619514","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":3799292735},{"type":"v1","addr":"172.21.15.188:6809","nonce":3799292735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":3799292735},{"type":"v1","addr":"172.21.15.188:6811","nonce":3799292735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":3799292735},{"type":"v1","addr":"172.21.15.188:6815","nonce":3799292735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":3799292735},{"type":"v1","addr":"172.21.15.188:6813","nonce":3799292735}]},"public_addr":"172.21.15.188:6809/3799292735","cluster_addr":"172.21.15.188:6811/3799292735","heartbeat_back_addr":"172.21.15.188:6815/3799292735","heartbeat_front_addr":"172.21.15.188:6813/3799292735","state":["exists","up"]},{"osd":6,"uuid":"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":135312866},{"type":"v1","addr":"172.21.15.188:6817","nonce":135312866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":135312866},{"type":"v1","addr":"172.21.15.188:6819","nonce":135312866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":135312866},{"type":"v1","addr":"172.21.15.188:6823","nonce":135312866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":135312866},{"type":"v1","addr":"172.21.15.188:6821","nonce":135312866}]},"public_addr":"172.21.15.188:6817/135312866","cluster_addr":"172.21.15.188:6819/135312866","heartbeat_back_addr":"172.21.15.188:6823/135312866","heartbeat_front_addr":"172.21.15.188:6821/135312866","state":["exists","up"]},{"osd":7,"uuid":"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":21822620},{"type":"v1","addr":"172.21.15.188:6825","nonce":21822620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":21822620},{"type":"v1","addr":"172.21.15.188:6827","nonce":21822620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":21822620},{"type":"v1","addr":"172.21.15.188:6831","nonce":21822620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":21822620},{"type":"v1","addr":"172.21.15.188:6829","nonce":21822620}]},"public_addr":"172.21.15.188:6825/21822620","cluster_addr":"172.21.15.188:6827/21822620","heartbeat_back_addr":"172.21.15.188:6831/21822620","heartbeat_front_addr":"172.21.15.188:6829/21822620","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T13:31:41.485298+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T13:31:58.520342+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T13:32:15.095160+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T13:32:31.313251+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T13:32:46.769407+0000","dead_epoch":34},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T13:33:06.873905+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T13:33:24.013074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T13:33:40.951941+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.132:6800/2485003984":"2020-07-17T13:30:05.628867+0000","172.21.15.132:0/3322785803":"2020-07-17T13:30:05.628867+0000","172.21.15.132:0/33794564":"2020-07-17T13:30:05.628867+0000","172.21.15.132:6801/2485003984":"2020-07-17T13:30:05.628867+0000","172.21.15.132:6800/253269341":"2020-07-17T13:29:51.583848+0000","172.21.15.132:0/3369903850":"2020-07-17T13:30:05.628867+0000","172.21.15.132:0/4253611559":"2020-07-17T13:29:51.583848+0000","172.21.15.132:6801/253269341":"2020-07-17T13:29:51.583848+0000","172.21.15.132:0/4187674408":"2020-07-17T13:29:51.583848+0000","172.21.15.132:0/1086302082":"2020-07-17T13:29:51.583848+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-07-16T13:34:18.978 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:18 smithi132 bash[27079]: cluster 2020-07-16T13:34:17.733780+0000 mgr.y (mgr.14140) 169 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:18.979 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:18 smithi132 bash[23299]: cluster 2020-07-16T13:34:17.733780+0000 mgr.y (mgr.14140) 169 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:19.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:18 smithi188 bash[23329]: cluster 2020-07-16T13:34:17.733780+0000 mgr.y (mgr.14140) 169 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:19.500 INFO:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 4c8ed362-c768-11ea-a06f-001a4aab830c -- ceph tell osd.0 flush_pg_stats 2020-07-16T13:34:20.170 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:19 smithi132 bash[27079]: audit 2020-07-16T13:34:18.941670+0000 mon.c (mon.1) 15 : audit [DBG] from='client.? 172.21.15.132:0/3312995675' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2020-07-16T13:34:20.170 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:19 smithi132 bash[23299]: audit 2020-07-16T13:34:18.941670+0000 mon.c (mon.1) 15 : audit [DBG] from='client.? 172.21.15.132:0/3312995675' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2020-07-16T13:34:20.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:19 smithi188 bash[23329]: audit 2020-07-16T13:34:18.941670+0000 mon.c (mon.1) 15 : audit [DBG] from='client.? 172.21.15.132:0/3312995675' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2020-07-16T13:34:20.920 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:20 smithi132 bash[23299]: cluster 2020-07-16T13:34:19.734141+0000 mgr.y (mgr.14140) 170 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:20.921 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:20 smithi132 bash[27079]: cluster 2020-07-16T13:34:19.734141+0000 mgr.y (mgr.14140) 170 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:21.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:20 smithi188 bash[23329]: cluster 2020-07-16T13:34:19.734141+0000 mgr.y (mgr.14140) 170 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:21.631 INFO:teuthology.orchestra.run.smithi132.stdout:42949672995 2020-07-16T13:34:21.631 INFO:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 4c8ed362-c768-11ea-a06f-001a4aab830c -- ceph tell osd.1 flush_pg_stats 2020-07-16T13:34:23.069 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:22 smithi132 bash[27079]: cluster 2020-07-16T13:34:21.734446+0000 mgr.y (mgr.14140) 171 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:23.070 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:22 smithi132 bash[23299]: cluster 2020-07-16T13:34:21.734446+0000 mgr.y (mgr.14140) 171 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:23.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:22 smithi188 bash[23329]: cluster 2020-07-16T13:34:21.734446+0000 mgr.y (mgr.14140) 171 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:23.740 INFO:teuthology.orchestra.run.smithi132.stdout:68719476767 2020-07-16T13:34:23.741 INFO:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 4c8ed362-c768-11ea-a06f-001a4aab830c -- ceph tell osd.2 flush_pg_stats 2020-07-16T13:34:24.029 INFO:journalctl@ceph.alertmanager.a.smithi132.stdout:Jul 16 13:34:23 smithi132 bash[3471]: level=info ts=2020-07-16T13:34:23.717Z caller=cluster.go:640 component=cluster msg="gossip settled; proceeding" elapsed=10.000764746s 2020-07-16T13:34:24.950 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:24 smithi188 bash[23329]: cluster 2020-07-16T13:34:23.734759+0000 mgr.y (mgr.14140) 172 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:25.102 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:24 smithi132 bash[27079]: cluster 2020-07-16T13:34:23.734759+0000 mgr.y (mgr.14140) 172 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:25.103 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:24 smithi132 bash[23299]: cluster 2020-07-16T13:34:23.734759+0000 mgr.y (mgr.14140) 172 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:25.828 INFO:teuthology.orchestra.run.smithi132.stdout:90194313244 2020-07-16T13:34:25.828 INFO:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 4c8ed362-c768-11ea-a06f-001a4aab830c -- ceph tell osd.3 flush_pg_stats 2020-07-16T13:34:27.161 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:26 smithi132 bash[27079]: cluster 2020-07-16T13:34:25.735048+0000 mgr.y (mgr.14140) 173 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:27.161 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:26 smithi132 bash[23299]: cluster 2020-07-16T13:34:25.735048+0000 mgr.y (mgr.14140) 173 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:27.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:26 smithi188 bash[23329]: cluster 2020-07-16T13:34:25.735048+0000 mgr.y (mgr.14140) 173 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:27.926 INFO:teuthology.orchestra.run.smithi132.stdout:111669149720 2020-07-16T13:34:27.926 INFO:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 4c8ed362-c768-11ea-a06f-001a4aab830c -- ceph tell osd.4 flush_pg_stats 2020-07-16T13:34:29.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:28 smithi132 bash[27079]: cluster 2020-07-16T13:34:27.735370+0000 mgr.y (mgr.14140) 174 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:29.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:28 smithi132 bash[23299]: cluster 2020-07-16T13:34:27.735370+0000 mgr.y (mgr.14140) 174 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:29.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:28 smithi188 bash[23329]: cluster 2020-07-16T13:34:27.735370+0000 mgr.y (mgr.14140) 174 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:30.152 INFO:teuthology.orchestra.run.smithi132.stdout:154618822675 2020-07-16T13:34:30.153 INFO:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 4c8ed362-c768-11ea-a06f-001a4aab830c -- ceph tell osd.5 flush_pg_stats 2020-07-16T13:34:30.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:30 smithi188 bash[23329]: cluster 2020-07-16T13:34:29.735859+0000 mgr.y (mgr.14140) 175 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:30.852 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:30 smithi132 bash[27079]: cluster 2020-07-16T13:34:29.735859+0000 mgr.y (mgr.14140) 175 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:30.852 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:30 smithi132 bash[23299]: cluster 2020-07-16T13:34:29.735859+0000 mgr.y (mgr.14140) 175 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:31.504 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:31 smithi188 systemd[1]: Starting Ceph grafana.a for 4c8ed362-c768-11ea-a06f-001a4aab830c... 2020-07-16T13:34:31.759 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:31 smithi188 bash[23329]: audit 2020-07-16T13:34:31.540169+0000 mon.a (mon.0) 538 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386072\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386152\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386184\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386212\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386240\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386267\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"hostname\": \"smithi188\", \"container_id\": \"55d17e2eaa72\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386296\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:33:57.033143\"}, \"node-exporter.b\": {\"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386323\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"hostname\": \"smithi188\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:33:43.545910\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:34:31.760 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:31 smithi188 bash[23329]: audit 2020-07-16T13:34:31.543186+0000 mon.a (mon.0) 539 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386072\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386152\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386184\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386212\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386240\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386267\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"hostname\": \"smithi188\", \"container_id\": \"55d17e2eaa72\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386296\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:33:57.033143\"}, \"node-exporter.b\": {\"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386323\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"hostname\": \"smithi188\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:33:43.545910\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:34:31.760 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:31 smithi188 bash[23329]: audit 2020-07-16T13:34:31.543790+0000 mon.a (mon.0) 540 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:34:31.761 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:31 smithi188 podman[1350]: Error: no container with name or ID ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-grafana.a found: no such container 2020-07-16T13:34:31.761 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:31 smithi188 systemd[1]: Started Ceph grafana.a for 4c8ed362-c768-11ea-a06f-001a4aab830c. 2020-07-16T13:34:31.855 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:31 smithi132 bash[27079]: audit 2020-07-16T13:34:31.540169+0000 mon.a (mon.0) 538 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386072\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386152\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386184\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386212\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386240\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386267\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"hostname\": \"smithi188\", \"container_id\": \"55d17e2eaa72\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386296\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:33:57.033143\"}, \"node-exporter.b\": {\"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386323\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"hostname\": \"smithi188\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:33:43.545910\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:34:31.856 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:31 smithi132 bash[27079]: audit 2020-07-16T13:34:31.543186+0000 mon.a (mon.0) 539 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386072\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386152\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386184\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386212\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386240\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386267\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"hostname\": \"smithi188\", \"container_id\": \"55d17e2eaa72\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386296\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:33:57.033143\"}, \"node-exporter.b\": {\"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386323\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"hostname\": \"smithi188\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:33:43.545910\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:34:31.856 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:31 smithi132 bash[27079]: audit 2020-07-16T13:34:31.543790+0000 mon.a (mon.0) 540 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:34:31.856 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:31 smithi132 bash[23299]: audit 2020-07-16T13:34:31.540169+0000 mon.a (mon.0) 538 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386072\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386152\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386184\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386212\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386240\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386267\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"hostname\": \"smithi188\", \"container_id\": \"55d17e2eaa72\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386296\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:33:57.033143\"}, \"node-exporter.b\": {\"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386323\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"hostname\": \"smithi188\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:33:43.545910\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:34:31.857 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:31 smithi132 bash[23299]: audit 2020-07-16T13:34:31.543186+0000 mon.a (mon.0) 539 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386072\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386152\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386184\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386212\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386240\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386267\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"hostname\": \"smithi188\", \"container_id\": \"55d17e2eaa72\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386296\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:33:57.033143\"}, \"node-exporter.b\": {\"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:03.386323\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"hostname\": \"smithi188\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:33:43.545910\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:34:31.857 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:31 smithi132 bash[23299]: audit 2020-07-16T13:34:31.543790+0000 mon.a (mon.0) 540 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:34:32.090 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:31 smithi188 podman[1370]: 2020-07-16 13:34:31.756778865 +0000 UTC m=+0.231135568 container create ac88c2d305d52dd5b7de2862bf8a84573b6c7d538168c2a862604e6946759ca4 (image=docker.io/ceph/ceph-grafana:latest, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-grafana.a) 2020-07-16T13:34:32.351 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:32 smithi188 podman[1370]: 2020-07-16 13:34:32.090062883 +0000 UTC m=+0.564419469 container init ac88c2d305d52dd5b7de2862bf8a84573b6c7d538168c2a862604e6946759ca4 (image=docker.io/ceph/ceph-grafana:latest, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-grafana.a) 2020-07-16T13:34:32.351 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:32 smithi188 podman[1370]: 2020-07-16 13:34:32.140460218 +0000 UTC m=+0.614816807 container start ac88c2d305d52dd5b7de2862bf8a84573b6c7d538168c2a862604e6946759ca4 (image=docker.io/ceph/ceph-grafana:latest, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-grafana.a) 2020-07-16T13:34:32.352 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:32 smithi188 podman[1370]: 2020-07-16 13:34:32.140533793 +0000 UTC m=+0.614890407 container attach ac88c2d305d52dd5b7de2862bf8a84573b6c7d538168c2a862604e6946759ca4 (image=docker.io/ceph/ceph-grafana:latest, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-grafana.a) 2020-07-16T13:34:32.352 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:32 smithi188 bash[1368]: t=2020-07-16T13:34:32+0000 lvl=info msg="Starting Grafana" logger=server version=6.6.2 commit=3fa63cfc34 branch=HEAD compiled=2020-02-20T12:03:49+0000 2020-07-16T13:34:32.352 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:32 smithi188 bash[1368]: t=2020-07-16T13:34:32+0000 lvl=info msg="Config loaded from" logger=settings file=/usr/share/grafana/conf/defaults.ini 2020-07-16T13:34:32.353 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:32 smithi188 bash[1368]: t=2020-07-16T13:34:32+0000 lvl=info msg="Config loaded from" logger=settings file=/etc/grafana/grafana.ini 2020-07-16T13:34:32.353 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:32 smithi188 bash[1368]: t=2020-07-16T13:34:32+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_DATA=/var/lib/grafana" 2020-07-16T13:34:32.353 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:32 smithi188 bash[1368]: t=2020-07-16T13:34:32+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_LOGS=/var/log/grafana" 2020-07-16T13:34:32.354 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:32 smithi188 bash[1368]: t=2020-07-16T13:34:32+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2020-07-16T13:34:32.354 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:32 smithi188 bash[1368]: t=2020-07-16T13:34:32+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2020-07-16T13:34:32.354 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:32 smithi188 bash[1368]: t=2020-07-16T13:34:32+0000 lvl=info msg="Path Home" logger=settings path=/usr/share/grafana 2020-07-16T13:34:32.355 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:32 smithi188 bash[1368]: t=2020-07-16T13:34:32+0000 lvl=info msg="Path Data" logger=settings path=/var/lib/grafana 2020-07-16T13:34:32.355 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:32 smithi188 bash[1368]: t=2020-07-16T13:34:32+0000 lvl=info msg="Path Logs" logger=settings path=/var/log/grafana 2020-07-16T13:34:32.355 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:32 smithi188 bash[1368]: t=2020-07-16T13:34:32+0000 lvl=info msg="Path Plugins" logger=settings path=/var/lib/grafana/plugins 2020-07-16T13:34:32.356 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:32 smithi188 bash[1368]: t=2020-07-16T13:34:32+0000 lvl=info msg="Path Provisioning" logger=settings path=/etc/grafana/provisioning 2020-07-16T13:34:32.356 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:32 smithi188 bash[1368]: t=2020-07-16T13:34:32+0000 lvl=info msg="App mode production" logger=settings 2020-07-16T13:34:32.356 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:32 smithi188 bash[1368]: t=2020-07-16T13:34:32+0000 lvl=info msg="Initializing SqlStore" logger=server 2020-07-16T13:34:32.357 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:32 smithi188 bash[1368]: t=2020-07-16T13:34:32+0000 lvl=info msg="Connecting to DB" logger=sqlstore dbtype=sqlite3 2020-07-16T13:34:32.357 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:32 smithi188 bash[1368]: t=2020-07-16T13:34:32+0000 lvl=info msg="Starting DB migration" logger=migrator 2020-07-16T13:34:32.357 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:32 smithi188 bash[1368]: t=2020-07-16T13:34:32+0000 lvl=info msg="Executing migration" logger=migrator id="create migration_log table" 2020-07-16T13:34:32.358 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:32 smithi188 bash[1368]: t=2020-07-16T13:34:32+0000 lvl=info msg="Executing migration" logger=migrator id="create user table" 2020-07-16T13:34:32.358 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:32 smithi188 bash[1368]: t=2020-07-16T13:34:32+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.login" 2020-07-16T13:34:32.358 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:32 smithi188 bash[1368]: t=2020-07-16T13:34:32+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.email" 2020-07-16T13:34:32.456 INFO:teuthology.orchestra.run.smithi132.stdout:171798691859 2020-07-16T13:34:32.457 INFO:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 4c8ed362-c768-11ea-a06f-001a4aab830c -- ceph tell osd.6 flush_pg_stats 2020-07-16T13:34:32.611 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:32 smithi188 bash[1368]: t=2020-07-16T13:34:32+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_login - v1" 2020-07-16T13:34:32.611 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:32 smithi188 bash[1368]: t=2020-07-16T13:34:32+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_email - v1" 2020-07-16T13:34:32.612 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:32 smithi188 bash[1368]: t=2020-07-16T13:34:32+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table user to user_v1 - v1" 2020-07-16T13:34:32.612 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:32 smithi188 bash[1368]: t=2020-07-16T13:34:32+0000 lvl=info msg="Executing migration" logger=migrator id="create user table v2" 2020-07-16T13:34:32.613 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:32 smithi188 bash[1368]: t=2020-07-16T13:34:32+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_login - v2" 2020-07-16T13:34:32.779 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:32 smithi132 bash[23299]: cluster 2020-07-16T13:34:31.736170+0000 mgr.y (mgr.14140) 176 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:32.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:32 smithi132 bash[27079]: cluster 2020-07-16T13:34:31.736170+0000 mgr.y (mgr.14140) 176 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:32.913 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:32 smithi188 bash[23329]: cluster 2020-07-16T13:34:31.736170+0000 mgr.y (mgr.14140) 176 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:32.914 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:32 smithi188 bash[1368]: t=2020-07-16T13:34:32+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_email - v2" 2020-07-16T13:34:32.914 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:32 smithi188 bash[1368]: t=2020-07-16T13:34:32+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2020-07-16T13:34:32.914 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:32 smithi188 bash[1368]: t=2020-07-16T13:34:32+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table user_v1" 2020-07-16T13:34:32.915 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:32 smithi188 bash[1368]: t=2020-07-16T13:34:32+0000 lvl=info msg="Executing migration" logger=migrator id="Add column help_flags1 to user table" 2020-07-16T13:34:33.170 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:33 smithi188 bash[1368]: t=2020-07-16T13:34:33+0000 lvl=info msg="Executing migration" logger=migrator id="Update user table charset" 2020-07-16T13:34:33.171 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:33 smithi188 bash[1368]: t=2020-07-16T13:34:33+0000 lvl=info msg="Executing migration" logger=migrator id="Add last_seen_at column to user" 2020-07-16T13:34:33.171 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:33 smithi188 bash[1368]: t=2020-07-16T13:34:33+0000 lvl=info msg="Executing migration" logger=migrator id="Add missing user data" 2020-07-16T13:34:33.499 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:33 smithi188 bash[1368]: t=2020-07-16T13:34:33+0000 lvl=info msg="Executing migration" logger=migrator id="Add is_disabled column to user" 2020-07-16T13:34:33.499 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:33 smithi188 bash[1368]: t=2020-07-16T13:34:33+0000 lvl=info msg="Executing migration" logger=migrator id="create temp user table v1-7" 2020-07-16T13:34:33.500 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:33 smithi188 bash[1368]: t=2020-07-16T13:34:33+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_email - v1-7" 2020-07-16T13:34:33.500 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:33 smithi188 bash[1368]: t=2020-07-16T13:34:33+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_org_id - v1-7" 2020-07-16T13:34:33.500 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:33 smithi188 bash[1368]: t=2020-07-16T13:34:33+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_code - v1-7" 2020-07-16T13:34:33.751 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:33 smithi188 bash[1368]: t=2020-07-16T13:34:33+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_status - v1-7" 2020-07-16T13:34:33.751 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:33 smithi188 bash[1368]: t=2020-07-16T13:34:33+0000 lvl=info msg="Executing migration" logger=migrator id="Update temp_user table charset" 2020-07-16T13:34:33.751 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:33 smithi188 bash[1368]: t=2020-07-16T13:34:33+0000 lvl=info msg="Executing migration" logger=migrator id="create star table" 2020-07-16T13:34:33.752 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:33 smithi188 bash[1368]: t=2020-07-16T13:34:33+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index star.user_id_dashboard_id" 2020-07-16T13:34:34.027 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:33 smithi188 bash[1368]: t=2020-07-16T13:34:33+0000 lvl=info msg="Executing migration" logger=migrator id="create org table v1" 2020-07-16T13:34:34.028 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:33 smithi188 bash[1368]: t=2020-07-16T13:34:33+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_name - v1" 2020-07-16T13:34:34.028 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:33 smithi188 bash[1368]: t=2020-07-16T13:34:33+0000 lvl=info msg="Executing migration" logger=migrator id="create org_user table v1" 2020-07-16T13:34:34.029 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:34 smithi188 bash[1368]: t=2020-07-16T13:34:34+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_org_user_org_id - v1" 2020-07-16T13:34:34.295 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:34 smithi188 bash[1368]: t=2020-07-16T13:34:34+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_user_org_id_user_id - v1" 2020-07-16T13:34:34.296 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:34 smithi188 bash[1368]: t=2020-07-16T13:34:34+0000 lvl=info msg="Executing migration" logger=migrator id="Update org table charset" 2020-07-16T13:34:34.296 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:34 smithi188 bash[1368]: t=2020-07-16T13:34:34+0000 lvl=info msg="Executing migration" logger=migrator id="Update org_user table charset" 2020-07-16T13:34:34.297 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:34 smithi188 bash[1368]: t=2020-07-16T13:34:34+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate all Read Only Viewers to Viewers" 2020-07-16T13:34:34.572 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:34 smithi188 bash[1368]: t=2020-07-16T13:34:34+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard table" 2020-07-16T13:34:34.573 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:34 smithi188 bash[1368]: t=2020-07-16T13:34:34+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard.account_id" 2020-07-16T13:34:34.573 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:34 smithi188 bash[1368]: t=2020-07-16T13:34:34+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_account_id_slug" 2020-07-16T13:34:34.573 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:34 smithi188 bash[1368]: t=2020-07-16T13:34:34+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_tag table" 2020-07-16T13:34:34.838 INFO:teuthology.orchestra.run.smithi132.stdout:193273528336 2020-07-16T13:34:34.838 INFO:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 4c8ed362-c768-11ea-a06f-001a4aab830c -- ceph tell osd.7 flush_pg_stats 2020-07-16T13:34:34.860 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:34 smithi188 bash[1368]: t=2020-07-16T13:34:34+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_tag.dasboard_id_term" 2020-07-16T13:34:34.861 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:34 smithi188 bash[1368]: t=2020-07-16T13:34:34+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_dashboard_tag_dashboard_id_term - v1" 2020-07-16T13:34:34.861 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:34 smithi188 bash[1368]: t=2020-07-16T13:34:34+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard to dashboard_v1 - v1" 2020-07-16T13:34:34.861 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:34 smithi188 bash[1368]: t=2020-07-16T13:34:34+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard v2" 2020-07-16T13:34:34.861 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:34 smithi188 bash[23329]: cluster 2020-07-16T13:34:33.736601+0000 mgr.y (mgr.14140) 177 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:34.862 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:34 smithi188 bash[23329]: audit 2020-07-16T13:34:34.635818+0000 mon.a (mon.0) 541 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634664\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634755\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634785\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634812\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634839\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634865\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634891\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634918\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"hostname\": \"smithi132\", \"container_id\": \"f3982ed08432\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634944\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:34:12.994659\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:34:03.394122\"}}, \"last_daemon_update\": \"2020-07-16T13:34:34.635021\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:34:34.862 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:34 smithi188 bash[23329]: audit 2020-07-16T13:34:34.639525+0000 mon.a (mon.0) 542 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634664\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634755\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634785\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634812\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634839\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634865\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634891\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634918\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"hostname\": \"smithi132\", \"container_id\": \"f3982ed08432\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634944\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:34:12.994659\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:34:03.394122\"}}, \"last_daemon_update\": \"2020-07-16T13:34:34.635021\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:34:34.862 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:34 smithi188 bash[23329]: audit 2020-07-16T13:34:34.640127+0000 mon.a (mon.0) 543 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:34:35.145 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:34 smithi188 bash[1368]: t=2020-07-16T13:34:34+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_org_id - v2" 2020-07-16T13:34:35.146 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:35 smithi188 bash[1368]: t=2020-07-16T13:34:35+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_org_id_slug - v2" 2020-07-16T13:34:35.184 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:34 smithi132 bash[23299]: cluster 2020-07-16T13:34:33.736601+0000 mgr.y (mgr.14140) 177 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:35.185 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:34 smithi132 bash[23299]: audit 2020-07-16T13:34:34.635818+0000 mon.a (mon.0) 541 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634664\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634755\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634785\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634812\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634839\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634865\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634891\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634918\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"hostname\": \"smithi132\", \"container_id\": \"f3982ed08432\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634944\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:34:12.994659\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:34:03.394122\"}}, \"last_daemon_update\": \"2020-07-16T13:34:34.635021\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:34:35.185 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:34 smithi132 bash[23299]: audit 2020-07-16T13:34:34.639525+0000 mon.a (mon.0) 542 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634664\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634755\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634785\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634812\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634839\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634865\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634891\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634918\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"hostname\": \"smithi132\", \"container_id\": \"f3982ed08432\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634944\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:34:12.994659\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:34:03.394122\"}}, \"last_daemon_update\": \"2020-07-16T13:34:34.635021\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:34:35.185 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:34 smithi132 bash[23299]: audit 2020-07-16T13:34:34.640127+0000 mon.a (mon.0) 543 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:34:35.186 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:34 smithi132 bash[27079]: cluster 2020-07-16T13:34:33.736601+0000 mgr.y (mgr.14140) 177 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:35.186 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:34 smithi132 bash[27079]: audit 2020-07-16T13:34:34.635818+0000 mon.a (mon.0) 541 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634664\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634755\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634785\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634812\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634839\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634865\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634891\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634918\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"hostname\": \"smithi132\", \"container_id\": \"f3982ed08432\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634944\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:34:12.994659\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:34:03.394122\"}}, \"last_daemon_update\": \"2020-07-16T13:34:34.635021\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:34:35.186 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:34 smithi132 bash[27079]: audit 2020-07-16T13:34:34.639525+0000 mon.a (mon.0) 542 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634664\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634755\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634785\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634812\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634839\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634865\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634891\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634918\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"hostname\": \"smithi132\", \"container_id\": \"f3982ed08432\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634944\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:34:12.994659\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:34:03.394122\"}}, \"last_daemon_update\": \"2020-07-16T13:34:34.635021\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:34:35.187 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:34 smithi132 bash[27079]: audit 2020-07-16T13:34:34.640127+0000 mon.a (mon.0) 543 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:34:35.420 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:35 smithi188 bash[1368]: t=2020-07-16T13:34:35+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard v1 to v2" 2020-07-16T13:34:35.421 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:35 smithi188 bash[1368]: t=2020-07-16T13:34:35+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_v1" 2020-07-16T13:34:35.679 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:35 smithi188 bash[1368]: t=2020-07-16T13:34:35+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard.data to mediumtext v1" 2020-07-16T13:34:35.679 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:35 smithi188 bash[1368]: t=2020-07-16T13:34:35+0000 lvl=info msg="Executing migration" logger=migrator id="Add column updated_by in dashboard - v2" 2020-07-16T13:34:35.679 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:35 smithi188 bash[1368]: t=2020-07-16T13:34:35+0000 lvl=info msg="Executing migration" logger=migrator id="Add column created_by in dashboard - v2" 2020-07-16T13:34:35.680 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:35 smithi188 bash[1368]: t=2020-07-16T13:34:35+0000 lvl=info msg="Executing migration" logger=migrator id="Add column gnetId in dashboard" 2020-07-16T13:34:35.680 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:35 smithi188 bash[1368]: t=2020-07-16T13:34:35+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for gnetId in dashboard" 2020-07-16T13:34:35.964 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:35 smithi188 bash[1368]: t=2020-07-16T13:34:35+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_id in dashboard" 2020-07-16T13:34:35.965 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:35 smithi188 bash[1368]: t=2020-07-16T13:34:35+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for plugin_id in dashboard" 2020-07-16T13:34:35.965 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:35 smithi188 bash[1368]: t=2020-07-16T13:34:35+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for dashboard_id in dashboard_tag" 2020-07-16T13:34:35.965 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:35 smithi188 bash[1368]: t=2020-07-16T13:34:35+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard table charset" 2020-07-16T13:34:36.259 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:36 smithi188 bash[1368]: t=2020-07-16T13:34:36+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_tag table charset" 2020-07-16T13:34:36.259 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:36 smithi188 bash[1368]: t=2020-07-16T13:34:36+0000 lvl=info msg="Executing migration" logger=migrator id="Add column folder_id in dashboard" 2020-07-16T13:34:36.260 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:36 smithi188 bash[1368]: t=2020-07-16T13:34:36+0000 lvl=info msg="Executing migration" logger=migrator id="Add column isFolder in dashboard" 2020-07-16T13:34:36.563 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:36 smithi188 bash[1368]: t=2020-07-16T13:34:36+0000 lvl=info msg="Executing migration" logger=migrator id="Add column has_acl in dashboard" 2020-07-16T13:34:36.563 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:36 smithi188 bash[1368]: t=2020-07-16T13:34:36+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in dashboard" 2020-07-16T13:34:36.564 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:36 smithi188 bash[1368]: t=2020-07-16T13:34:36+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in dashboard" 2020-07-16T13:34:36.820 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:36 smithi188 bash[23329]: cluster 2020-07-16T13:34:35.736915+0000 mgr.y (mgr.14140) 178 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:36.820 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:36 smithi188 bash[1368]: t=2020-07-16T13:34:36+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index dashboard_org_id_uid" 2020-07-16T13:34:36.821 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:36 smithi188 bash[1368]: t=2020-07-16T13:34:36+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_slug" 2020-07-16T13:34:36.821 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:36 smithi188 bash[1368]: t=2020-07-16T13:34:36+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard title length" 2020-07-16T13:34:36.821 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:36 smithi188 bash[1368]: t=2020-07-16T13:34:36+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index for dashboard_org_id_title_folder_id" 2020-07-16T13:34:37.005 INFO:teuthology.orchestra.run.smithi132.stdout:214748364812 2020-07-16T13:34:37.006 INFO:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 4c8ed362-c768-11ea-a06f-001a4aab830c -- ceph osd last-stat-seq osd.0 2020-07-16T13:34:37.131 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:36 smithi188 bash[1368]: t=2020-07-16T13:34:36+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning" 2020-07-16T13:34:37.131 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:36 smithi188 bash[1368]: t=2020-07-16T13:34:36+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard_provisioning to dashboard_provisioning_tmp_qwerty - v1" 2020-07-16T13:34:37.132 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:37 smithi188 bash[1368]: t=2020-07-16T13:34:37+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning v2" 2020-07-16T13:34:37.132 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:37 smithi188 bash[1368]: t=2020-07-16T13:34:37+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id - v2" 2020-07-16T13:34:37.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:36 smithi132 bash[27079]: cluster 2020-07-16T13:34:35.736915+0000 mgr.y (mgr.14140) 178 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:37.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:36 smithi132 bash[23299]: cluster 2020-07-16T13:34:35.736915+0000 mgr.y (mgr.14140) 178 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:37.390 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:37 smithi188 bash[1368]: t=2020-07-16T13:34:37+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id_name - v2" 2020-07-16T13:34:37.391 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:37 smithi188 bash[1368]: t=2020-07-16T13:34:37+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard_provisioning v1 to v2" 2020-07-16T13:34:37.391 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:37 smithi188 bash[1368]: t=2020-07-16T13:34:37+0000 lvl=info msg="Executing migration" logger=migrator id="drop dashboard_provisioning_tmp_qwerty" 2020-07-16T13:34:37.658 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:37 smithi188 bash[1368]: t=2020-07-16T13:34:37+0000 lvl=info msg="Executing migration" logger=migrator id="Add check_sum column" 2020-07-16T13:34:37.659 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:37 smithi188 bash[1368]: t=2020-07-16T13:34:37+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table" 2020-07-16T13:34:37.659 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:37 smithi188 bash[1368]: t=2020-07-16T13:34:37+0000 lvl=info msg="Executing migration" logger=migrator id="add index data_source.account_id" 2020-07-16T13:34:37.659 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:37 smithi188 bash[1368]: t=2020-07-16T13:34:37+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index data_source.account_id_name" 2020-07-16T13:34:37.659 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:37 smithi188 bash[1368]: t=2020-07-16T13:34:37+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_data_source_account_id - v1" 2020-07-16T13:34:37.921 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:37 smithi188 bash[1368]: t=2020-07-16T13:34:37+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_data_source_account_id_name - v1" 2020-07-16T13:34:37.921 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:37 smithi188 bash[1368]: t=2020-07-16T13:34:37+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table data_source to data_source_v1 - v1" 2020-07-16T13:34:37.922 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:37 smithi188 bash[1368]: t=2020-07-16T13:34:37+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table v2" 2020-07-16T13:34:37.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:37 smithi188 bash[23329]: audit 2020-07-16T13:34:37.088295+0000 mon.a (mon.0) 544 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087089\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087167\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087199\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087227\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087255\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087282\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"hostname\": \"smithi188\", \"container_id\": \"55d17e2eaa72\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087309\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:33:57.033143\"}, \"node-exporter.b\": {\"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087337\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087364\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:33:43.545910\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:34:37.087475\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:34:37.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:37 smithi188 bash[23329]: audit 2020-07-16T13:34:37.093245+0000 mon.a (mon.0) 545 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087089\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087167\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087199\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087227\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087255\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087282\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"hostname\": \"smithi188\", \"container_id\": \"55d17e2eaa72\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087309\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:33:57.033143\"}, \"node-exporter.b\": {\"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087337\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087364\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:33:43.545910\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:34:37.087475\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:34:38.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:37 smithi132 bash[23299]: audit 2020-07-16T13:34:37.088295+0000 mon.a (mon.0) 544 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087089\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087167\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087199\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087227\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087255\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087282\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"hostname\": \"smithi188\", \"container_id\": \"55d17e2eaa72\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087309\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:33:57.033143\"}, \"node-exporter.b\": {\"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087337\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087364\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:33:43.545910\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:34:37.087475\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:34:38.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:37 smithi132 bash[23299]: audit 2020-07-16T13:34:37.093245+0000 mon.a (mon.0) 545 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087089\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087167\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087199\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087227\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087255\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087282\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"hostname\": \"smithi188\", \"container_id\": \"55d17e2eaa72\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087309\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:33:57.033143\"}, \"node-exporter.b\": {\"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087337\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087364\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:33:43.545910\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:34:37.087475\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:34:38.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:37 smithi132 bash[27079]: audit 2020-07-16T13:34:37.088295+0000 mon.a (mon.0) 544 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087089\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087167\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087199\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087227\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087255\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087282\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"hostname\": \"smithi188\", \"container_id\": \"55d17e2eaa72\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087309\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:33:57.033143\"}, \"node-exporter.b\": {\"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087337\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087364\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:33:43.545910\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:34:37.087475\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:34:38.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:37 smithi132 bash[27079]: audit 2020-07-16T13:34:37.093245+0000 mon.a (mon.0) 545 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087089\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087167\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087199\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087227\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087255\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087282\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"hostname\": \"smithi188\", \"container_id\": \"55d17e2eaa72\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087309\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:33:57.033143\"}, \"node-exporter.b\": {\"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087337\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087364\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:33:43.545910\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:34:37.087475\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:34:38.262 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:37 smithi188 bash[1368]: t=2020-07-16T13:34:37+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_data_source_org_id - v2" 2020-07-16T13:34:38.262 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:38 smithi188 bash[1368]: t=2020-07-16T13:34:38+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_data_source_org_id_name - v2" 2020-07-16T13:34:38.262 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:38 smithi188 bash[1368]: t=2020-07-16T13:34:38+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2020-07-16T13:34:38.263 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:38 smithi188 bash[1368]: t=2020-07-16T13:34:38+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table data_source_v1 #2" 2020-07-16T13:34:38.263 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:38 smithi188 bash[1368]: t=2020-07-16T13:34:38+0000 lvl=info msg="Executing migration" logger=migrator id="Add column with_credentials" 2020-07-16T13:34:38.525 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:38 smithi188 bash[1368]: t=2020-07-16T13:34:38+0000 lvl=info msg="Executing migration" logger=migrator id="Add secure json data column" 2020-07-16T13:34:38.525 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:38 smithi188 bash[1368]: t=2020-07-16T13:34:38+0000 lvl=info msg="Executing migration" logger=migrator id="Update data_source table charset" 2020-07-16T13:34:38.525 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:38 smithi188 bash[1368]: t=2020-07-16T13:34:38+0000 lvl=info msg="Executing migration" logger=migrator id="Update initial version to 1" 2020-07-16T13:34:38.526 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:38 smithi188 bash[1368]: t=2020-07-16T13:34:38+0000 lvl=info msg="Executing migration" logger=migrator id="Add read_only data column" 2020-07-16T13:34:38.801 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:38 smithi188 bash[1368]: t=2020-07-16T13:34:38+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate logging ds to loki ds" 2020-07-16T13:34:38.802 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:38 smithi188 bash[1368]: t=2020-07-16T13:34:38+0000 lvl=info msg="Executing migration" logger=migrator id="Update json_data with nulls" 2020-07-16T13:34:38.802 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:38 smithi188 bash[1368]: t=2020-07-16T13:34:38+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table" 2020-07-16T13:34:39.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:38 smithi132 bash[27079]: cephadm 2020-07-16T13:34:37.094919+0000 mgr.y (mgr.14140) 179 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2020-07-16T13:34:39.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:38 smithi132 bash[27079]: cephadm 2020-07-16T13:34:37.096686+0000 mgr.y (mgr.14140) 180 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi132 2020-07-16T13:34:39.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:38 smithi132 bash[27079]: cluster 2020-07-16T13:34:37.737315+0000 mgr.y (mgr.14140) 181 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:39.068 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:38 smithi132 bash[23299]: cephadm 2020-07-16T13:34:37.094919+0000 mgr.y (mgr.14140) 179 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2020-07-16T13:34:39.068 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:38 smithi132 bash[23299]: cephadm 2020-07-16T13:34:37.096686+0000 mgr.y (mgr.14140) 180 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi132 2020-07-16T13:34:39.068 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:38 smithi132 bash[23299]: cluster 2020-07-16T13:34:37.737315+0000 mgr.y (mgr.14140) 181 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:39.100 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:38 smithi188 bash[23329]: cephadm 2020-07-16T13:34:37.094919+0000 mgr.y (mgr.14140) 179 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2020-07-16T13:34:39.100 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:38 smithi188 bash[23329]: cephadm 2020-07-16T13:34:37.096686+0000 mgr.y (mgr.14140) 180 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi132 2020-07-16T13:34:39.100 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:38 smithi188 bash[23329]: cluster 2020-07-16T13:34:37.737315+0000 mgr.y (mgr.14140) 181 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:39.100 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:38 smithi188 bash[1368]: t=2020-07-16T13:34:38+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id" 2020-07-16T13:34:39.101 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:38 smithi188 bash[1368]: t=2020-07-16T13:34:38+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.key" 2020-07-16T13:34:39.101 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:38 smithi188 bash[1368]: t=2020-07-16T13:34:38+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id_name" 2020-07-16T13:34:39.101 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:39 smithi188 bash[1368]: t=2020-07-16T13:34:39+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_api_key_account_id - v1" 2020-07-16T13:34:39.101 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:39 smithi188 bash[1368]: t=2020-07-16T13:34:39+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_key - v1" 2020-07-16T13:34:39.388 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:39 smithi188 bash[1368]: t=2020-07-16T13:34:39+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_account_id_name - v1" 2020-07-16T13:34:39.389 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:39 smithi188 bash[1368]: t=2020-07-16T13:34:39+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table api_key to api_key_v1 - v1" 2020-07-16T13:34:39.389 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:39 smithi188 bash[1368]: t=2020-07-16T13:34:39+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table v2" 2020-07-16T13:34:39.395 INFO:teuthology.orchestra.run.smithi132.stdout:42949672998 2020-07-16T13:34:39.670 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:39 smithi188 bash[1368]: t=2020-07-16T13:34:39+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_api_key_org_id - v2" 2020-07-16T13:34:39.671 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:39 smithi188 bash[1368]: t=2020-07-16T13:34:39+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_key - v2" 2020-07-16T13:34:39.671 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:39 smithi188 bash[1368]: t=2020-07-16T13:34:39+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_org_id_name - v2" 2020-07-16T13:34:39.962 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:39 smithi188 bash[23329]: audit 2020-07-16T13:34:39.390432+0000 mon.a (mon.0) 546 : audit [DBG] from='client.? 172.21.15.132:0/1827811151' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2020-07-16T13:34:39.963 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:39 smithi188 bash[1368]: t=2020-07-16T13:34:39+0000 lvl=info msg="Executing migration" logger=migrator id="copy api_key v1 to v2" 2020-07-16T13:34:39.963 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:39 smithi188 bash[1368]: t=2020-07-16T13:34:39+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table api_key_v1" 2020-07-16T13:34:39.964 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:39 smithi188 bash[1368]: t=2020-07-16T13:34:39+0000 lvl=info msg="Executing migration" logger=migrator id="Update api_key table charset" 2020-07-16T13:34:39.964 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:39 smithi188 bash[1368]: t=2020-07-16T13:34:39+0000 lvl=info msg="Executing migration" logger=migrator id="Add expires to api_key table" 2020-07-16T13:34:39.964 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:39 smithi188 bash[1368]: t=2020-07-16T13:34:39+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v4" 2020-07-16T13:34:39.964 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:39 smithi188 bash[1368]: t=2020-07-16T13:34:39+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_snapshot_v4 #1" 2020-07-16T13:34:40.086 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:39 smithi132 bash[23299]: audit 2020-07-16T13:34:39.390432+0000 mon.a (mon.0) 546 : audit [DBG] from='client.? 172.21.15.132:0/1827811151' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2020-07-16T13:34:40.087 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:39 smithi132 bash[27079]: audit 2020-07-16T13:34:39.390432+0000 mon.a (mon.0) 546 : audit [DBG] from='client.? 172.21.15.132:0/1827811151' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2020-07-16T13:34:40.101 INFO:tasks.cephadm.ceph_manager.ceph:need seq 42949672995 got 42949672998 for osd.0 2020-07-16T13:34:40.102 INFO:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 4c8ed362-c768-11ea-a06f-001a4aab830c -- ceph osd last-stat-seq osd.1 2020-07-16T13:34:40.222 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:40 smithi188 bash[1368]: t=2020-07-16T13:34:40+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v5 #2" 2020-07-16T13:34:40.223 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:40 smithi188 bash[1368]: t=2020-07-16T13:34:40+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_key - v5" 2020-07-16T13:34:40.223 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:40 smithi188 bash[1368]: t=2020-07-16T13:34:40+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_delete_key - v5" 2020-07-16T13:34:40.223 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:40 smithi188 bash[1368]: t=2020-07-16T13:34:40+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_snapshot_user_id - v5" 2020-07-16T13:34:40.507 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:40 smithi188 bash[1368]: t=2020-07-16T13:34:40+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_snapshot to mediumtext v2" 2020-07-16T13:34:40.508 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:40 smithi188 bash[1368]: t=2020-07-16T13:34:40+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_snapshot table charset" 2020-07-16T13:34:40.508 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:40 smithi188 bash[1368]: t=2020-07-16T13:34:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external_delete_url to dashboard_snapshots table" 2020-07-16T13:34:40.508 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:40 smithi188 bash[1368]: t=2020-07-16T13:34:40+0000 lvl=info msg="Executing migration" logger=migrator id="create quota table v1" 2020-07-16T13:34:40.509 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:40 smithi188 bash[1368]: t=2020-07-16T13:34:40+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_quota_org_id_user_id_target - v1" 2020-07-16T13:34:40.777 INFO:journalctl@ceph.alertmanager.a.smithi132.stdout:Jul 16 13:34:40 smithi132 systemd[1]: Stopping Ceph alertmanager.a for 4c8ed362-c768-11ea-a06f-001a4aab830c... 2020-07-16T13:34:40.807 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:40 smithi188 bash[1368]: t=2020-07-16T13:34:40+0000 lvl=info msg="Executing migration" logger=migrator id="Update quota table charset" 2020-07-16T13:34:40.808 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:40 smithi188 bash[1368]: t=2020-07-16T13:34:40+0000 lvl=info msg="Executing migration" logger=migrator id="create plugin_setting table" 2020-07-16T13:34:40.808 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:40 smithi188 bash[1368]: t=2020-07-16T13:34:40+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_plugin_setting_org_id_plugin_id - v1" 2020-07-16T13:34:41.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:40 smithi132 bash[27079]: cluster 2020-07-16T13:34:39.737623+0000 mgr.y (mgr.14140) 182 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:41.029 INFO:journalctl@ceph.alertmanager.a.smithi132.stdout:Jul 16 13:34:40 smithi132 bash[3471]: level=info ts=2020-07-16T13:34:40.814Z caller=main.go:524 msg="Received SIGTERM, exiting gracefully..." 2020-07-16T13:34:41.029 INFO:journalctl@ceph.alertmanager.a.smithi132.stdout:Jul 16 13:34:40 smithi132 podman[6166]: 2020-07-16 13:34:40.967142917 +0000 UTC m=+0.290218916 container died f3982ed084323ee8c7d96210dd7d0771cfee2683c07d09751299f34d40bd6e72 (image=docker.io/prom/alertmanager:latest, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-alertmanager.a) 2020-07-16T13:34:41.030 INFO:journalctl@ceph.alertmanager.a.smithi132.stdout:Jul 16 13:34:41 smithi132 podman[6166]: 2020-07-16 13:34:41.007345617 +0000 UTC m=+0.330421609 container stop f3982ed084323ee8c7d96210dd7d0771cfee2683c07d09751299f34d40bd6e72 (image=docker.io/prom/alertmanager:latest, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-alertmanager.a) 2020-07-16T13:34:41.030 INFO:journalctl@ceph.alertmanager.a.smithi132.stdout:Jul 16 13:34:41 smithi132 podman[6166]: f3982ed084323ee8c7d96210dd7d0771cfee2683c07d09751299f34d40bd6e72 2020-07-16T13:34:41.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:40 smithi132 bash[23299]: cluster 2020-07-16T13:34:39.737623+0000 mgr.y (mgr.14140) 182 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:41.111 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:40 smithi188 bash[23329]: cluster 2020-07-16T13:34:39.737623+0000 mgr.y (mgr.14140) 182 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:41.111 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:40 smithi188 bash[1368]: t=2020-07-16T13:34:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_version to plugin_settings" 2020-07-16T13:34:41.112 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:40 smithi188 bash[1368]: t=2020-07-16T13:34:40+0000 lvl=info msg="Executing migration" logger=migrator id="Update plugin_setting table charset" 2020-07-16T13:34:41.112 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:40 smithi188 bash[1368]: t=2020-07-16T13:34:40+0000 lvl=info msg="Executing migration" logger=migrator id="create session table" 2020-07-16T13:34:41.112 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:41 smithi188 bash[1368]: t=2020-07-16T13:34:41+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist table" 2020-07-16T13:34:41.112 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:41 smithi188 bash[1368]: t=2020-07-16T13:34:41+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist_item table" 2020-07-16T13:34:41.362 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:41 smithi188 bash[1368]: t=2020-07-16T13:34:41+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist table v2" 2020-07-16T13:34:41.362 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:41 smithi188 bash[1368]: t=2020-07-16T13:34:41+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist item table v2" 2020-07-16T13:34:41.363 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:41 smithi188 bash[1368]: t=2020-07-16T13:34:41+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist table charset" 2020-07-16T13:34:41.651 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:41 smithi188 bash[1368]: t=2020-07-16T13:34:41+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist_item table charset" 2020-07-16T13:34:41.652 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:41 smithi188 bash[1368]: t=2020-07-16T13:34:41+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v2" 2020-07-16T13:34:41.652 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:41 smithi188 bash[1368]: t=2020-07-16T13:34:41+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v3" 2020-07-16T13:34:41.652 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:41 smithi188 bash[1368]: t=2020-07-16T13:34:41+0000 lvl=info msg="Executing migration" logger=migrator id="create preferences table v3" 2020-07-16T13:34:41.653 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:41 smithi188 bash[1368]: t=2020-07-16T13:34:41+0000 lvl=info msg="Executing migration" logger=migrator id="Update preferences table charset" 2020-07-16T13:34:41.903 INFO:journalctl@ceph.alertmanager.a.smithi132.stdout:Jul 16 13:34:41 smithi132 systemd[1]: Stopped Ceph alertmanager.a for 4c8ed362-c768-11ea-a06f-001a4aab830c. 2020-07-16T13:34:41.904 INFO:journalctl@ceph.alertmanager.a.smithi132.stdout:Jul 16 13:34:41 smithi132 systemd[1]: Starting Ceph alertmanager.a for 4c8ed362-c768-11ea-a06f-001a4aab830c... 2020-07-16T13:34:41.920 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:41 smithi188 bash[1368]: t=2020-07-16T13:34:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add column team_id in preferences" 2020-07-16T13:34:41.921 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:41 smithi188 bash[1368]: t=2020-07-16T13:34:41+0000 lvl=info msg="Executing migration" logger=migrator id="Update team_id column values in preferences" 2020-07-16T13:34:41.921 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:41 smithi188 bash[1368]: t=2020-07-16T13:34:41+0000 lvl=info msg="Executing migration" logger=migrator id="create alert table v1" 2020-07-16T13:34:42.158 INFO:journalctl@ceph.alertmanager.a.smithi132.stdout:Jul 16 13:34:41 smithi132 podman[6265]: Error: no container with name or ID ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-alertmanager.a found: no such container 2020-07-16T13:34:42.159 INFO:journalctl@ceph.alertmanager.a.smithi132.stdout:Jul 16 13:34:41 smithi132 systemd[1]: Started Ceph alertmanager.a for 4c8ed362-c768-11ea-a06f-001a4aab830c. 2020-07-16T13:34:42.276 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:41 smithi188 bash[1368]: t=2020-07-16T13:34:41+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert org_id & id " 2020-07-16T13:34:42.276 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:42 smithi188 bash[1368]: t=2020-07-16T13:34:42+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert state" 2020-07-16T13:34:42.277 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:42 smithi188 bash[1368]: t=2020-07-16T13:34:42+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert dashboard_id" 2020-07-16T13:34:42.277 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:42 smithi188 bash[1368]: t=2020-07-16T13:34:42+0000 lvl=info msg="Executing migration" logger=migrator id="Create alert_rule_tag table v1" 2020-07-16T13:34:42.277 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:42 smithi188 bash[1368]: t=2020-07-16T13:34:42+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_rule_tag.alert_id_tag_id" 2020-07-16T13:34:42.419 INFO:journalctl@ceph.alertmanager.a.smithi132.stdout:Jul 16 13:34:42 smithi132 podman[6285]: 2020-07-16 13:34:42.334188004 +0000 UTC m=+0.402166662 container create 83de891fa91ca7d35a5f8af864e709a4523cc9995525e8c46bcce782204a1d12 (image=docker.io/prom/alertmanager:latest, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-alertmanager.a) 2020-07-16T13:34:42.620 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:42 smithi188 bash[1368]: t=2020-07-16T13:34:42+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification table v1" 2020-07-16T13:34:42.621 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:42 smithi188 bash[1368]: t=2020-07-16T13:34:42+0000 lvl=info msg="Executing migration" logger=migrator id="Add column is_default" 2020-07-16T13:34:42.692 INFO:teuthology.orchestra.run.smithi132.stdout:68719476771 2020-07-16T13:34:42.699 INFO:journalctl@ceph.alertmanager.a.smithi132.stdout:Jul 16 13:34:42 smithi132 podman[6285]: 2020-07-16 13:34:42.663287889 +0000 UTC m=+0.731266545 container init 83de891fa91ca7d35a5f8af864e709a4523cc9995525e8c46bcce782204a1d12 (image=docker.io/prom/alertmanager:latest, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-alertmanager.a) 2020-07-16T13:34:42.872 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:42 smithi188 bash[1368]: t=2020-07-16T13:34:42+0000 lvl=info msg="Executing migration" logger=migrator id="Add column frequency" 2020-07-16T13:34:42.873 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:42 smithi188 bash[1368]: t=2020-07-16T13:34:42+0000 lvl=info msg="Executing migration" logger=migrator id="Add column send_reminder" 2020-07-16T13:34:42.873 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:42 smithi188 bash[23329]: cluster 2020-07-16T13:34:41.738119+0000 mgr.y (mgr.14140) 183 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:42.874 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:42 smithi188 bash[23329]: audit 2020-07-16T13:34:41.932971+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634664\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634755\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634785\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634812\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634839\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634865\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634891\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634918\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"hostname\": \"smithi132\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2020-07-16T13:34:37.094927\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:34:42.874 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:42 smithi188 bash[23329]: audit 2020-07-16T13:34:41.938005+0000 mon.a (mon.0) 548 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634664\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634755\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634785\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634812\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634839\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634865\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634891\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634918\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"hostname\": \"smithi132\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2020-07-16T13:34:37.094927\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:34:42.874 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:42 smithi188 bash[23329]: cephadm 2020-07-16T13:34:41.938586+0000 mgr.y (mgr.14140) 184 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2020-07-16T13:34:42.875 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:42 smithi188 bash[23329]: cephadm 2020-07-16T13:34:41.940879+0000 mgr.y (mgr.14140) 185 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi188 2020-07-16T13:34:42.875 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:42 smithi188 bash[23329]: audit 2020-07-16T13:34:42.690394+0000 mon.c (mon.1) 16 : audit [DBG] from='client.? 172.21.15.132:0/71639513' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2020-07-16T13:34:43.030 INFO:journalctl@ceph.alertmanager.a.smithi132.stdout:Jul 16 13:34:42 smithi132 podman[6285]: 2020-07-16 13:34:42.69874347 +0000 UTC m=+0.766722111 container start 83de891fa91ca7d35a5f8af864e709a4523cc9995525e8c46bcce782204a1d12 (image=docker.io/prom/alertmanager:latest, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-alertmanager.a) 2020-07-16T13:34:43.030 INFO:journalctl@ceph.alertmanager.a.smithi132.stdout:Jul 16 13:34:42 smithi132 bash[6284]: level=info ts=2020-07-16T13:34:42.690Z caller=main.go:216 msg="Starting Alertmanager" version="(version=0.21.0, branch=HEAD, revision=4c6c03ebfe21009c546e4d1e9b92c371d67c021d)" 2020-07-16T13:34:43.030 INFO:journalctl@ceph.alertmanager.a.smithi132.stdout:Jul 16 13:34:42 smithi132 bash[6284]: level=info ts=2020-07-16T13:34:42.690Z caller=main.go:217 build_context="(go=go1.14.4, user=root@dee35927357f, date=20200617-08:54:02)" 2020-07-16T13:34:43.030 INFO:journalctl@ceph.alertmanager.a.smithi132.stdout:Jul 16 13:34:42 smithi132 bash[6284]: level=info ts=2020-07-16T13:34:42.691Z caller=cluster.go:161 component=cluster msg="setting advertise address explicitly" addr=172.21.15.132 port=9094 2020-07-16T13:34:43.031 INFO:journalctl@ceph.alertmanager.a.smithi132.stdout:Jul 16 13:34:42 smithi132 bash[6284]: level=info ts=2020-07-16T13:34:42.692Z caller=cluster.go:623 component=cluster msg="Waiting for gossip to settle..." interval=2s 2020-07-16T13:34:43.031 INFO:journalctl@ceph.alertmanager.a.smithi132.stdout:Jul 16 13:34:42 smithi132 podman[6285]: 2020-07-16 13:34:42.698813359 +0000 UTC m=+0.766792028 container attach 83de891fa91ca7d35a5f8af864e709a4523cc9995525e8c46bcce782204a1d12 (image=docker.io/prom/alertmanager:latest, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-alertmanager.a) 2020-07-16T13:34:43.031 INFO:journalctl@ceph.alertmanager.a.smithi132.stdout:Jul 16 13:34:42 smithi132 bash[6284]: level=info ts=2020-07-16T13:34:42.713Z caller=coordinator.go:119 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2020-07-16T13:34:43.031 INFO:journalctl@ceph.alertmanager.a.smithi132.stdout:Jul 16 13:34:42 smithi132 bash[6284]: level=info ts=2020-07-16T13:34:42.714Z caller=coordinator.go:131 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2020-07-16T13:34:43.031 INFO:journalctl@ceph.alertmanager.a.smithi132.stdout:Jul 16 13:34:42 smithi132 bash[6284]: level=info ts=2020-07-16T13:34:42.716Z caller=main.go:485 msg=Listening address=:9093 2020-07-16T13:34:43.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:42 smithi132 bash[27079]: cluster 2020-07-16T13:34:41.738119+0000 mgr.y (mgr.14140) 183 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:43.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:42 smithi132 bash[27079]: audit 2020-07-16T13:34:41.932971+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634664\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634755\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634785\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634812\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634839\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634865\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634891\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634918\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"hostname\": \"smithi132\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2020-07-16T13:34:37.094927\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:34:43.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:42 smithi132 bash[27079]: audit 2020-07-16T13:34:41.938005+0000 mon.a (mon.0) 548 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634664\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634755\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634785\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634812\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634839\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634865\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634891\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634918\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"hostname\": \"smithi132\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2020-07-16T13:34:37.094927\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:34:43.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:42 smithi132 bash[27079]: cephadm 2020-07-16T13:34:41.938586+0000 mgr.y (mgr.14140) 184 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2020-07-16T13:34:43.033 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:42 smithi132 bash[27079]: cephadm 2020-07-16T13:34:41.940879+0000 mgr.y (mgr.14140) 185 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi188 2020-07-16T13:34:43.033 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:42 smithi132 bash[27079]: audit 2020-07-16T13:34:42.690394+0000 mon.c (mon.1) 16 : audit [DBG] from='client.? 172.21.15.132:0/71639513' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2020-07-16T13:34:43.033 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:42 smithi132 bash[23299]: cluster 2020-07-16T13:34:41.738119+0000 mgr.y (mgr.14140) 183 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:43.033 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:42 smithi132 bash[23299]: audit 2020-07-16T13:34:41.932971+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634664\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634755\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634785\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634812\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634839\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634865\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634891\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634918\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"hostname\": \"smithi132\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2020-07-16T13:34:37.094927\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:34:43.034 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:42 smithi132 bash[23299]: audit 2020-07-16T13:34:41.938005+0000 mon.a (mon.0) 548 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634664\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634755\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634785\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634812\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634839\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634865\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634891\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:34.634918\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"hostname\": \"smithi132\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2020-07-16T13:34:37.094927\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:34:43.034 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:42 smithi132 bash[23299]: cephadm 2020-07-16T13:34:41.938586+0000 mgr.y (mgr.14140) 184 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2020-07-16T13:34:43.034 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:42 smithi132 bash[23299]: cephadm 2020-07-16T13:34:41.940879+0000 mgr.y (mgr.14140) 185 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi188 2020-07-16T13:34:43.035 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:42 smithi132 bash[23299]: audit 2020-07-16T13:34:42.690394+0000 mon.c (mon.1) 16 : audit [DBG] from='client.? 172.21.15.132:0/71639513' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2020-07-16T13:34:43.165 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:42 smithi188 bash[1368]: t=2020-07-16T13:34:42+0000 lvl=info msg="Executing migration" logger=migrator id="Add column disable_resolve_message" 2020-07-16T13:34:43.165 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:43 smithi188 bash[1368]: t=2020-07-16T13:34:43+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification org_id & name" 2020-07-16T13:34:43.166 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:43 smithi188 bash[1368]: t=2020-07-16T13:34:43+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert table charset" 2020-07-16T13:34:43.293 INFO:tasks.cephadm.ceph_manager.ceph:need seq 68719476767 got 68719476771 for osd.1 2020-07-16T13:34:43.294 INFO:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 4c8ed362-c768-11ea-a06f-001a4aab830c -- ceph osd last-stat-seq osd.2 2020-07-16T13:34:43.426 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:43 smithi188 bash[1368]: t=2020-07-16T13:34:43+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert_notification table charset" 2020-07-16T13:34:43.884 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:43 smithi188 bash[1368]: t=2020-07-16T13:34:43+0000 lvl=info msg="Executing migration" logger=migrator id="create notification_journal table v1" 2020-07-16T13:34:44.170 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:43 smithi188 bash[1368]: t=2020-07-16T13:34:43+0000 lvl=info msg="Executing migration" logger=migrator id="add index notification_journal org_id & alert_id & notifier_id" 2020-07-16T13:34:44.171 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:43 smithi188 bash[1368]: t=2020-07-16T13:34:43+0000 lvl=info msg="Executing migration" logger=migrator id="drop alert_notification_journal" 2020-07-16T13:34:44.171 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:44 smithi188 bash[1368]: t=2020-07-16T13:34:44+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification_state table v1" 2020-07-16T13:34:44.540 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:44 smithi188 bash[1368]: t=2020-07-16T13:34:44+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification_state org_id & alert_id & notifier_id" 2020-07-16T13:34:44.540 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:44 smithi188 bash[1368]: t=2020-07-16T13:34:44+0000 lvl=info msg="Executing migration" logger=migrator id="Add for to alert table" 2020-07-16T13:34:44.540 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:44 smithi188 bash[1368]: t=2020-07-16T13:34:44+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in alert_notification" 2020-07-16T13:34:44.779 INFO:journalctl@ceph.alertmanager.a.smithi132.stdout:Jul 16 13:34:44 smithi132 bash[6284]: level=info ts=2020-07-16T13:34:44.692Z caller=cluster.go:648 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000064643s 2020-07-16T13:34:44.818 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:44 smithi188 bash[1368]: t=2020-07-16T13:34:44+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in alert_notification" 2020-07-16T13:34:44.818 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:44 smithi188 bash[1368]: t=2020-07-16T13:34:44+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_notification_org_id_uid" 2020-07-16T13:34:44.819 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:44 smithi188 bash[1368]: t=2020-07-16T13:34:44+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_name" 2020-07-16T13:34:45.089 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:44 smithi188 bash[23329]: cluster 2020-07-16T13:34:43.738411+0000 mgr.y (mgr.14140) 186 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:45.090 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:44 smithi188 bash[1368]: t=2020-07-16T13:34:44+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old annotation table v4" 2020-07-16T13:34:45.090 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:44 smithi188 bash[1368]: t=2020-07-16T13:34:44+0000 lvl=info msg="Executing migration" logger=migrator id="create annotation table v5" 2020-07-16T13:34:45.090 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:45 smithi188 bash[1368]: t=2020-07-16T13:34:45+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 0 v3" 2020-07-16T13:34:45.186 INFO:teuthology.orchestra.run.smithi132.stdout:90194313248 2020-07-16T13:34:45.216 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:44 smithi132 bash[23299]: cluster 2020-07-16T13:34:43.738411+0000 mgr.y (mgr.14140) 186 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:45.216 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:44 smithi132 bash[27079]: cluster 2020-07-16T13:34:43.738411+0000 mgr.y (mgr.14140) 186 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:45.420 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:45 smithi188 bash[1368]: t=2020-07-16T13:34:45+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 1 v3" 2020-07-16T13:34:45.726 INFO:tasks.cephadm.ceph_manager.ceph:need seq 90194313244 got 90194313248 for osd.2 2020-07-16T13:34:45.727 INFO:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 4c8ed362-c768-11ea-a06f-001a4aab830c -- ceph osd last-stat-seq osd.3 2020-07-16T13:34:45.878 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:45 smithi188 bash[23329]: audit 2020-07-16T13:34:45.184182+0000 mon.a (mon.0) 549 : audit [DBG] from='client.? 172.21.15.132:0/1697002146' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2020-07-16T13:34:45.878 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 13:34:45 smithi188 systemd[1]: Stopping Ceph prometheus.a for 4c8ed362-c768-11ea-a06f-001a4aab830c... 2020-07-16T13:34:45.879 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:45 smithi188 bash[1368]: t=2020-07-16T13:34:45+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 2 v3" 2020-07-16T13:34:45.879 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:45 smithi188 bash[1368]: t=2020-07-16T13:34:45+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 3 v3" 2020-07-16T13:34:45.879 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:45 smithi188 bash[1368]: t=2020-07-16T13:34:45+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 4 v3" 2020-07-16T13:34:46.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:45 smithi132 bash[27079]: audit 2020-07-16T13:34:45.184182+0000 mon.a (mon.0) 549 : audit [DBG] from='client.? 172.21.15.132:0/1697002146' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2020-07-16T13:34:46.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:45 smithi132 bash[23299]: audit 2020-07-16T13:34:45.184182+0000 mon.a (mon.0) 549 : audit [DBG] from='client.? 172.21.15.132:0/1697002146' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2020-07-16T13:34:46.152 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 13:34:45 smithi188 bash[326]: level=warn ts=2020-07-16T13:34:45.876Z caller=main.go:524 msg="Received SIGTERM, exiting gracefully..." 2020-07-16T13:34:46.152 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 13:34:45 smithi188 bash[326]: level=info ts=2020-07-16T13:34:45.876Z caller=main.go:547 msg="Stopping scrape discovery manager..." 2020-07-16T13:34:46.152 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 13:34:45 smithi188 bash[326]: level=info ts=2020-07-16T13:34:45.876Z caller=main.go:561 msg="Stopping notify discovery manager..." 2020-07-16T13:34:46.152 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 13:34:45 smithi188 bash[326]: level=info ts=2020-07-16T13:34:45.876Z caller=main.go:583 msg="Stopping scrape manager..." 2020-07-16T13:34:46.153 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 13:34:45 smithi188 bash[326]: level=info ts=2020-07-16T13:34:45.876Z caller=main.go:543 msg="Scrape discovery manager stopped" 2020-07-16T13:34:46.153 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 13:34:45 smithi188 bash[326]: level=info ts=2020-07-16T13:34:45.876Z caller=manager.go:882 component="rule manager" msg="Stopping rule manager..." 2020-07-16T13:34:46.153 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 13:34:45 smithi188 bash[326]: level=info ts=2020-07-16T13:34:45.876Z caller=manager.go:892 component="rule manager" msg="Rule manager stopped" 2020-07-16T13:34:46.153 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 13:34:45 smithi188 bash[326]: level=info ts=2020-07-16T13:34:45.876Z caller=main.go:557 msg="Notify discovery manager stopped" 2020-07-16T13:34:46.154 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 13:34:45 smithi188 bash[326]: level=info ts=2020-07-16T13:34:45.876Z caller=main.go:577 msg="Scrape manager stopped" 2020-07-16T13:34:46.154 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 13:34:45 smithi188 bash[326]: level=info ts=2020-07-16T13:34:45.876Z caller=notifier.go:601 component=notifier msg="Stopping notification manager..." 2020-07-16T13:34:46.154 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 13:34:45 smithi188 bash[326]: level=info ts=2020-07-16T13:34:45.876Z caller=main.go:749 msg="Notifier manager stopped" 2020-07-16T13:34:46.154 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 13:34:45 smithi188 bash[326]: level=info ts=2020-07-16T13:34:45.877Z caller=main.go:761 msg="See you next time!" 2020-07-16T13:34:46.155 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 13:34:46 smithi188 podman[2005]: 2020-07-16 13:34:46.108390068 +0000 UTC m=+0.268203477 container died 55d17e2eaa72cbceaf083adb1b6c3deb261465f6100415ee25caa0096c9cb03a (image=docker.io/prom/prometheus:latest, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-prometheus.a) 2020-07-16T13:34:46.155 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 13:34:46 smithi188 podman[2005]: 2020-07-16 13:34:46.150924636 +0000 UTC m=+0.310738036 container stop 55d17e2eaa72cbceaf083adb1b6c3deb261465f6100415ee25caa0096c9cb03a (image=docker.io/prom/prometheus:latest, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-prometheus.a) 2020-07-16T13:34:46.155 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 13:34:46 smithi188 podman[2005]: 55d17e2eaa72cbceaf083adb1b6c3deb261465f6100415ee25caa0096c9cb03a 2020-07-16T13:34:46.155 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:45 smithi188 bash[1368]: t=2020-07-16T13:34:45+0000 lvl=info msg="Executing migration" logger=migrator id="Update annotation table charset" 2020-07-16T13:34:46.155 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:45 smithi188 bash[1368]: t=2020-07-16T13:34:45+0000 lvl=info msg="Executing migration" logger=migrator id="Add column region_id to annotation table" 2020-07-16T13:34:46.156 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:46 smithi188 bash[1368]: t=2020-07-16T13:34:46+0000 lvl=info msg="Executing migration" logger=migrator id="Drop category_id index" 2020-07-16T13:34:46.420 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:46 smithi188 bash[1368]: t=2020-07-16T13:34:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add column tags to annotation table" 2020-07-16T13:34:46.763 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:46 smithi188 bash[1368]: t=2020-07-16T13:34:46+0000 lvl=info msg="Executing migration" logger=migrator id="Create annotation_tag table v2" 2020-07-16T13:34:46.763 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:46 smithi188 bash[1368]: t=2020-07-16T13:34:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index annotation_tag.annotation_id_tag_id" 2020-07-16T13:34:46.764 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:46 smithi188 bash[1368]: t=2020-07-16T13:34:46+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert annotations and set TEXT to empty" 2020-07-16T13:34:47.088 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:46 smithi188 bash[23329]: cluster 2020-07-16T13:34:45.738708+0000 mgr.y (mgr.14140) 187 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:47.089 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 13:34:46 smithi188 systemd[1]: Stopped Ceph prometheus.a for 4c8ed362-c768-11ea-a06f-001a4aab830c. 2020-07-16T13:34:47.089 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 13:34:46 smithi188 systemd[1]: Starting Ceph prometheus.a for 4c8ed362-c768-11ea-a06f-001a4aab830c... 2020-07-16T13:34:47.089 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 13:34:46 smithi188 podman[2048]: Error: no container with name or ID ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-prometheus.a found: no such container 2020-07-16T13:34:47.090 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 13:34:46 smithi188 systemd[1]: Started Ceph prometheus.a for 4c8ed362-c768-11ea-a06f-001a4aab830c. 2020-07-16T13:34:47.090 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:46 smithi188 bash[1368]: t=2020-07-16T13:34:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add created time to annotation table" 2020-07-16T13:34:47.091 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:46 smithi188 bash[1368]: t=2020-07-16T13:34:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add updated time to annotation table" 2020-07-16T13:34:47.241 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:46 smithi132 bash[27079]: cluster 2020-07-16T13:34:45.738708+0000 mgr.y (mgr.14140) 187 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:47.241 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:46 smithi132 bash[23299]: cluster 2020-07-16T13:34:45.738708+0000 mgr.y (mgr.14140) 187 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:47.340 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 13:34:47 smithi188 podman[2066]: 2020-07-16 13:34:47.261526162 +0000 UTC m=+0.419069331 container create a143aea22145d2ee30a0fc7a275d87bcaa9ee3e962b5246b275db90d4e56bd0e (image=docker.io/prom/prometheus:latest, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-prometheus.a) 2020-07-16T13:34:47.341 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:47 smithi188 bash[1368]: t=2020-07-16T13:34:47+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for created in annotation table" 2020-07-16T13:34:47.341 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:47 smithi188 bash[1368]: t=2020-07-16T13:34:47+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for updated in annotation table" 2020-07-16T13:34:47.342 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:47 smithi188 bash[1368]: t=2020-07-16T13:34:47+0000 lvl=info msg="Executing migration" logger=migrator id="Convert existing annotations from seconds to milliseconds" 2020-07-16T13:34:47.606 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:47 smithi188 bash[1368]: t=2020-07-16T13:34:47+0000 lvl=info msg="Executing migration" logger=migrator id="Add epoch_end column" 2020-07-16T13:34:47.607 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:47 smithi188 bash[1368]: t=2020-07-16T13:34:47+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for epoch_end" 2020-07-16T13:34:47.607 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:47 smithi188 bash[1368]: t=2020-07-16T13:34:47+0000 lvl=info msg="Executing migration" logger=migrator id="Make epoch_end the same as epoch" 2020-07-16T13:34:47.626 INFO:teuthology.orchestra.run.smithi132.stdout:111669149724 2020-07-16T13:34:47.902 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:47 smithi188 bash[1368]: t=2020-07-16T13:34:47+0000 lvl=info msg="Executing migration" logger=migrator id="Move region to single row" 2020-07-16T13:34:47.903 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:47 smithi188 bash[1368]: t=2020-07-16T13:34:47+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch from annotation table" 2020-07-16T13:34:47.903 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:47 smithi188 bash[1368]: t=2020-07-16T13:34:47+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_dashboard_id_panel_id_epoch from annotation table" 2020-07-16T13:34:47.903 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:47 smithi188 bash[1368]: t=2020-07-16T13:34:47+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_dashboard_id_epoch_end_epoch on annotation table" 2020-07-16T13:34:47.903 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:47 smithi188 bash[23329]: audit 2020-07-16T13:34:46.844477+0000 mon.a (mon.0) 550 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087089\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087167\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087199\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087227\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087255\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087282\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"hostname\": \"smithi188\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087337\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087364\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:34:47.904 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:47 smithi188 bash[23329]: audit 2020-07-16T13:34:46.847228+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087089\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087167\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087199\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087227\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087255\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087282\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"hostname\": \"smithi188\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087337\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087364\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:34:47.904 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:47 smithi188 bash[23329]: cephadm 2020-07-16T13:34:46.847575+0000 mgr.y (mgr.14140) 188 : cephadm [INF] Setting dashboard grafana config to https://smithi188:3000 2020-07-16T13:34:47.904 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:47 smithi188 bash[23329]: audit 2020-07-16T13:34:46.847742+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config set","value":"https://smithi188:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]: dispatch 2020-07-16T13:34:47.905 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:47 smithi188 bash[23329]: audit 2020-07-16T13:34:46.850542+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config set","value":"https://smithi188:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]': finished 2020-07-16T13:34:47.905 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:47 smithi188 bash[23329]: audit 2020-07-16T13:34:46.852710+0000 mon.a (mon.0) 554 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:34:47.905 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:47 smithi188 bash[23329]: audit 2020-07-16T13:34:47.625444+0000 mon.a (mon.0) 555 : audit [DBG] from='client.? 172.21.15.132:0/1075179054' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2020-07-16T13:34:47.905 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 13:34:47 smithi188 podman[2066]: 2020-07-16 13:34:47.620762793 +0000 UTC m=+0.778305965 container init a143aea22145d2ee30a0fc7a275d87bcaa9ee3e962b5246b275db90d4e56bd0e (image=docker.io/prom/prometheus:latest, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-prometheus.a) 2020-07-16T13:34:47.906 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 13:34:47 smithi188 podman[2066]: 2020-07-16 13:34:47.666173725 +0000 UTC m=+0.823716911 container start a143aea22145d2ee30a0fc7a275d87bcaa9ee3e962b5246b275db90d4e56bd0e (image=docker.io/prom/prometheus:latest, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-prometheus.a) 2020-07-16T13:34:47.906 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 13:34:47 smithi188 podman[2066]: 2020-07-16 13:34:47.666253351 +0000 UTC m=+0.823796570 container attach a143aea22145d2ee30a0fc7a275d87bcaa9ee3e962b5246b275db90d4e56bd0e (image=docker.io/prom/prometheus:latest, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-prometheus.a) 2020-07-16T13:34:47.906 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 13:34:47 smithi188 bash[2065]: level=info ts=2020-07-16T13:34:47.655Z caller=main.go:302 msg="No time or size retention was set so using the default time retention" duration=15d 2020-07-16T13:34:47.915 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 13:34:47 smithi188 bash[2065]: level=info ts=2020-07-16T13:34:47.655Z caller=main.go:337 msg="Starting Prometheus" version="(version=2.19.2, branch=HEAD, revision=c448ada63d83002e9c1d2c9f84e09f55a61f0ff7)" 2020-07-16T13:34:47.915 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 13:34:47 smithi188 bash[2065]: level=info ts=2020-07-16T13:34:47.655Z caller=main.go:338 build_context="(go=go1.14.4, user=root@dd72efe1549d, date=20200626-09:02:20)" 2020-07-16T13:34:47.915 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 13:34:47 smithi188 bash[2065]: level=info ts=2020-07-16T13:34:47.655Z caller=main.go:339 host_details="(Linux 4.18.0-193.el8.x86_64 #1 SMP Fri Mar 27 14:35:58 UTC 2020 x86_64 smithi188 (none))" 2020-07-16T13:34:47.916 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 13:34:47 smithi188 bash[2065]: level=info ts=2020-07-16T13:34:47.655Z caller=main.go:340 fd_limits="(soft=1048576, hard=1048576)" 2020-07-16T13:34:47.916 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 13:34:47 smithi188 bash[2065]: level=info ts=2020-07-16T13:34:47.655Z caller=main.go:341 vm_limits="(soft=unlimited, hard=unlimited)" 2020-07-16T13:34:47.916 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 13:34:47 smithi188 bash[2065]: level=info ts=2020-07-16T13:34:47.656Z caller=main.go:678 msg="Starting TSDB ..." 2020-07-16T13:34:47.917 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 13:34:47 smithi188 bash[2065]: level=info ts=2020-07-16T13:34:47.656Z caller=web.go:524 component=web msg="Start listening for connections" address=:9095 2020-07-16T13:34:47.917 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 13:34:47 smithi188 bash[2065]: level=info ts=2020-07-16T13:34:47.658Z caller=head.go:645 component=tsdb msg="Replaying WAL and on-disk memory mappable chunks if any, this may take a while" 2020-07-16T13:34:47.917 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 13:34:47 smithi188 bash[2065]: level=info ts=2020-07-16T13:34:47.658Z caller=head.go:706 component=tsdb msg="WAL segment loaded" segment=0 maxSegment=1 2020-07-16T13:34:47.917 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 13:34:47 smithi188 bash[2065]: level=info ts=2020-07-16T13:34:47.658Z caller=head.go:706 component=tsdb msg="WAL segment loaded" segment=1 maxSegment=1 2020-07-16T13:34:47.918 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 13:34:47 smithi188 bash[2065]: level=info ts=2020-07-16T13:34:47.659Z caller=head.go:709 component=tsdb msg="WAL replay completed" duration=557.824µs 2020-07-16T13:34:47.919 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 13:34:47 smithi188 bash[2065]: level=info ts=2020-07-16T13:34:47.659Z caller=main.go:694 fs_type=XFS_SUPER_MAGIC 2020-07-16T13:34:47.919 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 13:34:47 smithi188 bash[2065]: level=info ts=2020-07-16T13:34:47.659Z caller=main.go:695 msg="TSDB started" 2020-07-16T13:34:47.919 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 13:34:47 smithi188 bash[2065]: level=info ts=2020-07-16T13:34:47.659Z caller=main.go:799 msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2020-07-16T13:34:47.919 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 13:34:47 smithi188 bash[2065]: level=info ts=2020-07-16T13:34:47.661Z caller=main.go:827 msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml 2020-07-16T13:34:47.919 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 13:34:47 smithi188 bash[2065]: level=info ts=2020-07-16T13:34:47.661Z caller=main.go:646 msg="Server is ready to receive web requests." 2020-07-16T13:34:47.942 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:47 smithi132 bash[23299]: audit 2020-07-16T13:34:46.844477+0000 mon.a (mon.0) 550 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087089\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087167\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087199\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087227\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087255\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087282\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"hostname\": \"smithi188\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087337\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087364\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:34:47.943 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:47 smithi132 bash[23299]: audit 2020-07-16T13:34:46.847228+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087089\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087167\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087199\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087227\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087255\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087282\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"hostname\": \"smithi188\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087337\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087364\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:34:47.943 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:47 smithi132 bash[23299]: cephadm 2020-07-16T13:34:46.847575+0000 mgr.y (mgr.14140) 188 : cephadm [INF] Setting dashboard grafana config to https://smithi188:3000 2020-07-16T13:34:47.943 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:47 smithi132 bash[23299]: audit 2020-07-16T13:34:46.847742+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config set","value":"https://smithi188:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]: dispatch 2020-07-16T13:34:47.944 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:47 smithi132 bash[23299]: audit 2020-07-16T13:34:46.850542+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config set","value":"https://smithi188:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]': finished 2020-07-16T13:34:47.944 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:47 smithi132 bash[23299]: audit 2020-07-16T13:34:46.852710+0000 mon.a (mon.0) 554 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:34:47.945 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:47 smithi132 bash[23299]: audit 2020-07-16T13:34:47.625444+0000 mon.a (mon.0) 555 : audit [DBG] from='client.? 172.21.15.132:0/1075179054' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2020-07-16T13:34:48.164 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149720 got 111669149724 for osd.3 2020-07-16T13:34:48.165 INFO:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 4c8ed362-c768-11ea-a06f-001a4aab830c -- ceph osd last-stat-seq osd.4 2020-07-16T13:34:48.171 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:48 smithi188 bash[1368]: t=2020-07-16T13:34:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_epoch_end_epoch on annotation table" 2020-07-16T13:34:48.171 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:48 smithi188 bash[1368]: t=2020-07-16T13:34:48+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch_epoch_end from annotation table" 2020-07-16T13:34:48.171 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:48 smithi188 bash[1368]: t=2020-07-16T13:34:48+0000 lvl=info msg="Executing migration" logger=migrator id="create test_data table" 2020-07-16T13:34:48.196 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:47 smithi132 bash[27079]: audit 2020-07-16T13:34:46.844477+0000 mon.a (mon.0) 550 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087089\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087167\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087199\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087227\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087255\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087282\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"hostname\": \"smithi188\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087337\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087364\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:34:48.196 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:47 smithi132 bash[27079]: audit 2020-07-16T13:34:46.847228+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087089\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087167\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087199\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087227\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087255\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087282\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"hostname\": \"smithi188\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087337\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:37.087364\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:34:48.196 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:47 smithi132 bash[27079]: cephadm 2020-07-16T13:34:46.847575+0000 mgr.y (mgr.14140) 188 : cephadm [INF] Setting dashboard grafana config to https://smithi188:3000 2020-07-16T13:34:48.197 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:47 smithi132 bash[27079]: audit 2020-07-16T13:34:46.847742+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config set","value":"https://smithi188:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]: dispatch 2020-07-16T13:34:48.197 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:47 smithi132 bash[27079]: audit 2020-07-16T13:34:46.850542+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config set","value":"https://smithi188:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]': finished 2020-07-16T13:34:48.197 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:47 smithi132 bash[27079]: audit 2020-07-16T13:34:46.852710+0000 mon.a (mon.0) 554 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:34:48.197 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:47 smithi132 bash[27079]: audit 2020-07-16T13:34:47.625444+0000 mon.a (mon.0) 555 : audit [DBG] from='client.? 172.21.15.132:0/1075179054' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2020-07-16T13:34:48.505 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:48 smithi188 bash[1368]: t=2020-07-16T13:34:48+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_version table v1" 2020-07-16T13:34:48.505 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:48 smithi188 bash[1368]: t=2020-07-16T13:34:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_version.dashboard_id" 2020-07-16T13:34:48.505 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:48 smithi188 bash[1368]: t=2020-07-16T13:34:48+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_version.dashboard_id and dashboard_version.version" 2020-07-16T13:34:48.506 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:48 smithi188 bash[1368]: t=2020-07-16T13:34:48+0000 lvl=info msg="Executing migration" logger=migrator id="Set dashboard version to 1 where 0" 2020-07-16T13:34:48.506 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:48 smithi188 bash[1368]: t=2020-07-16T13:34:48+0000 lvl=info msg="Executing migration" logger=migrator id="save existing dashboard data in dashboard_version table v1" 2020-07-16T13:34:48.815 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:48 smithi188 bash[1368]: t=2020-07-16T13:34:48+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_version.data to mediumtext v1" 2020-07-16T13:34:48.815 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:48 smithi188 bash[1368]: t=2020-07-16T13:34:48+0000 lvl=info msg="Executing migration" logger=migrator id="create team table" 2020-07-16T13:34:48.815 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:48 smithi188 bash[1368]: t=2020-07-16T13:34:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index team.org_id" 2020-07-16T13:34:48.815 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:48 smithi188 bash[1368]: t=2020-07-16T13:34:48+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_org_id_name" 2020-07-16T13:34:49.090 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:48 smithi188 bash[23329]: cluster 2020-07-16T13:34:47.739050+0000 mgr.y (mgr.14140) 189 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:49.090 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:48 smithi188 bash[1368]: t=2020-07-16T13:34:48+0000 lvl=info msg="Executing migration" logger=migrator id="create team member table" 2020-07-16T13:34:49.091 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:48 smithi188 bash[1368]: t=2020-07-16T13:34:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_member.org_id" 2020-07-16T13:34:49.091 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:49 smithi188 bash[1368]: t=2020-07-16T13:34:49+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_member_org_id_team_id_user_id" 2020-07-16T13:34:49.091 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:49 smithi188 bash[1368]: t=2020-07-16T13:34:49+0000 lvl=info msg="Executing migration" logger=migrator id="Add column email to team table" 2020-07-16T13:34:49.199 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:48 smithi132 bash[27079]: cluster 2020-07-16T13:34:47.739050+0000 mgr.y (mgr.14140) 189 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:49.199 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:48 smithi132 bash[23299]: cluster 2020-07-16T13:34:47.739050+0000 mgr.y (mgr.14140) 189 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:49.392 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:49 smithi188 bash[1368]: t=2020-07-16T13:34:49+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external to team_member table" 2020-07-16T13:34:49.392 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:49 smithi188 bash[1368]: t=2020-07-16T13:34:49+0000 lvl=info msg="Executing migration" logger=migrator id="Add column permission to team_member table" 2020-07-16T13:34:49.392 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:49 smithi188 bash[1368]: t=2020-07-16T13:34:49+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard acl table" 2020-07-16T13:34:49.393 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:49 smithi188 bash[1368]: t=2020-07-16T13:34:49+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_dashboard_id" 2020-07-16T13:34:49.666 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:49 smithi188 bash[1368]: t=2020-07-16T13:34:49+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_user_id" 2020-07-16T13:34:49.666 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:49 smithi188 bash[1368]: t=2020-07-16T13:34:49+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_team_id" 2020-07-16T13:34:49.667 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:49 smithi188 bash[1368]: t=2020-07-16T13:34:49+0000 lvl=info msg="Executing migration" logger=migrator id="save default acl rules in dashboard_acl table" 2020-07-16T13:34:49.921 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:49 smithi188 bash[1368]: t=2020-07-16T13:34:49+0000 lvl=info msg="Executing migration" logger=migrator id="create tag table" 2020-07-16T13:34:49.921 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:49 smithi188 bash[1368]: t=2020-07-16T13:34:49+0000 lvl=info msg="Executing migration" logger=migrator id="add index tag.key_value" 2020-07-16T13:34:49.921 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:49 smithi188 bash[1368]: t=2020-07-16T13:34:49+0000 lvl=info msg="Executing migration" logger=migrator id="create login attempt table" 2020-07-16T13:34:49.922 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:49 smithi188 bash[1368]: t=2020-07-16T13:34:49+0000 lvl=info msg="Executing migration" logger=migrator id="add index login_attempt.username" 2020-07-16T13:34:50.203 INFO:teuthology.orchestra.run.smithi132.stdout:154618822678 2020-07-16T13:34:50.243 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:49 smithi188 bash[1368]: t=2020-07-16T13:34:49+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_login_attempt_username - v1" 2020-07-16T13:34:50.243 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:50 smithi188 bash[1368]: t=2020-07-16T13:34:50+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table login_attempt to login_attempt_tmp_qwerty - v1" 2020-07-16T13:34:50.244 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:50 smithi188 bash[1368]: t=2020-07-16T13:34:50+0000 lvl=info msg="Executing migration" logger=migrator id="create login_attempt v2" 2020-07-16T13:34:50.244 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:50 smithi188 bash[1368]: t=2020-07-16T13:34:50+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_login_attempt_username - v2" 2020-07-16T13:34:50.539 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:50 smithi188 bash[1368]: t=2020-07-16T13:34:50+0000 lvl=info msg="Executing migration" logger=migrator id="copy login_attempt v1 to v2" 2020-07-16T13:34:50.540 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:50 smithi188 bash[1368]: t=2020-07-16T13:34:50+0000 lvl=info msg="Executing migration" logger=migrator id="drop login_attempt_tmp_qwerty" 2020-07-16T13:34:50.540 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:50 smithi188 bash[1368]: t=2020-07-16T13:34:50+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth table" 2020-07-16T13:34:50.540 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:50 smithi188 bash[1368]: t=2020-07-16T13:34:50+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_user_auth_auth_module_auth_id - v1" 2020-07-16T13:34:50.833 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822675 got 154618822678 for osd.4 2020-07-16T13:34:50.834 INFO:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 4c8ed362-c768-11ea-a06f-001a4aab830c -- ceph osd last-stat-seq osd.5 2020-07-16T13:34:50.839 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:50 smithi188 bash[1368]: t=2020-07-16T13:34:50+0000 lvl=info msg="Executing migration" logger=migrator id="alter user_auth.auth_id to length 190" 2020-07-16T13:34:50.839 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:50 smithi188 bash[1368]: t=2020-07-16T13:34:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth access token to user_auth" 2020-07-16T13:34:50.840 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:50 smithi188 bash[23329]: cluster 2020-07-16T13:34:49.739375+0000 mgr.y (mgr.14140) 190 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:50.840 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:50 smithi188 bash[23329]: audit 2020-07-16T13:34:50.006908+0000 mon.a (mon.0) 556 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:50.005660\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:50.005734\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:50.005766\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:50.005794\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:50.005821\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:50.005848\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:50.005914\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:50.005944\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"hostname\": \"smithi132\", \"container_id\": \"83de891fa91c\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:50.005972\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:34:42.059327\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2020-07-16T13:34:37.094927\"}}, \"last_daemon_update\": \"2020-07-16T13:34:50.006044\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:34:50.840 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:50 smithi188 bash[23329]: audit 2020-07-16T13:34:50.012131+0000 mon.a (mon.0) 557 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:50.005660\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:50.005734\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:50.005766\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:50.005794\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:50.005821\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:50.005848\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:50.005914\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:50.005944\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"hostname\": \"smithi132\", \"container_id\": \"83de891fa91c\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:50.005972\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:34:42.059327\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2020-07-16T13:34:37.094927\"}}, \"last_daemon_update\": \"2020-07-16T13:34:50.006044\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:34:50.841 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:50 smithi188 bash[23329]: audit 2020-07-16T13:34:50.013445+0000 mon.a (mon.0) 558 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:34:50.841 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:50 smithi188 bash[23329]: audit 2020-07-16T13:34:50.202401+0000 mon.c (mon.1) 17 : audit [DBG] from='client.? 172.21.15.132:0/323807628' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2020-07-16T13:34:50.902 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:50 smithi132 bash[27079]: cluster 2020-07-16T13:34:49.739375+0000 mgr.y (mgr.14140) 190 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:50.902 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:50 smithi132 bash[27079]: audit 2020-07-16T13:34:50.006908+0000 mon.a (mon.0) 556 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:50.005660\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:50.005734\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:50.005766\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:50.005794\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:50.005821\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:50.005848\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:50.005914\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:50.005944\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"hostname\": \"smithi132\", \"container_id\": \"83de891fa91c\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:50.005972\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:34:42.059327\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2020-07-16T13:34:37.094927\"}}, \"last_daemon_update\": \"2020-07-16T13:34:50.006044\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:34:50.902 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:50 smithi132 bash[27079]: audit 2020-07-16T13:34:50.012131+0000 mon.a (mon.0) 557 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:50.005660\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:50.005734\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:50.005766\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:50.005794\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:50.005821\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:50.005848\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:50.005914\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:50.005944\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"hostname\": \"smithi132\", \"container_id\": \"83de891fa91c\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:50.005972\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:34:42.059327\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2020-07-16T13:34:37.094927\"}}, \"last_daemon_update\": \"2020-07-16T13:34:50.006044\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:34:50.903 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:50 smithi132 bash[27079]: audit 2020-07-16T13:34:50.013445+0000 mon.a (mon.0) 558 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:34:50.903 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:50 smithi132 bash[27079]: audit 2020-07-16T13:34:50.202401+0000 mon.c (mon.1) 17 : audit [DBG] from='client.? 172.21.15.132:0/323807628' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2020-07-16T13:34:50.903 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:50 smithi132 bash[23299]: cluster 2020-07-16T13:34:49.739375+0000 mgr.y (mgr.14140) 190 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:50.903 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:50 smithi132 bash[23299]: audit 2020-07-16T13:34:50.006908+0000 mon.a (mon.0) 556 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:50.005660\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:50.005734\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:50.005766\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:50.005794\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:50.005821\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:50.005848\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:50.005914\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:50.005944\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"hostname\": \"smithi132\", \"container_id\": \"83de891fa91c\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:50.005972\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:34:42.059327\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2020-07-16T13:34:37.094927\"}}, \"last_daemon_update\": \"2020-07-16T13:34:50.006044\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:34:50.904 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:50 smithi132 bash[23299]: audit 2020-07-16T13:34:50.012131+0000 mon.a (mon.0) 557 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:50.005660\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:50.005734\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:50.005766\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:50.005794\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:50.005821\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:50.005848\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:50.005914\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:50.005944\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"hostname\": \"smithi132\", \"container_id\": \"83de891fa91c\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:50.005972\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:34:42.059327\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2020-07-16T13:34:37.094927\"}}, \"last_daemon_update\": \"2020-07-16T13:34:50.006044\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:34:50.904 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:50 smithi132 bash[23299]: audit 2020-07-16T13:34:50.013445+0000 mon.a (mon.0) 558 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:34:50.904 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:50 smithi132 bash[23299]: audit 2020-07-16T13:34:50.202401+0000 mon.c (mon.1) 17 : audit [DBG] from='client.? 172.21.15.132:0/323807628' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2020-07-16T13:34:51.118 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:50 smithi188 bash[1368]: t=2020-07-16T13:34:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth refresh token to user_auth" 2020-07-16T13:34:51.119 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:50 smithi188 bash[1368]: t=2020-07-16T13:34:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth token type to user_auth" 2020-07-16T13:34:51.119 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:51 smithi188 bash[1368]: t=2020-07-16T13:34:51+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth expiry to user_auth" 2020-07-16T13:34:51.119 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:51 smithi188 bash[1368]: t=2020-07-16T13:34:51+0000 lvl=info msg="Executing migration" logger=migrator id="Add index to user_id column in user_auth" 2020-07-16T13:34:51.378 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:51 smithi188 bash[1368]: t=2020-07-16T13:34:51+0000 lvl=info msg="Executing migration" logger=migrator id="create server_lock table" 2020-07-16T13:34:51.379 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:51 smithi188 bash[1368]: t=2020-07-16T13:34:51+0000 lvl=info msg="Executing migration" logger=migrator id="add index server_lock.operation_uid" 2020-07-16T13:34:51.655 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:51 smithi188 bash[1368]: t=2020-07-16T13:34:51+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth token table" 2020-07-16T13:34:51.656 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:51 smithi188 bash[1368]: t=2020-07-16T13:34:51+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.auth_token" 2020-07-16T13:34:51.656 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:51 smithi188 bash[1368]: t=2020-07-16T13:34:51+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.prev_auth_token" 2020-07-16T13:34:51.656 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:51 smithi188 bash[1368]: t=2020-07-16T13:34:51+0000 lvl=info msg="Executing migration" logger=migrator id="create cache_data table" 2020-07-16T13:34:51.920 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:51 smithi188 bash[1368]: t=2020-07-16T13:34:51+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index cache_data.cache_key" 2020-07-16T13:34:52.379 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:51 smithi188 bash[1368]: t=2020-07-16T13:34:51+0000 lvl=info msg="Created default admin" logger=sqlstore user=admin 2020-07-16T13:34:52.379 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:51 smithi188 bash[1368]: t=2020-07-16T13:34:51+0000 lvl=info msg="Initializing HTTPServer" logger=server 2020-07-16T13:34:52.380 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:51 smithi188 bash[1368]: t=2020-07-16T13:34:51+0000 lvl=info msg="Initializing BackendPluginManager" logger=server 2020-07-16T13:34:52.380 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:51 smithi188 bash[1368]: t=2020-07-16T13:34:51+0000 lvl=info msg="Initializing PluginManager" logger=server 2020-07-16T13:34:52.380 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:51 smithi188 bash[1368]: t=2020-07-16T13:34:51+0000 lvl=info msg="Starting plugin search" logger=plugins 2020-07-16T13:34:52.380 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:51 smithi188 bash[1368]: t=2020-07-16T13:34:51+0000 lvl=info msg="Registering plugin" logger=plugins name="Pie Chart" 2020-07-16T13:34:52.380 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:51 smithi188 bash[1368]: t=2020-07-16T13:34:51+0000 lvl=info msg="Registering plugin" logger=plugins name="Status Panel" 2020-07-16T13:34:52.381 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:51 smithi188 bash[1368]: t=2020-07-16T13:34:51+0000 lvl=info msg="Initializing HooksService" logger=server 2020-07-16T13:34:52.381 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:51 smithi188 bash[1368]: t=2020-07-16T13:34:51+0000 lvl=info msg="Initializing OSSLicensingService" logger=server 2020-07-16T13:34:52.381 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:51 smithi188 bash[1368]: t=2020-07-16T13:34:51+0000 lvl=info msg="Initializing InternalMetricsService" logger=server 2020-07-16T13:34:52.381 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:51 smithi188 bash[1368]: t=2020-07-16T13:34:51+0000 lvl=info msg="Initializing RemoteCache" logger=server 2020-07-16T13:34:52.382 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:51 smithi188 bash[1368]: t=2020-07-16T13:34:51+0000 lvl=info msg="Initializing QuotaService" logger=server 2020-07-16T13:34:52.382 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:51 smithi188 bash[1368]: t=2020-07-16T13:34:51+0000 lvl=info msg="Initializing ServerLockService" logger=server 2020-07-16T13:34:52.382 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:51 smithi188 bash[1368]: t=2020-07-16T13:34:51+0000 lvl=info msg="Initializing UserAuthTokenService" logger=server 2020-07-16T13:34:52.382 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:51 smithi188 bash[1368]: t=2020-07-16T13:34:51+0000 lvl=info msg="Initializing RenderingService" logger=server 2020-07-16T13:34:52.382 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:51 smithi188 bash[1368]: t=2020-07-16T13:34:51+0000 lvl=info msg="Initializing AlertEngine" logger=server 2020-07-16T13:34:52.383 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:51 smithi188 bash[1368]: t=2020-07-16T13:34:51+0000 lvl=info msg="Initializing DatasourceCacheService" logger=server 2020-07-16T13:34:52.383 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:51 smithi188 bash[1368]: t=2020-07-16T13:34:51+0000 lvl=info msg="Initializing LoginService" logger=server 2020-07-16T13:34:52.383 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:51 smithi188 bash[1368]: t=2020-07-16T13:34:51+0000 lvl=info msg="Initializing SearchService" logger=server 2020-07-16T13:34:52.383 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:51 smithi188 bash[1368]: t=2020-07-16T13:34:51+0000 lvl=info msg="Initializing TracingService" logger=server 2020-07-16T13:34:52.384 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:51 smithi188 bash[1368]: t=2020-07-16T13:34:51+0000 lvl=info msg="Initializing UsageStatsService" logger=server 2020-07-16T13:34:52.384 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:51 smithi188 bash[1368]: t=2020-07-16T13:34:51+0000 lvl=info msg="Initializing CleanUpService" logger=server 2020-07-16T13:34:52.384 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:51 smithi188 bash[1368]: t=2020-07-16T13:34:51+0000 lvl=info msg="Initializing NotificationService" logger=server 2020-07-16T13:34:52.385 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:51 smithi188 bash[1368]: t=2020-07-16T13:34:51+0000 lvl=info msg="Initializing provisioningServiceImpl" logger=server 2020-07-16T13:34:52.385 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:51 smithi188 bash[1368]: t=2020-07-16T13:34:51+0000 lvl=warn msg="[Deprecated] the datasource provisioning config is outdated. please upgrade" logger=provisioning.datasources filename=/etc/grafana/provisioning/datasources/ceph-dashboard.yml 2020-07-16T13:34:52.385 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:51 smithi188 bash[1368]: t=2020-07-16T13:34:51+0000 lvl=info msg="inserting datasource from configuration " logger=provisioning.datasources name="Dashboard 1" 2020-07-16T13:34:52.385 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:52 smithi188 bash[1368]: t=2020-07-16T13:34:52+0000 lvl=info msg="Backend rendering via phantomJS" logger=rendering renderer=phantomJS 2020-07-16T13:34:52.385 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:52 smithi188 bash[1368]: t=2020-07-16T13:34:52+0000 lvl=warn msg="phantomJS is deprecated and will be removed in a future release. You should consider migrating from phantomJS to grafana-image-renderer plugin." logger=rendering renderer=phantomJS 2020-07-16T13:34:52.386 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:52 smithi188 bash[1368]: t=2020-07-16T13:34:52+0000 lvl=info msg="Initializing Stream Manager" 2020-07-16T13:34:52.386 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Jul 16 13:34:52 smithi188 bash[1368]: t=2020-07-16T13:34:52+0000 lvl=info msg="HTTP Server Listen" logger=http.server address=127.0.0.1:3000 protocol=https subUrl= socket= 2020-07-16T13:34:52.703 INFO:teuthology.orchestra.run.smithi132.stdout:171798691863 2020-07-16T13:34:53.029 INFO:journalctl@ceph.alertmanager.a.smithi132.stdout:Jul 16 13:34:52 smithi132 bash[6284]: level=info ts=2020-07-16T13:34:52.692Z caller=cluster.go:640 component=cluster msg="gossip settled; proceeding" elapsed=10.000714895s 2020-07-16T13:34:53.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:52 smithi132 bash[27079]: cluster 2020-07-16T13:34:51.739773+0000 mgr.y (mgr.14140) 191 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:53.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:52 smithi132 bash[27079]: audit 2020-07-16T13:34:52.468137+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:52.466498\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:52.466606\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:52.466676\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:52.466735\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:52.466793\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:52.466849\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:52.466912\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:52.466970\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:52.467026\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:34:52.467149\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:34:53.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:52 smithi132 bash[27079]: audit 2020-07-16T13:34:52.470991+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:52.466498\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:52.466606\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:52.466676\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:52.466735\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:52.466793\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:52.466849\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:52.466912\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:52.466970\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:52.467026\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:34:52.467149\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:34:53.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:52 smithi132 bash[27079]: audit 2020-07-16T13:34:52.472913+0000 mon.a (mon.0) 561 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:34:53.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:52 smithi132 bash[27079]: audit 2020-07-16T13:34:52.701117+0000 mon.a (mon.0) 562 : audit [DBG] from='client.? 172.21.15.132:0/1000745789' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2020-07-16T13:34:53.032 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:52 smithi132 bash[23299]: cluster 2020-07-16T13:34:51.739773+0000 mgr.y (mgr.14140) 191 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:53.032 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:52 smithi132 bash[23299]: audit 2020-07-16T13:34:52.468137+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:52.466498\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:52.466606\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:52.466676\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:52.466735\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:52.466793\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:52.466849\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:52.466912\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:52.466970\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:52.467026\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:34:52.467149\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:34:53.033 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:52 smithi132 bash[23299]: audit 2020-07-16T13:34:52.470991+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:52.466498\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:52.466606\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:52.466676\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:52.466735\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:52.466793\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:52.466849\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:52.466912\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:52.466970\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:52.467026\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:34:52.467149\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:34:53.033 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:52 smithi132 bash[23299]: audit 2020-07-16T13:34:52.472913+0000 mon.a (mon.0) 561 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:34:53.033 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:52 smithi132 bash[23299]: audit 2020-07-16T13:34:52.701117+0000 mon.a (mon.0) 562 : audit [DBG] from='client.? 172.21.15.132:0/1000745789' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2020-07-16T13:34:53.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:52 smithi188 bash[23329]: cluster 2020-07-16T13:34:51.739773+0000 mgr.y (mgr.14140) 191 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:53.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:52 smithi188 bash[23329]: audit 2020-07-16T13:34:52.468137+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:52.466498\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:52.466606\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:52.466676\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:52.466735\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:52.466793\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:52.466849\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:52.466912\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:52.466970\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:52.467026\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:34:52.467149\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:34:53.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:52 smithi188 bash[23329]: audit 2020-07-16T13:34:52.470991+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:52.466498\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:52.466606\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:52.466676\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:52.466735\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:52.466793\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:52.466849\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:52.466912\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:52.466970\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:52.467026\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:34:52.467149\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:34:53.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:52 smithi188 bash[23329]: audit 2020-07-16T13:34:52.472913+0000 mon.a (mon.0) 561 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:34:53.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:52 smithi188 bash[23329]: audit 2020-07-16T13:34:52.701117+0000 mon.a (mon.0) 562 : audit [DBG] from='client.? 172.21.15.132:0/1000745789' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2020-07-16T13:34:53.216 INFO:tasks.cephadm.ceph_manager.ceph:need seq 171798691859 got 171798691863 for osd.5 2020-07-16T13:34:53.217 INFO:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 4c8ed362-c768-11ea-a06f-001a4aab830c -- ceph osd last-stat-seq osd.6 2020-07-16T13:34:54.981 INFO:teuthology.orchestra.run.smithi132.stdout:193273528340 2020-07-16T13:34:55.011 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:54 smithi132 bash[27079]: cluster 2020-07-16T13:34:53.740121+0000 mgr.y (mgr.14140) 192 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:55.012 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:54 smithi132 bash[27079]: audit 2020-07-16T13:34:54.750808+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749702\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749778\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749809\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749837\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749865\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749892\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749920\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749947\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749974\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:34:54.750048\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:34:55.012 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:54 smithi132 bash[27079]: audit 2020-07-16T13:34:54.754264+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749702\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749778\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749809\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749837\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749865\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749892\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749920\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749947\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749974\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:34:54.750048\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:34:55.013 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:54 smithi132 bash[23299]: cluster 2020-07-16T13:34:53.740121+0000 mgr.y (mgr.14140) 192 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:55.013 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:54 smithi132 bash[23299]: audit 2020-07-16T13:34:54.750808+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749702\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749778\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749809\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749837\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749865\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749892\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749920\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749947\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749974\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:34:54.750048\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:34:55.015 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:54 smithi132 bash[23299]: audit 2020-07-16T13:34:54.754264+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749702\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749778\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749809\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749837\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749865\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749892\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749920\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749947\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749974\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:34:54.750048\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:34:55.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:54 smithi188 bash[23329]: cluster 2020-07-16T13:34:53.740121+0000 mgr.y (mgr.14140) 192 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:55.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:54 smithi188 bash[23329]: audit 2020-07-16T13:34:54.750808+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749702\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749778\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749809\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749837\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749865\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749892\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749920\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749947\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749974\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:34:54.750048\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:34:55.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:54 smithi188 bash[23329]: audit 2020-07-16T13:34:54.754264+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749702\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"476cdb85d918\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749778\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:31:23.603381\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749809\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749837\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749865\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749892\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749920\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749947\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749974\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:21.860412\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:34:54.750048\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:34:55.498 INFO:tasks.cephadm.ceph_manager.ceph:need seq 193273528336 got 193273528340 for osd.6 2020-07-16T13:34:55.499 INFO:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 4c8ed362-c768-11ea-a06f-001a4aab830c -- ceph osd last-stat-seq osd.7 2020-07-16T13:34:56.131 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:55 smithi132 bash[27079]: audit 2020-07-16T13:34:54.979139+0000 mon.c (mon.1) 18 : audit [DBG] from='client.? 172.21.15.132:0/1185734484' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2020-07-16T13:34:56.132 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:55 smithi132 bash[23299]: audit 2020-07-16T13:34:54.979139+0000 mon.c (mon.1) 18 : audit [DBG] from='client.? 172.21.15.132:0/1185734484' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2020-07-16T13:34:56.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:55 smithi188 bash[23329]: audit 2020-07-16T13:34:54.979139+0000 mon.c (mon.1) 18 : audit [DBG] from='client.? 172.21.15.132:0/1185734484' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2020-07-16T13:34:56.914 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:56 smithi132 bash[27079]: cluster 2020-07-16T13:34:55.740425+0000 mgr.y (mgr.14140) 193 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:56.915 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:56 smithi132 bash[23299]: cluster 2020-07-16T13:34:55.740425+0000 mgr.y (mgr.14140) 193 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:57.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:56 smithi188 bash[23329]: cluster 2020-07-16T13:34:55.740425+0000 mgr.y (mgr.14140) 193 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:57.222 INFO:teuthology.orchestra.run.smithi132.stdout:214748364816 2020-07-16T13:34:57.726 INFO:tasks.cephadm.ceph_manager.ceph:need seq 214748364812 got 214748364816 for osd.7 2020-07-16T13:34:57.727 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2020-07-16T13:34:57.728 INFO:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 4c8ed362-c768-11ea-a06f-001a4aab830c -- ceph pg dump --format=json 2020-07-16T13:34:58.033 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:57 smithi132 bash[23299]: audit 2020-07-16T13:34:57.221715+0000 mon.c (mon.1) 19 : audit [DBG] from='client.? 172.21.15.132:0/489882250' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2020-07-16T13:34:58.034 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:57 smithi132 bash[27079]: audit 2020-07-16T13:34:57.221715+0000 mon.c (mon.1) 19 : audit [DBG] from='client.? 172.21.15.132:0/489882250' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2020-07-16T13:34:58.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:57 smithi188 bash[23329]: audit 2020-07-16T13:34:57.221715+0000 mon.c (mon.1) 19 : audit [DBG] from='client.? 172.21.15.132:0/489882250' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2020-07-16T13:34:59.097 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:34:58 smithi132 bash[27079]: cluster 2020-07-16T13:34:57.740821+0000 mgr.y (mgr.14140) 194 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:59.098 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:34:58 smithi132 bash[23299]: cluster 2020-07-16T13:34:57.740821+0000 mgr.y (mgr.14140) 194 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:59.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:34:58 smithi188 bash[23329]: cluster 2020-07-16T13:34:57.740821+0000 mgr.y (mgr.14140) 194 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:34:59.467 INFO:teuthology.orchestra.run.smithi132.stdout: 2020-07-16T13:34:59.468 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2020-07-16T13:34:59.956 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":185,"stamp":"2020-07-16T13:34:57.740648+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":749961216,"kb_used":8392608,"kb_used_data":3936,"kb_used_omap":6,"kb_used_meta":8388601,"kb_avail":741568608,"statfs":{"total":767960285184,"available":759366254592,"internally_reserved":8589934592,"allocated":4030464,"data_stored":1586800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6662,"internal_metadata":8589927930},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002074"},"pg_stats":[{"pgid":"1.0","version":"17'1","reported_seq":"14","reported_epoch":"51","state":"active+clean","last_fresh":"2020-07-16T13:33:43.921111+0000","last_change":"2020-07-16T13:33:43.921111+0000","last_active":"2020-07-16T13:33:43.921111+0000","last_peered":"2020-07-16T13:33:43.921111+0000","last_clean":"2020-07-16T13:33:43.921111+0000","last_became_active":"2020-07-16T13:33:43.915141+0000","last_became_peered":"2020-07-16T13:33:43.915141+0000","last_unstale":"2020-07-16T13:33:43.921111+0000","last_undegraded":"2020-07-16T13:33:43.921111+0000","last_fullsized":"2020-07-16T13:33:43.921111+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":2,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T13:29:44.933310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T13:29:44.933310+0000","last_clean_scrub_stamp":"2020-07-16T13:29:44.933310+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6662,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":3,"acting":3,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":50,"seq":214748364816,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049076,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696076,"statfs":{"total":95995035648,"available":94920781824,"internally_reserved":1073741824,"allocated":503808,"data_stored":198350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 16 13:34:43 2020","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":5.9390000000000001,"5min":5.9390000000000001,"15min":5.9390000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":0.64300000000000002}]},{"osd":1,"last update":"Thu Jul 16 13:34:43 2020","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.2649999999999999}]},{"osd":2,"last update":"Thu Jul 16 13:34:43 2020","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.032}]},{"osd":3,"last update":"Thu Jul 16 13:34:43 2020","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.786,"5min":1.786,"15min":1.786},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":1.8149999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":1.208}]},{"osd":4,"last update":"Thu Jul 16 13:34:43 2020","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":0.80200000000000005},{"interface":"front","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.647,"5min":1.647,"15min":1.647},"last":1.3879999999999999}]},{"osd":5,"last update":"Thu Jul 16 13:34:43 2020","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":2.0009999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.355},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"min":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"max":{"1min":2.0209999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":1.4139999999999999}]},{"osd":6,"last update":"Thu Jul 16 13:34:43 2020","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":2.089,"5min":2.089,"15min":2.089},"last":1.5029999999999999},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"min":{"1min":1.028,"5min":1.028,"15min":1.028},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":1.2390000000000001}]}]},{"osd":6,"up_from":45,"seq":193273528341,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049076,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696076,"statfs":{"total":95995035648,"available":94920781824,"internally_reserved":1073741824,"allocated":503808,"data_stored":198350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 16 13:34:31 2020","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":1.226},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.66000000000000003}]},{"osd":1,"last update":"Thu Jul 16 13:34:31 2020","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.0950000000000002,"5min":2.0950000000000002,"15min":2.0950000000000002},"last":1.085}]},{"osd":2,"last update":"Thu Jul 16 13:34:31 2020","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.8640000000000001,"5min":1.8640000000000001,"15min":1.8640000000000001},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.89100000000000001}]},{"osd":3,"last update":"Thu Jul 16 13:34:31 2020","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":1.369}]},{"osd":4,"last update":"Thu Jul 16 13:34:31 2020","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":0.78600000000000003},{"interface":"front","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":0.85399999999999998}]},{"osd":5,"last update":"Thu Jul 16 13:34:31 2020","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.8320000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":1.341}]},{"osd":7,"last update":"Thu Jul 16 13:34:45 2020","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":1.196},{"interface":"front","average":{"1min":1.45,"5min":1.45,"15min":1.45},"min":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"max":{"1min":2.4569999999999999,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":1.7}]}]},{"osd":1,"up_from":16,"seq":68719476774,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049076,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696076,"statfs":{"total":95995035648,"available":94920781824,"internally_reserved":1073741824,"allocated":503808,"data_stored":198350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 16 13:34:04 2020","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.68300000000000005,"15min":0.65300000000000002},"min":{"1min":0.54900000000000004,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":1.25},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.754,"15min":0.71899999999999997},"min":{"1min":0.69499999999999995,"5min":0.439,"15min":0.439},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":0.80400000000000005}]},{"osd":2,"last update":"Thu Jul 16 13:34:17 2020","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.76700000000000002,"15min":0.76300000000000001},"min":{"1min":0.51900000000000002,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.85999999999999999},{"interface":"front","average":{"1min":1.01,"5min":0.86399999999999999,"15min":0.83999999999999997},"min":{"1min":0.66000000000000003,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":1.5469999999999999}]},{"osd":3,"last update":"Thu Jul 16 13:34:38 2020","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.0209999999999999,"15min":1.0189999999999999},"min":{"1min":0.78900000000000003,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":1.8919999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.0449999999999999,"15min":1.054},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.95499999999999996}]},{"osd":4,"last update":"Thu Jul 16 13:34:04 2020","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":1.9339999999999999},{"interface":"front","average":{"1min":1.248,"5min":1.248,"15min":1.248},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":1.472}]},{"osd":5,"last update":"Thu Jul 16 13:34:14 2020","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.385,"5min":1.385,"15min":1.385},"min":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"max":{"1min":1.984,"5min":1.984,"15min":1.984},"last":1.3979999999999999}]},{"osd":6,"last update":"Thu Jul 16 13:34:27 2020","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.363,"15min":1.363},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":1.048,"5min":1.048,"15min":1.048},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":2.1059999999999999}]},{"osd":7,"last update":"Thu Jul 16 13:34:45 2020","interfaces":[{"interface":"back","average":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"min":{"1min":1.085,"5min":1.085,"15min":1.085},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.7210000000000001},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"min":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"max":{"1min":2.0169999999999999,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":1.3340000000000001}]}]},{"osd":0,"up_from":10,"seq":42949673002,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049076,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696076,"statfs":{"total":95995035648,"available":94920781824,"internally_reserved":1073741824,"allocated":503808,"data_stored":198350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 16 13:34:03 2020","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.69599999999999995,"15min":0.67600000000000005},"min":{"1min":0.53800000000000003,"5min":0.438,"15min":0.438},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.70899999999999996,"15min":0.69099999999999995},"min":{"1min":0.56799999999999995,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0449999999999999,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.65800000000000003}]},{"osd":2,"last update":"Thu Jul 16 13:34:18 2020","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.80800000000000005,"15min":0.80200000000000005},"min":{"1min":0.65000000000000002,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.004,"5min":0.85799999999999998,"15min":0.83399999999999996},"min":{"1min":0.78200000000000003,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.98299999999999998}]},{"osd":3,"last update":"Thu Jul 16 13:34:34 2020","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":1.0629999999999999,"15min":1.075},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.4870000000000001,"5min":1.583,"15min":1.583},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.90700000000000003,"15min":0.90400000000000003},"min":{"1min":0.74099999999999999,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.73199999999999998}]},{"osd":4,"last update":"Thu Jul 16 13:34:03 2020","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":3.9729999999999999,"5min":3.9729999999999999,"15min":3.9729999999999999},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.329,"5min":1.329,"15min":1.329},"min":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"max":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":1.077}]},{"osd":5,"last update":"Thu Jul 16 13:34:10 2020","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"min":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"max":{"1min":1.915,"5min":1.915,"15min":1.915},"last":1.302}]},{"osd":6,"last update":"Thu Jul 16 13:34:26 2020","interfaces":[{"interface":"back","average":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"min":{"1min":1.306,"5min":1.306,"15min":1.306},"max":{"1min":2.3959999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":1.2709999999999999}]},{"osd":7,"last update":"Thu Jul 16 13:34:44 2020","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":1.3819999999999999},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"min":{"1min":1.103,"5min":1.103,"15min":1.103},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":1.143}]}]},{"osd":2,"up_from":21,"seq":90194313250,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049076,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696076,"statfs":{"total":95995035648,"available":94920781824,"internally_reserved":1073741824,"allocated":503808,"data_stored":198350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 16 13:34:19 2020","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.78800000000000003,"15min":0.76200000000000001},"min":{"1min":0.55700000000000005,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.0760000000000001,"5min":0.94399999999999995,"15min":0.92200000000000004},"min":{"1min":0.73299999999999998,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.8939999999999999,"5min":1.8939999999999999,"15min":1.8939999999999999},"last":1.01}]},{"osd":1,"last update":"Thu Jul 16 13:34:19 2020","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.77900000000000003,"15min":0.77000000000000002},"min":{"1min":0.55600000000000005,"5min":0.5,"15min":0.5},"max":{"1min":1.242,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.85299999999999998,"15min":0.83999999999999997},"min":{"1min":0.65600000000000003,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":1.052}]},{"osd":3,"last update":"Thu Jul 16 13:34:34 2020","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97899999999999998,"15min":0.97999999999999998},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.3440000000000001,"5min":1.411,"15min":1.411},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.96199999999999997,"15min":0.96399999999999997},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.3480000000000001,"5min":1.365,"15min":1.365},"last":1.153}]},{"osd":4,"last update":"Thu Jul 16 13:34:07 2020","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":1.446},{"interface":"front","average":{"1min":1.151,"5min":1.151,"15min":1.151},"min":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":1.115}]},{"osd":5,"last update":"Thu Jul 16 13:34:12 2020","interfaces":[{"interface":"back","average":{"1min":1.367,"5min":1.367,"15min":1.367},"min":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"max":{"1min":1.825,"5min":1.825,"15min":1.825},"last":1.393},{"interface":"front","average":{"1min":1.367,"5min":1.367,"15min":1.367},"min":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":1.4159999999999999}]},{"osd":6,"last update":"Thu Jul 16 13:34:27 2020","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"min":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"max":{"1min":1.972,"5min":1.972,"15min":1.972},"last":1.325},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"min":{"1min":1.085,"5min":1.085,"15min":1.085},"max":{"1min":1.861,"5min":1.861,"15min":1.861},"last":1.3009999999999999}]},{"osd":7,"last update":"Thu Jul 16 13:34:44 2020","interfaces":[{"interface":"back","average":{"1min":1.482,"5min":1.482,"15min":1.482},"min":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"max":{"1min":1.774,"5min":1.774,"15min":1.774},"last":1.4930000000000001},{"interface":"front","average":{"1min":1.393,"5min":1.393,"15min":1.393},"min":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"max":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":1.514}]}]},{"osd":3,"up_from":26,"seq":111669149726,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049076,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696076,"statfs":{"total":95995035648,"available":94920781824,"internally_reserved":1073741824,"allocated":503808,"data_stored":198350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 16 13:34:37 2020","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.82399999999999995,"15min":0.83199999999999996},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.93400000000000005}]},{"osd":1,"last update":"Thu Jul 16 13:34:37 2020","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.93200000000000005,"15min":0.94499999999999995},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":1.097},{"interface":"front","average":{"1min":0.874,"5min":0.92300000000000004,"15min":0.93100000000000005},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.81299999999999994}]},{"osd":2,"last update":"Thu Jul 16 13:34:37 2020","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.95999999999999996,"15min":0.97199999999999998},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.78000000000000003,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":1.0189999999999999}]},{"osd":4,"last update":"Thu Jul 16 13:34:04 2020","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":1.597},{"interface":"front","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"max":{"1min":1.518,"5min":1.518,"15min":1.518},"last":1.5089999999999999}]},{"osd":5,"last update":"Thu Jul 16 13:34:10 2020","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":1.1679999999999999},{"interface":"front","average":{"1min":1.335,"5min":1.335,"15min":1.335},"min":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":1.7669999999999999}]},{"osd":6,"last update":"Thu Jul 16 13:34:26 2020","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"min":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"max":{"1min":1.827,"5min":1.827,"15min":1.827},"last":1.319}]},{"osd":7,"last update":"Thu Jul 16 13:34:47 2020","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.361,"15min":1.361},"min":{"1min":1.008,"5min":1.008,"15min":1.008},"max":{"1min":1.681,"5min":1.681,"15min":1.681},"last":1.4099999999999999},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"min":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"max":{"1min":1.8480000000000001,"5min":1.8480000000000001,"15min":1.8480000000000001},"last":1.6819999999999999}]}]},{"osd":4,"up_from":36,"seq":154618822680,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049076,"kb_used_data":492,"kb_used_omap":6,"kb_used_meta":1048569,"kb_avail":92696076,"statfs":{"total":95995035648,"available":94920781824,"internally_reserved":1073741824,"allocated":503808,"data_stored":198350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6662,"internal_metadata":1073735162},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 16 13:34:05 2020","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.96999999999999997}]},{"osd":1,"last update":"Thu Jul 16 13:34:05 2020","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.5149999999999999},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":0.69999999999999996}]},{"osd":2,"last update":"Thu Jul 16 13:34:05 2020","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":1.169},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.81699999999999995}]},{"osd":3,"last update":"Thu Jul 16 13:34:05 2020","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.474,"5min":1.474,"15min":1.474},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":1.2090000000000001}]},{"osd":5,"last update":"Thu Jul 16 13:34:10 2020","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":1.341},{"interface":"front","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":1.663}]},{"osd":6,"last update":"Thu Jul 16 13:34:28 2020","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":1.069},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.2509999999999999}]},{"osd":7,"last update":"Thu Jul 16 13:34:43 2020","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":1.3779999999999999},{"interface":"front","average":{"1min":1.478,"5min":1.478,"15min":1.478},"min":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":1.2809999999999999}]}]},{"osd":5,"up_from":40,"seq":171798691864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049076,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696076,"statfs":{"total":95995035648,"available":94920781824,"internally_reserved":1073741824,"allocated":503808,"data_stored":198350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 16 13:34:09 2020","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":1.377},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":1.4790000000000001}]},{"osd":1,"last update":"Thu Jul 16 13:34:09 2020","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":1.3320000000000001}]},{"osd":2,"last update":"Thu Jul 16 13:34:09 2020","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.97699999999999998}]},{"osd":3,"last update":"Thu Jul 16 13:34:09 2020","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":1.099,"5min":1.099,"15min":1.099},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":1.0960000000000001}]},{"osd":4,"last update":"Thu Jul 16 13:34:09 2020","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.762,"5min":1.762,"15min":1.762},"last":1.0309999999999999},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.0529999999999999}]},{"osd":6,"last update":"Thu Jul 16 13:34:27 2020","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.262,"5min":1.262,"15min":1.262},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":1.163}]},{"osd":7,"last update":"Thu Jul 16 13:34:45 2020","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"min":{"1min":0.997,"5min":0.997,"15min":0.997},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":1.8280000000000001}]}]}]}} 2020-07-16T13:34:59.960 INFO:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 4c8ed362-c768-11ea-a06f-001a4aab830c -- ceph pg dump --format=json 2020-07-16T13:35:00.664 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:35:00 smithi132 bash[27079]: audit 2020-07-16T13:34:59.461719+0000 mgr.y (mgr.14140) 195 : audit [DBG] from='client.24460 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2020-07-16T13:35:00.665 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:35:00 smithi132 bash[27079]: cluster 2020-07-16T13:34:59.741222+0000 mgr.y (mgr.14140) 196 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:00.665 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:35:00 smithi132 bash[23299]: audit 2020-07-16T13:34:59.461719+0000 mgr.y (mgr.14140) 195 : audit [DBG] from='client.24460 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2020-07-16T13:35:00.665 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:35:00 smithi132 bash[23299]: cluster 2020-07-16T13:34:59.741222+0000 mgr.y (mgr.14140) 196 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:00.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:35:00 smithi188 bash[23329]: audit 2020-07-16T13:34:59.461719+0000 mgr.y (mgr.14140) 195 : audit [DBG] from='client.24460 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2020-07-16T13:35:00.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:35:00 smithi188 bash[23329]: cluster 2020-07-16T13:34:59.741222+0000 mgr.y (mgr.14140) 196 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:01.756 INFO:teuthology.orchestra.run.smithi132.stdout: 2020-07-16T13:35:01.756 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2020-07-16T13:35:02.270 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":187,"stamp":"2020-07-16T13:35:01.741362+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":749961216,"kb_used":8392608,"kb_used_data":3936,"kb_used_omap":6,"kb_used_meta":8388601,"kb_avail":741568608,"statfs":{"total":767960285184,"available":759366254592,"internally_reserved":8589934592,"allocated":4030464,"data_stored":1586800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6662,"internal_metadata":8589927930},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002126"},"pg_stats":[{"pgid":"1.0","version":"17'1","reported_seq":"14","reported_epoch":"51","state":"active+clean","last_fresh":"2020-07-16T13:33:43.921111+0000","last_change":"2020-07-16T13:33:43.921111+0000","last_active":"2020-07-16T13:33:43.921111+0000","last_peered":"2020-07-16T13:33:43.921111+0000","last_clean":"2020-07-16T13:33:43.921111+0000","last_became_active":"2020-07-16T13:33:43.915141+0000","last_became_peered":"2020-07-16T13:33:43.915141+0000","last_unstale":"2020-07-16T13:33:43.921111+0000","last_undegraded":"2020-07-16T13:33:43.921111+0000","last_fullsized":"2020-07-16T13:33:43.921111+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":2,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T13:29:44.933310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T13:29:44.933310+0000","last_clean_scrub_stamp":"2020-07-16T13:29:44.933310+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6662,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":3,"acting":3,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":50,"seq":214748364817,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049076,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696076,"statfs":{"total":95995035648,"available":94920781824,"internally_reserved":1073741824,"allocated":503808,"data_stored":198350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 16 13:34:43 2020","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":5.9390000000000001,"5min":5.9390000000000001,"15min":5.9390000000000001},"last":0.622},{"interface":"front","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":0.874}]},{"osd":1,"last update":"Thu Jul 16 13:34:43 2020","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.048}]},{"osd":2,"last update":"Thu Jul 16 13:34:43 2020","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":0.81200000000000006}]},{"osd":3,"last update":"Thu Jul 16 13:34:43 2020","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.786,"5min":1.786,"15min":1.786},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":1.8149999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":1.1359999999999999}]},{"osd":4,"last update":"Thu Jul 16 13:34:43 2020","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":1.478},{"interface":"front","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.647,"5min":1.647,"15min":1.647},"last":1.1799999999999999}]},{"osd":5,"last update":"Thu Jul 16 13:34:43 2020","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":2.0009999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.2470000000000001},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"min":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"max":{"1min":2.0209999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":1.2230000000000001}]},{"osd":6,"last update":"Thu Jul 16 13:34:43 2020","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":2.089,"5min":2.089,"15min":2.089},"last":1.3740000000000001},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"min":{"1min":1.028,"5min":1.028,"15min":1.028},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":1.3480000000000001}]}]},{"osd":6,"up_from":45,"seq":193273528342,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049076,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696076,"statfs":{"total":95995035648,"available":94920781824,"internally_reserved":1073741824,"allocated":503808,"data_stored":198350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 16 13:34:31 2020","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":1.1399999999999999},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":1.226}]},{"osd":1,"last update":"Thu Jul 16 13:34:31 2020","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.0950000000000002,"5min":2.0950000000000002,"15min":2.0950000000000002},"last":1.302}]},{"osd":2,"last update":"Thu Jul 16 13:34:31 2020","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.8640000000000001,"5min":1.8640000000000001,"15min":1.8640000000000001},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":1.0649999999999999}]},{"osd":3,"last update":"Thu Jul 16 13:34:31 2020","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":1.258},{"interface":"front","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":1.512}]},{"osd":4,"last update":"Thu Jul 16 13:34:31 2020","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":1.3600000000000001},{"interface":"front","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":1.119}]},{"osd":5,"last update":"Thu Jul 16 13:34:31 2020","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.8320000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":1.544}]},{"osd":7,"last update":"Thu Jul 16 13:34:45 2020","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.45,"5min":1.45,"15min":1.45},"min":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"max":{"1min":2.4569999999999999,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":1.661}]}]},{"osd":1,"up_from":16,"seq":68719476775,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049076,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696076,"statfs":{"total":95995035648,"available":94920781824,"internally_reserved":1073741824,"allocated":503808,"data_stored":198350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 16 13:34:04 2020","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.68300000000000005,"15min":0.65300000000000002},"min":{"1min":0.54900000000000004,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.754,"15min":0.71899999999999997},"min":{"1min":0.69499999999999995,"5min":0.439,"15min":0.439},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":0.81499999999999995}]},{"osd":2,"last update":"Thu Jul 16 13:34:17 2020","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.76700000000000002,"15min":0.76300000000000001},"min":{"1min":0.51900000000000002,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.01,"5min":0.86399999999999999,"15min":0.83999999999999997},"min":{"1min":0.66000000000000003,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":1.0009999999999999}]},{"osd":3,"last update":"Thu Jul 16 13:34:38 2020","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.0209999999999999,"15min":1.0189999999999999},"min":{"1min":0.78900000000000003,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":1.093},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.0449999999999999,"15min":1.054},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.97099999999999997}]},{"osd":4,"last update":"Thu Jul 16 13:34:04 2020","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":1.127},{"interface":"front","average":{"1min":1.248,"5min":1.248,"15min":1.248},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":1.421}]},{"osd":5,"last update":"Thu Jul 16 13:34:14 2020","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.266},{"interface":"front","average":{"1min":1.385,"5min":1.385,"15min":1.385},"min":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"max":{"1min":1.984,"5min":1.984,"15min":1.984},"last":1.504}]},{"osd":6,"last update":"Thu Jul 16 13:34:27 2020","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.363,"15min":1.363},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.571},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":1.048,"5min":1.048,"15min":1.048},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":1.3939999999999999}]},{"osd":7,"last update":"Thu Jul 16 13:34:45 2020","interfaces":[{"interface":"back","average":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"min":{"1min":1.085,"5min":1.085,"15min":1.085},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.6040000000000001},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"min":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"max":{"1min":2.0169999999999999,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":1.728}]}]},{"osd":0,"up_from":10,"seq":42949673003,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049076,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696076,"statfs":{"total":95995035648,"available":94920781824,"internally_reserved":1073741824,"allocated":503808,"data_stored":198350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 16 13:34:03 2020","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.69599999999999995,"15min":0.67600000000000005},"min":{"1min":0.53800000000000003,"5min":0.438,"15min":0.438},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.70899999999999996,"15min":0.69099999999999995},"min":{"1min":0.56799999999999995,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0449999999999999,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.75}]},{"osd":2,"last update":"Thu Jul 16 13:34:18 2020","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.80800000000000005,"15min":0.80200000000000005},"min":{"1min":0.65000000000000002,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.004,"5min":0.85799999999999998,"15min":0.83399999999999996},"min":{"1min":0.78200000000000003,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":1.1040000000000001}]},{"osd":3,"last update":"Thu Jul 16 13:34:34 2020","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":1.0629999999999999,"15min":1.075},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.4870000000000001,"5min":1.583,"15min":1.583},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.90700000000000003,"15min":0.90400000000000003},"min":{"1min":0.74099999999999999,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":1.0249999999999999}]},{"osd":4,"last update":"Thu Jul 16 13:34:03 2020","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":3.9729999999999999,"5min":3.9729999999999999,"15min":3.9729999999999999},"last":1.474},{"interface":"front","average":{"1min":1.329,"5min":1.329,"15min":1.329},"min":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"max":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":1.6439999999999999}]},{"osd":5,"last update":"Thu Jul 16 13:34:10 2020","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.4590000000000001},{"interface":"front","average":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"min":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"max":{"1min":1.915,"5min":1.915,"15min":1.915},"last":1.7909999999999999}]},{"osd":6,"last update":"Thu Jul 16 13:34:26 2020","interfaces":[{"interface":"back","average":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"min":{"1min":1.306,"5min":1.306,"15min":1.306},"max":{"1min":2.3959999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":1.9259999999999999},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":1.7689999999999999}]},{"osd":7,"last update":"Thu Jul 16 13:34:44 2020","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":1.6259999999999999},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"min":{"1min":1.103,"5min":1.103,"15min":1.103},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":1.6699999999999999}]}]},{"osd":2,"up_from":21,"seq":90194313251,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049076,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696076,"statfs":{"total":95995035648,"available":94920781824,"internally_reserved":1073741824,"allocated":503808,"data_stored":198350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 16 13:34:19 2020","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.78800000000000003,"15min":0.76200000000000001},"min":{"1min":0.55700000000000005,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":0.88},{"interface":"front","average":{"1min":1.0760000000000001,"5min":0.94399999999999995,"15min":0.92200000000000004},"min":{"1min":0.73299999999999998,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.8939999999999999,"5min":1.8939999999999999,"15min":1.8939999999999999},"last":1.101}]},{"osd":1,"last update":"Thu Jul 16 13:34:19 2020","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.77900000000000003,"15min":0.77000000000000002},"min":{"1min":0.55600000000000005,"5min":0.5,"15min":0.5},"max":{"1min":1.242,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.85299999999999998,"15min":0.83999999999999997},"min":{"1min":0.65600000000000003,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.96199999999999997}]},{"osd":3,"last update":"Thu Jul 16 13:34:34 2020","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97899999999999998,"15min":0.97999999999999998},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.3440000000000001,"5min":1.411,"15min":1.411},"last":1.129},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.96199999999999997,"15min":0.96399999999999997},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.3480000000000001,"5min":1.365,"15min":1.365},"last":1.266}]},{"osd":4,"last update":"Thu Jul 16 13:34:07 2020","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.93600000000000005},{"interface":"front","average":{"1min":1.151,"5min":1.151,"15min":1.151},"min":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.99199999999999999}]},{"osd":5,"last update":"Thu Jul 16 13:34:12 2020","interfaces":[{"interface":"back","average":{"1min":1.367,"5min":1.367,"15min":1.367},"min":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"max":{"1min":1.825,"5min":1.825,"15min":1.825},"last":1.248},{"interface":"front","average":{"1min":1.367,"5min":1.367,"15min":1.367},"min":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":1.145}]},{"osd":6,"last update":"Thu Jul 16 13:34:27 2020","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"min":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"max":{"1min":1.972,"5min":1.972,"15min":1.972},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"min":{"1min":1.085,"5min":1.085,"15min":1.085},"max":{"1min":1.861,"5min":1.861,"15min":1.861},"last":1.7170000000000001}]},{"osd":7,"last update":"Thu Jul 16 13:34:44 2020","interfaces":[{"interface":"back","average":{"1min":1.482,"5min":1.482,"15min":1.482},"min":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"max":{"1min":1.774,"5min":1.774,"15min":1.774},"last":1.446},{"interface":"front","average":{"1min":1.393,"5min":1.393,"15min":1.393},"min":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"max":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":1.3380000000000001}]}]},{"osd":3,"up_from":26,"seq":111669149727,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049076,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696076,"statfs":{"total":95995035648,"available":94920781824,"internally_reserved":1073741824,"allocated":503808,"data_stored":198350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 16 13:34:37 2020","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.82399999999999995,"15min":0.83199999999999996},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.66700000000000004}]},{"osd":1,"last update":"Thu Jul 16 13:34:37 2020","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.93200000000000005,"15min":0.94499999999999995},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.872},{"interface":"front","average":{"1min":0.874,"5min":0.92300000000000004,"15min":0.93100000000000005},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.54900000000000004}]},{"osd":2,"last update":"Thu Jul 16 13:34:37 2020","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.95999999999999996,"15min":0.97199999999999998},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.78000000000000003,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.95799999999999996}]},{"osd":4,"last update":"Thu Jul 16 13:34:04 2020","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":1.02},{"interface":"front","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"max":{"1min":1.518,"5min":1.518,"15min":1.518},"last":1.1299999999999999}]},{"osd":5,"last update":"Thu Jul 16 13:34:10 2020","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.335,"5min":1.335,"15min":1.335},"min":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":1.222}]},{"osd":6,"last update":"Thu Jul 16 13:34:26 2020","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"min":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"max":{"1min":1.827,"5min":1.827,"15min":1.827},"last":1.524}]},{"osd":7,"last update":"Thu Jul 16 13:34:47 2020","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.361,"15min":1.361},"min":{"1min":1.008,"5min":1.008,"15min":1.008},"max":{"1min":1.681,"5min":1.681,"15min":1.681},"last":1.391},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"min":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"max":{"1min":1.8480000000000001,"5min":1.8480000000000001,"15min":1.8480000000000001},"last":1.3009999999999999}]}]},{"osd":4,"up_from":36,"seq":154618822681,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049076,"kb_used_data":492,"kb_used_omap":6,"kb_used_meta":1048569,"kb_avail":92696076,"statfs":{"total":95995035648,"available":94920781824,"internally_reserved":1073741824,"allocated":503808,"data_stored":198350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6662,"internal_metadata":1073735162},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 16 13:34:05 2020","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":0.66600000000000004},{"interface":"front","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.75800000000000001}]},{"osd":1,"last update":"Thu Jul 16 13:34:05 2020","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.84499999999999997},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":1.0680000000000001}]},{"osd":2,"last update":"Thu Jul 16 13:34:05 2020","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":1.177},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":1.3899999999999999}]},{"osd":3,"last update":"Thu Jul 16 13:34:05 2020","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.474,"5min":1.474,"15min":1.474},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":1.2709999999999999}]},{"osd":5,"last update":"Thu Jul 16 13:34:10 2020","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":1.4359999999999999}]},{"osd":6,"last update":"Thu Jul 16 13:34:28 2020","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.254}]},{"osd":7,"last update":"Thu Jul 16 13:34:43 2020","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.478,"5min":1.478,"15min":1.478},"min":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":1.4179999999999999}]}]},{"osd":5,"up_from":40,"seq":171798691865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049076,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696076,"statfs":{"total":95995035648,"available":94920781824,"internally_reserved":1073741824,"allocated":503808,"data_stored":198350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 16 13:34:09 2020","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":1.0109999999999999}]},{"osd":1,"last update":"Thu Jul 16 13:34:09 2020","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":1.22},{"interface":"front","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":1.1759999999999999}]},{"osd":2,"last update":"Thu Jul 16 13:34:09 2020","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":1.3999999999999999}]},{"osd":3,"last update":"Thu Jul 16 13:34:09 2020","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.099,"5min":1.099,"15min":1.099},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":1.5700000000000001}]},{"osd":4,"last update":"Thu Jul 16 13:34:09 2020","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.762,"5min":1.762,"15min":1.762},"last":1.321},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.0660000000000001}]},{"osd":6,"last update":"Thu Jul 16 13:34:27 2020","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.262,"5min":1.262,"15min":1.262},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":1.4339999999999999}]},{"osd":7,"last update":"Thu Jul 16 13:34:45 2020","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.736},{"interface":"front","average":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"min":{"1min":0.997,"5min":0.997,"15min":0.997},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":1.607}]}]}]}} 2020-07-16T13:35:02.272 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2020-07-16T13:35:02.273 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2020-07-16T13:35:02.273 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2020-07-16T13:35:02.273 INFO:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 4c8ed362-c768-11ea-a06f-001a4aab830c -- ceph health --format=json 2020-07-16T13:35:02.922 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:35:02 smithi132 bash[27079]: cluster 2020-07-16T13:35:01.741474+0000 mgr.y (mgr.14140) 197 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:02.922 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:35:02 smithi132 bash[27079]: audit 2020-07-16T13:35:01.752039+0000 mgr.y (mgr.14140) 198 : audit [DBG] from='client.14550 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2020-07-16T13:35:02.922 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:35:02 smithi132 bash[23299]: cluster 2020-07-16T13:35:01.741474+0000 mgr.y (mgr.14140) 197 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:02.923 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:35:02 smithi132 bash[23299]: audit 2020-07-16T13:35:01.752039+0000 mgr.y (mgr.14140) 198 : audit [DBG] from='client.14550 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2020-07-16T13:35:03.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:35:02 smithi188 bash[23329]: cluster 2020-07-16T13:35:01.741474+0000 mgr.y (mgr.14140) 197 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:03.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:35:02 smithi188 bash[23329]: audit 2020-07-16T13:35:01.752039+0000 mgr.y (mgr.14140) 198 : audit [DBG] from='client.14550 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2020-07-16T13:35:04.099 INFO:teuthology.orchestra.run.smithi132.stdout: 2020-07-16T13:35:04.638 INFO:teuthology.orchestra.run.smithi132.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2020-07-16T13:35:04.639 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2020-07-16T13:35:04.639 INFO:tasks.cephadm:Setup complete, yielding 2020-07-16T13:35:04.640 INFO:teuthology.run_tasks:Running task cephadm.shell... 2020-07-16T13:35:04.657 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi132.front.sepia.ceph.com 2020-07-16T13:35:04.657 INFO:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4c8ed362-c768-11ea-a06f-001a4aab830c -e sha1=7260671e53beca8ba2a87a02b9c7c669f4c30eca -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2020-07-16T13:35:05.013 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:35:04 smithi132 bash[27079]: cluster 2020-07-16T13:35:03.741766+0000 mgr.y (mgr.14140) 199 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:05.013 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:35:04 smithi132 bash[27079]: audit 2020-07-16T13:35:04.095931+0000 mon.a (mon.0) 565 : audit [DBG] from='client.? 172.21.15.132:0/1541198733' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2020-07-16T13:35:05.014 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:35:04 smithi132 bash[23299]: cluster 2020-07-16T13:35:03.741766+0000 mgr.y (mgr.14140) 199 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:05.014 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:35:04 smithi132 bash[23299]: audit 2020-07-16T13:35:04.095931+0000 mon.a (mon.0) 565 : audit [DBG] from='client.? 172.21.15.132:0/1541198733' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2020-07-16T13:35:05.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:35:04 smithi188 bash[23329]: cluster 2020-07-16T13:35:03.741766+0000 mgr.y (mgr.14140) 199 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:05.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:35:04 smithi188 bash[23329]: audit 2020-07-16T13:35:04.095931+0000 mon.a (mon.0) 565 : audit [DBG] from='client.? 172.21.15.132:0/1541198733' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2020-07-16T13:35:06.524 INFO:teuthology.orchestra.run.smithi132.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T13:35:07.065 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:35:06 smithi132 bash[27079]: cluster 2020-07-16T13:35:05.742123+0000 mgr.y (mgr.14140) 200 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:07.065 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:35:06 smithi132 bash[27079]: audit 2020-07-16T13:35:06.518888+0000 mon.a (mon.0) 566 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"progress_id\": \"e27d2e86-c799-4738-b39a-453c2be79645\"}"}]: dispatch 2020-07-16T13:35:07.066 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:35:06 smithi132 bash[27079]: audit 2020-07-16T13:35:06.521693+0000 mon.a (mon.0) 567 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"progress_id\": \"e27d2e86-c799-4738-b39a-453c2be79645\"}"}]': finished 2020-07-16T13:35:07.066 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:35:06 smithi132 bash[23299]: cluster 2020-07-16T13:35:05.742123+0000 mgr.y (mgr.14140) 200 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:07.066 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:35:06 smithi132 bash[23299]: audit 2020-07-16T13:35:06.518888+0000 mon.a (mon.0) 566 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"progress_id\": \"e27d2e86-c799-4738-b39a-453c2be79645\"}"}]: dispatch 2020-07-16T13:35:07.066 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:35:06 smithi132 bash[23299]: audit 2020-07-16T13:35:06.521693+0000 mon.a (mon.0) 567 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"progress_id\": \"e27d2e86-c799-4738-b39a-453c2be79645\"}"}]': finished 2020-07-16T13:35:07.067 INFO:teuthology.run_tasks:Running task cephadm.shell... 2020-07-16T13:35:07.079 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi132.front.sepia.ceph.com 2020-07-16T13:35:07.080 INFO:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4c8ed362-c768-11ea-a06f-001a4aab830c -e sha1=7260671e53beca8ba2a87a02b9c7c669f4c30eca -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true ; do ceph orch ps ; ceph versions ; sleep 30 ; done' 2020-07-16T13:35:07.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:35:06 smithi188 bash[23329]: cluster 2020-07-16T13:35:05.742123+0000 mgr.y (mgr.14140) 200 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:07.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:35:06 smithi188 bash[23329]: audit 2020-07-16T13:35:06.518888+0000 mon.a (mon.0) 566 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"progress_id\": \"e27d2e86-c799-4738-b39a-453c2be79645\"}"}]: dispatch 2020-07-16T13:35:07.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:35:06 smithi188 bash[23329]: audit 2020-07-16T13:35:06.521693+0000 mon.a (mon.0) 567 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"progress_id\": \"e27d2e86-c799-4738-b39a-453c2be79645\"}"}]': finished 2020-07-16T13:35:07.970 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:35:07 smithi132 bash[27079]: audit 2020-07-16T13:35:06.518013+0000 mgr.y (mgr.14140) 201 : audit [DBG] from='client.14562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:35:07.971 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:35:07 smithi132 bash[27079]: cephadm 2020-07-16T13:35:06.523794+0000 mgr.y (mgr.14140) 202 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T13:35:07.972 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:35:07 smithi132 bash[23299]: audit 2020-07-16T13:35:06.518013+0000 mgr.y (mgr.14140) 201 : audit [DBG] from='client.14562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:35:07.972 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:35:07 smithi132 bash[23299]: cephadm 2020-07-16T13:35:06.523794+0000 mgr.y (mgr.14140) 202 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T13:35:08.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:35:07 smithi188 bash[23329]: audit 2020-07-16T13:35:06.518013+0000 mgr.y (mgr.14140) 201 : audit [DBG] from='client.14562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:35:08.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:35:07 smithi188 bash[23329]: cephadm 2020-07-16T13:35:06.523794+0000 mgr.y (mgr.14140) 202 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T13:35:09.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:35:08 smithi132 bash[23299]: cluster 2020-07-16T13:35:07.742434+0000 mgr.y (mgr.14140) 203 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:09.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:35:08 smithi132 bash[27079]: cluster 2020-07-16T13:35:07.742434+0000 mgr.y (mgr.14140) 203 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:09.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:35:08 smithi188 bash[23329]: cluster 2020-07-16T13:35:07.742434+0000 mgr.y (mgr.14140) 203 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:09.518 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T13:35:09.903 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T13:35:09.904 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (27s) 19s ago 56s 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 83de891fa91c 2020-07-16T13:35:09.904 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (38s) 15s ago 38s 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T13:35:09.904 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (3m) 15s ago 3m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 476cdb85d918 2020-07-16T13:35:09.904 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (5m) 19s ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 9aeb379e8310 2020-07-16T13:35:09.904 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 running (5m) 19s ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 fa8441eb419e 2020-07-16T13:35:09.905 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (3m) 15s ago 3m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T13:35:09.905 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (4m) 19s ago 4m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T13:35:09.905 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (68s) 19s ago 71s 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T13:35:09.905 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (68s) 15s ago 72s 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T13:35:09.905 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (3m) 19s ago 3m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T13:35:09.906 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (3m) 19s ago 3m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T13:35:09.906 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2m) 19s ago 2m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T13:35:09.906 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2m) 19s ago 2m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T13:35:09.906 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2m) 15s ago 2m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T13:35:09.907 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2m) 15s ago 2m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T13:35:09.907 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (108s) 15s ago 110s 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T13:35:09.907 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (91s) 15s ago 93s 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T13:35:09.907 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (23s) 15s ago 72s 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T13:35:10.367 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T13:35:10.367 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T13:35:10.367 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2020-07-16T13:35:10.367 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:35:10.368 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T13:35:10.368 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2020-07-16T13:35:10.368 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:35:10.368 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T13:35:10.368 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T13:35:10.369 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:35:10.369 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T13:35:10.369 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T13:35:10.369 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 13 2020-07-16T13:35:10.369 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T13:35:10.370 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T13:35:10.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:35:10 smithi188 bash[23329]: audit 2020-07-16T13:35:09.505398+0000 mgr.y (mgr.14140) 204 : audit [DBG] from='client.14568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:35:10.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:35:10 smithi188 bash[23329]: cluster 2020-07-16T13:35:09.742746+0000 mgr.y (mgr.14140) 205 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:10.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:35:10 smithi188 bash[23329]: audit 2020-07-16T13:35:09.898246+0000 mgr.y (mgr.14140) 206 : audit [DBG] from='client.24490 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:35:10.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:35:10 smithi188 bash[23329]: audit 2020-07-16T13:35:10.365922+0000 mon.c (mon.1) 20 : audit [DBG] from='client.? 172.21.15.132:0/3249733714' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:35:11.034 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:35:10 smithi132 bash[23299]: audit 2020-07-16T13:35:09.505398+0000 mgr.y (mgr.14140) 204 : audit [DBG] from='client.14568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:35:11.034 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:35:10 smithi132 bash[23299]: cluster 2020-07-16T13:35:09.742746+0000 mgr.y (mgr.14140) 205 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:11.035 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:35:10 smithi132 bash[23299]: audit 2020-07-16T13:35:09.898246+0000 mgr.y (mgr.14140) 206 : audit [DBG] from='client.24490 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:35:11.035 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:35:10 smithi132 bash[23299]: audit 2020-07-16T13:35:10.365922+0000 mon.c (mon.1) 20 : audit [DBG] from='client.? 172.21.15.132:0/3249733714' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:35:11.035 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:35:10 smithi132 bash[27079]: audit 2020-07-16T13:35:09.505398+0000 mgr.y (mgr.14140) 204 : audit [DBG] from='client.14568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:35:11.035 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:35:10 smithi132 bash[27079]: cluster 2020-07-16T13:35:09.742746+0000 mgr.y (mgr.14140) 205 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:11.036 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:35:10 smithi132 bash[27079]: audit 2020-07-16T13:35:09.898246+0000 mgr.y (mgr.14140) 206 : audit [DBG] from='client.24490 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:35:11.036 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:35:10 smithi132 bash[27079]: audit 2020-07-16T13:35:10.365922+0000 mon.c (mon.1) 20 : audit [DBG] from='client.? 172.21.15.132:0/3249733714' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:35:13.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:35:12 smithi188 bash[23329]: cluster 2020-07-16T13:35:11.743019+0000 mgr.y (mgr.14140) 207 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:13.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:35:12 smithi132 bash[27079]: cluster 2020-07-16T13:35:11.743019+0000 mgr.y (mgr.14140) 207 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:13.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:35:12 smithi132 bash[23299]: cluster 2020-07-16T13:35:11.743019+0000 mgr.y (mgr.14140) 207 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:15.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:35:14 smithi188 bash[23329]: cluster 2020-07-16T13:35:13.743261+0000 mgr.y (mgr.14140) 208 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:15.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:35:14 smithi132 bash[27079]: cluster 2020-07-16T13:35:13.743261+0000 mgr.y (mgr.14140) 208 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:15.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:35:14 smithi132 bash[23299]: cluster 2020-07-16T13:35:13.743261+0000 mgr.y (mgr.14140) 208 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:17.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:35:16 smithi188 bash[23329]: cluster 2020-07-16T13:35:15.743519+0000 mgr.y (mgr.14140) 209 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:17.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:35:16 smithi132 bash[23299]: cluster 2020-07-16T13:35:15.743519+0000 mgr.y (mgr.14140) 209 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:17.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:35:16 smithi132 bash[27079]: cluster 2020-07-16T13:35:15.743519+0000 mgr.y (mgr.14140) 209 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:19.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:35:18 smithi188 bash[23329]: cluster 2020-07-16T13:35:17.743807+0000 mgr.y (mgr.14140) 210 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:19.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:35:18 smithi132 bash[27079]: cluster 2020-07-16T13:35:17.743807+0000 mgr.y (mgr.14140) 210 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:19.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:35:18 smithi132 bash[23299]: cluster 2020-07-16T13:35:17.743807+0000 mgr.y (mgr.14140) 210 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:20.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:35:20 smithi188 bash[23329]: cluster 2020-07-16T13:35:19.744121+0000 mgr.y (mgr.14140) 211 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:21.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:35:20 smithi132 bash[23299]: cluster 2020-07-16T13:35:19.744121+0000 mgr.y (mgr.14140) 211 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:21.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:35:20 smithi132 bash[27079]: cluster 2020-07-16T13:35:19.744121+0000 mgr.y (mgr.14140) 211 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:23.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:35:22 smithi188 bash[23329]: cluster 2020-07-16T13:35:21.744390+0000 mgr.y (mgr.14140) 212 : cluster [DBG] pgmap v197: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:23.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:35:22 smithi132 bash[27079]: cluster 2020-07-16T13:35:21.744390+0000 mgr.y (mgr.14140) 212 : cluster [DBG] pgmap v197: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:23.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:35:22 smithi132 bash[23299]: cluster 2020-07-16T13:35:21.744390+0000 mgr.y (mgr.14140) 212 : cluster [DBG] pgmap v197: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:25.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:35:24 smithi188 bash[23329]: cluster 2020-07-16T13:35:23.744713+0000 mgr.y (mgr.14140) 213 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:25.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:35:24 smithi132 bash[23299]: cluster 2020-07-16T13:35:23.744713+0000 mgr.y (mgr.14140) 213 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:25.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:35:24 smithi132 bash[27079]: cluster 2020-07-16T13:35:23.744713+0000 mgr.y (mgr.14140) 213 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:27.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:35:26 smithi188 bash[23329]: cluster 2020-07-16T13:35:25.745031+0000 mgr.y (mgr.14140) 214 : cluster [DBG] pgmap v199: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:27.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:35:26 smithi132 bash[27079]: cluster 2020-07-16T13:35:25.745031+0000 mgr.y (mgr.14140) 214 : cluster [DBG] pgmap v199: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:27.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:35:26 smithi132 bash[23299]: cluster 2020-07-16T13:35:25.745031+0000 mgr.y (mgr.14140) 214 : cluster [DBG] pgmap v199: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:29.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:35:28 smithi188 bash[23329]: cluster 2020-07-16T13:35:27.745358+0000 mgr.y (mgr.14140) 215 : cluster [DBG] pgmap v200: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:29.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:35:28 smithi132 bash[27079]: cluster 2020-07-16T13:35:27.745358+0000 mgr.y (mgr.14140) 215 : cluster [DBG] pgmap v200: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:29.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:35:28 smithi132 bash[23299]: cluster 2020-07-16T13:35:27.745358+0000 mgr.y (mgr.14140) 215 : cluster [DBG] pgmap v200: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:30.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:35:30 smithi188 bash[23329]: cluster 2020-07-16T13:35:29.745650+0000 mgr.y (mgr.14140) 216 : cluster [DBG] pgmap v201: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:31.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:35:30 smithi132 bash[23299]: cluster 2020-07-16T13:35:29.745650+0000 mgr.y (mgr.14140) 216 : cluster [DBG] pgmap v201: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:31.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:35:30 smithi132 bash[27079]: cluster 2020-07-16T13:35:29.745650+0000 mgr.y (mgr.14140) 216 : cluster [DBG] pgmap v201: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:33.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:35:32 smithi188 bash[23329]: cluster 2020-07-16T13:35:31.745920+0000 mgr.y (mgr.14140) 217 : cluster [DBG] pgmap v202: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:33.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:35:32 smithi132 bash[27079]: cluster 2020-07-16T13:35:31.745920+0000 mgr.y (mgr.14140) 217 : cluster [DBG] pgmap v202: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:33.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:35:32 smithi132 bash[23299]: cluster 2020-07-16T13:35:31.745920+0000 mgr.y (mgr.14140) 217 : cluster [DBG] pgmap v202: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:35.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:35:34 smithi188 bash[23329]: cluster 2020-07-16T13:35:33.746200+0000 mgr.y (mgr.14140) 218 : cluster [DBG] pgmap v203: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:35.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:35:34 smithi132 bash[27079]: cluster 2020-07-16T13:35:33.746200+0000 mgr.y (mgr.14140) 218 : cluster [DBG] pgmap v203: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:35.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:35:34 smithi132 bash[23299]: cluster 2020-07-16T13:35:33.746200+0000 mgr.y (mgr.14140) 218 : cluster [DBG] pgmap v203: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:37.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:35:36 smithi188 bash[23329]: cluster 2020-07-16T13:35:35.746480+0000 mgr.y (mgr.14140) 219 : cluster [DBG] pgmap v204: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:37.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:35:36 smithi132 bash[27079]: cluster 2020-07-16T13:35:35.746480+0000 mgr.y (mgr.14140) 219 : cluster [DBG] pgmap v204: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:37.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:35:36 smithi132 bash[23299]: cluster 2020-07-16T13:35:35.746480+0000 mgr.y (mgr.14140) 219 : cluster [DBG] pgmap v204: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:39.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:35:38 smithi188 bash[23329]: cluster 2020-07-16T13:35:37.746785+0000 mgr.y (mgr.14140) 220 : cluster [DBG] pgmap v205: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:39.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:35:38 smithi132 bash[23299]: cluster 2020-07-16T13:35:37.746785+0000 mgr.y (mgr.14140) 220 : cluster [DBG] pgmap v205: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:39.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:35:38 smithi132 bash[27079]: cluster 2020-07-16T13:35:37.746785+0000 mgr.y (mgr.14140) 220 : cluster [DBG] pgmap v205: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:40.707 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T13:35:40.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:35:40 smithi188 bash[23329]: cluster 2020-07-16T13:35:39.747135+0000 mgr.y (mgr.14140) 221 : cluster [DBG] pgmap v206: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:40.969 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T13:35:40.969 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (58s) 50s ago 88s 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 83de891fa91c 2020-07-16T13:35:40.969 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (69s) 46s ago 69s 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T13:35:40.969 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (4m) 46s ago 4m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 476cdb85d918 2020-07-16T13:35:40.970 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (6m) 50s ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 9aeb379e8310 2020-07-16T13:35:40.970 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 running (6m) 50s ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 fa8441eb419e 2020-07-16T13:35:40.970 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (4m) 46s ago 4m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T13:35:40.970 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (4m) 50s ago 4m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T13:35:40.970 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (99s) 50s ago 102s 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T13:35:40.971 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (99s) 46s ago 103s 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T13:35:40.971 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (4m) 50s ago 4m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T13:35:40.971 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (3m) 50s ago 3m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T13:35:40.971 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (3m) 50s ago 3m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T13:35:40.971 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (3m) 50s ago 3m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T13:35:40.971 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2m) 46s ago 2m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T13:35:40.972 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2m) 46s ago 2m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T13:35:40.972 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2m) 46s ago 2m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T13:35:40.972 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2m) 46s ago 2m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T13:35:40.972 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (54s) 46s ago 103s 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T13:35:41.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:35:40 smithi132 bash[27079]: cluster 2020-07-16T13:35:39.747135+0000 mgr.y (mgr.14140) 221 : cluster [DBG] pgmap v206: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:41.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:35:40 smithi132 bash[23299]: cluster 2020-07-16T13:35:39.747135+0000 mgr.y (mgr.14140) 221 : cluster [DBG] pgmap v206: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:41.256 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T13:35:41.256 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T13:35:41.257 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2020-07-16T13:35:41.257 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:35:41.257 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T13:35:41.258 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2020-07-16T13:35:41.258 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:35:41.258 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T13:35:41.258 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T13:35:41.258 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:35:41.259 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T13:35:41.259 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T13:35:41.259 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 13 2020-07-16T13:35:41.259 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T13:35:41.259 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T13:35:41.690 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:35:41 smithi132 bash[27079]: audit 2020-07-16T13:35:40.694914+0000 mgr.y (mgr.14140) 222 : audit [DBG] from='client.14586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:35:41.691 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:35:41 smithi132 bash[27079]: audit 2020-07-16T13:35:40.964908+0000 mgr.y (mgr.14140) 223 : audit [DBG] from='client.14592 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:35:41.691 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:35:41 smithi132 bash[27079]: audit 2020-07-16T13:35:41.255103+0000 mon.a (mon.0) 568 : audit [DBG] from='client.? 172.21.15.132:0/2651144503' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:35:41.692 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:35:41 smithi132 bash[23299]: audit 2020-07-16T13:35:40.694914+0000 mgr.y (mgr.14140) 222 : audit [DBG] from='client.14586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:35:41.692 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:35:41 smithi132 bash[23299]: audit 2020-07-16T13:35:40.964908+0000 mgr.y (mgr.14140) 223 : audit [DBG] from='client.14592 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:35:41.692 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:35:41 smithi132 bash[23299]: audit 2020-07-16T13:35:41.255103+0000 mon.a (mon.0) 568 : audit [DBG] from='client.? 172.21.15.132:0/2651144503' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:35:41.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:35:41 smithi188 bash[23329]: audit 2020-07-16T13:35:40.694914+0000 mgr.y (mgr.14140) 222 : audit [DBG] from='client.14586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:35:41.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:35:41 smithi188 bash[23329]: audit 2020-07-16T13:35:40.964908+0000 mgr.y (mgr.14140) 223 : audit [DBG] from='client.14592 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:35:41.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:35:41 smithi188 bash[23329]: audit 2020-07-16T13:35:41.255103+0000 mon.a (mon.0) 568 : audit [DBG] from='client.? 172.21.15.132:0/2651144503' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:35:42.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:35:42 smithi188 bash[23329]: cluster 2020-07-16T13:35:41.747527+0000 mgr.y (mgr.14140) 224 : cluster [DBG] pgmap v207: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:43.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:35:42 smithi132 bash[27079]: cluster 2020-07-16T13:35:41.747527+0000 mgr.y (mgr.14140) 224 : cluster [DBG] pgmap v207: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:43.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:35:42 smithi132 bash[23299]: cluster 2020-07-16T13:35:41.747527+0000 mgr.y (mgr.14140) 224 : cluster [DBG] pgmap v207: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:45.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:35:44 smithi188 bash[23329]: cluster 2020-07-16T13:35:43.747930+0000 mgr.y (mgr.14140) 225 : cluster [DBG] pgmap v208: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:45.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:35:44 smithi132 bash[27079]: cluster 2020-07-16T13:35:43.747930+0000 mgr.y (mgr.14140) 225 : cluster [DBG] pgmap v208: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:45.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:35:44 smithi132 bash[23299]: cluster 2020-07-16T13:35:43.747930+0000 mgr.y (mgr.14140) 225 : cluster [DBG] pgmap v208: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:47.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:35:46 smithi188 bash[23329]: cluster 2020-07-16T13:35:45.748390+0000 mgr.y (mgr.14140) 226 : cluster [DBG] pgmap v209: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:47.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:35:46 smithi132 bash[23299]: cluster 2020-07-16T13:35:45.748390+0000 mgr.y (mgr.14140) 226 : cluster [DBG] pgmap v209: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:47.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:35:46 smithi132 bash[27079]: cluster 2020-07-16T13:35:45.748390+0000 mgr.y (mgr.14140) 226 : cluster [DBG] pgmap v209: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:49.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:35:48 smithi188 bash[23329]: cluster 2020-07-16T13:35:47.748869+0000 mgr.y (mgr.14140) 227 : cluster [DBG] pgmap v210: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:49.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:35:48 smithi132 bash[27079]: cluster 2020-07-16T13:35:47.748869+0000 mgr.y (mgr.14140) 227 : cluster [DBG] pgmap v210: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:49.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:35:48 smithi132 bash[23299]: cluster 2020-07-16T13:35:47.748869+0000 mgr.y (mgr.14140) 227 : cluster [DBG] pgmap v210: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:50.925 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:35:50 smithi188 bash[23329]: cluster 2020-07-16T13:35:49.749320+0000 mgr.y (mgr.14140) 228 : cluster [DBG] pgmap v211: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:51.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:35:50 smithi132 bash[23299]: cluster 2020-07-16T13:35:49.749320+0000 mgr.y (mgr.14140) 228 : cluster [DBG] pgmap v211: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:51.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:35:50 smithi132 bash[27079]: cluster 2020-07-16T13:35:49.749320+0000 mgr.y (mgr.14140) 228 : cluster [DBG] pgmap v211: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:53.178 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:35:52 smithi188 bash[23329]: cluster 2020-07-16T13:35:51.749731+0000 mgr.y (mgr.14140) 229 : cluster [DBG] pgmap v212: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:53.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:35:52 smithi132 bash[27079]: cluster 2020-07-16T13:35:51.749731+0000 mgr.y (mgr.14140) 229 : cluster [DBG] pgmap v212: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:53.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:35:52 smithi132 bash[23299]: cluster 2020-07-16T13:35:51.749731+0000 mgr.y (mgr.14140) 229 : cluster [DBG] pgmap v212: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:55.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:35:54 smithi132 bash[23299]: cluster 2020-07-16T13:35:53.750117+0000 mgr.y (mgr.14140) 230 : cluster [DBG] pgmap v213: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:55.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:35:54 smithi132 bash[23299]: audit 2020-07-16T13:35:54.605616+0000 mon.a (mon.0) 569 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"progress_id\": \"e27d2e86-c799-4738-b39a-453c2be79645\", \"target_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"target_version\": \"ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)\"}"}]: dispatch 2020-07-16T13:35:55.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:35:54 smithi132 bash[23299]: audit 2020-07-16T13:35:54.608928+0000 mon.a (mon.0) 570 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"progress_id\": \"e27d2e86-c799-4738-b39a-453c2be79645\", \"target_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"target_version\": \"ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)\"}"}]': finished 2020-07-16T13:35:55.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:35:54 smithi132 bash[23299]: audit 2020-07-16T13:35:54.609560+0000 mon.a (mon.0) 571 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T13:35:55.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:35:54 smithi132 bash[27079]: cluster 2020-07-16T13:35:53.750117+0000 mgr.y (mgr.14140) 230 : cluster [DBG] pgmap v213: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:55.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:35:54 smithi132 bash[27079]: audit 2020-07-16T13:35:54.605616+0000 mon.a (mon.0) 569 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"progress_id\": \"e27d2e86-c799-4738-b39a-453c2be79645\", \"target_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"target_version\": \"ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)\"}"}]: dispatch 2020-07-16T13:35:55.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:35:54 smithi132 bash[27079]: audit 2020-07-16T13:35:54.608928+0000 mon.a (mon.0) 570 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"progress_id\": \"e27d2e86-c799-4738-b39a-453c2be79645\", \"target_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"target_version\": \"ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)\"}"}]': finished 2020-07-16T13:35:55.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:35:54 smithi132 bash[27079]: audit 2020-07-16T13:35:54.609560+0000 mon.a (mon.0) 571 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T13:35:55.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:35:54 smithi188 bash[23329]: cluster 2020-07-16T13:35:53.750117+0000 mgr.y (mgr.14140) 230 : cluster [DBG] pgmap v213: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:55.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:35:54 smithi188 bash[23329]: audit 2020-07-16T13:35:54.605616+0000 mon.a (mon.0) 569 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"progress_id\": \"e27d2e86-c799-4738-b39a-453c2be79645\", \"target_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"target_version\": \"ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)\"}"}]: dispatch 2020-07-16T13:35:55.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:35:54 smithi188 bash[23329]: audit 2020-07-16T13:35:54.608928+0000 mon.a (mon.0) 570 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"progress_id\": \"e27d2e86-c799-4738-b39a-453c2be79645\", \"target_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"target_version\": \"ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)\"}"}]': finished 2020-07-16T13:35:55.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:35:54 smithi188 bash[23329]: audit 2020-07-16T13:35:54.609560+0000 mon.a (mon.0) 571 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T13:35:56.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:35:55 smithi188 bash[23329]: cephadm 2020-07-16T13:35:54.609315+0000 mgr.y (mgr.14140) 231 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T13:35:56.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:35:55 smithi188 bash[23329]: cephadm 2020-07-16T13:35:54.610958+0000 mgr.y (mgr.14140) 232 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T13:35:56.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:35:55 smithi188 bash[23329]: cephadm 2020-07-16T13:35:54.611350+0000 mgr.y (mgr.14140) 233 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2020-07-16T13:35:56.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:35:55 smithi188 bash[23329]: cephadm 2020-07-16T13:35:54.838502+0000 mgr.y (mgr.14140) 234 : cephadm [INF] Upgrade: Pulling quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca on smithi188 2020-07-16T13:35:56.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:35:55 smithi132 bash[27079]: cephadm 2020-07-16T13:35:54.609315+0000 mgr.y (mgr.14140) 231 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T13:35:56.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:35:55 smithi132 bash[27079]: cephadm 2020-07-16T13:35:54.610958+0000 mgr.y (mgr.14140) 232 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T13:35:56.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:35:55 smithi132 bash[27079]: cephadm 2020-07-16T13:35:54.611350+0000 mgr.y (mgr.14140) 233 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2020-07-16T13:35:56.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:35:55 smithi132 bash[27079]: cephadm 2020-07-16T13:35:54.838502+0000 mgr.y (mgr.14140) 234 : cephadm [INF] Upgrade: Pulling quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca on smithi188 2020-07-16T13:35:56.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:35:55 smithi132 bash[23299]: cephadm 2020-07-16T13:35:54.609315+0000 mgr.y (mgr.14140) 231 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T13:35:56.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:35:55 smithi132 bash[23299]: cephadm 2020-07-16T13:35:54.610958+0000 mgr.y (mgr.14140) 232 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T13:35:56.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:35:55 smithi132 bash[23299]: cephadm 2020-07-16T13:35:54.611350+0000 mgr.y (mgr.14140) 233 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2020-07-16T13:35:56.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:35:55 smithi132 bash[23299]: cephadm 2020-07-16T13:35:54.838502+0000 mgr.y (mgr.14140) 234 : cephadm [INF] Upgrade: Pulling quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca on smithi188 2020-07-16T13:35:57.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:35:56 smithi188 bash[23329]: cluster 2020-07-16T13:35:55.750551+0000 mgr.y (mgr.14140) 235 : cluster [DBG] pgmap v214: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:57.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:35:56 smithi132 bash[27079]: cluster 2020-07-16T13:35:55.750551+0000 mgr.y (mgr.14140) 235 : cluster [DBG] pgmap v214: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:57.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:35:56 smithi132 bash[23299]: cluster 2020-07-16T13:35:55.750551+0000 mgr.y (mgr.14140) 235 : cluster [DBG] pgmap v214: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:59.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:35:58 smithi188 bash[23329]: cluster 2020-07-16T13:35:57.751051+0000 mgr.y (mgr.14140) 236 : cluster [DBG] pgmap v215: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:59.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:35:58 smithi132 bash[23299]: cluster 2020-07-16T13:35:57.751051+0000 mgr.y (mgr.14140) 236 : cluster [DBG] pgmap v215: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:35:59.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:35:58 smithi132 bash[27079]: cluster 2020-07-16T13:35:57.751051+0000 mgr.y (mgr.14140) 236 : cluster [DBG] pgmap v215: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:00.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:36:00 smithi188 bash[23329]: cluster 2020-07-16T13:35:59.751536+0000 mgr.y (mgr.14140) 237 : cluster [DBG] pgmap v216: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:01.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:36:00 smithi132 bash[27079]: cluster 2020-07-16T13:35:59.751536+0000 mgr.y (mgr.14140) 237 : cluster [DBG] pgmap v216: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:01.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:36:00 smithi132 bash[23299]: cluster 2020-07-16T13:35:59.751536+0000 mgr.y (mgr.14140) 237 : cluster [DBG] pgmap v216: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:03.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:36:02 smithi188 bash[23329]: cluster 2020-07-16T13:36:01.752019+0000 mgr.y (mgr.14140) 238 : cluster [DBG] pgmap v217: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:03.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:36:02 smithi132 bash[23299]: cluster 2020-07-16T13:36:01.752019+0000 mgr.y (mgr.14140) 238 : cluster [DBG] pgmap v217: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:03.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:36:02 smithi132 bash[27079]: cluster 2020-07-16T13:36:01.752019+0000 mgr.y (mgr.14140) 238 : cluster [DBG] pgmap v217: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:05.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:36:04 smithi188 bash[23329]: cluster 2020-07-16T13:36:03.752562+0000 mgr.y (mgr.14140) 239 : cluster [DBG] pgmap v218: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:05.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:36:04 smithi132 bash[27079]: cluster 2020-07-16T13:36:03.752562+0000 mgr.y (mgr.14140) 239 : cluster [DBG] pgmap v218: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:05.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:36:04 smithi132 bash[23299]: cluster 2020-07-16T13:36:03.752562+0000 mgr.y (mgr.14140) 239 : cluster [DBG] pgmap v218: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:07.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:36:06 smithi188 bash[23329]: cluster 2020-07-16T13:36:05.752897+0000 mgr.y (mgr.14140) 240 : cluster [DBG] pgmap v219: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:07.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:36:06 smithi132 bash[27079]: cluster 2020-07-16T13:36:05.752897+0000 mgr.y (mgr.14140) 240 : cluster [DBG] pgmap v219: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:07.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:36:06 smithi132 bash[23299]: cluster 2020-07-16T13:36:05.752897+0000 mgr.y (mgr.14140) 240 : cluster [DBG] pgmap v219: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:09.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:36:08 smithi188 bash[23329]: cluster 2020-07-16T13:36:07.753264+0000 mgr.y (mgr.14140) 241 : cluster [DBG] pgmap v220: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:09.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:36:08 smithi132 bash[23299]: cluster 2020-07-16T13:36:07.753264+0000 mgr.y (mgr.14140) 241 : cluster [DBG] pgmap v220: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:09.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:36:08 smithi132 bash[27079]: cluster 2020-07-16T13:36:07.753264+0000 mgr.y (mgr.14140) 241 : cluster [DBG] pgmap v220: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:10.926 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:36:10 smithi188 bash[23329]: cluster 2020-07-16T13:36:09.753594+0000 mgr.y (mgr.14140) 242 : cluster [DBG] pgmap v221: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:11.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:36:10 smithi132 bash[23299]: cluster 2020-07-16T13:36:09.753594+0000 mgr.y (mgr.14140) 242 : cluster [DBG] pgmap v221: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:11.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:36:10 smithi132 bash[27079]: cluster 2020-07-16T13:36:09.753594+0000 mgr.y (mgr.14140) 242 : cluster [DBG] pgmap v221: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:11.543 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T13:36:11.796 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T13:36:11.797 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (89s) 81s ago 118s 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 83de891fa91c 2020-07-16T13:36:11.797 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (100s) 77s ago 100s 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T13:36:11.798 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (4m) 77s ago 4m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 476cdb85d918 2020-07-16T13:36:11.798 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (6m) 81s ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 9aeb379e8310 2020-07-16T13:36:11.798 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 running (6m) 81s ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 fa8441eb419e 2020-07-16T13:36:11.799 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (5m) 77s ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T13:36:11.799 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (5m) 81s ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T13:36:11.799 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2m) 81s ago 2m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T13:36:11.800 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2m) 77s ago 2m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T13:36:11.800 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (4m) 81s ago 4m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T13:36:11.800 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (4m) 81s ago 4m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T13:36:11.801 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (3m) 81s ago 4m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T13:36:11.801 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (3m) 81s ago 3m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T13:36:11.801 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (3m) 77s ago 3m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T13:36:11.802 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (3m) 77s ago 3m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T13:36:11.802 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2m) 77s ago 2m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T13:36:11.803 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2m) 77s ago 2m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T13:36:11.803 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (84s) 77s ago 2m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T13:36:12.080 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T13:36:12.080 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T13:36:12.081 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2020-07-16T13:36:12.081 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:36:12.081 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T13:36:12.081 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2020-07-16T13:36:12.081 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:36:12.082 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T13:36:12.082 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T13:36:12.082 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:36:12.082 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T13:36:12.082 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T13:36:12.083 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 13 2020-07-16T13:36:12.083 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T13:36:12.083 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T13:36:13.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:36:12 smithi188 bash[23329]: audit 2020-07-16T13:36:11.531451+0000 mgr.y (mgr.14140) 243 : audit [DBG] from='client.14604 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:36:13.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:36:12 smithi188 bash[23329]: cluster 2020-07-16T13:36:11.753904+0000 mgr.y (mgr.14140) 244 : cluster [DBG] pgmap v222: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:13.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:36:12 smithi188 bash[23329]: audit 2020-07-16T13:36:11.792645+0000 mgr.y (mgr.14140) 245 : audit [DBG] from='client.14610 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:36:13.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:36:12 smithi188 bash[23329]: audit 2020-07-16T13:36:12.079351+0000 mon.c (mon.1) 21 : audit [DBG] from='client.? 172.21.15.132:0/905830005' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:36:13.284 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:36:12 smithi132 bash[23299]: audit 2020-07-16T13:36:11.531451+0000 mgr.y (mgr.14140) 243 : audit [DBG] from='client.14604 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:36:13.284 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:36:12 smithi132 bash[23299]: cluster 2020-07-16T13:36:11.753904+0000 mgr.y (mgr.14140) 244 : cluster [DBG] pgmap v222: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:13.285 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:36:12 smithi132 bash[23299]: audit 2020-07-16T13:36:11.792645+0000 mgr.y (mgr.14140) 245 : audit [DBG] from='client.14610 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:36:13.285 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:36:12 smithi132 bash[23299]: audit 2020-07-16T13:36:12.079351+0000 mon.c (mon.1) 21 : audit [DBG] from='client.? 172.21.15.132:0/905830005' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:36:13.285 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:36:12 smithi132 bash[27079]: audit 2020-07-16T13:36:11.531451+0000 mgr.y (mgr.14140) 243 : audit [DBG] from='client.14604 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:36:13.285 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:36:12 smithi132 bash[27079]: cluster 2020-07-16T13:36:11.753904+0000 mgr.y (mgr.14140) 244 : cluster [DBG] pgmap v222: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:13.286 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:36:12 smithi132 bash[27079]: audit 2020-07-16T13:36:11.792645+0000 mgr.y (mgr.14140) 245 : audit [DBG] from='client.14610 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:36:13.286 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:36:12 smithi132 bash[27079]: audit 2020-07-16T13:36:12.079351+0000 mon.c (mon.1) 21 : audit [DBG] from='client.? 172.21.15.132:0/905830005' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:36:15.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:36:14 smithi188 bash[23329]: cluster 2020-07-16T13:36:13.754312+0000 mgr.y (mgr.14140) 246 : cluster [DBG] pgmap v223: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:15.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:36:14 smithi132 bash[27079]: cluster 2020-07-16T13:36:13.754312+0000 mgr.y (mgr.14140) 246 : cluster [DBG] pgmap v223: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:15.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:36:14 smithi132 bash[23299]: cluster 2020-07-16T13:36:13.754312+0000 mgr.y (mgr.14140) 246 : cluster [DBG] pgmap v223: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:17.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:36:16 smithi188 bash[23329]: cluster 2020-07-16T13:36:15.754789+0000 mgr.y (mgr.14140) 247 : cluster [DBG] pgmap v224: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:17.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:36:16 smithi132 bash[27079]: cluster 2020-07-16T13:36:15.754789+0000 mgr.y (mgr.14140) 247 : cluster [DBG] pgmap v224: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:17.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:36:16 smithi132 bash[23299]: cluster 2020-07-16T13:36:15.754789+0000 mgr.y (mgr.14140) 247 : cluster [DBG] pgmap v224: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:19.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:36:18 smithi188 bash[23329]: cluster 2020-07-16T13:36:17.755218+0000 mgr.y (mgr.14140) 248 : cluster [DBG] pgmap v225: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:19.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:36:18 smithi132 bash[27079]: cluster 2020-07-16T13:36:17.755218+0000 mgr.y (mgr.14140) 248 : cluster [DBG] pgmap v225: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:19.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:36:18 smithi132 bash[23299]: cluster 2020-07-16T13:36:17.755218+0000 mgr.y (mgr.14140) 248 : cluster [DBG] pgmap v225: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:20.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:36:20 smithi188 bash[23329]: cluster 2020-07-16T13:36:19.755596+0000 mgr.y (mgr.14140) 249 : cluster [DBG] pgmap v226: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:21.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:36:20 smithi132 bash[27079]: cluster 2020-07-16T13:36:19.755596+0000 mgr.y (mgr.14140) 249 : cluster [DBG] pgmap v226: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:21.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:36:20 smithi132 bash[23299]: cluster 2020-07-16T13:36:19.755596+0000 mgr.y (mgr.14140) 249 : cluster [DBG] pgmap v226: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:23.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:36:22 smithi188 bash[23329]: cluster 2020-07-16T13:36:21.755929+0000 mgr.y (mgr.14140) 250 : cluster [DBG] pgmap v227: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:23.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:36:22 smithi132 bash[27079]: cluster 2020-07-16T13:36:21.755929+0000 mgr.y (mgr.14140) 250 : cluster [DBG] pgmap v227: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:23.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:36:22 smithi132 bash[23299]: cluster 2020-07-16T13:36:21.755929+0000 mgr.y (mgr.14140) 250 : cluster [DBG] pgmap v227: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:25.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:36:24 smithi188 bash[23329]: cluster 2020-07-16T13:36:23.756293+0000 mgr.y (mgr.14140) 251 : cluster [DBG] pgmap v228: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:25.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:36:24 smithi132 bash[27079]: cluster 2020-07-16T13:36:23.756293+0000 mgr.y (mgr.14140) 251 : cluster [DBG] pgmap v228: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:25.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:36:24 smithi132 bash[23299]: cluster 2020-07-16T13:36:23.756293+0000 mgr.y (mgr.14140) 251 : cluster [DBG] pgmap v228: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:27.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:36:26 smithi188 bash[23329]: cluster 2020-07-16T13:36:25.756683+0000 mgr.y (mgr.14140) 252 : cluster [DBG] pgmap v229: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:27.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:36:26 smithi132 bash[27079]: cluster 2020-07-16T13:36:25.756683+0000 mgr.y (mgr.14140) 252 : cluster [DBG] pgmap v229: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:27.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:36:26 smithi132 bash[23299]: cluster 2020-07-16T13:36:25.756683+0000 mgr.y (mgr.14140) 252 : cluster [DBG] pgmap v229: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:29.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:36:28 smithi188 bash[23329]: cluster 2020-07-16T13:36:27.757060+0000 mgr.y (mgr.14140) 253 : cluster [DBG] pgmap v230: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:29.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:36:28 smithi132 bash[27079]: cluster 2020-07-16T13:36:27.757060+0000 mgr.y (mgr.14140) 253 : cluster [DBG] pgmap v230: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:29.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:36:28 smithi132 bash[23299]: cluster 2020-07-16T13:36:27.757060+0000 mgr.y (mgr.14140) 253 : cluster [DBG] pgmap v230: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:30.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:36:30 smithi188 bash[23329]: cluster 2020-07-16T13:36:29.757565+0000 mgr.y (mgr.14140) 254 : cluster [DBG] pgmap v231: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:31.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:36:30 smithi132 bash[27079]: cluster 2020-07-16T13:36:29.757565+0000 mgr.y (mgr.14140) 254 : cluster [DBG] pgmap v231: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:31.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:36:30 smithi132 bash[23299]: cluster 2020-07-16T13:36:29.757565+0000 mgr.y (mgr.14140) 254 : cluster [DBG] pgmap v231: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:33.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:36:32 smithi188 bash[23329]: cluster 2020-07-16T13:36:31.758068+0000 mgr.y (mgr.14140) 255 : cluster [DBG] pgmap v232: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:33.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:36:32 smithi132 bash[27079]: cluster 2020-07-16T13:36:31.758068+0000 mgr.y (mgr.14140) 255 : cluster [DBG] pgmap v232: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:33.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:36:32 smithi132 bash[23299]: cluster 2020-07-16T13:36:31.758068+0000 mgr.y (mgr.14140) 255 : cluster [DBG] pgmap v232: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:35.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:36:34 smithi188 bash[23329]: cluster 2020-07-16T13:36:33.758534+0000 mgr.y (mgr.14140) 256 : cluster [DBG] pgmap v233: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:35.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:36:34 smithi132 bash[27079]: cluster 2020-07-16T13:36:33.758534+0000 mgr.y (mgr.14140) 256 : cluster [DBG] pgmap v233: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:35.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:36:34 smithi132 bash[23299]: cluster 2020-07-16T13:36:33.758534+0000 mgr.y (mgr.14140) 256 : cluster [DBG] pgmap v233: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:37.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:36:36 smithi188 bash[23329]: cluster 2020-07-16T13:36:35.758878+0000 mgr.y (mgr.14140) 257 : cluster [DBG] pgmap v234: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:37.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:36:36 smithi132 bash[27079]: cluster 2020-07-16T13:36:35.758878+0000 mgr.y (mgr.14140) 257 : cluster [DBG] pgmap v234: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:37.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:36:36 smithi132 bash[23299]: cluster 2020-07-16T13:36:35.758878+0000 mgr.y (mgr.14140) 257 : cluster [DBG] pgmap v234: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:39.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:36:38 smithi188 bash[23329]: cluster 2020-07-16T13:36:37.759393+0000 mgr.y (mgr.14140) 258 : cluster [DBG] pgmap v235: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:39.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:36:38 smithi132 bash[23299]: cluster 2020-07-16T13:36:37.759393+0000 mgr.y (mgr.14140) 258 : cluster [DBG] pgmap v235: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:39.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:36:38 smithi132 bash[27079]: cluster 2020-07-16T13:36:37.759393+0000 mgr.y (mgr.14140) 258 : cluster [DBG] pgmap v235: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:40.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:36:40 smithi188 bash[23329]: cluster 2020-07-16T13:36:39.759792+0000 mgr.y (mgr.14140) 259 : cluster [DBG] pgmap v236: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:41.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:36:40 smithi132 bash[23299]: cluster 2020-07-16T13:36:39.759792+0000 mgr.y (mgr.14140) 259 : cluster [DBG] pgmap v236: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:41.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:36:40 smithi132 bash[27079]: cluster 2020-07-16T13:36:39.759792+0000 mgr.y (mgr.14140) 259 : cluster [DBG] pgmap v236: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:42.366 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T13:36:42.619 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T13:36:42.619 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2m) 112s ago 2m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 83de891fa91c 2020-07-16T13:36:42.620 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2m) 107s ago 2m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T13:36:42.620 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (5m) 107s ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 476cdb85d918 2020-07-16T13:36:42.620 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (7m) 112s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 9aeb379e8310 2020-07-16T13:36:42.620 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 running (7m) 112s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 fa8441eb419e 2020-07-16T13:36:42.620 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (5m) 107s ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T13:36:42.621 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (5m) 112s ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T13:36:42.621 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2m) 112s ago 2m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T13:36:42.621 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2m) 107s ago 2m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T13:36:42.622 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (5m) 112s ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T13:36:42.622 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (4m) 112s ago 4m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T13:36:42.622 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (4m) 112s ago 4m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T13:36:42.622 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (4m) 112s ago 4m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T13:36:42.622 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (3m) 107s ago 4m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T13:36:42.623 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (3m) 107s ago 3m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T13:36:42.623 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (3m) 107s ago 3m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T13:36:42.623 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (3m) 107s ago 3m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T13:36:42.623 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (115s) 107s ago 2m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T13:36:42.912 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T13:36:42.913 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T13:36:42.913 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2020-07-16T13:36:42.913 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:36:42.913 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T13:36:42.913 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2020-07-16T13:36:42.914 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:36:42.914 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T13:36:42.914 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T13:36:42.914 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:36:42.914 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T13:36:42.914 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T13:36:42.915 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 13 2020-07-16T13:36:42.915 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T13:36:42.915 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T13:36:43.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:36:42 smithi188 bash[23329]: cluster 2020-07-16T13:36:41.760224+0000 mgr.y (mgr.14140) 260 : cluster [DBG] pgmap v237: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:43.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:36:42 smithi132 bash[27079]: cluster 2020-07-16T13:36:41.760224+0000 mgr.y (mgr.14140) 260 : cluster [DBG] pgmap v237: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:43.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:36:42 smithi132 bash[23299]: cluster 2020-07-16T13:36:41.760224+0000 mgr.y (mgr.14140) 260 : cluster [DBG] pgmap v237: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:44.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:36:43 smithi188 bash[23329]: audit 2020-07-16T13:36:42.354326+0000 mgr.y (mgr.14140) 261 : audit [DBG] from='client.14622 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:36:44.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:36:43 smithi188 bash[23329]: audit 2020-07-16T13:36:42.614770+0000 mgr.y (mgr.14140) 262 : audit [DBG] from='client.24544 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:36:44.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:36:43 smithi188 bash[23329]: audit 2020-07-16T13:36:42.909501+0000 mon.c (mon.1) 22 : audit [DBG] from='client.? 172.21.15.132:0/2371117275' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:36:44.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:36:43 smithi188 bash[23329]: audit 2020-07-16T13:36:43.508465+0000 mon.a (mon.0) 572 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca", "who": "mgr.x"}]: dispatch 2020-07-16T13:36:44.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:36:43 smithi188 bash[23329]: audit 2020-07-16T13:36:43.512232+0000 mon.a (mon.0) 573 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca", "who": "mgr.x"}]': finished 2020-07-16T13:36:44.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:36:43 smithi188 bash[23329]: audit 2020-07-16T13:36:43.512884+0000 mon.a (mon.0) 574 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.x"}]: dispatch 2020-07-16T13:36:44.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:36:43 smithi188 bash[23329]: audit 2020-07-16T13:36:43.513487+0000 mon.a (mon.0) 575 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:36:44.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:36:43 smithi188 bash[23329]: audit 2020-07-16T13:36:43.514276+0000 mon.a (mon.0) 576 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2020-07-16T13:36:44.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:36:43 smithi132 bash[27079]: audit 2020-07-16T13:36:42.354326+0000 mgr.y (mgr.14140) 261 : audit [DBG] from='client.14622 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:36:44.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:36:43 smithi132 bash[27079]: audit 2020-07-16T13:36:42.614770+0000 mgr.y (mgr.14140) 262 : audit [DBG] from='client.24544 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:36:44.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:36:43 smithi132 bash[27079]: audit 2020-07-16T13:36:42.909501+0000 mon.c (mon.1) 22 : audit [DBG] from='client.? 172.21.15.132:0/2371117275' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:36:44.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:36:43 smithi132 bash[27079]: audit 2020-07-16T13:36:43.508465+0000 mon.a (mon.0) 572 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca", "who": "mgr.x"}]: dispatch 2020-07-16T13:36:44.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:36:43 smithi132 bash[27079]: audit 2020-07-16T13:36:43.512232+0000 mon.a (mon.0) 573 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca", "who": "mgr.x"}]': finished 2020-07-16T13:36:44.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:36:43 smithi132 bash[27079]: audit 2020-07-16T13:36:43.512884+0000 mon.a (mon.0) 574 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.x"}]: dispatch 2020-07-16T13:36:44.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:36:43 smithi132 bash[27079]: audit 2020-07-16T13:36:43.513487+0000 mon.a (mon.0) 575 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:36:44.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:36:43 smithi132 bash[27079]: audit 2020-07-16T13:36:43.514276+0000 mon.a (mon.0) 576 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2020-07-16T13:36:44.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:36:43 smithi132 bash[23299]: audit 2020-07-16T13:36:42.354326+0000 mgr.y (mgr.14140) 261 : audit [DBG] from='client.14622 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:36:44.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:36:43 smithi132 bash[23299]: audit 2020-07-16T13:36:42.614770+0000 mgr.y (mgr.14140) 262 : audit [DBG] from='client.24544 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:36:44.282 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:36:43 smithi132 bash[23299]: audit 2020-07-16T13:36:42.909501+0000 mon.c (mon.1) 22 : audit [DBG] from='client.? 172.21.15.132:0/2371117275' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:36:44.283 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:36:43 smithi132 bash[23299]: audit 2020-07-16T13:36:43.508465+0000 mon.a (mon.0) 572 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca", "who": "mgr.x"}]: dispatch 2020-07-16T13:36:44.284 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:36:43 smithi132 bash[23299]: audit 2020-07-16T13:36:43.512232+0000 mon.a (mon.0) 573 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca", "who": "mgr.x"}]': finished 2020-07-16T13:36:44.284 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:36:43 smithi132 bash[23299]: audit 2020-07-16T13:36:43.512884+0000 mon.a (mon.0) 574 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.x"}]: dispatch 2020-07-16T13:36:44.284 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:36:43 smithi132 bash[23299]: audit 2020-07-16T13:36:43.513487+0000 mon.a (mon.0) 575 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:36:44.285 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:36:43 smithi132 bash[23299]: audit 2020-07-16T13:36:43.514276+0000 mon.a (mon.0) 576 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2020-07-16T13:36:45.171 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Jul 16 13:36:44 smithi188 systemd[1]: Stopping Ceph mgr.x for 4c8ed362-c768-11ea-a06f-001a4aab830c... 2020-07-16T13:36:45.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:36:44 smithi188 bash[23329]: cephadm 2020-07-16T13:36:43.508116+0000 mgr.y (mgr.14140) 263 : cephadm [INF] Upgrade: It is presumed safe to stop mgr.x 2020-07-16T13:36:45.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:36:44 smithi188 bash[23329]: cephadm 2020-07-16T13:36:43.508181+0000 mgr.y (mgr.14140) 264 : cephadm [INF] Upgrade: Redeploying mgr.x 2020-07-16T13:36:45.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:36:44 smithi188 bash[23329]: cephadm 2020-07-16T13:36:43.513926+0000 mgr.y (mgr.14140) 265 : cephadm [INF] Deploying daemon mgr.x on smithi188 2020-07-16T13:36:45.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:36:44 smithi188 bash[23329]: cluster 2020-07-16T13:36:43.760693+0000 mgr.y (mgr.14140) 266 : cluster [DBG] pgmap v238: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:45.282 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:36:44 smithi132 bash[23299]: cephadm 2020-07-16T13:36:43.508116+0000 mgr.y (mgr.14140) 263 : cephadm [INF] Upgrade: It is presumed safe to stop mgr.x 2020-07-16T13:36:45.283 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:36:44 smithi132 bash[23299]: cephadm 2020-07-16T13:36:43.508181+0000 mgr.y (mgr.14140) 264 : cephadm [INF] Upgrade: Redeploying mgr.x 2020-07-16T13:36:45.283 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:36:44 smithi132 bash[23299]: cephadm 2020-07-16T13:36:43.513926+0000 mgr.y (mgr.14140) 265 : cephadm [INF] Deploying daemon mgr.x on smithi188 2020-07-16T13:36:45.283 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:36:44 smithi132 bash[23299]: cluster 2020-07-16T13:36:43.760693+0000 mgr.y (mgr.14140) 266 : cluster [DBG] pgmap v238: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:45.284 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:36:44 smithi132 bash[27079]: cephadm 2020-07-16T13:36:43.508116+0000 mgr.y (mgr.14140) 263 : cephadm [INF] Upgrade: It is presumed safe to stop mgr.x 2020-07-16T13:36:45.284 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:36:44 smithi132 bash[27079]: cephadm 2020-07-16T13:36:43.508181+0000 mgr.y (mgr.14140) 264 : cephadm [INF] Upgrade: Redeploying mgr.x 2020-07-16T13:36:45.284 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:36:44 smithi132 bash[27079]: cephadm 2020-07-16T13:36:43.513926+0000 mgr.y (mgr.14140) 265 : cephadm [INF] Deploying daemon mgr.x on smithi188 2020-07-16T13:36:45.285 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:36:44 smithi132 bash[27079]: cluster 2020-07-16T13:36:43.760693+0000 mgr.y (mgr.14140) 266 : cluster [DBG] pgmap v238: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:47.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:36:46 smithi188 bash[23329]: cluster 2020-07-16T13:36:45.761170+0000 mgr.y (mgr.14140) 267 : cluster [DBG] pgmap v239: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:47.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:36:46 smithi132 bash[27079]: cluster 2020-07-16T13:36:45.761170+0000 mgr.y (mgr.14140) 267 : cluster [DBG] pgmap v239: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:47.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:36:46 smithi132 bash[23299]: cluster 2020-07-16T13:36:45.761170+0000 mgr.y (mgr.14140) 267 : cluster [DBG] pgmap v239: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:49.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:36:48 smithi188 bash[23329]: cluster 2020-07-16T13:36:47.761483+0000 mgr.y (mgr.14140) 268 : cluster [DBG] pgmap v240: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:49.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:36:48 smithi132 bash[27079]: cluster 2020-07-16T13:36:47.761483+0000 mgr.y (mgr.14140) 268 : cluster [DBG] pgmap v240: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:49.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:36:48 smithi132 bash[23299]: cluster 2020-07-16T13:36:47.761483+0000 mgr.y (mgr.14140) 268 : cluster [DBG] pgmap v240: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:50.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:36:50 smithi188 bash[23329]: cluster 2020-07-16T13:36:49.761970+0000 mgr.y (mgr.14140) 269 : cluster [DBG] pgmap v241: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:51.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:36:50 smithi132 bash[23299]: cluster 2020-07-16T13:36:49.761970+0000 mgr.y (mgr.14140) 269 : cluster [DBG] pgmap v241: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:51.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:36:50 smithi132 bash[27079]: cluster 2020-07-16T13:36:49.761970+0000 mgr.y (mgr.14140) 269 : cluster [DBG] pgmap v241: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:53.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:36:52 smithi188 bash[23329]: cluster 2020-07-16T13:36:51.762347+0000 mgr.y (mgr.14140) 270 : cluster [DBG] pgmap v242: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:53.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:36:52 smithi132 bash[23299]: cluster 2020-07-16T13:36:51.762347+0000 mgr.y (mgr.14140) 270 : cluster [DBG] pgmap v242: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:53.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:36:52 smithi132 bash[27079]: cluster 2020-07-16T13:36:51.762347+0000 mgr.y (mgr.14140) 270 : cluster [DBG] pgmap v242: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:55.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:36:54 smithi188 bash[23329]: cluster 2020-07-16T13:36:53.762720+0000 mgr.y (mgr.14140) 271 : cluster [DBG] pgmap v243: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:55.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:36:54 smithi132 bash[23299]: cluster 2020-07-16T13:36:53.762720+0000 mgr.y (mgr.14140) 271 : cluster [DBG] pgmap v243: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:55.290 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:36:54 smithi132 bash[27079]: cluster 2020-07-16T13:36:53.762720+0000 mgr.y (mgr.14140) 271 : cluster [DBG] pgmap v243: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:55.671 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Jul 16 13:36:55 smithi188 podman[3290]: 2020-07-16 13:36:55.200448373 +0000 UTC m=+10.207984506 container died 476cdb85d918b6264a6b36f79d09caec2afb7be95491ca25d0eb75c74f55a4a2 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mgr.x) 2020-07-16T13:36:55.672 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Jul 16 13:36:55 smithi188 podman[3290]: 2020-07-16 13:36:55.231976322 +0000 UTC m=+10.239512428 container stop 476cdb85d918b6264a6b36f79d09caec2afb7be95491ca25d0eb75c74f55a4a2 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mgr.x) 2020-07-16T13:36:55.672 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Jul 16 13:36:55 smithi188 podman[3290]: 476cdb85d918b6264a6b36f79d09caec2afb7be95491ca25d0eb75c74f55a4a2 2020-07-16T13:36:56.173 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Jul 16 13:36:55 smithi188 systemd[1]: ceph-4c8ed362-c768-11ea-a06f-001a4aab830c@mgr.x.service: Main process exited, code=exited, status=137/n/a 2020-07-16T13:36:56.173 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Jul 16 13:36:55 smithi188 systemd[1]: ceph-4c8ed362-c768-11ea-a06f-001a4aab830c@mgr.x.service: Failed with result 'exit-code'. 2020-07-16T13:36:56.173 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Jul 16 13:36:55 smithi188 systemd[1]: Stopped Ceph mgr.x for 4c8ed362-c768-11ea-a06f-001a4aab830c. 2020-07-16T13:36:56.174 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Jul 16 13:36:55 smithi188 systemd[1]: Starting Ceph mgr.x for 4c8ed362-c768-11ea-a06f-001a4aab830c... 2020-07-16T13:36:56.174 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Jul 16 13:36:55 smithi188 podman[3367]: Error: no container with name or ID ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mgr.x found: no such container 2020-07-16T13:36:56.175 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Jul 16 13:36:55 smithi188 systemd[1]: Started Ceph mgr.x for 4c8ed362-c768-11ea-a06f-001a4aab830c. 2020-07-16T13:36:56.491 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Jul 16 13:36:56 smithi188 podman[3385]: 2020-07-16 13:36:56.232052692 +0000 UTC m=+0.243576307 container create 2e95f416d8f01e0a18b9d7c47e0a129487aa9bad3e9655ad15023df1ee3c209c (image=quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mgr.x) 2020-07-16T13:36:56.828 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Jul 16 13:36:56 smithi188 podman[3385]: 2020-07-16 13:36:56.606588391 +0000 UTC m=+0.618111999 container init 2e95f416d8f01e0a18b9d7c47e0a129487aa9bad3e9655ad15023df1ee3c209c (image=quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mgr.x) 2020-07-16T13:36:56.829 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Jul 16 13:36:56 smithi188 podman[3385]: 2020-07-16 13:36:56.639917107 +0000 UTC m=+0.651440703 container start 2e95f416d8f01e0a18b9d7c47e0a129487aa9bad3e9655ad15023df1ee3c209c (image=quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mgr.x) 2020-07-16T13:36:56.829 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Jul 16 13:36:56 smithi188 podman[3385]: 2020-07-16 13:36:56.639988107 +0000 UTC m=+0.651511708 container attach 2e95f416d8f01e0a18b9d7c47e0a129487aa9bad3e9655ad15023df1ee3c209c (image=quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mgr.x) 2020-07-16T13:36:56.829 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Jul 16 13:36:56 smithi188 bash[3383]: debug 2020-07-16T13:36:56.634+0000 7f266f08f380 1 -- 172.21.15.188:0/2303338761 shutdown_connections 2020-07-16T13:36:56.829 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Jul 16 13:36:56 smithi188 bash[3383]: debug 2020-07-16T13:36:56.634+0000 7f266f08f380 1 --2- 172.21.15.188:0/2303338761 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55d751f0d400 0x55d751f90300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-07-16T13:36:56.830 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Jul 16 13:36:56 smithi188 bash[3383]: debug 2020-07-16T13:36:56.634+0000 7f266f08f380 1 --2- 172.21.15.188:0/2303338761 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d751f0cc00 0x55d751f8f900 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-07-16T13:36:56.830 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Jul 16 13:36:56 smithi188 bash[3383]: debug 2020-07-16T13:36:56.634+0000 7f266f08f380 1 --2- 172.21.15.188:0/2303338761 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d751f0d000 0x55d751f8fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-07-16T13:36:56.830 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Jul 16 13:36:56 smithi188 bash[3383]: debug 2020-07-16T13:36:56.634+0000 7f266f08f380 1 -- 172.21.15.188:0/2303338761 >> 172.21.15.188:0/2303338761 conn(0x55d751f0c800 msgr2=0x55d752b7e800 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T13:36:56.830 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Jul 16 13:36:56 smithi188 bash[3383]: debug 2020-07-16T13:36:56.634+0000 7f266f08f380 1 -- 172.21.15.188:0/2303338761 shutdown_connections 2020-07-16T13:36:56.830 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Jul 16 13:36:56 smithi188 bash[3383]: debug 2020-07-16T13:36:56.634+0000 7f266f08f380 1 -- 172.21.15.188:0/2303338761 wait complete. 2020-07-16T13:36:57.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:36:56 smithi188 bash[23329]: cluster 2020-07-16T13:36:55.763181+0000 mgr.y (mgr.14140) 272 : cluster [DBG] pgmap v244: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:57.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:36:56 smithi188 bash[23329]: audit 2020-07-16T13:36:56.003909+0000 mon.a (mon.0) 577 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749702\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749809\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749837\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749865\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749892\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749920\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749947\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749974\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:36:57.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:36:56 smithi188 bash[23329]: audit 2020-07-16T13:36:56.007547+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749702\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749809\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749837\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749865\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749892\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749920\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749947\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749974\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:36:57.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:36:56 smithi188 bash[23329]: audit 2020-07-16T13:36:56.008353+0000 mon.a (mon.0) 579 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:36:57.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:36:56 smithi132 bash[23299]: cluster 2020-07-16T13:36:55.763181+0000 mgr.y (mgr.14140) 272 : cluster [DBG] pgmap v244: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:57.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:36:56 smithi132 bash[23299]: audit 2020-07-16T13:36:56.003909+0000 mon.a (mon.0) 577 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749702\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749809\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749837\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749865\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749892\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749920\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749947\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749974\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:36:57.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:36:56 smithi132 bash[23299]: audit 2020-07-16T13:36:56.007547+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749702\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749809\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749837\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749865\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749892\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749920\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749947\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749974\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:36:57.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:36:56 smithi132 bash[23299]: audit 2020-07-16T13:36:56.008353+0000 mon.a (mon.0) 579 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:36:57.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:36:56 smithi132 bash[27079]: cluster 2020-07-16T13:36:55.763181+0000 mgr.y (mgr.14140) 272 : cluster [DBG] pgmap v244: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:57.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:36:56 smithi132 bash[27079]: audit 2020-07-16T13:36:56.003909+0000 mon.a (mon.0) 577 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749702\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749809\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749837\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749865\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749892\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749920\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749947\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749974\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:36:57.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:36:56 smithi132 bash[27079]: audit 2020-07-16T13:36:56.007547+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749702\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749809\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749837\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749865\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749892\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749920\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749947\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:34:54.749974\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:36:57.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:36:56 smithi132 bash[27079]: audit 2020-07-16T13:36:56.008353+0000 mon.a (mon.0) 579 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:36:59.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:36:58 smithi188 bash[23329]: cluster 2020-07-16T13:36:57.763523+0000 mgr.y (mgr.14140) 273 : cluster [DBG] pgmap v245: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:59.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:36:58 smithi188 bash[23329]: audit 2020-07-16T13:36:58.806495+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:36:58.805226\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:36:58.805317\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:36:58.805353\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:36:58.805385\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:36:58.805416\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:36:58.805447\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:36:58.805478\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:36:58.805510\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:36:58.805541\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:36:58.805627\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:36:59.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:36:58 smithi188 bash[23329]: audit 2020-07-16T13:36:58.809831+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:36:58.805226\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:36:58.805317\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:36:58.805353\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:36:58.805385\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:36:58.805416\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:36:58.805447\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:36:58.805478\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:36:58.805510\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:36:58.805541\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:36:58.805627\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:36:59.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:36:58 smithi188 bash[23329]: audit 2020-07-16T13:36:58.812143+0000 mon.a (mon.0) 582 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T13:36:59.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:36:58 smithi188 bash[23329]: audit 2020-07-16T13:36:58.815873+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2020-07-16T13:36:59.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:36:58 smithi132 bash[27079]: cluster 2020-07-16T13:36:57.763523+0000 mgr.y (mgr.14140) 273 : cluster [DBG] pgmap v245: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:59.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:36:58 smithi132 bash[27079]: audit 2020-07-16T13:36:58.806495+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:36:58.805226\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:36:58.805317\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:36:58.805353\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:36:58.805385\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:36:58.805416\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:36:58.805447\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:36:58.805478\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:36:58.805510\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:36:58.805541\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:36:58.805627\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:36:59.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:36:58 smithi132 bash[27079]: audit 2020-07-16T13:36:58.809831+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:36:58.805226\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:36:58.805317\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:36:58.805353\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:36:58.805385\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:36:58.805416\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:36:58.805447\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:36:58.805478\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:36:58.805510\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:36:58.805541\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:36:58.805627\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:36:59.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:36:58 smithi132 bash[27079]: audit 2020-07-16T13:36:58.812143+0000 mon.a (mon.0) 582 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T13:36:59.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:36:58 smithi132 bash[27079]: audit 2020-07-16T13:36:58.815873+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2020-07-16T13:36:59.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:36:58 smithi132 bash[23299]: cluster 2020-07-16T13:36:57.763523+0000 mgr.y (mgr.14140) 273 : cluster [DBG] pgmap v245: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:36:59.282 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:36:58 smithi132 bash[23299]: audit 2020-07-16T13:36:58.806495+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:36:58.805226\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:36:58.805317\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:36:58.805353\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:36:58.805385\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:36:58.805416\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:36:58.805447\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:36:58.805478\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:36:58.805510\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:36:58.805541\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:36:58.805627\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:36:59.282 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:36:58 smithi132 bash[23299]: audit 2020-07-16T13:36:58.809831+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:36:58.805226\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:36:58.805317\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:36:58.805353\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:36:58.805385\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:36:58.805416\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:36:58.805447\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:36:58.805478\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:36:58.805510\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:36:58.805541\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:36:58.805627\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:36:59.282 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:36:58 smithi132 bash[23299]: audit 2020-07-16T13:36:58.812143+0000 mon.a (mon.0) 582 : audit [DBG] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T13:36:59.282 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:36:58 smithi132 bash[23299]: audit 2020-07-16T13:36:58.815873+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2020-07-16T13:37:00.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:36:59 smithi188 bash[23329]: cephadm 2020-07-16T13:36:58.811838+0000 mgr.y (mgr.14140) 274 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T13:37:00.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:36:59 smithi188 bash[23329]: cephadm 2020-07-16T13:36:58.813052+0000 mgr.y (mgr.14140) 275 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T13:37:00.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:36:59 smithi188 bash[23329]: cephadm 2020-07-16T13:36:58.813533+0000 mgr.y (mgr.14140) 276 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2020-07-16T13:37:00.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:36:59 smithi188 bash[23329]: cephadm 2020-07-16T13:36:58.815365+0000 mgr.y (mgr.14140) 277 : cephadm [INF] Upgrade: there are 1 other already-upgraded standby mgrs, failing over 2020-07-16T13:37:00.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:36:59 smithi188 bash[23329]: cluster 2020-07-16T13:36:58.827257+0000 mon.a (mon.0) 584 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2020-07-16T13:37:00.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:36:59 smithi188 bash[23329]: cluster 2020-07-16T13:36:59.156186+0000 mon.a (mon.0) 585 : cluster [DBG] Standby manager daemon y started 2020-07-16T13:37:00.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:36:59 smithi188 bash[23329]: audit 2020-07-16T13:36:59.815826+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2020-07-16T13:37:00.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:36:59 smithi188 bash[23329]: cluster 2020-07-16T13:36:59.815879+0000 mon.a (mon.0) 587 : cluster [DBG] mgrmap e15: x(active, starting, since 0.999454s), standbys: y 2020-07-16T13:37:00.285 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:36:59 smithi132 bash[23299]: cephadm 2020-07-16T13:36:58.811838+0000 mgr.y (mgr.14140) 274 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T13:37:00.286 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:36:59 smithi132 bash[23299]: cephadm 2020-07-16T13:36:58.813052+0000 mgr.y (mgr.14140) 275 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T13:37:00.286 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:36:59 smithi132 bash[23299]: cephadm 2020-07-16T13:36:58.813533+0000 mgr.y (mgr.14140) 276 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2020-07-16T13:37:00.287 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:36:59 smithi132 bash[23299]: cephadm 2020-07-16T13:36:58.815365+0000 mgr.y (mgr.14140) 277 : cephadm [INF] Upgrade: there are 1 other already-upgraded standby mgrs, failing over 2020-07-16T13:37:00.287 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:36:59 smithi132 bash[23299]: cluster 2020-07-16T13:36:58.827257+0000 mon.a (mon.0) 584 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2020-07-16T13:37:00.287 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:36:59 smithi132 bash[23299]: cluster 2020-07-16T13:36:59.156186+0000 mon.a (mon.0) 585 : cluster [DBG] Standby manager daemon y started 2020-07-16T13:37:00.288 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:36:59 smithi132 bash[23299]: audit 2020-07-16T13:36:59.815826+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2020-07-16T13:37:00.288 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:36:59 smithi132 bash[23299]: cluster 2020-07-16T13:36:59.815879+0000 mon.a (mon.0) 587 : cluster [DBG] mgrmap e15: x(active, starting, since 0.999454s), standbys: y 2020-07-16T13:37:00.288 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:36:59 smithi132 bash[23536]: ignoring --setuser ceph since I am not root 2020-07-16T13:37:00.289 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:36:59 smithi132 bash[23536]: ignoring --setgroup ceph since I am not root 2020-07-16T13:37:00.289 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:36:59 smithi132 bash[23536]: debug 2020-07-16T13:36:59.849+0000 7f8502f56040 -1 asok(0x561e8347c000) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/ceph-mgr.y.asok': (13) Permission denied 2020-07-16T13:37:00.289 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:36:59 smithi132 bash[27079]: cephadm 2020-07-16T13:36:58.811838+0000 mgr.y (mgr.14140) 274 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T13:37:00.290 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:36:59 smithi132 bash[27079]: cephadm 2020-07-16T13:36:58.813052+0000 mgr.y (mgr.14140) 275 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T13:37:00.291 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:36:59 smithi132 bash[27079]: cephadm 2020-07-16T13:36:58.813533+0000 mgr.y (mgr.14140) 276 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2020-07-16T13:37:00.291 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:36:59 smithi132 bash[27079]: cephadm 2020-07-16T13:36:58.815365+0000 mgr.y (mgr.14140) 277 : cephadm [INF] Upgrade: there are 1 other already-upgraded standby mgrs, failing over 2020-07-16T13:37:00.291 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:36:59 smithi132 bash[27079]: cluster 2020-07-16T13:36:58.827257+0000 mon.a (mon.0) 584 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2020-07-16T13:37:00.292 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:36:59 smithi132 bash[27079]: cluster 2020-07-16T13:36:59.156186+0000 mon.a (mon.0) 585 : cluster [DBG] Standby manager daemon y started 2020-07-16T13:37:00.292 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:36:59 smithi132 bash[27079]: audit 2020-07-16T13:36:59.815826+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.14140 172.21.15.132:0/3969750498' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2020-07-16T13:37:00.292 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:36:59 smithi132 bash[27079]: cluster 2020-07-16T13:36:59.815879+0000 mon.a (mon.0) 587 : cluster [DBG] mgrmap e15: x(active, starting, since 0.999454s), standbys: y 2020-07-16T13:37:01.106 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:00 smithi188 bash[23329]: cluster 2020-07-16T13:37:00.449899+0000 mon.a (mon.0) 588 : cluster [INF] Active manager daemon x restarted 2020-07-16T13:37:01.106 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:00 smithi188 bash[23329]: audit 2020-07-16T13:37:00.450086+0000 mon.b (mon.2) 22 : audit [DBG] from='mgr.? 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2020-07-16T13:37:01.107 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:00 smithi188 bash[23329]: cluster 2020-07-16T13:37:00.450446+0000 mon.a (mon.0) 589 : cluster [INF] Activating manager daemon x 2020-07-16T13:37:01.107 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:00 smithi188 bash[23329]: cluster 2020-07-16T13:37:00.453185+0000 mon.a (mon.0) 590 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2020-07-16T13:37:01.107 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:00 smithi188 bash[23329]: audit 2020-07-16T13:37:00.453316+0000 mon.b (mon.2) 23 : audit [DBG] from='mgr.? 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2020-07-16T13:37:01.107 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Jul 16 13:37:01 smithi188 bash[3383]: Warning: Permanently added 'smithi132,172.21.15.132' (ECDSA) to the list of known hosts. 2020-07-16T13:37:01.108 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Jul 16 13:37:01 smithi188 bash[3383]: Warning: Permanently added 'smithi188,172.21.15.188' (ECDSA) to the list of known hosts. 2020-07-16T13:37:01.112 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:00 smithi132 bash[23299]: cluster 2020-07-16T13:37:00.449899+0000 mon.a (mon.0) 588 : cluster [INF] Active manager daemon x restarted 2020-07-16T13:37:01.112 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:00 smithi132 bash[23299]: audit 2020-07-16T13:37:00.450086+0000 mon.b (mon.2) 22 : audit [DBG] from='mgr.? 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2020-07-16T13:37:01.112 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:00 smithi132 bash[23299]: cluster 2020-07-16T13:37:00.450446+0000 mon.a (mon.0) 589 : cluster [INF] Activating manager daemon x 2020-07-16T13:37:01.112 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:00 smithi132 bash[23299]: cluster 2020-07-16T13:37:00.453185+0000 mon.a (mon.0) 590 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2020-07-16T13:37:01.113 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:00 smithi132 bash[23299]: audit 2020-07-16T13:37:00.453316+0000 mon.b (mon.2) 23 : audit [DBG] from='mgr.? 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2020-07-16T13:37:01.113 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:00 smithi132 bash[27079]: cluster 2020-07-16T13:37:00.449899+0000 mon.a (mon.0) 588 : cluster [INF] Active manager daemon x restarted 2020-07-16T13:37:01.113 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:00 smithi132 bash[27079]: audit 2020-07-16T13:37:00.450086+0000 mon.b (mon.2) 22 : audit [DBG] from='mgr.? 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2020-07-16T13:37:01.113 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:00 smithi132 bash[27079]: cluster 2020-07-16T13:37:00.450446+0000 mon.a (mon.0) 589 : cluster [INF] Activating manager daemon x 2020-07-16T13:37:01.113 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:00 smithi132 bash[27079]: cluster 2020-07-16T13:37:00.453185+0000 mon.a (mon.0) 590 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2020-07-16T13:37:01.114 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:00 smithi132 bash[27079]: audit 2020-07-16T13:37:00.453316+0000 mon.b (mon.2) 23 : audit [DBG] from='mgr.? 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2020-07-16T13:37:02.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[27079]: cluster 2020-07-16T13:37:00.843550+0000 mon.a (mon.0) 591 : cluster [DBG] mgrmap e16: x(active, starting, since 0.393212s), standbys: y 2020-07-16T13:37:02.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[27079]: audit 2020-07-16T13:37:00.847852+0000 mon.b (mon.2) 24 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2020-07-16T13:37:02.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[27079]: audit 2020-07-16T13:37:00.848077+0000 mon.b (mon.2) 25 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2020-07-16T13:37:02.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[27079]: audit 2020-07-16T13:37:00.848261+0000 mon.b (mon.2) 26 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-07-16T13:37:02.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[27079]: audit 2020-07-16T13:37:00.848500+0000 mon.b (mon.2) 27 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2020-07-16T13:37:02.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[27079]: audit 2020-07-16T13:37:00.848707+0000 mon.b (mon.2) 28 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-07-16T13:37:02.033 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[27079]: audit 2020-07-16T13:37:00.848888+0000 mon.b (mon.2) 29 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-07-16T13:37:02.035 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[27079]: audit 2020-07-16T13:37:00.849073+0000 mon.b (mon.2) 30 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-07-16T13:37:02.035 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[27079]: audit 2020-07-16T13:37:00.849253+0000 mon.b (mon.2) 31 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-07-16T13:37:02.035 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[27079]: audit 2020-07-16T13:37:00.849454+0000 mon.b (mon.2) 32 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2020-07-16T13:37:02.036 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[27079]: audit 2020-07-16T13:37:00.849649+0000 mon.b (mon.2) 33 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2020-07-16T13:37:02.036 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[27079]: audit 2020-07-16T13:37:00.850249+0000 mon.b (mon.2) 34 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2020-07-16T13:37:02.036 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[27079]: audit 2020-07-16T13:37:00.850491+0000 mon.b (mon.2) 35 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2020-07-16T13:37:02.037 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[27079]: audit 2020-07-16T13:37:00.850916+0000 mon.b (mon.2) 36 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2020-07-16T13:37:02.037 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[27079]: audit 2020-07-16T13:37:00.851551+0000 mon.b (mon.2) 37 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key ls"}]: dispatch 2020-07-16T13:37:02.037 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[27079]: audit 2020-07-16T13:37:00.852113+0000 mon.b (mon.2) 38 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2020-07-16T13:37:02.038 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[27079]: audit 2020-07-16T13:37:00.852316+0000 mon.b (mon.2) 39 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2020-07-16T13:37:02.038 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[27079]: audit 2020-07-16T13:37:00.852529+0000 mon.b (mon.2) 40 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi132"}]: dispatch 2020-07-16T13:37:02.038 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[27079]: audit 2020-07-16T13:37:00.852743+0000 mon.b (mon.2) 41 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi188"}]: dispatch 2020-07-16T13:37:02.039 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[27079]: audit 2020-07-16T13:37:00.852934+0000 mon.b (mon.2) 42 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2020-07-16T13:37:02.039 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[27079]: audit 2020-07-16T13:37:00.853140+0000 mon.b (mon.2) 43 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2020-07-16T13:37:02.039 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[27079]: audit 2020-07-16T13:37:00.853342+0000 mon.b (mon.2) 44 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2020-07-16T13:37:02.040 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[27079]: audit 2020-07-16T13:37:00.853545+0000 mon.b (mon.2) 45 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2020-07-16T13:37:02.040 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[27079]: audit 2020-07-16T13:37:00.853736+0000 mon.b (mon.2) 46 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2020-07-16T13:37:02.040 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[27079]: audit 2020-07-16T13:37:00.853917+0000 mon.b (mon.2) 47 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2020-07-16T13:37:02.041 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[27079]: audit 2020-07-16T13:37:00.854098+0000 mon.b (mon.2) 48 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2020-07-16T13:37:02.041 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[27079]: audit 2020-07-16T13:37:00.854301+0000 mon.b (mon.2) 49 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2020-07-16T13:37:02.041 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[27079]: audit 2020-07-16T13:37:00.854488+0000 mon.b (mon.2) 50 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2020-07-16T13:37:02.049 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[27079]: audit 2020-07-16T13:37:00.854665+0000 mon.b (mon.2) 51 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2020-07-16T13:37:02.049 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[27079]: audit 2020-07-16T13:37:00.854847+0000 mon.b (mon.2) 52 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2020-07-16T13:37:02.049 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[27079]: audit 2020-07-16T13:37:00.855020+0000 mon.b (mon.2) 53 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2020-07-16T13:37:02.050 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[27079]: audit 2020-07-16T13:37:00.855213+0000 mon.b (mon.2) 54 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2020-07-16T13:37:02.050 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[27079]: audit 2020-07-16T13:37:00.855403+0000 mon.b (mon.2) 55 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2020-07-16T13:37:02.050 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[27079]: audit 2020-07-16T13:37:00.855581+0000 mon.b (mon.2) 56 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2020-07-16T13:37:02.050 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[27079]: audit 2020-07-16T13:37:00.855757+0000 mon.b (mon.2) 57 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2020-07-16T13:37:02.050 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[27079]: cluster 2020-07-16T13:37:00.859409+0000 mon.a (mon.0) 592 : cluster [INF] Manager daemon x is now available 2020-07-16T13:37:02.051 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[27079]: audit 2020-07-16T13:37:00.867372+0000 mon.b (mon.2) 58 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix":"config set","value":"0","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2020-07-16T13:37:02.051 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[27079]: audit 2020-07-16T13:37:00.867695+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"0","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2020-07-16T13:37:02.052 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[27079]: audit 2020-07-16T13:37:00.871641+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"0","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2020-07-16T13:37:02.052 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[27079]: cephadm 2020-07-16T13:37:00.872427+0000 mgr.x (mgr.34499) 1 : cephadm [INF] Unable to migrate yet. Daemon Cache still incomplete. 2020-07-16T13:37:02.052 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[27079]: audit 2020-07-16T13:37:01.268101+0000 mon.b (mon.2) 59 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:37:02.052 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[27079]: audit 2020-07-16T13:37:01.275968+0000 mon.b (mon.2) 60 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:37:02.053 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[23299]: cluster 2020-07-16T13:37:00.843550+0000 mon.a (mon.0) 591 : cluster [DBG] mgrmap e16: x(active, starting, since 0.393212s), standbys: y 2020-07-16T13:37:02.053 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[23299]: audit 2020-07-16T13:37:00.847852+0000 mon.b (mon.2) 24 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2020-07-16T13:37:02.053 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[23299]: audit 2020-07-16T13:37:00.848077+0000 mon.b (mon.2) 25 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2020-07-16T13:37:02.054 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[23299]: audit 2020-07-16T13:37:00.848261+0000 mon.b (mon.2) 26 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-07-16T13:37:02.054 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[23299]: audit 2020-07-16T13:37:00.848500+0000 mon.b (mon.2) 27 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2020-07-16T13:37:02.054 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[23299]: audit 2020-07-16T13:37:00.848707+0000 mon.b (mon.2) 28 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-07-16T13:37:02.055 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[23299]: audit 2020-07-16T13:37:00.848888+0000 mon.b (mon.2) 29 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-07-16T13:37:02.055 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[23299]: audit 2020-07-16T13:37:00.849073+0000 mon.b (mon.2) 30 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-07-16T13:37:02.055 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[23299]: audit 2020-07-16T13:37:00.849253+0000 mon.b (mon.2) 31 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-07-16T13:37:02.055 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[23299]: audit 2020-07-16T13:37:00.849454+0000 mon.b (mon.2) 32 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2020-07-16T13:37:02.055 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[23299]: audit 2020-07-16T13:37:00.849649+0000 mon.b (mon.2) 33 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2020-07-16T13:37:02.056 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[23299]: audit 2020-07-16T13:37:00.850249+0000 mon.b (mon.2) 34 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2020-07-16T13:37:02.056 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[23299]: audit 2020-07-16T13:37:00.850491+0000 mon.b (mon.2) 35 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2020-07-16T13:37:02.056 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[23299]: audit 2020-07-16T13:37:00.850916+0000 mon.b (mon.2) 36 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2020-07-16T13:37:02.056 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[23299]: audit 2020-07-16T13:37:00.851551+0000 mon.b (mon.2) 37 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key ls"}]: dispatch 2020-07-16T13:37:02.056 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[23299]: audit 2020-07-16T13:37:00.852113+0000 mon.b (mon.2) 38 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2020-07-16T13:37:02.057 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[23299]: audit 2020-07-16T13:37:00.852316+0000 mon.b (mon.2) 39 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2020-07-16T13:37:02.057 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[23299]: audit 2020-07-16T13:37:00.852529+0000 mon.b (mon.2) 40 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi132"}]: dispatch 2020-07-16T13:37:02.057 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[23299]: audit 2020-07-16T13:37:00.852743+0000 mon.b (mon.2) 41 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi188"}]: dispatch 2020-07-16T13:37:02.057 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[23299]: audit 2020-07-16T13:37:00.852934+0000 mon.b (mon.2) 42 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2020-07-16T13:37:02.057 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[23299]: audit 2020-07-16T13:37:00.853140+0000 mon.b (mon.2) 43 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2020-07-16T13:37:02.059 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[23299]: audit 2020-07-16T13:37:00.853342+0000 mon.b (mon.2) 44 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2020-07-16T13:37:02.059 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[23299]: audit 2020-07-16T13:37:00.853545+0000 mon.b (mon.2) 45 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2020-07-16T13:37:02.060 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[23299]: audit 2020-07-16T13:37:00.853736+0000 mon.b (mon.2) 46 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2020-07-16T13:37:02.060 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[23299]: audit 2020-07-16T13:37:00.853917+0000 mon.b (mon.2) 47 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2020-07-16T13:37:02.060 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[23299]: audit 2020-07-16T13:37:00.854098+0000 mon.b (mon.2) 48 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2020-07-16T13:37:02.069 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[23299]: audit 2020-07-16T13:37:00.854301+0000 mon.b (mon.2) 49 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2020-07-16T13:37:02.084 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[23299]: audit 2020-07-16T13:37:00.854488+0000 mon.b (mon.2) 50 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2020-07-16T13:37:02.084 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[23299]: audit 2020-07-16T13:37:00.854665+0000 mon.b (mon.2) 51 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2020-07-16T13:37:02.084 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[23299]: audit 2020-07-16T13:37:00.854847+0000 mon.b (mon.2) 52 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2020-07-16T13:37:02.084 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[23299]: audit 2020-07-16T13:37:00.855020+0000 mon.b (mon.2) 53 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2020-07-16T13:37:02.085 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[23299]: audit 2020-07-16T13:37:00.855213+0000 mon.b (mon.2) 54 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2020-07-16T13:37:02.085 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[23299]: audit 2020-07-16T13:37:00.855403+0000 mon.b (mon.2) 55 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2020-07-16T13:37:02.085 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[23299]: audit 2020-07-16T13:37:00.855581+0000 mon.b (mon.2) 56 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2020-07-16T13:37:02.085 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[23299]: audit 2020-07-16T13:37:00.855757+0000 mon.b (mon.2) 57 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2020-07-16T13:37:02.085 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[23299]: cluster 2020-07-16T13:37:00.859409+0000 mon.a (mon.0) 592 : cluster [INF] Manager daemon x is now available 2020-07-16T13:37:02.086 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[23299]: audit 2020-07-16T13:37:00.867372+0000 mon.b (mon.2) 58 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix":"config set","value":"0","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2020-07-16T13:37:02.086 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[23299]: audit 2020-07-16T13:37:00.867695+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"0","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2020-07-16T13:37:02.086 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[23299]: audit 2020-07-16T13:37:00.871641+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"0","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2020-07-16T13:37:02.086 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[23299]: cephadm 2020-07-16T13:37:00.872427+0000 mgr.x (mgr.34499) 1 : cephadm [INF] Unable to migrate yet. Daemon Cache still incomplete. 2020-07-16T13:37:02.086 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[23299]: audit 2020-07-16T13:37:01.268101+0000 mon.b (mon.2) 59 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:37:02.087 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:01 smithi132 bash[23299]: audit 2020-07-16T13:37:01.275968+0000 mon.b (mon.2) 60 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:37:02.156 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:01 smithi188 bash[23329]: cluster 2020-07-16T13:37:00.843550+0000 mon.a (mon.0) 591 : cluster [DBG] mgrmap e16: x(active, starting, since 0.393212s), standbys: y 2020-07-16T13:37:02.157 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:01 smithi188 bash[23329]: audit 2020-07-16T13:37:00.847852+0000 mon.b (mon.2) 24 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2020-07-16T13:37:02.157 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:01 smithi188 bash[23329]: audit 2020-07-16T13:37:00.848077+0000 mon.b (mon.2) 25 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2020-07-16T13:37:02.157 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:01 smithi188 bash[23329]: audit 2020-07-16T13:37:00.848261+0000 mon.b (mon.2) 26 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-07-16T13:37:02.157 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:01 smithi188 bash[23329]: audit 2020-07-16T13:37:00.848500+0000 mon.b (mon.2) 27 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2020-07-16T13:37:02.158 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:01 smithi188 bash[23329]: audit 2020-07-16T13:37:00.848707+0000 mon.b (mon.2) 28 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-07-16T13:37:02.158 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:01 smithi188 bash[23329]: audit 2020-07-16T13:37:00.848888+0000 mon.b (mon.2) 29 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-07-16T13:37:02.158 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:01 smithi188 bash[23329]: audit 2020-07-16T13:37:00.849073+0000 mon.b (mon.2) 30 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-07-16T13:37:02.158 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:01 smithi188 bash[23329]: audit 2020-07-16T13:37:00.849253+0000 mon.b (mon.2) 31 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-07-16T13:37:02.158 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:01 smithi188 bash[23329]: audit 2020-07-16T13:37:00.849454+0000 mon.b (mon.2) 32 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2020-07-16T13:37:02.159 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:01 smithi188 bash[23329]: audit 2020-07-16T13:37:00.849649+0000 mon.b (mon.2) 33 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2020-07-16T13:37:02.159 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:01 smithi188 bash[23329]: audit 2020-07-16T13:37:00.850249+0000 mon.b (mon.2) 34 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2020-07-16T13:37:02.159 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:01 smithi188 bash[23329]: audit 2020-07-16T13:37:00.850491+0000 mon.b (mon.2) 35 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2020-07-16T13:37:02.159 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:01 smithi188 bash[23329]: audit 2020-07-16T13:37:00.850916+0000 mon.b (mon.2) 36 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2020-07-16T13:37:02.159 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:01 smithi188 bash[23329]: audit 2020-07-16T13:37:00.851551+0000 mon.b (mon.2) 37 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key ls"}]: dispatch 2020-07-16T13:37:02.159 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:01 smithi188 bash[23329]: audit 2020-07-16T13:37:00.852113+0000 mon.b (mon.2) 38 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2020-07-16T13:37:02.160 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:01 smithi188 bash[23329]: audit 2020-07-16T13:37:00.852316+0000 mon.b (mon.2) 39 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2020-07-16T13:37:02.160 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:01 smithi188 bash[23329]: audit 2020-07-16T13:37:00.852529+0000 mon.b (mon.2) 40 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi132"}]: dispatch 2020-07-16T13:37:02.160 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:01 smithi188 bash[23329]: audit 2020-07-16T13:37:00.852743+0000 mon.b (mon.2) 41 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi188"}]: dispatch 2020-07-16T13:37:02.160 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:01 smithi188 bash[23329]: audit 2020-07-16T13:37:00.852934+0000 mon.b (mon.2) 42 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2020-07-16T13:37:02.160 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:01 smithi188 bash[23329]: audit 2020-07-16T13:37:00.853140+0000 mon.b (mon.2) 43 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2020-07-16T13:37:02.161 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:01 smithi188 bash[23329]: audit 2020-07-16T13:37:00.853342+0000 mon.b (mon.2) 44 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2020-07-16T13:37:02.161 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:01 smithi188 bash[23329]: audit 2020-07-16T13:37:00.853545+0000 mon.b (mon.2) 45 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2020-07-16T13:37:02.162 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:01 smithi188 bash[23329]: audit 2020-07-16T13:37:00.853736+0000 mon.b (mon.2) 46 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2020-07-16T13:37:02.162 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:01 smithi188 bash[23329]: audit 2020-07-16T13:37:00.853917+0000 mon.b (mon.2) 47 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2020-07-16T13:37:02.162 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:01 smithi188 bash[23329]: audit 2020-07-16T13:37:00.854098+0000 mon.b (mon.2) 48 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2020-07-16T13:37:02.162 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:01 smithi188 bash[23329]: audit 2020-07-16T13:37:00.854301+0000 mon.b (mon.2) 49 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2020-07-16T13:37:02.162 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:01 smithi188 bash[23329]: audit 2020-07-16T13:37:00.854488+0000 mon.b (mon.2) 50 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2020-07-16T13:37:02.163 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:01 smithi188 bash[23329]: audit 2020-07-16T13:37:00.854665+0000 mon.b (mon.2) 51 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2020-07-16T13:37:02.163 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:01 smithi188 bash[23329]: audit 2020-07-16T13:37:00.854847+0000 mon.b (mon.2) 52 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2020-07-16T13:37:02.163 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:01 smithi188 bash[23329]: audit 2020-07-16T13:37:00.855020+0000 mon.b (mon.2) 53 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2020-07-16T13:37:02.163 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:01 smithi188 bash[23329]: audit 2020-07-16T13:37:00.855213+0000 mon.b (mon.2) 54 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2020-07-16T13:37:02.163 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:01 smithi188 bash[23329]: audit 2020-07-16T13:37:00.855403+0000 mon.b (mon.2) 55 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2020-07-16T13:37:02.163 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:01 smithi188 bash[23329]: audit 2020-07-16T13:37:00.855581+0000 mon.b (mon.2) 56 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2020-07-16T13:37:02.164 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:01 smithi188 bash[23329]: audit 2020-07-16T13:37:00.855757+0000 mon.b (mon.2) 57 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2020-07-16T13:37:02.164 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:01 smithi188 bash[23329]: cluster 2020-07-16T13:37:00.859409+0000 mon.a (mon.0) 592 : cluster [INF] Manager daemon x is now available 2020-07-16T13:37:02.164 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:01 smithi188 bash[23329]: audit 2020-07-16T13:37:00.867372+0000 mon.b (mon.2) 58 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix":"config set","value":"0","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2020-07-16T13:37:02.164 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:01 smithi188 bash[23329]: audit 2020-07-16T13:37:00.867695+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"0","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2020-07-16T13:37:02.164 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:01 smithi188 bash[23329]: audit 2020-07-16T13:37:00.871641+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"0","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2020-07-16T13:37:02.165 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:01 smithi188 bash[23329]: cephadm 2020-07-16T13:37:00.872427+0000 mgr.x (mgr.34499) 1 : cephadm [INF] Unable to migrate yet. Daemon Cache still incomplete. 2020-07-16T13:37:02.165 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:01 smithi188 bash[23329]: audit 2020-07-16T13:37:01.268101+0000 mon.b (mon.2) 59 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:37:02.165 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:01 smithi188 bash[23329]: audit 2020-07-16T13:37:01.275968+0000 mon.b (mon.2) 60 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:37:03.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:02 smithi132 bash[27079]: cluster 2020-07-16T13:37:01.855183+0000 mon.a (mon.0) 595 : cluster [DBG] mgrmap e17: x(active, since 1.40484s), standbys: y 2020-07-16T13:37:03.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:02 smithi132 bash[27079]: cluster 2020-07-16T13:37:01.859547+0000 mgr.x (mgr.34499) 2 : cluster [DBG] pgmap v3: 1 pgs: 1 active+clean; 0 B data, 4.1 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:37:03.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:02 smithi132 bash[23299]: cluster 2020-07-16T13:37:01.855183+0000 mon.a (mon.0) 595 : cluster [DBG] mgrmap e17: x(active, since 1.40484s), standbys: y 2020-07-16T13:37:03.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:02 smithi132 bash[23299]: cluster 2020-07-16T13:37:01.859547+0000 mgr.x (mgr.34499) 2 : cluster [DBG] pgmap v3: 1 pgs: 1 active+clean; 0 B data, 4.1 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:37:03.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:02 smithi188 bash[23329]: cluster 2020-07-16T13:37:01.855183+0000 mon.a (mon.0) 595 : cluster [DBG] mgrmap e17: x(active, since 1.40484s), standbys: y 2020-07-16T13:37:03.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:02 smithi188 bash[23329]: cluster 2020-07-16T13:37:01.859547+0000 mgr.x (mgr.34499) 2 : cluster [DBG] pgmap v3: 1 pgs: 1 active+clean; 0 B data, 4.1 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:37:04.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:03 smithi188 bash[23329]: cluster 2020-07-16T13:37:02.850377+0000 mgr.x (mgr.34499) 3 : cluster [DBG] pgmap v4: 1 pgs: 1 active+clean; 0 B data, 4.1 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:37:04.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:03 smithi188 bash[23329]: cluster 2020-07-16T13:37:02.864729+0000 mon.a (mon.0) 596 : cluster [DBG] mgrmap e18: x(active, since 2s), standbys: y 2020-07-16T13:37:04.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:03 smithi188 bash[23329]: audit 2020-07-16T13:37:03.291944+0000 mon.b (mon.2) 61 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290390\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290485\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290519\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290549\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290723\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290827\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290927\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291025\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"83de891fa91c\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291076\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:34:42.059327\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2020-07-16T13:34:37.094927\"}}, \"last_daemon_update\": \"2020-07-16T13:37:03.291157\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:37:04.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:03 smithi188 bash[23329]: audit 2020-07-16T13:37:03.292667+0000 mon.a (mon.0) 597 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290390\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290485\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290519\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290549\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290723\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290827\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290927\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291025\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"83de891fa91c\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291076\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:34:42.059327\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2020-07-16T13:34:37.094927\"}}, \"last_daemon_update\": \"2020-07-16T13:37:03.291157\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:37:04.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:03 smithi188 bash[23329]: audit 2020-07-16T13:37:03.295494+0000 mon.a (mon.0) 598 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290390\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290485\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290519\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290549\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290723\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290827\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290927\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291025\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"83de891fa91c\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291076\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:34:42.059327\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2020-07-16T13:34:37.094927\"}}, \"last_daemon_update\": \"2020-07-16T13:37:03.291157\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:37:04.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:03 smithi188 bash[23329]: cluster 2020-07-16T13:37:03.545984+0000 mon.a (mon.0) 599 : cluster [DBG] Standby manager daemon y restarted 2020-07-16T13:37:04.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:03 smithi188 bash[23329]: cluster 2020-07-16T13:37:03.546088+0000 mon.a (mon.0) 600 : cluster [DBG] Standby manager daemon y started 2020-07-16T13:37:04.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:03 smithi188 bash[23329]: audit 2020-07-16T13:37:03.546596+0000 mon.c (mon.1) 23 : audit [DBG] from='mgr.? 172.21.15.132:0/1949936463' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2020-07-16T13:37:04.175 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:03 smithi188 bash[23329]: audit 2020-07-16T13:37:03.549230+0000 mon.c (mon.1) 24 : audit [DBG] from='mgr.? 172.21.15.132:0/1949936463' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2020-07-16T13:37:04.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:03 smithi132 bash[27079]: cluster 2020-07-16T13:37:02.850377+0000 mgr.x (mgr.34499) 3 : cluster [DBG] pgmap v4: 1 pgs: 1 active+clean; 0 B data, 4.1 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:37:04.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:03 smithi132 bash[27079]: cluster 2020-07-16T13:37:02.864729+0000 mon.a (mon.0) 596 : cluster [DBG] mgrmap e18: x(active, since 2s), standbys: y 2020-07-16T13:37:04.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:03 smithi132 bash[27079]: audit 2020-07-16T13:37:03.291944+0000 mon.b (mon.2) 61 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290390\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290485\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290519\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290549\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290723\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290827\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290927\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291025\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"83de891fa91c\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291076\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:34:42.059327\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2020-07-16T13:34:37.094927\"}}, \"last_daemon_update\": \"2020-07-16T13:37:03.291157\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:37:04.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:03 smithi132 bash[27079]: audit 2020-07-16T13:37:03.292667+0000 mon.a (mon.0) 597 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290390\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290485\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290519\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290549\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290723\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290827\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290927\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291025\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"83de891fa91c\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291076\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:34:42.059327\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2020-07-16T13:34:37.094927\"}}, \"last_daemon_update\": \"2020-07-16T13:37:03.291157\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:37:04.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:03 smithi132 bash[27079]: audit 2020-07-16T13:37:03.295494+0000 mon.a (mon.0) 598 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290390\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290485\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290519\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290549\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290723\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290827\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290927\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291025\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"83de891fa91c\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291076\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:34:42.059327\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2020-07-16T13:34:37.094927\"}}, \"last_daemon_update\": \"2020-07-16T13:37:03.291157\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:37:04.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:03 smithi132 bash[27079]: cluster 2020-07-16T13:37:03.545984+0000 mon.a (mon.0) 599 : cluster [DBG] Standby manager daemon y restarted 2020-07-16T13:37:04.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:03 smithi132 bash[27079]: cluster 2020-07-16T13:37:03.546088+0000 mon.a (mon.0) 600 : cluster [DBG] Standby manager daemon y started 2020-07-16T13:37:04.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:03 smithi132 bash[27079]: audit 2020-07-16T13:37:03.546596+0000 mon.c (mon.1) 23 : audit [DBG] from='mgr.? 172.21.15.132:0/1949936463' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2020-07-16T13:37:04.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:03 smithi132 bash[27079]: audit 2020-07-16T13:37:03.549230+0000 mon.c (mon.1) 24 : audit [DBG] from='mgr.? 172.21.15.132:0/1949936463' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2020-07-16T13:37:04.283 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:03 smithi132 bash[23299]: cluster 2020-07-16T13:37:02.850377+0000 mgr.x (mgr.34499) 3 : cluster [DBG] pgmap v4: 1 pgs: 1 active+clean; 0 B data, 4.1 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:37:04.283 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:03 smithi132 bash[23299]: cluster 2020-07-16T13:37:02.864729+0000 mon.a (mon.0) 596 : cluster [DBG] mgrmap e18: x(active, since 2s), standbys: y 2020-07-16T13:37:04.283 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:03 smithi132 bash[23299]: audit 2020-07-16T13:37:03.291944+0000 mon.b (mon.2) 61 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290390\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290485\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290519\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290549\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290723\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290827\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290927\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291025\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"83de891fa91c\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291076\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:34:42.059327\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2020-07-16T13:34:37.094927\"}}, \"last_daemon_update\": \"2020-07-16T13:37:03.291157\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:37:04.283 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:03 smithi132 bash[23299]: audit 2020-07-16T13:37:03.292667+0000 mon.a (mon.0) 597 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290390\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290485\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290519\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290549\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290723\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290827\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290927\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291025\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"83de891fa91c\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291076\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:34:42.059327\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2020-07-16T13:34:37.094927\"}}, \"last_daemon_update\": \"2020-07-16T13:37:03.291157\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:37:04.284 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:03 smithi132 bash[23299]: audit 2020-07-16T13:37:03.295494+0000 mon.a (mon.0) 598 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290390\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290485\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290519\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290549\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290723\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290827\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290927\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291025\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"83de891fa91c\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291076\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:34:42.059327\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2020-07-16T13:34:37.094927\"}}, \"last_daemon_update\": \"2020-07-16T13:37:03.291157\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:37:04.284 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:03 smithi132 bash[23299]: cluster 2020-07-16T13:37:03.545984+0000 mon.a (mon.0) 599 : cluster [DBG] Standby manager daemon y restarted 2020-07-16T13:37:04.284 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:03 smithi132 bash[23299]: cluster 2020-07-16T13:37:03.546088+0000 mon.a (mon.0) 600 : cluster [DBG] Standby manager daemon y started 2020-07-16T13:37:04.284 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:03 smithi132 bash[23299]: audit 2020-07-16T13:37:03.546596+0000 mon.c (mon.1) 23 : audit [DBG] from='mgr.? 172.21.15.132:0/1949936463' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2020-07-16T13:37:04.285 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:03 smithi132 bash[23299]: audit 2020-07-16T13:37:03.549230+0000 mon.c (mon.1) 24 : audit [DBG] from='mgr.? 172.21.15.132:0/1949936463' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2020-07-16T13:37:05.031 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:04 smithi132 bash[23299]: audit 2020-07-16T13:37:03.948850+0000 mon.b (mon.2) 62 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947274\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947371\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947404\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947567\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947718\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947821\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947920\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947954\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947982\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:37:03.948054\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:37:05.032 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:04 smithi132 bash[23299]: audit 2020-07-16T13:37:03.949547+0000 mon.a (mon.0) 601 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947274\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947371\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947404\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947567\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947718\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947821\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947920\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947954\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947982\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:37:03.948054\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:37:05.032 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:04 smithi132 bash[23299]: audit 2020-07-16T13:37:03.951984+0000 mon.a (mon.0) 602 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947274\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947371\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947404\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947567\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947718\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947821\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947920\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947954\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947982\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:37:03.948054\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:37:05.033 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:04 smithi132 bash[23299]: cephadm 2020-07-16T13:37:03.953339+0000 mgr.x (mgr.34499) 4 : cephadm [INF] Migrating to explicit placement 2020-07-16T13:37:05.033 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:04 smithi132 bash[23299]: audit 2020-07-16T13:37:03.953582+0000 mon.b (mon.2) 63 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2020-07-16T13:37:03.953349\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi132\", \"name\": \"\", \"network\": \"\"}, {\"hostname\": \"smithi188\", \"name\": \"x\", \"network\": \"\"}]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]: dispatch 2020-07-16T13:37:05.034 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:04 smithi132 bash[23299]: audit 2020-07-16T13:37:03.953868+0000 mon.a (mon.0) 603 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2020-07-16T13:37:03.953349\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi132\", \"name\": \"\", \"network\": \"\"}, {\"hostname\": \"smithi188\", \"name\": \"x\", \"network\": \"\"}]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]: dispatch 2020-07-16T13:37:05.034 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:04 smithi132 bash[23299]: audit 2020-07-16T13:37:03.956283+0000 mon.a (mon.0) 604 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2020-07-16T13:37:03.953349\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi132\", \"name\": \"\", \"network\": \"\"}, {\"hostname\": \"smithi188\", \"name\": \"x\", \"network\": \"\"}]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]': finished 2020-07-16T13:37:05.034 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:04 smithi132 bash[23299]: audit 2020-07-16T13:37:03.956970+0000 mon.b (mon.2) 64 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix":"config set","value":"1","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2020-07-16T13:37:05.035 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:04 smithi132 bash[23299]: audit 2020-07-16T13:37:03.957227+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"1","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2020-07-16T13:37:05.035 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:04 smithi132 bash[23299]: audit 2020-07-16T13:37:03.960560+0000 mon.a (mon.0) 606 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"1","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2020-07-16T13:37:05.035 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:04 smithi132 bash[23299]: cephadm 2020-07-16T13:37:03.963090+0000 mgr.x (mgr.34499) 5 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2020-07-16T13:37:05.036 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:04 smithi132 bash[23299]: audit 2020-07-16T13:37:03.963340+0000 mon.b (mon.2) 65 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2020-07-16T13:37:05.036 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:04 smithi132 bash[23299]: audit 2020-07-16T13:37:03.964007+0000 mon.b (mon.2) 66 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:37:05.036 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:04 smithi132 bash[23299]: cephadm 2020-07-16T13:37:03.964564+0000 mgr.x (mgr.34499) 6 : cephadm [INF] Reconfiguring daemon mon.a on smithi132 2020-07-16T13:37:05.037 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:04 smithi132 bash[23299]: audit 2020-07-16T13:37:03.964843+0000 mon.b (mon.2) 67 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon.a", "key": "container_image"}]: dispatch 2020-07-16T13:37:05.037 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:04 smithi132 bash[23299]: cluster 2020-07-16T13:37:04.299142+0000 mon.a (mon.0) 607 : cluster [DBG] mgrmap e19: x(active, since 3s), standbys: y 2020-07-16T13:37:05.042 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:04 smithi132 bash[27079]: audit 2020-07-16T13:37:03.948850+0000 mon.b (mon.2) 62 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947274\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947371\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947404\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947567\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947718\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947821\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947920\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947954\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947982\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:37:03.948054\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:37:05.042 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:04 smithi132 bash[27079]: audit 2020-07-16T13:37:03.949547+0000 mon.a (mon.0) 601 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947274\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947371\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947404\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947567\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947718\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947821\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947920\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947954\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947982\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:37:03.948054\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:37:05.043 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:04 smithi132 bash[27079]: audit 2020-07-16T13:37:03.951984+0000 mon.a (mon.0) 602 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947274\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947371\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947404\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947567\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947718\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947821\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947920\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947954\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947982\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:37:03.948054\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:37:05.043 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:04 smithi132 bash[27079]: cephadm 2020-07-16T13:37:03.953339+0000 mgr.x (mgr.34499) 4 : cephadm [INF] Migrating to explicit placement 2020-07-16T13:37:05.043 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:04 smithi132 bash[27079]: audit 2020-07-16T13:37:03.953582+0000 mon.b (mon.2) 63 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2020-07-16T13:37:03.953349\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi132\", \"name\": \"\", \"network\": \"\"}, {\"hostname\": \"smithi188\", \"name\": \"x\", \"network\": \"\"}]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]: dispatch 2020-07-16T13:37:05.043 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:04 smithi132 bash[27079]: audit 2020-07-16T13:37:03.953868+0000 mon.a (mon.0) 603 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2020-07-16T13:37:03.953349\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi132\", \"name\": \"\", \"network\": \"\"}, {\"hostname\": \"smithi188\", \"name\": \"x\", \"network\": \"\"}]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]: dispatch 2020-07-16T13:37:05.044 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:04 smithi132 bash[27079]: audit 2020-07-16T13:37:03.956283+0000 mon.a (mon.0) 604 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2020-07-16T13:37:03.953349\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi132\", \"name\": \"\", \"network\": \"\"}, {\"hostname\": \"smithi188\", \"name\": \"x\", \"network\": \"\"}]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]': finished 2020-07-16T13:37:05.044 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:04 smithi132 bash[27079]: audit 2020-07-16T13:37:03.956970+0000 mon.b (mon.2) 64 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix":"config set","value":"1","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2020-07-16T13:37:05.044 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:04 smithi132 bash[27079]: audit 2020-07-16T13:37:03.957227+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"1","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2020-07-16T13:37:05.044 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:04 smithi132 bash[27079]: audit 2020-07-16T13:37:03.960560+0000 mon.a (mon.0) 606 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"1","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2020-07-16T13:37:05.044 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:04 smithi132 bash[27079]: cephadm 2020-07-16T13:37:03.963090+0000 mgr.x (mgr.34499) 5 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2020-07-16T13:37:05.045 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:04 smithi132 bash[27079]: audit 2020-07-16T13:37:03.963340+0000 mon.b (mon.2) 65 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2020-07-16T13:37:05.045 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:04 smithi132 bash[27079]: audit 2020-07-16T13:37:03.964007+0000 mon.b (mon.2) 66 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:37:05.045 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:04 smithi132 bash[27079]: cephadm 2020-07-16T13:37:03.964564+0000 mgr.x (mgr.34499) 6 : cephadm [INF] Reconfiguring daemon mon.a on smithi132 2020-07-16T13:37:05.045 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:04 smithi132 bash[27079]: audit 2020-07-16T13:37:03.964843+0000 mon.b (mon.2) 67 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon.a", "key": "container_image"}]: dispatch 2020-07-16T13:37:05.045 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:04 smithi132 bash[27079]: cluster 2020-07-16T13:37:04.299142+0000 mon.a (mon.0) 607 : cluster [DBG] mgrmap e19: x(active, since 3s), standbys: y 2020-07-16T13:37:05.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:04 smithi188 bash[23329]: audit 2020-07-16T13:37:03.948850+0000 mon.b (mon.2) 62 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947274\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947371\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947404\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947567\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947718\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947821\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947920\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947954\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947982\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:37:03.948054\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:37:05.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:04 smithi188 bash[23329]: audit 2020-07-16T13:37:03.949547+0000 mon.a (mon.0) 601 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947274\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947371\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947404\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947567\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947718\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947821\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947920\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947954\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947982\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:37:03.948054\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:37:05.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:04 smithi188 bash[23329]: audit 2020-07-16T13:37:03.951984+0000 mon.a (mon.0) 602 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947274\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947371\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947404\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947567\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947718\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947821\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947920\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947954\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947982\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:07.884815\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:37:03.948054\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:37:05.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:04 smithi188 bash[23329]: cephadm 2020-07-16T13:37:03.953339+0000 mgr.x (mgr.34499) 4 : cephadm [INF] Migrating to explicit placement 2020-07-16T13:37:05.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:04 smithi188 bash[23329]: audit 2020-07-16T13:37:03.953582+0000 mon.b (mon.2) 63 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2020-07-16T13:37:03.953349\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi132\", \"name\": \"\", \"network\": \"\"}, {\"hostname\": \"smithi188\", \"name\": \"x\", \"network\": \"\"}]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]: dispatch 2020-07-16T13:37:05.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:04 smithi188 bash[23329]: audit 2020-07-16T13:37:03.953868+0000 mon.a (mon.0) 603 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2020-07-16T13:37:03.953349\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi132\", \"name\": \"\", \"network\": \"\"}, {\"hostname\": \"smithi188\", \"name\": \"x\", \"network\": \"\"}]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]: dispatch 2020-07-16T13:37:05.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:04 smithi188 bash[23329]: audit 2020-07-16T13:37:03.956283+0000 mon.a (mon.0) 604 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2020-07-16T13:37:03.953349\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi132\", \"name\": \"\", \"network\": \"\"}, {\"hostname\": \"smithi188\", \"name\": \"x\", \"network\": \"\"}]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]': finished 2020-07-16T13:37:05.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:04 smithi188 bash[23329]: audit 2020-07-16T13:37:03.956970+0000 mon.b (mon.2) 64 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix":"config set","value":"1","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2020-07-16T13:37:05.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:04 smithi188 bash[23329]: audit 2020-07-16T13:37:03.957227+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"1","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2020-07-16T13:37:05.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:04 smithi188 bash[23329]: audit 2020-07-16T13:37:03.960560+0000 mon.a (mon.0) 606 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"1","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2020-07-16T13:37:05.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:04 smithi188 bash[23329]: cephadm 2020-07-16T13:37:03.963090+0000 mgr.x (mgr.34499) 5 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2020-07-16T13:37:05.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:04 smithi188 bash[23329]: audit 2020-07-16T13:37:03.963340+0000 mon.b (mon.2) 65 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2020-07-16T13:37:05.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:04 smithi188 bash[23329]: audit 2020-07-16T13:37:03.964007+0000 mon.b (mon.2) 66 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:37:05.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:04 smithi188 bash[23329]: cephadm 2020-07-16T13:37:03.964564+0000 mgr.x (mgr.34499) 6 : cephadm [INF] Reconfiguring daemon mon.a on smithi132 2020-07-16T13:37:05.175 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:04 smithi188 bash[23329]: audit 2020-07-16T13:37:03.964843+0000 mon.b (mon.2) 67 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon.a", "key": "container_image"}]: dispatch 2020-07-16T13:37:05.175 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:04 smithi188 bash[23329]: cluster 2020-07-16T13:37:04.299142+0000 mon.a (mon.0) 607 : cluster [DBG] mgrmap e19: x(active, since 3s), standbys: y 2020-07-16T13:37:06.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:05 smithi188 bash[23329]: cluster 2020-07-16T13:37:04.850820+0000 mgr.x (mgr.34499) 7 : cluster [DBG] pgmap v5: 1 pgs: 1 active+clean; 0 B data, 4.1 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:37:06.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:05 smithi188 bash[23329]: audit 2020-07-16T13:37:05.541401+0000 mon.b (mon.2) 68 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290485\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290519\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290549\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290723\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290827\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290927\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291025\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"83de891fa91c\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291076\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:34:42.059327\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2020-07-16T13:34:37.094927\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:03.963129\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:37:06.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:05 smithi188 bash[23329]: audit 2020-07-16T13:37:05.542061+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290485\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290519\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290549\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290723\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290827\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290927\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291025\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"83de891fa91c\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291076\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:34:42.059327\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2020-07-16T13:34:37.094927\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:03.963129\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:37:06.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:05 smithi188 bash[23329]: audit 2020-07-16T13:37:05.545649+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290485\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290519\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290549\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290723\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290827\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290927\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291025\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"83de891fa91c\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291076\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:34:42.059327\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2020-07-16T13:34:37.094927\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:03.963129\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:37:06.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:05 smithi188 bash[23329]: cephadm 2020-07-16T13:37:05.546298+0000 mgr.x (mgr.34499) 8 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2020-07-16T13:37:06.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:05 smithi188 bash[23329]: audit 2020-07-16T13:37:05.546596+0000 mon.b (mon.2) 69 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2020-07-16T13:37:06.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:05 smithi188 bash[23329]: audit 2020-07-16T13:37:05.547401+0000 mon.b (mon.2) 70 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:37:06.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:05 smithi188 bash[23329]: cephadm 2020-07-16T13:37:05.548005+0000 mgr.x (mgr.34499) 9 : cephadm [INF] Reconfiguring daemon mon.c on smithi132 2020-07-16T13:37:06.175 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:05 smithi188 bash[23329]: audit 2020-07-16T13:37:05.548387+0000 mon.b (mon.2) 71 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon.c", "key": "container_image"}]: dispatch 2020-07-16T13:37:06.282 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:05 smithi132 bash[23299]: cluster 2020-07-16T13:37:04.850820+0000 mgr.x (mgr.34499) 7 : cluster [DBG] pgmap v5: 1 pgs: 1 active+clean; 0 B data, 4.1 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:37:06.282 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:05 smithi132 bash[23299]: audit 2020-07-16T13:37:05.541401+0000 mon.b (mon.2) 68 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290485\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290519\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290549\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290723\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290827\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290927\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291025\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"83de891fa91c\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291076\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:34:42.059327\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2020-07-16T13:34:37.094927\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:03.963129\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:37:06.282 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:05 smithi132 bash[23299]: audit 2020-07-16T13:37:05.542061+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290485\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290519\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290549\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290723\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290827\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290927\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291025\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"83de891fa91c\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291076\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:34:42.059327\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2020-07-16T13:34:37.094927\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:03.963129\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:37:06.283 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:05 smithi132 bash[23299]: audit 2020-07-16T13:37:05.545649+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290485\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290519\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290549\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290723\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290827\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290927\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291025\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"83de891fa91c\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291076\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:34:42.059327\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2020-07-16T13:34:37.094927\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:03.963129\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:37:06.283 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:05 smithi132 bash[23299]: cephadm 2020-07-16T13:37:05.546298+0000 mgr.x (mgr.34499) 8 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2020-07-16T13:37:06.283 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:05 smithi132 bash[23299]: audit 2020-07-16T13:37:05.546596+0000 mon.b (mon.2) 69 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2020-07-16T13:37:06.283 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:05 smithi132 bash[23299]: audit 2020-07-16T13:37:05.547401+0000 mon.b (mon.2) 70 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:37:06.284 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:05 smithi132 bash[23299]: cephadm 2020-07-16T13:37:05.548005+0000 mgr.x (mgr.34499) 9 : cephadm [INF] Reconfiguring daemon mon.c on smithi132 2020-07-16T13:37:06.284 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:05 smithi132 bash[23299]: audit 2020-07-16T13:37:05.548387+0000 mon.b (mon.2) 71 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon.c", "key": "container_image"}]: dispatch 2020-07-16T13:37:06.284 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:05 smithi132 bash[27079]: cluster 2020-07-16T13:37:04.850820+0000 mgr.x (mgr.34499) 7 : cluster [DBG] pgmap v5: 1 pgs: 1 active+clean; 0 B data, 4.1 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:37:06.285 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:05 smithi132 bash[27079]: audit 2020-07-16T13:37:05.541401+0000 mon.b (mon.2) 68 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290485\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290519\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290549\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290723\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290827\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290927\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291025\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"83de891fa91c\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291076\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:34:42.059327\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2020-07-16T13:34:37.094927\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:03.963129\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:37:06.285 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:05 smithi132 bash[27079]: audit 2020-07-16T13:37:05.542061+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290485\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290519\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290549\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290723\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290827\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290927\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291025\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"83de891fa91c\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291076\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:34:42.059327\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2020-07-16T13:34:37.094927\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:03.963129\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:37:06.286 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:05 smithi132 bash[27079]: audit 2020-07-16T13:37:05.545649+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290485\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290519\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290549\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290723\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290827\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290927\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291025\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"83de891fa91c\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291076\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:34:42.059327\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:30:55.874074\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2020-07-16T13:34:37.094927\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:03.963129\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:37:06.286 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:05 smithi132 bash[27079]: cephadm 2020-07-16T13:37:05.546298+0000 mgr.x (mgr.34499) 8 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2020-07-16T13:37:06.287 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:05 smithi132 bash[27079]: audit 2020-07-16T13:37:05.546596+0000 mon.b (mon.2) 69 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2020-07-16T13:37:06.287 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:05 smithi132 bash[27079]: audit 2020-07-16T13:37:05.547401+0000 mon.b (mon.2) 70 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:37:06.287 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:05 smithi132 bash[27079]: cephadm 2020-07-16T13:37:05.548005+0000 mgr.x (mgr.34499) 9 : cephadm [INF] Reconfiguring daemon mon.c on smithi132 2020-07-16T13:37:06.288 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:05 smithi132 bash[27079]: audit 2020-07-16T13:37:05.548387+0000 mon.b (mon.2) 71 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon.c", "key": "container_image"}]: dispatch 2020-07-16T13:37:08.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:07 smithi188 bash[23329]: cluster 2020-07-16T13:37:06.851168+0000 mgr.x (mgr.34499) 10 : cluster [DBG] pgmap v6: 1 pgs: 1 active+clean; 0 B data, 4.1 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:37:08.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:07 smithi188 bash[23329]: audit 2020-07-16T13:37:07.003469+0000 mon.b (mon.2) 72 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290485\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290549\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290723\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290827\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290927\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291025\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"83de891fa91c\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291076\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:34:42.059327\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2020-07-16T13:34:37.094927\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:03.963129\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:37:08.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:07 smithi188 bash[23329]: audit 2020-07-16T13:37:07.004255+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290485\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290549\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290723\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290827\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290927\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291025\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"83de891fa91c\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291076\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:34:42.059327\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2020-07-16T13:34:37.094927\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:03.963129\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:37:08.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:07 smithi188 bash[23329]: audit 2020-07-16T13:37:07.007057+0000 mon.a (mon.0) 611 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290485\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290549\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290723\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290827\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290927\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291025\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"83de891fa91c\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291076\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:34:42.059327\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2020-07-16T13:34:37.094927\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:03.963129\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:37:08.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:07 smithi188 bash[23329]: cephadm 2020-07-16T13:37:07.007740+0000 mgr.x (mgr.34499) 11 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2020-07-16T13:37:08.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:07 smithi188 bash[23329]: cephadm 2020-07-16T13:37:07.014541+0000 mgr.x (mgr.34499) 12 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi132 2020-07-16T13:37:08.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:07 smithi132 bash[23299]: cluster 2020-07-16T13:37:06.851168+0000 mgr.x (mgr.34499) 10 : cluster [DBG] pgmap v6: 1 pgs: 1 active+clean; 0 B data, 4.1 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:37:08.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:07 smithi132 bash[23299]: audit 2020-07-16T13:37:07.003469+0000 mon.b (mon.2) 72 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290485\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290549\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290723\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290827\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290927\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291025\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"83de891fa91c\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291076\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:34:42.059327\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2020-07-16T13:34:37.094927\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:03.963129\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:37:08.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:07 smithi132 bash[23299]: audit 2020-07-16T13:37:07.004255+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290485\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290549\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290723\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290827\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290927\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291025\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"83de891fa91c\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291076\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:34:42.059327\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2020-07-16T13:34:37.094927\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:03.963129\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:37:08.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:07 smithi132 bash[23299]: audit 2020-07-16T13:37:07.007057+0000 mon.a (mon.0) 611 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290485\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290549\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290723\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290827\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290927\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291025\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"83de891fa91c\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291076\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:34:42.059327\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2020-07-16T13:34:37.094927\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:03.963129\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:37:08.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:07 smithi132 bash[23299]: cephadm 2020-07-16T13:37:07.007740+0000 mgr.x (mgr.34499) 11 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2020-07-16T13:37:08.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:07 smithi132 bash[23299]: cephadm 2020-07-16T13:37:07.014541+0000 mgr.x (mgr.34499) 12 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi132 2020-07-16T13:37:08.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:07 smithi132 bash[27079]: cluster 2020-07-16T13:37:06.851168+0000 mgr.x (mgr.34499) 10 : cluster [DBG] pgmap v6: 1 pgs: 1 active+clean; 0 B data, 4.1 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:37:08.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:07 smithi132 bash[27079]: audit 2020-07-16T13:37:07.003469+0000 mon.b (mon.2) 72 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290485\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290549\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290723\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290827\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290927\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291025\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"83de891fa91c\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291076\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:34:42.059327\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2020-07-16T13:34:37.094927\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:03.963129\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:37:08.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:07 smithi132 bash[27079]: audit 2020-07-16T13:37:07.004255+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290485\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290549\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290723\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290827\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290927\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291025\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"83de891fa91c\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291076\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:34:42.059327\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2020-07-16T13:34:37.094927\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:03.963129\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:37:08.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:07 smithi132 bash[27079]: audit 2020-07-16T13:37:07.007057+0000 mon.a (mon.0) 611 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290485\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290549\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290723\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290827\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290927\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291025\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"83de891fa91c\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291076\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:34:42.059327\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2020-07-16T13:34:37.094927\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:03.963129\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:37:08.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:07 smithi132 bash[27079]: cephadm 2020-07-16T13:37:07.007740+0000 mgr.x (mgr.34499) 11 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2020-07-16T13:37:08.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:07 smithi132 bash[27079]: cephadm 2020-07-16T13:37:07.014541+0000 mgr.x (mgr.34499) 12 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi132 2020-07-16T13:37:10.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:10 smithi188 bash[23329]: cluster 2020-07-16T13:37:08.851532+0000 mgr.x (mgr.34499) 13 : cluster [DBG] pgmap v7: 1 pgs: 1 active+clean; 0 B data, 4.1 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:37:11.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:10 smithi132 bash[27079]: cluster 2020-07-16T13:37:08.851532+0000 mgr.x (mgr.34499) 13 : cluster [DBG] pgmap v7: 1 pgs: 1 active+clean; 0 B data, 4.1 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:37:11.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:10 smithi132 bash[23299]: cluster 2020-07-16T13:37:08.851532+0000 mgr.x (mgr.34499) 13 : cluster [DBG] pgmap v7: 1 pgs: 1 active+clean; 0 B data, 4.1 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:37:12.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:12 smithi188 bash[23329]: cluster 2020-07-16T13:37:10.851996+0000 mgr.x (mgr.34499) 14 : cluster [DBG] pgmap v8: 1 pgs: 1 active+clean; 0 B data, 4.1 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:37:13.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:12 smithi132 bash[27079]: cluster 2020-07-16T13:37:10.851996+0000 mgr.x (mgr.34499) 14 : cluster [DBG] pgmap v8: 1 pgs: 1 active+clean; 0 B data, 4.1 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:37:13.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:12 smithi132 bash[23299]: cluster 2020-07-16T13:37:10.851996+0000 mgr.x (mgr.34499) 14 : cluster [DBG] pgmap v8: 1 pgs: 1 active+clean; 0 B data, 4.1 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:37:13.221 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T13:37:13.508 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T13:37:13.509 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2m) 10s ago 3m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 83de891fa91c 2020-07-16T13:37:13.509 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2m) 9s ago 2m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T13:37:13.509 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (17s) 9s ago 5m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T13:37:13.509 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (7m) 10s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 9aeb379e8310 2020-07-16T13:37:13.509 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 starting - - 2020-07-16T13:37:13.510 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (6m) 9s ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T13:37:13.510 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 starting - - 2020-07-16T13:37:13.510 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (3m) 10s ago 3m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T13:37:13.510 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (3m) 9s ago 3m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T13:37:13.510 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (5m) 10s ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T13:37:13.511 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (5m) 10s ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T13:37:13.511 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (5m) 10s ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T13:37:13.511 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (4m) 10s ago 4m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T13:37:13.511 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (4m) 9s ago 4m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T13:37:13.511 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (4m) 9s ago 4m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T13:37:13.512 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (3m) 9s ago 3m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T13:37:13.512 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (3m) 9s ago 3m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T13:37:13.512 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2m) 9s ago 3m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T13:37:13.815 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T13:37:13.815 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T13:37:13.815 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2020-07-16T13:37:13.815 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:37:13.816 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T13:37:13.816 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 1, 2020-07-16T13:37:13.816 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T13:37:13.816 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:37:13.816 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T13:37:13.817 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T13:37:13.817 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:37:13.817 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T13:37:13.817 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T13:37:13.817 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 12, 2020-07-16T13:37:13.818 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T13:37:13.818 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T13:37:13.818 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T13:37:14.209 INFO:journalctl@ceph.alertmanager.a.smithi132.stdout:Jul 16 13:37:13 smithi132 systemd[1]: Stopping Ceph alertmanager.a for 4c8ed362-c768-11ea-a06f-001a4aab830c... 2020-07-16T13:37:14.209 INFO:journalctl@ceph.alertmanager.a.smithi132.stdout:Jul 16 13:37:14 smithi132 bash[6284]: level=info ts=2020-07-16T13:37:14.023Z caller=main.go:524 msg="Received SIGTERM, exiting gracefully..." 2020-07-16T13:37:14.210 INFO:journalctl@ceph.alertmanager.a.smithi132.stdout:Jul 16 13:37:14 smithi132 podman[10099]: 2020-07-16 13:37:14.177184506 +0000 UTC m=+0.187313446 container died 83de891fa91ca7d35a5f8af864e709a4523cc9995525e8c46bcce782204a1d12 (image=docker.io/prom/alertmanager:latest, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-alertmanager.a) 2020-07-16T13:37:14.210 INFO:journalctl@ceph.alertmanager.a.smithi132.stdout:Jul 16 13:37:14 smithi132 podman[10099]: 2020-07-16 13:37:14.208454351 +0000 UTC m=+0.218583273 container stop 83de891fa91ca7d35a5f8af864e709a4523cc9995525e8c46bcce782204a1d12 (image=docker.io/prom/alertmanager:latest, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-alertmanager.a) 2020-07-16T13:37:14.528 INFO:journalctl@ceph.alertmanager.a.smithi132.stdout:Jul 16 13:37:14 smithi132 podman[10099]: 83de891fa91ca7d35a5f8af864e709a4523cc9995525e8c46bcce782204a1d12 2020-07-16T13:37:14.892 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:14 smithi132 bash[27079]: cluster 2020-07-16T13:37:12.852432+0000 mgr.x (mgr.34499) 15 : cluster [DBG] pgmap v9: 1 pgs: 1 active+clean; 0 B data, 4.1 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:37:14.893 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:14 smithi132 bash[27079]: audit 2020-07-16T13:37:13.207538+0000 mgr.x (mgr.34499) 16 : audit [DBG] from='client.24580 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:37:14.893 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:14 smithi132 bash[27079]: audit 2020-07-16T13:37:13.503523+0000 mgr.x (mgr.34499) 17 : audit [DBG] from='client.24586 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:37:14.893 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:14 smithi132 bash[27079]: audit 2020-07-16T13:37:13.813855+0000 mon.c (mon.1) 25 : audit [DBG] from='client.? 172.21.15.132:0/3505052591' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:37:14.894 INFO:journalctl@ceph.alertmanager.a.smithi132.stdout:Jul 16 13:37:14 smithi132 systemd[1]: Stopped Ceph alertmanager.a for 4c8ed362-c768-11ea-a06f-001a4aab830c. 2020-07-16T13:37:14.894 INFO:journalctl@ceph.alertmanager.a.smithi132.stdout:Jul 16 13:37:14 smithi132 systemd[1]: Starting Ceph alertmanager.a for 4c8ed362-c768-11ea-a06f-001a4aab830c... 2020-07-16T13:37:14.894 INFO:journalctl@ceph.alertmanager.a.smithi132.stdout:Jul 16 13:37:14 smithi132 podman[10144]: Error: no container with name or ID ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-alertmanager.a found: no such container 2020-07-16T13:37:14.894 INFO:journalctl@ceph.alertmanager.a.smithi132.stdout:Jul 16 13:37:14 smithi132 systemd[1]: Started Ceph alertmanager.a for 4c8ed362-c768-11ea-a06f-001a4aab830c. 2020-07-16T13:37:14.894 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:14 smithi132 bash[23299]: cluster 2020-07-16T13:37:12.852432+0000 mgr.x (mgr.34499) 15 : cluster [DBG] pgmap v9: 1 pgs: 1 active+clean; 0 B data, 4.1 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:37:14.895 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:14 smithi132 bash[23299]: audit 2020-07-16T13:37:13.207538+0000 mgr.x (mgr.34499) 16 : audit [DBG] from='client.24580 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:37:14.895 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:14 smithi132 bash[23299]: audit 2020-07-16T13:37:13.503523+0000 mgr.x (mgr.34499) 17 : audit [DBG] from='client.24586 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:37:14.895 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:14 smithi132 bash[23299]: audit 2020-07-16T13:37:13.813855+0000 mon.c (mon.1) 25 : audit [DBG] from='client.? 172.21.15.132:0/3505052591' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:37:14.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:14 smithi188 bash[23329]: cluster 2020-07-16T13:37:12.852432+0000 mgr.x (mgr.34499) 15 : cluster [DBG] pgmap v9: 1 pgs: 1 active+clean; 0 B data, 4.1 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:37:14.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:14 smithi188 bash[23329]: audit 2020-07-16T13:37:13.207538+0000 mgr.x (mgr.34499) 16 : audit [DBG] from='client.24580 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:37:14.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:14 smithi188 bash[23329]: audit 2020-07-16T13:37:13.503523+0000 mgr.x (mgr.34499) 17 : audit [DBG] from='client.24586 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:37:14.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:14 smithi188 bash[23329]: audit 2020-07-16T13:37:13.813855+0000 mon.c (mon.1) 25 : audit [DBG] from='client.? 172.21.15.132:0/3505052591' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:37:15.184 INFO:journalctl@ceph.alertmanager.a.smithi132.stdout:Jul 16 13:37:14 smithi132 podman[10163]: 2020-07-16 13:37:14.891591072 +0000 UTC m=+0.223010910 container create 30a3c37e52edc75f6083eb79134efb36fbc54aa2df2efe365c072f487952d56a (image=docker.io/prom/alertmanager:latest, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-alertmanager.a) 2020-07-16T13:37:15.529 INFO:journalctl@ceph.alertmanager.a.smithi132.stdout:Jul 16 13:37:15 smithi132 podman[10163]: 2020-07-16 13:37:15.183221748 +0000 UTC m=+0.514641491 container init 30a3c37e52edc75f6083eb79134efb36fbc54aa2df2efe365c072f487952d56a (image=docker.io/prom/alertmanager:latest, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-alertmanager.a) 2020-07-16T13:37:15.529 INFO:journalctl@ceph.alertmanager.a.smithi132.stdout:Jul 16 13:37:15 smithi132 podman[10163]: 2020-07-16 13:37:15.216550843 +0000 UTC m=+0.547970587 container start 30a3c37e52edc75f6083eb79134efb36fbc54aa2df2efe365c072f487952d56a (image=docker.io/prom/alertmanager:latest, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-alertmanager.a) 2020-07-16T13:37:15.529 INFO:journalctl@ceph.alertmanager.a.smithi132.stdout:Jul 16 13:37:15 smithi132 podman[10163]: 2020-07-16 13:37:15.216629141 +0000 UTC m=+0.548048899 container attach 30a3c37e52edc75f6083eb79134efb36fbc54aa2df2efe365c072f487952d56a (image=docker.io/prom/alertmanager:latest, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-alertmanager.a) 2020-07-16T13:37:15.529 INFO:journalctl@ceph.alertmanager.a.smithi132.stdout:Jul 16 13:37:15 smithi132 bash[10162]: level=info ts=2020-07-16T13:37:15.209Z caller=main.go:216 msg="Starting Alertmanager" version="(version=0.21.0, branch=HEAD, revision=4c6c03ebfe21009c546e4d1e9b92c371d67c021d)" 2020-07-16T13:37:15.530 INFO:journalctl@ceph.alertmanager.a.smithi132.stdout:Jul 16 13:37:15 smithi132 bash[10162]: level=info ts=2020-07-16T13:37:15.209Z caller=main.go:217 build_context="(go=go1.14.4, user=root@dee35927357f, date=20200617-08:54:02)" 2020-07-16T13:37:15.530 INFO:journalctl@ceph.alertmanager.a.smithi132.stdout:Jul 16 13:37:15 smithi132 bash[10162]: level=info ts=2020-07-16T13:37:15.210Z caller=cluster.go:161 component=cluster msg="setting advertise address explicitly" addr=172.21.15.132 port=9094 2020-07-16T13:37:15.530 INFO:journalctl@ceph.alertmanager.a.smithi132.stdout:Jul 16 13:37:15 smithi132 bash[10162]: level=info ts=2020-07-16T13:37:15.211Z caller=cluster.go:623 component=cluster msg="Waiting for gossip to settle..." interval=2s 2020-07-16T13:37:15.530 INFO:journalctl@ceph.alertmanager.a.smithi132.stdout:Jul 16 13:37:15 smithi132 bash[10162]: level=info ts=2020-07-16T13:37:15.229Z caller=coordinator.go:119 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2020-07-16T13:37:15.531 INFO:journalctl@ceph.alertmanager.a.smithi132.stdout:Jul 16 13:37:15 smithi132 bash[10162]: level=info ts=2020-07-16T13:37:15.229Z caller=coordinator.go:131 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2020-07-16T13:37:15.531 INFO:journalctl@ceph.alertmanager.a.smithi132.stdout:Jul 16 13:37:15 smithi132 bash[10162]: level=info ts=2020-07-16T13:37:15.231Z caller=main.go:485 msg=Listening address=:9093 2020-07-16T13:37:15.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:15 smithi188 bash[23329]: audit 2020-07-16T13:37:14.672309+0000 mon.b (mon.2) 73 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290485\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290549\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290723\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290827\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290927\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291025\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:03.963129\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:37:15.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:15 smithi188 bash[23329]: audit 2020-07-16T13:37:14.672962+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290485\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290549\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290723\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290827\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290927\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291025\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:03.963129\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:37:15.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:15 smithi188 bash[23329]: audit 2020-07-16T13:37:14.676524+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290485\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290549\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290723\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290827\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290927\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291025\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:03.963129\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:37:15.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:15 smithi188 bash[23329]: audit 2020-07-16T13:37:14.678544+0000 mon.b (mon.2) 74 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2020-07-16T13:37:15.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:15 smithi188 bash[23329]: audit 2020-07-16T13:37:14.679338+0000 mon.b (mon.2) 75 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:37:15.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:15 smithi188 bash[23329]: audit 2020-07-16T13:37:14.680469+0000 mon.b (mon.2) 76 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2020-07-16T13:37:16.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:15 smithi132 bash[27079]: audit 2020-07-16T13:37:14.672309+0000 mon.b (mon.2) 73 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290485\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290549\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290723\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290827\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290927\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291025\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:03.963129\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:37:16.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:15 smithi132 bash[27079]: audit 2020-07-16T13:37:14.672962+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290485\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290549\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290723\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290827\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290927\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291025\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:03.963129\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:37:16.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:15 smithi132 bash[27079]: audit 2020-07-16T13:37:14.676524+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290485\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290549\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290723\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290827\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290927\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291025\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:03.963129\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:37:16.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:15 smithi132 bash[27079]: audit 2020-07-16T13:37:14.678544+0000 mon.b (mon.2) 74 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2020-07-16T13:37:16.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:15 smithi132 bash[27079]: audit 2020-07-16T13:37:14.679338+0000 mon.b (mon.2) 75 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:37:16.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:15 smithi132 bash[27079]: audit 2020-07-16T13:37:14.680469+0000 mon.b (mon.2) 76 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2020-07-16T13:37:16.032 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:15 smithi132 bash[23299]: audit 2020-07-16T13:37:14.672309+0000 mon.b (mon.2) 73 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290485\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290549\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290723\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290827\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290927\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291025\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:03.963129\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:37:16.032 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:15 smithi132 bash[23299]: audit 2020-07-16T13:37:14.672962+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290485\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290549\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290723\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290827\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290927\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291025\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:03.963129\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:37:16.033 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:15 smithi132 bash[23299]: audit 2020-07-16T13:37:14.676524+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9aeb379e8310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290485\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:29:40.558256\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290549\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290723\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290827\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290927\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291025\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:24.172732\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:03.963129\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:37:16.033 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:15 smithi132 bash[23299]: audit 2020-07-16T13:37:14.678544+0000 mon.b (mon.2) 74 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2020-07-16T13:37:16.033 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:15 smithi132 bash[23299]: audit 2020-07-16T13:37:14.679338+0000 mon.b (mon.2) 75 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:37:16.033 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:15 smithi132 bash[23299]: audit 2020-07-16T13:37:14.680469+0000 mon.b (mon.2) 76 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2020-07-16T13:37:16.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:16 smithi188 bash[23329]: cephadm 2020-07-16T13:37:14.678269+0000 mgr.x (mgr.34499) 18 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2020-07-16T13:37:16.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:16 smithi188 bash[23329]: cephadm 2020-07-16T13:37:14.679943+0000 mgr.x (mgr.34499) 19 : cephadm [INF] Reconfiguring daemon mon.b on smithi188 2020-07-16T13:37:16.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:16 smithi188 bash[23329]: cluster 2020-07-16T13:37:14.852710+0000 mgr.x (mgr.34499) 20 : cluster [DBG] pgmap v10: 1 pgs: 1 active+clean; 0 B data, 4.1 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:37:16.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:16 smithi188 bash[23329]: audit 2020-07-16T13:37:16.252515+0000 mon.b (mon.2) 77 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947371\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947404\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947567\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947718\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947821\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947920\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947954\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947982\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:37:16.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:16 smithi188 bash[23329]: audit 2020-07-16T13:37:16.253257+0000 mon.a (mon.0) 614 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947371\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947404\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947567\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947718\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947821\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947920\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947954\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947982\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:37:16.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:16 smithi188 bash[23329]: audit 2020-07-16T13:37:16.257352+0000 mon.a (mon.0) 615 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947371\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947404\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947567\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947718\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947821\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947920\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947954\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947982\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:37:16.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:16 smithi188 bash[23329]: audit 2020-07-16T13:37:16.258200+0000 mon.b (mon.2) 78 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:37:16.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:16 smithi188 bash[23329]: audit 2020-07-16T13:37:16.259692+0000 mon.b (mon.2) 79 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi132:9093"}]: dispatch 2020-07-16T13:37:16.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:16 smithi188 bash[23329]: audit 2020-07-16T13:37:16.260151+0000 mon.b (mon.2) 80 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi132:9093","who":"mgr","name":"mgr/dashboard/ALERTMANAGER_API_HOST"}]: dispatch 2020-07-16T13:37:16.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:16 smithi188 bash[23329]: audit 2020-07-16T13:37:16.260415+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi132:9093","who":"mgr","name":"mgr/dashboard/ALERTMANAGER_API_HOST"}]: dispatch 2020-07-16T13:37:16.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:16 smithi188 bash[23329]: audit 2020-07-16T13:37:16.265060+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"http://smithi132:9093","who":"mgr","name":"mgr/dashboard/ALERTMANAGER_API_HOST"}]': finished 2020-07-16T13:37:16.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:16 smithi188 bash[23329]: audit 2020-07-16T13:37:16.266101+0000 mon.b (mon.2) 81 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:37:16.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:16 smithi188 bash[23329]: audit 2020-07-16T13:37:16.270752+0000 mon.b (mon.2) 82 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi188:9095"}]: dispatch 2020-07-16T13:37:16.925 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:16 smithi188 bash[23329]: audit 2020-07-16T13:37:16.271197+0000 mon.b (mon.2) 83 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi188:9095","who":"mgr","name":"mgr/dashboard/PROMETHEUS_API_HOST"}]: dispatch 2020-07-16T13:37:16.925 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:16 smithi188 bash[23329]: audit 2020-07-16T13:37:16.271432+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi188:9095","who":"mgr","name":"mgr/dashboard/PROMETHEUS_API_HOST"}]: dispatch 2020-07-16T13:37:16.925 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:16 smithi188 bash[23329]: audit 2020-07-16T13:37:16.275845+0000 mon.a (mon.0) 619 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"http://smithi188:9095","who":"mgr","name":"mgr/dashboard/PROMETHEUS_API_HOST"}]': finished 2020-07-16T13:37:16.925 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:16 smithi188 bash[23329]: audit 2020-07-16T13:37:16.276938+0000 mon.b (mon.2) 84 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:37:16.925 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:16 smithi188 bash[23329]: audit 2020-07-16T13:37:16.281027+0000 mon.b (mon.2) 85 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T13:37:17.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:16 smithi132 bash[27079]: cephadm 2020-07-16T13:37:14.678269+0000 mgr.x (mgr.34499) 18 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2020-07-16T13:37:17.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:16 smithi132 bash[27079]: cephadm 2020-07-16T13:37:14.679943+0000 mgr.x (mgr.34499) 19 : cephadm [INF] Reconfiguring daemon mon.b on smithi188 2020-07-16T13:37:17.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:16 smithi132 bash[27079]: cluster 2020-07-16T13:37:14.852710+0000 mgr.x (mgr.34499) 20 : cluster [DBG] pgmap v10: 1 pgs: 1 active+clean; 0 B data, 4.1 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:37:17.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:16 smithi132 bash[27079]: audit 2020-07-16T13:37:16.252515+0000 mon.b (mon.2) 77 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947371\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947404\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947567\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947718\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947821\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947920\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947954\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947982\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:37:17.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:16 smithi132 bash[27079]: audit 2020-07-16T13:37:16.253257+0000 mon.a (mon.0) 614 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947371\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947404\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947567\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947718\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947821\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947920\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947954\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947982\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:37:17.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:16 smithi132 bash[27079]: audit 2020-07-16T13:37:16.257352+0000 mon.a (mon.0) 615 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947371\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947404\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947567\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947718\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947821\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947920\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947954\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947982\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:37:17.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:16 smithi132 bash[27079]: audit 2020-07-16T13:37:16.258200+0000 mon.b (mon.2) 78 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:37:17.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:16 smithi132 bash[27079]: audit 2020-07-16T13:37:16.259692+0000 mon.b (mon.2) 79 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi132:9093"}]: dispatch 2020-07-16T13:37:17.033 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:16 smithi132 bash[27079]: audit 2020-07-16T13:37:16.260151+0000 mon.b (mon.2) 80 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi132:9093","who":"mgr","name":"mgr/dashboard/ALERTMANAGER_API_HOST"}]: dispatch 2020-07-16T13:37:17.033 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:16 smithi132 bash[27079]: audit 2020-07-16T13:37:16.260415+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi132:9093","who":"mgr","name":"mgr/dashboard/ALERTMANAGER_API_HOST"}]: dispatch 2020-07-16T13:37:17.033 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:16 smithi132 bash[27079]: audit 2020-07-16T13:37:16.265060+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"http://smithi132:9093","who":"mgr","name":"mgr/dashboard/ALERTMANAGER_API_HOST"}]': finished 2020-07-16T13:37:17.033 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:16 smithi132 bash[27079]: audit 2020-07-16T13:37:16.266101+0000 mon.b (mon.2) 81 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:37:17.033 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:16 smithi132 bash[27079]: audit 2020-07-16T13:37:16.270752+0000 mon.b (mon.2) 82 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi188:9095"}]: dispatch 2020-07-16T13:37:17.034 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:16 smithi132 bash[27079]: audit 2020-07-16T13:37:16.271197+0000 mon.b (mon.2) 83 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi188:9095","who":"mgr","name":"mgr/dashboard/PROMETHEUS_API_HOST"}]: dispatch 2020-07-16T13:37:17.034 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:16 smithi132 bash[27079]: audit 2020-07-16T13:37:16.271432+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi188:9095","who":"mgr","name":"mgr/dashboard/PROMETHEUS_API_HOST"}]: dispatch 2020-07-16T13:37:17.034 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:16 smithi132 bash[27079]: audit 2020-07-16T13:37:16.275845+0000 mon.a (mon.0) 619 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"http://smithi188:9095","who":"mgr","name":"mgr/dashboard/PROMETHEUS_API_HOST"}]': finished 2020-07-16T13:37:17.034 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:16 smithi132 bash[27079]: audit 2020-07-16T13:37:16.276938+0000 mon.b (mon.2) 84 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:37:17.034 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:16 smithi132 bash[27079]: audit 2020-07-16T13:37:16.281027+0000 mon.b (mon.2) 85 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T13:37:17.035 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:16 smithi132 bash[23299]: cephadm 2020-07-16T13:37:14.678269+0000 mgr.x (mgr.34499) 18 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2020-07-16T13:37:17.035 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:16 smithi132 bash[23299]: cephadm 2020-07-16T13:37:14.679943+0000 mgr.x (mgr.34499) 19 : cephadm [INF] Reconfiguring daemon mon.b on smithi188 2020-07-16T13:37:17.035 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:16 smithi132 bash[23299]: cluster 2020-07-16T13:37:14.852710+0000 mgr.x (mgr.34499) 20 : cluster [DBG] pgmap v10: 1 pgs: 1 active+clean; 0 B data, 4.1 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:37:17.035 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:16 smithi132 bash[23299]: audit 2020-07-16T13:37:16.252515+0000 mon.b (mon.2) 77 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947371\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947404\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947567\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947718\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947821\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947920\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947954\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947982\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:37:17.037 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:16 smithi132 bash[23299]: audit 2020-07-16T13:37:16.253257+0000 mon.a (mon.0) 614 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947371\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947404\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947567\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947718\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947821\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947920\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947954\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947982\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:37:17.037 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:16 smithi132 bash[23299]: audit 2020-07-16T13:37:16.257352+0000 mon.a (mon.0) 615 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947371\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947404\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947567\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947718\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947821\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947920\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947954\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.947982\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:37:17.038 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:16 smithi132 bash[23299]: audit 2020-07-16T13:37:16.258200+0000 mon.b (mon.2) 78 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:37:17.038 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:16 smithi132 bash[23299]: audit 2020-07-16T13:37:16.259692+0000 mon.b (mon.2) 79 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi132:9093"}]: dispatch 2020-07-16T13:37:17.039 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:16 smithi132 bash[23299]: audit 2020-07-16T13:37:16.260151+0000 mon.b (mon.2) 80 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi132:9093","who":"mgr","name":"mgr/dashboard/ALERTMANAGER_API_HOST"}]: dispatch 2020-07-16T13:37:17.039 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:16 smithi132 bash[23299]: audit 2020-07-16T13:37:16.260415+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi132:9093","who":"mgr","name":"mgr/dashboard/ALERTMANAGER_API_HOST"}]: dispatch 2020-07-16T13:37:17.039 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:16 smithi132 bash[23299]: audit 2020-07-16T13:37:16.265060+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"http://smithi132:9093","who":"mgr","name":"mgr/dashboard/ALERTMANAGER_API_HOST"}]': finished 2020-07-16T13:37:17.040 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:16 smithi132 bash[23299]: audit 2020-07-16T13:37:16.266101+0000 mon.b (mon.2) 81 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:37:17.040 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:16 smithi132 bash[23299]: audit 2020-07-16T13:37:16.270752+0000 mon.b (mon.2) 82 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi188:9095"}]: dispatch 2020-07-16T13:37:17.041 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:16 smithi132 bash[23299]: audit 2020-07-16T13:37:16.271197+0000 mon.b (mon.2) 83 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi188:9095","who":"mgr","name":"mgr/dashboard/PROMETHEUS_API_HOST"}]: dispatch 2020-07-16T13:37:17.042 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:16 smithi132 bash[23299]: audit 2020-07-16T13:37:16.271432+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi188:9095","who":"mgr","name":"mgr/dashboard/PROMETHEUS_API_HOST"}]: dispatch 2020-07-16T13:37:17.042 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:16 smithi132 bash[23299]: audit 2020-07-16T13:37:16.275845+0000 mon.a (mon.0) 619 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"http://smithi188:9095","who":"mgr","name":"mgr/dashboard/PROMETHEUS_API_HOST"}]': finished 2020-07-16T13:37:17.044 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:16 smithi132 bash[23299]: audit 2020-07-16T13:37:16.276938+0000 mon.b (mon.2) 84 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:37:17.044 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:16 smithi132 bash[23299]: audit 2020-07-16T13:37:16.281027+0000 mon.b (mon.2) 85 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T13:37:17.528 INFO:journalctl@ceph.alertmanager.a.smithi132.stdout:Jul 16 13:37:17 smithi132 bash[10162]: level=info ts=2020-07-16T13:37:17.211Z caller=cluster.go:648 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000107339s 2020-07-16T13:37:17.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:17 smithi188 bash[23329]: audit 2020-07-16T13:37:16.258509+0000 mgr.x (mgr.34499) 21 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:37:17.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:17 smithi188 bash[23329]: cephadm 2020-07-16T13:37:16.259227+0000 mgr.x (mgr.34499) 22 : cephadm [INF] Setting Dashboard config for AlertManager: command: {'prefix': 'dashboard set-alertmanager-api-host', 'value': 'http://smithi132:9093'} 2020-07-16T13:37:17.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:17 smithi188 bash[23329]: audit 2020-07-16T13:37:16.259936+0000 mgr.x (mgr.34499) 23 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi132:9093"}]: dispatch 2020-07-16T13:37:17.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:17 smithi188 bash[23329]: audit 2020-07-16T13:37:16.266387+0000 mgr.x (mgr.34499) 24 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:37:17.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:17 smithi188 bash[23329]: cephadm 2020-07-16T13:37:16.270465+0000 mgr.x (mgr.34499) 25 : cephadm [INF] Setting Dashboard config for Prometheus: command: {'prefix': 'dashboard set-prometheus-api-host', 'value': 'http://smithi188:9095'} 2020-07-16T13:37:17.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:17 smithi188 bash[23329]: audit 2020-07-16T13:37:16.270987+0000 mgr.x (mgr.34499) 26 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi188:9095"}]: dispatch 2020-07-16T13:37:17.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:17 smithi188 bash[23329]: audit 2020-07-16T13:37:16.277255+0000 mgr.x (mgr.34499) 27 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:37:17.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:17 smithi188 bash[23329]: cephadm 2020-07-16T13:37:16.280828+0000 mgr.x (mgr.34499) 28 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T13:37:17.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:17 smithi188 bash[23329]: cephadm 2020-07-16T13:37:16.281747+0000 mgr.x (mgr.34499) 29 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T13:37:17.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:17 smithi188 bash[23329]: cluster 2020-07-16T13:37:16.853058+0000 mgr.x (mgr.34499) 30 : cluster [DBG] pgmap v11: 1 pgs: 1 active+clean; 0 B data, 4.1 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:37:18.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:17 smithi132 bash[27079]: audit 2020-07-16T13:37:16.258509+0000 mgr.x (mgr.34499) 21 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:37:18.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:17 smithi132 bash[27079]: cephadm 2020-07-16T13:37:16.259227+0000 mgr.x (mgr.34499) 22 : cephadm [INF] Setting Dashboard config for AlertManager: command: {'prefix': 'dashboard set-alertmanager-api-host', 'value': 'http://smithi132:9093'} 2020-07-16T13:37:18.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:17 smithi132 bash[27079]: audit 2020-07-16T13:37:16.259936+0000 mgr.x (mgr.34499) 23 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi132:9093"}]: dispatch 2020-07-16T13:37:18.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:17 smithi132 bash[27079]: audit 2020-07-16T13:37:16.266387+0000 mgr.x (mgr.34499) 24 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:37:18.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:17 smithi132 bash[27079]: cephadm 2020-07-16T13:37:16.270465+0000 mgr.x (mgr.34499) 25 : cephadm [INF] Setting Dashboard config for Prometheus: command: {'prefix': 'dashboard set-prometheus-api-host', 'value': 'http://smithi188:9095'} 2020-07-16T13:37:18.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:17 smithi132 bash[27079]: audit 2020-07-16T13:37:16.270987+0000 mgr.x (mgr.34499) 26 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi188:9095"}]: dispatch 2020-07-16T13:37:18.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:17 smithi132 bash[27079]: audit 2020-07-16T13:37:16.277255+0000 mgr.x (mgr.34499) 27 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:37:18.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:17 smithi132 bash[27079]: cephadm 2020-07-16T13:37:16.280828+0000 mgr.x (mgr.34499) 28 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T13:37:18.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:17 smithi132 bash[27079]: cephadm 2020-07-16T13:37:16.281747+0000 mgr.x (mgr.34499) 29 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T13:37:18.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:17 smithi132 bash[27079]: cluster 2020-07-16T13:37:16.853058+0000 mgr.x (mgr.34499) 30 : cluster [DBG] pgmap v11: 1 pgs: 1 active+clean; 0 B data, 4.1 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:37:18.031 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:17 smithi132 bash[23299]: audit 2020-07-16T13:37:16.258509+0000 mgr.x (mgr.34499) 21 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:37:18.031 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:17 smithi132 bash[23299]: cephadm 2020-07-16T13:37:16.259227+0000 mgr.x (mgr.34499) 22 : cephadm [INF] Setting Dashboard config for AlertManager: command: {'prefix': 'dashboard set-alertmanager-api-host', 'value': 'http://smithi132:9093'} 2020-07-16T13:37:18.032 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:17 smithi132 bash[23299]: audit 2020-07-16T13:37:16.259936+0000 mgr.x (mgr.34499) 23 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi132:9093"}]: dispatch 2020-07-16T13:37:18.032 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:17 smithi132 bash[23299]: audit 2020-07-16T13:37:16.266387+0000 mgr.x (mgr.34499) 24 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:37:18.032 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:17 smithi132 bash[23299]: cephadm 2020-07-16T13:37:16.270465+0000 mgr.x (mgr.34499) 25 : cephadm [INF] Setting Dashboard config for Prometheus: command: {'prefix': 'dashboard set-prometheus-api-host', 'value': 'http://smithi188:9095'} 2020-07-16T13:37:18.032 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:17 smithi132 bash[23299]: audit 2020-07-16T13:37:16.270987+0000 mgr.x (mgr.34499) 26 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi188:9095"}]: dispatch 2020-07-16T13:37:18.032 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:17 smithi132 bash[23299]: audit 2020-07-16T13:37:16.277255+0000 mgr.x (mgr.34499) 27 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:37:18.033 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:17 smithi132 bash[23299]: cephadm 2020-07-16T13:37:16.280828+0000 mgr.x (mgr.34499) 28 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T13:37:18.033 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:17 smithi132 bash[23299]: cephadm 2020-07-16T13:37:16.281747+0000 mgr.x (mgr.34499) 29 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T13:37:18.034 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:17 smithi132 bash[23299]: cluster 2020-07-16T13:37:16.853058+0000 mgr.x (mgr.34499) 30 : cluster [DBG] pgmap v11: 1 pgs: 1 active+clean; 0 B data, 4.1 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:37:18.779 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:18 smithi132 bash[23299]: cephadm 2020-07-16T13:37:17.772879+0000 mgr.x (mgr.34499) 31 : cephadm [INF] Upgrade: It is presumed safe to stop ['mgr.y'] 2020-07-16T13:37:18.779 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:18 smithi132 bash[23299]: cephadm 2020-07-16T13:37:17.772946+0000 mgr.x (mgr.34499) 32 : cephadm [INF] Upgrade: It is presumed safe to stop mgr.y 2020-07-16T13:37:18.780 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:18 smithi132 bash[23299]: cephadm 2020-07-16T13:37:17.773006+0000 mgr.x (mgr.34499) 33 : cephadm [INF] Upgrade: Redeploying mgr.y 2020-07-16T13:37:18.780 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:18 smithi132 bash[23299]: audit 2020-07-16T13:37:17.773351+0000 mon.b (mon.2) 86 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca", "who": "mgr.y"}]: dispatch 2020-07-16T13:37:18.781 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:18 smithi132 bash[23299]: audit 2020-07-16T13:37:17.773991+0000 mon.a (mon.0) 620 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca", "who": "mgr.y"}]: dispatch 2020-07-16T13:37:18.781 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:18 smithi132 bash[23299]: audit 2020-07-16T13:37:17.777908+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca", "who": "mgr.y"}]': finished 2020-07-16T13:37:18.781 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:18 smithi132 bash[23299]: audit 2020-07-16T13:37:17.779258+0000 mon.b (mon.2) 87 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2020-07-16T13:37:18.782 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:18 smithi132 bash[23299]: audit 2020-07-16T13:37:17.780046+0000 mon.b (mon.2) 88 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:37:18.782 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:18 smithi132 bash[23299]: cephadm 2020-07-16T13:37:17.780640+0000 mgr.x (mgr.34499) 34 : cephadm [INF] Deploying daemon mgr.y on smithi132 2020-07-16T13:37:18.783 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:18 smithi132 bash[23299]: audit 2020-07-16T13:37:17.781039+0000 mon.b (mon.2) 89 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2020-07-16T13:37:18.784 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:18 smithi132 bash[27079]: cephadm 2020-07-16T13:37:17.772879+0000 mgr.x (mgr.34499) 31 : cephadm [INF] Upgrade: It is presumed safe to stop ['mgr.y'] 2020-07-16T13:37:18.784 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:18 smithi132 bash[27079]: cephadm 2020-07-16T13:37:17.772946+0000 mgr.x (mgr.34499) 32 : cephadm [INF] Upgrade: It is presumed safe to stop mgr.y 2020-07-16T13:37:18.784 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:18 smithi132 bash[27079]: cephadm 2020-07-16T13:37:17.773006+0000 mgr.x (mgr.34499) 33 : cephadm [INF] Upgrade: Redeploying mgr.y 2020-07-16T13:37:18.784 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:18 smithi132 bash[27079]: audit 2020-07-16T13:37:17.773351+0000 mon.b (mon.2) 86 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca", "who": "mgr.y"}]: dispatch 2020-07-16T13:37:18.784 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:18 smithi132 bash[27079]: audit 2020-07-16T13:37:17.773991+0000 mon.a (mon.0) 620 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca", "who": "mgr.y"}]: dispatch 2020-07-16T13:37:18.785 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:18 smithi132 bash[27079]: audit 2020-07-16T13:37:17.777908+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca", "who": "mgr.y"}]': finished 2020-07-16T13:37:18.785 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:18 smithi132 bash[27079]: audit 2020-07-16T13:37:17.779258+0000 mon.b (mon.2) 87 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2020-07-16T13:37:18.785 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:18 smithi132 bash[27079]: audit 2020-07-16T13:37:17.780046+0000 mon.b (mon.2) 88 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:37:18.785 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:18 smithi132 bash[27079]: cephadm 2020-07-16T13:37:17.780640+0000 mgr.x (mgr.34499) 34 : cephadm [INF] Deploying daemon mgr.y on smithi132 2020-07-16T13:37:18.786 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:18 smithi132 bash[27079]: audit 2020-07-16T13:37:17.781039+0000 mon.b (mon.2) 89 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2020-07-16T13:37:18.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:18 smithi188 bash[23329]: cephadm 2020-07-16T13:37:17.772879+0000 mgr.x (mgr.34499) 31 : cephadm [INF] Upgrade: It is presumed safe to stop ['mgr.y'] 2020-07-16T13:37:18.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:18 smithi188 bash[23329]: cephadm 2020-07-16T13:37:17.772946+0000 mgr.x (mgr.34499) 32 : cephadm [INF] Upgrade: It is presumed safe to stop mgr.y 2020-07-16T13:37:18.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:18 smithi188 bash[23329]: cephadm 2020-07-16T13:37:17.773006+0000 mgr.x (mgr.34499) 33 : cephadm [INF] Upgrade: Redeploying mgr.y 2020-07-16T13:37:18.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:18 smithi188 bash[23329]: audit 2020-07-16T13:37:17.773351+0000 mon.b (mon.2) 86 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca", "who": "mgr.y"}]: dispatch 2020-07-16T13:37:18.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:18 smithi188 bash[23329]: audit 2020-07-16T13:37:17.773991+0000 mon.a (mon.0) 620 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca", "who": "mgr.y"}]: dispatch 2020-07-16T13:37:18.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:18 smithi188 bash[23329]: audit 2020-07-16T13:37:17.777908+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca", "who": "mgr.y"}]': finished 2020-07-16T13:37:18.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:18 smithi188 bash[23329]: audit 2020-07-16T13:37:17.779258+0000 mon.b (mon.2) 87 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2020-07-16T13:37:18.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:18 smithi188 bash[23329]: audit 2020-07-16T13:37:17.780046+0000 mon.b (mon.2) 88 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:37:18.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:18 smithi188 bash[23329]: cephadm 2020-07-16T13:37:17.780640+0000 mgr.x (mgr.34499) 34 : cephadm [INF] Deploying daemon mgr.y on smithi132 2020-07-16T13:37:18.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:18 smithi188 bash[23329]: audit 2020-07-16T13:37:17.781039+0000 mon.b (mon.2) 89 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2020-07-16T13:37:19.279 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:37:19 smithi132 systemd[1]: Stopping Ceph mgr.y for 4c8ed362-c768-11ea-a06f-001a4aab830c... 2020-07-16T13:37:20.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:20 smithi188 bash[23329]: cluster 2020-07-16T13:37:18.853623+0000 mgr.x (mgr.34499) 35 : cluster [DBG] pgmap v12: 1 pgs: 1 active+clean; 0 B data, 4.1 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:37:21.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:20 smithi132 bash[23299]: cluster 2020-07-16T13:37:18.853623+0000 mgr.x (mgr.34499) 35 : cluster [DBG] pgmap v12: 1 pgs: 1 active+clean; 0 B data, 4.1 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:37:21.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:20 smithi132 bash[27079]: cluster 2020-07-16T13:37:18.853623+0000 mgr.x (mgr.34499) 35 : cluster [DBG] pgmap v12: 1 pgs: 1 active+clean; 0 B data, 4.1 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:37:22.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:22 smithi188 bash[23329]: cluster 2020-07-16T13:37:20.854134+0000 mgr.x (mgr.34499) 36 : cluster [DBG] pgmap v13: 1 pgs: 1 active+clean; 0 B data, 4.1 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:37:23.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:22 smithi132 bash[23299]: cluster 2020-07-16T13:37:20.854134+0000 mgr.x (mgr.34499) 36 : cluster [DBG] pgmap v13: 1 pgs: 1 active+clean; 0 B data, 4.1 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:37:23.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:22 smithi132 bash[27079]: cluster 2020-07-16T13:37:20.854134+0000 mgr.x (mgr.34499) 36 : cluster [DBG] pgmap v13: 1 pgs: 1 active+clean; 0 B data, 4.1 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:37:24.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:24 smithi188 bash[23329]: cluster 2020-07-16T13:37:22.854615+0000 mgr.x (mgr.34499) 37 : cluster [DBG] pgmap v14: 1 pgs: 1 active+clean; 0 B data, 4.1 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:37:25.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:24 smithi132 bash[23299]: cluster 2020-07-16T13:37:22.854615+0000 mgr.x (mgr.34499) 37 : cluster [DBG] pgmap v14: 1 pgs: 1 active+clean; 0 B data, 4.1 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:37:25.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:24 smithi132 bash[27079]: cluster 2020-07-16T13:37:22.854615+0000 mgr.x (mgr.34499) 37 : cluster [DBG] pgmap v14: 1 pgs: 1 active+clean; 0 B data, 4.1 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:37:25.529 INFO:journalctl@ceph.alertmanager.a.smithi132.stdout:Jul 16 13:37:25 smithi132 bash[10162]: level=info ts=2020-07-16T13:37:25.212Z caller=cluster.go:640 component=cluster msg="gossip settled; proceeding" elapsed=10.000860173s 2020-07-16T13:37:26.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:26 smithi188 bash[23329]: cluster 2020-07-16T13:37:24.855023+0000 mgr.x (mgr.34499) 38 : cluster [DBG] pgmap v15: 1 pgs: 1 active+clean; 0 B data, 4.1 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:37:27.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:26 smithi132 bash[27079]: cluster 2020-07-16T13:37:24.855023+0000 mgr.x (mgr.34499) 38 : cluster [DBG] pgmap v15: 1 pgs: 1 active+clean; 0 B data, 4.1 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:37:27.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:26 smithi132 bash[23299]: cluster 2020-07-16T13:37:24.855023+0000 mgr.x (mgr.34499) 38 : cluster [DBG] pgmap v15: 1 pgs: 1 active+clean; 0 B data, 4.1 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:37:27.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:27 smithi188 bash[23329]: cluster 2020-07-16T13:37:26.855448+0000 mgr.x (mgr.34499) 39 : cluster [DBG] pgmap v16: 1 pgs: 1 active+clean; 0 B data, 4.1 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:37:28.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:27 smithi132 bash[27079]: cluster 2020-07-16T13:37:26.855448+0000 mgr.x (mgr.34499) 39 : cluster [DBG] pgmap v16: 1 pgs: 1 active+clean; 0 B data, 4.1 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:37:28.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:27 smithi132 bash[23299]: cluster 2020-07-16T13:37:26.855448+0000 mgr.x (mgr.34499) 39 : cluster [DBG] pgmap v16: 1 pgs: 1 active+clean; 0 B data, 4.1 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:37:29.529 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:37:29 smithi132 podman[10407]: 2020-07-16 13:37:29.366181694 +0000 UTC m=+10.221730844 container died 9aeb379e83104f2d2d09de0d3d4bf4b3efadd47e24f2e698d838540b6c22bc61 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mgr.y) 2020-07-16T13:37:29.529 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:37:29 smithi132 podman[10407]: 2020-07-16 13:37:29.414339564 +0000 UTC m=+10.269888777 container stop 9aeb379e83104f2d2d09de0d3d4bf4b3efadd47e24f2e698d838540b6c22bc61 (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mgr.y) 2020-07-16T13:37:29.530 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:37:29 smithi132 podman[10407]: 9aeb379e83104f2d2d09de0d3d4bf4b3efadd47e24f2e698d838540b6c22bc61 2020-07-16T13:37:30.279 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:37:29 smithi132 systemd[1]: ceph-4c8ed362-c768-11ea-a06f-001a4aab830c@mgr.y.service: Main process exited, code=exited, status=137/n/a 2020-07-16T13:37:30.279 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:37:29 smithi132 systemd[1]: ceph-4c8ed362-c768-11ea-a06f-001a4aab830c@mgr.y.service: Failed with result 'exit-code'. 2020-07-16T13:37:30.280 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:37:29 smithi132 systemd[1]: Stopped Ceph mgr.y for 4c8ed362-c768-11ea-a06f-001a4aab830c. 2020-07-16T13:37:30.280 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:37:30 smithi132 systemd[1]: Starting Ceph mgr.y for 4c8ed362-c768-11ea-a06f-001a4aab830c... 2020-07-16T13:37:30.280 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:37:30 smithi132 podman[10482]: Error: no container with name or ID ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mgr.y found: no such container 2020-07-16T13:37:30.281 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:37:30 smithi132 systemd[1]: Started Ceph mgr.y for 4c8ed362-c768-11ea-a06f-001a4aab830c. 2020-07-16T13:37:30.281 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:37:30 smithi132 bash[10496]: Error: Failed to evict container: "": Failed to find container "ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mgr.y" in state: no container with name or ID ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mgr.y found: no such container 2020-07-16T13:37:30.281 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:37:30 smithi132 bash[10496]: ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mgr.y 2020-07-16T13:37:30.282 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:37:30 smithi132 bash[10496]: Error: no container with ID or name "ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mgr.y" found: no such container 2020-07-16T13:37:30.780 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:37:30 smithi132 podman[10532]: 2020-07-16 13:37:30.395619774 +0000 UTC m=+0.220789196 container create 9f86dd60ad4e035fabb2c5cc8b7c48ba4e2b5ac22cafdfa1372ed50eaea72d1c (image=quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mgr.y) 2020-07-16T13:37:30.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:30 smithi132 bash[27079]: cluster 2020-07-16T13:37:28.855944+0000 mgr.x (mgr.34499) 40 : cluster [DBG] pgmap v17: 1 pgs: 1 active+clean; 0 B data, 4.1 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:37:30.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:30 smithi132 bash[27079]: audit 2020-07-16T13:37:30.113698+0000 mon.b (mon.2) 90 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290549\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290723\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290827\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290927\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291025\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:03.963129\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:37:30.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:30 smithi132 bash[27079]: audit 2020-07-16T13:37:30.114233+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290549\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290723\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290827\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290927\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291025\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:03.963129\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:37:30.782 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:30 smithi132 bash[27079]: audit 2020-07-16T13:37:30.117841+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290549\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290723\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290827\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290927\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291025\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:03.963129\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:37:30.782 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:30 smithi132 bash[27079]: audit 2020-07-16T13:37:30.119148+0000 mon.b (mon.2) 91 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:37:30.782 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:30 smithi132 bash[27079]: audit 2020-07-16T13:37:30.119444+0000 mon.b (mon.2) 92 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:37:30.783 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:30 smithi132 bash[23299]: cluster 2020-07-16T13:37:28.855944+0000 mgr.x (mgr.34499) 40 : cluster [DBG] pgmap v17: 1 pgs: 1 active+clean; 0 B data, 4.1 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:37:30.783 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:30 smithi132 bash[23299]: audit 2020-07-16T13:37:30.113698+0000 mon.b (mon.2) 90 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290549\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290723\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290827\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290927\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291025\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:03.963129\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:37:30.783 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:30 smithi132 bash[23299]: audit 2020-07-16T13:37:30.114233+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290549\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290723\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290827\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290927\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291025\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:03.963129\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:37:30.784 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:30 smithi132 bash[23299]: audit 2020-07-16T13:37:30.117841+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290549\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290723\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290827\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290927\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291025\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:03.963129\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:37:30.784 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:30 smithi132 bash[23299]: audit 2020-07-16T13:37:30.119148+0000 mon.b (mon.2) 91 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:37:30.784 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:30 smithi132 bash[23299]: audit 2020-07-16T13:37:30.119444+0000 mon.b (mon.2) 92 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:37:30.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:30 smithi188 bash[23329]: cluster 2020-07-16T13:37:28.855944+0000 mgr.x (mgr.34499) 40 : cluster [DBG] pgmap v17: 1 pgs: 1 active+clean; 0 B data, 4.1 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:37:30.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:30 smithi188 bash[23329]: audit 2020-07-16T13:37:30.113698+0000 mon.b (mon.2) 90 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290549\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290723\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290827\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290927\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291025\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:03.963129\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:37:30.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:30 smithi188 bash[23329]: audit 2020-07-16T13:37:30.114233+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290549\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290723\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290827\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290927\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291025\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:03.963129\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:37:30.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:30 smithi188 bash[23329]: audit 2020-07-16T13:37:30.117841+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290549\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290723\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290827\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.290927\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:03.291025\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:03.963129\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:37:30.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:30 smithi188 bash[23329]: audit 2020-07-16T13:37:30.119148+0000 mon.b (mon.2) 91 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:37:30.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:30 smithi188 bash[23329]: audit 2020-07-16T13:37:30.119444+0000 mon.b (mon.2) 92 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:37:31.173 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:37:30 smithi132 podman[10532]: 2020-07-16 13:37:30.830762771 +0000 UTC m=+0.655932280 container init 9f86dd60ad4e035fabb2c5cc8b7c48ba4e2b5ac22cafdfa1372ed50eaea72d1c (image=quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mgr.y) 2020-07-16T13:37:31.174 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:37:30 smithi132 podman[10532]: 2020-07-16 13:37:30.872367315 +0000 UTC m=+0.697536737 container start 9f86dd60ad4e035fabb2c5cc8b7c48ba4e2b5ac22cafdfa1372ed50eaea72d1c (image=quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mgr.y) 2020-07-16T13:37:31.174 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:37:30 smithi132 podman[10532]: 2020-07-16 13:37:30.872438299 +0000 UTC m=+0.697607747 container attach 9f86dd60ad4e035fabb2c5cc8b7c48ba4e2b5ac22cafdfa1372ed50eaea72d1c (image=quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mgr.y) 2020-07-16T13:37:31.174 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:37:30 smithi132 bash[10496]: debug 2020-07-16T13:37:30.856+0000 7f3aad53d380 1 -- 172.21.15.132:0/777126020 shutdown_connections 2020-07-16T13:37:31.175 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:37:30 smithi132 bash[10496]: debug 2020-07-16T13:37:30.856+0000 7f3aad53d380 1 --2- 172.21.15.132:0/777126020 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5564dace3400 0x5564dad66300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-07-16T13:37:31.175 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:37:30 smithi132 bash[10496]: debug 2020-07-16T13:37:30.856+0000 7f3aad53d380 1 --2- 172.21.15.132:0/777126020 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5564dace2c00 0x5564dad65900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-07-16T13:37:31.175 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:37:30 smithi132 bash[10496]: debug 2020-07-16T13:37:30.856+0000 7f3aad53d380 1 --2- 172.21.15.132:0/777126020 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5564dace3000 0x5564dad65e00 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-07-16T13:37:31.176 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:37:30 smithi132 bash[10496]: debug 2020-07-16T13:37:30.856+0000 7f3aad53d380 1 -- 172.21.15.132:0/777126020 >> 172.21.15.132:0/777126020 conn(0x5564dace2800 msgr2=0x5564db954800 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T13:37:31.176 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:37:30 smithi132 bash[10496]: debug 2020-07-16T13:37:30.856+0000 7f3aad53d380 1 -- 172.21.15.132:0/777126020 shutdown_connections 2020-07-16T13:37:31.176 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:37:30 smithi132 bash[10496]: debug 2020-07-16T13:37:30.856+0000 7f3aad53d380 1 -- 172.21.15.132:0/777126020 wait complete. 2020-07-16T13:37:32.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:32 smithi188 bash[23329]: cluster 2020-07-16T13:37:30.856234+0000 mgr.x (mgr.34499) 41 : cluster [DBG] pgmap v18: 1 pgs: 1 active+clean; 0 B data, 4.1 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:37:33.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:32 smithi132 bash[27079]: cluster 2020-07-16T13:37:30.856234+0000 mgr.x (mgr.34499) 41 : cluster [DBG] pgmap v18: 1 pgs: 1 active+clean; 0 B data, 4.1 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:37:33.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:32 smithi132 bash[23299]: cluster 2020-07-16T13:37:30.856234+0000 mgr.x (mgr.34499) 41 : cluster [DBG] pgmap v18: 1 pgs: 1 active+clean; 0 B data, 4.1 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:37:33.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:33 smithi188 bash[23329]: audit 2020-07-16T13:37:32.634316+0000 mon.b (mon.2) 93 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632864\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632944\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632975\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633004\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633155\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633259\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633374\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633475\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633508\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:03.963129\"}}, \"last_daemon_update\": \"2020-07-16T13:37:32.633581\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:37:33.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:33 smithi188 bash[23329]: audit 2020-07-16T13:37:32.634787+0000 mon.a (mon.0) 624 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632864\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632944\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632975\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633004\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633155\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633259\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633374\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633475\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633508\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:03.963129\"}}, \"last_daemon_update\": \"2020-07-16T13:37:32.633581\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:37:33.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:33 smithi188 bash[23329]: audit 2020-07-16T13:37:32.644219+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632864\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632944\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632975\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633004\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633155\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633259\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633374\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633475\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633508\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:03.963129\"}}, \"last_daemon_update\": \"2020-07-16T13:37:32.633581\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:37:33.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:33 smithi188 bash[23329]: audit 2020-07-16T13:37:32.689336+0000 mon.b (mon.2) 94 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.687808\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.687880\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.687910\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.688065\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.688169\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.688270\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.688406\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.688441\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.688470\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:37:32.688539\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:37:33.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:33 smithi188 bash[23329]: audit 2020-07-16T13:37:32.690055+0000 mon.a (mon.0) 626 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.687808\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.687880\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.687910\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.688065\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.688169\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.688270\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.688406\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.688441\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.688470\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:37:32.688539\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:37:33.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:33 smithi188 bash[23329]: audit 2020-07-16T13:37:32.696119+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.687808\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.687880\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.687910\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.688065\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.688169\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.688270\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.688406\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.688441\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.688470\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:37:32.688539\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:37:33.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:33 smithi188 bash[23329]: audit 2020-07-16T13:37:32.698323+0000 mon.b (mon.2) 95 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:37:33.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:33 smithi188 bash[23329]: audit 2020-07-16T13:37:32.699288+0000 mon.b (mon.2) 96 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:37:33.925 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:33 smithi188 bash[23329]: audit 2020-07-16T13:37:32.700123+0000 mon.b (mon.2) 97 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:37:33.926 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:33 smithi188 bash[23329]: audit 2020-07-16T13:37:32.701105+0000 mon.b (mon.2) 98 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T13:37:33.926 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:33 smithi188 bash[23329]: audit 2020-07-16T13:37:32.702020+0000 mon.b (mon.2) 99 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:37:33.926 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:33 smithi188 bash[23329]: audit 2020-07-16T13:37:32.702925+0000 mon.b (mon.2) 100 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca", "who": "mgr"}]: dispatch 2020-07-16T13:37:33.927 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:33 smithi188 bash[23329]: audit 2020-07-16T13:37:32.703257+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca", "who": "mgr"}]: dispatch 2020-07-16T13:37:33.927 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:33 smithi188 bash[23329]: audit 2020-07-16T13:37:32.706632+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca", "who": "mgr"}]': finished 2020-07-16T13:37:33.927 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:33 smithi188 bash[23329]: audit 2020-07-16T13:37:32.707411+0000 mon.b (mon.2) 101 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2020-07-16T13:37:33.927 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:33 smithi188 bash[23329]: audit 2020-07-16T13:37:32.707731+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2020-07-16T13:37:33.927 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:33 smithi188 bash[23329]: audit 2020-07-16T13:37:32.713581+0000 mon.a (mon.0) 631 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2020-07-16T13:37:33.928 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:33 smithi188 bash[23329]: audit 2020-07-16T13:37:32.714256+0000 mon.b (mon.2) 102 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2020-07-16T13:37:33.928 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:33 smithi188 bash[23329]: audit 2020-07-16T13:37:32.714544+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2020-07-16T13:37:33.928 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:33 smithi188 bash[23329]: audit 2020-07-16T13:37:32.719923+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2020-07-16T13:37:34.031 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:33 smithi132 bash[23299]: audit 2020-07-16T13:37:32.634316+0000 mon.b (mon.2) 93 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632864\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632944\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632975\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633004\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633155\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633259\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633374\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633475\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633508\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:03.963129\"}}, \"last_daemon_update\": \"2020-07-16T13:37:32.633581\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:37:34.031 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:33 smithi132 bash[23299]: audit 2020-07-16T13:37:32.634787+0000 mon.a (mon.0) 624 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632864\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632944\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632975\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633004\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633155\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633259\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633374\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633475\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633508\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:03.963129\"}}, \"last_daemon_update\": \"2020-07-16T13:37:32.633581\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:37:34.032 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:33 smithi132 bash[23299]: audit 2020-07-16T13:37:32.644219+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632864\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632944\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632975\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633004\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633155\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633259\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633374\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633475\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633508\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:03.963129\"}}, \"last_daemon_update\": \"2020-07-16T13:37:32.633581\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:37:34.032 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:33 smithi132 bash[23299]: audit 2020-07-16T13:37:32.689336+0000 mon.b (mon.2) 94 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.687808\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.687880\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.687910\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.688065\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.688169\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.688270\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.688406\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.688441\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.688470\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:37:32.688539\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:37:34.033 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:33 smithi132 bash[23299]: audit 2020-07-16T13:37:32.690055+0000 mon.a (mon.0) 626 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.687808\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.687880\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.687910\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.688065\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.688169\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.688270\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.688406\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.688441\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.688470\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:37:32.688539\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:37:34.033 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:33 smithi132 bash[23299]: audit 2020-07-16T13:37:32.696119+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.687808\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.687880\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.687910\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.688065\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.688169\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.688270\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.688406\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.688441\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.688470\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:37:32.688539\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:37:34.033 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:33 smithi132 bash[23299]: audit 2020-07-16T13:37:32.698323+0000 mon.b (mon.2) 95 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:37:34.034 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:33 smithi132 bash[23299]: audit 2020-07-16T13:37:32.699288+0000 mon.b (mon.2) 96 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:37:34.034 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:33 smithi132 bash[23299]: audit 2020-07-16T13:37:32.700123+0000 mon.b (mon.2) 97 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:37:34.034 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:33 smithi132 bash[23299]: audit 2020-07-16T13:37:32.701105+0000 mon.b (mon.2) 98 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T13:37:34.035 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:33 smithi132 bash[23299]: audit 2020-07-16T13:37:32.702020+0000 mon.b (mon.2) 99 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:37:34.035 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:33 smithi132 bash[23299]: audit 2020-07-16T13:37:32.702925+0000 mon.b (mon.2) 100 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca", "who": "mgr"}]: dispatch 2020-07-16T13:37:34.035 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:33 smithi132 bash[23299]: audit 2020-07-16T13:37:32.703257+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca", "who": "mgr"}]: dispatch 2020-07-16T13:37:34.035 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:33 smithi132 bash[23299]: audit 2020-07-16T13:37:32.706632+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca", "who": "mgr"}]': finished 2020-07-16T13:37:34.035 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:33 smithi132 bash[23299]: audit 2020-07-16T13:37:32.707411+0000 mon.b (mon.2) 101 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2020-07-16T13:37:34.036 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:33 smithi132 bash[23299]: audit 2020-07-16T13:37:32.707731+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2020-07-16T13:37:34.036 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:33 smithi132 bash[23299]: audit 2020-07-16T13:37:32.713581+0000 mon.a (mon.0) 631 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2020-07-16T13:37:34.036 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:33 smithi132 bash[23299]: audit 2020-07-16T13:37:32.714256+0000 mon.b (mon.2) 102 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2020-07-16T13:37:34.036 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:33 smithi132 bash[23299]: audit 2020-07-16T13:37:32.714544+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2020-07-16T13:37:34.036 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:33 smithi132 bash[23299]: audit 2020-07-16T13:37:32.719923+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2020-07-16T13:37:34.037 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:33 smithi132 bash[27079]: audit 2020-07-16T13:37:32.634316+0000 mon.b (mon.2) 93 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632864\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632944\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632975\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633004\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633155\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633259\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633374\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633475\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633508\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:03.963129\"}}, \"last_daemon_update\": \"2020-07-16T13:37:32.633581\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:37:34.037 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:33 smithi132 bash[27079]: audit 2020-07-16T13:37:32.634787+0000 mon.a (mon.0) 624 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632864\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632944\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632975\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633004\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633155\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633259\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633374\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633475\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633508\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:03.963129\"}}, \"last_daemon_update\": \"2020-07-16T13:37:32.633581\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:37:34.037 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:33 smithi132 bash[27079]: audit 2020-07-16T13:37:32.644219+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"fa8441eb419e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632864\", \"created\": \"2020-07-16T13:29:34.140048\", \"started\": \"2020-07-16T13:29:39.080450\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632944\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632975\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633004\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633155\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633259\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633374\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633475\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633508\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:03.963129\"}}, \"last_daemon_update\": \"2020-07-16T13:37:32.633581\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:37:34.038 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:33 smithi132 bash[27079]: audit 2020-07-16T13:37:32.689336+0000 mon.b (mon.2) 94 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.687808\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.687880\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.687910\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.688065\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.688169\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.688270\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.688406\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.688441\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.688470\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:37:32.688539\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:37:34.038 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:33 smithi132 bash[27079]: audit 2020-07-16T13:37:32.690055+0000 mon.a (mon.0) 626 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.687808\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.687880\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.687910\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.688065\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.688169\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.688270\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.688406\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.688441\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.688470\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:37:32.688539\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:37:34.038 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:33 smithi132 bash[27079]: audit 2020-07-16T13:37:32.696119+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.687808\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.687880\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.687910\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.688065\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.688169\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.688270\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.688406\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.688441\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.688470\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:37:32.688539\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:37:34.039 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:33 smithi132 bash[27079]: audit 2020-07-16T13:37:32.698323+0000 mon.b (mon.2) 95 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:37:34.039 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:33 smithi132 bash[27079]: audit 2020-07-16T13:37:32.699288+0000 mon.b (mon.2) 96 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:37:34.040 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:33 smithi132 bash[27079]: audit 2020-07-16T13:37:32.700123+0000 mon.b (mon.2) 97 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:37:34.040 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:33 smithi132 bash[27079]: audit 2020-07-16T13:37:32.701105+0000 mon.b (mon.2) 98 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T13:37:34.040 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:33 smithi132 bash[27079]: audit 2020-07-16T13:37:32.702020+0000 mon.b (mon.2) 99 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:37:34.040 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:33 smithi132 bash[27079]: audit 2020-07-16T13:37:32.702925+0000 mon.b (mon.2) 100 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca", "who": "mgr"}]: dispatch 2020-07-16T13:37:34.041 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:33 smithi132 bash[27079]: audit 2020-07-16T13:37:32.703257+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca", "who": "mgr"}]: dispatch 2020-07-16T13:37:34.041 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:33 smithi132 bash[27079]: audit 2020-07-16T13:37:32.706632+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca", "who": "mgr"}]': finished 2020-07-16T13:37:34.041 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:33 smithi132 bash[27079]: audit 2020-07-16T13:37:32.707411+0000 mon.b (mon.2) 101 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2020-07-16T13:37:34.041 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:33 smithi132 bash[27079]: audit 2020-07-16T13:37:32.707731+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2020-07-16T13:37:34.041 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:33 smithi132 bash[27079]: audit 2020-07-16T13:37:32.713581+0000 mon.a (mon.0) 631 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2020-07-16T13:37:34.042 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:33 smithi132 bash[27079]: audit 2020-07-16T13:37:32.714256+0000 mon.b (mon.2) 102 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2020-07-16T13:37:34.042 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:33 smithi132 bash[27079]: audit 2020-07-16T13:37:32.714544+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2020-07-16T13:37:34.042 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:33 smithi132 bash[27079]: audit 2020-07-16T13:37:32.719923+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2020-07-16T13:37:34.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:34 smithi188 bash[23329]: audit 2020-07-16T13:37:32.698603+0000 mgr.x (mgr.34499) 42 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:37:34.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:34 smithi188 bash[23329]: audit 2020-07-16T13:37:32.699538+0000 mgr.x (mgr.34499) 43 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:37:34.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:34 smithi188 bash[23329]: audit 2020-07-16T13:37:32.700373+0000 mgr.x (mgr.34499) 44 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:37:34.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:34 smithi188 bash[23329]: cephadm 2020-07-16T13:37:32.700881+0000 mgr.x (mgr.34499) 45 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T13:37:34.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:34 smithi188 bash[23329]: cephadm 2020-07-16T13:37:32.701731+0000 mgr.x (mgr.34499) 46 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T13:37:34.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:34 smithi188 bash[23329]: cephadm 2020-07-16T13:37:32.702547+0000 mgr.x (mgr.34499) 47 : cephadm [WRN] Upgrade: 1 mgr daemon(s) are ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc) != target ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev) 2020-07-16T13:37:34.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:34 smithi188 bash[23329]: cephadm 2020-07-16T13:37:32.702744+0000 mgr.x (mgr.34499) 48 : cephadm [INF] Upgrade: Setting container_image for all mgr... 2020-07-16T13:37:34.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:34 smithi188 bash[23329]: cephadm 2020-07-16T13:37:32.720761+0000 mgr.x (mgr.34499) 49 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T13:37:34.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:34 smithi188 bash[23329]: cephadm 2020-07-16T13:37:32.720949+0000 mgr.x (mgr.34499) 50 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T13:37:34.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:34 smithi188 bash[23329]: cluster 2020-07-16T13:37:32.856544+0000 mgr.x (mgr.34499) 51 : cluster [DBG] pgmap v19: 1 pgs: 1 active+clean; 0 B data, 4.1 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:37:34.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:34 smithi188 bash[23329]: audit 2020-07-16T13:37:34.242440+0000 mon.b (mon.2) 103 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2020-07-16T13:37:34.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:34 smithi188 bash[23329]: audit 2020-07-16T13:37:34.243691+0000 mon.b (mon.2) 104 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca", "who": "mon.a"}]: dispatch 2020-07-16T13:37:34.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:34 smithi188 bash[23329]: audit 2020-07-16T13:37:34.244069+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca", "who": "mon.a"}]: dispatch 2020-07-16T13:37:34.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:34 smithi188 bash[23329]: audit 2020-07-16T13:37:34.247573+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca", "who": "mon.a"}]': finished 2020-07-16T13:37:34.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:34 smithi188 bash[23329]: audit 2020-07-16T13:37:34.248922+0000 mon.b (mon.2) 105 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2020-07-16T13:37:34.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:34 smithi188 bash[23329]: audit 2020-07-16T13:37:34.249625+0000 mon.b (mon.2) 106 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:37:34.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:34 smithi188 bash[23329]: audit 2020-07-16T13:37:34.250721+0000 mon.b (mon.2) 107 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon.a", "key": "container_image"}]: dispatch 2020-07-16T13:37:34.973 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:34 smithi132 bash[27079]: audit 2020-07-16T13:37:32.698603+0000 mgr.x (mgr.34499) 42 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:37:34.973 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:34 smithi132 bash[27079]: audit 2020-07-16T13:37:32.699538+0000 mgr.x (mgr.34499) 43 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:37:34.973 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:34 smithi132 bash[27079]: audit 2020-07-16T13:37:32.700373+0000 mgr.x (mgr.34499) 44 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:37:34.974 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:34 smithi132 bash[27079]: cephadm 2020-07-16T13:37:32.700881+0000 mgr.x (mgr.34499) 45 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T13:37:34.974 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:34 smithi132 bash[27079]: cephadm 2020-07-16T13:37:32.701731+0000 mgr.x (mgr.34499) 46 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T13:37:34.974 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:34 smithi132 bash[27079]: cephadm 2020-07-16T13:37:32.702547+0000 mgr.x (mgr.34499) 47 : cephadm [WRN] Upgrade: 1 mgr daemon(s) are ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc) != target ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev) 2020-07-16T13:37:34.974 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:34 smithi132 bash[27079]: cephadm 2020-07-16T13:37:32.702744+0000 mgr.x (mgr.34499) 48 : cephadm [INF] Upgrade: Setting container_image for all mgr... 2020-07-16T13:37:34.975 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:34 smithi132 bash[27079]: cephadm 2020-07-16T13:37:32.720761+0000 mgr.x (mgr.34499) 49 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T13:37:34.975 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:34 smithi132 bash[27079]: cephadm 2020-07-16T13:37:32.720949+0000 mgr.x (mgr.34499) 50 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T13:37:34.975 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:34 smithi132 bash[27079]: cluster 2020-07-16T13:37:32.856544+0000 mgr.x (mgr.34499) 51 : cluster [DBG] pgmap v19: 1 pgs: 1 active+clean; 0 B data, 4.1 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:37:34.975 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:34 smithi132 bash[27079]: audit 2020-07-16T13:37:34.242440+0000 mon.b (mon.2) 103 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2020-07-16T13:37:34.975 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:34 smithi132 bash[27079]: audit 2020-07-16T13:37:34.243691+0000 mon.b (mon.2) 104 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca", "who": "mon.a"}]: dispatch 2020-07-16T13:37:34.976 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:34 smithi132 bash[27079]: audit 2020-07-16T13:37:34.244069+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca", "who": "mon.a"}]: dispatch 2020-07-16T13:37:34.976 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:34 smithi132 bash[27079]: audit 2020-07-16T13:37:34.247573+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca", "who": "mon.a"}]': finished 2020-07-16T13:37:34.976 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:34 smithi132 bash[27079]: audit 2020-07-16T13:37:34.248922+0000 mon.b (mon.2) 105 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2020-07-16T13:37:34.976 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:34 smithi132 bash[27079]: audit 2020-07-16T13:37:34.249625+0000 mon.b (mon.2) 106 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:37:34.976 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:34 smithi132 bash[27079]: audit 2020-07-16T13:37:34.250721+0000 mon.b (mon.2) 107 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon.a", "key": "container_image"}]: dispatch 2020-07-16T13:37:34.977 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:34 smithi132 bash[23299]: audit 2020-07-16T13:37:32.698603+0000 mgr.x (mgr.34499) 42 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:37:34.977 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:34 smithi132 bash[23299]: audit 2020-07-16T13:37:32.699538+0000 mgr.x (mgr.34499) 43 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:37:34.977 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:34 smithi132 bash[23299]: audit 2020-07-16T13:37:32.700373+0000 mgr.x (mgr.34499) 44 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:37:34.977 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:34 smithi132 bash[23299]: cephadm 2020-07-16T13:37:32.700881+0000 mgr.x (mgr.34499) 45 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T13:37:34.977 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:34 smithi132 bash[23299]: cephadm 2020-07-16T13:37:32.701731+0000 mgr.x (mgr.34499) 46 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T13:37:34.978 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:34 smithi132 bash[23299]: cephadm 2020-07-16T13:37:32.702547+0000 mgr.x (mgr.34499) 47 : cephadm [WRN] Upgrade: 1 mgr daemon(s) are ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc) != target ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev) 2020-07-16T13:37:34.978 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:34 smithi132 bash[23299]: cephadm 2020-07-16T13:37:32.702744+0000 mgr.x (mgr.34499) 48 : cephadm [INF] Upgrade: Setting container_image for all mgr... 2020-07-16T13:37:34.978 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:34 smithi132 bash[23299]: cephadm 2020-07-16T13:37:32.720761+0000 mgr.x (mgr.34499) 49 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T13:37:34.978 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:34 smithi132 bash[23299]: cephadm 2020-07-16T13:37:32.720949+0000 mgr.x (mgr.34499) 50 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T13:37:34.978 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:34 smithi132 bash[23299]: cluster 2020-07-16T13:37:32.856544+0000 mgr.x (mgr.34499) 51 : cluster [DBG] pgmap v19: 1 pgs: 1 active+clean; 0 B data, 4.1 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:37:34.979 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:34 smithi132 bash[23299]: audit 2020-07-16T13:37:34.242440+0000 mon.b (mon.2) 103 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2020-07-16T13:37:34.979 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:34 smithi132 bash[23299]: audit 2020-07-16T13:37:34.243691+0000 mon.b (mon.2) 104 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca", "who": "mon.a"}]: dispatch 2020-07-16T13:37:34.979 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:34 smithi132 bash[23299]: audit 2020-07-16T13:37:34.244069+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca", "who": "mon.a"}]: dispatch 2020-07-16T13:37:34.979 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:34 smithi132 bash[23299]: audit 2020-07-16T13:37:34.247573+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.34499 ' entity='mgr.x' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca", "who": "mon.a"}]': finished 2020-07-16T13:37:34.979 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:34 smithi132 bash[23299]: audit 2020-07-16T13:37:34.248922+0000 mon.b (mon.2) 105 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2020-07-16T13:37:34.980 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:34 smithi132 bash[23299]: audit 2020-07-16T13:37:34.249625+0000 mon.b (mon.2) 106 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-07-16T13:37:34.980 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:34 smithi132 bash[23299]: audit 2020-07-16T13:37:34.250721+0000 mon.b (mon.2) 107 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon.a", "key": "container_image"}]: dispatch 2020-07-16T13:37:35.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:35 smithi132 bash[27079]: cephadm 2020-07-16T13:37:34.243039+0000 mgr.x (mgr.34499) 52 : cephadm [INF] Upgrade: It is presumed safe to stop mon.a 2020-07-16T13:37:35.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:35 smithi132 bash[27079]: cephadm 2020-07-16T13:37:34.243414+0000 mgr.x (mgr.34499) 53 : cephadm [INF] Upgrade: Redeploying mon.a 2020-07-16T13:37:35.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:35 smithi132 bash[27079]: cephadm 2020-07-16T13:37:34.250161+0000 mgr.x (mgr.34499) 54 : cephadm [INF] Deploying daemon mon.a on smithi132 2020-07-16T13:37:35.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:35 smithi132 bash[27079]: cluster 2020-07-16T13:37:34.737122+0000 mon.a (mon.0) 636 : cluster [DBG] Standby manager daemon y restarted 2020-07-16T13:37:35.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:35 smithi132 bash[27079]: cluster 2020-07-16T13:37:34.737233+0000 mon.a (mon.0) 637 : cluster [DBG] Standby manager daemon y started 2020-07-16T13:37:35.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:35 smithi132 bash[27079]: audit 2020-07-16T13:37:34.737294+0000 mon.c (mon.1) 26 : audit [DBG] from='mgr.? 172.21.15.132:0/2613558882' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2020-07-16T13:37:35.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:35 smithi132 bash[27079]: audit 2020-07-16T13:37:34.738816+0000 mon.c (mon.1) 27 : audit [DBG] from='mgr.? 172.21.15.132:0/2613558882' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2020-07-16T13:37:35.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:35 smithi132 bash[27079]: cluster 2020-07-16T13:37:34.856996+0000 mgr.x (mgr.34499) 55 : cluster [DBG] pgmap v20: 1 pgs: 1 active+clean; 0 B data, 4.1 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:37:35.781 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:35 smithi132 systemd[1]: Stopping Ceph mon.a for 4c8ed362-c768-11ea-a06f-001a4aab830c... 2020-07-16T13:37:35.781 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:35 smithi132 bash[23299]: cephadm 2020-07-16T13:37:34.243039+0000 mgr.x (mgr.34499) 52 : cephadm [INF] Upgrade: It is presumed safe to stop mon.a 2020-07-16T13:37:35.781 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:35 smithi132 bash[23299]: cephadm 2020-07-16T13:37:34.243414+0000 mgr.x (mgr.34499) 53 : cephadm [INF] Upgrade: Redeploying mon.a 2020-07-16T13:37:35.782 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:35 smithi132 bash[23299]: cephadm 2020-07-16T13:37:34.250161+0000 mgr.x (mgr.34499) 54 : cephadm [INF] Deploying daemon mon.a on smithi132 2020-07-16T13:37:35.782 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:35 smithi132 bash[23299]: cluster 2020-07-16T13:37:34.737122+0000 mon.a (mon.0) 636 : cluster [DBG] Standby manager daemon y restarted 2020-07-16T13:37:35.782 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:35 smithi132 bash[23299]: cluster 2020-07-16T13:37:34.737233+0000 mon.a (mon.0) 637 : cluster [DBG] Standby manager daemon y started 2020-07-16T13:37:35.782 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:35 smithi132 bash[23299]: audit 2020-07-16T13:37:34.737294+0000 mon.c (mon.1) 26 : audit [DBG] from='mgr.? 172.21.15.132:0/2613558882' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2020-07-16T13:37:35.783 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:35 smithi132 bash[23299]: audit 2020-07-16T13:37:34.738816+0000 mon.c (mon.1) 27 : audit [DBG] from='mgr.? 172.21.15.132:0/2613558882' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2020-07-16T13:37:35.783 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:35 smithi132 bash[23299]: cluster 2020-07-16T13:37:34.856996+0000 mgr.x (mgr.34499) 55 : cluster [DBG] pgmap v20: 1 pgs: 1 active+clean; 0 B data, 4.1 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:37:35.783 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:35 smithi132 bash[23299]: debug 2020-07-16T13:37:35.688+0000 7f013172a700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2020-07-16T13:37:35.783 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:35 smithi132 bash[23299]: debug 2020-07-16T13:37:35.688+0000 7f013172a700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2020-07-16T13:37:35.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:35 smithi188 bash[23329]: cephadm 2020-07-16T13:37:34.243039+0000 mgr.x (mgr.34499) 52 : cephadm [INF] Upgrade: It is presumed safe to stop mon.a 2020-07-16T13:37:35.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:35 smithi188 bash[23329]: cephadm 2020-07-16T13:37:34.243414+0000 mgr.x (mgr.34499) 53 : cephadm [INF] Upgrade: Redeploying mon.a 2020-07-16T13:37:35.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:35 smithi188 bash[23329]: cephadm 2020-07-16T13:37:34.250161+0000 mgr.x (mgr.34499) 54 : cephadm [INF] Deploying daemon mon.a on smithi132 2020-07-16T13:37:35.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:35 smithi188 bash[23329]: cluster 2020-07-16T13:37:34.737122+0000 mon.a (mon.0) 636 : cluster [DBG] Standby manager daemon y restarted 2020-07-16T13:37:35.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:35 smithi188 bash[23329]: cluster 2020-07-16T13:37:34.737233+0000 mon.a (mon.0) 637 : cluster [DBG] Standby manager daemon y started 2020-07-16T13:37:35.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:35 smithi188 bash[23329]: audit 2020-07-16T13:37:34.737294+0000 mon.c (mon.1) 26 : audit [DBG] from='mgr.? 172.21.15.132:0/2613558882' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2020-07-16T13:37:35.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:35 smithi188 bash[23329]: audit 2020-07-16T13:37:34.738816+0000 mon.c (mon.1) 27 : audit [DBG] from='mgr.? 172.21.15.132:0/2613558882' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2020-07-16T13:37:35.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:35 smithi188 bash[23329]: cluster 2020-07-16T13:37:34.856996+0000 mgr.x (mgr.34499) 55 : cluster [DBG] pgmap v20: 1 pgs: 1 active+clean; 0 B data, 4.1 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:37:36.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:35 smithi132 podman[11221]: 2020-07-16 13:37:35.865270435 +0000 UTC m=+0.211223926 container died fa8441eb419efc0ae0d02eab952f0f4b7293ad46aeefa0982bc1f82493859baa (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a) 2020-07-16T13:37:36.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:35 smithi132 podman[11221]: 2020-07-16 13:37:35.888308658 +0000 UTC m=+0.234262083 container stop fa8441eb419efc0ae0d02eab952f0f4b7293ad46aeefa0982bc1f82493859baa (image=docker.io/ceph/ceph:v15.2.0, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a) 2020-07-16T13:37:36.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:35 smithi132 podman[11221]: fa8441eb419efc0ae0d02eab952f0f4b7293ad46aeefa0982bc1f82493859baa 2020-07-16T13:37:36.786 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 systemd[1]: Stopped Ceph mon.a for 4c8ed362-c768-11ea-a06f-001a4aab830c. 2020-07-16T13:37:36.786 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 systemd[1]: Starting Ceph mon.a for 4c8ed362-c768-11ea-a06f-001a4aab830c... 2020-07-16T13:37:36.786 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 podman[11295]: Error: no container with name or ID ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a found: no such container 2020-07-16T13:37:36.786 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 systemd[1]: Started Ceph mon.a for 4c8ed362-c768-11ea-a06f-001a4aab830c. 2020-07-16T13:37:36.787 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: Error: Failed to evict container: "": Failed to find container "ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a" in state: no container with name or ID ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a found: no such container 2020-07-16T13:37:36.787 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a 2020-07-16T13:37:36.787 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: Error: no container with ID or name "ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a" found: no such container 2020-07-16T13:37:37.249 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 podman[11343]: 2020-07-16 13:37:36.813229618 +0000 UTC m=+0.242975860 container create f5f855da9cad32e8d9852181941a4a512acdf0bf0f825af7a71b136a83bfc693 (image=quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a) 2020-07-16T13:37:37.250 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 podman[11343]: 2020-07-16 13:37:36.954820942 +0000 UTC m=+0.384567082 container init f5f855da9cad32e8d9852181941a4a512acdf0bf0f825af7a71b136a83bfc693 (image=quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a) 2020-07-16T13:37:37.250 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 podman[11343]: 2020-07-16 13:37:36.988139944 +0000 UTC m=+0.417886076 container start f5f855da9cad32e8d9852181941a4a512acdf0bf0f825af7a71b136a83bfc693 (image=quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a) 2020-07-16T13:37:37.250 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 podman[11343]: 2020-07-16 13:37:36.988214349 +0000 UTC m=+0.417960515 container attach f5f855da9cad32e8d9852181941a4a512acdf0bf0f825af7a71b136a83bfc693 (image=quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a) 2020-07-16T13:37:37.250 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.978+0000 7fb2ff702700 0 set uid:gid to 167:167 (ceph:ceph) 2020-07-16T13:37:37.251 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.978+0000 7fb2ff702700 0 ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev), process ceph-mon, pid 1 2020-07-16T13:37:37.251 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.978+0000 7fb2ff702700 0 pidfile_write: ignore empty --pid-file 2020-07-16T13:37:37.251 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.982+0000 7fb2ff702700 0 load: jerasure load: lrc load: isa 2020-07-16T13:37:37.252 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: RocksDB version: 6.8.1 2020-07-16T13:37:37.252 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2020-07-16T13:37:37.252 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Compile date Jul 16 2020 2020-07-16T13:37:37.252 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: DB SUMMARY 2020-07-16T13:37:37.253 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: CURRENT file: CURRENT 2020-07-16T13:37:37.253 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: IDENTITY file: IDENTITY 2020-07-16T13:37:37.253 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: MANIFEST file: MANIFEST-000008 size: 380 Bytes 2020-07-16T13:37:37.254 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000016.sst 2020-07-16T13:37:37.255 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000014.log size: 5976129 ; 2020-07-16T13:37:37.256 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.error_if_exists: 0 2020-07-16T13:37:37.256 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.create_if_missing: 0 2020-07-16T13:37:37.256 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.paranoid_checks: 1 2020-07-16T13:37:37.257 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.env: 0x558a6fed2c00 2020-07-16T13:37:37.257 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.fs: Posix File System 2020-07-16T13:37:37.257 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.info_log: 0x558a711706c0 2020-07-16T13:37:37.258 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.max_file_opening_threads: 16 2020-07-16T13:37:37.258 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.statistics: (nil) 2020-07-16T13:37:37.258 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.use_fsync: 0 2020-07-16T13:37:37.258 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.max_log_file_size: 0 2020-07-16T13:37:37.259 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2020-07-16T13:37:37.259 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.log_file_time_to_roll: 0 2020-07-16T13:37:37.259 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.keep_log_file_num: 1000 2020-07-16T13:37:37.260 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.recycle_log_file_num: 0 2020-07-16T13:37:37.260 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.allow_fallocate: 1 2020-07-16T13:37:37.260 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.allow_mmap_reads: 0 2020-07-16T13:37:37.261 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.allow_mmap_writes: 0 2020-07-16T13:37:37.261 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.use_direct_reads: 0 2020-07-16T13:37:37.261 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2020-07-16T13:37:37.261 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.create_missing_column_families: 0 2020-07-16T13:37:37.262 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.db_log_dir: 2020-07-16T13:37:37.263 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2020-07-16T13:37:37.263 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.table_cache_numshardbits: 6 2020-07-16T13:37:37.263 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.max_subcompactions: 1 2020-07-16T13:37:37.263 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.max_background_flushes: -1 2020-07-16T13:37:37.263 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.WAL_ttl_seconds: 0 2020-07-16T13:37:37.264 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.WAL_size_limit_MB: 0 2020-07-16T13:37:37.264 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2020-07-16T13:37:37.264 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2020-07-16T13:37:37.264 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.is_fd_close_on_exec: 1 2020-07-16T13:37:37.264 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.advise_random_on_open: 1 2020-07-16T13:37:37.265 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.db_write_buffer_size: 0 2020-07-16T13:37:37.266 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.write_buffer_manager: 0x558a711bf380 2020-07-16T13:37:37.266 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2020-07-16T13:37:37.266 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2020-07-16T13:37:37.267 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2020-07-16T13:37:37.267 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.use_adaptive_mutex: 0 2020-07-16T13:37:37.267 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.rate_limiter: (nil) 2020-07-16T13:37:37.267 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2020-07-16T13:37:37.267 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.wal_recovery_mode: 2 2020-07-16T13:37:37.268 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.enable_thread_tracking: 0 2020-07-16T13:37:37.268 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.enable_pipelined_write: 0 2020-07-16T13:37:37.268 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.unordered_write: 0 2020-07-16T13:37:37.268 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2020-07-16T13:37:37.268 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2020-07-16T13:37:37.269 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2020-07-16T13:37:37.269 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2020-07-16T13:37:37.269 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.row_cache: None 2020-07-16T13:37:37.269 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.wal_filter: None 2020-07-16T13:37:37.270 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2020-07-16T13:37:37.270 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.allow_ingest_behind: 0 2020-07-16T13:37:37.270 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.preserve_deletes: 0 2020-07-16T13:37:37.270 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.two_write_queues: 0 2020-07-16T13:37:37.270 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.manual_wal_flush: 0 2020-07-16T13:37:37.271 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.atomic_flush: 0 2020-07-16T13:37:37.271 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2020-07-16T13:37:37.271 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.persist_stats_to_disk: 0 2020-07-16T13:37:37.271 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.write_dbid_to_manifest: 0 2020-07-16T13:37:37.271 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.log_readahead_size: 0 2020-07-16T13:37:37.271 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2020-07-16T13:37:37.272 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.max_background_jobs: 2 2020-07-16T13:37:37.272 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.max_background_compactions: -1 2020-07-16T13:37:37.272 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2020-07-16T13:37:37.272 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2020-07-16T13:37:37.272 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.delayed_write_rate : 16777216 2020-07-16T13:37:37.273 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.max_total_wal_size: 0 2020-07-16T13:37:37.273 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2020-07-16T13:37:37.273 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.stats_dump_period_sec: 600 2020-07-16T13:37:37.273 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.stats_persist_period_sec: 600 2020-07-16T13:37:37.273 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2020-07-16T13:37:37.274 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.max_open_files: -1 2020-07-16T13:37:37.274 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.bytes_per_sync: 0 2020-07-16T13:37:37.274 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.wal_bytes_per_sync: 0 2020-07-16T13:37:37.274 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.strict_bytes_per_sync: 0 2020-07-16T13:37:37.274 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.compaction_readahead_size: 0 2020-07-16T13:37:37.275 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Compression algorithms supported: 2020-07-16T13:37:37.275 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2020-07-16T13:37:37.275 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: kZSTD supported: 0 2020-07-16T13:37:37.276 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: kXpressCompression supported: 0 2020-07-16T13:37:37.276 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: kLZ4HCCompression supported: 1 2020-07-16T13:37:37.276 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: kLZ4Compression supported: 1 2020-07-16T13:37:37.276 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: kBZip2Compression supported: 0 2020-07-16T13:37:37.277 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: kZlibCompression supported: 1 2020-07-16T13:37:37.277 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: kSnappyCompression supported: 1 2020-07-16T13:37:37.277 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Fast CRC32 supported: Supported on x86 2020-07-16T13:37:37.277 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000008 2020-07-16T13:37:37.277 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2020-07-16T13:37:37.278 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2020-07-16T13:37:37.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.merge_operator: 2020-07-16T13:37:37.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.compaction_filter: None 2020-07-16T13:37:37.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.compaction_filter_factory: None 2020-07-16T13:37:37.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.memtable_factory: SkipListFactory 2020-07-16T13:37:37.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.table_factory: BlockBasedTable 2020-07-16T13:37:37.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x558a71113bd8) 2020-07-16T13:37:37.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: cache_index_and_filter_blocks: 1 2020-07-16T13:37:37.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: cache_index_and_filter_blocks_with_high_priority: 1 2020-07-16T13:37:37.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: pin_l0_filter_and_index_blocks_in_cache: 0 2020-07-16T13:37:37.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: pin_top_level_index_and_filter: 1 2020-07-16T13:37:37.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: index_type: 0 2020-07-16T13:37:37.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: data_block_index_type: 0 2020-07-16T13:37:37.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: index_shortening: 1 2020-07-16T13:37:37.282 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: data_block_hash_table_util_ratio: 0.750000 2020-07-16T13:37:37.282 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: hash_index_allow_collision: 1 2020-07-16T13:37:37.282 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: checksum: 1 2020-07-16T13:37:37.282 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: no_block_cache: 0 2020-07-16T13:37:37.282 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: block_cache: 0x558a7114c610 2020-07-16T13:37:37.282 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: block_cache_name: BinnedLRUCache 2020-07-16T13:37:37.283 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: block_cache_options: 2020-07-16T13:37:37.283 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: capacity : 536870912 2020-07-16T13:37:37.283 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: num_shard_bits : 4 2020-07-16T13:37:37.283 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: strict_capacity_limit : 0 2020-07-16T13:37:37.283 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: high_pri_pool_ratio: 0.000 2020-07-16T13:37:37.284 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: block_cache_compressed: (nil) 2020-07-16T13:37:37.284 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: persistent_cache: (nil) 2020-07-16T13:37:37.284 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: block_size: 4096 2020-07-16T13:37:37.284 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: block_size_deviation: 10 2020-07-16T13:37:37.284 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: block_restart_interval: 16 2020-07-16T13:37:37.285 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: index_block_restart_interval: 1 2020-07-16T13:37:37.285 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: metadata_block_size: 4096 2020-07-16T13:37:37.285 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: partition_filters: 0 2020-07-16T13:37:37.285 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: use_delta_encoding: 1 2020-07-16T13:37:37.285 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: filter_policy: rocksdb.BuiltinBloomFilter 2020-07-16T13:37:37.286 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: whole_key_filtering: 1 2020-07-16T13:37:37.286 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: verify_compression: 0 2020-07-16T13:37:37.286 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: read_amp_bytes_per_bit: 0 2020-07-16T13:37:37.286 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: format_version: 2 2020-07-16T13:37:37.287 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: enable_index_compression: 1 2020-07-16T13:37:37.287 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: block_align: 0 2020-07-16T13:37:37.287 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.write_buffer_size: 33554432 2020-07-16T13:37:37.287 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.max_write_buffer_number: 2 2020-07-16T13:37:37.287 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.compression: NoCompression 2020-07-16T13:37:37.288 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.bottommost_compression: Disabled 2020-07-16T13:37:37.288 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.prefix_extractor: nullptr 2020-07-16T13:37:37.288 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2020-07-16T13:37:37.288 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.num_levels: 7 2020-07-16T13:37:37.288 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2020-07-16T13:37:37.288 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2020-07-16T13:37:37.289 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2020-07-16T13:37:37.289 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2020-07-16T13:37:37.289 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2020-07-16T13:37:37.289 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2020-07-16T13:37:37.290 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2020-07-16T13:37:37.290 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2020-07-16T13:37:37.290 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2020-07-16T13:37:37.291 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.compression_opts.window_bits: -14 2020-07-16T13:37:37.291 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.compression_opts.level: 32767 2020-07-16T13:37:37.291 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.compression_opts.strategy: 0 2020-07-16T13:37:37.291 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2020-07-16T13:37:37.291 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2020-07-16T13:37:37.292 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.compression_opts.enabled: false 2020-07-16T13:37:37.292 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2020-07-16T13:37:37.292 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2020-07-16T13:37:37.292 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2020-07-16T13:37:37.292 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.target_file_size_base: 67108864 2020-07-16T13:37:37.293 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.target_file_size_multiplier: 1 2020-07-16T13:37:37.293 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2020-07-16T13:37:37.293 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2020-07-16T13:37:37.293 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2020-07-16T13:37:37.293 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2020-07-16T13:37:37.293 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2020-07-16T13:37:37.294 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2020-07-16T13:37:37.294 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2020-07-16T13:37:37.294 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2020-07-16T13:37:37.294 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2020-07-16T13:37:37.294 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2020-07-16T13:37:37.295 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2020-07-16T13:37:37.295 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2020-07-16T13:37:37.295 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.arena_block_size: 4194304 2020-07-16T13:37:37.295 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2020-07-16T13:37:37.296 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2020-07-16T13:37:37.296 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2020-07-16T13:37:37.296 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.disable_auto_compactions: 0 2020-07-16T13:37:37.297 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2020-07-16T13:37:37.297 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2020-07-16T13:37:37.297 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2020-07-16T13:37:37.298 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2020-07-16T13:37:37.298 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2020-07-16T13:37:37.298 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2020-07-16T13:37:37.299 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2020-07-16T13:37:37.299 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2020-07-16T13:37:37.299 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2020-07-16T13:37:37.299 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2020-07-16T13:37:37.300 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.table_properties_collectors: 2020-07-16T13:37:37.300 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.inplace_update_support: 0 2020-07-16T13:37:37.300 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.inplace_update_num_locks: 10000 2020-07-16T13:37:37.301 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2020-07-16T13:37:37.301 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2020-07-16T13:37:37.301 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.memtable_huge_page_size: 0 2020-07-16T13:37:37.302 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.bloom_locality: 0 2020-07-16T13:37:37.302 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.max_successive_merges: 0 2020-07-16T13:37:37.302 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.optimize_filters_for_hits: 0 2020-07-16T13:37:37.303 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.paranoid_file_checks: 0 2020-07-16T13:37:37.303 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.force_consistency_checks: 0 2020-07-16T13:37:37.303 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.report_bg_io_stats: 0 2020-07-16T13:37:37.303 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.ttl: 2592000 2020-07-16T13:37:37.304 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.983+0000 7fb2ff702700 4 rocksdb: Options.periodic_compaction_seconds: 0 2020-07-16T13:37:37.304 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.984+0000 7fb2ff702700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000008 succeeded,manifest_file_number is 8, next_file_number is 18, last_sequence is 6280, log_number is 14,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2020-07-16T13:37:37.304 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.984+0000 7fb2ff702700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 14 2020-07-16T13:37:37.304 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.984+0000 7fb2ff702700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1594906656985699, "job": 1, "event": "recovery_started", "log_files": [14]} 2020-07-16T13:37:37.304 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.984+0000 7fb2ff702700 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #14 mode 2 2020-07-16T13:37:37.305 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:36 smithi132 bash[11311]: debug 2020-07-16T13:37:36.989+0000 7fb2ff702700 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2020-07-16T13:37:37.305 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: debug 2020-07-16T13:37:36.998+0000 7fb2ff702700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1594906657000011, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 18, "file_size": 5920681, "table_properties": {"data_size": 5916920, "index_size": 2490, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 453, "raw_key_size": 4122, "raw_average_key_size": 24, "raw_value_size": 5912258, "raw_average_value_size": 34983, "num_data_blocks": 77, "num_entries": 169, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1594906656, "oldest_key_time": 3, "file_creation_time": 0}} 2020-07-16T13:37:37.305 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: debug 2020-07-16T13:37:36.998+0000 7fb2ff702700 4 rocksdb: [version_set.cc:3826] Creating manifest 19 2020-07-16T13:37:37.305 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: debug 2020-07-16T13:37:37.001+0000 7fb2ff702700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1594906657002390, "job": 1, "event": "recovery_finished"} 2020-07-16T13:37:37.306 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: debug 2020-07-16T13:37:37.002+0000 7fb2ff702700 4 rocksdb: DB pointer 0x558a7119f800 2020-07-16T13:37:37.306 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: debug 2020-07-16T13:37:37.002+0000 7fb2e6548700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2020-07-16T13:37:37.306 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: debug 2020-07-16T13:37:37.002+0000 7fb2e6548700 4 rocksdb: [db_impl/db_impl.cc:851] 2020-07-16T13:37:37.307 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: ** DB Stats ** 2020-07-16T13:37:37.307 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: Uptime(secs): 0.0 total, 0.0 interval 2020-07-16T13:37:37.307 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2020-07-16T13:37:37.307 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2020-07-16T13:37:37.307 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2020-07-16T13:37:37.308 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2020-07-16T13:37:37.308 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2020-07-16T13:37:37.308 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2020-07-16T13:37:37.308 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: ** Compaction Stats [default] ** 2020-07-16T13:37:37.308 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2020-07-16T13:37:37.309 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2020-07-16T13:37:37.309 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: L0 1/0 5.65 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 609.6 0.01 0.00 1 0.009 0 0 2020-07-16T13:37:37.309 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: L6 1/0 54.98 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2020-07-16T13:37:37.309 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: Sum 2/0 60.63 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 609.6 0.01 0.00 1 0.009 0 0 2020-07-16T13:37:37.309 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 609.6 0.01 0.00 1 0.009 0 0 2020-07-16T13:37:37.310 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: ** Compaction Stats [default] ** 2020-07-16T13:37:37.310 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2020-07-16T13:37:37.310 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2020-07-16T13:37:37.310 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 609.6 0.01 0.00 1 0.009 0 0 2020-07-16T13:37:37.310 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: Uptime(secs): 0.0 total, 0.0 interval 2020-07-16T13:37:37.310 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: Flush(GB): cumulative 0.006, interval 0.006 2020-07-16T13:37:37.311 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: AddFile(GB): cumulative 0.000, interval 0.000 2020-07-16T13:37:37.311 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: AddFile(Total Files): cumulative 0, interval 0 2020-07-16T13:37:37.311 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: AddFile(L0 Files): cumulative 0, interval 0 2020-07-16T13:37:37.311 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: AddFile(Keys): cumulative 0, interval 0 2020-07-16T13:37:37.311 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: Cumulative compaction: 0.01 GB write, 301.56 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2020-07-16T13:37:37.312 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: Interval compaction: 0.01 GB write, 301.56 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2020-07-16T13:37:37.312 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2020-07-16T13:37:37.312 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: ** File Read Latency Histogram By Level [default] ** 2020-07-16T13:37:37.312 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: ** Compaction Stats [default] ** 2020-07-16T13:37:37.312 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2020-07-16T13:37:37.313 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2020-07-16T13:37:37.313 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: L0 1/0 5.65 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 609.6 0.01 0.00 1 0.009 0 0 2020-07-16T13:37:37.313 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: L6 1/0 54.98 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2020-07-16T13:37:37.313 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: Sum 2/0 60.63 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 609.6 0.01 0.00 1 0.009 0 0 2020-07-16T13:37:37.313 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2020-07-16T13:37:37.313 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: ** Compaction Stats [default] ** 2020-07-16T13:37:37.314 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2020-07-16T13:37:37.314 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2020-07-16T13:37:37.314 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 609.6 0.01 0.00 1 0.009 0 0 2020-07-16T13:37:37.314 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: Uptime(secs): 0.0 total, 0.0 interval 2020-07-16T13:37:37.314 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: Flush(GB): cumulative 0.006, interval 0.000 2020-07-16T13:37:37.315 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: AddFile(GB): cumulative 0.000, interval 0.000 2020-07-16T13:37:37.315 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: AddFile(Total Files): cumulative 0, interval 0 2020-07-16T13:37:37.315 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: AddFile(L0 Files): cumulative 0, interval 0 2020-07-16T13:37:37.315 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: AddFile(Keys): cumulative 0, interval 0 2020-07-16T13:37:37.315 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: Cumulative compaction: 0.01 GB write, 301.01 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2020-07-16T13:37:37.316 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2020-07-16T13:37:37.316 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2020-07-16T13:37:37.316 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: ** File Read Latency Histogram By Level [default] ** 2020-07-16T13:37:37.316 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: debug 2020-07-16T13:37:37.003+0000 7fb2ff702700 0 starting mon.a rank 0 at public addrs [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] at bind addrs [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 4c8ed362-c768-11ea-a06f-001a4aab830c 2020-07-16T13:37:37.316 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: debug 2020-07-16T13:37:37.003+0000 7fb2ff702700 1 mon.a@-1(???) e3 preinit fsid 4c8ed362-c768-11ea-a06f-001a4aab830c 2020-07-16T13:37:37.317 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: debug 2020-07-16T13:37:37.004+0000 7fb2ff702700 0 mon.a@-1(???).mds e1 new map 2020-07-16T13:37:37.317 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: debug 2020-07-16T13:37:37.004+0000 7fb2ff702700 0 mon.a@-1(???).mds e1 print_map 2020-07-16T13:37:37.317 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: e1 2020-07-16T13:37:37.318 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: enable_multiple, ever_enabled_multiple: 0,0 2020-07-16T13:37:37.318 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2020-07-16T13:37:37.318 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: legacy client fscid: -1 2020-07-16T13:37:37.318 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: 2020-07-16T13:37:37.319 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: No filesystems configured 2020-07-16T13:37:37.319 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: debug 2020-07-16T13:37:37.004+0000 7fb2ff702700 0 mon.a@-1(???).osd e53 crush map has features 288514051259236352, adjusting msgr requires 2020-07-16T13:37:37.319 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: debug 2020-07-16T13:37:37.004+0000 7fb2ff702700 0 mon.a@-1(???).osd e53 crush map has features 3314933000852226048, adjusting msgr requires 2020-07-16T13:37:37.319 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: debug 2020-07-16T13:37:37.004+0000 7fb2ff702700 0 mon.a@-1(???).osd e53 crush map has features 288514051259236352, adjusting msgr requires 2020-07-16T13:37:37.319 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: cephadm 2020-07-16T13:37:34.243039+0000 mgr.x (mgr.34499) 52 : cephadm [INF] Upgrade: It is presumed safe to stop mon.a 2020-07-16T13:37:37.319 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: cephadm 2020-07-16T13:37:34.243414+0000 mgr.x (mgr.34499) 53 : cephadm [INF] Upgrade: Redeploying mon.a 2020-07-16T13:37:37.320 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: cephadm 2020-07-16T13:37:34.250161+0000 mgr.x (mgr.34499) 54 : cephadm [INF] Deploying daemon mon.a on smithi132 2020-07-16T13:37:37.320 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: cluster 2020-07-16T13:37:34.737122+0000 mon.a (mon.0) 636 : cluster [DBG] Standby manager daemon y restarted 2020-07-16T13:37:37.320 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: cluster 2020-07-16T13:37:34.737233+0000 mon.a (mon.0) 637 : cluster [DBG] Standby manager daemon y started 2020-07-16T13:37:37.320 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: audit 2020-07-16T13:37:34.737294+0000 mon.c (mon.1) 26 : audit [DBG] from='mgr.? 172.21.15.132:0/2613558882' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2020-07-16T13:37:37.320 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: audit 2020-07-16T13:37:34.738816+0000 mon.c (mon.1) 27 : audit [DBG] from='mgr.? 172.21.15.132:0/2613558882' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2020-07-16T13:37:37.321 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: cluster 2020-07-16T13:37:34.856996+0000 mgr.x (mgr.34499) 55 : cluster [DBG] pgmap v20: 1 pgs: 1 active+clean; 0 B data, 4.1 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:37:37.321 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: debug 2020-07-16T13:37:37.004+0000 7fb2ff702700 1 mon.a@-1(???).paxosservice(auth 1..17) refresh upgraded, format 0 -> 3 2020-07-16T13:37:37.530 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[10496]: ignoring --setuser ceph since I am not root 2020-07-16T13:37:37.530 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[10496]: ignoring --setgroup ceph since I am not root 2020-07-16T13:37:37.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[27079]: audit 2020-07-16T13:37:36.508751+0000 mon.b (mon.2) 108 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632944\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632975\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633004\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633155\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633259\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633374\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633475\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633508\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:37:37.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[27079]: cluster 2020-07-16T13:37:37.211734+0000 mon.a (mon.0) 1 : cluster [INF] mon.a calling monitor election 2020-07-16T13:37:37.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[27079]: cluster 2020-07-16T13:37:37.213663+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2020-07-16T13:37:37.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[27079]: audit 2020-07-16T13:37:37.216962+0000 mon.a (mon.0) 3 : audit [INF] from='mgr.34499 ' entity='' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632944\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632975\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633004\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633155\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633259\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633374\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633475\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633508\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:37:37.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[27079]: cluster 2020-07-16T13:37:37.218621+0000 mon.a (mon.0) 4 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0],b=[v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0],c=[v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0]} 2020-07-16T13:37:37.532 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[27079]: cluster 2020-07-16T13:37:37.218663+0000 mon.a (mon.0) 5 : cluster [DBG] fsmap 2020-07-16T13:37:37.532 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[27079]: cluster 2020-07-16T13:37:37.218692+0000 mon.a (mon.0) 6 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2020-07-16T13:37:37.532 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[27079]: cluster 2020-07-16T13:37:37.219387+0000 mon.a (mon.0) 7 : cluster [DBG] mgrmap e20: x(active, since 36s), standbys: y 2020-07-16T13:37:37.532 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[27079]: audit 2020-07-16T13:37:37.221847+0000 mon.a (mon.0) 8 : audit [INF] from='mgr.34499 ' entity='' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632944\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632975\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633004\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633155\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633259\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633374\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633475\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633508\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:37:37.533 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[27079]: audit 2020-07-16T13:37:37.224012+0000 mon.b (mon.2) 109 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:37:37.533 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[27079]: cluster 2020-07-16T13:37:37.225743+0000 mon.a (mon.0) 9 : cluster [DBG] mgrmap e21: x(active, since 36s), standbys: y 2020-07-16T13:37:37.533 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[27079]: cluster 2020-07-16T13:37:37.225773+0000 mon.a (mon.0) 10 : cluster [INF] overall HEALTH_OK 2020-07-16T13:37:37.533 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: audit 2020-07-16T13:37:36.508751+0000 mon.b (mon.2) 108 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632944\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632975\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633004\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633155\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633259\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633374\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633475\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633508\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:37:37.534 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: cluster 2020-07-16T13:37:37.211734+0000 mon.a (mon.0) 1 : cluster [INF] mon.a calling monitor election 2020-07-16T13:37:37.534 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: cluster 2020-07-16T13:37:37.213663+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2020-07-16T13:37:37.534 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: audit 2020-07-16T13:37:37.216962+0000 mon.a (mon.0) 3 : audit [INF] from='mgr.34499 ' entity='' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632944\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632975\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633004\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633155\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633259\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633374\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633475\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633508\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:37:37.534 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: cluster 2020-07-16T13:37:37.218621+0000 mon.a (mon.0) 4 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0],b=[v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0],c=[v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0]} 2020-07-16T13:37:37.534 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: cluster 2020-07-16T13:37:37.218663+0000 mon.a (mon.0) 5 : cluster [DBG] fsmap 2020-07-16T13:37:37.535 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: cluster 2020-07-16T13:37:37.218692+0000 mon.a (mon.0) 6 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2020-07-16T13:37:37.535 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: cluster 2020-07-16T13:37:37.219387+0000 mon.a (mon.0) 7 : cluster [DBG] mgrmap e20: x(active, since 36s), standbys: y 2020-07-16T13:37:37.535 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: audit 2020-07-16T13:37:37.221847+0000 mon.a (mon.0) 8 : audit [INF] from='mgr.34499 ' entity='' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632944\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632975\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633004\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633155\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633259\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633374\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633475\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633508\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:37:37.535 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: audit 2020-07-16T13:37:37.224012+0000 mon.b (mon.2) 109 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:37:37.536 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: cluster 2020-07-16T13:37:37.225743+0000 mon.a (mon.0) 9 : cluster [DBG] mgrmap e21: x(active, since 36s), standbys: y 2020-07-16T13:37:37.536 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:37 smithi132 bash[11311]: cluster 2020-07-16T13:37:37.225773+0000 mon.a (mon.0) 10 : cluster [INF] overall HEALTH_OK 2020-07-16T13:37:37.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:37 smithi188 bash[23329]: audit 2020-07-16T13:37:36.508751+0000 mon.b (mon.2) 108 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632944\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632975\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633004\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633155\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633259\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633374\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633475\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633508\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:37:37.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:37 smithi188 bash[23329]: cluster 2020-07-16T13:37:37.211734+0000 mon.a (mon.0) 1 : cluster [INF] mon.a calling monitor election 2020-07-16T13:37:37.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:37 smithi188 bash[23329]: cluster 2020-07-16T13:37:37.213663+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2020-07-16T13:37:37.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:37 smithi188 bash[23329]: audit 2020-07-16T13:37:37.216962+0000 mon.a (mon.0) 3 : audit [INF] from='mgr.34499 ' entity='' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632944\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632975\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633004\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633155\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633259\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633374\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633475\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633508\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:37:37.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:37 smithi188 bash[23329]: cluster 2020-07-16T13:37:37.218621+0000 mon.a (mon.0) 4 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0],b=[v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0],c=[v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0]} 2020-07-16T13:37:37.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:37 smithi188 bash[23329]: cluster 2020-07-16T13:37:37.218663+0000 mon.a (mon.0) 5 : cluster [DBG] fsmap 2020-07-16T13:37:37.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:37 smithi188 bash[23329]: cluster 2020-07-16T13:37:37.218692+0000 mon.a (mon.0) 6 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2020-07-16T13:37:37.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:37 smithi188 bash[23329]: cluster 2020-07-16T13:37:37.219387+0000 mon.a (mon.0) 7 : cluster [DBG] mgrmap e20: x(active, since 36s), standbys: y 2020-07-16T13:37:37.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:37 smithi188 bash[23329]: audit 2020-07-16T13:37:37.221847+0000 mon.a (mon.0) 8 : audit [INF] from='mgr.34499 ' entity='' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632944\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632975\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633004\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633155\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633259\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633374\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633475\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633508\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:37:37.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:37 smithi188 bash[23329]: audit 2020-07-16T13:37:37.224012+0000 mon.b (mon.2) 109 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:37:37.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:37 smithi188 bash[23329]: cluster 2020-07-16T13:37:37.225743+0000 mon.a (mon.0) 9 : cluster [DBG] mgrmap e21: x(active, since 36s), standbys: y 2020-07-16T13:37:37.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:37:37 smithi188 bash[23329]: cluster 2020-07-16T13:37:37.225773+0000 mon.a (mon.0) 10 : cluster [INF] overall HEALTH_OK 2020-07-16T13:37:37.675 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Jul 16 13:37:37 smithi188 bash[3383]: ignoring --setuser ceph since I am not root 2020-07-16T13:37:37.675 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Jul 16 13:37:37 smithi188 bash[3383]: ignoring --setgroup ceph since I am not root 2020-07-16T13:37:37.675 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Jul 16 13:37:37 smithi188 bash[3383]: debug 2020-07-16T13:37:37.263+0000 7f1b47c46380 1 -- 172.21.15.188:0/2615577700 shutdown_connections 2020-07-16T13:37:37.675 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Jul 16 13:37:37 smithi188 bash[3383]: debug 2020-07-16T13:37:37.263+0000 7f1b47c46380 1 --2- 172.21.15.188:0/2615577700 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ff93fa5400 0x55ff94027e00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-07-16T13:37:37.675 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Jul 16 13:37:37 smithi188 bash[3383]: debug 2020-07-16T13:37:37.263+0000 7f1b47c46380 1 --2- 172.21.15.188:0/2615577700 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55ff93fa4c00 0x55ff94027400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-07-16T13:37:37.676 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Jul 16 13:37:37 smithi188 bash[3383]: debug 2020-07-16T13:37:37.263+0000 7f1b47c46380 1 --2- 172.21.15.188:0/2615577700 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ff93fa5000 0x55ff94027900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T13:37:37.676 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Jul 16 13:37:37 smithi188 bash[3383]: debug 2020-07-16T13:37:37.263+0000 7f1b47c46380 1 -- 172.21.15.188:0/2615577700 >> 172.21.15.188:0/2615577700 conn(0x55ff93fa4800 msgr2=0x55ff94c14800 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T13:37:37.676 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Jul 16 13:37:37 smithi188 bash[3383]: debug 2020-07-16T13:37:37.264+0000 7f1b47c46380 1 -- 172.21.15.188:0/2615577700 shutdown_connections 2020-07-16T13:37:37.676 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Jul 16 13:37:37 smithi188 bash[3383]: debug 2020-07-16T13:37:37.264+0000 7f1b47c46380 1 -- 172.21.15.188:0/2615577700 wait complete. 2020-07-16T13:37:41.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.0.0-3349-g7260671e53b/rpm/el8/BUILD/ceph-16.0.0-3349-g7260671e53b/src/mon/OSDMonitor.cc: In function 'virtual void OSDMonitor::encode_pending(MonitorDBStore::TransactionRef)' thread 7fb2e8d4d700 time 2020-07-16T13:37:40.852072+0000 2020-07-16T13:37:41.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.0.0-3349-g7260671e53b/rpm/el8/BUILD/ceph-16.0.0-3349-g7260671e53b/src/mon/OSDMonitor.cc: 2023: FAILED ceph_assert((features & ~mon->get_quorum_con_features()) == 0) 2020-07-16T13:37:41.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev) 2020-07-16T13:37:41.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7fb2f68b8b96] 2020-07-16T13:37:41.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 2: (()+0x275db0) [0x7fb2f68b8db0] 2020-07-16T13:37:41.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 3: (OSDMonitor::encode_pending(std::shared_ptr)+0x6738) [0x558a6f7c96d8] 2020-07-16T13:37:41.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 4: (PaxosService::propose_pending()+0x21a) [0x558a6f73999a] 2020-07-16T13:37:41.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 5: (MgrMonitor::drop_active()+0x346) [0x558a6f82dce6] 2020-07-16T13:37:41.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 6: (MgrMonitor::prepare_beacon(boost::intrusive_ptr)+0x1e27) [0x558a6f82fe97] 2020-07-16T13:37:41.282 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 7: (MgrMonitor::prepare_update(boost::intrusive_ptr)+0x5b) [0x558a6f8342db] 2020-07-16T13:37:41.282 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 8: (PaxosService::dispatch(boost::intrusive_ptr)+0xa6d) [0x558a6f73a84d] 2020-07-16T13:37:41.282 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 9: (Monitor::dispatch_op(boost::intrusive_ptr)+0x7c1) [0x558a6f630ca1] 2020-07-16T13:37:41.282 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 10: (Monitor::_ms_dispatch(Message*)+0x619) [0x558a6f632099] 2020-07-16T13:37:41.282 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 11: (Monitor::handle_forward(boost::intrusive_ptr)+0x941) [0x558a6f633da1] 2020-07-16T13:37:41.283 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 12: (Monitor::dispatch_op(boost::intrusive_ptr)+0x1200) [0x558a6f6316e0] 2020-07-16T13:37:41.283 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 13: (Monitor::_ms_dispatch(Message*)+0x619) [0x558a6f632099] 2020-07-16T13:37:41.283 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 14: (Dispatcher::ms_dispatch2(boost::intrusive_ptr const&)+0x5c) [0x558a6f65e7ac] 2020-07-16T13:37:41.283 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 15: (DispatchQueue::entry()+0x126a) [0x7fb2f6adff3a] 2020-07-16T13:37:41.283 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 16: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fb2f6b8edf1] 2020-07-16T13:37:41.284 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 17: (()+0x82de) [0x7fb2f43b32de] 2020-07-16T13:37:41.284 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 18: (clone()+0x43) [0x7fb2f30eae83] 2020-07-16T13:37:41.284 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: *** Caught signal (Aborted) ** 2020-07-16T13:37:41.284 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: in thread 7fb2e8d4d700 thread_name:ms_dispatch 2020-07-16T13:37:41.284 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: debug 2020-07-16T13:37:40.852+0000 7fb2e8d4d700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.0.0-3349-g7260671e53b/rpm/el8/BUILD/ceph-16.0.0-3349-g7260671e53b/src/mon/OSDMonitor.cc: In function 'virtual void OSDMonitor::encode_pending(MonitorDBStore::TransactionRef)' thread 7fb2e8d4d700 time 2020-07-16T13:37:40.852072+0000 2020-07-16T13:37:41.284 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.0.0-3349-g7260671e53b/rpm/el8/BUILD/ceph-16.0.0-3349-g7260671e53b/src/mon/OSDMonitor.cc: 2023: FAILED ceph_assert((features & ~mon->get_quorum_con_features()) == 0) 2020-07-16T13:37:41.285 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev) 2020-07-16T13:37:41.285 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7fb2f68b8b96] 2020-07-16T13:37:41.285 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 2: (()+0x275db0) [0x7fb2f68b8db0] 2020-07-16T13:37:41.285 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 3: (OSDMonitor::encode_pending(std::shared_ptr)+0x6738) [0x558a6f7c96d8] 2020-07-16T13:37:41.285 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 4: (PaxosService::propose_pending()+0x21a) [0x558a6f73999a] 2020-07-16T13:37:41.286 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 5: (MgrMonitor::drop_active()+0x346) [0x558a6f82dce6] 2020-07-16T13:37:41.286 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 6: (MgrMonitor::prepare_beacon(boost::intrusive_ptr)+0x1e27) [0x558a6f82fe97] 2020-07-16T13:37:41.286 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 7: (MgrMonitor::prepare_update(boost::intrusive_ptr)+0x5b) [0x558a6f8342db] 2020-07-16T13:37:41.286 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 8: (PaxosService::dispatch(boost::intrusive_ptr)+0xa6d) [0x558a6f73a84d] 2020-07-16T13:37:41.286 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 9: (Monitor::dispatch_op(boost::intrusive_ptr)+0x7c1) [0x558a6f630ca1] 2020-07-16T13:37:41.287 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 10: (Monitor::_ms_dispatch(Message*)+0x619) [0x558a6f632099] 2020-07-16T13:37:41.287 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 11: (Monitor::handle_forward(boost::intrusive_ptr)+0x941) [0x558a6f633da1] 2020-07-16T13:37:41.287 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 12: (Monitor::dispatch_op(boost::intrusive_ptr)+0x1200) [0x558a6f6316e0] 2020-07-16T13:37:41.287 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 13: (Monitor::_ms_dispatch(Message*)+0x619) [0x558a6f632099] 2020-07-16T13:37:41.288 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 14: (Dispatcher::ms_dispatch2(boost::intrusive_ptr const&)+0x5c) [0x558a6f65e7ac] 2020-07-16T13:37:41.288 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 15: (DispatchQueue::entry()+0x126a) [0x7fb2f6adff3a] 2020-07-16T13:37:41.288 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 16: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fb2f6b8edf1] 2020-07-16T13:37:41.288 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 17: (()+0x82de) [0x7fb2f43b32de] 2020-07-16T13:37:41.288 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 18: (clone()+0x43) [0x7fb2f30eae83] 2020-07-16T13:37:41.289 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev) 2020-07-16T13:37:41.289 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 1: (()+0x12dd0) [0x7fb2f43bddd0] 2020-07-16T13:37:41.289 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 2: (gsignal()+0x10f) [0x7fb2f302670f] 2020-07-16T13:37:41.289 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 3: (abort()+0x127) [0x7fb2f3010b25] 2020-07-16T13:37:41.290 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a9) [0x7fb2f68b8be7] 2020-07-16T13:37:41.290 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 5: (()+0x275db0) [0x7fb2f68b8db0] 2020-07-16T13:37:41.290 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 6: (OSDMonitor::encode_pending(std::shared_ptr)+0x6738) [0x558a6f7c96d8] 2020-07-16T13:37:41.290 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 7: (PaxosService::propose_pending()+0x21a) [0x558a6f73999a] 2020-07-16T13:37:41.290 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 8: (MgrMonitor::drop_active()+0x346) [0x558a6f82dce6] 2020-07-16T13:37:41.291 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 9: (MgrMonitor::prepare_beacon(boost::intrusive_ptr)+0x1e27) [0x558a6f82fe97] 2020-07-16T13:37:41.291 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 10: (MgrMonitor::prepare_update(boost::intrusive_ptr)+0x5b) [0x558a6f8342db] 2020-07-16T13:37:41.291 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 11: (PaxosService::dispatch(boost::intrusive_ptr)+0xa6d) [0x558a6f73a84d] 2020-07-16T13:37:41.291 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 12: (Monitor::dispatch_op(boost::intrusive_ptr)+0x7c1) [0x558a6f630ca1] 2020-07-16T13:37:41.291 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 13: (Monitor::_ms_dispatch(Message*)+0x619) [0x558a6f632099] 2020-07-16T13:37:41.291 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 14: (Monitor::handle_forward(boost::intrusive_ptr)+0x941) [0x558a6f633da1] 2020-07-16T13:37:41.292 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 15: (Monitor::dispatch_op(boost::intrusive_ptr)+0x1200) [0x558a6f6316e0] 2020-07-16T13:37:41.292 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 16: (Monitor::_ms_dispatch(Message*)+0x619) [0x558a6f632099] 2020-07-16T13:37:41.292 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 17: (Dispatcher::ms_dispatch2(boost::intrusive_ptr const&)+0x5c) [0x558a6f65e7ac] 2020-07-16T13:37:41.292 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 18: (DispatchQueue::entry()+0x126a) [0x7fb2f6adff3a] 2020-07-16T13:37:41.292 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 19: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fb2f6b8edf1] 2020-07-16T13:37:41.293 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 20: (()+0x82de) [0x7fb2f43b32de] 2020-07-16T13:37:41.293 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 21: (clone()+0x43) [0x7fb2f30eae83] 2020-07-16T13:37:41.293 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: debug 2020-07-16T13:37:40.854+0000 7fb2e8d4d700 -1 *** Caught signal (Aborted) ** 2020-07-16T13:37:41.293 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: in thread 7fb2e8d4d700 thread_name:ms_dispatch 2020-07-16T13:37:41.293 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev) 2020-07-16T13:37:41.294 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 1: (()+0x12dd0) [0x7fb2f43bddd0] 2020-07-16T13:37:41.294 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 2: (gsignal()+0x10f) [0x7fb2f302670f] 2020-07-16T13:37:41.294 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 3: (abort()+0x127) [0x7fb2f3010b25] 2020-07-16T13:37:41.294 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a9) [0x7fb2f68b8be7] 2020-07-16T13:37:41.294 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 5: (()+0x275db0) [0x7fb2f68b8db0] 2020-07-16T13:37:41.294 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 6: (OSDMonitor::encode_pending(std::shared_ptr)+0x6738) [0x558a6f7c96d8] 2020-07-16T13:37:41.295 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 7: (PaxosService::propose_pending()+0x21a) [0x558a6f73999a] 2020-07-16T13:37:41.295 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 8: (MgrMonitor::drop_active()+0x346) [0x558a6f82dce6] 2020-07-16T13:37:41.295 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 9: (MgrMonitor::prepare_beacon(boost::intrusive_ptr)+0x1e27) [0x558a6f82fe97] 2020-07-16T13:37:41.295 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 10: (MgrMonitor::prepare_update(boost::intrusive_ptr)+0x5b) [0x558a6f8342db] 2020-07-16T13:37:41.295 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 11: (PaxosService::dispatch(boost::intrusive_ptr)+0xa6d) [0x558a6f73a84d] 2020-07-16T13:37:41.296 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 12: (Monitor::dispatch_op(boost::intrusive_ptr)+0x7c1) [0x558a6f630ca1] 2020-07-16T13:37:41.296 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 13: (Monitor::_ms_dispatch(Message*)+0x619) [0x558a6f632099] 2020-07-16T13:37:41.296 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 14: (Monitor::handle_forward(boost::intrusive_ptr)+0x941) [0x558a6f633da1] 2020-07-16T13:37:41.296 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 15: (Monitor::dispatch_op(boost::intrusive_ptr)+0x1200) [0x558a6f6316e0] 2020-07-16T13:37:41.296 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 16: (Monitor::_ms_dispatch(Message*)+0x619) [0x558a6f632099] 2020-07-16T13:37:41.296 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 17: (Dispatcher::ms_dispatch2(boost::intrusive_ptr const&)+0x5c) [0x558a6f65e7ac] 2020-07-16T13:37:41.297 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 18: (DispatchQueue::entry()+0x126a) [0x7fb2f6adff3a] 2020-07-16T13:37:41.297 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 19: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fb2f6b8edf1] 2020-07-16T13:37:41.297 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 20: (()+0x82de) [0x7fb2f43b32de] 2020-07-16T13:37:41.297 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 21: (clone()+0x43) [0x7fb2f30eae83] 2020-07-16T13:37:41.297 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-07-16T13:37:41.298 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: debug -1> 2020-07-16T13:37:40.852+0000 7fb2e8d4d700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.0.0-3349-g7260671e53b/rpm/el8/BUILD/ceph-16.0.0-3349-g7260671e53b/src/mon/OSDMonitor.cc: In function 'virtual void OSDMonitor::encode_pending(MonitorDBStore::TransactionRef)' thread 7fb2e8d4d700 time 2020-07-16T13:37:40.852072+0000 2020-07-16T13:37:41.298 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.0.0-3349-g7260671e53b/rpm/el8/BUILD/ceph-16.0.0-3349-g7260671e53b/src/mon/OSDMonitor.cc: 2023: FAILED ceph_assert((features & ~mon->get_quorum_con_features()) == 0) 2020-07-16T13:37:41.298 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev) 2020-07-16T13:37:41.298 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7fb2f68b8b96] 2020-07-16T13:37:41.298 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 2: (()+0x275db0) [0x7fb2f68b8db0] 2020-07-16T13:37:41.299 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 3: (OSDMonitor::encode_pending(std::shared_ptr)+0x6738) [0x558a6f7c96d8] 2020-07-16T13:37:41.299 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 4: (PaxosService::propose_pending()+0x21a) [0x558a6f73999a] 2020-07-16T13:37:41.299 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 5: (MgrMonitor::drop_active()+0x346) [0x558a6f82dce6] 2020-07-16T13:37:41.299 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 6: (MgrMonitor::prepare_beacon(boost::intrusive_ptr)+0x1e27) [0x558a6f82fe97] 2020-07-16T13:37:41.299 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 7: (MgrMonitor::prepare_update(boost::intrusive_ptr)+0x5b) [0x558a6f8342db] 2020-07-16T13:37:41.300 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 8: (PaxosService::dispatch(boost::intrusive_ptr)+0xa6d) [0x558a6f73a84d] 2020-07-16T13:37:41.300 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 9: (Monitor::dispatch_op(boost::intrusive_ptr)+0x7c1) [0x558a6f630ca1] 2020-07-16T13:37:41.300 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 10: (Monitor::_ms_dispatch(Message*)+0x619) [0x558a6f632099] 2020-07-16T13:37:41.300 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 11: (Monitor::handle_forward(boost::intrusive_ptr)+0x941) [0x558a6f633da1] 2020-07-16T13:37:41.300 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 12: (Monitor::dispatch_op(boost::intrusive_ptr)+0x1200) [0x558a6f6316e0] 2020-07-16T13:37:41.300 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 13: (Monitor::_ms_dispatch(Message*)+0x619) [0x558a6f632099] 2020-07-16T13:37:41.301 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 14: (Dispatcher::ms_dispatch2(boost::intrusive_ptr const&)+0x5c) [0x558a6f65e7ac] 2020-07-16T13:37:41.301 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 15: (DispatchQueue::entry()+0x126a) [0x7fb2f6adff3a] 2020-07-16T13:37:41.301 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 16: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fb2f6b8edf1] 2020-07-16T13:37:41.301 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 17: (()+0x82de) [0x7fb2f43b32de] 2020-07-16T13:37:41.301 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 18: (clone()+0x43) [0x7fb2f30eae83] 2020-07-16T13:37:41.302 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: debug 0> 2020-07-16T13:37:40.854+0000 7fb2e8d4d700 -1 *** Caught signal (Aborted) ** 2020-07-16T13:37:41.302 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: in thread 7fb2e8d4d700 thread_name:ms_dispatch 2020-07-16T13:37:41.302 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev) 2020-07-16T13:37:41.302 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 1: (()+0x12dd0) [0x7fb2f43bddd0] 2020-07-16T13:37:41.303 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 2: (gsignal()+0x10f) [0x7fb2f302670f] 2020-07-16T13:37:41.303 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 3: (abort()+0x127) [0x7fb2f3010b25] 2020-07-16T13:37:41.303 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a9) [0x7fb2f68b8be7] 2020-07-16T13:37:41.303 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 5: (()+0x275db0) [0x7fb2f68b8db0] 2020-07-16T13:37:41.303 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 6: (OSDMonitor::encode_pending(std::shared_ptr)+0x6738) [0x558a6f7c96d8] 2020-07-16T13:37:41.303 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 7: (PaxosService::propose_pending()+0x21a) [0x558a6f73999a] 2020-07-16T13:37:41.304 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 8: (MgrMonitor::drop_active()+0x346) [0x558a6f82dce6] 2020-07-16T13:37:41.304 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 9: (MgrMonitor::prepare_beacon(boost::intrusive_ptr)+0x1e27) [0x558a6f82fe97] 2020-07-16T13:37:41.304 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 10: (MgrMonitor::prepare_update(boost::intrusive_ptr)+0x5b) [0x558a6f8342db] 2020-07-16T13:37:41.304 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 11: (PaxosService::dispatch(boost::intrusive_ptr)+0xa6d) [0x558a6f73a84d] 2020-07-16T13:37:41.304 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 12: (Monitor::dispatch_op(boost::intrusive_ptr)+0x7c1) [0x558a6f630ca1] 2020-07-16T13:37:41.305 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 13: (Monitor::_ms_dispatch(Message*)+0x619) [0x558a6f632099] 2020-07-16T13:37:41.305 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 14: (Monitor::handle_forward(boost::intrusive_ptr)+0x941) [0x558a6f633da1] 2020-07-16T13:37:41.305 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 15: (Monitor::dispatch_op(boost::intrusive_ptr)+0x1200) [0x558a6f6316e0] 2020-07-16T13:37:41.305 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 16: (Monitor::_ms_dispatch(Message*)+0x619) [0x558a6f632099] 2020-07-16T13:37:41.305 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 17: (Dispatcher::ms_dispatch2(boost::intrusive_ptr const&)+0x5c) [0x558a6f65e7ac] 2020-07-16T13:37:41.306 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 18: (DispatchQueue::entry()+0x126a) [0x7fb2f6adff3a] 2020-07-16T13:37:41.306 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 19: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fb2f6b8edf1] 2020-07-16T13:37:41.306 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 20: (()+0x82de) [0x7fb2f43b32de] 2020-07-16T13:37:41.306 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 21: (clone()+0x43) [0x7fb2f30eae83] 2020-07-16T13:37:41.307 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-07-16T13:37:41.307 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: debug -1> 2020-07-16T13:37:40.852+0000 7fb2e8d4d700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.0.0-3349-g7260671e53b/rpm/el8/BUILD/ceph-16.0.0-3349-g7260671e53b/src/mon/OSDMonitor.cc: In function 'virtual void OSDMonitor::encode_pending(MonitorDBStore::TransactionRef)' thread 7fb2e8d4d700 time 2020-07-16T13:37:40.852072+0000 2020-07-16T13:37:41.307 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.0.0-3349-g7260671e53b/rpm/el8/BUILD/ceph-16.0.0-3349-g7260671e53b/src/mon/OSDMonitor.cc: 2023: FAILED ceph_assert((features & ~mon->get_quorum_con_features()) == 0) 2020-07-16T13:37:41.307 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev) 2020-07-16T13:37:41.307 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7fb2f68b8b96] 2020-07-16T13:37:41.308 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 2: (()+0x275db0) [0x7fb2f68b8db0] 2020-07-16T13:37:41.308 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 3: (OSDMonitor::encode_pending(std::shared_ptr)+0x6738) [0x558a6f7c96d8] 2020-07-16T13:37:41.308 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 4: (PaxosService::propose_pending()+0x21a) [0x558a6f73999a] 2020-07-16T13:37:41.308 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 5: (MgrMonitor::drop_active()+0x346) [0x558a6f82dce6] 2020-07-16T13:37:41.308 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 6: (MgrMonitor::prepare_beacon(boost::intrusive_ptr)+0x1e27) [0x558a6f82fe97] 2020-07-16T13:37:41.309 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 7: (MgrMonitor::prepare_update(boost::intrusive_ptr)+0x5b) [0x558a6f8342db] 2020-07-16T13:37:41.309 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 8: (PaxosService::dispatch(boost::intrusive_ptr)+0xa6d) [0x558a6f73a84d] 2020-07-16T13:37:41.309 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 9: (Monitor::dispatch_op(boost::intrusive_ptr)+0x7c1) [0x558a6f630ca1] 2020-07-16T13:37:41.309 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 10: (Monitor::_ms_dispatch(Message*)+0x619) [0x558a6f632099] 2020-07-16T13:37:41.309 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 11: (Monitor::handle_forward(boost::intrusive_ptr)+0x941) [0x558a6f633da1] 2020-07-16T13:37:41.309 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 12: (Monitor::dispatch_op(boost::intrusive_ptr)+0x1200) [0x558a6f6316e0] 2020-07-16T13:37:41.310 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 13: (Monitor::_ms_dispatch(Message*)+0x619) [0x558a6f632099] 2020-07-16T13:37:41.310 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 14: (Dispatcher::ms_dispatch2(boost::intrusive_ptr const&)+0x5c) [0x558a6f65e7ac] 2020-07-16T13:37:41.310 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 15: (DispatchQueue::entry()+0x126a) [0x7fb2f6adff3a] 2020-07-16T13:37:41.310 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 16: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fb2f6b8edf1] 2020-07-16T13:37:41.311 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 17: (()+0x82de) [0x7fb2f43b32de] 2020-07-16T13:37:41.311 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 18: (clone()+0x43) [0x7fb2f30eae83] 2020-07-16T13:37:41.311 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: debug 0> 2020-07-16T13:37:40.854+0000 7fb2e8d4d700 -1 *** Caught signal (Aborted) ** 2020-07-16T13:37:41.311 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: in thread 7fb2e8d4d700 thread_name:ms_dispatch 2020-07-16T13:37:41.311 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev) 2020-07-16T13:37:41.312 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 1: (()+0x12dd0) [0x7fb2f43bddd0] 2020-07-16T13:37:41.312 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 2: (gsignal()+0x10f) [0x7fb2f302670f] 2020-07-16T13:37:41.312 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 3: (abort()+0x127) [0x7fb2f3010b25] 2020-07-16T13:37:41.312 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a9) [0x7fb2f68b8be7] 2020-07-16T13:37:41.312 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 5: (()+0x275db0) [0x7fb2f68b8db0] 2020-07-16T13:37:41.312 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 6: (OSDMonitor::encode_pending(std::shared_ptr)+0x6738) [0x558a6f7c96d8] 2020-07-16T13:37:41.313 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 7: (PaxosService::propose_pending()+0x21a) [0x558a6f73999a] 2020-07-16T13:37:41.313 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 8: (MgrMonitor::drop_active()+0x346) [0x558a6f82dce6] 2020-07-16T13:37:41.313 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 9: (MgrMonitor::prepare_beacon(boost::intrusive_ptr)+0x1e27) [0x558a6f82fe97] 2020-07-16T13:37:41.313 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 10: (MgrMonitor::prepare_update(boost::intrusive_ptr)+0x5b) [0x558a6f8342db] 2020-07-16T13:37:41.313 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 11: (PaxosService::dispatch(boost::intrusive_ptr)+0xa6d) [0x558a6f73a84d] 2020-07-16T13:37:41.314 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 12: (Monitor::dispatch_op(boost::intrusive_ptr)+0x7c1) [0x558a6f630ca1] 2020-07-16T13:37:41.314 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 13: (Monitor::_ms_dispatch(Message*)+0x619) [0x558a6f632099] 2020-07-16T13:37:41.314 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 14: (Monitor::handle_forward(boost::intrusive_ptr)+0x941) [0x558a6f633da1] 2020-07-16T13:37:41.314 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 15: (Monitor::dispatch_op(boost::intrusive_ptr)+0x1200) [0x558a6f6316e0] 2020-07-16T13:37:41.314 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 16: (Monitor::_ms_dispatch(Message*)+0x619) [0x558a6f632099] 2020-07-16T13:37:41.315 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 17: (Dispatcher::ms_dispatch2(boost::intrusive_ptr const&)+0x5c) [0x558a6f65e7ac] 2020-07-16T13:37:41.315 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 18: (DispatchQueue::entry()+0x126a) [0x7fb2f6adff3a] 2020-07-16T13:37:41.315 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 19: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fb2f6b8edf1] 2020-07-16T13:37:41.315 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 20: (()+0x82de) [0x7fb2f43b32de] 2020-07-16T13:37:41.315 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: 21: (clone()+0x43) [0x7fb2f30eae83] 2020-07-16T13:37:41.315 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-07-16T13:37:41.316 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 bash[11311]: reraise_fatal: default handler for signal 6 didn't terminate the process? 2020-07-16T13:37:41.316 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:40 smithi132 podman[11343]: 2020-07-16 13:37:40.907324812 +0000 UTC m=+4.337070964 container died f5f855da9cad32e8d9852181941a4a512acdf0bf0f825af7a71b136a83bfc693 (image=quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a) 2020-07-16T13:37:41.779 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:41 smithi132 podman[11343]: 2020-07-16 13:37:41.449317758 +0000 UTC m=+4.879063910 container remove f5f855da9cad32e8d9852181941a4a512acdf0bf0f825af7a71b136a83bfc693 (image=quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a) 2020-07-16T13:37:41.779 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:41 smithi132 systemd[1]: ceph-4c8ed362-c768-11ea-a06f-001a4aab830c@mon.a.service: Main process exited, code=exited, status=1/FAILURE 2020-07-16T13:37:41.779 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:41 smithi132 systemd[1]: ceph-4c8ed362-c768-11ea-a06f-001a4aab830c@mon.a.service: Failed with result 'exit-code'. 2020-07-16T13:37:51.904 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:51 smithi132 systemd[1]: ceph-4c8ed362-c768-11ea-a06f-001a4aab830c@mon.a.service: Service RestartSec=10s expired, scheduling restart. 2020-07-16T13:37:51.904 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:51 smithi132 systemd[1]: ceph-4c8ed362-c768-11ea-a06f-001a4aab830c@mon.a.service: Scheduled restart job, restart counter is at 1. 2020-07-16T13:37:51.904 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:51 smithi132 systemd[1]: Stopped Ceph mon.a for 4c8ed362-c768-11ea-a06f-001a4aab830c. 2020-07-16T13:37:51.905 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:51 smithi132 systemd[1]: Starting Ceph mon.a for 4c8ed362-c768-11ea-a06f-001a4aab830c... 2020-07-16T13:37:51.905 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:51 smithi132 podman[11555]: Error: no container with name or ID ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a found: no such container 2020-07-16T13:37:51.905 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:51 smithi132 systemd[1]: Started Ceph mon.a for 4c8ed362-c768-11ea-a06f-001a4aab830c. 2020-07-16T13:37:51.905 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:51 smithi132 bash[11571]: Error: Failed to evict container: "": Failed to find container "ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a" in state: no container with name or ID ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a found: no such container 2020-07-16T13:37:51.905 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:51 smithi132 bash[11571]: ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a 2020-07-16T13:37:51.906 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:51 smithi132 bash[11571]: Error: no container with ID or name "ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a" found: no such container 2020-07-16T13:37:52.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:51 smithi132 podman[11600]: 2020-07-16 13:37:51.902488313 +0000 UTC m=+0.233475214 container create df4da6fb48d5895892151003327f2d6a4dd15b5415e106a835b245d43a76625f (image=quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a) 2020-07-16T13:37:52.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 podman[11600]: 2020-07-16 13:37:52.027488434 +0000 UTC m=+0.358475429 container init df4da6fb48d5895892151003327f2d6a4dd15b5415e106a835b245d43a76625f (image=quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a) 2020-07-16T13:37:52.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 podman[11600]: 2020-07-16 13:37:52.060738911 +0000 UTC m=+0.391725799 container start df4da6fb48d5895892151003327f2d6a4dd15b5415e106a835b245d43a76625f (image=quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a) 2020-07-16T13:37:52.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 podman[11600]: 2020-07-16 13:37:52.060803748 +0000 UTC m=+0.391790655 container attach df4da6fb48d5895892151003327f2d6a4dd15b5415e106a835b245d43a76625f (image=quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a) 2020-07-16T13:37:52.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.051+0000 7f9c45b82700 0 set uid:gid to 167:167 (ceph:ceph) 2020-07-16T13:37:52.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.051+0000 7f9c45b82700 0 ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev), process ceph-mon, pid 1 2020-07-16T13:37:52.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.051+0000 7f9c45b82700 0 pidfile_write: ignore empty --pid-file 2020-07-16T13:37:52.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.055+0000 7f9c45b82700 0 load: jerasure load: lrc load: isa 2020-07-16T13:37:52.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: RocksDB version: 6.8.1 2020-07-16T13:37:52.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2020-07-16T13:37:52.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Compile date Jul 16 2020 2020-07-16T13:37:52.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: DB SUMMARY 2020-07-16T13:37:52.282 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: CURRENT file: CURRENT 2020-07-16T13:37:52.282 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: IDENTITY file: IDENTITY 2020-07-16T13:37:52.282 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: MANIFEST file: MANIFEST-000019 size: 213 Bytes 2020-07-16T13:37:52.282 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 2, files: 000016.sst 000018.sst 2020-07-16T13:37:52.283 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000020.log size: 407300 ; 2020-07-16T13:37:52.283 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.error_if_exists: 0 2020-07-16T13:37:52.283 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.create_if_missing: 0 2020-07-16T13:37:52.283 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.paranoid_checks: 1 2020-07-16T13:37:52.283 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.env: 0x555f8f096c00 2020-07-16T13:37:52.284 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.fs: Posix File System 2020-07-16T13:37:52.284 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.info_log: 0x555f90ad86c0 2020-07-16T13:37:52.284 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.max_file_opening_threads: 16 2020-07-16T13:37:52.284 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.statistics: (nil) 2020-07-16T13:37:52.284 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.use_fsync: 0 2020-07-16T13:37:52.285 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.max_log_file_size: 0 2020-07-16T13:37:52.285 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2020-07-16T13:37:52.285 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.log_file_time_to_roll: 0 2020-07-16T13:37:52.285 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.keep_log_file_num: 1000 2020-07-16T13:37:52.285 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.recycle_log_file_num: 0 2020-07-16T13:37:52.286 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.allow_fallocate: 1 2020-07-16T13:37:52.286 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.allow_mmap_reads: 0 2020-07-16T13:37:52.286 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.allow_mmap_writes: 0 2020-07-16T13:37:52.287 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.use_direct_reads: 0 2020-07-16T13:37:52.287 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2020-07-16T13:37:52.287 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.create_missing_column_families: 0 2020-07-16T13:37:52.287 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.db_log_dir: 2020-07-16T13:37:52.287 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2020-07-16T13:37:52.288 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.table_cache_numshardbits: 6 2020-07-16T13:37:52.288 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.max_subcompactions: 1 2020-07-16T13:37:52.288 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.max_background_flushes: -1 2020-07-16T13:37:52.288 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.WAL_ttl_seconds: 0 2020-07-16T13:37:52.289 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.WAL_size_limit_MB: 0 2020-07-16T13:37:52.289 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2020-07-16T13:37:52.289 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2020-07-16T13:37:52.289 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.is_fd_close_on_exec: 1 2020-07-16T13:37:52.289 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.advise_random_on_open: 1 2020-07-16T13:37:52.290 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.db_write_buffer_size: 0 2020-07-16T13:37:52.290 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.write_buffer_manager: 0x555f90b27380 2020-07-16T13:37:52.290 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2020-07-16T13:37:52.290 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2020-07-16T13:37:52.291 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2020-07-16T13:37:52.291 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.use_adaptive_mutex: 0 2020-07-16T13:37:52.291 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.rate_limiter: (nil) 2020-07-16T13:37:52.291 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2020-07-16T13:37:52.291 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.wal_recovery_mode: 2 2020-07-16T13:37:52.292 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.enable_thread_tracking: 0 2020-07-16T13:37:52.292 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.enable_pipelined_write: 0 2020-07-16T13:37:52.292 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.unordered_write: 0 2020-07-16T13:37:52.292 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2020-07-16T13:37:52.292 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2020-07-16T13:37:52.293 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2020-07-16T13:37:52.293 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2020-07-16T13:37:52.293 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.row_cache: None 2020-07-16T13:37:52.293 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.wal_filter: None 2020-07-16T13:37:52.293 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2020-07-16T13:37:52.294 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.allow_ingest_behind: 0 2020-07-16T13:37:52.294 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.preserve_deletes: 0 2020-07-16T13:37:52.294 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.two_write_queues: 0 2020-07-16T13:37:52.294 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.manual_wal_flush: 0 2020-07-16T13:37:52.294 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.atomic_flush: 0 2020-07-16T13:37:52.295 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2020-07-16T13:37:52.295 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.persist_stats_to_disk: 0 2020-07-16T13:37:52.295 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.write_dbid_to_manifest: 0 2020-07-16T13:37:52.295 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.log_readahead_size: 0 2020-07-16T13:37:52.295 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2020-07-16T13:37:52.296 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.max_background_jobs: 2 2020-07-16T13:37:52.296 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.max_background_compactions: -1 2020-07-16T13:37:52.296 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2020-07-16T13:37:52.296 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2020-07-16T13:37:52.296 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.delayed_write_rate : 16777216 2020-07-16T13:37:52.297 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.max_total_wal_size: 0 2020-07-16T13:37:52.297 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2020-07-16T13:37:52.297 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.stats_dump_period_sec: 600 2020-07-16T13:37:52.297 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.stats_persist_period_sec: 600 2020-07-16T13:37:52.297 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2020-07-16T13:37:52.298 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.max_open_files: -1 2020-07-16T13:37:52.298 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.bytes_per_sync: 0 2020-07-16T13:37:52.298 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.wal_bytes_per_sync: 0 2020-07-16T13:37:52.298 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.strict_bytes_per_sync: 0 2020-07-16T13:37:52.298 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.compaction_readahead_size: 0 2020-07-16T13:37:52.299 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Compression algorithms supported: 2020-07-16T13:37:52.299 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2020-07-16T13:37:52.299 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: kZSTD supported: 0 2020-07-16T13:37:52.299 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: kXpressCompression supported: 0 2020-07-16T13:37:52.299 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: kLZ4HCCompression supported: 1 2020-07-16T13:37:52.300 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: kLZ4Compression supported: 1 2020-07-16T13:37:52.300 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: kBZip2Compression supported: 0 2020-07-16T13:37:52.300 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: kZlibCompression supported: 1 2020-07-16T13:37:52.300 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: kSnappyCompression supported: 1 2020-07-16T13:37:52.300 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Fast CRC32 supported: Supported on x86 2020-07-16T13:37:52.301 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000019 2020-07-16T13:37:52.301 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2020-07-16T13:37:52.301 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2020-07-16T13:37:52.302 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.merge_operator: 2020-07-16T13:37:52.302 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.compaction_filter: None 2020-07-16T13:37:52.302 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.compaction_filter_factory: None 2020-07-16T13:37:52.302 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.memtable_factory: SkipListFactory 2020-07-16T13:37:52.302 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.table_factory: BlockBasedTable 2020-07-16T13:37:52.303 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x555f90a7bbd8) 2020-07-16T13:37:52.303 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: cache_index_and_filter_blocks: 1 2020-07-16T13:37:52.303 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: cache_index_and_filter_blocks_with_high_priority: 1 2020-07-16T13:37:52.304 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: pin_l0_filter_and_index_blocks_in_cache: 0 2020-07-16T13:37:52.304 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: pin_top_level_index_and_filter: 1 2020-07-16T13:37:52.304 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: index_type: 0 2020-07-16T13:37:52.304 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: data_block_index_type: 0 2020-07-16T13:37:52.305 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: index_shortening: 1 2020-07-16T13:37:52.305 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: data_block_hash_table_util_ratio: 0.750000 2020-07-16T13:37:52.306 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: hash_index_allow_collision: 1 2020-07-16T13:37:52.306 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: checksum: 1 2020-07-16T13:37:52.306 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: no_block_cache: 0 2020-07-16T13:37:52.307 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: block_cache: 0x555f90ab4610 2020-07-16T13:37:52.307 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: block_cache_name: BinnedLRUCache 2020-07-16T13:37:52.307 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: block_cache_options: 2020-07-16T13:37:52.307 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: capacity : 536870912 2020-07-16T13:37:52.307 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: num_shard_bits : 4 2020-07-16T13:37:52.308 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: strict_capacity_limit : 0 2020-07-16T13:37:52.308 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: high_pri_pool_ratio: 0.000 2020-07-16T13:37:52.308 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: block_cache_compressed: (nil) 2020-07-16T13:37:52.308 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: persistent_cache: (nil) 2020-07-16T13:37:52.308 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: block_size: 4096 2020-07-16T13:37:52.308 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: block_size_deviation: 10 2020-07-16T13:37:52.309 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: block_restart_interval: 16 2020-07-16T13:37:52.309 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: index_block_restart_interval: 1 2020-07-16T13:37:52.309 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: metadata_block_size: 4096 2020-07-16T13:37:52.309 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: partition_filters: 0 2020-07-16T13:37:52.310 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: use_delta_encoding: 1 2020-07-16T13:37:52.310 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: filter_policy: rocksdb.BuiltinBloomFilter 2020-07-16T13:37:52.310 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: whole_key_filtering: 1 2020-07-16T13:37:52.310 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: verify_compression: 0 2020-07-16T13:37:52.310 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: read_amp_bytes_per_bit: 0 2020-07-16T13:37:52.311 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: format_version: 2 2020-07-16T13:37:52.311 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: enable_index_compression: 1 2020-07-16T13:37:52.311 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: block_align: 0 2020-07-16T13:37:52.312 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.write_buffer_size: 33554432 2020-07-16T13:37:52.312 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.max_write_buffer_number: 2 2020-07-16T13:37:52.312 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.compression: NoCompression 2020-07-16T13:37:52.312 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.bottommost_compression: Disabled 2020-07-16T13:37:52.312 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.prefix_extractor: nullptr 2020-07-16T13:37:52.313 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2020-07-16T13:37:52.313 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.num_levels: 7 2020-07-16T13:37:52.313 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2020-07-16T13:37:52.313 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2020-07-16T13:37:52.313 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2020-07-16T13:37:52.314 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2020-07-16T13:37:52.314 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2020-07-16T13:37:52.314 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2020-07-16T13:37:52.314 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2020-07-16T13:37:52.314 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2020-07-16T13:37:52.315 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2020-07-16T13:37:52.315 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.compression_opts.window_bits: -14 2020-07-16T13:37:52.315 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.compression_opts.level: 32767 2020-07-16T13:37:52.315 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.compression_opts.strategy: 0 2020-07-16T13:37:52.315 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2020-07-16T13:37:52.316 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2020-07-16T13:37:52.316 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.compression_opts.enabled: false 2020-07-16T13:37:52.316 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2020-07-16T13:37:52.316 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2020-07-16T13:37:52.316 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2020-07-16T13:37:52.317 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.target_file_size_base: 67108864 2020-07-16T13:37:52.317 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.target_file_size_multiplier: 1 2020-07-16T13:37:52.317 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2020-07-16T13:37:52.317 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2020-07-16T13:37:52.318 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2020-07-16T13:37:52.318 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2020-07-16T13:37:52.318 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2020-07-16T13:37:52.318 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2020-07-16T13:37:52.318 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2020-07-16T13:37:52.319 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2020-07-16T13:37:52.319 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2020-07-16T13:37:52.319 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2020-07-16T13:37:52.319 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2020-07-16T13:37:52.319 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2020-07-16T13:37:52.320 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.arena_block_size: 4194304 2020-07-16T13:37:52.320 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2020-07-16T13:37:52.320 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2020-07-16T13:37:52.320 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2020-07-16T13:37:52.321 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.disable_auto_compactions: 0 2020-07-16T13:37:52.321 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2020-07-16T13:37:52.321 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2020-07-16T13:37:52.321 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2020-07-16T13:37:52.321 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2020-07-16T13:37:52.322 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2020-07-16T13:37:52.322 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2020-07-16T13:37:52.322 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2020-07-16T13:37:52.322 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2020-07-16T13:37:52.322 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2020-07-16T13:37:52.323 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2020-07-16T13:37:52.323 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.table_properties_collectors: 2020-07-16T13:37:52.323 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.inplace_update_support: 0 2020-07-16T13:37:52.323 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.inplace_update_num_locks: 10000 2020-07-16T13:37:52.324 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2020-07-16T13:37:52.324 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2020-07-16T13:37:52.324 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.memtable_huge_page_size: 0 2020-07-16T13:37:52.324 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.bloom_locality: 0 2020-07-16T13:37:52.325 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.max_successive_merges: 0 2020-07-16T13:37:52.325 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.optimize_filters_for_hits: 0 2020-07-16T13:37:52.325 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.paranoid_file_checks: 0 2020-07-16T13:37:52.325 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.force_consistency_checks: 0 2020-07-16T13:37:52.325 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.report_bg_io_stats: 0 2020-07-16T13:37:52.326 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.ttl: 2592000 2020-07-16T13:37:52.326 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.056+0000 7f9c45b82700 4 rocksdb: Options.periodic_compaction_seconds: 0 2020-07-16T13:37:52.326 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.057+0000 7f9c45b82700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000019 succeeded,manifest_file_number is 19, next_file_number is 21, last_sequence is 6759, log_number is 15,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2020-07-16T13:37:52.326 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.057+0000 7f9c45b82700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 15 2020-07-16T13:37:52.326 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.057+0000 7f9c45b82700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1594906672058181, "job": 1, "event": "recovery_started", "log_files": [20]} 2020-07-16T13:37:52.327 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.057+0000 7f9c45b82700 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #20 mode 2 2020-07-16T13:37:52.327 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.057+0000 7f9c45b82700 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2020-07-16T13:37:52.327 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.058+0000 7f9c45b82700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1594906672059684, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 21, "file_size": 408095, "table_properties": {"data_size": 406846, "index_size": 239, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 197, "raw_key_size": 761, "raw_average_key_size": 23, "raw_value_size": 406007, "raw_average_value_size": 12687, "num_data_blocks": 8, "num_entries": 32, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1594906672, "oldest_key_time": 3, "file_creation_time": 0}} 2020-07-16T13:37:52.328 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.058+0000 7f9c45b82700 4 rocksdb: [version_set.cc:3826] Creating manifest 22 2020-07-16T13:37:52.328 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.058+0000 7f9c45b82700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1594906672060063, "job": 1, "event": "recovery_finished"} 2020-07-16T13:37:52.330 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.059+0000 7f9c45b82700 4 rocksdb: DB pointer 0x555f90b07800 2020-07-16T13:37:52.330 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.059+0000 7f9c2c9c8700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2020-07-16T13:37:52.330 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.059+0000 7f9c2c9c8700 4 rocksdb: [db_impl/db_impl.cc:851] 2020-07-16T13:37:52.330 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: ** DB Stats ** 2020-07-16T13:37:52.331 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: Uptime(secs): 0.0 total, 0.0 interval 2020-07-16T13:37:52.331 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2020-07-16T13:37:52.331 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2020-07-16T13:37:52.331 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2020-07-16T13:37:52.331 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2020-07-16T13:37:52.332 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2020-07-16T13:37:52.332 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2020-07-16T13:37:52.332 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: ** Compaction Stats [default] ** 2020-07-16T13:37:52.332 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2020-07-16T13:37:52.332 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2020-07-16T13:37:52.333 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: L0 2/0 6.04 MB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 395.1 0.00 0.00 1 0.001 0 0 2020-07-16T13:37:52.333 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: L6 1/0 54.98 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2020-07-16T13:37:52.333 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: Sum 3/0 61.02 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 395.1 0.00 0.00 1 0.001 0 0 2020-07-16T13:37:52.333 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 395.1 0.00 0.00 1 0.001 0 0 2020-07-16T13:37:52.333 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: ** Compaction Stats [default] ** 2020-07-16T13:37:52.334 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2020-07-16T13:37:52.334 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2020-07-16T13:37:52.334 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 395.1 0.00 0.00 1 0.001 0 0 2020-07-16T13:37:52.334 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: Uptime(secs): 0.0 total, 0.0 interval 2020-07-16T13:37:52.334 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: Flush(GB): cumulative 0.000, interval 0.000 2020-07-16T13:37:52.335 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: AddFile(GB): cumulative 0.000, interval 0.000 2020-07-16T13:37:52.335 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: AddFile(Total Files): cumulative 0, interval 0 2020-07-16T13:37:52.335 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: AddFile(L0 Files): cumulative 0, interval 0 2020-07-16T13:37:52.335 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: AddFile(Keys): cumulative 0, interval 0 2020-07-16T13:37:52.335 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: Cumulative compaction: 0.00 GB write, 114.10 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2020-07-16T13:37:52.336 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: Interval compaction: 0.00 GB write, 114.10 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2020-07-16T13:37:52.336 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2020-07-16T13:37:52.337 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: ** File Read Latency Histogram By Level [default] ** 2020-07-16T13:37:52.337 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: ** Compaction Stats [default] ** 2020-07-16T13:37:52.337 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2020-07-16T13:37:52.338 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2020-07-16T13:37:52.338 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: L0 2/0 6.04 MB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 395.1 0.00 0.00 1 0.001 0 0 2020-07-16T13:37:52.338 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: L6 1/0 54.98 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2020-07-16T13:37:52.338 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: Sum 3/0 61.02 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 395.1 0.00 0.00 1 0.001 0 0 2020-07-16T13:37:52.338 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2020-07-16T13:37:52.339 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: ** Compaction Stats [default] ** 2020-07-16T13:37:52.339 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2020-07-16T13:37:52.339 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2020-07-16T13:37:52.339 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 395.1 0.00 0.00 1 0.001 0 0 2020-07-16T13:37:52.339 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: Uptime(secs): 0.0 total, 0.0 interval 2020-07-16T13:37:52.340 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: Flush(GB): cumulative 0.000, interval 0.000 2020-07-16T13:37:52.340 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: AddFile(GB): cumulative 0.000, interval 0.000 2020-07-16T13:37:52.340 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: AddFile(Total Files): cumulative 0, interval 0 2020-07-16T13:37:52.340 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: AddFile(L0 Files): cumulative 0, interval 0 2020-07-16T13:37:52.340 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: AddFile(Keys): cumulative 0, interval 0 2020-07-16T13:37:52.341 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: Cumulative compaction: 0.00 GB write, 112.58 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2020-07-16T13:37:52.341 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2020-07-16T13:37:52.341 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2020-07-16T13:37:52.341 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: ** File Read Latency Histogram By Level [default] ** 2020-07-16T13:37:52.341 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.060+0000 7f9c45b82700 0 starting mon.a rank 0 at public addrs [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] at bind addrs [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 4c8ed362-c768-11ea-a06f-001a4aab830c 2020-07-16T13:37:52.342 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.061+0000 7f9c45b82700 1 mon.a@-1(???) e3 preinit fsid 4c8ed362-c768-11ea-a06f-001a4aab830c 2020-07-16T13:37:52.342 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.061+0000 7f9c45b82700 0 mon.a@-1(???).mds e1 new map 2020-07-16T13:37:52.342 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.061+0000 7f9c45b82700 0 mon.a@-1(???).mds e1 print_map 2020-07-16T13:37:52.342 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: e1 2020-07-16T13:37:52.342 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: enable_multiple, ever_enabled_multiple: 0,0 2020-07-16T13:37:52.343 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2020-07-16T13:37:52.343 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: legacy client fscid: -1 2020-07-16T13:37:52.343 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 2020-07-16T13:37:52.343 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: No filesystems configured 2020-07-16T13:37:52.343 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.061+0000 7f9c45b82700 0 mon.a@-1(???).osd e53 crush map has features 288514051259236352, adjusting msgr requires 2020-07-16T13:37:52.344 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.061+0000 7f9c45b82700 0 mon.a@-1(???).osd e53 crush map has features 3314933000852226048, adjusting msgr requires 2020-07-16T13:37:52.344 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.061+0000 7f9c45b82700 0 mon.a@-1(???).osd e53 crush map has features 288514051259236352, adjusting msgr requires 2020-07-16T13:37:52.344 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: audit 2020-07-16T13:37:36.508751+0000 mon.b (mon.2) 108 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632944\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632975\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633004\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633155\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633259\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633374\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633475\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633508\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:37:52.344 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: cluster 2020-07-16T13:37:37.211734+0000 mon.a (mon.0) 1 : cluster [INF] mon.a calling monitor election 2020-07-16T13:37:52.345 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: cluster 2020-07-16T13:37:37.213663+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2020-07-16T13:37:52.345 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: audit 2020-07-16T13:37:37.216962+0000 mon.a (mon.0) 3 : audit [INF] from='mgr.34499 ' entity='' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632944\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632975\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633004\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633155\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633259\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633374\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633475\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633508\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:37:52.345 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: cluster 2020-07-16T13:37:37.218621+0000 mon.a (mon.0) 4 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0],b=[v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0],c=[v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0]} 2020-07-16T13:37:52.345 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: cluster 2020-07-16T13:37:37.218663+0000 mon.a (mon.0) 5 : cluster [DBG] fsmap 2020-07-16T13:37:52.346 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: cluster 2020-07-16T13:37:37.218692+0000 mon.a (mon.0) 6 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2020-07-16T13:37:52.346 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: cluster 2020-07-16T13:37:37.219387+0000 mon.a (mon.0) 7 : cluster [DBG] mgrmap e20: x(active, since 36s), standbys: y 2020-07-16T13:37:52.346 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: audit 2020-07-16T13:37:37.221847+0000 mon.a (mon.0) 8 : audit [INF] from='mgr.34499 ' entity='' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632944\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632975\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633004\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633155\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633259\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633374\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633475\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633508\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:37:52.346 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: audit 2020-07-16T13:37:37.224012+0000 mon.b (mon.2) 109 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:37:52.347 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: cluster 2020-07-16T13:37:37.225743+0000 mon.a (mon.0) 9 : cluster [DBG] mgrmap e21: x(active, since 36s), standbys: y 2020-07-16T13:37:52.347 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: cluster 2020-07-16T13:37:37.225773+0000 mon.a (mon.0) 10 : cluster [INF] overall HEALTH_OK 2020-07-16T13:37:52.347 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.062+0000 7f9c45b82700 1 mon.a@-1(???).paxosservice(auth 1..18) refresh upgraded, format 0 -> 3 2020-07-16T13:37:52.347 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.064+0000 7f9c45b82700 20 expand_channel_meta expand map: {default=false} 2020-07-16T13:37:52.347 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.064+0000 7f9c45b82700 20 expand_channel_meta from 'false' to 'false' 2020-07-16T13:37:52.348 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.064+0000 7f9c45b82700 20 expand_channel_meta expanded map: {default=false} 2020-07-16T13:37:52.348 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.064+0000 7f9c45b82700 20 expand_channel_meta expand map: {default=info} 2020-07-16T13:37:52.348 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.064+0000 7f9c45b82700 20 expand_channel_meta from 'info' to 'info' 2020-07-16T13:37:52.348 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.064+0000 7f9c45b82700 20 expand_channel_meta expanded map: {default=info} 2020-07-16T13:37:52.348 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.064+0000 7f9c45b82700 20 expand_channel_meta expand map: {default=daemon} 2020-07-16T13:37:52.349 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.064+0000 7f9c45b82700 20 expand_channel_meta from 'daemon' to 'daemon' 2020-07-16T13:37:52.349 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.064+0000 7f9c45b82700 20 expand_channel_meta expanded map: {default=daemon} 2020-07-16T13:37:52.349 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.064+0000 7f9c45b82700 20 expand_channel_meta expand map: {default=debug} 2020-07-16T13:37:52.349 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.064+0000 7f9c45b82700 20 expand_channel_meta from 'debug' to 'debug' 2020-07-16T13:37:52.349 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.064+0000 7f9c45b82700 20 expand_channel_meta expanded map: {default=debug} 2020-07-16T13:37:52.350 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.0.0-3349-g7260671e53b/rpm/el8/BUILD/ceph-16.0.0-3349-g7260671e53b/src/mon/OSDMonitor.cc: In function 'virtual void OSDMonitor::encode_pending(MonitorDBStore::TransactionRef)' thread 7f9c2f1cd700 time 2020-07-16T13:37:52.276848+0000 2020-07-16T13:37:52.350 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.0.0-3349-g7260671e53b/rpm/el8/BUILD/ceph-16.0.0-3349-g7260671e53b/src/mon/OSDMonitor.cc: 2023: FAILED ceph_assert((features & ~mon->get_quorum_con_features()) == 0) 2020-07-16T13:37:52.350 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev) 2020-07-16T13:37:52.350 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7f9c3cd38b96] 2020-07-16T13:37:52.350 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 2: (()+0x275db0) [0x7f9c3cd38db0] 2020-07-16T13:37:52.351 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 3: (OSDMonitor::encode_pending(std::shared_ptr)+0x6738) [0x555f8e98d6d8] 2020-07-16T13:37:52.351 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 4: (PaxosService::propose_pending()+0x21a) [0x555f8e8fd99a] 2020-07-16T13:37:52.351 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 5: (MgrMonitor::drop_active()+0x346) [0x555f8e9f1ce6] 2020-07-16T13:37:52.351 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 6: (MgrMonitor::prepare_beacon(boost::intrusive_ptr)+0x1e27) [0x555f8e9f3e97] 2020-07-16T13:37:52.351 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 7: (MgrMonitor::prepare_update(boost::intrusive_ptr)+0x5b) [0x555f8e9f82db] 2020-07-16T13:37:52.352 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 8: (PaxosService::dispatch(boost::intrusive_ptr)+0xa6d) [0x555f8e8fe84d] 2020-07-16T13:37:52.352 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 9: (PaxosService::C_RetryMessage::_finish(int)+0x64) [0x555f8e85b754] 2020-07-16T13:37:52.352 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 10: (C_MonOp::finish(int)+0x49) [0x555f8e7fb089] 2020-07-16T13:37:52.352 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 11: (Context::complete(int)+0xd) [0x555f8e7f82ad] 2020-07-16T13:37:52.352 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 12: (void finish_contexts > >(ceph::common::CephContext*, std::__cxx11::list >&, int)+0xa5) [0x555f8e821ae5] 2020-07-16T13:37:52.353 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 13: (Paxos::finish_round()+0x27b) [0x555f8e8f51ab] 2020-07-16T13:37:52.353 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 14: (Paxos::handle_last(boost::intrusive_ptr)+0xe29) [0x555f8e8f6469] 2020-07-16T13:37:52.353 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 15: (Paxos::dispatch(boost::intrusive_ptr)+0x417) [0x555f8e8f7107] 2020-07-16T13:37:52.353 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 16: (Monitor::dispatch_op(boost::intrusive_ptr)+0xfea) [0x555f8e7f54ca] 2020-07-16T13:37:52.353 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 17: (Monitor::_ms_dispatch(Message*)+0x619) [0x555f8e7f6099] 2020-07-16T13:37:52.354 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 18: (Dispatcher::ms_dispatch2(boost::intrusive_ptr const&)+0x5c) [0x555f8e8227ac] 2020-07-16T13:37:52.354 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 19: (DispatchQueue::entry()+0x126a) [0x7f9c3cf5ff3a] 2020-07-16T13:37:52.354 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 20: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f9c3d00edf1] 2020-07-16T13:37:52.354 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 21: (()+0x82de) [0x7f9c3a8332de] 2020-07-16T13:37:52.354 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 22: (clone()+0x43) [0x7f9c3956ae83] 2020-07-16T13:37:52.355 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.277+0000 7f9c2f1cd700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.0.0-3349-g7260671e53b/rpm/el8/BUILD/ceph-16.0.0-3349-g7260671e53b/src/mon/OSDMonitor.cc: In function 'virtual void OSDMonitor::encode_pending(MonitorDBStore::TransactionRef)' thread 7f9c2f1cd700 time 2020-07-16T13:37:52.276848+0000 2020-07-16T13:37:52.355 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.0.0-3349-g7260671e53b/rpm/el8/BUILD/ceph-16.0.0-3349-g7260671e53b/src/mon/OSDMonitor.cc: 2023: FAILED ceph_assert((features & ~mon->get_quorum_con_features()) == 0) 2020-07-16T13:37:52.355 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev) 2020-07-16T13:37:52.355 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7f9c3cd38b96] 2020-07-16T13:37:52.356 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 2: (()+0x275db0) [0x7f9c3cd38db0] 2020-07-16T13:37:52.530 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 3: (OSDMonitor::encode_pending(std::shared_ptr)+0x6738) [0x555f8e98d6d8] 2020-07-16T13:37:52.530 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 4: (PaxosService::propose_pending()+0x21a) [0x555f8e8fd99a] 2020-07-16T13:37:52.530 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 5: (MgrMonitor::drop_active()+0x346) [0x555f8e9f1ce6] 2020-07-16T13:37:52.530 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 6: (MgrMonitor::prepare_beacon(boost::intrusive_ptr)+0x1e27) [0x555f8e9f3e97] 2020-07-16T13:37:52.531 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 7: (MgrMonitor::prepare_update(boost::intrusive_ptr)+0x5b) [0x555f8e9f82db] 2020-07-16T13:37:52.531 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 8: (PaxosService::dispatch(boost::intrusive_ptr)+0xa6d) [0x555f8e8fe84d] 2020-07-16T13:37:52.531 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 9: (PaxosService::C_RetryMessage::_finish(int)+0x64) [0x555f8e85b754] 2020-07-16T13:37:52.531 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 10: (C_MonOp::finish(int)+0x49) [0x555f8e7fb089] 2020-07-16T13:37:52.531 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 11: (Context::complete(int)+0xd) [0x555f8e7f82ad] 2020-07-16T13:37:52.532 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 12: (void finish_contexts > >(ceph::common::CephContext*, std::__cxx11::list >&, int)+0xa5) [0x555f8e821ae5] 2020-07-16T13:37:52.532 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 13: (Paxos::finish_round()+0x27b) [0x555f8e8f51ab] 2020-07-16T13:37:52.532 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 14: (Paxos::handle_last(boost::intrusive_ptr)+0xe29) [0x555f8e8f6469] 2020-07-16T13:37:52.532 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 15: (Paxos::dispatch(boost::intrusive_ptr)+0x417) [0x555f8e8f7107] 2020-07-16T13:37:52.532 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 16: (Monitor::dispatch_op(boost::intrusive_ptr)+0xfea) [0x555f8e7f54ca] 2020-07-16T13:37:52.533 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 17: (Monitor::_ms_dispatch(Message*)+0x619) [0x555f8e7f6099] 2020-07-16T13:37:52.533 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 18: (Dispatcher::ms_dispatch2(boost::intrusive_ptr const&)+0x5c) [0x555f8e8227ac] 2020-07-16T13:37:52.533 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 19: (DispatchQueue::entry()+0x126a) [0x7f9c3cf5ff3a] 2020-07-16T13:37:52.533 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 20: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f9c3d00edf1] 2020-07-16T13:37:52.533 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 21: (()+0x82de) [0x7f9c3a8332de] 2020-07-16T13:37:52.534 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 22: (clone()+0x43) [0x7f9c3956ae83] 2020-07-16T13:37:52.534 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: *** Caught signal (Aborted) ** 2020-07-16T13:37:52.534 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: in thread 7f9c2f1cd700 thread_name:ms_dispatch 2020-07-16T13:37:52.534 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev) 2020-07-16T13:37:52.534 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 1: (()+0x12dd0) [0x7f9c3a83ddd0] 2020-07-16T13:37:52.534 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 2: (gsignal()+0x10f) [0x7f9c394a670f] 2020-07-16T13:37:52.535 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 3: (abort()+0x127) [0x7f9c39490b25] 2020-07-16T13:37:52.535 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a9) [0x7f9c3cd38be7] 2020-07-16T13:37:52.535 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 5: (()+0x275db0) [0x7f9c3cd38db0] 2020-07-16T13:37:52.535 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 6: (OSDMonitor::encode_pending(std::shared_ptr)+0x6738) [0x555f8e98d6d8] 2020-07-16T13:37:52.535 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 7: (PaxosService::propose_pending()+0x21a) [0x555f8e8fd99a] 2020-07-16T13:37:52.536 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 8: (MgrMonitor::drop_active()+0x346) [0x555f8e9f1ce6] 2020-07-16T13:37:52.536 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 9: (MgrMonitor::prepare_beacon(boost::intrusive_ptr)+0x1e27) [0x555f8e9f3e97] 2020-07-16T13:37:52.536 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 10: (MgrMonitor::prepare_update(boost::intrusive_ptr)+0x5b) [0x555f8e9f82db] 2020-07-16T13:37:52.536 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 11: (PaxosService::dispatch(boost::intrusive_ptr)+0xa6d) [0x555f8e8fe84d] 2020-07-16T13:37:52.536 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 12: (PaxosService::C_RetryMessage::_finish(int)+0x64) [0x555f8e85b754] 2020-07-16T13:37:52.536 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 13: (C_MonOp::finish(int)+0x49) [0x555f8e7fb089] 2020-07-16T13:37:52.537 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 14: (Context::complete(int)+0xd) [0x555f8e7f82ad] 2020-07-16T13:37:52.537 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 15: (void finish_contexts > >(ceph::common::CephContext*, std::__cxx11::list >&, int)+0xa5) [0x555f8e821ae5] 2020-07-16T13:37:52.537 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 16: (Paxos::finish_round()+0x27b) [0x555f8e8f51ab] 2020-07-16T13:37:52.537 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 17: (Paxos::handle_last(boost::intrusive_ptr)+0xe29) [0x555f8e8f6469] 2020-07-16T13:37:52.537 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 18: (Paxos::dispatch(boost::intrusive_ptr)+0x417) [0x555f8e8f7107] 2020-07-16T13:37:52.538 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 19: (Monitor::dispatch_op(boost::intrusive_ptr)+0xfea) [0x555f8e7f54ca] 2020-07-16T13:37:52.538 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 20: (Monitor::_ms_dispatch(Message*)+0x619) [0x555f8e7f6099] 2020-07-16T13:37:52.538 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 21: (Dispatcher::ms_dispatch2(boost::intrusive_ptr const&)+0x5c) [0x555f8e8227ac] 2020-07-16T13:37:52.538 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 22: (DispatchQueue::entry()+0x126a) [0x7f9c3cf5ff3a] 2020-07-16T13:37:52.539 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 23: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f9c3d00edf1] 2020-07-16T13:37:52.539 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 24: (()+0x82de) [0x7f9c3a8332de] 2020-07-16T13:37:52.539 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 25: (clone()+0x43) [0x7f9c3956ae83] 2020-07-16T13:37:52.539 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 2020-07-16T13:37:52.280+0000 7f9c2f1cd700 -1 *** Caught signal (Aborted) ** 2020-07-16T13:37:52.540 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: in thread 7f9c2f1cd700 thread_name:ms_dispatch 2020-07-16T13:37:52.540 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev) 2020-07-16T13:37:52.540 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 1: (()+0x12dd0) [0x7f9c3a83ddd0] 2020-07-16T13:37:52.540 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 2: (gsignal()+0x10f) [0x7f9c394a670f] 2020-07-16T13:37:52.541 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 3: (abort()+0x127) [0x7f9c39490b25] 2020-07-16T13:37:52.541 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a9) [0x7f9c3cd38be7] 2020-07-16T13:37:52.541 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 5: (()+0x275db0) [0x7f9c3cd38db0] 2020-07-16T13:37:52.541 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 6: (OSDMonitor::encode_pending(std::shared_ptr)+0x6738) [0x555f8e98d6d8] 2020-07-16T13:37:52.541 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 7: (PaxosService::propose_pending()+0x21a) [0x555f8e8fd99a] 2020-07-16T13:37:52.542 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 8: (MgrMonitor::drop_active()+0x346) [0x555f8e9f1ce6] 2020-07-16T13:37:52.542 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 9: (MgrMonitor::prepare_beacon(boost::intrusive_ptr)+0x1e27) [0x555f8e9f3e97] 2020-07-16T13:37:52.543 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 10: (MgrMonitor::prepare_update(boost::intrusive_ptr)+0x5b) [0x555f8e9f82db] 2020-07-16T13:37:52.543 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 11: (PaxosService::dispatch(boost::intrusive_ptr)+0xa6d) [0x555f8e8fe84d] 2020-07-16T13:37:52.543 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 12: (PaxosService::C_RetryMessage::_finish(int)+0x64) [0x555f8e85b754] 2020-07-16T13:37:52.543 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 13: (C_MonOp::finish(int)+0x49) [0x555f8e7fb089] 2020-07-16T13:37:52.543 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 14: (Context::complete(int)+0xd) [0x555f8e7f82ad] 2020-07-16T13:37:52.543 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 15: (void finish_contexts > >(ceph::common::CephContext*, std::__cxx11::list >&, int)+0xa5) [0x555f8e821ae5] 2020-07-16T13:37:52.544 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 16: (Paxos::finish_round()+0x27b) [0x555f8e8f51ab] 2020-07-16T13:37:52.544 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 17: (Paxos::handle_last(boost::intrusive_ptr)+0xe29) [0x555f8e8f6469] 2020-07-16T13:37:52.544 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 18: (Paxos::dispatch(boost::intrusive_ptr)+0x417) [0x555f8e8f7107] 2020-07-16T13:37:52.544 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 19: (Monitor::dispatch_op(boost::intrusive_ptr)+0xfea) [0x555f8e7f54ca] 2020-07-16T13:37:52.544 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 20: (Monitor::_ms_dispatch(Message*)+0x619) [0x555f8e7f6099] 2020-07-16T13:37:52.545 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 21: (Dispatcher::ms_dispatch2(boost::intrusive_ptr const&)+0x5c) [0x555f8e8227ac] 2020-07-16T13:37:52.545 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 22: (DispatchQueue::entry()+0x126a) [0x7f9c3cf5ff3a] 2020-07-16T13:37:52.545 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 23: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f9c3d00edf1] 2020-07-16T13:37:52.546 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 24: (()+0x82de) [0x7f9c3a8332de] 2020-07-16T13:37:52.546 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 25: (clone()+0x43) [0x7f9c3956ae83] 2020-07-16T13:37:52.546 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-07-16T13:37:52.546 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug -1> 2020-07-16T13:37:52.277+0000 7f9c2f1cd700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.0.0-3349-g7260671e53b/rpm/el8/BUILD/ceph-16.0.0-3349-g7260671e53b/src/mon/OSDMonitor.cc: In function 'virtual void OSDMonitor::encode_pending(MonitorDBStore::TransactionRef)' thread 7f9c2f1cd700 time 2020-07-16T13:37:52.276848+0000 2020-07-16T13:37:52.546 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.0.0-3349-g7260671e53b/rpm/el8/BUILD/ceph-16.0.0-3349-g7260671e53b/src/mon/OSDMonitor.cc: 2023: FAILED ceph_assert((features & ~mon->get_quorum_con_features()) == 0) 2020-07-16T13:37:52.546 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev) 2020-07-16T13:37:52.547 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7f9c3cd38b96] 2020-07-16T13:37:52.547 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 2: (()+0x275db0) [0x7f9c3cd38db0] 2020-07-16T13:37:52.547 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 3: (OSDMonitor::encode_pending(std::shared_ptr)+0x6738) [0x555f8e98d6d8] 2020-07-16T13:37:52.547 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 4: (PaxosService::propose_pending()+0x21a) [0x555f8e8fd99a] 2020-07-16T13:37:52.547 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 5: (MgrMonitor::drop_active()+0x346) [0x555f8e9f1ce6] 2020-07-16T13:37:52.548 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 6: (MgrMonitor::prepare_beacon(boost::intrusive_ptr)+0x1e27) [0x555f8e9f3e97] 2020-07-16T13:37:52.548 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 7: (MgrMonitor::prepare_update(boost::intrusive_ptr)+0x5b) [0x555f8e9f82db] 2020-07-16T13:37:52.548 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 8: (PaxosService::dispatch(boost::intrusive_ptr)+0xa6d) [0x555f8e8fe84d] 2020-07-16T13:37:52.548 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 9: (PaxosService::C_RetryMessage::_finish(int)+0x64) [0x555f8e85b754] 2020-07-16T13:37:52.548 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 10: (C_MonOp::finish(int)+0x49) [0x555f8e7fb089] 2020-07-16T13:37:52.549 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 11: (Context::complete(int)+0xd) [0x555f8e7f82ad] 2020-07-16T13:37:52.549 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 12: (void finish_contexts > >(ceph::common::CephContext*, std::__cxx11::list >&, int)+0xa5) [0x555f8e821ae5] 2020-07-16T13:37:52.549 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 13: (Paxos::finish_round()+0x27b) [0x555f8e8f51ab] 2020-07-16T13:37:52.549 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 14: (Paxos::handle_last(boost::intrusive_ptr)+0xe29) [0x555f8e8f6469] 2020-07-16T13:37:52.549 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 15: (Paxos::dispatch(boost::intrusive_ptr)+0x417) [0x555f8e8f7107] 2020-07-16T13:37:52.550 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 16: (Monitor::dispatch_op(boost::intrusive_ptr)+0xfea) [0x555f8e7f54ca] 2020-07-16T13:37:52.550 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 17: (Monitor::_ms_dispatch(Message*)+0x619) [0x555f8e7f6099] 2020-07-16T13:37:52.550 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 18: (Dispatcher::ms_dispatch2(boost::intrusive_ptr const&)+0x5c) [0x555f8e8227ac] 2020-07-16T13:37:52.550 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 19: (DispatchQueue::entry()+0x126a) [0x7f9c3cf5ff3a] 2020-07-16T13:37:52.550 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 20: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f9c3d00edf1] 2020-07-16T13:37:52.551 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 21: (()+0x82de) [0x7f9c3a8332de] 2020-07-16T13:37:52.551 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 22: (clone()+0x43) [0x7f9c3956ae83] 2020-07-16T13:37:52.551 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 0> 2020-07-16T13:37:52.280+0000 7f9c2f1cd700 -1 *** Caught signal (Aborted) ** 2020-07-16T13:37:52.551 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: in thread 7f9c2f1cd700 thread_name:ms_dispatch 2020-07-16T13:37:52.551 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev) 2020-07-16T13:37:52.552 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 1: (()+0x12dd0) [0x7f9c3a83ddd0] 2020-07-16T13:37:52.552 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 2: (gsignal()+0x10f) [0x7f9c394a670f] 2020-07-16T13:37:52.552 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 3: (abort()+0x127) [0x7f9c39490b25] 2020-07-16T13:37:52.552 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a9) [0x7f9c3cd38be7] 2020-07-16T13:37:52.552 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 5: (()+0x275db0) [0x7f9c3cd38db0] 2020-07-16T13:37:52.553 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 6: (OSDMonitor::encode_pending(std::shared_ptr)+0x6738) [0x555f8e98d6d8] 2020-07-16T13:37:52.553 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 7: (PaxosService::propose_pending()+0x21a) [0x555f8e8fd99a] 2020-07-16T13:37:52.553 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 8: (MgrMonitor::drop_active()+0x346) [0x555f8e9f1ce6] 2020-07-16T13:37:52.553 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 9: (MgrMonitor::prepare_beacon(boost::intrusive_ptr)+0x1e27) [0x555f8e9f3e97] 2020-07-16T13:37:52.553 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 10: (MgrMonitor::prepare_update(boost::intrusive_ptr)+0x5b) [0x555f8e9f82db] 2020-07-16T13:37:52.554 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 11: (PaxosService::dispatch(boost::intrusive_ptr)+0xa6d) [0x555f8e8fe84d] 2020-07-16T13:37:52.554 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 12: (PaxosService::C_RetryMessage::_finish(int)+0x64) [0x555f8e85b754] 2020-07-16T13:37:52.554 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 13: (C_MonOp::finish(int)+0x49) [0x555f8e7fb089] 2020-07-16T13:37:52.554 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 14: (Context::complete(int)+0xd) [0x555f8e7f82ad] 2020-07-16T13:37:52.554 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 15: (void finish_contexts > >(ceph::common::CephContext*, std::__cxx11::list >&, int)+0xa5) [0x555f8e821ae5] 2020-07-16T13:37:52.554 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 16: (Paxos::finish_round()+0x27b) [0x555f8e8f51ab] 2020-07-16T13:37:52.555 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 17: (Paxos::handle_last(boost::intrusive_ptr)+0xe29) [0x555f8e8f6469] 2020-07-16T13:37:52.555 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 18: (Paxos::dispatch(boost::intrusive_ptr)+0x417) [0x555f8e8f7107] 2020-07-16T13:37:52.555 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 19: (Monitor::dispatch_op(boost::intrusive_ptr)+0xfea) [0x555f8e7f54ca] 2020-07-16T13:37:52.555 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 20: (Monitor::_ms_dispatch(Message*)+0x619) [0x555f8e7f6099] 2020-07-16T13:37:52.555 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 21: (Dispatcher::ms_dispatch2(boost::intrusive_ptr const&)+0x5c) [0x555f8e8227ac] 2020-07-16T13:37:52.556 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 22: (DispatchQueue::entry()+0x126a) [0x7f9c3cf5ff3a] 2020-07-16T13:37:52.556 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 23: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f9c3d00edf1] 2020-07-16T13:37:52.556 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 24: (()+0x82de) [0x7f9c3a8332de] 2020-07-16T13:37:52.556 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 25: (clone()+0x43) [0x7f9c3956ae83] 2020-07-16T13:37:52.556 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-07-16T13:37:52.556 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug -1> 2020-07-16T13:37:52.277+0000 7f9c2f1cd700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.0.0-3349-g7260671e53b/rpm/el8/BUILD/ceph-16.0.0-3349-g7260671e53b/src/mon/OSDMonitor.cc: In function 'virtual void OSDMonitor::encode_pending(MonitorDBStore::TransactionRef)' thread 7f9c2f1cd700 time 2020-07-16T13:37:52.276848+0000 2020-07-16T13:37:52.557 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.0.0-3349-g7260671e53b/rpm/el8/BUILD/ceph-16.0.0-3349-g7260671e53b/src/mon/OSDMonitor.cc: 2023: FAILED ceph_assert((features & ~mon->get_quorum_con_features()) == 0) 2020-07-16T13:37:52.557 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev) 2020-07-16T13:37:52.557 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7f9c3cd38b96] 2020-07-16T13:37:52.557 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 2: (()+0x275db0) [0x7f9c3cd38db0] 2020-07-16T13:37:52.557 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 3: (OSDMonitor::encode_pending(std::shared_ptr)+0x6738) [0x555f8e98d6d8] 2020-07-16T13:37:52.558 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 4: (PaxosService::propose_pending()+0x21a) [0x555f8e8fd99a] 2020-07-16T13:37:52.558 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 5: (MgrMonitor::drop_active()+0x346) [0x555f8e9f1ce6] 2020-07-16T13:37:52.558 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 6: (MgrMonitor::prepare_beacon(boost::intrusive_ptr)+0x1e27) [0x555f8e9f3e97] 2020-07-16T13:37:52.558 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 7: (MgrMonitor::prepare_update(boost::intrusive_ptr)+0x5b) [0x555f8e9f82db] 2020-07-16T13:37:52.558 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 8: (PaxosService::dispatch(boost::intrusive_ptr)+0xa6d) [0x555f8e8fe84d] 2020-07-16T13:37:52.559 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 9: (PaxosService::C_RetryMessage::_finish(int)+0x64) [0x555f8e85b754] 2020-07-16T13:37:52.559 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 10: (C_MonOp::finish(int)+0x49) [0x555f8e7fb089] 2020-07-16T13:37:52.559 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 11: (Context::complete(int)+0xd) [0x555f8e7f82ad] 2020-07-16T13:37:52.559 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 12: (void finish_contexts > >(ceph::common::CephContext*, std::__cxx11::list >&, int)+0xa5) [0x555f8e821ae5] 2020-07-16T13:37:52.559 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 13: (Paxos::finish_round()+0x27b) [0x555f8e8f51ab] 2020-07-16T13:37:52.560 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 14: (Paxos::handle_last(boost::intrusive_ptr)+0xe29) [0x555f8e8f6469] 2020-07-16T13:37:52.560 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 15: (Paxos::dispatch(boost::intrusive_ptr)+0x417) [0x555f8e8f7107] 2020-07-16T13:37:52.560 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 16: (Monitor::dispatch_op(boost::intrusive_ptr)+0xfea) [0x555f8e7f54ca] 2020-07-16T13:37:52.560 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 17: (Monitor::_ms_dispatch(Message*)+0x619) [0x555f8e7f6099] 2020-07-16T13:37:52.560 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 18: (Dispatcher::ms_dispatch2(boost::intrusive_ptr const&)+0x5c) [0x555f8e8227ac] 2020-07-16T13:37:52.561 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 19: (DispatchQueue::entry()+0x126a) [0x7f9c3cf5ff3a] 2020-07-16T13:37:52.561 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 20: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f9c3d00edf1] 2020-07-16T13:37:52.561 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 21: (()+0x82de) [0x7f9c3a8332de] 2020-07-16T13:37:52.561 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 22: (clone()+0x43) [0x7f9c3956ae83] 2020-07-16T13:37:52.561 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: debug 0> 2020-07-16T13:37:52.280+0000 7f9c2f1cd700 -1 *** Caught signal (Aborted) ** 2020-07-16T13:37:52.562 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: in thread 7f9c2f1cd700 thread_name:ms_dispatch 2020-07-16T13:37:52.562 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev) 2020-07-16T13:37:52.562 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 1: (()+0x12dd0) [0x7f9c3a83ddd0] 2020-07-16T13:37:52.562 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 2: (gsignal()+0x10f) [0x7f9c394a670f] 2020-07-16T13:37:52.563 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 3: (abort()+0x127) [0x7f9c39490b25] 2020-07-16T13:37:52.563 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a9) [0x7f9c3cd38be7] 2020-07-16T13:37:52.563 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 5: (()+0x275db0) [0x7f9c3cd38db0] 2020-07-16T13:37:52.563 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 6: (OSDMonitor::encode_pending(std::shared_ptr)+0x6738) [0x555f8e98d6d8] 2020-07-16T13:37:52.563 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 7: (PaxosService::propose_pending()+0x21a) [0x555f8e8fd99a] 2020-07-16T13:37:52.564 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 8: (MgrMonitor::drop_active()+0x346) [0x555f8e9f1ce6] 2020-07-16T13:37:52.564 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 9: (MgrMonitor::prepare_beacon(boost::intrusive_ptr)+0x1e27) [0x555f8e9f3e97] 2020-07-16T13:37:52.564 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 10: (MgrMonitor::prepare_update(boost::intrusive_ptr)+0x5b) [0x555f8e9f82db] 2020-07-16T13:37:52.564 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 11: (PaxosService::dispatch(boost::intrusive_ptr)+0xa6d) [0x555f8e8fe84d] 2020-07-16T13:37:52.564 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 12: (PaxosService::C_RetryMessage::_finish(int)+0x64) [0x555f8e85b754] 2020-07-16T13:37:52.565 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 13: (C_MonOp::finish(int)+0x49) [0x555f8e7fb089] 2020-07-16T13:37:52.565 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 14: (Context::complete(int)+0xd) [0x555f8e7f82ad] 2020-07-16T13:37:52.565 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 15: (void finish_contexts > >(ceph::common::CephContext*, std::__cxx11::list >&, int)+0xa5) [0x555f8e821ae5] 2020-07-16T13:37:52.565 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 16: (Paxos::finish_round()+0x27b) [0x555f8e8f51ab] 2020-07-16T13:37:52.565 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 17: (Paxos::handle_last(boost::intrusive_ptr)+0xe29) [0x555f8e8f6469] 2020-07-16T13:37:52.566 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 18: (Paxos::dispatch(boost::intrusive_ptr)+0x417) [0x555f8e8f7107] 2020-07-16T13:37:52.566 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 19: (Monitor::dispatch_op(boost::intrusive_ptr)+0xfea) [0x555f8e7f54ca] 2020-07-16T13:37:52.566 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 20: (Monitor::_ms_dispatch(Message*)+0x619) [0x555f8e7f6099] 2020-07-16T13:37:52.566 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 21: (Dispatcher::ms_dispatch2(boost::intrusive_ptr const&)+0x5c) [0x555f8e8227ac] 2020-07-16T13:37:52.567 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 22: (DispatchQueue::entry()+0x126a) [0x7f9c3cf5ff3a] 2020-07-16T13:37:52.567 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 23: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f9c3d00edf1] 2020-07-16T13:37:52.567 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 24: (()+0x82de) [0x7f9c3a8332de] 2020-07-16T13:37:52.567 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: 25: (clone()+0x43) [0x7f9c3956ae83] 2020-07-16T13:37:52.568 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-07-16T13:37:52.568 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 bash[11571]: reraise_fatal: default handler for signal 6 didn't terminate the process? 2020-07-16T13:37:52.568 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 podman[11600]: 2020-07-16 13:37:52.369309527 +0000 UTC m=+0.700296459 container died df4da6fb48d5895892151003327f2d6a4dd15b5415e106a835b245d43a76625f (image=quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a) 2020-07-16T13:37:53.278 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 podman[11600]: 2020-07-16 13:37:52.878692952 +0000 UTC m=+1.209679863 container remove df4da6fb48d5895892151003327f2d6a4dd15b5415e106a835b245d43a76625f (image=quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a) 2020-07-16T13:37:53.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 systemd[1]: ceph-4c8ed362-c768-11ea-a06f-001a4aab830c@mon.a.service: Main process exited, code=exited, status=1/FAILURE 2020-07-16T13:37:53.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:37:52 smithi132 systemd[1]: ceph-4c8ed362-c768-11ea-a06f-001a4aab830c@mon.a.service: Failed with result 'exit-code'. 2020-07-16T13:38:03.378 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 systemd[1]: ceph-4c8ed362-c768-11ea-a06f-001a4aab830c@mon.a.service: Service RestartSec=10s expired, scheduling restart. 2020-07-16T13:38:03.378 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 systemd[1]: ceph-4c8ed362-c768-11ea-a06f-001a4aab830c@mon.a.service: Scheduled restart job, restart counter is at 2. 2020-07-16T13:38:03.379 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 systemd[1]: Stopped Ceph mon.a for 4c8ed362-c768-11ea-a06f-001a4aab830c. 2020-07-16T13:38:03.379 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 systemd[1]: Starting Ceph mon.a for 4c8ed362-c768-11ea-a06f-001a4aab830c... 2020-07-16T13:38:03.379 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 podman[11711]: Error: no container with name or ID ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a found: no such container 2020-07-16T13:38:03.379 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 systemd[1]: Started Ceph mon.a for 4c8ed362-c768-11ea-a06f-001a4aab830c. 2020-07-16T13:38:03.380 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: Error: Failed to evict container: "": Failed to find container "ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a" in state: no container with name or ID ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a found: no such container 2020-07-16T13:38:03.380 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a 2020-07-16T13:38:03.380 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: Error: no container with ID or name "ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a" found: no such container 2020-07-16T13:38:03.780 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 podman[11756]: 2020-07-16 13:38:03.377018775 +0000 UTC m=+0.208954702 container create b50c9a5eeb10bfa010c978500ef40e2bb97aa7d003b9b884f26801719daf9c07 (image=quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a) 2020-07-16T13:38:03.780 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 podman[11756]: 2020-07-16 13:38:03.54225396 +0000 UTC m=+0.374189892 container init b50c9a5eeb10bfa010c978500ef40e2bb97aa7d003b9b884f26801719daf9c07 (image=quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a) 2020-07-16T13:38:03.780 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 podman[11756]: 2020-07-16 13:38:03.575608672 +0000 UTC m=+0.407544616 container start b50c9a5eeb10bfa010c978500ef40e2bb97aa7d003b9b884f26801719daf9c07 (image=quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a) 2020-07-16T13:38:03.780 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 podman[11756]: 2020-07-16 13:38:03.575679009 +0000 UTC m=+0.407614966 container attach b50c9a5eeb10bfa010c978500ef40e2bb97aa7d003b9b884f26801719daf9c07 (image=quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a) 2020-07-16T13:38:03.781 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.564+0000 7f457d369700 0 set uid:gid to 167:167 (ceph:ceph) 2020-07-16T13:38:03.781 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.564+0000 7f457d369700 0 ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev), process ceph-mon, pid 1 2020-07-16T13:38:03.781 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.564+0000 7f457d369700 0 pidfile_write: ignore empty --pid-file 2020-07-16T13:38:03.781 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.568+0000 7f457d369700 0 load: jerasure load: lrc load: isa 2020-07-16T13:38:03.781 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.568+0000 7f457d369700 4 rocksdb: RocksDB version: 6.8.1 2020-07-16T13:38:03.782 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.568+0000 7f457d369700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2020-07-16T13:38:03.782 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.568+0000 7f457d369700 4 rocksdb: Compile date Jul 16 2020 2020-07-16T13:38:03.782 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.568+0000 7f457d369700 4 rocksdb: DB SUMMARY 2020-07-16T13:38:03.782 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.568+0000 7f457d369700 4 rocksdb: CURRENT file: CURRENT 2020-07-16T13:38:03.782 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.568+0000 7f457d369700 4 rocksdb: IDENTITY file: IDENTITY 2020-07-16T13:38:03.783 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.568+0000 7f457d369700 4 rocksdb: MANIFEST file: MANIFEST-000022 size: 285 Bytes 2020-07-16T13:38:03.783 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.568+0000 7f457d369700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 3, files: 000016.sst 000018.sst 000021.sst 2020-07-16T13:38:03.783 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.568+0000 7f457d369700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000023.log size: 3399 ; 2020-07-16T13:38:03.783 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.568+0000 7f457d369700 4 rocksdb: Options.error_if_exists: 0 2020-07-16T13:38:03.783 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.568+0000 7f457d369700 4 rocksdb: Options.create_if_missing: 0 2020-07-16T13:38:03.784 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.568+0000 7f457d369700 4 rocksdb: Options.paranoid_checks: 1 2020-07-16T13:38:03.784 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.568+0000 7f457d369700 4 rocksdb: Options.env: 0x5573a24a5c00 2020-07-16T13:38:03.784 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.568+0000 7f457d369700 4 rocksdb: Options.fs: Posix File System 2020-07-16T13:38:03.784 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.568+0000 7f457d369700 4 rocksdb: Options.info_log: 0x5573a3f8e6c0 2020-07-16T13:38:03.784 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.568+0000 7f457d369700 4 rocksdb: Options.max_file_opening_threads: 16 2020-07-16T13:38:03.785 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.568+0000 7f457d369700 4 rocksdb: Options.statistics: (nil) 2020-07-16T13:38:03.785 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.568+0000 7f457d369700 4 rocksdb: Options.use_fsync: 0 2020-07-16T13:38:03.785 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.568+0000 7f457d369700 4 rocksdb: Options.max_log_file_size: 0 2020-07-16T13:38:03.785 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.568+0000 7f457d369700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2020-07-16T13:38:03.785 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.568+0000 7f457d369700 4 rocksdb: Options.log_file_time_to_roll: 0 2020-07-16T13:38:03.786 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.568+0000 7f457d369700 4 rocksdb: Options.keep_log_file_num: 1000 2020-07-16T13:38:03.786 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.568+0000 7f457d369700 4 rocksdb: Options.recycle_log_file_num: 0 2020-07-16T13:38:03.786 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.568+0000 7f457d369700 4 rocksdb: Options.allow_fallocate: 1 2020-07-16T13:38:03.786 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.568+0000 7f457d369700 4 rocksdb: Options.allow_mmap_reads: 0 2020-07-16T13:38:03.786 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.568+0000 7f457d369700 4 rocksdb: Options.allow_mmap_writes: 0 2020-07-16T13:38:03.786 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.568+0000 7f457d369700 4 rocksdb: Options.use_direct_reads: 0 2020-07-16T13:38:03.787 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.568+0000 7f457d369700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2020-07-16T13:38:03.787 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.568+0000 7f457d369700 4 rocksdb: Options.create_missing_column_families: 0 2020-07-16T13:38:03.787 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.568+0000 7f457d369700 4 rocksdb: Options.db_log_dir: 2020-07-16T13:38:03.787 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.568+0000 7f457d369700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2020-07-16T13:38:03.787 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.table_cache_numshardbits: 6 2020-07-16T13:38:03.788 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.max_subcompactions: 1 2020-07-16T13:38:03.788 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.max_background_flushes: -1 2020-07-16T13:38:03.788 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.WAL_ttl_seconds: 0 2020-07-16T13:38:03.789 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.WAL_size_limit_MB: 0 2020-07-16T13:38:03.789 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2020-07-16T13:38:03.789 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2020-07-16T13:38:03.789 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.is_fd_close_on_exec: 1 2020-07-16T13:38:03.789 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.advise_random_on_open: 1 2020-07-16T13:38:03.790 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.db_write_buffer_size: 0 2020-07-16T13:38:03.790 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.write_buffer_manager: 0x5573a3fdd380 2020-07-16T13:38:03.790 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2020-07-16T13:38:03.790 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2020-07-16T13:38:03.790 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2020-07-16T13:38:03.791 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.use_adaptive_mutex: 0 2020-07-16T13:38:03.791 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.rate_limiter: (nil) 2020-07-16T13:38:03.791 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2020-07-16T13:38:03.791 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.wal_recovery_mode: 2 2020-07-16T13:38:03.791 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.enable_thread_tracking: 0 2020-07-16T13:38:03.792 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.enable_pipelined_write: 0 2020-07-16T13:38:03.792 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.unordered_write: 0 2020-07-16T13:38:03.792 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2020-07-16T13:38:03.792 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2020-07-16T13:38:03.792 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2020-07-16T13:38:03.792 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2020-07-16T13:38:03.793 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.row_cache: None 2020-07-16T13:38:03.793 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.wal_filter: None 2020-07-16T13:38:03.793 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2020-07-16T13:38:03.793 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.allow_ingest_behind: 0 2020-07-16T13:38:03.793 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.preserve_deletes: 0 2020-07-16T13:38:03.794 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.two_write_queues: 0 2020-07-16T13:38:03.794 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.manual_wal_flush: 0 2020-07-16T13:38:03.794 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.atomic_flush: 0 2020-07-16T13:38:03.794 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2020-07-16T13:38:03.794 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.persist_stats_to_disk: 0 2020-07-16T13:38:03.795 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.write_dbid_to_manifest: 0 2020-07-16T13:38:03.795 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.log_readahead_size: 0 2020-07-16T13:38:03.795 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2020-07-16T13:38:03.795 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.max_background_jobs: 2 2020-07-16T13:38:03.795 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.max_background_compactions: -1 2020-07-16T13:38:03.795 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2020-07-16T13:38:03.796 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2020-07-16T13:38:03.796 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.delayed_write_rate : 16777216 2020-07-16T13:38:03.796 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.max_total_wal_size: 0 2020-07-16T13:38:03.796 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2020-07-16T13:38:03.796 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.stats_dump_period_sec: 600 2020-07-16T13:38:03.797 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.stats_persist_period_sec: 600 2020-07-16T13:38:03.797 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2020-07-16T13:38:03.797 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.max_open_files: -1 2020-07-16T13:38:03.797 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.bytes_per_sync: 0 2020-07-16T13:38:03.797 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.wal_bytes_per_sync: 0 2020-07-16T13:38:03.801 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.strict_bytes_per_sync: 0 2020-07-16T13:38:03.801 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.compaction_readahead_size: 0 2020-07-16T13:38:03.801 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Compression algorithms supported: 2020-07-16T13:38:03.801 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2020-07-16T13:38:03.802 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: kZSTD supported: 0 2020-07-16T13:38:03.802 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: kXpressCompression supported: 0 2020-07-16T13:38:03.802 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: kLZ4HCCompression supported: 1 2020-07-16T13:38:03.802 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: kLZ4Compression supported: 1 2020-07-16T13:38:03.802 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: kBZip2Compression supported: 0 2020-07-16T13:38:03.803 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: kZlibCompression supported: 1 2020-07-16T13:38:03.803 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: kSnappyCompression supported: 1 2020-07-16T13:38:03.803 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Fast CRC32 supported: Supported on x86 2020-07-16T13:38:03.803 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000022 2020-07-16T13:38:03.803 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2020-07-16T13:38:03.804 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2020-07-16T13:38:03.804 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.merge_operator: 2020-07-16T13:38:03.804 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.compaction_filter: None 2020-07-16T13:38:03.804 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.compaction_filter_factory: None 2020-07-16T13:38:03.804 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.memtable_factory: SkipListFactory 2020-07-16T13:38:03.805 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.table_factory: BlockBasedTable 2020-07-16T13:38:03.805 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5573a3f31bd8) 2020-07-16T13:38:03.805 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: cache_index_and_filter_blocks: 1 2020-07-16T13:38:03.805 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: cache_index_and_filter_blocks_with_high_priority: 1 2020-07-16T13:38:03.805 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: pin_l0_filter_and_index_blocks_in_cache: 0 2020-07-16T13:38:03.806 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: pin_top_level_index_and_filter: 1 2020-07-16T13:38:03.806 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: index_type: 0 2020-07-16T13:38:03.806 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: data_block_index_type: 0 2020-07-16T13:38:03.806 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: index_shortening: 1 2020-07-16T13:38:03.807 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: data_block_hash_table_util_ratio: 0.750000 2020-07-16T13:38:03.807 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: hash_index_allow_collision: 1 2020-07-16T13:38:03.807 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: checksum: 1 2020-07-16T13:38:03.807 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: no_block_cache: 0 2020-07-16T13:38:03.808 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: block_cache: 0x5573a3f6a610 2020-07-16T13:38:03.808 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: block_cache_name: BinnedLRUCache 2020-07-16T13:38:03.808 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: block_cache_options: 2020-07-16T13:38:03.809 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: capacity : 536870912 2020-07-16T13:38:03.809 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: num_shard_bits : 4 2020-07-16T13:38:03.809 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: strict_capacity_limit : 0 2020-07-16T13:38:03.810 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: high_pri_pool_ratio: 0.000 2020-07-16T13:38:03.810 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: block_cache_compressed: (nil) 2020-07-16T13:38:03.810 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: persistent_cache: (nil) 2020-07-16T13:38:03.810 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: block_size: 4096 2020-07-16T13:38:03.810 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: block_size_deviation: 10 2020-07-16T13:38:03.811 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: block_restart_interval: 16 2020-07-16T13:38:03.812 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: index_block_restart_interval: 1 2020-07-16T13:38:03.812 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: metadata_block_size: 4096 2020-07-16T13:38:03.812 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: partition_filters: 0 2020-07-16T13:38:03.812 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: use_delta_encoding: 1 2020-07-16T13:38:03.812 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: filter_policy: rocksdb.BuiltinBloomFilter 2020-07-16T13:38:03.813 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: whole_key_filtering: 1 2020-07-16T13:38:03.813 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: verify_compression: 0 2020-07-16T13:38:03.813 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: read_amp_bytes_per_bit: 0 2020-07-16T13:38:03.813 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: format_version: 2 2020-07-16T13:38:03.814 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: enable_index_compression: 1 2020-07-16T13:38:03.814 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: block_align: 0 2020-07-16T13:38:03.814 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.write_buffer_size: 33554432 2020-07-16T13:38:03.814 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.max_write_buffer_number: 2 2020-07-16T13:38:03.814 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.compression: NoCompression 2020-07-16T13:38:03.815 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.bottommost_compression: Disabled 2020-07-16T13:38:03.815 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.prefix_extractor: nullptr 2020-07-16T13:38:03.815 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2020-07-16T13:38:03.815 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.num_levels: 7 2020-07-16T13:38:03.815 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2020-07-16T13:38:03.816 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2020-07-16T13:38:03.816 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2020-07-16T13:38:03.816 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2020-07-16T13:38:03.816 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2020-07-16T13:38:03.816 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2020-07-16T13:38:03.817 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2020-07-16T13:38:03.817 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2020-07-16T13:38:03.817 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2020-07-16T13:38:03.817 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.compression_opts.window_bits: -14 2020-07-16T13:38:03.818 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.compression_opts.level: 32767 2020-07-16T13:38:03.818 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.compression_opts.strategy: 0 2020-07-16T13:38:03.818 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2020-07-16T13:38:03.818 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2020-07-16T13:38:03.818 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.compression_opts.enabled: false 2020-07-16T13:38:03.819 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2020-07-16T13:38:03.819 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2020-07-16T13:38:03.819 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2020-07-16T13:38:03.819 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.target_file_size_base: 67108864 2020-07-16T13:38:03.819 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.target_file_size_multiplier: 1 2020-07-16T13:38:03.820 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2020-07-16T13:38:03.820 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2020-07-16T13:38:03.820 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2020-07-16T13:38:03.820 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2020-07-16T13:38:03.820 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2020-07-16T13:38:03.822 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2020-07-16T13:38:03.822 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2020-07-16T13:38:03.823 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2020-07-16T13:38:03.823 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2020-07-16T13:38:03.823 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2020-07-16T13:38:03.823 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2020-07-16T13:38:03.824 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2020-07-16T13:38:03.824 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.arena_block_size: 4194304 2020-07-16T13:38:03.824 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2020-07-16T13:38:03.824 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2020-07-16T13:38:03.824 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2020-07-16T13:38:03.825 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.disable_auto_compactions: 0 2020-07-16T13:38:03.825 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2020-07-16T13:38:03.825 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2020-07-16T13:38:03.825 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2020-07-16T13:38:03.825 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2020-07-16T13:38:03.826 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2020-07-16T13:38:03.826 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2020-07-16T13:38:03.826 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2020-07-16T13:38:03.826 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2020-07-16T13:38:03.827 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2020-07-16T13:38:03.827 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2020-07-16T13:38:03.827 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.table_properties_collectors: 2020-07-16T13:38:03.827 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.inplace_update_support: 0 2020-07-16T13:38:03.828 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.inplace_update_num_locks: 10000 2020-07-16T13:38:03.828 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2020-07-16T13:38:03.828 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2020-07-16T13:38:03.828 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.memtable_huge_page_size: 0 2020-07-16T13:38:03.828 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.bloom_locality: 0 2020-07-16T13:38:03.829 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.max_successive_merges: 0 2020-07-16T13:38:03.829 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.optimize_filters_for_hits: 0 2020-07-16T13:38:03.829 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.paranoid_file_checks: 0 2020-07-16T13:38:03.829 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.force_consistency_checks: 0 2020-07-16T13:38:03.829 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.report_bg_io_stats: 0 2020-07-16T13:38:03.830 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.ttl: 2592000 2020-07-16T13:38:03.830 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: Options.periodic_compaction_seconds: 0 2020-07-16T13:38:03.830 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000022 succeeded,manifest_file_number is 22, next_file_number is 24, last_sequence is 6802, log_number is 21,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2020-07-16T13:38:03.830 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 21 2020-07-16T13:38:03.831 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1594906683571042, "job": 1, "event": "recovery_started", "log_files": [23]} 2020-07-16T13:38:03.831 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.569+0000 7f457d369700 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #23 mode 2 2020-07-16T13:38:03.831 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.570+0000 7f457d369700 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2020-07-16T13:38:03.831 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.570+0000 7f457d369700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1594906683571657, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 24, "file_size": 4135, "table_properties": {"data_size": 3218, "index_size": 42, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 69, "raw_key_size": 150, "raw_average_key_size": 25, "raw_value_size": 3070, "raw_average_value_size": 511, "num_data_blocks": 1, "num_entries": 6, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1594906683, "oldest_key_time": 3, "file_creation_time": 0}} 2020-07-16T13:38:03.832 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.570+0000 7f457d369700 4 rocksdb: [version_set.cc:3826] Creating manifest 25 2020-07-16T13:38:03.832 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.571+0000 7f457d369700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1594906683572105, "job": 1, "event": "recovery_finished"} 2020-07-16T13:38:03.832 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.571+0000 7f457d369700 4 rocksdb: DB pointer 0x5573a3fbd800 2020-07-16T13:38:03.832 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.571+0000 7f45641af700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2020-07-16T13:38:03.833 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.571+0000 7f45641af700 4 rocksdb: [db_impl/db_impl.cc:851] 2020-07-16T13:38:03.833 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: ** DB Stats ** 2020-07-16T13:38:03.833 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: Uptime(secs): 0.0 total, 0.0 interval 2020-07-16T13:38:03.833 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2020-07-16T13:38:03.833 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2020-07-16T13:38:03.834 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2020-07-16T13:38:03.834 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2020-07-16T13:38:03.834 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2020-07-16T13:38:03.834 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2020-07-16T13:38:03.835 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: ** Compaction Stats [default] ** 2020-07-16T13:38:03.835 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2020-07-16T13:38:03.835 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2020-07-16T13:38:03.835 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: L0 3/0 6.04 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 8.4 0.00 0.00 1 0.000 0 0 2020-07-16T13:38:03.835 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: L6 1/0 54.98 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2020-07-16T13:38:03.836 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: Sum 4/0 61.02 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 8.4 0.00 0.00 1 0.000 0 0 2020-07-16T13:38:03.836 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 8.4 0.00 0.00 1 0.000 0 0 2020-07-16T13:38:03.836 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: ** Compaction Stats [default] ** 2020-07-16T13:38:03.836 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2020-07-16T13:38:03.836 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2020-07-16T13:38:03.837 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 8.4 0.00 0.00 1 0.000 0 0 2020-07-16T13:38:03.837 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: Uptime(secs): 0.0 total, 0.0 interval 2020-07-16T13:38:03.837 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: Flush(GB): cumulative 0.000, interval 0.000 2020-07-16T13:38:03.837 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: AddFile(GB): cumulative 0.000, interval 0.000 2020-07-16T13:38:03.837 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: AddFile(Total Files): cumulative 0, interval 0 2020-07-16T13:38:03.838 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: AddFile(L0 Files): cumulative 0, interval 0 2020-07-16T13:38:03.838 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: AddFile(Keys): cumulative 0, interval 0 2020-07-16T13:38:03.838 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: Cumulative compaction: 0.00 GB write, 1.50 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2020-07-16T13:38:03.838 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: Interval compaction: 0.00 GB write, 1.50 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2020-07-16T13:38:03.838 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2020-07-16T13:38:03.839 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: ** File Read Latency Histogram By Level [default] ** 2020-07-16T13:38:03.839 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: ** Compaction Stats [default] ** 2020-07-16T13:38:03.839 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2020-07-16T13:38:03.839 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2020-07-16T13:38:03.839 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: L0 3/0 6.04 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 8.4 0.00 0.00 1 0.000 0 0 2020-07-16T13:38:03.840 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: L6 1/0 54.98 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2020-07-16T13:38:03.840 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: Sum 4/0 61.02 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 8.4 0.00 0.00 1 0.000 0 0 2020-07-16T13:38:03.840 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2020-07-16T13:38:03.840 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: ** Compaction Stats [default] ** 2020-07-16T13:38:03.840 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2020-07-16T13:38:03.841 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2020-07-16T13:38:03.841 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 8.4 0.00 0.00 1 0.000 0 0 2020-07-16T13:38:03.841 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: Uptime(secs): 0.0 total, 0.0 interval 2020-07-16T13:38:03.841 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: Flush(GB): cumulative 0.000, interval 0.000 2020-07-16T13:38:03.841 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: AddFile(GB): cumulative 0.000, interval 0.000 2020-07-16T13:38:03.842 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: AddFile(Total Files): cumulative 0, interval 0 2020-07-16T13:38:03.842 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: AddFile(L0 Files): cumulative 0, interval 0 2020-07-16T13:38:03.842 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: AddFile(Keys): cumulative 0, interval 0 2020-07-16T13:38:03.843 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: Cumulative compaction: 0.00 GB write, 1.48 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2020-07-16T13:38:03.843 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2020-07-16T13:38:03.843 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2020-07-16T13:38:03.843 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: ** File Read Latency Histogram By Level [default] ** 2020-07-16T13:38:03.844 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.572+0000 7f457d369700 0 starting mon.a rank 0 at public addrs [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] at bind addrs [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 4c8ed362-c768-11ea-a06f-001a4aab830c 2020-07-16T13:38:03.844 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.573+0000 7f457d369700 1 mon.a@-1(???) e3 preinit fsid 4c8ed362-c768-11ea-a06f-001a4aab830c 2020-07-16T13:38:03.844 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.573+0000 7f457d369700 0 mon.a@-1(???).mds e1 new map 2020-07-16T13:38:03.844 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.573+0000 7f457d369700 0 mon.a@-1(???).mds e1 print_map 2020-07-16T13:38:03.845 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: e1 2020-07-16T13:38:03.845 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: enable_multiple, ever_enabled_multiple: 0,0 2020-07-16T13:38:03.845 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2020-07-16T13:38:03.845 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: legacy client fscid: -1 2020-07-16T13:38:03.845 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 2020-07-16T13:38:03.846 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: No filesystems configured 2020-07-16T13:38:03.846 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.573+0000 7f457d369700 0 mon.a@-1(???).osd e53 crush map has features 288514051259236352, adjusting msgr requires 2020-07-16T13:38:03.846 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.573+0000 7f457d369700 0 mon.a@-1(???).osd e53 crush map has features 3314933000852226048, adjusting msgr requires 2020-07-16T13:38:03.846 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.573+0000 7f457d369700 0 mon.a@-1(???).osd e53 crush map has features 288514051259236352, adjusting msgr requires 2020-07-16T13:38:03.847 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: audit 2020-07-16T13:37:36.508751+0000 mon.b (mon.2) 108 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632944\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632975\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633004\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633155\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633259\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633374\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633475\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633508\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:38:03.847 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: cluster 2020-07-16T13:37:37.211734+0000 mon.a (mon.0) 1 : cluster [INF] mon.a calling monitor election 2020-07-16T13:38:03.848 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: cluster 2020-07-16T13:37:37.213663+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2020-07-16T13:38:03.848 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: audit 2020-07-16T13:37:37.216962+0000 mon.a (mon.0) 3 : audit [INF] from='mgr.34499 ' entity='' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632944\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632975\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633004\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633155\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633259\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633374\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633475\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633508\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:38:03.848 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: cluster 2020-07-16T13:37:37.218621+0000 mon.a (mon.0) 4 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0],b=[v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0],c=[v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0]} 2020-07-16T13:38:03.848 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: cluster 2020-07-16T13:37:37.218663+0000 mon.a (mon.0) 5 : cluster [DBG] fsmap 2020-07-16T13:38:03.849 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: cluster 2020-07-16T13:37:37.218692+0000 mon.a (mon.0) 6 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2020-07-16T13:38:03.849 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: cluster 2020-07-16T13:37:37.219387+0000 mon.a (mon.0) 7 : cluster [DBG] mgrmap e20: x(active, since 36s), standbys: y 2020-07-16T13:38:03.849 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: audit 2020-07-16T13:37:37.221847+0000 mon.a (mon.0) 8 : audit [INF] from='mgr.34499 ' entity='' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632944\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632975\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633004\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633155\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633259\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633374\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633475\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633508\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:38:03.849 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: audit 2020-07-16T13:37:37.224012+0000 mon.b (mon.2) 109 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:38:03.850 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: cluster 2020-07-16T13:37:37.225743+0000 mon.a (mon.0) 9 : cluster [DBG] mgrmap e21: x(active, since 36s), standbys: y 2020-07-16T13:38:03.850 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: cluster 2020-07-16T13:37:37.225773+0000 mon.a (mon.0) 10 : cluster [INF] overall HEALTH_OK 2020-07-16T13:38:03.850 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.574+0000 7f457d369700 1 mon.a@-1(???).paxosservice(auth 1..18) refresh upgraded, format 0 -> 3 2020-07-16T13:38:03.850 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.576+0000 7f457d369700 20 expand_channel_meta expand map: {default=false} 2020-07-16T13:38:03.850 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.576+0000 7f457d369700 20 expand_channel_meta from 'false' to 'false' 2020-07-16T13:38:03.851 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.576+0000 7f457d369700 20 expand_channel_meta expanded map: {default=false} 2020-07-16T13:38:03.851 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.576+0000 7f457d369700 20 expand_channel_meta expand map: {default=info} 2020-07-16T13:38:03.851 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.576+0000 7f457d369700 20 expand_channel_meta from 'info' to 'info' 2020-07-16T13:38:03.851 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.576+0000 7f457d369700 20 expand_channel_meta expanded map: {default=info} 2020-07-16T13:38:03.851 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.576+0000 7f457d369700 20 expand_channel_meta expand map: {default=daemon} 2020-07-16T13:38:03.852 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.576+0000 7f457d369700 20 expand_channel_meta from 'daemon' to 'daemon' 2020-07-16T13:38:03.852 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.576+0000 7f457d369700 20 expand_channel_meta expanded map: {default=daemon} 2020-07-16T13:38:03.852 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.576+0000 7f457d369700 20 expand_channel_meta expand map: {default=debug} 2020-07-16T13:38:03.852 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.576+0000 7f457d369700 20 expand_channel_meta from 'debug' to 'debug' 2020-07-16T13:38:03.852 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.576+0000 7f457d369700 20 expand_channel_meta expanded map: {default=debug} 2020-07-16T13:38:04.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.0.0-3349-g7260671e53b/rpm/el8/BUILD/ceph-16.0.0-3349-g7260671e53b/src/mon/OSDMonitor.cc: In function 'virtual void OSDMonitor::encode_pending(MonitorDBStore::TransactionRef)' thread 7f45651b1700 time 2020-07-16T13:38:03.791638+0000 2020-07-16T13:38:04.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.0.0-3349-g7260671e53b/rpm/el8/BUILD/ceph-16.0.0-3349-g7260671e53b/src/mon/OSDMonitor.cc: 2023: FAILED ceph_assert((features & ~mon->get_quorum_con_features()) == 0) 2020-07-16T13:38:04.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev) 2020-07-16T13:38:04.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7f457451fb96] 2020-07-16T13:38:04.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 2: (()+0x275db0) [0x7f457451fdb0] 2020-07-16T13:38:04.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 3: (OSDMonitor::encode_pending(std::shared_ptr)+0x6738) [0x5573a1d9c6d8] 2020-07-16T13:38:04.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 4: (PaxosService::propose_pending()+0x21a) [0x5573a1d0c99a] 2020-07-16T13:38:04.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 5: (MgrMonitor::drop_active()+0x346) [0x5573a1e00ce6] 2020-07-16T13:38:04.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 6: (MgrMonitor::prepare_beacon(boost::intrusive_ptr)+0x1e27) [0x5573a1e02e97] 2020-07-16T13:38:04.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 7: (MgrMonitor::prepare_update(boost::intrusive_ptr)+0x5b) [0x5573a1e072db] 2020-07-16T13:38:04.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 8: (PaxosService::dispatch(boost::intrusive_ptr)+0xa6d) [0x5573a1d0d84d] 2020-07-16T13:38:04.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 9: (PaxosService::C_RetryMessage::_finish(int)+0x64) [0x5573a1c6a754] 2020-07-16T13:38:04.282 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 10: (C_MonOp::finish(int)+0x49) [0x5573a1c0a089] 2020-07-16T13:38:04.282 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 11: (Context::complete(int)+0xd) [0x5573a1c072ad] 2020-07-16T13:38:04.282 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 12: (void finish_contexts > >(ceph::common::CephContext*, std::__cxx11::list >&, int)+0xa5) [0x5573a1c30ae5] 2020-07-16T13:38:04.282 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 13: (Paxos::finish_round()+0x27b) [0x5573a1d041ab] 2020-07-16T13:38:04.282 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 14: (Paxos::commit_finish()+0x91c) [0x5573a1d06c1c] 2020-07-16T13:38:04.283 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 15: (C_Committed::finish(int)+0x45) [0x5573a1d0b055] 2020-07-16T13:38:04.283 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 16: (Context::complete(int)+0xd) [0x5573a1c072ad] 2020-07-16T13:38:04.283 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 17: (MonitorDBStore::C_DoTransaction::finish(int)+0x98) [0x5573a1d0ad78] 2020-07-16T13:38:04.283 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 18: (Context::complete(int)+0xd) [0x5573a1c072ad] 2020-07-16T13:38:04.283 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 19: (Finisher::finisher_thread_entry()+0x1a5) [0x7f45745bc2c5] 2020-07-16T13:38:04.284 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 20: (()+0x82de) [0x7f457201a2de] 2020-07-16T13:38:04.284 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 21: (clone()+0x43) [0x7f4570d51e83] 2020-07-16T13:38:04.284 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.792+0000 7f45651b1700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.0.0-3349-g7260671e53b/rpm/el8/BUILD/ceph-16.0.0-3349-g7260671e53b/src/mon/OSDMonitor.cc: In function 'virtual void OSDMonitor::encode_pending(MonitorDBStore::TransactionRef)' thread 7f45651b1700 time 2020-07-16T13:38:03.791638+0000 2020-07-16T13:38:04.284 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.0.0-3349-g7260671e53b/rpm/el8/BUILD/ceph-16.0.0-3349-g7260671e53b/src/mon/OSDMonitor.cc: 2023: FAILED ceph_assert((features & ~mon->get_quorum_con_features()) == 0) 2020-07-16T13:38:04.284 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev) 2020-07-16T13:38:04.284 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7f457451fb96] 2020-07-16T13:38:04.285 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 2: (()+0x275db0) [0x7f457451fdb0] 2020-07-16T13:38:04.285 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 3: (OSDMonitor::encode_pending(std::shared_ptr)+0x6738) [0x5573a1d9c6d8] 2020-07-16T13:38:04.285 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 4: (PaxosService::propose_pending()+0x21a) [0x5573a1d0c99a] 2020-07-16T13:38:04.285 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 5: (MgrMonitor::drop_active()+0x346) [0x5573a1e00ce6] 2020-07-16T13:38:04.285 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 6: (MgrMonitor::prepare_beacon(boost::intrusive_ptr)+0x1e27) [0x5573a1e02e97] 2020-07-16T13:38:04.286 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 7: (MgrMonitor::prepare_update(boost::intrusive_ptr)+0x5b) [0x5573a1e072db] 2020-07-16T13:38:04.286 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 8: (PaxosService::dispatch(boost::intrusive_ptr)+0xa6d) [0x5573a1d0d84d] 2020-07-16T13:38:04.286 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 9: (PaxosService::C_RetryMessage::_finish(int)+0x64) [0x5573a1c6a754] 2020-07-16T13:38:04.287 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 10: (C_MonOp::finish(int)+0x49) [0x5573a1c0a089] 2020-07-16T13:38:04.287 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 11: (Context::complete(int)+0xd) [0x5573a1c072ad] 2020-07-16T13:38:04.287 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 12: (void finish_contexts > >(ceph::common::CephContext*, std::__cxx11::list >&, int)+0xa5) [0x5573a1c30ae5] 2020-07-16T13:38:04.287 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 13: (Paxos::finish_round()+0x27b) [0x5573a1d041ab] 2020-07-16T13:38:04.287 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 14: (Paxos::commit_finish()+0x91c) [0x5573a1d06c1c] 2020-07-16T13:38:04.288 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 15: (C_Committed::finish(int)+0x45) [0x5573a1d0b055] 2020-07-16T13:38:04.288 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 16: (Context::complete(int)+0xd) [0x5573a1c072ad] 2020-07-16T13:38:04.288 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 17: (MonitorDBStore::C_DoTransaction::finish(int)+0x98) [0x5573a1d0ad78] 2020-07-16T13:38:04.288 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 18: (Context::complete(int)+0xd) [0x5573a1c072ad] 2020-07-16T13:38:04.288 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 19: (Finisher::finisher_thread_entry()+0x1a5) [0x7f45745bc2c5] 2020-07-16T13:38:04.288 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 20: (()+0x82de) [0x7f457201a2de] 2020-07-16T13:38:04.289 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 21: (clone()+0x43) [0x7f4570d51e83] 2020-07-16T13:38:04.289 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: *** Caught signal (Aborted) ** 2020-07-16T13:38:04.289 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: in thread 7f45651b1700 thread_name:fn_monstore 2020-07-16T13:38:04.289 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev) 2020-07-16T13:38:04.289 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 1: (()+0x12dd0) [0x7f4572024dd0] 2020-07-16T13:38:04.290 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 2: (gsignal()+0x10f) [0x7f4570c8d70f] 2020-07-16T13:38:04.291 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 3: (abort()+0x127) [0x7f4570c77b25] 2020-07-16T13:38:04.291 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a9) [0x7f457451fbe7] 2020-07-16T13:38:04.291 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 5: (()+0x275db0) [0x7f457451fdb0] 2020-07-16T13:38:04.291 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 6: (OSDMonitor::encode_pending(std::shared_ptr)+0x6738) [0x5573a1d9c6d8] 2020-07-16T13:38:04.291 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 7: (PaxosService::propose_pending()+0x21a) [0x5573a1d0c99a] 2020-07-16T13:38:04.292 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 8: (MgrMonitor::drop_active()+0x346) [0x5573a1e00ce6] 2020-07-16T13:38:04.292 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 9: (MgrMonitor::prepare_beacon(boost::intrusive_ptr)+0x1e27) [0x5573a1e02e97] 2020-07-16T13:38:04.292 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 10: (MgrMonitor::prepare_update(boost::intrusive_ptr)+0x5b) [0x5573a1e072db] 2020-07-16T13:38:04.292 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 11: (PaxosService::dispatch(boost::intrusive_ptr)+0xa6d) [0x5573a1d0d84d] 2020-07-16T13:38:04.292 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 12: (PaxosService::C_RetryMessage::_finish(int)+0x64) [0x5573a1c6a754] 2020-07-16T13:38:04.293 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 13: (C_MonOp::finish(int)+0x49) [0x5573a1c0a089] 2020-07-16T13:38:04.293 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 14: (Context::complete(int)+0xd) [0x5573a1c072ad] 2020-07-16T13:38:04.293 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 15: (void finish_contexts > >(ceph::common::CephContext*, std::__cxx11::list >&, int)+0xa5) [0x5573a1c30ae5] 2020-07-16T13:38:04.293 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 16: (Paxos::finish_round()+0x27b) [0x5573a1d041ab] 2020-07-16T13:38:04.293 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 17: (Paxos::commit_finish()+0x91c) [0x5573a1d06c1c] 2020-07-16T13:38:04.294 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 18: (C_Committed::finish(int)+0x45) [0x5573a1d0b055] 2020-07-16T13:38:04.294 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 19: (Context::complete(int)+0xd) [0x5573a1c072ad] 2020-07-16T13:38:04.294 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 20: (MonitorDBStore::C_DoTransaction::finish(int)+0x98) [0x5573a1d0ad78] 2020-07-16T13:38:04.295 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 21: (Context::complete(int)+0xd) [0x5573a1c072ad] 2020-07-16T13:38:04.295 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 22: (Finisher::finisher_thread_entry()+0x1a5) [0x7f45745bc2c5] 2020-07-16T13:38:04.295 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 23: (()+0x82de) [0x7f457201a2de] 2020-07-16T13:38:04.295 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 24: (clone()+0x43) [0x7f4570d51e83] 2020-07-16T13:38:04.295 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 2020-07-16T13:38:03.795+0000 7f45651b1700 -1 *** Caught signal (Aborted) ** 2020-07-16T13:38:04.296 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: in thread 7f45651b1700 thread_name:fn_monstore 2020-07-16T13:38:04.296 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev) 2020-07-16T13:38:04.296 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 1: (()+0x12dd0) [0x7f4572024dd0] 2020-07-16T13:38:04.296 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 2: (gsignal()+0x10f) [0x7f4570c8d70f] 2020-07-16T13:38:04.297 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 3: (abort()+0x127) [0x7f4570c77b25] 2020-07-16T13:38:04.297 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a9) [0x7f457451fbe7] 2020-07-16T13:38:04.297 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 5: (()+0x275db0) [0x7f457451fdb0] 2020-07-16T13:38:04.297 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 6: (OSDMonitor::encode_pending(std::shared_ptr)+0x6738) [0x5573a1d9c6d8] 2020-07-16T13:38:04.297 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 7: (PaxosService::propose_pending()+0x21a) [0x5573a1d0c99a] 2020-07-16T13:38:04.298 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 8: (MgrMonitor::drop_active()+0x346) [0x5573a1e00ce6] 2020-07-16T13:38:04.298 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 9: (MgrMonitor::prepare_beacon(boost::intrusive_ptr)+0x1e27) [0x5573a1e02e97] 2020-07-16T13:38:04.298 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 10: (MgrMonitor::prepare_update(boost::intrusive_ptr)+0x5b) [0x5573a1e072db] 2020-07-16T13:38:04.298 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 11: (PaxosService::dispatch(boost::intrusive_ptr)+0xa6d) [0x5573a1d0d84d] 2020-07-16T13:38:04.298 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 12: (PaxosService::C_RetryMessage::_finish(int)+0x64) [0x5573a1c6a754] 2020-07-16T13:38:04.299 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 13: (C_MonOp::finish(int)+0x49) [0x5573a1c0a089] 2020-07-16T13:38:04.299 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 14: (Context::complete(int)+0xd) [0x5573a1c072ad] 2020-07-16T13:38:04.299 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 15: (void finish_contexts > >(ceph::common::CephContext*, std::__cxx11::list >&, int)+0xa5) [0x5573a1c30ae5] 2020-07-16T13:38:04.299 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 16: (Paxos::finish_round()+0x27b) [0x5573a1d041ab] 2020-07-16T13:38:04.299 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 17: (Paxos::commit_finish()+0x91c) [0x5573a1d06c1c] 2020-07-16T13:38:04.299 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 18: (C_Committed::finish(int)+0x45) [0x5573a1d0b055] 2020-07-16T13:38:04.300 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 19: (Context::complete(int)+0xd) [0x5573a1c072ad] 2020-07-16T13:38:04.300 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 20: (MonitorDBStore::C_DoTransaction::finish(int)+0x98) [0x5573a1d0ad78] 2020-07-16T13:38:04.300 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 21: (Context::complete(int)+0xd) [0x5573a1c072ad] 2020-07-16T13:38:04.300 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 22: (Finisher::finisher_thread_entry()+0x1a5) [0x7f45745bc2c5] 2020-07-16T13:38:04.300 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 23: (()+0x82de) [0x7f457201a2de] 2020-07-16T13:38:04.301 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 24: (clone()+0x43) [0x7f4570d51e83] 2020-07-16T13:38:04.301 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-07-16T13:38:04.301 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug -1> 2020-07-16T13:38:03.792+0000 7f45651b1700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.0.0-3349-g7260671e53b/rpm/el8/BUILD/ceph-16.0.0-3349-g7260671e53b/src/mon/OSDMonitor.cc: In function 'virtual void OSDMonitor::encode_pending(MonitorDBStore::TransactionRef)' thread 7f45651b1700 time 2020-07-16T13:38:03.791638+0000 2020-07-16T13:38:04.301 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.0.0-3349-g7260671e53b/rpm/el8/BUILD/ceph-16.0.0-3349-g7260671e53b/src/mon/OSDMonitor.cc: 2023: FAILED ceph_assert((features & ~mon->get_quorum_con_features()) == 0) 2020-07-16T13:38:04.301 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev) 2020-07-16T13:38:04.302 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7f457451fb96] 2020-07-16T13:38:04.302 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 2: (()+0x275db0) [0x7f457451fdb0] 2020-07-16T13:38:04.302 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 3: (OSDMonitor::encode_pending(std::shared_ptr)+0x6738) [0x5573a1d9c6d8] 2020-07-16T13:38:04.302 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 4: (PaxosService::propose_pending()+0x21a) [0x5573a1d0c99a] 2020-07-16T13:38:04.302 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 5: (MgrMonitor::drop_active()+0x346) [0x5573a1e00ce6] 2020-07-16T13:38:04.302 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 6: (MgrMonitor::prepare_beacon(boost::intrusive_ptr)+0x1e27) [0x5573a1e02e97] 2020-07-16T13:38:04.303 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 7: (MgrMonitor::prepare_update(boost::intrusive_ptr)+0x5b) [0x5573a1e072db] 2020-07-16T13:38:04.303 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 8: (PaxosService::dispatch(boost::intrusive_ptr)+0xa6d) [0x5573a1d0d84d] 2020-07-16T13:38:04.303 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 9: (PaxosService::C_RetryMessage::_finish(int)+0x64) [0x5573a1c6a754] 2020-07-16T13:38:04.303 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 10: (C_MonOp::finish(int)+0x49) [0x5573a1c0a089] 2020-07-16T13:38:04.303 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 11: (Context::complete(int)+0xd) [0x5573a1c072ad] 2020-07-16T13:38:04.304 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 12: (void finish_contexts > >(ceph::common::CephContext*, std::__cxx11::list >&, int)+0xa5) [0x5573a1c30ae5] 2020-07-16T13:38:04.304 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 13: (Paxos::finish_round()+0x27b) [0x5573a1d041ab] 2020-07-16T13:38:04.304 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 14: (Paxos::commit_finish()+0x91c) [0x5573a1d06c1c] 2020-07-16T13:38:04.304 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 15: (C_Committed::finish(int)+0x45) [0x5573a1d0b055] 2020-07-16T13:38:04.304 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 16: (Context::complete(int)+0xd) [0x5573a1c072ad] 2020-07-16T13:38:04.304 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 17: (MonitorDBStore::C_DoTransaction::finish(int)+0x98) [0x5573a1d0ad78] 2020-07-16T13:38:04.305 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 18: (Context::complete(int)+0xd) [0x5573a1c072ad] 2020-07-16T13:38:04.305 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 19: (Finisher::finisher_thread_entry()+0x1a5) [0x7f45745bc2c5] 2020-07-16T13:38:04.305 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 20: (()+0x82de) [0x7f457201a2de] 2020-07-16T13:38:04.305 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 21: (clone()+0x43) [0x7f4570d51e83] 2020-07-16T13:38:04.305 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 0> 2020-07-16T13:38:03.795+0000 7f45651b1700 -1 *** Caught signal (Aborted) ** 2020-07-16T13:38:04.306 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: in thread 7f45651b1700 thread_name:fn_monstore 2020-07-16T13:38:04.306 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev) 2020-07-16T13:38:04.306 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 1: (()+0x12dd0) [0x7f4572024dd0] 2020-07-16T13:38:04.306 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 2: (gsignal()+0x10f) [0x7f4570c8d70f] 2020-07-16T13:38:04.307 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 3: (abort()+0x127) [0x7f4570c77b25] 2020-07-16T13:38:04.307 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a9) [0x7f457451fbe7] 2020-07-16T13:38:04.307 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 5: (()+0x275db0) [0x7f457451fdb0] 2020-07-16T13:38:04.308 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 6: (OSDMonitor::encode_pending(std::shared_ptr)+0x6738) [0x5573a1d9c6d8] 2020-07-16T13:38:04.308 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 7: (PaxosService::propose_pending()+0x21a) [0x5573a1d0c99a] 2020-07-16T13:38:04.308 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 8: (MgrMonitor::drop_active()+0x346) [0x5573a1e00ce6] 2020-07-16T13:38:04.309 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 9: (MgrMonitor::prepare_beacon(boost::intrusive_ptr)+0x1e27) [0x5573a1e02e97] 2020-07-16T13:38:04.309 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 10: (MgrMonitor::prepare_update(boost::intrusive_ptr)+0x5b) [0x5573a1e072db] 2020-07-16T13:38:04.309 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 11: (PaxosService::dispatch(boost::intrusive_ptr)+0xa6d) [0x5573a1d0d84d] 2020-07-16T13:38:04.309 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 12: (PaxosService::C_RetryMessage::_finish(int)+0x64) [0x5573a1c6a754] 2020-07-16T13:38:04.309 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 13: (C_MonOp::finish(int)+0x49) [0x5573a1c0a089] 2020-07-16T13:38:04.309 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 14: (Context::complete(int)+0xd) [0x5573a1c072ad] 2020-07-16T13:38:04.310 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 15: (void finish_contexts > >(ceph::common::CephContext*, std::__cxx11::list >&, int)+0xa5) [0x5573a1c30ae5] 2020-07-16T13:38:04.310 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 16: (Paxos::finish_round()+0x27b) [0x5573a1d041ab] 2020-07-16T13:38:04.310 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 17: (Paxos::commit_finish()+0x91c) [0x5573a1d06c1c] 2020-07-16T13:38:04.310 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 18: (C_Committed::finish(int)+0x45) [0x5573a1d0b055] 2020-07-16T13:38:04.310 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 19: (Context::complete(int)+0xd) [0x5573a1c072ad] 2020-07-16T13:38:04.311 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 20: (MonitorDBStore::C_DoTransaction::finish(int)+0x98) [0x5573a1d0ad78] 2020-07-16T13:38:04.311 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 21: (Context::complete(int)+0xd) [0x5573a1c072ad] 2020-07-16T13:38:04.311 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 22: (Finisher::finisher_thread_entry()+0x1a5) [0x7f45745bc2c5] 2020-07-16T13:38:04.311 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 23: (()+0x82de) [0x7f457201a2de] 2020-07-16T13:38:04.311 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 24: (clone()+0x43) [0x7f4570d51e83] 2020-07-16T13:38:04.312 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-07-16T13:38:04.312 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug -1> 2020-07-16T13:38:03.792+0000 7f45651b1700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.0.0-3349-g7260671e53b/rpm/el8/BUILD/ceph-16.0.0-3349-g7260671e53b/src/mon/OSDMonitor.cc: In function 'virtual void OSDMonitor::encode_pending(MonitorDBStore::TransactionRef)' thread 7f45651b1700 time 2020-07-16T13:38:03.791638+0000 2020-07-16T13:38:04.312 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.0.0-3349-g7260671e53b/rpm/el8/BUILD/ceph-16.0.0-3349-g7260671e53b/src/mon/OSDMonitor.cc: 2023: FAILED ceph_assert((features & ~mon->get_quorum_con_features()) == 0) 2020-07-16T13:38:04.312 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev) 2020-07-16T13:38:04.312 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7f457451fb96] 2020-07-16T13:38:04.312 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 2: (()+0x275db0) [0x7f457451fdb0] 2020-07-16T13:38:04.313 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 3: (OSDMonitor::encode_pending(std::shared_ptr)+0x6738) [0x5573a1d9c6d8] 2020-07-16T13:38:04.313 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 4: (PaxosService::propose_pending()+0x21a) [0x5573a1d0c99a] 2020-07-16T13:38:04.313 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 5: (MgrMonitor::drop_active()+0x346) [0x5573a1e00ce6] 2020-07-16T13:38:04.313 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 6: (MgrMonitor::prepare_beacon(boost::intrusive_ptr)+0x1e27) [0x5573a1e02e97] 2020-07-16T13:38:04.313 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 7: (MgrMonitor::prepare_update(boost::intrusive_ptr)+0x5b) [0x5573a1e072db] 2020-07-16T13:38:04.314 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 8: (PaxosService::dispatch(boost::intrusive_ptr)+0xa6d) [0x5573a1d0d84d] 2020-07-16T13:38:04.314 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 9: (PaxosService::C_RetryMessage::_finish(int)+0x64) [0x5573a1c6a754] 2020-07-16T13:38:04.314 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 10: (C_MonOp::finish(int)+0x49) [0x5573a1c0a089] 2020-07-16T13:38:04.314 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 11: (Context::complete(int)+0xd) [0x5573a1c072ad] 2020-07-16T13:38:04.314 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 12: (void finish_contexts > >(ceph::common::CephContext*, std::__cxx11::list >&, int)+0xa5) [0x5573a1c30ae5] 2020-07-16T13:38:04.315 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 13: (Paxos::finish_round()+0x27b) [0x5573a1d041ab] 2020-07-16T13:38:04.315 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 14: (Paxos::commit_finish()+0x91c) [0x5573a1d06c1c] 2020-07-16T13:38:04.315 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 15: (C_Committed::finish(int)+0x45) [0x5573a1d0b055] 2020-07-16T13:38:04.315 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 16: (Context::complete(int)+0xd) [0x5573a1c072ad] 2020-07-16T13:38:04.315 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 17: (MonitorDBStore::C_DoTransaction::finish(int)+0x98) [0x5573a1d0ad78] 2020-07-16T13:38:04.315 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 18: (Context::complete(int)+0xd) [0x5573a1c072ad] 2020-07-16T13:38:04.316 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 19: (Finisher::finisher_thread_entry()+0x1a5) [0x7f45745bc2c5] 2020-07-16T13:38:04.316 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 20: (()+0x82de) [0x7f457201a2de] 2020-07-16T13:38:04.316 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 21: (clone()+0x43) [0x7f4570d51e83] 2020-07-16T13:38:04.316 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: debug 0> 2020-07-16T13:38:03.795+0000 7f45651b1700 -1 *** Caught signal (Aborted) ** 2020-07-16T13:38:04.316 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: in thread 7f45651b1700 thread_name:fn_monstore 2020-07-16T13:38:04.317 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev) 2020-07-16T13:38:04.317 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 1: (()+0x12dd0) [0x7f4572024dd0] 2020-07-16T13:38:04.317 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 2: (gsignal()+0x10f) [0x7f4570c8d70f] 2020-07-16T13:38:04.317 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 3: (abort()+0x127) [0x7f4570c77b25] 2020-07-16T13:38:04.318 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a9) [0x7f457451fbe7] 2020-07-16T13:38:04.318 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 5: (()+0x275db0) [0x7f457451fdb0] 2020-07-16T13:38:04.318 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 6: (OSDMonitor::encode_pending(std::shared_ptr)+0x6738) [0x5573a1d9c6d8] 2020-07-16T13:38:04.318 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 7: (PaxosService::propose_pending()+0x21a) [0x5573a1d0c99a] 2020-07-16T13:38:04.318 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 8: (MgrMonitor::drop_active()+0x346) [0x5573a1e00ce6] 2020-07-16T13:38:04.319 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 9: (MgrMonitor::prepare_beacon(boost::intrusive_ptr)+0x1e27) [0x5573a1e02e97] 2020-07-16T13:38:04.319 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 10: (MgrMonitor::prepare_update(boost::intrusive_ptr)+0x5b) [0x5573a1e072db] 2020-07-16T13:38:04.319 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 11: (PaxosService::dispatch(boost::intrusive_ptr)+0xa6d) [0x5573a1d0d84d] 2020-07-16T13:38:04.319 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 12: (PaxosService::C_RetryMessage::_finish(int)+0x64) [0x5573a1c6a754] 2020-07-16T13:38:04.319 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 13: (C_MonOp::finish(int)+0x49) [0x5573a1c0a089] 2020-07-16T13:38:04.319 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 14: (Context::complete(int)+0xd) [0x5573a1c072ad] 2020-07-16T13:38:04.320 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 15: (void finish_contexts > >(ceph::common::CephContext*, std::__cxx11::list >&, int)+0xa5) [0x5573a1c30ae5] 2020-07-16T13:38:04.320 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 16: (Paxos::finish_round()+0x27b) [0x5573a1d041ab] 2020-07-16T13:38:04.320 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 17: (Paxos::commit_finish()+0x91c) [0x5573a1d06c1c] 2020-07-16T13:38:04.320 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 18: (C_Committed::finish(int)+0x45) [0x5573a1d0b055] 2020-07-16T13:38:04.320 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 19: (Context::complete(int)+0xd) [0x5573a1c072ad] 2020-07-16T13:38:04.321 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 20: (MonitorDBStore::C_DoTransaction::finish(int)+0x98) [0x5573a1d0ad78] 2020-07-16T13:38:04.321 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 21: (Context::complete(int)+0xd) [0x5573a1c072ad] 2020-07-16T13:38:04.321 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 22: (Finisher::finisher_thread_entry()+0x1a5) [0x7f45745bc2c5] 2020-07-16T13:38:04.321 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 23: (()+0x82de) [0x7f457201a2de] 2020-07-16T13:38:04.321 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: 24: (clone()+0x43) [0x7f4570d51e83] 2020-07-16T13:38:04.322 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-07-16T13:38:04.322 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 bash[11726]: reraise_fatal: default handler for signal 6 didn't terminate the process? 2020-07-16T13:38:04.322 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:03 smithi132 podman[11756]: 2020-07-16 13:38:03.850301469 +0000 UTC m=+0.682237411 container died b50c9a5eeb10bfa010c978500ef40e2bb97aa7d003b9b884f26801719daf9c07 (image=quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a) 2020-07-16T13:38:04.779 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:04 smithi132 podman[11756]: 2020-07-16 13:38:04.400217147 +0000 UTC m=+1.232153111 container remove b50c9a5eeb10bfa010c978500ef40e2bb97aa7d003b9b884f26801719daf9c07 (image=quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a) 2020-07-16T13:38:04.779 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:04 smithi132 systemd[1]: ceph-4c8ed362-c768-11ea-a06f-001a4aab830c@mon.a.service: Main process exited, code=exited, status=1/FAILURE 2020-07-16T13:38:04.779 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:04 smithi132 systemd[1]: ceph-4c8ed362-c768-11ea-a06f-001a4aab830c@mon.a.service: Failed with result 'exit-code'. 2020-07-16T13:38:11.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:10 smithi188 bash[23329]: debug 2020-07-16T13:38:10.922+0000 7fe90d4b2700 -1 mon.b@2(peon) e3 get_health_metrics reporting 2 slow ops, oldest is log(1 entries from seq 110 at 2020-07-16T13:37:40.877704+0000) 2020-07-16T13:38:14.892 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:14 smithi132 systemd[1]: ceph-4c8ed362-c768-11ea-a06f-001a4aab830c@mon.a.service: Service RestartSec=10s expired, scheduling restart. 2020-07-16T13:38:14.892 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:14 smithi132 systemd[1]: ceph-4c8ed362-c768-11ea-a06f-001a4aab830c@mon.a.service: Scheduled restart job, restart counter is at 3. 2020-07-16T13:38:14.893 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:14 smithi132 systemd[1]: Stopped Ceph mon.a for 4c8ed362-c768-11ea-a06f-001a4aab830c. 2020-07-16T13:38:14.893 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:14 smithi132 systemd[1]: Starting Ceph mon.a for 4c8ed362-c768-11ea-a06f-001a4aab830c... 2020-07-16T13:38:14.893 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:14 smithi132 podman[11876]: Error: no container with name or ID ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a found: no such container 2020-07-16T13:38:14.894 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:14 smithi132 systemd[1]: Started Ceph mon.a for 4c8ed362-c768-11ea-a06f-001a4aab830c. 2020-07-16T13:38:14.894 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:14 smithi132 bash[11890]: Error: Failed to evict container: "": Failed to find container "ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a" in state: no container with name or ID ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a found: no such container 2020-07-16T13:38:14.894 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:14 smithi132 bash[11890]: ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a 2020-07-16T13:38:14.895 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:14 smithi132 bash[11890]: Error: no container with ID or name "ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a" found: no such container 2020-07-16T13:38:15.255 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:14 smithi132 podman[11919]: 2020-07-16 13:38:14.890567453 +0000 UTC m=+0.225306792 container create 4c690a4bc95a0882c9c38fc95b363c883cdf980d11b5df7db81af4f1243de645 (image=quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a) 2020-07-16T13:38:15.255 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:14 smithi132 podman[11919]: 2020-07-16 13:38:14.998900502 +0000 UTC m=+0.333639929 container init 4c690a4bc95a0882c9c38fc95b363c883cdf980d11b5df7db81af4f1243de645 (image=quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a) 2020-07-16T13:38:15.256 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 podman[11919]: 2020-07-16 13:38:15.057223661 +0000 UTC m=+0.391962998 container start 4c690a4bc95a0882c9c38fc95b363c883cdf980d11b5df7db81af4f1243de645 (image=quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a) 2020-07-16T13:38:15.256 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 podman[11919]: 2020-07-16 13:38:15.057325962 +0000 UTC m=+0.392065314 container attach 4c690a4bc95a0882c9c38fc95b363c883cdf980d11b5df7db81af4f1243de645 (image=quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a) 2020-07-16T13:38:15.256 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.021+0000 7fe3082ef700 0 set uid:gid to 167:167 (ceph:ceph) 2020-07-16T13:38:15.256 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.021+0000 7fe3082ef700 0 ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev), process ceph-mon, pid 1 2020-07-16T13:38:15.257 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.021+0000 7fe3082ef700 0 pidfile_write: ignore empty --pid-file 2020-07-16T13:38:15.257 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.025+0000 7fe3082ef700 0 load: jerasure load: lrc load: isa 2020-07-16T13:38:15.257 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: RocksDB version: 6.8.1 2020-07-16T13:38:15.257 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2020-07-16T13:38:15.257 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Compile date Jul 16 2020 2020-07-16T13:38:15.258 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: DB SUMMARY 2020-07-16T13:38:15.258 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: CURRENT file: CURRENT 2020-07-16T13:38:15.258 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: IDENTITY file: IDENTITY 2020-07-16T13:38:15.258 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: MANIFEST file: MANIFEST-000025 size: 376 Bytes 2020-07-16T13:38:15.258 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 4, files: 000016.sst 000018.sst 000021.sst 000024.sst 2020-07-16T13:38:15.259 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000026.log size: 9381 ; 2020-07-16T13:38:15.259 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.error_if_exists: 0 2020-07-16T13:38:15.259 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.create_if_missing: 0 2020-07-16T13:38:15.260 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.paranoid_checks: 1 2020-07-16T13:38:15.260 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.env: 0x5566b00e9c00 2020-07-16T13:38:15.260 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.fs: Posix File System 2020-07-16T13:38:15.260 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.info_log: 0x5566b232a6c0 2020-07-16T13:38:15.260 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.max_file_opening_threads: 16 2020-07-16T13:38:15.261 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.statistics: (nil) 2020-07-16T13:38:15.261 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.use_fsync: 0 2020-07-16T13:38:15.261 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.max_log_file_size: 0 2020-07-16T13:38:15.261 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2020-07-16T13:38:15.261 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.log_file_time_to_roll: 0 2020-07-16T13:38:15.262 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.keep_log_file_num: 1000 2020-07-16T13:38:15.262 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.recycle_log_file_num: 0 2020-07-16T13:38:15.262 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.allow_fallocate: 1 2020-07-16T13:38:15.262 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.allow_mmap_reads: 0 2020-07-16T13:38:15.262 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.allow_mmap_writes: 0 2020-07-16T13:38:15.263 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.use_direct_reads: 0 2020-07-16T13:38:15.263 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2020-07-16T13:38:15.264 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.create_missing_column_families: 0 2020-07-16T13:38:15.264 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.db_log_dir: 2020-07-16T13:38:15.264 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2020-07-16T13:38:15.264 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.table_cache_numshardbits: 6 2020-07-16T13:38:15.265 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.max_subcompactions: 1 2020-07-16T13:38:15.265 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.max_background_flushes: -1 2020-07-16T13:38:15.265 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.WAL_ttl_seconds: 0 2020-07-16T13:38:15.266 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.WAL_size_limit_MB: 0 2020-07-16T13:38:15.267 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2020-07-16T13:38:15.267 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2020-07-16T13:38:15.267 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.is_fd_close_on_exec: 1 2020-07-16T13:38:15.267 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.advise_random_on_open: 1 2020-07-16T13:38:15.268 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.db_write_buffer_size: 0 2020-07-16T13:38:15.268 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.write_buffer_manager: 0x5566b23793b0 2020-07-16T13:38:15.268 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2020-07-16T13:38:15.268 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2020-07-16T13:38:15.269 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2020-07-16T13:38:15.269 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.use_adaptive_mutex: 0 2020-07-16T13:38:15.269 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.rate_limiter: (nil) 2020-07-16T13:38:15.269 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2020-07-16T13:38:15.269 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.wal_recovery_mode: 2 2020-07-16T13:38:15.270 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.enable_thread_tracking: 0 2020-07-16T13:38:15.270 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.enable_pipelined_write: 0 2020-07-16T13:38:15.270 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.unordered_write: 0 2020-07-16T13:38:15.270 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2020-07-16T13:38:15.270 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2020-07-16T13:38:15.270 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2020-07-16T13:38:15.271 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2020-07-16T13:38:15.271 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.row_cache: None 2020-07-16T13:38:15.271 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.wal_filter: None 2020-07-16T13:38:15.271 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2020-07-16T13:38:15.271 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.allow_ingest_behind: 0 2020-07-16T13:38:15.272 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.preserve_deletes: 0 2020-07-16T13:38:15.272 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.two_write_queues: 0 2020-07-16T13:38:15.272 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.manual_wal_flush: 0 2020-07-16T13:38:15.272 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.atomic_flush: 0 2020-07-16T13:38:15.272 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2020-07-16T13:38:15.273 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.persist_stats_to_disk: 0 2020-07-16T13:38:15.273 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.write_dbid_to_manifest: 0 2020-07-16T13:38:15.273 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.log_readahead_size: 0 2020-07-16T13:38:15.273 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2020-07-16T13:38:15.273 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.max_background_jobs: 2 2020-07-16T13:38:15.274 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.max_background_compactions: -1 2020-07-16T13:38:15.274 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2020-07-16T13:38:15.274 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2020-07-16T13:38:15.274 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.delayed_write_rate : 16777216 2020-07-16T13:38:15.274 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.max_total_wal_size: 0 2020-07-16T13:38:15.275 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2020-07-16T13:38:15.275 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.stats_dump_period_sec: 600 2020-07-16T13:38:15.275 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.stats_persist_period_sec: 600 2020-07-16T13:38:15.275 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2020-07-16T13:38:15.275 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.max_open_files: -1 2020-07-16T13:38:15.275 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.bytes_per_sync: 0 2020-07-16T13:38:15.276 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.wal_bytes_per_sync: 0 2020-07-16T13:38:15.276 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.strict_bytes_per_sync: 0 2020-07-16T13:38:15.276 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.compaction_readahead_size: 0 2020-07-16T13:38:15.276 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Compression algorithms supported: 2020-07-16T13:38:15.277 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2020-07-16T13:38:15.277 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: kZSTD supported: 0 2020-07-16T13:38:15.277 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: kXpressCompression supported: 0 2020-07-16T13:38:15.278 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: kLZ4HCCompression supported: 1 2020-07-16T13:38:15.278 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: kLZ4Compression supported: 1 2020-07-16T13:38:15.278 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: kBZip2Compression supported: 0 2020-07-16T13:38:15.278 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: kZlibCompression supported: 1 2020-07-16T13:38:15.278 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: kSnappyCompression supported: 1 2020-07-16T13:38:15.278 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Fast CRC32 supported: Supported on x86 2020-07-16T13:38:15.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000025 2020-07-16T13:38:15.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2020-07-16T13:38:15.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2020-07-16T13:38:15.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.merge_operator: 2020-07-16T13:38:15.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.compaction_filter: None 2020-07-16T13:38:15.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.compaction_filter_factory: None 2020-07-16T13:38:15.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.memtable_factory: SkipListFactory 2020-07-16T13:38:15.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.table_factory: BlockBasedTable 2020-07-16T13:38:15.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5566b22cdbd8) 2020-07-16T13:38:15.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: cache_index_and_filter_blocks: 1 2020-07-16T13:38:15.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: cache_index_and_filter_blocks_with_high_priority: 1 2020-07-16T13:38:15.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: pin_l0_filter_and_index_blocks_in_cache: 0 2020-07-16T13:38:15.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: pin_top_level_index_and_filter: 1 2020-07-16T13:38:15.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: index_type: 0 2020-07-16T13:38:15.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: data_block_index_type: 0 2020-07-16T13:38:15.282 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: index_shortening: 1 2020-07-16T13:38:15.282 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: data_block_hash_table_util_ratio: 0.750000 2020-07-16T13:38:15.282 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: hash_index_allow_collision: 1 2020-07-16T13:38:15.282 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: checksum: 1 2020-07-16T13:38:15.284 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: no_block_cache: 0 2020-07-16T13:38:15.284 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: block_cache: 0x5566b2306610 2020-07-16T13:38:15.284 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: block_cache_name: BinnedLRUCache 2020-07-16T13:38:15.284 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: block_cache_options: 2020-07-16T13:38:15.284 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: capacity : 536870912 2020-07-16T13:38:15.285 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: num_shard_bits : 4 2020-07-16T13:38:15.285 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: strict_capacity_limit : 0 2020-07-16T13:38:15.285 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: high_pri_pool_ratio: 0.000 2020-07-16T13:38:15.285 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: block_cache_compressed: (nil) 2020-07-16T13:38:15.285 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: persistent_cache: (nil) 2020-07-16T13:38:15.286 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: block_size: 4096 2020-07-16T13:38:15.286 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: block_size_deviation: 10 2020-07-16T13:38:15.286 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: block_restart_interval: 16 2020-07-16T13:38:15.286 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: index_block_restart_interval: 1 2020-07-16T13:38:15.286 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: metadata_block_size: 4096 2020-07-16T13:38:15.287 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: partition_filters: 0 2020-07-16T13:38:15.287 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: use_delta_encoding: 1 2020-07-16T13:38:15.287 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: filter_policy: rocksdb.BuiltinBloomFilter 2020-07-16T13:38:15.287 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: whole_key_filtering: 1 2020-07-16T13:38:15.287 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: verify_compression: 0 2020-07-16T13:38:15.288 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: read_amp_bytes_per_bit: 0 2020-07-16T13:38:15.288 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: format_version: 2 2020-07-16T13:38:15.288 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: enable_index_compression: 1 2020-07-16T13:38:15.288 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: block_align: 0 2020-07-16T13:38:15.289 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.write_buffer_size: 33554432 2020-07-16T13:38:15.289 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.max_write_buffer_number: 2 2020-07-16T13:38:15.289 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.compression: NoCompression 2020-07-16T13:38:15.289 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.bottommost_compression: Disabled 2020-07-16T13:38:15.289 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.prefix_extractor: nullptr 2020-07-16T13:38:15.290 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2020-07-16T13:38:15.290 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.num_levels: 7 2020-07-16T13:38:15.290 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2020-07-16T13:38:15.290 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2020-07-16T13:38:15.290 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2020-07-16T13:38:15.290 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2020-07-16T13:38:15.291 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2020-07-16T13:38:15.291 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2020-07-16T13:38:15.291 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2020-07-16T13:38:15.291 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2020-07-16T13:38:15.292 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2020-07-16T13:38:15.292 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.compression_opts.window_bits: -14 2020-07-16T13:38:15.292 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.compression_opts.level: 32767 2020-07-16T13:38:15.292 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.compression_opts.strategy: 0 2020-07-16T13:38:15.292 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2020-07-16T13:38:15.293 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2020-07-16T13:38:15.293 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.compression_opts.enabled: false 2020-07-16T13:38:15.293 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2020-07-16T13:38:15.293 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2020-07-16T13:38:15.293 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2020-07-16T13:38:15.294 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.target_file_size_base: 67108864 2020-07-16T13:38:15.294 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.target_file_size_multiplier: 1 2020-07-16T13:38:15.294 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2020-07-16T13:38:15.294 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2020-07-16T13:38:15.294 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2020-07-16T13:38:15.295 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2020-07-16T13:38:15.295 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2020-07-16T13:38:15.295 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2020-07-16T13:38:15.295 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2020-07-16T13:38:15.295 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2020-07-16T13:38:15.295 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2020-07-16T13:38:15.296 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2020-07-16T13:38:15.296 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2020-07-16T13:38:15.296 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2020-07-16T13:38:15.296 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.arena_block_size: 4194304 2020-07-16T13:38:15.296 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2020-07-16T13:38:15.297 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2020-07-16T13:38:15.297 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2020-07-16T13:38:15.297 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.disable_auto_compactions: 0 2020-07-16T13:38:15.297 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2020-07-16T13:38:15.297 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2020-07-16T13:38:15.298 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2020-07-16T13:38:15.298 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2020-07-16T13:38:15.298 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2020-07-16T13:38:15.298 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2020-07-16T13:38:15.298 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2020-07-16T13:38:15.298 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2020-07-16T13:38:15.299 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2020-07-16T13:38:15.299 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2020-07-16T13:38:15.299 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.table_properties_collectors: 2020-07-16T13:38:15.299 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.inplace_update_support: 0 2020-07-16T13:38:15.299 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.inplace_update_num_locks: 10000 2020-07-16T13:38:15.300 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2020-07-16T13:38:15.300 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2020-07-16T13:38:15.300 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.memtable_huge_page_size: 0 2020-07-16T13:38:15.300 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.bloom_locality: 0 2020-07-16T13:38:15.301 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.max_successive_merges: 0 2020-07-16T13:38:15.301 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.optimize_filters_for_hits: 0 2020-07-16T13:38:15.301 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.paranoid_file_checks: 0 2020-07-16T13:38:15.301 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.force_consistency_checks: 0 2020-07-16T13:38:15.301 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.report_bg_io_stats: 0 2020-07-16T13:38:15.302 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.ttl: 2592000 2020-07-16T13:38:15.302 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: Options.periodic_compaction_seconds: 0 2020-07-16T13:38:15.302 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000025 succeeded,manifest_file_number is 25, next_file_number is 27, last_sequence is 6810, log_number is 24,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2020-07-16T13:38:15.302 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.026+0000 7fe3082ef700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 24 2020-07-16T13:38:15.302 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.027+0000 7fe3082ef700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1594906695028097, "job": 1, "event": "recovery_started", "log_files": [26]} 2020-07-16T13:38:15.303 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.027+0000 7fe3082ef700 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #26 mode 2 2020-07-16T13:38:15.303 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.027+0000 7fe3082ef700 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2020-07-16T13:38:15.303 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.027+0000 7fe3082ef700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1594906695028641, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 27, "file_size": 10095, "table_properties": {"data_size": 9150, "index_size": 70, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 69, "raw_key_size": 318, "raw_average_key_size": 24, "raw_value_size": 8826, "raw_average_value_size": 678, "num_data_blocks": 2, "num_entries": 13, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1594906695, "oldest_key_time": 3, "file_creation_time": 0}} 2020-07-16T13:38:15.303 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.027+0000 7fe3082ef700 4 rocksdb: [version_set.cc:3826] Creating manifest 28 2020-07-16T13:38:15.303 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.027+0000 7fe3082ef700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1594906695029025, "job": 1, "event": "recovery_finished"} 2020-07-16T13:38:15.304 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.028+0000 7fe3082ef700 4 rocksdb: DB pointer 0x5566b2359800 2020-07-16T13:38:15.304 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.028+0000 7fe2f7946700 4 rocksdb: [compaction/compaction_job.cc:1676] [default] [JOB 3] Compacting 4@0 + 1@6 files to L6, score 1.00 2020-07-16T13:38:15.304 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.028+0000 7fe2f7946700 4 rocksdb: [compaction/compaction_job.cc:1680] [default] Compaction start summary: Base version 2 Base level 0, inputs: [27(10095B) 24(4135B) 21(398KB) 18(5781KB)], [16(54MB)] 2020-07-16T13:38:15.304 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.028+0000 7fe2f7946700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1594906695029783, "job": 3, "event": "compaction_started", "compaction_reason": "LevelL0FilesNum", "files_L0": [27, 24, 21, 18], "files_L6": [16], "score": 1, "input_data_size": 63997668} 2020-07-16T13:38:15.304 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.028+0000 7fe2ef135700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2020-07-16T13:38:15.305 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.028+0000 7fe2ef135700 4 rocksdb: [db_impl/db_impl.cc:851] 2020-07-16T13:38:15.305 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: ** DB Stats ** 2020-07-16T13:38:15.305 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: Uptime(secs): 0.0 total, 0.0 interval 2020-07-16T13:38:15.305 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2020-07-16T13:38:15.305 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2020-07-16T13:38:15.306 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2020-07-16T13:38:15.306 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2020-07-16T13:38:15.306 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2020-07-16T13:38:15.306 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2020-07-16T13:38:15.306 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: ** Compaction Stats [default] ** 2020-07-16T13:38:15.306 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2020-07-16T13:38:15.307 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2020-07-16T13:38:15.307 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: L0 4/4 6.05 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 22.9 0.00 0.00 1 0.000 0 0 2020-07-16T13:38:15.307 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: L6 1/1 54.98 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2020-07-16T13:38:15.307 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: Sum 5/5 61.03 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 22.9 0.00 0.00 1 0.000 0 0 2020-07-16T13:38:15.307 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 22.9 0.00 0.00 1 0.000 0 0 2020-07-16T13:38:15.308 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: ** Compaction Stats [default] ** 2020-07-16T13:38:15.308 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2020-07-16T13:38:15.308 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2020-07-16T13:38:15.308 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 22.9 0.00 0.00 1 0.000 0 0 2020-07-16T13:38:15.309 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: Uptime(secs): 0.0 total, 0.0 interval 2020-07-16T13:38:15.309 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: Flush(GB): cumulative 0.000, interval 0.000 2020-07-16T13:38:15.309 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: AddFile(GB): cumulative 0.000, interval 0.000 2020-07-16T13:38:15.309 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: AddFile(Total Files): cumulative 0, interval 0 2020-07-16T13:38:15.309 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: AddFile(L0 Files): cumulative 0, interval 0 2020-07-16T13:38:15.309 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: AddFile(Keys): cumulative 0, interval 0 2020-07-16T13:38:15.310 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: Cumulative compaction: 0.00 GB write, 3.94 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2020-07-16T13:38:15.310 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: Interval compaction: 0.00 GB write, 3.94 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2020-07-16T13:38:15.310 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2020-07-16T13:38:15.310 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: ** File Read Latency Histogram By Level [default] ** 2020-07-16T13:38:15.310 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: ** Compaction Stats [default] ** 2020-07-16T13:38:15.311 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2020-07-16T13:38:15.311 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2020-07-16T13:38:15.311 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: L0 4/4 6.05 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 22.9 0.00 0.00 1 0.000 0 0 2020-07-16T13:38:15.311 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: L6 1/1 54.98 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2020-07-16T13:38:15.312 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: Sum 5/5 61.03 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 22.9 0.00 0.00 1 0.000 0 0 2020-07-16T13:38:15.312 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2020-07-16T13:38:15.312 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: ** Compaction Stats [default] ** 2020-07-16T13:38:15.312 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2020-07-16T13:38:15.312 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2020-07-16T13:38:15.313 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 22.9 0.00 0.00 1 0.000 0 0 2020-07-16T13:38:15.313 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: Uptime(secs): 0.0 total, 0.0 interval 2020-07-16T13:38:15.313 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: Flush(GB): cumulative 0.000, interval 0.000 2020-07-16T13:38:15.313 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: AddFile(GB): cumulative 0.000, interval 0.000 2020-07-16T13:38:15.313 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: AddFile(Total Files): cumulative 0, interval 0 2020-07-16T13:38:15.313 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: AddFile(L0 Files): cumulative 0, interval 0 2020-07-16T13:38:15.314 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: AddFile(Keys): cumulative 0, interval 0 2020-07-16T13:38:15.314 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: Cumulative compaction: 0.00 GB write, 3.89 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2020-07-16T13:38:15.314 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2020-07-16T13:38:15.314 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2020-07-16T13:38:15.314 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: ** File Read Latency Histogram By Level [default] ** 2020-07-16T13:38:15.315 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.029+0000 7fe3082ef700 0 starting mon.a rank 0 at public addrs [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] at bind addrs [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 4c8ed362-c768-11ea-a06f-001a4aab830c 2020-07-16T13:38:15.315 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.030+0000 7fe3082ef700 1 mon.a@-1(???) e3 preinit fsid 4c8ed362-c768-11ea-a06f-001a4aab830c 2020-07-16T13:38:15.315 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.030+0000 7fe3082ef700 0 mon.a@-1(???).mds e1 new map 2020-07-16T13:38:15.315 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.030+0000 7fe3082ef700 0 mon.a@-1(???).mds e1 print_map 2020-07-16T13:38:15.315 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: e1 2020-07-16T13:38:15.316 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: enable_multiple, ever_enabled_multiple: 0,0 2020-07-16T13:38:15.316 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2020-07-16T13:38:15.316 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: legacy client fscid: -1 2020-07-16T13:38:15.316 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 2020-07-16T13:38:15.317 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: No filesystems configured 2020-07-16T13:38:15.317 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.030+0000 7fe3082ef700 0 mon.a@-1(???).osd e53 crush map has features 288514051259236352, adjusting msgr requires 2020-07-16T13:38:15.317 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.030+0000 7fe3082ef700 0 mon.a@-1(???).osd e53 crush map has features 3314933000852226048, adjusting msgr requires 2020-07-16T13:38:15.317 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.030+0000 7fe3082ef700 0 mon.a@-1(???).osd e53 crush map has features 288514051259236352, adjusting msgr requires 2020-07-16T13:38:15.317 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: audit 2020-07-16T13:37:36.508751+0000 mon.b (mon.2) 108 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632944\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632975\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633004\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633155\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633259\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633374\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633475\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633508\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:38:15.318 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: cluster 2020-07-16T13:37:37.211734+0000 mon.a (mon.0) 1 : cluster [INF] mon.a calling monitor election 2020-07-16T13:38:15.318 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: cluster 2020-07-16T13:37:37.213663+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2020-07-16T13:38:15.318 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: audit 2020-07-16T13:37:37.216962+0000 mon.a (mon.0) 3 : audit [INF] from='mgr.34499 ' entity='' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632944\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632975\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633004\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633155\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633259\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633374\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633475\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633508\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:38:15.318 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: cluster 2020-07-16T13:37:37.218621+0000 mon.a (mon.0) 4 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0],b=[v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0],c=[v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0]} 2020-07-16T13:38:15.319 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: cluster 2020-07-16T13:37:37.218663+0000 mon.a (mon.0) 5 : cluster [DBG] fsmap 2020-07-16T13:38:15.319 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: cluster 2020-07-16T13:37:37.218692+0000 mon.a (mon.0) 6 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2020-07-16T13:38:15.319 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: cluster 2020-07-16T13:37:37.219387+0000 mon.a (mon.0) 7 : cluster [DBG] mgrmap e20: x(active, since 36s), standbys: y 2020-07-16T13:38:15.319 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: audit 2020-07-16T13:37:37.221847+0000 mon.a (mon.0) 8 : audit [INF] from='mgr.34499 ' entity='' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632944\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632975\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633004\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633155\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633259\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633374\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633475\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633508\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:38:15.320 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: audit 2020-07-16T13:37:37.224012+0000 mon.b (mon.2) 109 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:38:15.320 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: cluster 2020-07-16T13:37:37.225743+0000 mon.a (mon.0) 9 : cluster [DBG] mgrmap e21: x(active, since 36s), standbys: y 2020-07-16T13:38:15.320 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: cluster 2020-07-16T13:37:37.225773+0000 mon.a (mon.0) 10 : cluster [INF] overall HEALTH_OK 2020-07-16T13:38:15.320 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.031+0000 7fe3082ef700 1 mon.a@-1(???).paxosservice(auth 1..19) refresh upgraded, format 0 -> 3 2020-07-16T13:38:15.321 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.033+0000 7fe3082ef700 20 expand_channel_meta expand map: {default=false} 2020-07-16T13:38:15.321 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.033+0000 7fe3082ef700 20 expand_channel_meta from 'false' to 'false' 2020-07-16T13:38:15.321 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.033+0000 7fe3082ef700 20 expand_channel_meta expanded map: {default=false} 2020-07-16T13:38:15.321 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.033+0000 7fe3082ef700 20 expand_channel_meta expand map: {default=info} 2020-07-16T13:38:15.322 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.033+0000 7fe3082ef700 20 expand_channel_meta from 'info' to 'info' 2020-07-16T13:38:15.322 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.033+0000 7fe3082ef700 20 expand_channel_meta expanded map: {default=info} 2020-07-16T13:38:15.322 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.033+0000 7fe3082ef700 20 expand_channel_meta expand map: {default=daemon} 2020-07-16T13:38:15.323 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.033+0000 7fe3082ef700 20 expand_channel_meta from 'daemon' to 'daemon' 2020-07-16T13:38:15.323 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.033+0000 7fe3082ef700 20 expand_channel_meta expanded map: {default=daemon} 2020-07-16T13:38:15.323 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.033+0000 7fe3082ef700 20 expand_channel_meta expand map: {default=debug} 2020-07-16T13:38:15.323 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.033+0000 7fe3082ef700 20 expand_channel_meta from 'debug' to 'debug' 2020-07-16T13:38:15.323 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.033+0000 7fe3082ef700 20 expand_channel_meta expanded map: {default=debug} 2020-07-16T13:38:15.324 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.0.0-3349-g7260671e53b/rpm/el8/BUILD/ceph-16.0.0-3349-g7260671e53b/src/mon/OSDMonitor.cc: In function 'virtual void OSDMonitor::encode_pending(MonitorDBStore::TransactionRef)' thread 7fe2f0137700 time 2020-07-16T13:38:15.249800+0000 2020-07-16T13:38:15.324 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.0.0-3349-g7260671e53b/rpm/el8/BUILD/ceph-16.0.0-3349-g7260671e53b/src/mon/OSDMonitor.cc: 2023: FAILED ceph_assert((features & ~mon->get_quorum_con_features()) == 0) 2020-07-16T13:38:15.324 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev) 2020-07-16T13:38:15.325 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7fe2ff4a5b96] 2020-07-16T13:38:15.325 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 2: (()+0x275db0) [0x7fe2ff4a5db0] 2020-07-16T13:38:15.325 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 3: (OSDMonitor::encode_pending(std::shared_ptr)+0x6738) [0x5566af9e06d8] 2020-07-16T13:38:15.326 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 4: (PaxosService::propose_pending()+0x21a) [0x5566af95099a] 2020-07-16T13:38:15.326 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 5: (MgrMonitor::drop_active()+0x346) [0x5566afa44ce6] 2020-07-16T13:38:15.326 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 6: (MgrMonitor::prepare_beacon(boost::intrusive_ptr)+0x1e27) [0x5566afa46e97] 2020-07-16T13:38:15.327 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 7: (MgrMonitor::prepare_update(boost::intrusive_ptr)+0x5b) [0x5566afa4b2db] 2020-07-16T13:38:15.327 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 8: (PaxosService::dispatch(boost::intrusive_ptr)+0xa6d) [0x5566af95184d] 2020-07-16T13:38:15.328 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 9: (PaxosService::C_RetryMessage::_finish(int)+0x64) [0x5566af8ae754] 2020-07-16T13:38:15.328 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 10: (C_MonOp::finish(int)+0x49) [0x5566af84e089] 2020-07-16T13:38:15.328 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 11: (Context::complete(int)+0xd) [0x5566af84b2ad] 2020-07-16T13:38:15.329 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 12: (void finish_contexts > >(ceph::common::CephContext*, std::__cxx11::list >&, int)+0xa5) [0x5566af874ae5] 2020-07-16T13:38:15.329 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 13: (Paxos::finish_round()+0x27b) [0x5566af9481ab] 2020-07-16T13:38:15.329 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 14: (Paxos::commit_finish()+0x91c) [0x5566af94ac1c] 2020-07-16T13:38:15.330 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 15: (C_Committed::finish(int)+0x45) [0x5566af94f055] 2020-07-16T13:38:15.330 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 16: (Context::complete(int)+0xd) [0x5566af84b2ad] 2020-07-16T13:38:15.330 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 17: (MonitorDBStore::C_DoTransaction::finish(int)+0x98) [0x5566af94ed78] 2020-07-16T13:38:15.330 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 18: (Context::complete(int)+0xd) [0x5566af84b2ad] 2020-07-16T13:38:15.331 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 19: (Finisher::finisher_thread_entry()+0x1a5) [0x7fe2ff5422c5] 2020-07-16T13:38:15.331 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 20: (()+0x82de) [0x7fe2fcfa02de] 2020-07-16T13:38:15.331 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 21: (clone()+0x43) [0x7fe2fbcd7e83] 2020-07-16T13:38:15.332 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.250+0000 7fe2f0137700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.0.0-3349-g7260671e53b/rpm/el8/BUILD/ceph-16.0.0-3349-g7260671e53b/src/mon/OSDMonitor.cc: In function 'virtual void OSDMonitor::encode_pending(MonitorDBStore::TransactionRef)' thread 7fe2f0137700 time 2020-07-16T13:38:15.249800+0000 2020-07-16T13:38:15.332 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.0.0-3349-g7260671e53b/rpm/el8/BUILD/ceph-16.0.0-3349-g7260671e53b/src/mon/OSDMonitor.cc: 2023: FAILED ceph_assert((features & ~mon->get_quorum_con_features()) == 0) 2020-07-16T13:38:15.333 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev) 2020-07-16T13:38:15.333 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7fe2ff4a5b96] 2020-07-16T13:38:15.333 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 2: (()+0x275db0) [0x7fe2ff4a5db0] 2020-07-16T13:38:15.333 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 3: (OSDMonitor::encode_pending(std::shared_ptr)+0x6738) [0x5566af9e06d8] 2020-07-16T13:38:15.334 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 4: (PaxosService::propose_pending()+0x21a) [0x5566af95099a] 2020-07-16T13:38:15.334 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 5: (MgrMonitor::drop_active()+0x346) [0x5566afa44ce6] 2020-07-16T13:38:15.334 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 6: (MgrMonitor::prepare_beacon(boost::intrusive_ptr)+0x1e27) [0x5566afa46e97] 2020-07-16T13:38:15.334 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 7: (MgrMonitor::prepare_update(boost::intrusive_ptr)+0x5b) [0x5566afa4b2db] 2020-07-16T13:38:15.334 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 8: (PaxosService::dispatch(boost::intrusive_ptr)+0xa6d) [0x5566af95184d] 2020-07-16T13:38:15.335 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 9: (PaxosService::C_RetryMessage::_finish(int)+0x64) [0x5566af8ae754] 2020-07-16T13:38:15.335 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 10: (C_MonOp::finish(int)+0x49) [0x5566af84e089] 2020-07-16T13:38:15.335 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 11: (Context::complete(int)+0xd) [0x5566af84b2ad] 2020-07-16T13:38:15.335 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 12: (void finish_contexts > >(ceph::common::CephContext*, std::__cxx11::list >&, int)+0xa5) [0x5566af874ae5] 2020-07-16T13:38:15.335 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 13: (Paxos::finish_round()+0x27b) [0x5566af9481ab] 2020-07-16T13:38:15.336 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 14: (Paxos::commit_finish()+0x91c) [0x5566af94ac1c] 2020-07-16T13:38:15.336 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 15: (C_Committed::finish(int)+0x45) [0x5566af94f055] 2020-07-16T13:38:15.336 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 16: (Context::complete(int)+0xd) [0x5566af84b2ad] 2020-07-16T13:38:15.336 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 17: (MonitorDBStore::C_DoTransaction::finish(int)+0x98) [0x5566af94ed78] 2020-07-16T13:38:15.336 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 18: (Context::complete(int)+0xd) [0x5566af84b2ad] 2020-07-16T13:38:15.336 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 19: (Finisher::finisher_thread_entry()+0x1a5) [0x7fe2ff5422c5] 2020-07-16T13:38:15.529 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 20: (()+0x82de) [0x7fe2fcfa02de] 2020-07-16T13:38:15.530 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 21: (clone()+0x43) [0x7fe2fbcd7e83] 2020-07-16T13:38:15.530 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: *** Caught signal (Aborted) ** 2020-07-16T13:38:15.530 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: in thread 7fe2f0137700 thread_name:fn_monstore 2020-07-16T13:38:15.530 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev) 2020-07-16T13:38:15.530 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 1: (()+0x12dd0) [0x7fe2fcfaadd0] 2020-07-16T13:38:15.531 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 2: (gsignal()+0x10f) [0x7fe2fbc1370f] 2020-07-16T13:38:15.531 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 3: (abort()+0x127) [0x7fe2fbbfdb25] 2020-07-16T13:38:15.531 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a9) [0x7fe2ff4a5be7] 2020-07-16T13:38:15.531 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 5: (()+0x275db0) [0x7fe2ff4a5db0] 2020-07-16T13:38:15.531 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 6: (OSDMonitor::encode_pending(std::shared_ptr)+0x6738) [0x5566af9e06d8] 2020-07-16T13:38:15.532 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 7: (PaxosService::propose_pending()+0x21a) [0x5566af95099a] 2020-07-16T13:38:15.532 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 8: (MgrMonitor::drop_active()+0x346) [0x5566afa44ce6] 2020-07-16T13:38:15.532 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 9: (MgrMonitor::prepare_beacon(boost::intrusive_ptr)+0x1e27) [0x5566afa46e97] 2020-07-16T13:38:15.532 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 10: (MgrMonitor::prepare_update(boost::intrusive_ptr)+0x5b) [0x5566afa4b2db] 2020-07-16T13:38:15.532 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 11: (PaxosService::dispatch(boost::intrusive_ptr)+0xa6d) [0x5566af95184d] 2020-07-16T13:38:15.532 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 12: (PaxosService::C_RetryMessage::_finish(int)+0x64) [0x5566af8ae754] 2020-07-16T13:38:15.533 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 13: (C_MonOp::finish(int)+0x49) [0x5566af84e089] 2020-07-16T13:38:15.533 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 14: (Context::complete(int)+0xd) [0x5566af84b2ad] 2020-07-16T13:38:15.533 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 15: (void finish_contexts > >(ceph::common::CephContext*, std::__cxx11::list >&, int)+0xa5) [0x5566af874ae5] 2020-07-16T13:38:15.533 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 16: (Paxos::finish_round()+0x27b) [0x5566af9481ab] 2020-07-16T13:38:15.533 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 17: (Paxos::commit_finish()+0x91c) [0x5566af94ac1c] 2020-07-16T13:38:15.534 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 18: (C_Committed::finish(int)+0x45) [0x5566af94f055] 2020-07-16T13:38:15.534 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 19: (Context::complete(int)+0xd) [0x5566af84b2ad] 2020-07-16T13:38:15.534 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 20: (MonitorDBStore::C_DoTransaction::finish(int)+0x98) [0x5566af94ed78] 2020-07-16T13:38:15.534 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 21: (Context::complete(int)+0xd) [0x5566af84b2ad] 2020-07-16T13:38:15.534 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 22: (Finisher::finisher_thread_entry()+0x1a5) [0x7fe2ff5422c5] 2020-07-16T13:38:15.535 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 23: (()+0x82de) [0x7fe2fcfa02de] 2020-07-16T13:38:15.535 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 24: (clone()+0x43) [0x7fe2fbcd7e83] 2020-07-16T13:38:15.535 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 2020-07-16T13:38:15.252+0000 7fe2f0137700 -1 *** Caught signal (Aborted) ** 2020-07-16T13:38:15.535 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: in thread 7fe2f0137700 thread_name:fn_monstore 2020-07-16T13:38:15.535 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev) 2020-07-16T13:38:15.535 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 1: (()+0x12dd0) [0x7fe2fcfaadd0] 2020-07-16T13:38:15.536 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 2: (gsignal()+0x10f) [0x7fe2fbc1370f] 2020-07-16T13:38:15.536 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 3: (abort()+0x127) [0x7fe2fbbfdb25] 2020-07-16T13:38:15.536 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a9) [0x7fe2ff4a5be7] 2020-07-16T13:38:15.536 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 5: (()+0x275db0) [0x7fe2ff4a5db0] 2020-07-16T13:38:15.536 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 6: (OSDMonitor::encode_pending(std::shared_ptr)+0x6738) [0x5566af9e06d8] 2020-07-16T13:38:15.537 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 7: (PaxosService::propose_pending()+0x21a) [0x5566af95099a] 2020-07-16T13:38:15.537 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 8: (MgrMonitor::drop_active()+0x346) [0x5566afa44ce6] 2020-07-16T13:38:15.537 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 9: (MgrMonitor::prepare_beacon(boost::intrusive_ptr)+0x1e27) [0x5566afa46e97] 2020-07-16T13:38:15.537 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 10: (MgrMonitor::prepare_update(boost::intrusive_ptr)+0x5b) [0x5566afa4b2db] 2020-07-16T13:38:15.537 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 11: (PaxosService::dispatch(boost::intrusive_ptr)+0xa6d) [0x5566af95184d] 2020-07-16T13:38:15.540 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 12: (PaxosService::C_RetryMessage::_finish(int)+0x64) [0x5566af8ae754] 2020-07-16T13:38:15.540 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 13: (C_MonOp::finish(int)+0x49) [0x5566af84e089] 2020-07-16T13:38:15.540 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 14: (Context::complete(int)+0xd) [0x5566af84b2ad] 2020-07-16T13:38:15.541 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 15: (void finish_contexts > >(ceph::common::CephContext*, std::__cxx11::list >&, int)+0xa5) [0x5566af874ae5] 2020-07-16T13:38:15.541 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 16: (Paxos::finish_round()+0x27b) [0x5566af9481ab] 2020-07-16T13:38:15.541 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 17: (Paxos::commit_finish()+0x91c) [0x5566af94ac1c] 2020-07-16T13:38:15.542 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 18: (C_Committed::finish(int)+0x45) [0x5566af94f055] 2020-07-16T13:38:15.542 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 19: (Context::complete(int)+0xd) [0x5566af84b2ad] 2020-07-16T13:38:15.542 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 20: (MonitorDBStore::C_DoTransaction::finish(int)+0x98) [0x5566af94ed78] 2020-07-16T13:38:15.542 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 21: (Context::complete(int)+0xd) [0x5566af84b2ad] 2020-07-16T13:38:15.543 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 22: (Finisher::finisher_thread_entry()+0x1a5) [0x7fe2ff5422c5] 2020-07-16T13:38:15.543 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 23: (()+0x82de) [0x7fe2fcfa02de] 2020-07-16T13:38:15.543 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 24: (clone()+0x43) [0x7fe2fbcd7e83] 2020-07-16T13:38:15.543 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-07-16T13:38:15.543 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug -1> 2020-07-16T13:38:15.250+0000 7fe2f0137700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.0.0-3349-g7260671e53b/rpm/el8/BUILD/ceph-16.0.0-3349-g7260671e53b/src/mon/OSDMonitor.cc: In function 'virtual void OSDMonitor::encode_pending(MonitorDBStore::TransactionRef)' thread 7fe2f0137700 time 2020-07-16T13:38:15.249800+0000 2020-07-16T13:38:15.544 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.0.0-3349-g7260671e53b/rpm/el8/BUILD/ceph-16.0.0-3349-g7260671e53b/src/mon/OSDMonitor.cc: 2023: FAILED ceph_assert((features & ~mon->get_quorum_con_features()) == 0) 2020-07-16T13:38:15.544 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev) 2020-07-16T13:38:15.544 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7fe2ff4a5b96] 2020-07-16T13:38:15.544 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 2: (()+0x275db0) [0x7fe2ff4a5db0] 2020-07-16T13:38:15.545 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 3: (OSDMonitor::encode_pending(std::shared_ptr)+0x6738) [0x5566af9e06d8] 2020-07-16T13:38:15.545 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 4: (PaxosService::propose_pending()+0x21a) [0x5566af95099a] 2020-07-16T13:38:15.545 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 5: (MgrMonitor::drop_active()+0x346) [0x5566afa44ce6] 2020-07-16T13:38:15.545 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 6: (MgrMonitor::prepare_beacon(boost::intrusive_ptr)+0x1e27) [0x5566afa46e97] 2020-07-16T13:38:15.545 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 7: (MgrMonitor::prepare_update(boost::intrusive_ptr)+0x5b) [0x5566afa4b2db] 2020-07-16T13:38:15.546 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 8: (PaxosService::dispatch(boost::intrusive_ptr)+0xa6d) [0x5566af95184d] 2020-07-16T13:38:15.546 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 9: (PaxosService::C_RetryMessage::_finish(int)+0x64) [0x5566af8ae754] 2020-07-16T13:38:15.546 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 10: (C_MonOp::finish(int)+0x49) [0x5566af84e089] 2020-07-16T13:38:15.546 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 11: (Context::complete(int)+0xd) [0x5566af84b2ad] 2020-07-16T13:38:15.546 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 12: (void finish_contexts > >(ceph::common::CephContext*, std::__cxx11::list >&, int)+0xa5) [0x5566af874ae5] 2020-07-16T13:38:15.546 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 13: (Paxos::finish_round()+0x27b) [0x5566af9481ab] 2020-07-16T13:38:15.547 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 14: (Paxos::commit_finish()+0x91c) [0x5566af94ac1c] 2020-07-16T13:38:15.547 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 15: (C_Committed::finish(int)+0x45) [0x5566af94f055] 2020-07-16T13:38:15.547 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 16: (Context::complete(int)+0xd) [0x5566af84b2ad] 2020-07-16T13:38:15.547 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 17: (MonitorDBStore::C_DoTransaction::finish(int)+0x98) [0x5566af94ed78] 2020-07-16T13:38:15.548 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 18: (Context::complete(int)+0xd) [0x5566af84b2ad] 2020-07-16T13:38:15.548 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 19: (Finisher::finisher_thread_entry()+0x1a5) [0x7fe2ff5422c5] 2020-07-16T13:38:15.548 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 20: (()+0x82de) [0x7fe2fcfa02de] 2020-07-16T13:38:15.548 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 21: (clone()+0x43) [0x7fe2fbcd7e83] 2020-07-16T13:38:15.549 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 0> 2020-07-16T13:38:15.252+0000 7fe2f0137700 -1 *** Caught signal (Aborted) ** 2020-07-16T13:38:15.549 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: in thread 7fe2f0137700 thread_name:fn_monstore 2020-07-16T13:38:15.550 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev) 2020-07-16T13:38:15.550 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 1: (()+0x12dd0) [0x7fe2fcfaadd0] 2020-07-16T13:38:15.550 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 2: (gsignal()+0x10f) [0x7fe2fbc1370f] 2020-07-16T13:38:15.550 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 3: (abort()+0x127) [0x7fe2fbbfdb25] 2020-07-16T13:38:15.550 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a9) [0x7fe2ff4a5be7] 2020-07-16T13:38:15.551 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 5: (()+0x275db0) [0x7fe2ff4a5db0] 2020-07-16T13:38:15.551 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 6: (OSDMonitor::encode_pending(std::shared_ptr)+0x6738) [0x5566af9e06d8] 2020-07-16T13:38:15.551 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 7: (PaxosService::propose_pending()+0x21a) [0x5566af95099a] 2020-07-16T13:38:15.551 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 8: (MgrMonitor::drop_active()+0x346) [0x5566afa44ce6] 2020-07-16T13:38:15.551 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 9: (MgrMonitor::prepare_beacon(boost::intrusive_ptr)+0x1e27) [0x5566afa46e97] 2020-07-16T13:38:15.552 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 10: (MgrMonitor::prepare_update(boost::intrusive_ptr)+0x5b) [0x5566afa4b2db] 2020-07-16T13:38:15.552 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 11: (PaxosService::dispatch(boost::intrusive_ptr)+0xa6d) [0x5566af95184d] 2020-07-16T13:38:15.552 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 12: (PaxosService::C_RetryMessage::_finish(int)+0x64) [0x5566af8ae754] 2020-07-16T13:38:15.552 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 13: (C_MonOp::finish(int)+0x49) [0x5566af84e089] 2020-07-16T13:38:15.552 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 14: (Context::complete(int)+0xd) [0x5566af84b2ad] 2020-07-16T13:38:15.552 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 15: (void finish_contexts > >(ceph::common::CephContext*, std::__cxx11::list >&, int)+0xa5) [0x5566af874ae5] 2020-07-16T13:38:15.553 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 16: (Paxos::finish_round()+0x27b) [0x5566af9481ab] 2020-07-16T13:38:15.553 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 17: (Paxos::commit_finish()+0x91c) [0x5566af94ac1c] 2020-07-16T13:38:15.553 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 18: (C_Committed::finish(int)+0x45) [0x5566af94f055] 2020-07-16T13:38:15.553 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 19: (Context::complete(int)+0xd) [0x5566af84b2ad] 2020-07-16T13:38:15.553 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 20: (MonitorDBStore::C_DoTransaction::finish(int)+0x98) [0x5566af94ed78] 2020-07-16T13:38:15.554 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 21: (Context::complete(int)+0xd) [0x5566af84b2ad] 2020-07-16T13:38:15.554 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 22: (Finisher::finisher_thread_entry()+0x1a5) [0x7fe2ff5422c5] 2020-07-16T13:38:15.554 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 23: (()+0x82de) [0x7fe2fcfa02de] 2020-07-16T13:38:15.554 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 24: (clone()+0x43) [0x7fe2fbcd7e83] 2020-07-16T13:38:15.554 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-07-16T13:38:15.555 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug -1> 2020-07-16T13:38:15.250+0000 7fe2f0137700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.0.0-3349-g7260671e53b/rpm/el8/BUILD/ceph-16.0.0-3349-g7260671e53b/src/mon/OSDMonitor.cc: In function 'virtual void OSDMonitor::encode_pending(MonitorDBStore::TransactionRef)' thread 7fe2f0137700 time 2020-07-16T13:38:15.249800+0000 2020-07-16T13:38:15.555 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.0.0-3349-g7260671e53b/rpm/el8/BUILD/ceph-16.0.0-3349-g7260671e53b/src/mon/OSDMonitor.cc: 2023: FAILED ceph_assert((features & ~mon->get_quorum_con_features()) == 0) 2020-07-16T13:38:15.555 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev) 2020-07-16T13:38:15.555 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7fe2ff4a5b96] 2020-07-16T13:38:15.555 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 2: (()+0x275db0) [0x7fe2ff4a5db0] 2020-07-16T13:38:15.555 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 3: (OSDMonitor::encode_pending(std::shared_ptr)+0x6738) [0x5566af9e06d8] 2020-07-16T13:38:15.556 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 4: (PaxosService::propose_pending()+0x21a) [0x5566af95099a] 2020-07-16T13:38:15.556 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 5: (MgrMonitor::drop_active()+0x346) [0x5566afa44ce6] 2020-07-16T13:38:15.556 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 6: (MgrMonitor::prepare_beacon(boost::intrusive_ptr)+0x1e27) [0x5566afa46e97] 2020-07-16T13:38:15.556 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 7: (MgrMonitor::prepare_update(boost::intrusive_ptr)+0x5b) [0x5566afa4b2db] 2020-07-16T13:38:15.556 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 8: (PaxosService::dispatch(boost::intrusive_ptr)+0xa6d) [0x5566af95184d] 2020-07-16T13:38:15.557 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 9: (PaxosService::C_RetryMessage::_finish(int)+0x64) [0x5566af8ae754] 2020-07-16T13:38:15.557 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 10: (C_MonOp::finish(int)+0x49) [0x5566af84e089] 2020-07-16T13:38:15.557 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 11: (Context::complete(int)+0xd) [0x5566af84b2ad] 2020-07-16T13:38:15.557 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 12: (void finish_contexts > >(ceph::common::CephContext*, std::__cxx11::list >&, int)+0xa5) [0x5566af874ae5] 2020-07-16T13:38:15.557 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 13: (Paxos::finish_round()+0x27b) [0x5566af9481ab] 2020-07-16T13:38:15.558 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 14: (Paxos::commit_finish()+0x91c) [0x5566af94ac1c] 2020-07-16T13:38:15.558 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 15: (C_Committed::finish(int)+0x45) [0x5566af94f055] 2020-07-16T13:38:15.558 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 16: (Context::complete(int)+0xd) [0x5566af84b2ad] 2020-07-16T13:38:15.558 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 17: (MonitorDBStore::C_DoTransaction::finish(int)+0x98) [0x5566af94ed78] 2020-07-16T13:38:15.558 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 18: (Context::complete(int)+0xd) [0x5566af84b2ad] 2020-07-16T13:38:15.558 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 19: (Finisher::finisher_thread_entry()+0x1a5) [0x7fe2ff5422c5] 2020-07-16T13:38:15.559 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 20: (()+0x82de) [0x7fe2fcfa02de] 2020-07-16T13:38:15.559 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 21: (clone()+0x43) [0x7fe2fbcd7e83] 2020-07-16T13:38:15.559 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: debug 0> 2020-07-16T13:38:15.252+0000 7fe2f0137700 -1 *** Caught signal (Aborted) ** 2020-07-16T13:38:15.559 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: in thread 7fe2f0137700 thread_name:fn_monstore 2020-07-16T13:38:15.559 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev) 2020-07-16T13:38:15.560 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 1: (()+0x12dd0) [0x7fe2fcfaadd0] 2020-07-16T13:38:15.560 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 2: (gsignal()+0x10f) [0x7fe2fbc1370f] 2020-07-16T13:38:15.560 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 3: (abort()+0x127) [0x7fe2fbbfdb25] 2020-07-16T13:38:15.560 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a9) [0x7fe2ff4a5be7] 2020-07-16T13:38:15.560 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 5: (()+0x275db0) [0x7fe2ff4a5db0] 2020-07-16T13:38:15.561 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 6: (OSDMonitor::encode_pending(std::shared_ptr)+0x6738) [0x5566af9e06d8] 2020-07-16T13:38:15.561 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 7: (PaxosService::propose_pending()+0x21a) [0x5566af95099a] 2020-07-16T13:38:15.561 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 8: (MgrMonitor::drop_active()+0x346) [0x5566afa44ce6] 2020-07-16T13:38:15.562 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 9: (MgrMonitor::prepare_beacon(boost::intrusive_ptr)+0x1e27) [0x5566afa46e97] 2020-07-16T13:38:15.562 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 10: (MgrMonitor::prepare_update(boost::intrusive_ptr)+0x5b) [0x5566afa4b2db] 2020-07-16T13:38:15.562 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 11: (PaxosService::dispatch(boost::intrusive_ptr)+0xa6d) [0x5566af95184d] 2020-07-16T13:38:15.562 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 12: (PaxosService::C_RetryMessage::_finish(int)+0x64) [0x5566af8ae754] 2020-07-16T13:38:15.562 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 13: (C_MonOp::finish(int)+0x49) [0x5566af84e089] 2020-07-16T13:38:15.562 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 14: (Context::complete(int)+0xd) [0x5566af84b2ad] 2020-07-16T13:38:15.563 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 15: (void finish_contexts > >(ceph::common::CephContext*, std::__cxx11::list >&, int)+0xa5) [0x5566af874ae5] 2020-07-16T13:38:15.563 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 16: (Paxos::finish_round()+0x27b) [0x5566af9481ab] 2020-07-16T13:38:15.563 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 17: (Paxos::commit_finish()+0x91c) [0x5566af94ac1c] 2020-07-16T13:38:15.563 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 18: (C_Committed::finish(int)+0x45) [0x5566af94f055] 2020-07-16T13:38:15.563 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 19: (Context::complete(int)+0xd) [0x5566af84b2ad] 2020-07-16T13:38:15.564 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 20: (MonitorDBStore::C_DoTransaction::finish(int)+0x98) [0x5566af94ed78] 2020-07-16T13:38:15.564 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 21: (Context::complete(int)+0xd) [0x5566af84b2ad] 2020-07-16T13:38:15.564 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 22: (Finisher::finisher_thread_entry()+0x1a5) [0x7fe2ff5422c5] 2020-07-16T13:38:15.564 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 23: (()+0x82de) [0x7fe2fcfa02de] 2020-07-16T13:38:15.564 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: 24: (clone()+0x43) [0x7fe2fbcd7e83] 2020-07-16T13:38:15.564 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-07-16T13:38:15.565 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 bash[11890]: reraise_fatal: default handler for signal 6 didn't terminate the process? 2020-07-16T13:38:15.565 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 podman[11919]: 2020-07-16 13:38:15.312327516 +0000 UTC m=+0.647066870 container died 4c690a4bc95a0882c9c38fc95b363c883cdf980d11b5df7db81af4f1243de645 (image=quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a) 2020-07-16T13:38:16.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 podman[11919]: 2020-07-16 13:38:15.812247263 +0000 UTC m=+1.146986617 container remove 4c690a4bc95a0882c9c38fc95b363c883cdf980d11b5df7db81af4f1243de645 (image=quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a) 2020-07-16T13:38:16.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 systemd[1]: ceph-4c8ed362-c768-11ea-a06f-001a4aab830c@mon.a.service: Main process exited, code=exited, status=1/FAILURE 2020-07-16T13:38:16.279 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:15 smithi132 systemd[1]: ceph-4c8ed362-c768-11ea-a06f-001a4aab830c@mon.a.service: Failed with result 'exit-code'. 2020-07-16T13:38:16.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:15 smithi188 bash[23329]: debug 2020-07-16T13:38:15.922+0000 7fe90d4b2700 -1 mon.b@2(peon) e3 get_health_metrics reporting 2 slow ops, oldest is log(1 entries from seq 110 at 2020-07-16T13:37:40.877704+0000) 2020-07-16T13:38:19.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:18 smithi132 bash[27079]: debug 2020-07-16T13:38:18.924+0000 7ff2252a8700 -1 mon.c@1(peon) e3 get_health_metrics reporting 1 slow ops, oldest is log(1 entries from seq 28 at 2020-07-16T13:37:48.224646+0000) 2020-07-16T13:38:21.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:20 smithi188 bash[23329]: debug 2020-07-16T13:38:20.923+0000 7fe90d4b2700 -1 mon.b@2(peon) e3 get_health_metrics reporting 8 slow ops, oldest is log(1 entries from seq 110 at 2020-07-16T13:37:40.877704+0000) 2020-07-16T13:38:24.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:23 smithi132 bash[27079]: debug 2020-07-16T13:38:23.924+0000 7ff2252a8700 -1 mon.c@1(peon) e3 get_health_metrics reporting 1 slow ops, oldest is log(1 entries from seq 28 at 2020-07-16T13:37:48.224646+0000) 2020-07-16T13:38:26.407 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 systemd[1]: ceph-4c8ed362-c768-11ea-a06f-001a4aab830c@mon.a.service: Service RestartSec=10s expired, scheduling restart. 2020-07-16T13:38:26.407 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 systemd[1]: ceph-4c8ed362-c768-11ea-a06f-001a4aab830c@mon.a.service: Scheduled restart job, restart counter is at 4. 2020-07-16T13:38:26.407 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 systemd[1]: Stopped Ceph mon.a for 4c8ed362-c768-11ea-a06f-001a4aab830c. 2020-07-16T13:38:26.407 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 systemd[1]: Starting Ceph mon.a for 4c8ed362-c768-11ea-a06f-001a4aab830c... 2020-07-16T13:38:26.408 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 podman[12028]: Error: no container with name or ID ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a found: no such container 2020-07-16T13:38:26.408 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 systemd[1]: Started Ceph mon.a for 4c8ed362-c768-11ea-a06f-001a4aab830c. 2020-07-16T13:38:26.408 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: Error: Failed to evict container: "": Failed to find container "ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a" in state: no container with name or ID ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a found: no such container 2020-07-16T13:38:26.408 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a 2020-07-16T13:38:26.409 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: Error: no container with ID or name "ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a" found: no such container 2020-07-16T13:38:26.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:25 smithi188 bash[23329]: debug 2020-07-16T13:38:25.923+0000 7fe90d4b2700 -1 mon.b@2(electing) e3 get_health_metrics reporting 12 slow ops, oldest is log(1 entries from seq 110 at 2020-07-16T13:37:40.877704+0000) 2020-07-16T13:38:26.779 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 podman[12074]: 2020-07-16 13:38:26.405372046 +0000 UTC m=+0.239568416 container create 65442099a0ae86b094f4175fa468de9f14b03cd4e8255a0716ca5042bbd0de39 (image=quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a) 2020-07-16T13:38:26.779 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 podman[12074]: 2020-07-16 13:38:26.530448221 +0000 UTC m=+0.364644707 container init 65442099a0ae86b094f4175fa468de9f14b03cd4e8255a0716ca5042bbd0de39 (image=quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a) 2020-07-16T13:38:26.780 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 podman[12074]: 2020-07-16 13:38:26.563668766 +0000 UTC m=+0.397865134 container start 65442099a0ae86b094f4175fa468de9f14b03cd4e8255a0716ca5042bbd0de39 (image=quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a) 2020-07-16T13:38:26.780 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 podman[12074]: 2020-07-16 13:38:26.563741249 +0000 UTC m=+0.397937662 container attach 65442099a0ae86b094f4175fa468de9f14b03cd4e8255a0716ca5042bbd0de39 (image=quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a) 2020-07-16T13:38:26.780 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.552+0000 7fde86f6a700 0 set uid:gid to 167:167 (ceph:ceph) 2020-07-16T13:38:26.780 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.552+0000 7fde86f6a700 0 ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev), process ceph-mon, pid 1 2020-07-16T13:38:26.780 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.552+0000 7fde86f6a700 0 pidfile_write: ignore empty --pid-file 2020-07-16T13:38:26.781 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 0 load: jerasure load: lrc load: isa 2020-07-16T13:38:26.781 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: RocksDB version: 6.8.1 2020-07-16T13:38:26.781 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2020-07-16T13:38:26.781 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Compile date Jul 16 2020 2020-07-16T13:38:26.782 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: DB SUMMARY 2020-07-16T13:38:26.782 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: CURRENT file: CURRENT 2020-07-16T13:38:26.782 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: IDENTITY file: IDENTITY 2020-07-16T13:38:26.782 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: MANIFEST file: MANIFEST-000028 size: 550 Bytes 2020-07-16T13:38:26.782 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000032.sst 2020-07-16T13:38:26.783 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000029.log size: 9391 ; 2020-07-16T13:38:26.783 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.error_if_exists: 0 2020-07-16T13:38:26.783 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.create_if_missing: 0 2020-07-16T13:38:26.784 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.paranoid_checks: 1 2020-07-16T13:38:26.784 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.env: 0x55a34ec92c00 2020-07-16T13:38:26.784 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.fs: Posix File System 2020-07-16T13:38:26.784 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.info_log: 0x55a35049e6c0 2020-07-16T13:38:26.784 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.max_file_opening_threads: 16 2020-07-16T13:38:26.785 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.statistics: (nil) 2020-07-16T13:38:26.785 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.use_fsync: 0 2020-07-16T13:38:26.785 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.max_log_file_size: 0 2020-07-16T13:38:26.785 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2020-07-16T13:38:26.785 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.log_file_time_to_roll: 0 2020-07-16T13:38:26.786 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.keep_log_file_num: 1000 2020-07-16T13:38:26.786 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.recycle_log_file_num: 0 2020-07-16T13:38:26.786 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.allow_fallocate: 1 2020-07-16T13:38:26.787 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.allow_mmap_reads: 0 2020-07-16T13:38:26.787 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.allow_mmap_writes: 0 2020-07-16T13:38:26.787 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.use_direct_reads: 0 2020-07-16T13:38:26.787 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2020-07-16T13:38:26.787 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.create_missing_column_families: 0 2020-07-16T13:38:26.787 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.db_log_dir: 2020-07-16T13:38:26.788 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2020-07-16T13:38:26.788 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.table_cache_numshardbits: 6 2020-07-16T13:38:26.788 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.max_subcompactions: 1 2020-07-16T13:38:26.788 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.max_background_flushes: -1 2020-07-16T13:38:26.788 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.WAL_ttl_seconds: 0 2020-07-16T13:38:26.789 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.WAL_size_limit_MB: 0 2020-07-16T13:38:26.789 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2020-07-16T13:38:26.789 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2020-07-16T13:38:26.789 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.is_fd_close_on_exec: 1 2020-07-16T13:38:26.789 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.advise_random_on_open: 1 2020-07-16T13:38:26.790 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.db_write_buffer_size: 0 2020-07-16T13:38:26.790 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.write_buffer_manager: 0x55a3504ed3b0 2020-07-16T13:38:26.790 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2020-07-16T13:38:26.791 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2020-07-16T13:38:26.791 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2020-07-16T13:38:26.791 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.use_adaptive_mutex: 0 2020-07-16T13:38:26.791 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.rate_limiter: (nil) 2020-07-16T13:38:26.792 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2020-07-16T13:38:26.792 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.wal_recovery_mode: 2 2020-07-16T13:38:26.792 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.enable_thread_tracking: 0 2020-07-16T13:38:26.792 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.enable_pipelined_write: 0 2020-07-16T13:38:26.793 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.unordered_write: 0 2020-07-16T13:38:26.793 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2020-07-16T13:38:26.793 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2020-07-16T13:38:26.793 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2020-07-16T13:38:26.793 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2020-07-16T13:38:26.793 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.row_cache: None 2020-07-16T13:38:26.794 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.wal_filter: None 2020-07-16T13:38:26.794 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2020-07-16T13:38:26.794 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.allow_ingest_behind: 0 2020-07-16T13:38:26.794 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.preserve_deletes: 0 2020-07-16T13:38:26.794 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.two_write_queues: 0 2020-07-16T13:38:26.795 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.manual_wal_flush: 0 2020-07-16T13:38:26.795 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.atomic_flush: 0 2020-07-16T13:38:26.795 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2020-07-16T13:38:26.795 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.persist_stats_to_disk: 0 2020-07-16T13:38:26.795 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.write_dbid_to_manifest: 0 2020-07-16T13:38:26.796 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.log_readahead_size: 0 2020-07-16T13:38:26.796 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2020-07-16T13:38:26.798 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.max_background_jobs: 2 2020-07-16T13:38:26.798 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.max_background_compactions: -1 2020-07-16T13:38:26.799 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2020-07-16T13:38:26.799 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2020-07-16T13:38:26.800 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.delayed_write_rate : 16777216 2020-07-16T13:38:26.800 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.max_total_wal_size: 0 2020-07-16T13:38:26.801 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2020-07-16T13:38:26.801 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.stats_dump_period_sec: 600 2020-07-16T13:38:26.801 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.stats_persist_period_sec: 600 2020-07-16T13:38:26.801 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2020-07-16T13:38:26.801 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.max_open_files: -1 2020-07-16T13:38:26.802 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.bytes_per_sync: 0 2020-07-16T13:38:26.802 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.wal_bytes_per_sync: 0 2020-07-16T13:38:26.802 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.strict_bytes_per_sync: 0 2020-07-16T13:38:26.803 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Options.compaction_readahead_size: 0 2020-07-16T13:38:26.803 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Compression algorithms supported: 2020-07-16T13:38:26.803 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2020-07-16T13:38:26.804 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: kZSTD supported: 0 2020-07-16T13:38:26.804 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: kXpressCompression supported: 0 2020-07-16T13:38:26.804 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: kLZ4HCCompression supported: 1 2020-07-16T13:38:26.804 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: kLZ4Compression supported: 1 2020-07-16T13:38:26.805 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: kBZip2Compression supported: 0 2020-07-16T13:38:26.805 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: kZlibCompression supported: 1 2020-07-16T13:38:26.805 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: kSnappyCompression supported: 1 2020-07-16T13:38:26.805 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.557+0000 7fde86f6a700 4 rocksdb: Fast CRC32 supported: Supported on x86 2020-07-16T13:38:26.805 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000028 2020-07-16T13:38:26.806 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2020-07-16T13:38:26.806 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2020-07-16T13:38:26.806 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.merge_operator: 2020-07-16T13:38:26.806 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.compaction_filter: None 2020-07-16T13:38:26.806 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.compaction_filter_factory: None 2020-07-16T13:38:26.806 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.memtable_factory: SkipListFactory 2020-07-16T13:38:26.807 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.table_factory: BlockBasedTable 2020-07-16T13:38:26.807 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55a350441bd8) 2020-07-16T13:38:26.807 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: cache_index_and_filter_blocks: 1 2020-07-16T13:38:26.807 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: cache_index_and_filter_blocks_with_high_priority: 1 2020-07-16T13:38:26.807 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: pin_l0_filter_and_index_blocks_in_cache: 0 2020-07-16T13:38:26.808 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: pin_top_level_index_and_filter: 1 2020-07-16T13:38:26.808 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: index_type: 0 2020-07-16T13:38:26.808 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: data_block_index_type: 0 2020-07-16T13:38:26.808 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: index_shortening: 1 2020-07-16T13:38:26.808 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: data_block_hash_table_util_ratio: 0.750000 2020-07-16T13:38:26.808 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: hash_index_allow_collision: 1 2020-07-16T13:38:26.809 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: checksum: 1 2020-07-16T13:38:26.809 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: no_block_cache: 0 2020-07-16T13:38:26.809 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: block_cache: 0x55a35047a610 2020-07-16T13:38:26.809 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: block_cache_name: BinnedLRUCache 2020-07-16T13:38:26.809 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: block_cache_options: 2020-07-16T13:38:26.810 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: capacity : 536870912 2020-07-16T13:38:26.810 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: num_shard_bits : 4 2020-07-16T13:38:26.810 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: strict_capacity_limit : 0 2020-07-16T13:38:26.810 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: high_pri_pool_ratio: 0.000 2020-07-16T13:38:26.818 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: block_cache_compressed: (nil) 2020-07-16T13:38:26.818 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: persistent_cache: (nil) 2020-07-16T13:38:26.818 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: block_size: 4096 2020-07-16T13:38:26.818 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: block_size_deviation: 10 2020-07-16T13:38:26.819 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: block_restart_interval: 16 2020-07-16T13:38:26.819 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: index_block_restart_interval: 1 2020-07-16T13:38:26.819 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: metadata_block_size: 4096 2020-07-16T13:38:26.819 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: partition_filters: 0 2020-07-16T13:38:26.819 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: use_delta_encoding: 1 2020-07-16T13:38:26.820 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: filter_policy: rocksdb.BuiltinBloomFilter 2020-07-16T13:38:26.820 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: whole_key_filtering: 1 2020-07-16T13:38:26.820 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: verify_compression: 0 2020-07-16T13:38:26.820 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: read_amp_bytes_per_bit: 0 2020-07-16T13:38:26.820 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: format_version: 2 2020-07-16T13:38:26.821 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: enable_index_compression: 1 2020-07-16T13:38:26.821 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: block_align: 0 2020-07-16T13:38:26.821 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.write_buffer_size: 33554432 2020-07-16T13:38:26.821 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.max_write_buffer_number: 2 2020-07-16T13:38:26.821 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.compression: NoCompression 2020-07-16T13:38:26.822 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.bottommost_compression: Disabled 2020-07-16T13:38:26.822 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.prefix_extractor: nullptr 2020-07-16T13:38:26.822 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2020-07-16T13:38:26.822 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.num_levels: 7 2020-07-16T13:38:26.823 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2020-07-16T13:38:26.823 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2020-07-16T13:38:26.823 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2020-07-16T13:38:26.823 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2020-07-16T13:38:26.823 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2020-07-16T13:38:26.824 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2020-07-16T13:38:26.824 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2020-07-16T13:38:26.824 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2020-07-16T13:38:26.824 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2020-07-16T13:38:26.824 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.compression_opts.window_bits: -14 2020-07-16T13:38:26.825 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.compression_opts.level: 32767 2020-07-16T13:38:26.825 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.compression_opts.strategy: 0 2020-07-16T13:38:26.825 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2020-07-16T13:38:26.825 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2020-07-16T13:38:26.825 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.compression_opts.enabled: false 2020-07-16T13:38:26.825 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2020-07-16T13:38:26.826 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2020-07-16T13:38:26.826 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2020-07-16T13:38:26.826 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.target_file_size_base: 67108864 2020-07-16T13:38:26.826 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.target_file_size_multiplier: 1 2020-07-16T13:38:26.826 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2020-07-16T13:38:26.827 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2020-07-16T13:38:26.827 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2020-07-16T13:38:26.827 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2020-07-16T13:38:26.827 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2020-07-16T13:38:26.827 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2020-07-16T13:38:26.828 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2020-07-16T13:38:26.828 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2020-07-16T13:38:26.828 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2020-07-16T13:38:26.828 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2020-07-16T13:38:26.828 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2020-07-16T13:38:26.828 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2020-07-16T13:38:26.829 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.arena_block_size: 4194304 2020-07-16T13:38:26.829 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2020-07-16T13:38:26.829 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2020-07-16T13:38:26.829 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2020-07-16T13:38:26.829 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.disable_auto_compactions: 0 2020-07-16T13:38:26.830 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2020-07-16T13:38:26.830 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2020-07-16T13:38:26.830 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2020-07-16T13:38:26.830 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2020-07-16T13:38:26.830 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2020-07-16T13:38:26.831 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2020-07-16T13:38:26.831 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2020-07-16T13:38:26.831 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2020-07-16T13:38:26.831 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2020-07-16T13:38:26.831 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2020-07-16T13:38:26.831 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.table_properties_collectors: 2020-07-16T13:38:26.832 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.inplace_update_support: 0 2020-07-16T13:38:26.832 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.inplace_update_num_locks: 10000 2020-07-16T13:38:26.832 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2020-07-16T13:38:26.832 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2020-07-16T13:38:26.832 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.memtable_huge_page_size: 0 2020-07-16T13:38:26.833 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.bloom_locality: 0 2020-07-16T13:38:26.833 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.max_successive_merges: 0 2020-07-16T13:38:26.833 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.optimize_filters_for_hits: 0 2020-07-16T13:38:26.833 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.paranoid_file_checks: 0 2020-07-16T13:38:26.833 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.force_consistency_checks: 0 2020-07-16T13:38:26.834 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.report_bg_io_stats: 0 2020-07-16T13:38:26.834 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.ttl: 2592000 2020-07-16T13:38:26.834 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: Options.periodic_compaction_seconds: 0 2020-07-16T13:38:26.834 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000028 succeeded,manifest_file_number is 28, next_file_number is 34, last_sequence is 6827, log_number is 27,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2020-07-16T13:38:26.834 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 27 2020-07-16T13:38:26.835 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1594906706559787, "job": 1, "event": "recovery_started", "log_files": [29]} 2020-07-16T13:38:26.835 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #29 mode 2 2020-07-16T13:38:26.835 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.558+0000 7fde86f6a700 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2020-07-16T13:38:26.835 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.559+0000 7fde86f6a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1594906706560320, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 34, "file_size": 10094, "table_properties": {"data_size": 9149, "index_size": 70, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 69, "raw_key_size": 342, "raw_average_key_size": 24, "raw_value_size": 8817, "raw_average_value_size": 629, "num_data_blocks": 2, "num_entries": 14, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1594906706, "oldest_key_time": 3, "file_creation_time": 0}} 2020-07-16T13:38:26.835 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.559+0000 7fde86f6a700 4 rocksdb: [version_set.cc:3826] Creating manifest 35 2020-07-16T13:38:26.835 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.559+0000 7fde86f6a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1594906706560769, "job": 1, "event": "recovery_finished"} 2020-07-16T13:38:26.836 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.560+0000 7fde86f6a700 4 rocksdb: DB pointer 0x55a3504cd800 2020-07-16T13:38:26.836 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.560+0000 7fde6ddb0700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2020-07-16T13:38:26.836 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.560+0000 7fde6ddb0700 4 rocksdb: [db_impl/db_impl.cc:851] 2020-07-16T13:38:26.836 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: ** DB Stats ** 2020-07-16T13:38:26.836 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: Uptime(secs): 0.0 total, 0.0 interval 2020-07-16T13:38:26.837 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2020-07-16T13:38:26.837 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2020-07-16T13:38:26.837 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2020-07-16T13:38:26.837 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2020-07-16T13:38:26.837 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2020-07-16T13:38:26.838 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2020-07-16T13:38:26.838 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: ** Compaction Stats [default] ** 2020-07-16T13:38:26.838 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2020-07-16T13:38:26.838 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2020-07-16T13:38:26.838 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: L0 1/0 9.86 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 22.5 0.00 0.00 1 0.000 0 0 2020-07-16T13:38:26.839 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: L6 1/0 61.00 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2020-07-16T13:38:26.839 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: Sum 2/0 61.01 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 22.5 0.00 0.00 1 0.000 0 0 2020-07-16T13:38:26.839 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 22.5 0.00 0.00 1 0.000 0 0 2020-07-16T13:38:26.840 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: ** Compaction Stats [default] ** 2020-07-16T13:38:26.840 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2020-07-16T13:38:26.840 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2020-07-16T13:38:26.840 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 22.5 0.00 0.00 1 0.000 0 0 2020-07-16T13:38:26.840 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: Uptime(secs): 0.0 total, 0.0 interval 2020-07-16T13:38:26.840 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: Flush(GB): cumulative 0.000, interval 0.000 2020-07-16T13:38:26.841 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: AddFile(GB): cumulative 0.000, interval 0.000 2020-07-16T13:38:26.841 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: AddFile(Total Files): cumulative 0, interval 0 2020-07-16T13:38:26.841 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: AddFile(L0 Files): cumulative 0, interval 0 2020-07-16T13:38:26.841 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: AddFile(Keys): cumulative 0, interval 0 2020-07-16T13:38:26.841 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: Cumulative compaction: 0.00 GB write, 3.99 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2020-07-16T13:38:26.842 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: Interval compaction: 0.00 GB write, 3.99 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2020-07-16T13:38:26.843 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2020-07-16T13:38:26.843 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: ** File Read Latency Histogram By Level [default] ** 2020-07-16T13:38:26.843 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: ** Compaction Stats [default] ** 2020-07-16T13:38:26.843 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2020-07-16T13:38:26.844 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2020-07-16T13:38:26.844 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: L0 1/0 9.86 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 22.5 0.00 0.00 1 0.000 0 0 2020-07-16T13:38:26.844 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: L6 1/0 61.00 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2020-07-16T13:38:26.844 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: Sum 2/0 61.01 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 22.5 0.00 0.00 1 0.000 0 0 2020-07-16T13:38:26.844 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2020-07-16T13:38:26.845 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: ** Compaction Stats [default] ** 2020-07-16T13:38:26.845 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2020-07-16T13:38:26.845 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2020-07-16T13:38:26.845 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 22.5 0.00 0.00 1 0.000 0 0 2020-07-16T13:38:26.845 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: Uptime(secs): 0.0 total, 0.0 interval 2020-07-16T13:38:26.846 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: Flush(GB): cumulative 0.000, interval 0.000 2020-07-16T13:38:26.846 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: AddFile(GB): cumulative 0.000, interval 0.000 2020-07-16T13:38:26.846 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: AddFile(Total Files): cumulative 0, interval 0 2020-07-16T13:38:26.846 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: AddFile(L0 Files): cumulative 0, interval 0 2020-07-16T13:38:26.846 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: AddFile(Keys): cumulative 0, interval 0 2020-07-16T13:38:26.846 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: Cumulative compaction: 0.00 GB write, 3.94 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2020-07-16T13:38:26.847 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2020-07-16T13:38:26.847 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2020-07-16T13:38:26.847 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: ** File Read Latency Histogram By Level [default] ** 2020-07-16T13:38:26.847 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.561+0000 7fde86f6a700 0 starting mon.a rank 0 at public addrs [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] at bind addrs [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 4c8ed362-c768-11ea-a06f-001a4aab830c 2020-07-16T13:38:26.847 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.562+0000 7fde86f6a700 1 mon.a@-1(???) e3 preinit fsid 4c8ed362-c768-11ea-a06f-001a4aab830c 2020-07-16T13:38:26.848 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.562+0000 7fde86f6a700 0 mon.a@-1(???).mds e1 new map 2020-07-16T13:38:26.848 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.562+0000 7fde86f6a700 0 mon.a@-1(???).mds e1 print_map 2020-07-16T13:38:26.848 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: e1 2020-07-16T13:38:26.848 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: enable_multiple, ever_enabled_multiple: 0,0 2020-07-16T13:38:26.848 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2020-07-16T13:38:26.849 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: legacy client fscid: -1 2020-07-16T13:38:26.849 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 2020-07-16T13:38:26.849 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: No filesystems configured 2020-07-16T13:38:26.850 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.562+0000 7fde86f6a700 0 mon.a@-1(???).osd e53 crush map has features 288514051259236352, adjusting msgr requires 2020-07-16T13:38:26.850 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.562+0000 7fde86f6a700 0 mon.a@-1(???).osd e53 crush map has features 3314933000852226048, adjusting msgr requires 2020-07-16T13:38:26.850 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.562+0000 7fde86f6a700 0 mon.a@-1(???).osd e53 crush map has features 288514051259236352, adjusting msgr requires 2020-07-16T13:38:26.851 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: audit 2020-07-16T13:37:36.508751+0000 mon.b (mon.2) 108 : audit [INF] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632944\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632975\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633004\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633155\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633259\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633374\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633475\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633508\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:38:26.851 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: cluster 2020-07-16T13:37:37.211734+0000 mon.a (mon.0) 1 : cluster [INF] mon.a calling monitor election 2020-07-16T13:38:26.851 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: cluster 2020-07-16T13:37:37.213663+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2020-07-16T13:38:26.852 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: audit 2020-07-16T13:37:37.216962+0000 mon.a (mon.0) 3 : audit [INF] from='mgr.34499 ' entity='' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632944\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632975\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633004\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633155\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633259\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633374\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633475\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633508\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:38:26.852 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: cluster 2020-07-16T13:37:37.218621+0000 mon.a (mon.0) 4 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0],b=[v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0],c=[v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0]} 2020-07-16T13:38:26.853 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: cluster 2020-07-16T13:37:37.218663+0000 mon.a (mon.0) 5 : cluster [DBG] fsmap 2020-07-16T13:38:26.853 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: cluster 2020-07-16T13:37:37.218692+0000 mon.a (mon.0) 6 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2020-07-16T13:38:26.853 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: cluster 2020-07-16T13:37:37.219387+0000 mon.a (mon.0) 7 : cluster [DBG] mgrmap e20: x(active, since 36s), standbys: y 2020-07-16T13:38:26.854 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: audit 2020-07-16T13:37:37.221847+0000 mon.a (mon.0) 8 : audit [INF] from='mgr.34499 ' entity='' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632944\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.632975\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633004\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633155\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633259\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633374\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633475\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:37:32.633508\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:38:26.854 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: audit 2020-07-16T13:37:37.224012+0000 mon.b (mon.2) 109 : audit [DBG] from='mgr.34499 172.21.15.188:0/2830501755' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:38:26.854 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: cluster 2020-07-16T13:37:37.225743+0000 mon.a (mon.0) 9 : cluster [DBG] mgrmap e21: x(active, since 36s), standbys: y 2020-07-16T13:38:26.855 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: cluster 2020-07-16T13:37:37.225773+0000 mon.a (mon.0) 10 : cluster [INF] overall HEALTH_OK 2020-07-16T13:38:26.855 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.563+0000 7fde86f6a700 1 mon.a@-1(???).paxosservice(auth 1..19) refresh upgraded, format 0 -> 3 2020-07-16T13:38:26.855 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.565+0000 7fde86f6a700 20 expand_channel_meta expand map: {default=false} 2020-07-16T13:38:26.856 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.565+0000 7fde86f6a700 20 expand_channel_meta from 'false' to 'false' 2020-07-16T13:38:26.856 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.565+0000 7fde86f6a700 20 expand_channel_meta expanded map: {default=false} 2020-07-16T13:38:26.856 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.565+0000 7fde86f6a700 20 expand_channel_meta expand map: {default=info} 2020-07-16T13:38:26.857 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.565+0000 7fde86f6a700 20 expand_channel_meta from 'info' to 'info' 2020-07-16T13:38:26.857 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.565+0000 7fde86f6a700 20 expand_channel_meta expanded map: {default=info} 2020-07-16T13:38:26.857 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.565+0000 7fde86f6a700 20 expand_channel_meta expand map: {default=daemon} 2020-07-16T13:38:26.858 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.565+0000 7fde86f6a700 20 expand_channel_meta from 'daemon' to 'daemon' 2020-07-16T13:38:26.858 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.565+0000 7fde86f6a700 20 expand_channel_meta expanded map: {default=daemon} 2020-07-16T13:38:26.858 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.565+0000 7fde86f6a700 20 expand_channel_meta expand map: {default=debug} 2020-07-16T13:38:26.859 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.565+0000 7fde86f6a700 20 expand_channel_meta from 'debug' to 'debug' 2020-07-16T13:38:26.859 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.565+0000 7fde86f6a700 20 expand_channel_meta expanded map: {default=debug} 2020-07-16T13:38:27.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.0.0-3349-g7260671e53b/rpm/el8/BUILD/ceph-16.0.0-3349-g7260671e53b/src/mon/OSDMonitor.cc: In function 'virtual void OSDMonitor::encode_pending(MonitorDBStore::TransactionRef)' thread 7fde6edb2700 time 2020-07-16T13:38:26.786776+0000 2020-07-16T13:38:27.280 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.0.0-3349-g7260671e53b/rpm/el8/BUILD/ceph-16.0.0-3349-g7260671e53b/src/mon/OSDMonitor.cc: 2023: FAILED ceph_assert((features & ~mon->get_quorum_con_features()) == 0) 2020-07-16T13:38:27.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev) 2020-07-16T13:38:27.281 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7fde7e120b96] 2020-07-16T13:38:27.284 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 2: (()+0x275db0) [0x7fde7e120db0] 2020-07-16T13:38:27.285 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 3: (OSDMonitor::encode_pending(std::shared_ptr)+0x6738) [0x55a34e5896d8] 2020-07-16T13:38:27.285 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 4: (PaxosService::propose_pending()+0x21a) [0x55a34e4f999a] 2020-07-16T13:38:27.285 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 5: (MgrMonitor::drop_active()+0x346) [0x55a34e5edce6] 2020-07-16T13:38:27.286 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 6: (MgrMonitor::prepare_beacon(boost::intrusive_ptr)+0x1e27) [0x55a34e5efe97] 2020-07-16T13:38:27.286 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 7: (MgrMonitor::prepare_update(boost::intrusive_ptr)+0x5b) [0x55a34e5f42db] 2020-07-16T13:38:27.286 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 8: (PaxosService::dispatch(boost::intrusive_ptr)+0xa6d) [0x55a34e4fa84d] 2020-07-16T13:38:27.287 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 9: (PaxosService::C_RetryMessage::_finish(int)+0x64) [0x55a34e457754] 2020-07-16T13:38:27.287 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 10: (C_MonOp::finish(int)+0x49) [0x55a34e3f7089] 2020-07-16T13:38:27.287 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 11: (Context::complete(int)+0xd) [0x55a34e3f42ad] 2020-07-16T13:38:27.288 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 12: (void finish_contexts > >(ceph::common::CephContext*, std::__cxx11::list >&, int)+0xa5) [0x55a34e41dae5] 2020-07-16T13:38:27.288 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 13: (Paxos::finish_round()+0x27b) [0x55a34e4f11ab] 2020-07-16T13:38:27.288 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 14: (Paxos::commit_finish()+0x91c) [0x55a34e4f3c1c] 2020-07-16T13:38:27.288 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 15: (C_Committed::finish(int)+0x45) [0x55a34e4f8055] 2020-07-16T13:38:27.289 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 16: (Context::complete(int)+0xd) [0x55a34e3f42ad] 2020-07-16T13:38:27.289 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 17: (MonitorDBStore::C_DoTransaction::finish(int)+0x98) [0x55a34e4f7d78] 2020-07-16T13:38:27.289 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 18: (Context::complete(int)+0xd) [0x55a34e3f42ad] 2020-07-16T13:38:27.289 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 19: (Finisher::finisher_thread_entry()+0x1a5) [0x7fde7e1bd2c5] 2020-07-16T13:38:27.296 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 20: (()+0x82de) [0x7fde7bc1b2de] 2020-07-16T13:38:27.296 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 21: (clone()+0x43) [0x7fde7a952e83] 2020-07-16T13:38:27.296 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.788+0000 7fde6edb2700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.0.0-3349-g7260671e53b/rpm/el8/BUILD/ceph-16.0.0-3349-g7260671e53b/src/mon/OSDMonitor.cc: In function 'virtual void OSDMonitor::encode_pending(MonitorDBStore::TransactionRef)' thread 7fde6edb2700 time 2020-07-16T13:38:26.786776+0000 2020-07-16T13:38:27.297 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.0.0-3349-g7260671e53b/rpm/el8/BUILD/ceph-16.0.0-3349-g7260671e53b/src/mon/OSDMonitor.cc: 2023: FAILED ceph_assert((features & ~mon->get_quorum_con_features()) == 0) 2020-07-16T13:38:27.297 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev) 2020-07-16T13:38:27.297 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7fde7e120b96] 2020-07-16T13:38:27.298 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 2: (()+0x275db0) [0x7fde7e120db0] 2020-07-16T13:38:27.298 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 3: (OSDMonitor::encode_pending(std::shared_ptr)+0x6738) [0x55a34e5896d8] 2020-07-16T13:38:27.298 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 4: (PaxosService::propose_pending()+0x21a) [0x55a34e4f999a] 2020-07-16T13:38:27.299 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 5: (MgrMonitor::drop_active()+0x346) [0x55a34e5edce6] 2020-07-16T13:38:27.299 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 6: (MgrMonitor::prepare_beacon(boost::intrusive_ptr)+0x1e27) [0x55a34e5efe97] 2020-07-16T13:38:27.299 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 7: (MgrMonitor::prepare_update(boost::intrusive_ptr)+0x5b) [0x55a34e5f42db] 2020-07-16T13:38:27.300 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 8: (PaxosService::dispatch(boost::intrusive_ptr)+0xa6d) [0x55a34e4fa84d] 2020-07-16T13:38:27.300 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 9: (PaxosService::C_RetryMessage::_finish(int)+0x64) [0x55a34e457754] 2020-07-16T13:38:27.300 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 10: (C_MonOp::finish(int)+0x49) [0x55a34e3f7089] 2020-07-16T13:38:27.302 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 11: (Context::complete(int)+0xd) [0x55a34e3f42ad] 2020-07-16T13:38:27.302 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 12: (void finish_contexts > >(ceph::common::CephContext*, std::__cxx11::list >&, int)+0xa5) [0x55a34e41dae5] 2020-07-16T13:38:27.303 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 13: (Paxos::finish_round()+0x27b) [0x55a34e4f11ab] 2020-07-16T13:38:27.303 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 14: (Paxos::commit_finish()+0x91c) [0x55a34e4f3c1c] 2020-07-16T13:38:27.303 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 15: (C_Committed::finish(int)+0x45) [0x55a34e4f8055] 2020-07-16T13:38:27.304 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 16: (Context::complete(int)+0xd) [0x55a34e3f42ad] 2020-07-16T13:38:27.304 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 17: (MonitorDBStore::C_DoTransaction::finish(int)+0x98) [0x55a34e4f7d78] 2020-07-16T13:38:27.304 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 18: (Context::complete(int)+0xd) [0x55a34e3f42ad] 2020-07-16T13:38:27.305 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 19: (Finisher::finisher_thread_entry()+0x1a5) [0x7fde7e1bd2c5] 2020-07-16T13:38:27.305 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 20: (()+0x82de) [0x7fde7bc1b2de] 2020-07-16T13:38:27.305 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 21: (clone()+0x43) [0x7fde7a952e83] 2020-07-16T13:38:27.306 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: *** Caught signal (Aborted) ** 2020-07-16T13:38:27.307 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: in thread 7fde6edb2700 thread_name:fn_monstore 2020-07-16T13:38:27.308 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev) 2020-07-16T13:38:27.308 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 1: (()+0x12dd0) [0x7fde7bc25dd0] 2020-07-16T13:38:27.308 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 2: (gsignal()+0x10f) [0x7fde7a88e70f] 2020-07-16T13:38:27.309 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 3: (abort()+0x127) [0x7fde7a878b25] 2020-07-16T13:38:27.309 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a9) [0x7fde7e120be7] 2020-07-16T13:38:27.309 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 5: (()+0x275db0) [0x7fde7e120db0] 2020-07-16T13:38:27.310 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 6: (OSDMonitor::encode_pending(std::shared_ptr)+0x6738) [0x55a34e5896d8] 2020-07-16T13:38:27.310 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 7: (PaxosService::propose_pending()+0x21a) [0x55a34e4f999a] 2020-07-16T13:38:27.311 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 8: (MgrMonitor::drop_active()+0x346) [0x55a34e5edce6] 2020-07-16T13:38:27.311 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 9: (MgrMonitor::prepare_beacon(boost::intrusive_ptr)+0x1e27) [0x55a34e5efe97] 2020-07-16T13:38:27.312 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 10: (MgrMonitor::prepare_update(boost::intrusive_ptr)+0x5b) [0x55a34e5f42db] 2020-07-16T13:38:27.312 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 11: (PaxosService::dispatch(boost::intrusive_ptr)+0xa6d) [0x55a34e4fa84d] 2020-07-16T13:38:27.312 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 12: (PaxosService::C_RetryMessage::_finish(int)+0x64) [0x55a34e457754] 2020-07-16T13:38:27.313 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 13: (C_MonOp::finish(int)+0x49) [0x55a34e3f7089] 2020-07-16T13:38:27.313 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 14: (Context::complete(int)+0xd) [0x55a34e3f42ad] 2020-07-16T13:38:27.313 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 15: (void finish_contexts > >(ceph::common::CephContext*, std::__cxx11::list >&, int)+0xa5) [0x55a34e41dae5] 2020-07-16T13:38:27.314 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 16: (Paxos::finish_round()+0x27b) [0x55a34e4f11ab] 2020-07-16T13:38:27.314 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 17: (Paxos::commit_finish()+0x91c) [0x55a34e4f3c1c] 2020-07-16T13:38:27.314 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 18: (C_Committed::finish(int)+0x45) [0x55a34e4f8055] 2020-07-16T13:38:27.315 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 19: (Context::complete(int)+0xd) [0x55a34e3f42ad] 2020-07-16T13:38:27.315 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 20: (MonitorDBStore::C_DoTransaction::finish(int)+0x98) [0x55a34e4f7d78] 2020-07-16T13:38:27.315 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 21: (Context::complete(int)+0xd) [0x55a34e3f42ad] 2020-07-16T13:38:27.316 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 22: (Finisher::finisher_thread_entry()+0x1a5) [0x7fde7e1bd2c5] 2020-07-16T13:38:27.316 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 23: (()+0x82de) [0x7fde7bc1b2de] 2020-07-16T13:38:27.316 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 24: (clone()+0x43) [0x7fde7a952e83] 2020-07-16T13:38:27.317 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 2020-07-16T13:38:26.791+0000 7fde6edb2700 -1 *** Caught signal (Aborted) ** 2020-07-16T13:38:27.317 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: in thread 7fde6edb2700 thread_name:fn_monstore 2020-07-16T13:38:27.318 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev) 2020-07-16T13:38:27.318 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 1: (()+0x12dd0) [0x7fde7bc25dd0] 2020-07-16T13:38:27.318 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 2: (gsignal()+0x10f) [0x7fde7a88e70f] 2020-07-16T13:38:27.319 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 3: (abort()+0x127) [0x7fde7a878b25] 2020-07-16T13:38:27.319 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a9) [0x7fde7e120be7] 2020-07-16T13:38:27.319 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 5: (()+0x275db0) [0x7fde7e120db0] 2020-07-16T13:38:27.320 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 6: (OSDMonitor::encode_pending(std::shared_ptr)+0x6738) [0x55a34e5896d8] 2020-07-16T13:38:27.320 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 7: (PaxosService::propose_pending()+0x21a) [0x55a34e4f999a] 2020-07-16T13:38:27.320 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 8: (MgrMonitor::drop_active()+0x346) [0x55a34e5edce6] 2020-07-16T13:38:27.321 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 9: (MgrMonitor::prepare_beacon(boost::intrusive_ptr)+0x1e27) [0x55a34e5efe97] 2020-07-16T13:38:27.321 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 10: (MgrMonitor::prepare_update(boost::intrusive_ptr)+0x5b) [0x55a34e5f42db] 2020-07-16T13:38:27.321 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 11: (PaxosService::dispatch(boost::intrusive_ptr)+0xa6d) [0x55a34e4fa84d] 2020-07-16T13:38:27.322 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 12: (PaxosService::C_RetryMessage::_finish(int)+0x64) [0x55a34e457754] 2020-07-16T13:38:27.322 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 13: (C_MonOp::finish(int)+0x49) [0x55a34e3f7089] 2020-07-16T13:38:27.322 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 14: (Context::complete(int)+0xd) [0x55a34e3f42ad] 2020-07-16T13:38:27.322 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 15: (void finish_contexts > >(ceph::common::CephContext*, std::__cxx11::list >&, int)+0xa5) [0x55a34e41dae5] 2020-07-16T13:38:27.323 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 16: (Paxos::finish_round()+0x27b) [0x55a34e4f11ab] 2020-07-16T13:38:27.323 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 17: (Paxos::commit_finish()+0x91c) [0x55a34e4f3c1c] 2020-07-16T13:38:27.323 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 18: (C_Committed::finish(int)+0x45) [0x55a34e4f8055] 2020-07-16T13:38:27.324 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 19: (Context::complete(int)+0xd) [0x55a34e3f42ad] 2020-07-16T13:38:27.324 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 20: (MonitorDBStore::C_DoTransaction::finish(int)+0x98) [0x55a34e4f7d78] 2020-07-16T13:38:27.324 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 21: (Context::complete(int)+0xd) [0x55a34e3f42ad] 2020-07-16T13:38:27.325 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 22: (Finisher::finisher_thread_entry()+0x1a5) [0x7fde7e1bd2c5] 2020-07-16T13:38:27.325 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 23: (()+0x82de) [0x7fde7bc1b2de] 2020-07-16T13:38:27.325 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 24: (clone()+0x43) [0x7fde7a952e83] 2020-07-16T13:38:27.326 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-07-16T13:38:27.326 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug -1> 2020-07-16T13:38:26.788+0000 7fde6edb2700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.0.0-3349-g7260671e53b/rpm/el8/BUILD/ceph-16.0.0-3349-g7260671e53b/src/mon/OSDMonitor.cc: In function 'virtual void OSDMonitor::encode_pending(MonitorDBStore::TransactionRef)' thread 7fde6edb2700 time 2020-07-16T13:38:26.786776+0000 2020-07-16T13:38:27.326 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.0.0-3349-g7260671e53b/rpm/el8/BUILD/ceph-16.0.0-3349-g7260671e53b/src/mon/OSDMonitor.cc: 2023: FAILED ceph_assert((features & ~mon->get_quorum_con_features()) == 0) 2020-07-16T13:38:27.327 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev) 2020-07-16T13:38:27.327 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7fde7e120b96] 2020-07-16T13:38:27.327 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 2: (()+0x275db0) [0x7fde7e120db0] 2020-07-16T13:38:27.328 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 3: (OSDMonitor::encode_pending(std::shared_ptr)+0x6738) [0x55a34e5896d8] 2020-07-16T13:38:27.328 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 4: (PaxosService::propose_pending()+0x21a) [0x55a34e4f999a] 2020-07-16T13:38:27.328 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 5: (MgrMonitor::drop_active()+0x346) [0x55a34e5edce6] 2020-07-16T13:38:27.329 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 6: (MgrMonitor::prepare_beacon(boost::intrusive_ptr)+0x1e27) [0x55a34e5efe97] 2020-07-16T13:38:27.329 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 7: (MgrMonitor::prepare_update(boost::intrusive_ptr)+0x5b) [0x55a34e5f42db] 2020-07-16T13:38:27.329 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 8: (PaxosService::dispatch(boost::intrusive_ptr)+0xa6d) [0x55a34e4fa84d] 2020-07-16T13:38:27.330 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 9: (PaxosService::C_RetryMessage::_finish(int)+0x64) [0x55a34e457754] 2020-07-16T13:38:27.330 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 10: (C_MonOp::finish(int)+0x49) [0x55a34e3f7089] 2020-07-16T13:38:27.330 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 11: (Context::complete(int)+0xd) [0x55a34e3f42ad] 2020-07-16T13:38:27.331 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 12: (void finish_contexts > >(ceph::common::CephContext*, std::__cxx11::list >&, int)+0xa5) [0x55a34e41dae5] 2020-07-16T13:38:27.331 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 13: (Paxos::finish_round()+0x27b) [0x55a34e4f11ab] 2020-07-16T13:38:27.331 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 14: (Paxos::commit_finish()+0x91c) [0x55a34e4f3c1c] 2020-07-16T13:38:27.331 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 15: (C_Committed::finish(int)+0x45) [0x55a34e4f8055] 2020-07-16T13:38:27.332 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 16: (Context::complete(int)+0xd) [0x55a34e3f42ad] 2020-07-16T13:38:27.332 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 17: (MonitorDBStore::C_DoTransaction::finish(int)+0x98) [0x55a34e4f7d78] 2020-07-16T13:38:27.332 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 18: (Context::complete(int)+0xd) [0x55a34e3f42ad] 2020-07-16T13:38:27.333 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 19: (Finisher::finisher_thread_entry()+0x1a5) [0x7fde7e1bd2c5] 2020-07-16T13:38:27.333 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 20: (()+0x82de) [0x7fde7bc1b2de] 2020-07-16T13:38:27.333 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 21: (clone()+0x43) [0x7fde7a952e83] 2020-07-16T13:38:27.334 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 0> 2020-07-16T13:38:26.791+0000 7fde6edb2700 -1 *** Caught signal (Aborted) ** 2020-07-16T13:38:27.334 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: in thread 7fde6edb2700 thread_name:fn_monstore 2020-07-16T13:38:27.334 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev) 2020-07-16T13:38:27.335 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 1: (()+0x12dd0) [0x7fde7bc25dd0] 2020-07-16T13:38:27.335 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 2: (gsignal()+0x10f) [0x7fde7a88e70f] 2020-07-16T13:38:27.335 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 3: (abort()+0x127) [0x7fde7a878b25] 2020-07-16T13:38:27.336 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a9) [0x7fde7e120be7] 2020-07-16T13:38:27.336 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 5: (()+0x275db0) [0x7fde7e120db0] 2020-07-16T13:38:27.336 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 6: (OSDMonitor::encode_pending(std::shared_ptr)+0x6738) [0x55a34e5896d8] 2020-07-16T13:38:27.337 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 7: (PaxosService::propose_pending()+0x21a) [0x55a34e4f999a] 2020-07-16T13:38:27.337 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 8: (MgrMonitor::drop_active()+0x346) [0x55a34e5edce6] 2020-07-16T13:38:27.337 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 9: (MgrMonitor::prepare_beacon(boost::intrusive_ptr)+0x1e27) [0x55a34e5efe97] 2020-07-16T13:38:27.338 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 10: (MgrMonitor::prepare_update(boost::intrusive_ptr)+0x5b) [0x55a34e5f42db] 2020-07-16T13:38:27.338 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 11: (PaxosService::dispatch(boost::intrusive_ptr)+0xa6d) [0x55a34e4fa84d] 2020-07-16T13:38:27.348 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 12: (PaxosService::C_RetryMessage::_finish(int)+0x64) [0x55a34e457754] 2020-07-16T13:38:27.348 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 13: (C_MonOp::finish(int)+0x49) [0x55a34e3f7089] 2020-07-16T13:38:27.349 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 14: (Context::complete(int)+0xd) [0x55a34e3f42ad] 2020-07-16T13:38:27.349 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 15: (void finish_contexts > >(ceph::common::CephContext*, std::__cxx11::list >&, int)+0xa5) [0x55a34e41dae5] 2020-07-16T13:38:27.351 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 16: (Paxos::finish_round()+0x27b) [0x55a34e4f11ab] 2020-07-16T13:38:27.351 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 17: (Paxos::commit_finish()+0x91c) [0x55a34e4f3c1c] 2020-07-16T13:38:27.352 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 18: (C_Committed::finish(int)+0x45) [0x55a34e4f8055] 2020-07-16T13:38:27.352 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 19: (Context::complete(int)+0xd) [0x55a34e3f42ad] 2020-07-16T13:38:27.353 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 20: (MonitorDBStore::C_DoTransaction::finish(int)+0x98) [0x55a34e4f7d78] 2020-07-16T13:38:27.354 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 21: (Context::complete(int)+0xd) [0x55a34e3f42ad] 2020-07-16T13:38:27.354 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 22: (Finisher::finisher_thread_entry()+0x1a5) [0x7fde7e1bd2c5] 2020-07-16T13:38:27.354 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 23: (()+0x82de) [0x7fde7bc1b2de] 2020-07-16T13:38:27.355 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 24: (clone()+0x43) [0x7fde7a952e83] 2020-07-16T13:38:27.355 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-07-16T13:38:27.355 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug -1> 2020-07-16T13:38:26.788+0000 7fde6edb2700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.0.0-3349-g7260671e53b/rpm/el8/BUILD/ceph-16.0.0-3349-g7260671e53b/src/mon/OSDMonitor.cc: In function 'virtual void OSDMonitor::encode_pending(MonitorDBStore::TransactionRef)' thread 7fde6edb2700 time 2020-07-16T13:38:26.786776+0000 2020-07-16T13:38:27.356 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.0.0-3349-g7260671e53b/rpm/el8/BUILD/ceph-16.0.0-3349-g7260671e53b/src/mon/OSDMonitor.cc: 2023: FAILED ceph_assert((features & ~mon->get_quorum_con_features()) == 0) 2020-07-16T13:38:27.356 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev) 2020-07-16T13:38:27.356 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7fde7e120b96] 2020-07-16T13:38:27.357 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 2: (()+0x275db0) [0x7fde7e120db0] 2020-07-16T13:38:27.357 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 3: (OSDMonitor::encode_pending(std::shared_ptr)+0x6738) [0x55a34e5896d8] 2020-07-16T13:38:27.357 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 4: (PaxosService::propose_pending()+0x21a) [0x55a34e4f999a] 2020-07-16T13:38:27.358 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 5: (MgrMonitor::drop_active()+0x346) [0x55a34e5edce6] 2020-07-16T13:38:27.358 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 6: (MgrMonitor::prepare_beacon(boost::intrusive_ptr)+0x1e27) [0x55a34e5efe97] 2020-07-16T13:38:27.358 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 7: (MgrMonitor::prepare_update(boost::intrusive_ptr)+0x5b) [0x55a34e5f42db] 2020-07-16T13:38:27.358 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 8: (PaxosService::dispatch(boost::intrusive_ptr)+0xa6d) [0x55a34e4fa84d] 2020-07-16T13:38:27.359 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 9: (PaxosService::C_RetryMessage::_finish(int)+0x64) [0x55a34e457754] 2020-07-16T13:38:27.359 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 10: (C_MonOp::finish(int)+0x49) [0x55a34e3f7089] 2020-07-16T13:38:27.359 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 11: (Context::complete(int)+0xd) [0x55a34e3f42ad] 2020-07-16T13:38:27.360 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 12: (void finish_contexts > >(ceph::common::CephContext*, std::__cxx11::list >&, int)+0xa5) [0x55a34e41dae5] 2020-07-16T13:38:27.360 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 13: (Paxos::finish_round()+0x27b) [0x55a34e4f11ab] 2020-07-16T13:38:27.360 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 14: (Paxos::commit_finish()+0x91c) [0x55a34e4f3c1c] 2020-07-16T13:38:27.361 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 15: (C_Committed::finish(int)+0x45) [0x55a34e4f8055] 2020-07-16T13:38:27.361 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 16: (Context::complete(int)+0xd) [0x55a34e3f42ad] 2020-07-16T13:38:27.361 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 17: (MonitorDBStore::C_DoTransaction::finish(int)+0x98) [0x55a34e4f7d78] 2020-07-16T13:38:27.362 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 18: (Context::complete(int)+0xd) [0x55a34e3f42ad] 2020-07-16T13:38:27.362 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 19: (Finisher::finisher_thread_entry()+0x1a5) [0x7fde7e1bd2c5] 2020-07-16T13:38:27.363 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 20: (()+0x82de) [0x7fde7bc1b2de] 2020-07-16T13:38:27.363 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 21: (clone()+0x43) [0x7fde7a952e83] 2020-07-16T13:38:27.363 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: debug 0> 2020-07-16T13:38:26.791+0000 7fde6edb2700 -1 *** Caught signal (Aborted) ** 2020-07-16T13:38:27.364 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: in thread 7fde6edb2700 thread_name:fn_monstore 2020-07-16T13:38:27.364 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev) 2020-07-16T13:38:27.364 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 1: (()+0x12dd0) [0x7fde7bc25dd0] 2020-07-16T13:38:27.365 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 2: (gsignal()+0x10f) [0x7fde7a88e70f] 2020-07-16T13:38:27.365 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 3: (abort()+0x127) [0x7fde7a878b25] 2020-07-16T13:38:27.365 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a9) [0x7fde7e120be7] 2020-07-16T13:38:27.366 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 5: (()+0x275db0) [0x7fde7e120db0] 2020-07-16T13:38:27.366 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 6: (OSDMonitor::encode_pending(std::shared_ptr)+0x6738) [0x55a34e5896d8] 2020-07-16T13:38:27.366 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 7: (PaxosService::propose_pending()+0x21a) [0x55a34e4f999a] 2020-07-16T13:38:27.367 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 8: (MgrMonitor::drop_active()+0x346) [0x55a34e5edce6] 2020-07-16T13:38:27.367 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 9: (MgrMonitor::prepare_beacon(boost::intrusive_ptr)+0x1e27) [0x55a34e5efe97] 2020-07-16T13:38:27.367 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 10: (MgrMonitor::prepare_update(boost::intrusive_ptr)+0x5b) [0x55a34e5f42db] 2020-07-16T13:38:27.368 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 11: (PaxosService::dispatch(boost::intrusive_ptr)+0xa6d) [0x55a34e4fa84d] 2020-07-16T13:38:27.368 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 12: (PaxosService::C_RetryMessage::_finish(int)+0x64) [0x55a34e457754] 2020-07-16T13:38:27.368 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 13: (C_MonOp::finish(int)+0x49) [0x55a34e3f7089] 2020-07-16T13:38:27.369 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 14: (Context::complete(int)+0xd) [0x55a34e3f42ad] 2020-07-16T13:38:27.369 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 15: (void finish_contexts > >(ceph::common::CephContext*, std::__cxx11::list >&, int)+0xa5) [0x55a34e41dae5] 2020-07-16T13:38:27.369 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 16: (Paxos::finish_round()+0x27b) [0x55a34e4f11ab] 2020-07-16T13:38:27.370 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 17: (Paxos::commit_finish()+0x91c) [0x55a34e4f3c1c] 2020-07-16T13:38:27.370 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 18: (C_Committed::finish(int)+0x45) [0x55a34e4f8055] 2020-07-16T13:38:27.370 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 19: (Context::complete(int)+0xd) [0x55a34e3f42ad] 2020-07-16T13:38:27.371 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 20: (MonitorDBStore::C_DoTransaction::finish(int)+0x98) [0x55a34e4f7d78] 2020-07-16T13:38:27.371 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 21: (Context::complete(int)+0xd) [0x55a34e3f42ad] 2020-07-16T13:38:27.371 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 22: (Finisher::finisher_thread_entry()+0x1a5) [0x7fde7e1bd2c5] 2020-07-16T13:38:27.372 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 23: (()+0x82de) [0x7fde7bc1b2de] 2020-07-16T13:38:27.372 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: 24: (clone()+0x43) [0x7fde7a952e83] 2020-07-16T13:38:27.372 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-07-16T13:38:27.372 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 bash[12043]: reraise_fatal: default handler for signal 6 didn't terminate the process? 2020-07-16T13:38:27.373 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:26 smithi132 podman[12074]: 2020-07-16 13:38:26.849291389 +0000 UTC m=+0.683487765 container died 65442099a0ae86b094f4175fa468de9f14b03cd4e8255a0716ca5042bbd0de39 (image=quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a) 2020-07-16T13:38:27.779 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:27 smithi132 podman[12074]: 2020-07-16 13:38:27.425247916 +0000 UTC m=+1.259444293 container remove 65442099a0ae86b094f4175fa468de9f14b03cd4e8255a0716ca5042bbd0de39 (image=quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca, name=ceph-4c8ed362-c768-11ea-a06f-001a4aab830c-mon.a) 2020-07-16T13:38:27.779 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:27 smithi132 systemd[1]: ceph-4c8ed362-c768-11ea-a06f-001a4aab830c@mon.a.service: Main process exited, code=exited, status=1/FAILURE 2020-07-16T13:38:27.779 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:27 smithi132 systemd[1]: ceph-4c8ed362-c768-11ea-a06f-001a4aab830c@mon.a.service: Failed with result 'exit-code'. 2020-07-16T13:38:29.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:28 smithi132 bash[27079]: debug 2020-07-16T13:38:28.925+0000 7ff2252a8700 -1 mon.c@1(peon) e3 get_health_metrics reporting 1 slow ops, oldest is log(1 entries from seq 28 at 2020-07-16T13:37:48.224646+0000) 2020-07-16T13:38:31.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:30 smithi188 bash[23329]: debug 2020-07-16T13:38:30.924+0000 7fe90d4b2700 -1 mon.b@2(peon) e3 get_health_metrics reporting 14 slow ops, oldest is log(1 entries from seq 110 at 2020-07-16T13:37:40.877704+0000) 2020-07-16T13:38:34.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:33 smithi132 bash[27079]: debug 2020-07-16T13:38:33.925+0000 7ff2252a8700 -1 mon.c@1(peon) e3 get_health_metrics reporting 2 slow ops, oldest is log(1 entries from seq 28 at 2020-07-16T13:37:48.224646+0000) 2020-07-16T13:38:36.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:35 smithi188 bash[23329]: debug 2020-07-16T13:38:35.924+0000 7fe90d4b2700 -1 mon.b@2(peon) e3 get_health_metrics reporting 21 slow ops, oldest is log(1 entries from seq 110 at 2020-07-16T13:37:40.877704+0000) 2020-07-16T13:38:38.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:37 smithi132 systemd[1]: ceph-4c8ed362-c768-11ea-a06f-001a4aab830c@mon.a.service: Service RestartSec=10s expired, scheduling restart. 2020-07-16T13:38:38.029 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:37 smithi132 systemd[1]: ceph-4c8ed362-c768-11ea-a06f-001a4aab830c@mon.a.service: Scheduled restart job, restart counter is at 5. 2020-07-16T13:38:38.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:37 smithi132 systemd[1]: Stopped Ceph mon.a for 4c8ed362-c768-11ea-a06f-001a4aab830c. 2020-07-16T13:38:38.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:37 smithi132 systemd[1]: ceph-4c8ed362-c768-11ea-a06f-001a4aab830c@mon.a.service: Start request repeated too quickly. 2020-07-16T13:38:38.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:37 smithi132 systemd[1]: ceph-4c8ed362-c768-11ea-a06f-001a4aab830c@mon.a.service: Failed with result 'exit-code'. 2020-07-16T13:38:38.030 INFO:journalctl@ceph.mon.a.smithi132.stdout:Jul 16 13:38:37 smithi132 systemd[1]: Failed to start Ceph mon.a for 4c8ed362-c768-11ea-a06f-001a4aab830c. 2020-07-16T13:38:39.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:38 smithi132 bash[27079]: debug 2020-07-16T13:38:38.925+0000 7ff2252a8700 -1 mon.c@1(electing) e3 get_health_metrics reporting 2 slow ops, oldest is log(1 entries from seq 28 at 2020-07-16T13:37:48.224646+0000) 2020-07-16T13:38:41.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:40 smithi188 bash[23329]: debug 2020-07-16T13:38:40.924+0000 7fe90d4b2700 -1 mon.b@2(electing) e3 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 110 at 2020-07-16T13:37:40.877704+0000) 2020-07-16T13:38:42.171 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Jul 16 13:38:41 smithi188 bash[3383]: ignoring --setuser ceph since I am not root 2020-07-16T13:38:42.171 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Jul 16 13:38:41 smithi188 bash[3383]: ignoring --setgroup ceph since I am not root 2020-07-16T13:38:42.171 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Jul 16 13:38:41 smithi188 bash[3383]: debug 2020-07-16T13:38:41.850+0000 7f8824bb1380 1 -- 172.21.15.188:0/3501700580 shutdown_connections 2020-07-16T13:38:42.171 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Jul 16 13:38:41 smithi188 bash[3383]: debug 2020-07-16T13:38:41.850+0000 7f8824bb1380 1 --2- 172.21.15.188:0/3501700580 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558ce10b5400 0x558ce1137e00 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-07-16T13:38:42.172 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Jul 16 13:38:41 smithi188 bash[3383]: debug 2020-07-16T13:38:41.850+0000 7f8824bb1380 1 --2- 172.21.15.188:0/3501700580 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558ce10b4c00 0x558ce1137400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-07-16T13:38:42.172 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Jul 16 13:38:41 smithi188 bash[3383]: debug 2020-07-16T13:38:41.850+0000 7f8824bb1380 1 --2- 172.21.15.188:0/3501700580 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x558ce10b5000 0x558ce1137900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-07-16T13:38:42.172 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Jul 16 13:38:41 smithi188 bash[3383]: debug 2020-07-16T13:38:41.850+0000 7f8824bb1380 1 -- 172.21.15.188:0/3501700580 >> 172.21.15.188:0/3501700580 conn(0x558ce10b4800 msgr2=0x558ce1d24800 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T13:38:42.172 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Jul 16 13:38:41 smithi188 bash[3383]: debug 2020-07-16T13:38:41.850+0000 7f8824bb1380 1 -- 172.21.15.188:0/3501700580 shutdown_connections 2020-07-16T13:38:42.173 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Jul 16 13:38:41 smithi188 bash[3383]: debug 2020-07-16T13:38:41.851+0000 7f8824bb1380 1 -- 172.21.15.188:0/3501700580 wait complete. 2020-07-16T13:38:42.279 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:38:41 smithi132 bash[10496]: ignoring --setuser ceph since I am not root 2020-07-16T13:38:42.279 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:38:41 smithi132 bash[10496]: ignoring --setgroup ceph since I am not root 2020-07-16T13:38:42.279 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:38:41 smithi132 bash[10496]: debug 2020-07-16T13:38:41.852+0000 7f0b0fee9380 1 -- 172.21.15.132:0/2177283929 shutdown_connections 2020-07-16T13:38:42.280 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:38:41 smithi132 bash[10496]: debug 2020-07-16T13:38:41.852+0000 7f0b0fee9380 1 --2- 172.21.15.132:0/2177283929 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x560c20819400 0x560c2089be00 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-07-16T13:38:42.280 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:38:41 smithi132 bash[10496]: debug 2020-07-16T13:38:41.852+0000 7f0b0fee9380 1 --2- 172.21.15.132:0/2177283929 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560c20818c00 0x560c2089b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-07-16T13:38:42.280 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:38:41 smithi132 bash[10496]: debug 2020-07-16T13:38:41.852+0000 7f0b0fee9380 1 --2- 172.21.15.132:0/2177283929 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560c20819000 0x560c2089b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-07-16T13:38:42.280 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:38:41 smithi132 bash[10496]: debug 2020-07-16T13:38:41.852+0000 7f0b0fee9380 1 -- 172.21.15.132:0/2177283929 >> 172.21.15.132:0/2177283929 conn(0x560c20818800 msgr2=0x560c21488800 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T13:38:42.280 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:38:41 smithi132 bash[10496]: debug 2020-07-16T13:38:41.853+0000 7f0b0fee9380 1 -- 172.21.15.132:0/2177283929 shutdown_connections 2020-07-16T13:38:42.281 INFO:journalctl@ceph.mgr.y.smithi132.stdout:Jul 16 13:38:41 smithi132 bash[10496]: debug 2020-07-16T13:38:41.853+0000 7f0b0fee9380 1 -- 172.21.15.132:0/2177283929 wait complete. 2020-07-16T13:38:43.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:42 smithi188 bash[23329]: audit 2020-07-16T13:37:40.877704+0000 mon.b (mon.2) 110 : audit [DBG] from='mgr.44100 172.21.15.132:0/3373792286' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2020-07-16T13:38:43.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:42 smithi188 bash[23329]: audit 2020-07-16T13:37:40.879558+0000 mon.b (mon.2) 111 : audit [DBG] from='mgr.44100 172.21.15.132:0/3373792286' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2020-07-16T13:38:43.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:42 smithi188 bash[23329]: cluster 2020-07-16T13:37:48.224591+0000 mon.b (mon.2) 112 : cluster [INF] mon.b calling monitor election 2020-07-16T13:38:43.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:42 smithi188 bash[23329]: cluster 2020-07-16T13:37:48.224646+0000 mon.c (mon.1) 28 : cluster [INF] mon.c calling monitor election 2020-07-16T13:38:43.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:42 smithi188 bash[23329]: cluster 2020-07-16T13:38:02.273569+0000 mon.b (mon.2) 113 : cluster [INF] mon.b calling monitor election 2020-07-16T13:38:43.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:42 smithi188 bash[23329]: cluster 2020-07-16T13:38:02.273576+0000 mon.c (mon.1) 29 : cluster [INF] mon.c calling monitor election 2020-07-16T13:38:43.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:42 smithi188 bash[23329]: cluster 2020-07-16T13:38:13.792450+0000 mon.c (mon.1) 30 : cluster [INF] mon.c calling monitor election 2020-07-16T13:38:43.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:42 smithi188 bash[23329]: cluster 2020-07-16T13:38:25.249077+0000 mon.b (mon.2) 114 : cluster [INF] mon.b calling monitor election 2020-07-16T13:38:43.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:42 smithi188 bash[23329]: cluster 2020-07-16T13:38:25.249151+0000 mon.c (mon.1) 31 : cluster [INF] mon.c calling monitor election 2020-07-16T13:38:43.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:42 smithi188 bash[23329]: cluster 2020-07-16T13:38:36.785906+0000 mon.c (mon.1) 32 : cluster [INF] mon.c calling monitor election 2020-07-16T13:38:43.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:42 smithi188 bash[23329]: cluster 2020-07-16T13:38:36.785961+0000 mon.b (mon.2) 115 : cluster [INF] mon.b calling monitor election 2020-07-16T13:38:43.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:42 smithi188 bash[23329]: cluster 2020-07-16T13:38:41.799114+0000 mon.c (mon.1) 33 : cluster [INF] mon.c is new leader, mons c,b in quorum (ranks 1,2) 2020-07-16T13:38:43.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:42 smithi188 bash[23329]: cluster 2020-07-16T13:38:41.812119+0000 mon.c (mon.1) 34 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0],b=[v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0],c=[v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0]} 2020-07-16T13:38:43.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:42 smithi188 bash[23329]: cluster 2020-07-16T13:38:41.812174+0000 mon.c (mon.1) 35 : cluster [DBG] fsmap 2020-07-16T13:38:43.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:42 smithi188 bash[23329]: cluster 2020-07-16T13:38:41.812219+0000 mon.c (mon.1) 36 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2020-07-16T13:38:43.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:42 smithi188 bash[23329]: cluster 2020-07-16T13:38:41.812475+0000 mon.c (mon.1) 37 : cluster [DBG] mgrmap e21: x(active, since 101s), standbys: y 2020-07-16T13:38:43.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:42 smithi188 bash[23329]: cluster 2020-07-16T13:38:41.813161+0000 mon.c (mon.1) 38 : cluster [WRN] Health check failed: 1/3 mons down, quorum c,b (MON_DOWN) 2020-07-16T13:38:43.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:42 smithi188 bash[23329]: cluster 2020-07-16T13:38:41.820583+0000 mon.c (mon.1) 39 : cluster [DBG] Standby manager daemon y restarted 2020-07-16T13:38:43.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:42 smithi188 bash[23329]: cluster 2020-07-16T13:38:41.820646+0000 mon.c (mon.1) 40 : cluster [DBG] Standby manager daemon y started 2020-07-16T13:38:43.175 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:42 smithi188 bash[23329]: cluster 2020-07-16T13:38:41.820913+0000 mon.c (mon.1) 41 : cluster [INF] Active manager daemon x restarted 2020-07-16T13:38:43.175 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:42 smithi188 bash[23329]: cluster 2020-07-16T13:38:41.821654+0000 mon.c (mon.1) 42 : cluster [INF] Activating manager daemon x 2020-07-16T13:38:43.175 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:42 smithi188 bash[23329]: cluster 2020-07-16T13:38:41.823710+0000 mon.c (mon.1) 43 : cluster [DBG] mgrmap e22: x(active, since 101s), standbys: y 2020-07-16T13:38:43.176 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:42 smithi188 bash[23329]: cluster 2020-07-16T13:38:41.827251+0000 mon.c (mon.1) 44 : cluster [WRN] overall HEALTH_WARN 1/3 mons down, quorum c,b 2020-07-16T13:38:43.176 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:42 smithi188 bash[23329]: cluster 2020-07-16T13:38:41.827312+0000 mon.c (mon.1) 45 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2020-07-16T13:38:43.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:42 smithi132 bash[27079]: audit 2020-07-16T13:37:40.877704+0000 mon.b (mon.2) 110 : audit [DBG] from='mgr.44100 172.21.15.132:0/3373792286' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2020-07-16T13:38:43.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:42 smithi132 bash[27079]: audit 2020-07-16T13:37:40.879558+0000 mon.b (mon.2) 111 : audit [DBG] from='mgr.44100 172.21.15.132:0/3373792286' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2020-07-16T13:38:43.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:42 smithi132 bash[27079]: cluster 2020-07-16T13:37:48.224591+0000 mon.b (mon.2) 112 : cluster [INF] mon.b calling monitor election 2020-07-16T13:38:43.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:42 smithi132 bash[27079]: cluster 2020-07-16T13:37:48.224646+0000 mon.c (mon.1) 28 : cluster [INF] mon.c calling monitor election 2020-07-16T13:38:43.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:42 smithi132 bash[27079]: cluster 2020-07-16T13:38:02.273569+0000 mon.b (mon.2) 113 : cluster [INF] mon.b calling monitor election 2020-07-16T13:38:43.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:42 smithi132 bash[27079]: cluster 2020-07-16T13:38:02.273576+0000 mon.c (mon.1) 29 : cluster [INF] mon.c calling monitor election 2020-07-16T13:38:43.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:42 smithi132 bash[27079]: cluster 2020-07-16T13:38:13.792450+0000 mon.c (mon.1) 30 : cluster [INF] mon.c calling monitor election 2020-07-16T13:38:43.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:42 smithi132 bash[27079]: cluster 2020-07-16T13:38:25.249077+0000 mon.b (mon.2) 114 : cluster [INF] mon.b calling monitor election 2020-07-16T13:38:43.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:42 smithi132 bash[27079]: cluster 2020-07-16T13:38:25.249151+0000 mon.c (mon.1) 31 : cluster [INF] mon.c calling monitor election 2020-07-16T13:38:43.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:42 smithi132 bash[27079]: cluster 2020-07-16T13:38:36.785906+0000 mon.c (mon.1) 32 : cluster [INF] mon.c calling monitor election 2020-07-16T13:38:43.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:42 smithi132 bash[27079]: cluster 2020-07-16T13:38:36.785961+0000 mon.b (mon.2) 115 : cluster [INF] mon.b calling monitor election 2020-07-16T13:38:43.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:42 smithi132 bash[27079]: cluster 2020-07-16T13:38:41.799114+0000 mon.c (mon.1) 33 : cluster [INF] mon.c is new leader, mons c,b in quorum (ranks 1,2) 2020-07-16T13:38:43.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:42 smithi132 bash[27079]: cluster 2020-07-16T13:38:41.812119+0000 mon.c (mon.1) 34 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0],b=[v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0],c=[v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0]} 2020-07-16T13:38:43.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:42 smithi132 bash[27079]: cluster 2020-07-16T13:38:41.812174+0000 mon.c (mon.1) 35 : cluster [DBG] fsmap 2020-07-16T13:38:43.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:42 smithi132 bash[27079]: cluster 2020-07-16T13:38:41.812219+0000 mon.c (mon.1) 36 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2020-07-16T13:38:43.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:42 smithi132 bash[27079]: cluster 2020-07-16T13:38:41.812475+0000 mon.c (mon.1) 37 : cluster [DBG] mgrmap e21: x(active, since 101s), standbys: y 2020-07-16T13:38:43.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:42 smithi132 bash[27079]: cluster 2020-07-16T13:38:41.813161+0000 mon.c (mon.1) 38 : cluster [WRN] Health check failed: 1/3 mons down, quorum c,b (MON_DOWN) 2020-07-16T13:38:43.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:42 smithi132 bash[27079]: cluster 2020-07-16T13:38:41.820583+0000 mon.c (mon.1) 39 : cluster [DBG] Standby manager daemon y restarted 2020-07-16T13:38:43.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:42 smithi132 bash[27079]: cluster 2020-07-16T13:38:41.820646+0000 mon.c (mon.1) 40 : cluster [DBG] Standby manager daemon y started 2020-07-16T13:38:43.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:42 smithi132 bash[27079]: cluster 2020-07-16T13:38:41.820913+0000 mon.c (mon.1) 41 : cluster [INF] Active manager daemon x restarted 2020-07-16T13:38:43.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:42 smithi132 bash[27079]: cluster 2020-07-16T13:38:41.821654+0000 mon.c (mon.1) 42 : cluster [INF] Activating manager daemon x 2020-07-16T13:38:43.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:42 smithi132 bash[27079]: cluster 2020-07-16T13:38:41.823710+0000 mon.c (mon.1) 43 : cluster [DBG] mgrmap e22: x(active, since 101s), standbys: y 2020-07-16T13:38:43.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:42 smithi132 bash[27079]: cluster 2020-07-16T13:38:41.827251+0000 mon.c (mon.1) 44 : cluster [WRN] overall HEALTH_WARN 1/3 mons down, quorum c,b 2020-07-16T13:38:43.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:42 smithi132 bash[27079]: cluster 2020-07-16T13:38:41.827312+0000 mon.c (mon.1) 45 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2020-07-16T13:38:44.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:43 smithi188 bash[23329]: cluster 2020-07-16T13:38:42.821798+0000 mon.c (mon.1) 46 : cluster [DBG] mgrmap e23: x(active, starting, since 1.00032s), standbys: y 2020-07-16T13:38:44.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:43 smithi132 bash[27079]: cluster 2020-07-16T13:38:42.821798+0000 mon.c (mon.1) 46 : cluster [DBG] mgrmap e23: x(active, starting, since 1.00032s), standbys: y 2020-07-16T13:38:45.747 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:45 smithi188 bash[23329]: cluster 2020-07-16T13:38:45.434850+0000 mon.c (mon.1) 47 : cluster [INF] Active manager daemon x restarted 2020-07-16T13:38:45.747 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:45 smithi188 bash[23329]: cluster 2020-07-16T13:38:45.435319+0000 mon.c (mon.1) 48 : cluster [INF] Activating manager daemon x 2020-07-16T13:38:45.747 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:45 smithi188 bash[23329]: cluster 2020-07-16T13:38:45.438408+0000 mon.c (mon.1) 49 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2020-07-16T13:38:45.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:45 smithi188 bash[23329]: cluster 2020-07-16T13:38:45.444233+0000 mon.c (mon.1) 50 : cluster [DBG] Standby manager daemon y restarted 2020-07-16T13:38:45.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:45 smithi188 bash[23329]: cluster 2020-07-16T13:38:45.444291+0000 mon.c (mon.1) 51 : cluster [DBG] Standby manager daemon y started 2020-07-16T13:38:45.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:45 smithi188 bash[23329]: audit 2020-07-16T13:38:45.445492+0000 mon.c (mon.1) 52 : audit [DBG] from='mgr.? 172.21.15.132:0/2828111168' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2020-07-16T13:38:45.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:45 smithi188 bash[23329]: audit 2020-07-16T13:38:45.447049+0000 mon.c (mon.1) 53 : audit [DBG] from='mgr.? 172.21.15.132:0/2828111168' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2020-07-16T13:38:45.748 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Jul 16 13:38:45 smithi188 bash[3383]: Warning: Permanently added 'smithi188,172.21.15.188' (ECDSA) to the list of known hosts. 2020-07-16T13:38:45.749 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Jul 16 13:38:45 smithi188 bash[3383]: Warning: Permanently added 'smithi132,172.21.15.132' (ECDSA) to the list of known hosts. 2020-07-16T13:38:45.753 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:45 smithi132 bash[27079]: cluster 2020-07-16T13:38:45.434850+0000 mon.c (mon.1) 47 : cluster [INF] Active manager daemon x restarted 2020-07-16T13:38:45.753 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:45 smithi132 bash[27079]: cluster 2020-07-16T13:38:45.435319+0000 mon.c (mon.1) 48 : cluster [INF] Activating manager daemon x 2020-07-16T13:38:45.753 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:45 smithi132 bash[27079]: cluster 2020-07-16T13:38:45.438408+0000 mon.c (mon.1) 49 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2020-07-16T13:38:45.754 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:45 smithi132 bash[27079]: cluster 2020-07-16T13:38:45.444233+0000 mon.c (mon.1) 50 : cluster [DBG] Standby manager daemon y restarted 2020-07-16T13:38:45.754 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:45 smithi132 bash[27079]: cluster 2020-07-16T13:38:45.444291+0000 mon.c (mon.1) 51 : cluster [DBG] Standby manager daemon y started 2020-07-16T13:38:45.754 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:45 smithi132 bash[27079]: audit 2020-07-16T13:38:45.445492+0000 mon.c (mon.1) 52 : audit [DBG] from='mgr.? 172.21.15.132:0/2828111168' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2020-07-16T13:38:45.754 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:45 smithi132 bash[27079]: audit 2020-07-16T13:38:45.447049+0000 mon.c (mon.1) 53 : audit [DBG] from='mgr.? 172.21.15.132:0/2828111168' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2020-07-16T13:38:46.517 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T13:38:46.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:46 smithi188 bash[23329]: cluster 2020-07-16T13:38:45.490560+0000 mon.c (mon.1) 54 : cluster [DBG] mgrmap e24: x(active, starting, since 0.0553276s), standbys: y 2020-07-16T13:38:46.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:46 smithi188 bash[23329]: audit 2020-07-16T13:38:45.493089+0000 mon.b (mon.2) 116 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2020-07-16T13:38:46.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:46 smithi188 bash[23329]: audit 2020-07-16T13:38:45.493216+0000 mon.b (mon.2) 117 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2020-07-16T13:38:46.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:46 smithi188 bash[23329]: audit 2020-07-16T13:38:45.493329+0000 mon.b (mon.2) 118 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-07-16T13:38:46.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:46 smithi188 bash[23329]: audit 2020-07-16T13:38:45.493435+0000 mon.b (mon.2) 119 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2020-07-16T13:38:46.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:46 smithi188 bash[23329]: audit 2020-07-16T13:38:45.493541+0000 mon.b (mon.2) 120 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-07-16T13:38:46.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:46 smithi188 bash[23329]: audit 2020-07-16T13:38:45.493644+0000 mon.b (mon.2) 121 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-07-16T13:38:46.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:46 smithi188 bash[23329]: audit 2020-07-16T13:38:45.493753+0000 mon.b (mon.2) 122 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-07-16T13:38:46.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:46 smithi188 bash[23329]: audit 2020-07-16T13:38:45.493858+0000 mon.b (mon.2) 123 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-07-16T13:38:46.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:46 smithi188 bash[23329]: audit 2020-07-16T13:38:45.493962+0000 mon.b (mon.2) 124 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2020-07-16T13:38:46.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:46 smithi188 bash[23329]: audit 2020-07-16T13:38:45.494095+0000 mon.b (mon.2) 125 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2020-07-16T13:38:46.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:46 smithi188 bash[23329]: audit 2020-07-16T13:38:45.498109+0000 mon.b (mon.2) 126 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2020-07-16T13:38:46.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:46 smithi188 bash[23329]: audit 2020-07-16T13:38:45.498290+0000 mon.b (mon.2) 127 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2020-07-16T13:38:46.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:46 smithi188 bash[23329]: audit 2020-07-16T13:38:45.498702+0000 mon.b (mon.2) 128 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2020-07-16T13:38:46.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:46 smithi188 bash[23329]: audit 2020-07-16T13:38:45.499422+0000 mon.b (mon.2) 129 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config-key ls"}]: dispatch 2020-07-16T13:38:46.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:46 smithi188 bash[23329]: audit 2020-07-16T13:38:45.500053+0000 mon.b (mon.2) 130 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2020-07-16T13:38:46.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:46 smithi188 bash[23329]: audit 2020-07-16T13:38:45.500286+0000 mon.b (mon.2) 131 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2020-07-16T13:38:46.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:46 smithi188 bash[23329]: audit 2020-07-16T13:38:45.500508+0000 mon.b (mon.2) 132 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi132"}]: dispatch 2020-07-16T13:38:46.675 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:46 smithi188 bash[23329]: audit 2020-07-16T13:38:45.500703+0000 mon.b (mon.2) 133 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi188"}]: dispatch 2020-07-16T13:38:46.675 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:46 smithi188 bash[23329]: audit 2020-07-16T13:38:45.500901+0000 mon.b (mon.2) 134 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2020-07-16T13:38:46.675 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:46 smithi188 bash[23329]: audit 2020-07-16T13:38:45.501106+0000 mon.b (mon.2) 135 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2020-07-16T13:38:46.675 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:46 smithi188 bash[23329]: audit 2020-07-16T13:38:45.501321+0000 mon.b (mon.2) 136 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2020-07-16T13:38:46.675 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:46 smithi188 bash[23329]: audit 2020-07-16T13:38:45.501524+0000 mon.b (mon.2) 137 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2020-07-16T13:38:46.676 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:46 smithi188 bash[23329]: audit 2020-07-16T13:38:45.501726+0000 mon.b (mon.2) 138 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2020-07-16T13:38:46.676 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:46 smithi188 bash[23329]: audit 2020-07-16T13:38:45.501927+0000 mon.b (mon.2) 139 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2020-07-16T13:38:46.676 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:46 smithi188 bash[23329]: audit 2020-07-16T13:38:45.502128+0000 mon.b (mon.2) 140 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2020-07-16T13:38:46.676 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:46 smithi188 bash[23329]: audit 2020-07-16T13:38:45.502353+0000 mon.b (mon.2) 141 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2020-07-16T13:38:46.677 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:46 smithi188 bash[23329]: audit 2020-07-16T13:38:45.502554+0000 mon.b (mon.2) 142 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2020-07-16T13:38:46.677 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:46 smithi188 bash[23329]: audit 2020-07-16T13:38:45.502749+0000 mon.b (mon.2) 143 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2020-07-16T13:38:46.677 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:46 smithi188 bash[23329]: audit 2020-07-16T13:38:45.502958+0000 mon.b (mon.2) 144 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2020-07-16T13:38:46.677 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:46 smithi188 bash[23329]: audit 2020-07-16T13:38:45.503161+0000 mon.b (mon.2) 145 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2020-07-16T13:38:46.677 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:46 smithi188 bash[23329]: audit 2020-07-16T13:38:45.503368+0000 mon.b (mon.2) 146 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2020-07-16T13:38:46.678 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:46 smithi188 bash[23329]: audit 2020-07-16T13:38:45.503571+0000 mon.b (mon.2) 147 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2020-07-16T13:38:46.678 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:46 smithi188 bash[23329]: audit 2020-07-16T13:38:45.503756+0000 mon.b (mon.2) 148 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2020-07-16T13:38:46.678 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:46 smithi188 bash[23329]: audit 2020-07-16T13:38:45.503960+0000 mon.b (mon.2) 149 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2020-07-16T13:38:46.678 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:46 smithi188 bash[23329]: cluster 2020-07-16T13:38:45.506423+0000 mon.c (mon.1) 55 : cluster [INF] Manager daemon x is now available 2020-07-16T13:38:46.678 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:46 smithi188 bash[23329]: audit 2020-07-16T13:38:45.906756+0000 mon.b (mon.2) 150 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:38:46.679 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:46 smithi188 bash[23329]: audit 2020-07-16T13:38:45.911631+0000 mon.b (mon.2) 151 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:38:46.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:46 smithi132 bash[27079]: cluster 2020-07-16T13:38:45.490560+0000 mon.c (mon.1) 54 : cluster [DBG] mgrmap e24: x(active, starting, since 0.0553276s), standbys: y 2020-07-16T13:38:46.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:46 smithi132 bash[27079]: audit 2020-07-16T13:38:45.493089+0000 mon.b (mon.2) 116 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2020-07-16T13:38:46.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:46 smithi132 bash[27079]: audit 2020-07-16T13:38:45.493216+0000 mon.b (mon.2) 117 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2020-07-16T13:38:46.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:46 smithi132 bash[27079]: audit 2020-07-16T13:38:45.493329+0000 mon.b (mon.2) 118 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-07-16T13:38:46.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:46 smithi132 bash[27079]: audit 2020-07-16T13:38:45.493435+0000 mon.b (mon.2) 119 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2020-07-16T13:38:46.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:46 smithi132 bash[27079]: audit 2020-07-16T13:38:45.493541+0000 mon.b (mon.2) 120 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-07-16T13:38:46.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:46 smithi132 bash[27079]: audit 2020-07-16T13:38:45.493644+0000 mon.b (mon.2) 121 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-07-16T13:38:46.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:46 smithi132 bash[27079]: audit 2020-07-16T13:38:45.493753+0000 mon.b (mon.2) 122 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-07-16T13:38:46.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:46 smithi132 bash[27079]: audit 2020-07-16T13:38:45.493858+0000 mon.b (mon.2) 123 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-07-16T13:38:46.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:46 smithi132 bash[27079]: audit 2020-07-16T13:38:45.493962+0000 mon.b (mon.2) 124 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2020-07-16T13:38:46.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:46 smithi132 bash[27079]: audit 2020-07-16T13:38:45.494095+0000 mon.b (mon.2) 125 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2020-07-16T13:38:46.782 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:46 smithi132 bash[27079]: audit 2020-07-16T13:38:45.498109+0000 mon.b (mon.2) 126 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2020-07-16T13:38:46.782 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:46 smithi132 bash[27079]: audit 2020-07-16T13:38:45.498290+0000 mon.b (mon.2) 127 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2020-07-16T13:38:46.782 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:46 smithi132 bash[27079]: audit 2020-07-16T13:38:45.498702+0000 mon.b (mon.2) 128 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2020-07-16T13:38:46.782 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:46 smithi132 bash[27079]: audit 2020-07-16T13:38:45.499422+0000 mon.b (mon.2) 129 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config-key ls"}]: dispatch 2020-07-16T13:38:46.782 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:46 smithi132 bash[27079]: audit 2020-07-16T13:38:45.500053+0000 mon.b (mon.2) 130 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2020-07-16T13:38:46.783 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:46 smithi132 bash[27079]: audit 2020-07-16T13:38:45.500286+0000 mon.b (mon.2) 131 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2020-07-16T13:38:46.783 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:46 smithi132 bash[27079]: audit 2020-07-16T13:38:45.500508+0000 mon.b (mon.2) 132 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi132"}]: dispatch 2020-07-16T13:38:46.783 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:46 smithi132 bash[27079]: audit 2020-07-16T13:38:45.500703+0000 mon.b (mon.2) 133 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi188"}]: dispatch 2020-07-16T13:38:46.783 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:46 smithi132 bash[27079]: audit 2020-07-16T13:38:45.500901+0000 mon.b (mon.2) 134 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2020-07-16T13:38:46.784 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:46 smithi132 bash[27079]: audit 2020-07-16T13:38:45.501106+0000 mon.b (mon.2) 135 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2020-07-16T13:38:46.784 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:46 smithi132 bash[27079]: audit 2020-07-16T13:38:45.501321+0000 mon.b (mon.2) 136 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2020-07-16T13:38:46.784 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:46 smithi132 bash[27079]: audit 2020-07-16T13:38:45.501524+0000 mon.b (mon.2) 137 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2020-07-16T13:38:46.784 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:46 smithi132 bash[27079]: audit 2020-07-16T13:38:45.501726+0000 mon.b (mon.2) 138 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2020-07-16T13:38:46.784 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:46 smithi132 bash[27079]: audit 2020-07-16T13:38:45.501927+0000 mon.b (mon.2) 139 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2020-07-16T13:38:46.785 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:46 smithi132 bash[27079]: audit 2020-07-16T13:38:45.502128+0000 mon.b (mon.2) 140 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2020-07-16T13:38:46.785 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:46 smithi132 bash[27079]: audit 2020-07-16T13:38:45.502353+0000 mon.b (mon.2) 141 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2020-07-16T13:38:46.785 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:46 smithi132 bash[27079]: audit 2020-07-16T13:38:45.502554+0000 mon.b (mon.2) 142 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2020-07-16T13:38:46.785 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:46 smithi132 bash[27079]: audit 2020-07-16T13:38:45.502749+0000 mon.b (mon.2) 143 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2020-07-16T13:38:46.785 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:46 smithi132 bash[27079]: audit 2020-07-16T13:38:45.502958+0000 mon.b (mon.2) 144 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2020-07-16T13:38:46.786 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:46 smithi132 bash[27079]: audit 2020-07-16T13:38:45.503161+0000 mon.b (mon.2) 145 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2020-07-16T13:38:46.786 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:46 smithi132 bash[27079]: audit 2020-07-16T13:38:45.503368+0000 mon.b (mon.2) 146 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2020-07-16T13:38:46.786 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:46 smithi132 bash[27079]: audit 2020-07-16T13:38:45.503571+0000 mon.b (mon.2) 147 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2020-07-16T13:38:46.786 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:46 smithi132 bash[27079]: audit 2020-07-16T13:38:45.503756+0000 mon.b (mon.2) 148 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2020-07-16T13:38:46.786 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:46 smithi132 bash[27079]: audit 2020-07-16T13:38:45.503960+0000 mon.b (mon.2) 149 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2020-07-16T13:38:46.787 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:46 smithi132 bash[27079]: cluster 2020-07-16T13:38:45.506423+0000 mon.c (mon.1) 55 : cluster [INF] Manager daemon x is now available 2020-07-16T13:38:46.787 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:46 smithi132 bash[27079]: audit 2020-07-16T13:38:45.906756+0000 mon.b (mon.2) 150 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:38:46.787 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:46 smithi132 bash[27079]: audit 2020-07-16T13:38:45.911631+0000 mon.b (mon.2) 151 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:38:46.810 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T13:38:46.811 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (92s) 74s ago 4m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T13:38:46.811 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (4m) 74s ago 4m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T13:38:46.811 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (110s) 74s ago 7m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T13:38:46.811 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (76s) 74s ago 9m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T13:38:46.811 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 starting - - 2020-07-16T13:38:46.812 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (7m) 74s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T13:38:46.812 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (7m) 74s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T13:38:46.812 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (4m) 74s ago 4m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T13:38:46.812 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (4m) 74s ago 4m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T13:38:46.812 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (7m) 74s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T13:38:46.813 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (6m) 74s ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T13:38:46.813 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (6m) 74s ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T13:38:46.813 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (6m) 74s ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T13:38:46.813 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (5m) 74s ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T13:38:46.813 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (5m) 74s ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T13:38:46.814 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (5m) 74s ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T13:38:46.814 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (5m) 74s ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T13:38:46.814 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (3m) 74s ago 4m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T13:38:47.144 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T13:38:47.144 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T13:38:47.145 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T13:38:47.145 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T13:38:47.145 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:38:47.145 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T13:38:47.145 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T13:38:47.146 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:38:47.146 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T13:38:47.146 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T13:38:47.146 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:38:47.146 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T13:38:47.147 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T13:38:47.147 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T13:38:47.147 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T13:38:47.147 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T13:38:47.147 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T13:38:47.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:47 smithi132 bash[27079]: cluster 2020-07-16T13:38:46.500067+0000 mon.c (mon.1) 56 : cluster [DBG] mgrmap e25: x(active, since 1.06483s), standbys: y 2020-07-16T13:38:47.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:47 smithi132 bash[27079]: audit 2020-07-16T13:38:46.502471+0000 mgr.x (mgr.34562) 1 : audit [DBG] from='client.24616 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:38:47.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:47 smithi132 bash[27079]: cluster 2020-07-16T13:38:46.505578+0000 mgr.x (mgr.34562) 2 : cluster [DBG] pgmap v3: 1 pgs: 1 active+clean; 0 B data, 4.2 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:38:47.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:47 smithi132 bash[27079]: audit 2020-07-16T13:38:46.806457+0000 mgr.x (mgr.34562) 3 : audit [DBG] from='client.24646 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:38:47.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:47 smithi132 bash[27079]: audit 2020-07-16T13:38:47.143514+0000 mon.c (mon.1) 57 : audit [DBG] from='client.? 172.21.15.132:0/1589023556' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:38:47.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:47 smithi188 bash[23329]: cluster 2020-07-16T13:38:46.500067+0000 mon.c (mon.1) 56 : cluster [DBG] mgrmap e25: x(active, since 1.06483s), standbys: y 2020-07-16T13:38:47.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:47 smithi188 bash[23329]: audit 2020-07-16T13:38:46.502471+0000 mgr.x (mgr.34562) 1 : audit [DBG] from='client.24616 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:38:47.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:47 smithi188 bash[23329]: cluster 2020-07-16T13:38:46.505578+0000 mgr.x (mgr.34562) 2 : cluster [DBG] pgmap v3: 1 pgs: 1 active+clean; 0 B data, 4.2 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:38:47.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:47 smithi188 bash[23329]: audit 2020-07-16T13:38:46.806457+0000 mgr.x (mgr.34562) 3 : audit [DBG] from='client.24646 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:38:47.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:47 smithi188 bash[23329]: audit 2020-07-16T13:38:47.143514+0000 mon.c (mon.1) 57 : audit [DBG] from='client.? 172.21.15.132:0/1589023556' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:38:48.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:48 smithi132 bash[27079]: cluster 2020-07-16T13:38:47.495458+0000 mgr.x (mgr.34562) 4 : cluster [DBG] pgmap v4: 1 pgs: 1 active+clean; 0 B data, 4.2 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:38:48.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:48 smithi132 bash[27079]: cluster 2020-07-16T13:38:47.510984+0000 mon.c (mon.1) 58 : cluster [DBG] mgrmap e26: x(active, since 2s), standbys: y 2020-07-16T13:38:48.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:48 smithi132 bash[27079]: audit 2020-07-16T13:38:48.268581+0000 mon.b (mon.2) 152 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T13:38:48.267077\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267138\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267175\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267204\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267389\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267502\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267607\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267711\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267745\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T13:38:48.267821\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:38:48.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:48 smithi132 bash[27079]: audit 2020-07-16T13:38:48.269451+0000 mon.c (mon.1) 59 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T13:38:48.267077\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267138\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267175\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267204\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267389\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267502\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267607\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267711\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267745\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T13:38:48.267821\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:38:48.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:48 smithi132 bash[27079]: audit 2020-07-16T13:38:48.272131+0000 mon.c (mon.1) 60 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T13:38:48.267077\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267138\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267175\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267204\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267389\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267502\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267607\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267711\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267745\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T13:38:48.267821\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:38:48.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:48 smithi188 bash[23329]: cluster 2020-07-16T13:38:47.495458+0000 mgr.x (mgr.34562) 4 : cluster [DBG] pgmap v4: 1 pgs: 1 active+clean; 0 B data, 4.2 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:38:48.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:48 smithi188 bash[23329]: cluster 2020-07-16T13:38:47.510984+0000 mon.c (mon.1) 58 : cluster [DBG] mgrmap e26: x(active, since 2s), standbys: y 2020-07-16T13:38:48.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:48 smithi188 bash[23329]: audit 2020-07-16T13:38:48.268581+0000 mon.b (mon.2) 152 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T13:38:48.267077\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267138\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267175\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267204\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267389\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267502\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267607\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267711\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267745\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T13:38:48.267821\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:38:48.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:48 smithi188 bash[23329]: audit 2020-07-16T13:38:48.269451+0000 mon.c (mon.1) 59 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T13:38:48.267077\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267138\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267175\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267204\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267389\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267502\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267607\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267711\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267745\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T13:38:48.267821\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]: dispatch 2020-07-16T13:38:48.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:48 smithi188 bash[23329]: audit 2020-07-16T13:38:48.272131+0000 mon.c (mon.1) 60 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T13:38:48.267077\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267138\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267175\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267204\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267389\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267502\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267607\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267711\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267745\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T13:38:48.267821\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:29:59.044629\"}"}]': finished 2020-07-16T13:38:49.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:49 smithi132 bash[27079]: audit 2020-07-16T13:38:48.514392+0000 mon.b (mon.2) 153 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.512945\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513017\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513050\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513209\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513324\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513431\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513534\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513584\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513611\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:38:48.513684\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:38:49.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:49 smithi132 bash[27079]: audit 2020-07-16T13:38:48.514982+0000 mon.c (mon.1) 61 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.512945\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513017\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513050\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513209\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513324\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513431\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513534\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513584\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513611\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:38:48.513684\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:38:49.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:49 smithi132 bash[27079]: audit 2020-07-16T13:38:48.519512+0000 mon.c (mon.1) 62 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.512945\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513017\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513050\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513209\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513324\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513431\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513534\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513584\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513611\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:38:48.513684\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:38:49.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:49 smithi132 bash[27079]: audit 2020-07-16T13:38:48.523088+0000 mon.b (mon.2) 154 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:38:49.782 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:49 smithi132 bash[27079]: audit 2020-07-16T13:38:48.523362+0000 mgr.x (mgr.34562) 5 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:38:49.782 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:49 smithi132 bash[27079]: audit 2020-07-16T13:38:48.524066+0000 mon.b (mon.2) 155 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:38:49.782 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:49 smithi132 bash[27079]: audit 2020-07-16T13:38:48.524307+0000 mgr.x (mgr.34562) 6 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:38:49.782 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:49 smithi132 bash[27079]: audit 2020-07-16T13:38:48.524891+0000 mon.b (mon.2) 156 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:38:49.782 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:49 smithi132 bash[27079]: audit 2020-07-16T13:38:48.525127+0000 mgr.x (mgr.34562) 7 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:38:49.783 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:49 smithi132 bash[27079]: cephadm 2020-07-16T13:38:48.525643+0000 mgr.x (mgr.34562) 8 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T13:38:49.784 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:49 smithi132 bash[27079]: audit 2020-07-16T13:38:48.525881+0000 mon.b (mon.2) 157 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T13:38:49.784 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:49 smithi132 bash[27079]: cephadm 2020-07-16T13:38:48.526525+0000 mgr.x (mgr.34562) 9 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T13:38:49.784 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:49 smithi132 bash[27079]: audit 2020-07-16T13:38:48.526882+0000 mon.b (mon.2) 158 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:38:49.785 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:49 smithi132 bash[27079]: cephadm 2020-07-16T13:38:48.527371+0000 mgr.x (mgr.34562) 10 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T13:38:49.785 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:49 smithi132 bash[27079]: cephadm 2020-07-16T13:38:48.527492+0000 mgr.x (mgr.34562) 11 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T13:38:49.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:49 smithi188 bash[23329]: audit 2020-07-16T13:38:48.514392+0000 mon.b (mon.2) 153 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.512945\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513017\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513050\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513209\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513324\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513431\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513534\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513584\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513611\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:38:48.513684\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:38:49.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:49 smithi188 bash[23329]: audit 2020-07-16T13:38:48.514982+0000 mon.c (mon.1) 61 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.512945\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513017\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513050\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513209\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513324\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513431\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513534\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513584\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513611\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:38:48.513684\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]: dispatch 2020-07-16T13:38:49.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:49 smithi188 bash[23329]: audit 2020-07-16T13:38:48.519512+0000 mon.c (mon.1) 62 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.512945\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513017\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513050\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513209\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513324\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513431\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513534\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513584\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513611\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:38:48.513684\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:30:46.989770\"}"}]': finished 2020-07-16T13:38:49.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:49 smithi188 bash[23329]: audit 2020-07-16T13:38:48.523088+0000 mon.b (mon.2) 154 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:38:49.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:49 smithi188 bash[23329]: audit 2020-07-16T13:38:48.523362+0000 mgr.x (mgr.34562) 5 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:38:49.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:49 smithi188 bash[23329]: audit 2020-07-16T13:38:48.524066+0000 mon.b (mon.2) 155 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:38:49.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:49 smithi188 bash[23329]: audit 2020-07-16T13:38:48.524307+0000 mgr.x (mgr.34562) 6 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:38:49.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:49 smithi188 bash[23329]: audit 2020-07-16T13:38:48.524891+0000 mon.b (mon.2) 156 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:38:49.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:49 smithi188 bash[23329]: audit 2020-07-16T13:38:48.525127+0000 mgr.x (mgr.34562) 7 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:38:49.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:49 smithi188 bash[23329]: cephadm 2020-07-16T13:38:48.525643+0000 mgr.x (mgr.34562) 8 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T13:38:49.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:49 smithi188 bash[23329]: audit 2020-07-16T13:38:48.525881+0000 mon.b (mon.2) 157 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T13:38:49.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:49 smithi188 bash[23329]: cephadm 2020-07-16T13:38:48.526525+0000 mgr.x (mgr.34562) 9 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T13:38:49.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:49 smithi188 bash[23329]: audit 2020-07-16T13:38:48.526882+0000 mon.b (mon.2) 158 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:38:49.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:49 smithi188 bash[23329]: cephadm 2020-07-16T13:38:48.527371+0000 mgr.x (mgr.34562) 10 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T13:38:49.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:49 smithi188 bash[23329]: cephadm 2020-07-16T13:38:48.527492+0000 mgr.x (mgr.34562) 11 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T13:38:50.677 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:50 smithi132 bash[27079]: cluster 2020-07-16T13:38:49.495816+0000 mgr.x (mgr.34562) 12 : cluster [DBG] pgmap v5: 1 pgs: 1 active+clean; 0 B data, 4.2 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:38:50.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:50 smithi188 bash[23329]: cluster 2020-07-16T13:38:49.495816+0000 mgr.x (mgr.34562) 12 : cluster [DBG] pgmap v5: 1 pgs: 1 active+clean; 0 B data, 4.2 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:38:51.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:51 smithi132 bash[27079]: audit 2020-07-16T13:38:51.191606+0000 mon.b (mon.2) 159 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:38:51.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:51 smithi188 bash[23329]: audit 2020-07-16T13:38:51.191606+0000 mon.b (mon.2) 159 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:38:52.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:52 smithi132 bash[27079]: cephadm 2020-07-16T13:38:51.192217+0000 mgr.x (mgr.34562) 13 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:38:52.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:52 smithi132 bash[27079]: cephadm 2020-07-16T13:38:51.192416+0000 mgr.x (mgr.34562) 14 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:38:52.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:52 smithi132 bash[27079]: cluster 2020-07-16T13:38:51.496377+0000 mgr.x (mgr.34562) 15 : cluster [DBG] pgmap v6: 1 pgs: 1 active+clean; 0 B data, 4.2 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:38:52.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:52 smithi188 bash[23329]: cephadm 2020-07-16T13:38:51.192217+0000 mgr.x (mgr.34562) 13 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:38:52.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:52 smithi188 bash[23329]: cephadm 2020-07-16T13:38:51.192416+0000 mgr.x (mgr.34562) 14 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:38:52.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:52 smithi188 bash[23329]: cluster 2020-07-16T13:38:51.496377+0000 mgr.x (mgr.34562) 15 : cluster [DBG] pgmap v6: 1 pgs: 1 active+clean; 0 B data, 4.2 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:38:54.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:54 smithi132 bash[27079]: cluster 2020-07-16T13:38:53.496760+0000 mgr.x (mgr.34562) 16 : cluster [DBG] pgmap v7: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:38:54.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:54 smithi188 bash[23329]: cluster 2020-07-16T13:38:53.496760+0000 mgr.x (mgr.34562) 16 : cluster [DBG] pgmap v7: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:38:56.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:56 smithi188 bash[23329]: cluster 2020-07-16T13:38:55.497204+0000 mgr.x (mgr.34562) 17 : cluster [DBG] pgmap v8: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:38:57.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:56 smithi132 bash[27079]: cluster 2020-07-16T13:38:55.497204+0000 mgr.x (mgr.34562) 17 : cluster [DBG] pgmap v8: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:38:58.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:58 smithi188 bash[23329]: cluster 2020-07-16T13:38:57.497575+0000 mgr.x (mgr.34562) 18 : cluster [DBG] pgmap v9: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:38:59.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:58 smithi132 bash[27079]: cluster 2020-07-16T13:38:57.497575+0000 mgr.x (mgr.34562) 18 : cluster [DBG] pgmap v9: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:39:00.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:38:59 smithi132 bash[27079]: cluster 2020-07-16T13:38:59.497960+0000 mgr.x (mgr.34562) 19 : cluster [DBG] pgmap v10: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:39:00.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:38:59 smithi188 bash[23329]: cluster 2020-07-16T13:38:59.497960+0000 mgr.x (mgr.34562) 19 : cluster [DBG] pgmap v10: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:39:02.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:39:02 smithi188 bash[23329]: cluster 2020-07-16T13:39:01.498253+0000 mgr.x (mgr.34562) 20 : cluster [DBG] pgmap v11: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:39:03.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:39:02 smithi132 bash[27079]: cluster 2020-07-16T13:39:01.498253+0000 mgr.x (mgr.34562) 20 : cluster [DBG] pgmap v11: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:39:04.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:39:04 smithi188 bash[23329]: cluster 2020-07-16T13:39:03.498618+0000 mgr.x (mgr.34562) 21 : cluster [DBG] pgmap v12: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:39:05.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:39:04 smithi132 bash[27079]: cluster 2020-07-16T13:39:03.498618+0000 mgr.x (mgr.34562) 21 : cluster [DBG] pgmap v12: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:39:06.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:39:06 smithi188 bash[23329]: cluster 2020-07-16T13:39:05.498966+0000 mgr.x (mgr.34562) 22 : cluster [DBG] pgmap v13: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:39:06.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:39:06 smithi188 bash[23329]: audit 2020-07-16T13:39:06.200401+0000 mon.b (mon.2) 160 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:39:07.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:39:06 smithi132 bash[27079]: cluster 2020-07-16T13:39:05.498966+0000 mgr.x (mgr.34562) 22 : cluster [DBG] pgmap v13: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:39:07.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:39:06 smithi132 bash[27079]: audit 2020-07-16T13:39:06.200401+0000 mon.b (mon.2) 160 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:39:07.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:39:07 smithi188 bash[23329]: cephadm 2020-07-16T13:39:06.201093+0000 mgr.x (mgr.34562) 23 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:39:07.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:39:07 smithi188 bash[23329]: cephadm 2020-07-16T13:39:06.201600+0000 mgr.x (mgr.34562) 24 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:39:08.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:39:07 smithi132 bash[27079]: cephadm 2020-07-16T13:39:06.201093+0000 mgr.x (mgr.34562) 23 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:39:08.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:39:07 smithi132 bash[27079]: cephadm 2020-07-16T13:39:06.201600+0000 mgr.x (mgr.34562) 24 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:39:08.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:39:08 smithi188 bash[23329]: cluster 2020-07-16T13:39:07.499384+0000 mgr.x (mgr.34562) 25 : cluster [DBG] pgmap v14: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:39:09.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:39:08 smithi132 bash[27079]: cluster 2020-07-16T13:39:07.499384+0000 mgr.x (mgr.34562) 25 : cluster [DBG] pgmap v14: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:39:10.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:39:09 smithi132 bash[27079]: cluster 2020-07-16T13:39:09.499881+0000 mgr.x (mgr.34562) 26 : cluster [DBG] pgmap v15: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:39:10.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:39:09 smithi188 bash[23329]: cluster 2020-07-16T13:39:09.499881+0000 mgr.x (mgr.34562) 26 : cluster [DBG] pgmap v15: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:39:12.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:39:12 smithi188 bash[23329]: cluster 2020-07-16T13:39:11.500412+0000 mgr.x (mgr.34562) 27 : cluster [DBG] pgmap v16: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:39:13.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:39:12 smithi132 bash[27079]: cluster 2020-07-16T13:39:11.500412+0000 mgr.x (mgr.34562) 27 : cluster [DBG] pgmap v16: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:39:14.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:39:14 smithi188 bash[23329]: cluster 2020-07-16T13:39:13.500914+0000 mgr.x (mgr.34562) 28 : cluster [DBG] pgmap v17: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:39:15.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:39:14 smithi132 bash[27079]: cluster 2020-07-16T13:39:13.500914+0000 mgr.x (mgr.34562) 28 : cluster [DBG] pgmap v17: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:39:16.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:39:16 smithi188 bash[23329]: cluster 2020-07-16T13:39:15.501257+0000 mgr.x (mgr.34562) 29 : cluster [DBG] pgmap v18: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:39:17.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:39:16 smithi132 bash[27079]: cluster 2020-07-16T13:39:15.501257+0000 mgr.x (mgr.34562) 29 : cluster [DBG] pgmap v18: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:39:17.451 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T13:39:17.711 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T13:39:17.712 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2m) 29s ago 5m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T13:39:17.712 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (4m) 29s ago 4m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T13:39:17.712 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2m) 29s ago 7m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T13:39:17.712 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (107s) 29s ago 9m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T13:39:17.713 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 29s ago 9m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T13:39:17.713 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (8m) 29s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T13:39:17.713 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (8m) 29s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T13:39:17.713 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (5m) 29s ago 5m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T13:39:17.713 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (5m) 29s ago 5m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T13:39:17.714 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (7m) 29s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T13:39:17.714 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (7m) 29s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T13:39:17.714 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (7m) 29s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T13:39:17.714 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (6m) 29s ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T13:39:17.714 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (6m) 29s ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T13:39:17.715 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (6m) 29s ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T13:39:17.715 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (5m) 29s ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T13:39:17.715 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (5m) 29s ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T13:39:17.715 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (4m) 29s ago 5m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T13:39:18.009 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T13:39:18.009 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T13:39:18.009 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T13:39:18.010 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T13:39:18.010 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:39:18.010 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T13:39:18.010 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T13:39:18.011 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:39:18.011 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T13:39:18.011 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T13:39:18.011 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:39:18.011 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T13:39:18.011 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T13:39:18.012 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T13:39:18.012 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T13:39:18.012 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T13:39:18.012 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T13:39:18.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:39:18 smithi188 bash[23329]: audit 2020-07-16T13:39:17.435738+0000 mgr.x (mgr.34562) 30 : audit [DBG] from='client.24658 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:39:18.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:39:18 smithi188 bash[23329]: cluster 2020-07-16T13:39:17.501779+0000 mgr.x (mgr.34562) 31 : cluster [DBG] pgmap v19: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:39:18.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:39:18 smithi188 bash[23329]: audit 2020-07-16T13:39:17.707180+0000 mgr.x (mgr.34562) 32 : audit [DBG] from='client.24664 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:39:18.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:39:18 smithi188 bash[23329]: audit 2020-07-16T13:39:18.008099+0000 mon.c (mon.1) 63 : audit [DBG] from='client.? 172.21.15.132:0/4274256986' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:39:19.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:39:18 smithi132 bash[27079]: audit 2020-07-16T13:39:17.435738+0000 mgr.x (mgr.34562) 30 : audit [DBG] from='client.24658 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:39:19.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:39:18 smithi132 bash[27079]: cluster 2020-07-16T13:39:17.501779+0000 mgr.x (mgr.34562) 31 : cluster [DBG] pgmap v19: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:39:19.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:39:18 smithi132 bash[27079]: audit 2020-07-16T13:39:17.707180+0000 mgr.x (mgr.34562) 32 : audit [DBG] from='client.24664 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:39:19.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:39:18 smithi132 bash[27079]: audit 2020-07-16T13:39:18.008099+0000 mon.c (mon.1) 63 : audit [DBG] from='client.? 172.21.15.132:0/4274256986' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:39:20.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:39:19 smithi132 bash[27079]: cluster 2020-07-16T13:39:19.502175+0000 mgr.x (mgr.34562) 33 : cluster [DBG] pgmap v20: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:39:20.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:39:19 smithi188 bash[23329]: cluster 2020-07-16T13:39:19.502175+0000 mgr.x (mgr.34562) 33 : cluster [DBG] pgmap v20: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:39:21.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:39:21 smithi132 bash[27079]: audit 2020-07-16T13:39:21.204256+0000 mon.b (mon.2) 161 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:39:21.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:39:21 smithi188 bash[23329]: audit 2020-07-16T13:39:21.204256+0000 mon.b (mon.2) 161 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:39:22.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:39:22 smithi132 bash[27079]: cephadm 2020-07-16T13:39:21.205020+0000 mgr.x (mgr.34562) 34 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:39:22.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:39:22 smithi132 bash[27079]: cephadm 2020-07-16T13:39:21.205365+0000 mgr.x (mgr.34562) 35 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:39:22.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:39:22 smithi132 bash[27079]: cluster 2020-07-16T13:39:21.502564+0000 mgr.x (mgr.34562) 36 : cluster [DBG] pgmap v21: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:39:22.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:39:22 smithi188 bash[23329]: cephadm 2020-07-16T13:39:21.205020+0000 mgr.x (mgr.34562) 34 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:39:22.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:39:22 smithi188 bash[23329]: cephadm 2020-07-16T13:39:21.205365+0000 mgr.x (mgr.34562) 35 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:39:22.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:39:22 smithi188 bash[23329]: cluster 2020-07-16T13:39:21.502564+0000 mgr.x (mgr.34562) 36 : cluster [DBG] pgmap v21: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:39:24.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:39:24 smithi188 bash[23329]: cluster 2020-07-16T13:39:23.503098+0000 mgr.x (mgr.34562) 37 : cluster [DBG] pgmap v22: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:39:25.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:39:24 smithi132 bash[27079]: cluster 2020-07-16T13:39:23.503098+0000 mgr.x (mgr.34562) 37 : cluster [DBG] pgmap v22: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:39:26.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:39:26 smithi188 bash[23329]: cluster 2020-07-16T13:39:25.503638+0000 mgr.x (mgr.34562) 38 : cluster [DBG] pgmap v23: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:39:27.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:39:26 smithi132 bash[27079]: cluster 2020-07-16T13:39:25.503638+0000 mgr.x (mgr.34562) 38 : cluster [DBG] pgmap v23: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:39:28.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:39:28 smithi188 bash[23329]: cluster 2020-07-16T13:39:27.504081+0000 mgr.x (mgr.34562) 39 : cluster [DBG] pgmap v24: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:39:29.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:39:28 smithi132 bash[27079]: cluster 2020-07-16T13:39:27.504081+0000 mgr.x (mgr.34562) 39 : cluster [DBG] pgmap v24: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:39:30.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:39:29 smithi132 bash[27079]: cluster 2020-07-16T13:39:29.504469+0000 mgr.x (mgr.34562) 40 : cluster [DBG] pgmap v25: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:39:30.426 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:39:29 smithi188 bash[23329]: cluster 2020-07-16T13:39:29.504469+0000 mgr.x (mgr.34562) 40 : cluster [DBG] pgmap v25: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:39:32.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:39:32 smithi188 bash[23329]: cluster 2020-07-16T13:39:31.504805+0000 mgr.x (mgr.34562) 41 : cluster [DBG] pgmap v26: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:39:33.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:39:32 smithi132 bash[27079]: cluster 2020-07-16T13:39:31.504805+0000 mgr.x (mgr.34562) 41 : cluster [DBG] pgmap v26: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:39:34.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:39:34 smithi188 bash[23329]: cluster 2020-07-16T13:39:33.505302+0000 mgr.x (mgr.34562) 42 : cluster [DBG] pgmap v27: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:39:35.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:39:34 smithi132 bash[27079]: cluster 2020-07-16T13:39:33.505302+0000 mgr.x (mgr.34562) 42 : cluster [DBG] pgmap v27: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:39:36.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:39:36 smithi188 bash[23329]: cluster 2020-07-16T13:39:35.505667+0000 mgr.x (mgr.34562) 43 : cluster [DBG] pgmap v28: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:39:36.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:39:36 smithi188 bash[23329]: audit 2020-07-16T13:39:36.205753+0000 mon.b (mon.2) 162 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:39:37.034 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:39:36 smithi132 bash[27079]: cluster 2020-07-16T13:39:35.505667+0000 mgr.x (mgr.34562) 43 : cluster [DBG] pgmap v28: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:39:37.034 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:39:36 smithi132 bash[27079]: audit 2020-07-16T13:39:36.205753+0000 mon.b (mon.2) 162 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:39:37.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:39:37 smithi188 bash[23329]: cephadm 2020-07-16T13:39:36.206479+0000 mgr.x (mgr.34562) 44 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:39:37.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:39:37 smithi188 bash[23329]: cephadm 2020-07-16T13:39:36.206802+0000 mgr.x (mgr.34562) 45 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:39:38.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:39:37 smithi132 bash[27079]: cephadm 2020-07-16T13:39:36.206479+0000 mgr.x (mgr.34562) 44 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:39:38.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:39:37 smithi132 bash[27079]: cephadm 2020-07-16T13:39:36.206802+0000 mgr.x (mgr.34562) 45 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:39:38.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:39:38 smithi188 bash[23329]: cluster 2020-07-16T13:39:37.506130+0000 mgr.x (mgr.34562) 46 : cluster [DBG] pgmap v29: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:39:39.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:39:38 smithi132 bash[27079]: cluster 2020-07-16T13:39:37.506130+0000 mgr.x (mgr.34562) 46 : cluster [DBG] pgmap v29: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:39:40.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:39:39 smithi132 bash[27079]: cluster 2020-07-16T13:39:39.506578+0000 mgr.x (mgr.34562) 47 : cluster [DBG] pgmap v30: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:39:40.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:39:39 smithi188 bash[23329]: cluster 2020-07-16T13:39:39.506578+0000 mgr.x (mgr.34562) 47 : cluster [DBG] pgmap v30: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:39:42.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:39:42 smithi188 bash[23329]: cluster 2020-07-16T13:39:41.506892+0000 mgr.x (mgr.34562) 48 : cluster [DBG] pgmap v31: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:39:43.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:39:42 smithi132 bash[27079]: cluster 2020-07-16T13:39:41.506892+0000 mgr.x (mgr.34562) 48 : cluster [DBG] pgmap v31: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:39:44.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:39:44 smithi188 bash[23329]: cluster 2020-07-16T13:39:43.507325+0000 mgr.x (mgr.34562) 49 : cluster [DBG] pgmap v32: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:39:45.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:39:44 smithi132 bash[27079]: cluster 2020-07-16T13:39:43.507325+0000 mgr.x (mgr.34562) 49 : cluster [DBG] pgmap v32: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:39:46.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:39:46 smithi188 bash[23329]: cluster 2020-07-16T13:39:45.507828+0000 mgr.x (mgr.34562) 50 : cluster [DBG] pgmap v33: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:39:47.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:39:46 smithi132 bash[27079]: cluster 2020-07-16T13:39:45.507828+0000 mgr.x (mgr.34562) 50 : cluster [DBG] pgmap v33: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:39:48.312 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T13:39:48.566 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T13:39:48.566 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2m) 60s ago 5m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T13:39:48.566 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (5m) 60s ago 5m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T13:39:48.566 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2m) 60s ago 8m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T13:39:48.567 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2m) 60s ago 10m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T13:39:48.567 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 60s ago 10m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T13:39:48.567 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (8m) 60s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T13:39:48.567 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (8m) 60s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T13:39:48.568 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (5m) 60s ago 5m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T13:39:48.568 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (5m) 60s ago 5m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T13:39:48.568 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (8m) 60s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T13:39:48.568 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (7m) 60s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T13:39:48.568 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (7m) 60s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T13:39:48.569 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (7m) 60s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T13:39:48.569 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (6m) 60s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T13:39:48.569 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (6m) 60s ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T13:39:48.569 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (6m) 60s ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T13:39:48.569 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (6m) 60s ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T13:39:48.570 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (5m) 60s ago 5m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T13:39:48.861 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T13:39:48.862 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T13:39:48.862 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T13:39:48.862 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T13:39:48.863 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:39:48.863 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T13:39:48.863 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T13:39:48.863 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:39:48.863 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T13:39:48.864 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T13:39:48.864 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:39:48.864 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T13:39:48.864 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T13:39:48.864 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T13:39:48.865 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T13:39:48.865 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T13:39:48.865 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T13:39:48.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:39:48 smithi188 bash[23329]: cluster 2020-07-16T13:39:47.508319+0000 mgr.x (mgr.34562) 51 : cluster [DBG] pgmap v34: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:39:49.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:39:48 smithi132 bash[27079]: cluster 2020-07-16T13:39:47.508319+0000 mgr.x (mgr.34562) 51 : cluster [DBG] pgmap v34: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:39:49.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:39:49 smithi188 bash[23329]: audit 2020-07-16T13:39:48.293270+0000 mgr.x (mgr.34562) 52 : audit [DBG] from='client.24676 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:39:49.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:39:49 smithi188 bash[23329]: audit 2020-07-16T13:39:48.561360+0000 mgr.x (mgr.34562) 53 : audit [DBG] from='client.24682 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:39:49.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:39:49 smithi188 bash[23329]: audit 2020-07-16T13:39:48.860819+0000 mon.c (mon.1) 64 : audit [DBG] from='client.? 172.21.15.132:0/765439150' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:39:50.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:39:49 smithi132 bash[27079]: audit 2020-07-16T13:39:48.293270+0000 mgr.x (mgr.34562) 52 : audit [DBG] from='client.24676 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:39:50.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:39:49 smithi132 bash[27079]: audit 2020-07-16T13:39:48.561360+0000 mgr.x (mgr.34562) 53 : audit [DBG] from='client.24682 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:39:50.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:39:49 smithi132 bash[27079]: audit 2020-07-16T13:39:48.860819+0000 mon.c (mon.1) 64 : audit [DBG] from='client.? 172.21.15.132:0/765439150' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:39:50.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:39:50 smithi188 bash[23329]: cluster 2020-07-16T13:39:49.508669+0000 mgr.x (mgr.34562) 54 : cluster [DBG] pgmap v35: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:39:51.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:39:50 smithi132 bash[27079]: cluster 2020-07-16T13:39:49.508669+0000 mgr.x (mgr.34562) 54 : cluster [DBG] pgmap v35: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:39:51.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:39:51 smithi188 bash[23329]: audit 2020-07-16T13:39:51.225373+0000 mon.b (mon.2) 163 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:39:51.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:39:51 smithi188 bash[23329]: audit 2020-07-16T13:39:51.226767+0000 mon.b (mon.2) 164 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:39:51.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:39:51 smithi188 bash[23329]: audit 2020-07-16T13:39:51.227921+0000 mon.b (mon.2) 165 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:39:51.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:39:51 smithi188 bash[23329]: audit 2020-07-16T13:39:51.229227+0000 mon.b (mon.2) 166 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T13:39:51.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:39:51 smithi188 bash[23329]: audit 2020-07-16T13:39:51.230474+0000 mon.b (mon.2) 167 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:39:52.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:39:51 smithi132 bash[27079]: audit 2020-07-16T13:39:51.225373+0000 mon.b (mon.2) 163 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:39:52.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:39:51 smithi132 bash[27079]: audit 2020-07-16T13:39:51.226767+0000 mon.b (mon.2) 164 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:39:52.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:39:51 smithi132 bash[27079]: audit 2020-07-16T13:39:51.227921+0000 mon.b (mon.2) 165 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:39:52.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:39:51 smithi132 bash[27079]: audit 2020-07-16T13:39:51.229227+0000 mon.b (mon.2) 166 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T13:39:52.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:39:51 smithi132 bash[27079]: audit 2020-07-16T13:39:51.230474+0000 mon.b (mon.2) 167 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:39:52.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:39:52 smithi188 bash[23329]: audit 2020-07-16T13:39:51.225747+0000 mgr.x (mgr.34562) 55 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:39:52.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:39:52 smithi188 bash[23329]: audit 2020-07-16T13:39:51.227062+0000 mgr.x (mgr.34562) 56 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:39:52.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:39:52 smithi188 bash[23329]: audit 2020-07-16T13:39:51.228179+0000 mgr.x (mgr.34562) 57 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:39:52.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:39:52 smithi188 bash[23329]: cephadm 2020-07-16T13:39:51.228896+0000 mgr.x (mgr.34562) 58 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T13:39:52.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:39:52 smithi188 bash[23329]: cephadm 2020-07-16T13:39:51.230043+0000 mgr.x (mgr.34562) 59 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T13:39:52.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:39:52 smithi188 bash[23329]: cephadm 2020-07-16T13:39:51.231120+0000 mgr.x (mgr.34562) 60 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T13:39:52.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:39:52 smithi188 bash[23329]: cephadm 2020-07-16T13:39:51.231340+0000 mgr.x (mgr.34562) 61 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T13:39:52.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:39:52 smithi188 bash[23329]: cluster 2020-07-16T13:39:51.508994+0000 mgr.x (mgr.34562) 62 : cluster [DBG] pgmap v36: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:39:53.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:39:52 smithi132 bash[27079]: audit 2020-07-16T13:39:51.225747+0000 mgr.x (mgr.34562) 55 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:39:53.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:39:52 smithi132 bash[27079]: audit 2020-07-16T13:39:51.227062+0000 mgr.x (mgr.34562) 56 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:39:53.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:39:52 smithi132 bash[27079]: audit 2020-07-16T13:39:51.228179+0000 mgr.x (mgr.34562) 57 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:39:53.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:39:52 smithi132 bash[27079]: cephadm 2020-07-16T13:39:51.228896+0000 mgr.x (mgr.34562) 58 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T13:39:53.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:39:52 smithi132 bash[27079]: cephadm 2020-07-16T13:39:51.230043+0000 mgr.x (mgr.34562) 59 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T13:39:53.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:39:52 smithi132 bash[27079]: cephadm 2020-07-16T13:39:51.231120+0000 mgr.x (mgr.34562) 60 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T13:39:53.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:39:52 smithi132 bash[27079]: cephadm 2020-07-16T13:39:51.231340+0000 mgr.x (mgr.34562) 61 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T13:39:53.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:39:52 smithi132 bash[27079]: cluster 2020-07-16T13:39:51.508994+0000 mgr.x (mgr.34562) 62 : cluster [DBG] pgmap v36: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:39:54.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:39:54 smithi188 bash[23329]: cluster 2020-07-16T13:39:53.509484+0000 mgr.x (mgr.34562) 63 : cluster [DBG] pgmap v37: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:39:54.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:39:54 smithi188 bash[23329]: audit 2020-07-16T13:39:54.120641+0000 mon.b (mon.2) 168 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:39:55.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:39:54 smithi132 bash[27079]: cluster 2020-07-16T13:39:53.509484+0000 mgr.x (mgr.34562) 63 : cluster [DBG] pgmap v37: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:39:55.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:39:54 smithi132 bash[27079]: audit 2020-07-16T13:39:54.120641+0000 mon.b (mon.2) 168 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:39:55.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:39:55 smithi188 bash[23329]: cephadm 2020-07-16T13:39:54.121240+0000 mgr.x (mgr.34562) 64 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:39:55.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:39:55 smithi188 bash[23329]: cephadm 2020-07-16T13:39:54.121414+0000 mgr.x (mgr.34562) 65 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:39:56.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:39:55 smithi132 bash[27079]: cephadm 2020-07-16T13:39:54.121240+0000 mgr.x (mgr.34562) 64 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:39:56.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:39:55 smithi132 bash[27079]: cephadm 2020-07-16T13:39:54.121414+0000 mgr.x (mgr.34562) 65 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:39:56.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:39:56 smithi188 bash[23329]: cluster 2020-07-16T13:39:55.509967+0000 mgr.x (mgr.34562) 66 : cluster [DBG] pgmap v38: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:39:57.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:39:56 smithi132 bash[27079]: cluster 2020-07-16T13:39:55.509967+0000 mgr.x (mgr.34562) 66 : cluster [DBG] pgmap v38: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:39:58.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:39:58 smithi188 bash[23329]: cluster 2020-07-16T13:39:57.510592+0000 mgr.x (mgr.34562) 67 : cluster [DBG] pgmap v39: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:39:59.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:39:58 smithi132 bash[27079]: cluster 2020-07-16T13:39:57.510592+0000 mgr.x (mgr.34562) 67 : cluster [DBG] pgmap v39: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:40:00.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:39:59 smithi132 bash[27079]: cluster 2020-07-16T13:39:59.511086+0000 mgr.x (mgr.34562) 68 : cluster [DBG] pgmap v40: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:40:00.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:39:59 smithi188 bash[23329]: cluster 2020-07-16T13:39:59.511086+0000 mgr.x (mgr.34562) 68 : cluster [DBG] pgmap v40: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:40:02.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:02 smithi188 bash[23329]: cluster 2020-07-16T13:40:01.511416+0000 mgr.x (mgr.34562) 69 : cluster [DBG] pgmap v41: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:40:03.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:02 smithi132 bash[27079]: cluster 2020-07-16T13:40:01.511416+0000 mgr.x (mgr.34562) 69 : cluster [DBG] pgmap v41: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:40:04.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:04 smithi188 bash[23329]: cluster 2020-07-16T13:40:03.511926+0000 mgr.x (mgr.34562) 70 : cluster [DBG] pgmap v42: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:40:05.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:04 smithi132 bash[27079]: cluster 2020-07-16T13:40:03.511926+0000 mgr.x (mgr.34562) 70 : cluster [DBG] pgmap v42: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:40:06.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:06 smithi188 bash[23329]: cluster 2020-07-16T13:40:05.512260+0000 mgr.x (mgr.34562) 71 : cluster [DBG] pgmap v43: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:40:07.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:06 smithi132 bash[27079]: cluster 2020-07-16T13:40:05.512260+0000 mgr.x (mgr.34562) 71 : cluster [DBG] pgmap v43: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:40:08.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:08 smithi188 bash[23329]: cluster 2020-07-16T13:40:07.512689+0000 mgr.x (mgr.34562) 72 : cluster [DBG] pgmap v44: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:40:09.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:08 smithi132 bash[27079]: cluster 2020-07-16T13:40:07.512689+0000 mgr.x (mgr.34562) 72 : cluster [DBG] pgmap v44: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:40:10.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:09 smithi132 bash[27079]: audit 2020-07-16T13:40:09.130713+0000 mon.b (mon.2) 169 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:40:10.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:09 smithi132 bash[27079]: cephadm 2020-07-16T13:40:09.131440+0000 mgr.x (mgr.34562) 73 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:40:10.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:09 smithi132 bash[27079]: cephadm 2020-07-16T13:40:09.131604+0000 mgr.x (mgr.34562) 74 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:40:10.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:09 smithi132 bash[27079]: cluster 2020-07-16T13:40:09.513216+0000 mgr.x (mgr.34562) 75 : cluster [DBG] pgmap v45: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:40:10.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:09 smithi188 bash[23329]: audit 2020-07-16T13:40:09.130713+0000 mon.b (mon.2) 169 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:40:10.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:09 smithi188 bash[23329]: cephadm 2020-07-16T13:40:09.131440+0000 mgr.x (mgr.34562) 73 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:40:10.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:09 smithi188 bash[23329]: cephadm 2020-07-16T13:40:09.131604+0000 mgr.x (mgr.34562) 74 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:40:10.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:09 smithi188 bash[23329]: cluster 2020-07-16T13:40:09.513216+0000 mgr.x (mgr.34562) 75 : cluster [DBG] pgmap v45: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:40:12.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:12 smithi188 bash[23329]: cluster 2020-07-16T13:40:11.513560+0000 mgr.x (mgr.34562) 76 : cluster [DBG] pgmap v46: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:40:13.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:12 smithi132 bash[27079]: cluster 2020-07-16T13:40:11.513560+0000 mgr.x (mgr.34562) 76 : cluster [DBG] pgmap v46: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:40:14.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:14 smithi188 bash[23329]: cluster 2020-07-16T13:40:13.514076+0000 mgr.x (mgr.34562) 77 : cluster [DBG] pgmap v47: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:40:15.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:14 smithi132 bash[27079]: cluster 2020-07-16T13:40:13.514076+0000 mgr.x (mgr.34562) 77 : cluster [DBG] pgmap v47: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:40:16.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:16 smithi188 bash[23329]: cluster 2020-07-16T13:40:15.514590+0000 mgr.x (mgr.34562) 78 : cluster [DBG] pgmap v48: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:40:17.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:16 smithi132 bash[27079]: cluster 2020-07-16T13:40:15.514590+0000 mgr.x (mgr.34562) 78 : cluster [DBG] pgmap v48: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:40:18.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:18 smithi188 bash[23329]: cluster 2020-07-16T13:40:17.515173+0000 mgr.x (mgr.34562) 79 : cluster [DBG] pgmap v49: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:40:19.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:18 smithi132 bash[27079]: cluster 2020-07-16T13:40:17.515173+0000 mgr.x (mgr.34562) 79 : cluster [DBG] pgmap v49: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:40:19.156 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T13:40:19.416 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T13:40:19.417 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (3m) 91s ago 6m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T13:40:19.417 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (5m) 90s ago 5m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T13:40:19.417 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (3m) 90s ago 8m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T13:40:19.417 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2m) 91s ago 10m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T13:40:19.418 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 91s ago 10m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T13:40:19.418 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (9m) 90s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T13:40:19.418 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (9m) 91s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T13:40:19.418 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (6m) 91s ago 6m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T13:40:19.418 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (6m) 90s ago 6m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T13:40:19.419 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (8m) 91s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T13:40:19.419 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (8m) 91s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T13:40:19.419 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (8m) 91s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T13:40:19.419 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (7m) 91s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T13:40:19.419 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (7m) 90s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T13:40:19.420 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (7m) 90s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T13:40:19.420 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (6m) 90s ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T13:40:19.420 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (6m) 90s ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T13:40:19.420 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (5m) 90s ago 6m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T13:40:19.715 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T13:40:19.716 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T13:40:19.716 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T13:40:19.716 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T13:40:19.716 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:40:19.717 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T13:40:19.717 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T13:40:19.717 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:40:19.717 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T13:40:19.717 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T13:40:19.718 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:40:19.718 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T13:40:19.718 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T13:40:19.718 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T13:40:19.719 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T13:40:19.719 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T13:40:19.719 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T13:40:20.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:19 smithi132 bash[27079]: audit 2020-07-16T13:40:19.144084+0000 mgr.x (mgr.34562) 80 : audit [DBG] from='client.24694 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:40:20.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:19 smithi132 bash[27079]: audit 2020-07-16T13:40:19.412204+0000 mgr.x (mgr.34562) 81 : audit [DBG] from='client.24700 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:40:20.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:19 smithi132 bash[27079]: cluster 2020-07-16T13:40:19.515642+0000 mgr.x (mgr.34562) 82 : cluster [DBG] pgmap v50: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:40:20.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:19 smithi132 bash[27079]: audit 2020-07-16T13:40:19.714897+0000 mon.c (mon.1) 65 : audit [DBG] from='client.? 172.21.15.132:0/1844419520' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:40:20.425 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:19 smithi188 bash[23329]: audit 2020-07-16T13:40:19.144084+0000 mgr.x (mgr.34562) 80 : audit [DBG] from='client.24694 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:40:20.425 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:19 smithi188 bash[23329]: audit 2020-07-16T13:40:19.412204+0000 mgr.x (mgr.34562) 81 : audit [DBG] from='client.24700 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:40:20.425 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:19 smithi188 bash[23329]: cluster 2020-07-16T13:40:19.515642+0000 mgr.x (mgr.34562) 82 : cluster [DBG] pgmap v50: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:40:20.426 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:19 smithi188 bash[23329]: audit 2020-07-16T13:40:19.714897+0000 mon.c (mon.1) 65 : audit [DBG] from='client.? 172.21.15.132:0/1844419520' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:40:22.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:22 smithi188 bash[23329]: cluster 2020-07-16T13:40:21.516124+0000 mgr.x (mgr.34562) 83 : cluster [DBG] pgmap v51: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:40:23.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:22 smithi132 bash[27079]: cluster 2020-07-16T13:40:21.516124+0000 mgr.x (mgr.34562) 83 : cluster [DBG] pgmap v51: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:40:24.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:24 smithi188 bash[23329]: cluster 2020-07-16T13:40:23.516629+0000 mgr.x (mgr.34562) 84 : cluster [DBG] pgmap v52: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:40:24.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:24 smithi188 bash[23329]: audit 2020-07-16T13:40:24.147133+0000 mon.b (mon.2) 170 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:40:25.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:24 smithi132 bash[27079]: cluster 2020-07-16T13:40:23.516629+0000 mgr.x (mgr.34562) 84 : cluster [DBG] pgmap v52: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:40:25.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:24 smithi132 bash[27079]: audit 2020-07-16T13:40:24.147133+0000 mon.b (mon.2) 170 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:40:25.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:25 smithi188 bash[23329]: cephadm 2020-07-16T13:40:24.147869+0000 mgr.x (mgr.34562) 85 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:40:25.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:25 smithi188 bash[23329]: cephadm 2020-07-16T13:40:24.148114+0000 mgr.x (mgr.34562) 86 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:40:26.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:25 smithi132 bash[27079]: cephadm 2020-07-16T13:40:24.147869+0000 mgr.x (mgr.34562) 85 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:40:26.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:25 smithi132 bash[27079]: cephadm 2020-07-16T13:40:24.148114+0000 mgr.x (mgr.34562) 86 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:40:26.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:26 smithi188 bash[23329]: cluster 2020-07-16T13:40:25.517155+0000 mgr.x (mgr.34562) 87 : cluster [DBG] pgmap v53: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:40:27.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:26 smithi132 bash[27079]: cluster 2020-07-16T13:40:25.517155+0000 mgr.x (mgr.34562) 87 : cluster [DBG] pgmap v53: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:40:28.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:28 smithi188 bash[23329]: cluster 2020-07-16T13:40:27.517636+0000 mgr.x (mgr.34562) 88 : cluster [DBG] pgmap v54: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:40:29.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:28 smithi132 bash[27079]: cluster 2020-07-16T13:40:27.517636+0000 mgr.x (mgr.34562) 88 : cluster [DBG] pgmap v54: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:40:30.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:29 smithi132 bash[27079]: cluster 2020-07-16T13:40:29.518164+0000 mgr.x (mgr.34562) 89 : cluster [DBG] pgmap v55: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:40:30.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:29 smithi188 bash[23329]: cluster 2020-07-16T13:40:29.518164+0000 mgr.x (mgr.34562) 89 : cluster [DBG] pgmap v55: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:40:32.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:32 smithi188 bash[23329]: cluster 2020-07-16T13:40:31.518547+0000 mgr.x (mgr.34562) 90 : cluster [DBG] pgmap v56: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:40:33.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:32 smithi132 bash[27079]: cluster 2020-07-16T13:40:31.518547+0000 mgr.x (mgr.34562) 90 : cluster [DBG] pgmap v56: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:40:34.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:34 smithi188 bash[23329]: cluster 2020-07-16T13:40:33.519045+0000 mgr.x (mgr.34562) 91 : cluster [DBG] pgmap v57: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:40:35.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:34 smithi132 bash[27079]: cluster 2020-07-16T13:40:33.519045+0000 mgr.x (mgr.34562) 91 : cluster [DBG] pgmap v57: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:40:36.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:36 smithi188 bash[23329]: cluster 2020-07-16T13:40:35.519546+0000 mgr.x (mgr.34562) 92 : cluster [DBG] pgmap v58: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:40:37.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:36 smithi132 bash[27079]: cluster 2020-07-16T13:40:35.519546+0000 mgr.x (mgr.34562) 92 : cluster [DBG] pgmap v58: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:40:38.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:38 smithi188 bash[23329]: cluster 2020-07-16T13:40:37.519968+0000 mgr.x (mgr.34562) 93 : cluster [DBG] pgmap v59: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:40:39.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:38 smithi132 bash[27079]: cluster 2020-07-16T13:40:37.519968+0000 mgr.x (mgr.34562) 93 : cluster [DBG] pgmap v59: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:40:40.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:39 smithi132 bash[27079]: audit 2020-07-16T13:40:39.163827+0000 mon.b (mon.2) 171 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:40:40.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:39 smithi132 bash[27079]: cephadm 2020-07-16T13:40:39.164555+0000 mgr.x (mgr.34562) 94 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:40:40.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:39 smithi132 bash[27079]: cephadm 2020-07-16T13:40:39.164702+0000 mgr.x (mgr.34562) 95 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:40:40.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:39 smithi132 bash[27079]: cluster 2020-07-16T13:40:39.520414+0000 mgr.x (mgr.34562) 96 : cluster [DBG] pgmap v60: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:40:40.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:39 smithi188 bash[23329]: audit 2020-07-16T13:40:39.163827+0000 mon.b (mon.2) 171 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:40:40.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:39 smithi188 bash[23329]: cephadm 2020-07-16T13:40:39.164555+0000 mgr.x (mgr.34562) 94 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:40:40.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:39 smithi188 bash[23329]: cephadm 2020-07-16T13:40:39.164702+0000 mgr.x (mgr.34562) 95 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:40:40.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:39 smithi188 bash[23329]: cluster 2020-07-16T13:40:39.520414+0000 mgr.x (mgr.34562) 96 : cluster [DBG] pgmap v60: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:40:42.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:42 smithi188 bash[23329]: cluster 2020-07-16T13:40:41.520753+0000 mgr.x (mgr.34562) 97 : cluster [DBG] pgmap v61: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:40:43.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:42 smithi132 bash[27079]: cluster 2020-07-16T13:40:41.520753+0000 mgr.x (mgr.34562) 97 : cluster [DBG] pgmap v61: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:40:44.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:44 smithi188 bash[23329]: cluster 2020-07-16T13:40:43.521233+0000 mgr.x (mgr.34562) 98 : cluster [DBG] pgmap v62: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:40:45.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:44 smithi132 bash[27079]: cluster 2020-07-16T13:40:43.521233+0000 mgr.x (mgr.34562) 98 : cluster [DBG] pgmap v62: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:40:46.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:46 smithi188 bash[23329]: cluster 2020-07-16T13:40:45.521769+0000 mgr.x (mgr.34562) 99 : cluster [DBG] pgmap v63: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:40:47.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:46 smithi132 bash[27079]: cluster 2020-07-16T13:40:45.521769+0000 mgr.x (mgr.34562) 99 : cluster [DBG] pgmap v63: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:40:48.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:48 smithi188 bash[23329]: cluster 2020-07-16T13:40:47.522158+0000 mgr.x (mgr.34562) 100 : cluster [DBG] pgmap v64: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:40:49.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:48 smithi132 bash[27079]: cluster 2020-07-16T13:40:47.522158+0000 mgr.x (mgr.34562) 100 : cluster [DBG] pgmap v64: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:40:50.026 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T13:40:50.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:49 smithi132 bash[27079]: cluster 2020-07-16T13:40:49.522568+0000 mgr.x (mgr.34562) 101 : cluster [DBG] pgmap v65: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:40:50.287 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T13:40:50.288 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (3m) 2m ago 6m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T13:40:50.288 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (6m) 2m ago 6m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T13:40:50.288 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (3m) 2m ago 9m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T13:40:50.288 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (3m) 2m ago 11m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T13:40:50.288 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 2m ago 11m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T13:40:50.289 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (9m) 2m ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T13:40:50.289 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (9m) 2m ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T13:40:50.289 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (6m) 2m ago 6m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T13:40:50.289 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (6m) 2m ago 6m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T13:40:50.289 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (9m) 2m ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T13:40:50.290 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (8m) 2m ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T13:40:50.290 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (8m) 2m ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T13:40:50.290 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (8m) 2m ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T13:40:50.290 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (7m) 2m ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T13:40:50.290 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (7m) 2m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T13:40:50.291 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (7m) 2m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T13:40:50.291 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (7m) 2m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T13:40:50.291 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (6m) 2m ago 6m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T13:40:50.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:49 smithi188 bash[23329]: cluster 2020-07-16T13:40:49.522568+0000 mgr.x (mgr.34562) 101 : cluster [DBG] pgmap v65: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:40:50.588 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T13:40:50.588 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T13:40:50.588 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T13:40:50.588 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T13:40:50.589 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:40:50.589 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T13:40:50.589 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T13:40:50.589 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:40:50.589 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T13:40:50.590 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T13:40:50.590 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:40:50.590 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T13:40:50.590 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T13:40:50.590 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T13:40:50.591 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T13:40:50.591 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T13:40:50.591 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T13:40:51.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:50 smithi132 bash[27079]: audit 2020-07-16T13:40:50.013511+0000 mgr.x (mgr.34562) 102 : audit [DBG] from='client.24712 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:40:51.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:50 smithi132 bash[27079]: audit 2020-07-16T13:40:50.283377+0000 mgr.x (mgr.34562) 103 : audit [DBG] from='client.24718 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:40:51.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:50 smithi132 bash[27079]: audit 2020-07-16T13:40:50.587056+0000 mon.c (mon.1) 66 : audit [DBG] from='client.? 172.21.15.132:0/759007443' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:40:51.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:50 smithi188 bash[23329]: audit 2020-07-16T13:40:50.013511+0000 mgr.x (mgr.34562) 102 : audit [DBG] from='client.24712 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:40:51.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:50 smithi188 bash[23329]: audit 2020-07-16T13:40:50.283377+0000 mgr.x (mgr.34562) 103 : audit [DBG] from='client.24718 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:40:51.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:50 smithi188 bash[23329]: audit 2020-07-16T13:40:50.587056+0000 mon.c (mon.1) 66 : audit [DBG] from='client.? 172.21.15.132:0/759007443' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:40:52.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:51 smithi132 bash[27079]: cluster 2020-07-16T13:40:51.523116+0000 mgr.x (mgr.34562) 104 : cluster [DBG] pgmap v66: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:40:52.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:51 smithi188 bash[23329]: cluster 2020-07-16T13:40:51.523116+0000 mgr.x (mgr.34562) 104 : cluster [DBG] pgmap v66: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:40:54.925 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:54 smithi188 bash[23329]: cluster 2020-07-16T13:40:53.523634+0000 mgr.x (mgr.34562) 105 : cluster [DBG] pgmap v67: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:40:54.926 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:54 smithi188 bash[23329]: audit 2020-07-16T13:40:54.403771+0000 mon.b (mon.2) 172 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T13:38:48.267077\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267138\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267175\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267204\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267389\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267502\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267607\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267711\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267745\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T13:38:48.267821\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:40:54.402888\"}"}]: dispatch 2020-07-16T13:40:54.926 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:54 smithi188 bash[23329]: audit 2020-07-16T13:40:54.404378+0000 mon.c (mon.1) 67 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T13:38:48.267077\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267138\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267175\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267204\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267389\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267502\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267607\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267711\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267745\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T13:38:48.267821\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:40:54.402888\"}"}]: dispatch 2020-07-16T13:40:54.929 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:54 smithi188 bash[23329]: audit 2020-07-16T13:40:54.407077+0000 mon.c (mon.1) 68 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T13:38:48.267077\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267138\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267175\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267204\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267389\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267502\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267607\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267711\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267745\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T13:38:48.267821\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:40:54.402888\"}"}]': finished 2020-07-16T13:40:54.930 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:54 smithi188 bash[23329]: audit 2020-07-16T13:40:54.408404+0000 mon.b (mon.2) 173 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.512945\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513017\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513050\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513209\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513324\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513431\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513534\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513584\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513611\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:38:48.513684\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:40:54.407611\"}"}]: dispatch 2020-07-16T13:40:54.930 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:54 smithi188 bash[23329]: audit 2020-07-16T13:40:54.408828+0000 mon.c (mon.1) 69 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.512945\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513017\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513050\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513209\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513324\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513431\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513534\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513584\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513611\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:38:48.513684\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:40:54.407611\"}"}]: dispatch 2020-07-16T13:40:54.930 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:54 smithi188 bash[23329]: audit 2020-07-16T13:40:54.410808+0000 mon.c (mon.1) 70 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.512945\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513017\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513050\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513209\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513324\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513431\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513534\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513584\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513611\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:38:48.513684\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:40:54.407611\"}"}]': finished 2020-07-16T13:40:54.931 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:54 smithi188 bash[23329]: audit 2020-07-16T13:40:54.413178+0000 mon.b (mon.2) 174 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:40:54.931 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:54 smithi188 bash[23329]: audit 2020-07-16T13:40:54.414171+0000 mon.b (mon.2) 175 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:40:54.931 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:54 smithi188 bash[23329]: audit 2020-07-16T13:40:54.415042+0000 mon.b (mon.2) 176 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:40:54.931 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:54 smithi188 bash[23329]: audit 2020-07-16T13:40:54.416062+0000 mon.b (mon.2) 177 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T13:40:54.932 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:54 smithi188 bash[23329]: audit 2020-07-16T13:40:54.416965+0000 mon.b (mon.2) 178 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:40:54.933 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:54 smithi132 bash[27079]: cluster 2020-07-16T13:40:53.523634+0000 mgr.x (mgr.34562) 105 : cluster [DBG] pgmap v67: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:40:54.933 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:54 smithi132 bash[27079]: audit 2020-07-16T13:40:54.403771+0000 mon.b (mon.2) 172 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T13:38:48.267077\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267138\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267175\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267204\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267389\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267502\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267607\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267711\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267745\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T13:38:48.267821\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:40:54.402888\"}"}]: dispatch 2020-07-16T13:40:54.934 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:54 smithi132 bash[27079]: audit 2020-07-16T13:40:54.404378+0000 mon.c (mon.1) 67 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T13:38:48.267077\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267138\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267175\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267204\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267389\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267502\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267607\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267711\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267745\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T13:38:48.267821\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:40:54.402888\"}"}]: dispatch 2020-07-16T13:40:54.934 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:54 smithi132 bash[27079]: audit 2020-07-16T13:40:54.407077+0000 mon.c (mon.1) 68 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T13:38:48.267077\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267138\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267175\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267204\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267389\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267502\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267607\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267711\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.267745\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T13:38:48.267821\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:40:54.402888\"}"}]': finished 2020-07-16T13:40:54.935 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:54 smithi132 bash[27079]: audit 2020-07-16T13:40:54.408404+0000 mon.b (mon.2) 173 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.512945\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513017\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513050\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513209\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513324\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513431\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513534\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513584\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513611\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:38:48.513684\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:40:54.407611\"}"}]: dispatch 2020-07-16T13:40:54.935 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:54 smithi132 bash[27079]: audit 2020-07-16T13:40:54.408828+0000 mon.c (mon.1) 69 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.512945\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513017\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513050\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513209\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513324\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513431\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513534\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513584\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513611\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:38:48.513684\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:40:54.407611\"}"}]: dispatch 2020-07-16T13:40:54.936 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:54 smithi132 bash[27079]: audit 2020-07-16T13:40:54.410808+0000 mon.c (mon.1) 70 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.512945\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513017\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513050\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513209\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513324\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513431\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513534\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513584\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:38:48.513611\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:38:48.513684\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:40:54.407611\"}"}]': finished 2020-07-16T13:40:54.936 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:54 smithi132 bash[27079]: audit 2020-07-16T13:40:54.413178+0000 mon.b (mon.2) 174 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:40:54.937 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:54 smithi132 bash[27079]: audit 2020-07-16T13:40:54.414171+0000 mon.b (mon.2) 175 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:40:54.937 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:54 smithi132 bash[27079]: audit 2020-07-16T13:40:54.415042+0000 mon.b (mon.2) 176 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:40:54.937 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:54 smithi132 bash[27079]: audit 2020-07-16T13:40:54.416062+0000 mon.b (mon.2) 177 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T13:40:54.938 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:54 smithi132 bash[27079]: audit 2020-07-16T13:40:54.416965+0000 mon.b (mon.2) 178 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:40:55.856 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:55 smithi132 bash[27079]: audit 2020-07-16T13:40:54.413458+0000 mgr.x (mgr.34562) 106 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:40:55.856 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:55 smithi132 bash[27079]: audit 2020-07-16T13:40:54.414423+0000 mgr.x (mgr.34562) 107 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:40:55.856 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:55 smithi132 bash[27079]: audit 2020-07-16T13:40:54.415272+0000 mgr.x (mgr.34562) 108 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:40:55.856 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:55 smithi132 bash[27079]: cephadm 2020-07-16T13:40:54.415780+0000 mgr.x (mgr.34562) 109 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T13:40:55.857 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:55 smithi132 bash[27079]: cephadm 2020-07-16T13:40:54.416668+0000 mgr.x (mgr.34562) 110 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T13:40:55.857 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:55 smithi132 bash[27079]: cephadm 2020-07-16T13:40:54.417471+0000 mgr.x (mgr.34562) 111 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T13:40:55.857 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:55 smithi132 bash[27079]: cephadm 2020-07-16T13:40:54.417587+0000 mgr.x (mgr.34562) 112 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T13:40:55.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:55 smithi188 bash[23329]: audit 2020-07-16T13:40:54.413458+0000 mgr.x (mgr.34562) 106 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:40:55.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:55 smithi188 bash[23329]: audit 2020-07-16T13:40:54.414423+0000 mgr.x (mgr.34562) 107 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:40:55.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:55 smithi188 bash[23329]: audit 2020-07-16T13:40:54.415272+0000 mgr.x (mgr.34562) 108 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:40:55.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:55 smithi188 bash[23329]: cephadm 2020-07-16T13:40:54.415780+0000 mgr.x (mgr.34562) 109 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T13:40:55.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:55 smithi188 bash[23329]: cephadm 2020-07-16T13:40:54.416668+0000 mgr.x (mgr.34562) 110 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T13:40:55.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:55 smithi188 bash[23329]: cephadm 2020-07-16T13:40:54.417471+0000 mgr.x (mgr.34562) 111 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T13:40:55.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:55 smithi188 bash[23329]: cephadm 2020-07-16T13:40:54.417587+0000 mgr.x (mgr.34562) 112 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T13:40:56.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:56 smithi188 bash[23329]: cluster 2020-07-16T13:40:55.524072+0000 mgr.x (mgr.34562) 113 : cluster [DBG] pgmap v68: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:40:57.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:56 smithi132 bash[27079]: cluster 2020-07-16T13:40:55.524072+0000 mgr.x (mgr.34562) 113 : cluster [DBG] pgmap v68: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:40:57.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:57 smithi188 bash[23329]: audit 2020-07-16T13:40:57.206649+0000 mon.b (mon.2) 179 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:40:58.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:57 smithi132 bash[27079]: audit 2020-07-16T13:40:57.206649+0000 mon.b (mon.2) 179 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:40:58.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:58 smithi188 bash[23329]: cephadm 2020-07-16T13:40:57.207233+0000 mgr.x (mgr.34562) 114 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:40:58.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:58 smithi188 bash[23329]: cephadm 2020-07-16T13:40:57.207654+0000 mgr.x (mgr.34562) 115 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:40:58.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:58 smithi188 bash[23329]: cluster 2020-07-16T13:40:57.524535+0000 mgr.x (mgr.34562) 116 : cluster [DBG] pgmap v69: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:40:59.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:58 smithi132 bash[27079]: cephadm 2020-07-16T13:40:57.207233+0000 mgr.x (mgr.34562) 114 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:40:59.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:58 smithi132 bash[27079]: cephadm 2020-07-16T13:40:57.207654+0000 mgr.x (mgr.34562) 115 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:40:59.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:58 smithi132 bash[27079]: cluster 2020-07-16T13:40:57.524535+0000 mgr.x (mgr.34562) 116 : cluster [DBG] pgmap v69: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:41:00.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:40:59 smithi132 bash[27079]: cluster 2020-07-16T13:40:59.524950+0000 mgr.x (mgr.34562) 117 : cluster [DBG] pgmap v70: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:41:00.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:40:59 smithi188 bash[23329]: cluster 2020-07-16T13:40:59.524950+0000 mgr.x (mgr.34562) 117 : cluster [DBG] pgmap v70: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:41:02.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:41:02 smithi188 bash[23329]: cluster 2020-07-16T13:41:01.525478+0000 mgr.x (mgr.34562) 118 : cluster [DBG] pgmap v71: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:41:03.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:41:02 smithi132 bash[27079]: cluster 2020-07-16T13:41:01.525478+0000 mgr.x (mgr.34562) 118 : cluster [DBG] pgmap v71: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:41:04.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:41:04 smithi188 bash[23329]: cluster 2020-07-16T13:41:03.526052+0000 mgr.x (mgr.34562) 119 : cluster [DBG] pgmap v72: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:41:05.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:41:04 smithi132 bash[27079]: cluster 2020-07-16T13:41:03.526052+0000 mgr.x (mgr.34562) 119 : cluster [DBG] pgmap v72: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:41:06.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:41:06 smithi188 bash[23329]: cluster 2020-07-16T13:41:05.526543+0000 mgr.x (mgr.34562) 120 : cluster [DBG] pgmap v73: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:41:07.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:41:06 smithi132 bash[27079]: cluster 2020-07-16T13:41:05.526543+0000 mgr.x (mgr.34562) 120 : cluster [DBG] pgmap v73: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:41:08.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:41:08 smithi188 bash[23329]: cluster 2020-07-16T13:41:07.526904+0000 mgr.x (mgr.34562) 121 : cluster [DBG] pgmap v74: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:41:09.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:41:08 smithi132 bash[27079]: cluster 2020-07-16T13:41:07.526904+0000 mgr.x (mgr.34562) 121 : cluster [DBG] pgmap v74: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:41:10.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:41:09 smithi132 bash[27079]: cluster 2020-07-16T13:41:09.527516+0000 mgr.x (mgr.34562) 122 : cluster [DBG] pgmap v75: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:41:10.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:41:09 smithi188 bash[23329]: cluster 2020-07-16T13:41:09.527516+0000 mgr.x (mgr.34562) 122 : cluster [DBG] pgmap v75: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:41:12.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:41:12 smithi188 bash[23329]: cluster 2020-07-16T13:41:11.528023+0000 mgr.x (mgr.34562) 123 : cluster [DBG] pgmap v76: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:41:12.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:41:12 smithi188 bash[23329]: audit 2020-07-16T13:41:12.223146+0000 mon.b (mon.2) 180 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:41:13.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:41:12 smithi132 bash[27079]: cluster 2020-07-16T13:41:11.528023+0000 mgr.x (mgr.34562) 123 : cluster [DBG] pgmap v76: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:41:13.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:41:12 smithi132 bash[27079]: audit 2020-07-16T13:41:12.223146+0000 mon.b (mon.2) 180 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:41:13.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:41:13 smithi188 bash[23329]: cephadm 2020-07-16T13:41:12.223837+0000 mgr.x (mgr.34562) 124 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:41:13.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:41:13 smithi188 bash[23329]: cephadm 2020-07-16T13:41:12.223923+0000 mgr.x (mgr.34562) 125 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:41:14.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:41:13 smithi132 bash[27079]: cephadm 2020-07-16T13:41:12.223837+0000 mgr.x (mgr.34562) 124 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:41:14.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:41:13 smithi132 bash[27079]: cephadm 2020-07-16T13:41:12.223923+0000 mgr.x (mgr.34562) 125 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:41:14.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:41:14 smithi188 bash[23329]: cluster 2020-07-16T13:41:13.528418+0000 mgr.x (mgr.34562) 126 : cluster [DBG] pgmap v77: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:41:15.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:41:14 smithi132 bash[27079]: cluster 2020-07-16T13:41:13.528418+0000 mgr.x (mgr.34562) 126 : cluster [DBG] pgmap v77: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:41:16.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:41:16 smithi188 bash[23329]: cluster 2020-07-16T13:41:15.528916+0000 mgr.x (mgr.34562) 127 : cluster [DBG] pgmap v78: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:41:17.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:41:16 smithi132 bash[27079]: cluster 2020-07-16T13:41:15.528916+0000 mgr.x (mgr.34562) 127 : cluster [DBG] pgmap v78: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:41:18.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:41:18 smithi188 bash[23329]: cluster 2020-07-16T13:41:17.529512+0000 mgr.x (mgr.34562) 128 : cluster [DBG] pgmap v79: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:41:19.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:41:18 smithi132 bash[27079]: cluster 2020-07-16T13:41:17.529512+0000 mgr.x (mgr.34562) 128 : cluster [DBG] pgmap v79: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:41:20.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:41:19 smithi132 bash[27079]: cluster 2020-07-16T13:41:19.530050+0000 mgr.x (mgr.34562) 129 : cluster [DBG] pgmap v80: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:41:20.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:41:19 smithi188 bash[23329]: cluster 2020-07-16T13:41:19.530050+0000 mgr.x (mgr.34562) 129 : cluster [DBG] pgmap v80: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:41:20.886 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T13:41:21.152 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T13:41:21.152 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (4m) 2m ago 7m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T13:41:21.152 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (6m) 2m ago 6m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T13:41:21.152 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (4m) 2m ago 9m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T13:41:21.153 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (3m) 2m ago 11m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T13:41:21.153 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 2m ago 11m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T13:41:21.153 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (10m) 2m ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T13:41:21.153 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (10m) 2m ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T13:41:21.153 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (7m) 2m ago 7m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T13:41:21.154 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (7m) 2m ago 7m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T13:41:21.154 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (9m) 2m ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T13:41:21.154 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (9m) 2m ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T13:41:21.154 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (9m) 2m ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T13:41:21.154 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (8m) 2m ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T13:41:21.155 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (8m) 2m ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T13:41:21.155 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (8m) 2m ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T13:41:21.155 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (7m) 2m ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T13:41:21.155 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (7m) 2m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T13:41:21.156 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (6m) 2m ago 7m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T13:41:21.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:41:20 smithi132 bash[27079]: audit 2020-07-16T13:41:20.874194+0000 mgr.x (mgr.34562) 130 : audit [DBG] from='client.24730 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:41:21.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:41:20 smithi188 bash[23329]: audit 2020-07-16T13:41:20.874194+0000 mgr.x (mgr.34562) 130 : audit [DBG] from='client.24730 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:41:21.454 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T13:41:21.454 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T13:41:21.455 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T13:41:21.455 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T13:41:21.455 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:41:21.455 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T13:41:21.455 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T13:41:21.456 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:41:21.456 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T13:41:21.456 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T13:41:21.456 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:41:21.457 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T13:41:21.457 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T13:41:21.457 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T13:41:21.457 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T13:41:21.458 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T13:41:21.458 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T13:41:22.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:41:21 smithi132 bash[27079]: audit 2020-07-16T13:41:21.147419+0000 mgr.x (mgr.34562) 131 : audit [DBG] from='client.24736 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:41:22.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:41:21 smithi132 bash[27079]: audit 2020-07-16T13:41:21.453495+0000 mon.c (mon.1) 71 : audit [DBG] from='client.? 172.21.15.132:0/3265660169' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:41:22.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:41:21 smithi132 bash[27079]: cluster 2020-07-16T13:41:21.530639+0000 mgr.x (mgr.34562) 132 : cluster [DBG] pgmap v81: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:41:22.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:41:21 smithi188 bash[23329]: audit 2020-07-16T13:41:21.147419+0000 mgr.x (mgr.34562) 131 : audit [DBG] from='client.24736 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:41:22.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:41:21 smithi188 bash[23329]: audit 2020-07-16T13:41:21.453495+0000 mon.c (mon.1) 71 : audit [DBG] from='client.? 172.21.15.132:0/3265660169' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:41:22.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:41:21 smithi188 bash[23329]: cluster 2020-07-16T13:41:21.530639+0000 mgr.x (mgr.34562) 132 : cluster [DBG] pgmap v81: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:41:24.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:41:24 smithi188 bash[23329]: cluster 2020-07-16T13:41:23.531148+0000 mgr.x (mgr.34562) 133 : cluster [DBG] pgmap v82: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:41:25.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:41:24 smithi132 bash[27079]: cluster 2020-07-16T13:41:23.531148+0000 mgr.x (mgr.34562) 133 : cluster [DBG] pgmap v82: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:41:26.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:41:26 smithi188 bash[23329]: cluster 2020-07-16T13:41:25.531498+0000 mgr.x (mgr.34562) 134 : cluster [DBG] pgmap v83: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:41:27.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:41:26 smithi132 bash[27079]: cluster 2020-07-16T13:41:25.531498+0000 mgr.x (mgr.34562) 134 : cluster [DBG] pgmap v83: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:41:27.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:41:27 smithi188 bash[23329]: audit 2020-07-16T13:41:27.239504+0000 mon.b (mon.2) 181 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:41:28.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:41:27 smithi132 bash[27079]: audit 2020-07-16T13:41:27.239504+0000 mon.b (mon.2) 181 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:41:28.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:41:28 smithi188 bash[23329]: cephadm 2020-07-16T13:41:27.240240+0000 mgr.x (mgr.34562) 135 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:41:28.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:41:28 smithi188 bash[23329]: cephadm 2020-07-16T13:41:27.240660+0000 mgr.x (mgr.34562) 136 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:41:28.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:41:28 smithi188 bash[23329]: cluster 2020-07-16T13:41:27.531891+0000 mgr.x (mgr.34562) 137 : cluster [DBG] pgmap v84: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:41:29.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:41:28 smithi132 bash[27079]: cephadm 2020-07-16T13:41:27.240240+0000 mgr.x (mgr.34562) 135 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:41:29.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:41:28 smithi132 bash[27079]: cephadm 2020-07-16T13:41:27.240660+0000 mgr.x (mgr.34562) 136 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:41:29.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:41:28 smithi132 bash[27079]: cluster 2020-07-16T13:41:27.531891+0000 mgr.x (mgr.34562) 137 : cluster [DBG] pgmap v84: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:41:30.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:41:29 smithi132 bash[27079]: cluster 2020-07-16T13:41:29.532336+0000 mgr.x (mgr.34562) 138 : cluster [DBG] pgmap v85: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:41:30.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:41:29 smithi188 bash[23329]: cluster 2020-07-16T13:41:29.532336+0000 mgr.x (mgr.34562) 138 : cluster [DBG] pgmap v85: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:41:32.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:41:32 smithi188 bash[23329]: cluster 2020-07-16T13:41:31.532713+0000 mgr.x (mgr.34562) 139 : cluster [DBG] pgmap v86: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:41:33.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:41:32 smithi132 bash[27079]: cluster 2020-07-16T13:41:31.532713+0000 mgr.x (mgr.34562) 139 : cluster [DBG] pgmap v86: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:41:34.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:41:34 smithi188 bash[23329]: cluster 2020-07-16T13:41:33.533197+0000 mgr.x (mgr.34562) 140 : cluster [DBG] pgmap v87: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:41:35.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:41:34 smithi132 bash[27079]: cluster 2020-07-16T13:41:33.533197+0000 mgr.x (mgr.34562) 140 : cluster [DBG] pgmap v87: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:41:36.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:41:36 smithi188 bash[23329]: cluster 2020-07-16T13:41:35.533568+0000 mgr.x (mgr.34562) 141 : cluster [DBG] pgmap v88: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:41:37.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:41:36 smithi132 bash[27079]: cluster 2020-07-16T13:41:35.533568+0000 mgr.x (mgr.34562) 141 : cluster [DBG] pgmap v88: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:41:38.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:41:38 smithi188 bash[23329]: cluster 2020-07-16T13:41:37.534026+0000 mgr.x (mgr.34562) 142 : cluster [DBG] pgmap v89: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:41:39.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:41:38 smithi132 bash[27079]: cluster 2020-07-16T13:41:37.534026+0000 mgr.x (mgr.34562) 142 : cluster [DBG] pgmap v89: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:41:40.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:41:39 smithi132 bash[27079]: cluster 2020-07-16T13:41:39.534561+0000 mgr.x (mgr.34562) 143 : cluster [DBG] pgmap v90: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:41:40.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:41:39 smithi188 bash[23329]: cluster 2020-07-16T13:41:39.534561+0000 mgr.x (mgr.34562) 143 : cluster [DBG] pgmap v90: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:41:42.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:41:42 smithi188 bash[23329]: cluster 2020-07-16T13:41:41.535069+0000 mgr.x (mgr.34562) 144 : cluster [DBG] pgmap v91: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:41:42.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:41:42 smithi188 bash[23329]: audit 2020-07-16T13:41:42.256122+0000 mon.b (mon.2) 182 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:41:43.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:41:42 smithi132 bash[27079]: cluster 2020-07-16T13:41:41.535069+0000 mgr.x (mgr.34562) 144 : cluster [DBG] pgmap v91: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:41:43.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:41:42 smithi132 bash[27079]: audit 2020-07-16T13:41:42.256122+0000 mon.b (mon.2) 182 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:41:43.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:41:43 smithi188 bash[23329]: cephadm 2020-07-16T13:41:42.256898+0000 mgr.x (mgr.34562) 145 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:41:43.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:41:43 smithi188 bash[23329]: cephadm 2020-07-16T13:41:42.257072+0000 mgr.x (mgr.34562) 146 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:41:44.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:41:43 smithi132 bash[27079]: cephadm 2020-07-16T13:41:42.256898+0000 mgr.x (mgr.34562) 145 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:41:44.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:41:43 smithi132 bash[27079]: cephadm 2020-07-16T13:41:42.257072+0000 mgr.x (mgr.34562) 146 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:41:44.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:41:44 smithi188 bash[23329]: cluster 2020-07-16T13:41:43.535558+0000 mgr.x (mgr.34562) 147 : cluster [DBG] pgmap v92: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:41:45.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:41:44 smithi132 bash[27079]: cluster 2020-07-16T13:41:43.535558+0000 mgr.x (mgr.34562) 147 : cluster [DBG] pgmap v92: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:41:46.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:41:46 smithi188 bash[23329]: cluster 2020-07-16T13:41:45.535930+0000 mgr.x (mgr.34562) 148 : cluster [DBG] pgmap v93: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:41:47.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:41:46 smithi132 bash[27079]: cluster 2020-07-16T13:41:45.535930+0000 mgr.x (mgr.34562) 148 : cluster [DBG] pgmap v93: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:41:48.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:41:48 smithi188 bash[23329]: cluster 2020-07-16T13:41:47.536435+0000 mgr.x (mgr.34562) 149 : cluster [DBG] pgmap v94: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:41:49.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:41:48 smithi132 bash[27079]: cluster 2020-07-16T13:41:47.536435+0000 mgr.x (mgr.34562) 149 : cluster [DBG] pgmap v94: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:41:50.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:41:49 smithi132 bash[27079]: cluster 2020-07-16T13:41:49.536855+0000 mgr.x (mgr.34562) 150 : cluster [DBG] pgmap v95: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:41:50.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:41:49 smithi188 bash[23329]: cluster 2020-07-16T13:41:49.536855+0000 mgr.x (mgr.34562) 150 : cluster [DBG] pgmap v95: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:41:51.750 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T13:41:52.011 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T13:41:52.012 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (4m) 3m ago 7m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T13:41:52.012 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (7m) 3m ago 7m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T13:41:52.012 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (4m) 3m ago 10m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T13:41:52.012 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (4m) 3m ago 12m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T13:41:52.013 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 3m ago 12m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T13:41:52.013 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (10m) 3m ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T13:41:52.013 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (10m) 3m ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T13:41:52.013 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (7m) 3m ago 7m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T13:41:52.013 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (7m) 3m ago 7m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T13:41:52.014 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (10m) 3m ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T13:41:52.014 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (9m) 3m ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T13:41:52.014 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (9m) 3m ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T13:41:52.014 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (9m) 3m ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T13:41:52.014 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (8m) 3m ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T13:41:52.015 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (8m) 3m ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T13:41:52.015 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (8m) 3m ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T13:41:52.015 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (8m) 3m ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T13:41:52.015 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (7m) 3m ago 7m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T13:41:52.308 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T13:41:52.308 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T13:41:52.308 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T13:41:52.308 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T13:41:52.309 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:41:52.309 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T13:41:52.309 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T13:41:52.310 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:41:52.310 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T13:41:52.310 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T13:41:52.311 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:41:52.311 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T13:41:52.311 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T13:41:52.311 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T13:41:52.312 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T13:41:52.312 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T13:41:52.312 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T13:41:52.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:41:52 smithi188 bash[23329]: cluster 2020-07-16T13:41:51.537362+0000 mgr.x (mgr.34562) 151 : cluster [DBG] pgmap v96: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:41:52.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:41:52 smithi188 bash[23329]: audit 2020-07-16T13:41:51.739171+0000 mgr.x (mgr.34562) 152 : audit [DBG] from='client.24748 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:41:52.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:41:52 smithi188 bash[23329]: audit 2020-07-16T13:41:52.306997+0000 mon.c (mon.1) 72 : audit [DBG] from='client.? 172.21.15.132:0/3685765613' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:41:53.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:41:52 smithi132 bash[27079]: cluster 2020-07-16T13:41:51.537362+0000 mgr.x (mgr.34562) 151 : cluster [DBG] pgmap v96: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:41:53.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:41:52 smithi132 bash[27079]: audit 2020-07-16T13:41:51.739171+0000 mgr.x (mgr.34562) 152 : audit [DBG] from='client.24748 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:41:53.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:41:52 smithi132 bash[27079]: audit 2020-07-16T13:41:52.306997+0000 mon.c (mon.1) 72 : audit [DBG] from='client.? 172.21.15.132:0/3685765613' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:41:53.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:41:53 smithi188 bash[23329]: audit 2020-07-16T13:41:52.007506+0000 mgr.x (mgr.34562) 153 : audit [DBG] from='client.24754 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:41:54.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:41:53 smithi132 bash[27079]: audit 2020-07-16T13:41:52.007506+0000 mgr.x (mgr.34562) 153 : audit [DBG] from='client.24754 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:41:54.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:41:54 smithi188 bash[23329]: cluster 2020-07-16T13:41:53.537913+0000 mgr.x (mgr.34562) 154 : cluster [DBG] pgmap v97: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:41:55.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:41:54 smithi132 bash[27079]: cluster 2020-07-16T13:41:53.537913+0000 mgr.x (mgr.34562) 154 : cluster [DBG] pgmap v97: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:41:56.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:41:56 smithi188 bash[23329]: cluster 2020-07-16T13:41:55.538511+0000 mgr.x (mgr.34562) 155 : cluster [DBG] pgmap v98: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:41:57.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:41:56 smithi132 bash[27079]: cluster 2020-07-16T13:41:55.538511+0000 mgr.x (mgr.34562) 155 : cluster [DBG] pgmap v98: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:41:57.880 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:41:57 smithi132 bash[27079]: audit 2020-07-16T13:41:57.275310+0000 mon.b (mon.2) 183 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:41:57.880 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:41:57 smithi132 bash[27079]: audit 2020-07-16T13:41:57.276661+0000 mon.b (mon.2) 184 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:41:57.880 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:41:57 smithi132 bash[27079]: audit 2020-07-16T13:41:57.277867+0000 mon.b (mon.2) 185 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:41:57.880 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:41:57 smithi132 bash[27079]: audit 2020-07-16T13:41:57.279230+0000 mon.b (mon.2) 186 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T13:41:57.881 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:41:57 smithi132 bash[27079]: audit 2020-07-16T13:41:57.280367+0000 mon.b (mon.2) 187 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:41:57.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:41:57 smithi188 bash[23329]: audit 2020-07-16T13:41:57.275310+0000 mon.b (mon.2) 183 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:41:57.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:41:57 smithi188 bash[23329]: audit 2020-07-16T13:41:57.276661+0000 mon.b (mon.2) 184 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:41:57.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:41:57 smithi188 bash[23329]: audit 2020-07-16T13:41:57.277867+0000 mon.b (mon.2) 185 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:41:57.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:41:57 smithi188 bash[23329]: audit 2020-07-16T13:41:57.279230+0000 mon.b (mon.2) 186 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T13:41:57.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:41:57 smithi188 bash[23329]: audit 2020-07-16T13:41:57.280367+0000 mon.b (mon.2) 187 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:41:58.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:41:58 smithi188 bash[23329]: audit 2020-07-16T13:41:57.275686+0000 mgr.x (mgr.34562) 156 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:41:58.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:41:58 smithi188 bash[23329]: audit 2020-07-16T13:41:57.276967+0000 mgr.x (mgr.34562) 157 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:41:58.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:41:58 smithi188 bash[23329]: audit 2020-07-16T13:41:57.278138+0000 mgr.x (mgr.34562) 158 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:41:58.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:41:58 smithi188 bash[23329]: cephadm 2020-07-16T13:41:57.278887+0000 mgr.x (mgr.34562) 159 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T13:41:58.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:41:58 smithi188 bash[23329]: cephadm 2020-07-16T13:41:57.280066+0000 mgr.x (mgr.34562) 160 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T13:41:58.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:41:58 smithi188 bash[23329]: cephadm 2020-07-16T13:41:57.281056+0000 mgr.x (mgr.34562) 161 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T13:41:58.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:41:58 smithi188 bash[23329]: cephadm 2020-07-16T13:41:57.281307+0000 mgr.x (mgr.34562) 162 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T13:41:58.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:41:58 smithi188 bash[23329]: cluster 2020-07-16T13:41:57.538900+0000 mgr.x (mgr.34562) 163 : cluster [DBG] pgmap v99: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:41:59.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:41:58 smithi132 bash[27079]: audit 2020-07-16T13:41:57.275686+0000 mgr.x (mgr.34562) 156 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:41:59.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:41:58 smithi132 bash[27079]: audit 2020-07-16T13:41:57.276967+0000 mgr.x (mgr.34562) 157 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:41:59.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:41:58 smithi132 bash[27079]: audit 2020-07-16T13:41:57.278138+0000 mgr.x (mgr.34562) 158 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:41:59.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:41:58 smithi132 bash[27079]: cephadm 2020-07-16T13:41:57.278887+0000 mgr.x (mgr.34562) 159 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T13:41:59.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:41:58 smithi132 bash[27079]: cephadm 2020-07-16T13:41:57.280066+0000 mgr.x (mgr.34562) 160 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T13:41:59.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:41:58 smithi132 bash[27079]: cephadm 2020-07-16T13:41:57.281056+0000 mgr.x (mgr.34562) 161 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T13:41:59.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:41:58 smithi132 bash[27079]: cephadm 2020-07-16T13:41:57.281307+0000 mgr.x (mgr.34562) 162 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T13:41:59.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:41:58 smithi132 bash[27079]: cluster 2020-07-16T13:41:57.538900+0000 mgr.x (mgr.34562) 163 : cluster [DBG] pgmap v99: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:42:00.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:41:59 smithi132 bash[27079]: cluster 2020-07-16T13:41:59.539302+0000 mgr.x (mgr.34562) 164 : cluster [DBG] pgmap v100: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:42:00.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:41:59 smithi188 bash[23329]: cluster 2020-07-16T13:41:59.539302+0000 mgr.x (mgr.34562) 164 : cluster [DBG] pgmap v100: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:42:01.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:42:00 smithi132 bash[27079]: audit 2020-07-16T13:42:00.100849+0000 mon.b (mon.2) 188 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:42:01.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:42:00 smithi132 bash[27079]: cephadm 2020-07-16T13:42:00.101454+0000 mgr.x (mgr.34562) 165 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:42:01.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:42:00 smithi132 bash[27079]: cephadm 2020-07-16T13:42:00.101869+0000 mgr.x (mgr.34562) 166 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:42:01.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:42:00 smithi188 bash[23329]: audit 2020-07-16T13:42:00.100849+0000 mon.b (mon.2) 188 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:42:01.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:42:00 smithi188 bash[23329]: cephadm 2020-07-16T13:42:00.101454+0000 mgr.x (mgr.34562) 165 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:42:01.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:42:00 smithi188 bash[23329]: cephadm 2020-07-16T13:42:00.101869+0000 mgr.x (mgr.34562) 166 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:42:02.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:42:01 smithi132 bash[27079]: cluster 2020-07-16T13:42:01.539611+0000 mgr.x (mgr.34562) 167 : cluster [DBG] pgmap v101: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:42:02.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:42:01 smithi188 bash[23329]: cluster 2020-07-16T13:42:01.539611+0000 mgr.x (mgr.34562) 167 : cluster [DBG] pgmap v101: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:42:04.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:42:04 smithi188 bash[23329]: cluster 2020-07-16T13:42:03.539970+0000 mgr.x (mgr.34562) 168 : cluster [DBG] pgmap v102: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:42:05.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:42:04 smithi132 bash[27079]: cluster 2020-07-16T13:42:03.539970+0000 mgr.x (mgr.34562) 168 : cluster [DBG] pgmap v102: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:42:06.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:42:06 smithi188 bash[23329]: cluster 2020-07-16T13:42:05.540503+0000 mgr.x (mgr.34562) 169 : cluster [DBG] pgmap v103: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:42:07.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:42:06 smithi132 bash[27079]: cluster 2020-07-16T13:42:05.540503+0000 mgr.x (mgr.34562) 169 : cluster [DBG] pgmap v103: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:42:08.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:42:08 smithi188 bash[23329]: cluster 2020-07-16T13:42:07.540877+0000 mgr.x (mgr.34562) 170 : cluster [DBG] pgmap v104: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:42:09.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:42:08 smithi132 bash[27079]: cluster 2020-07-16T13:42:07.540877+0000 mgr.x (mgr.34562) 170 : cluster [DBG] pgmap v104: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:42:10.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:42:09 smithi132 bash[27079]: cluster 2020-07-16T13:42:09.541248+0000 mgr.x (mgr.34562) 171 : cluster [DBG] pgmap v105: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:42:10.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:42:09 smithi188 bash[23329]: cluster 2020-07-16T13:42:09.541248+0000 mgr.x (mgr.34562) 171 : cluster [DBG] pgmap v105: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:42:12.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:42:12 smithi188 bash[23329]: cluster 2020-07-16T13:42:11.541604+0000 mgr.x (mgr.34562) 172 : cluster [DBG] pgmap v106: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:42:13.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:42:12 smithi132 bash[27079]: cluster 2020-07-16T13:42:11.541604+0000 mgr.x (mgr.34562) 172 : cluster [DBG] pgmap v106: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:42:14.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:42:14 smithi188 bash[23329]: cluster 2020-07-16T13:42:13.542115+0000 mgr.x (mgr.34562) 173 : cluster [DBG] pgmap v107: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:42:15.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:42:14 smithi132 bash[27079]: cluster 2020-07-16T13:42:13.542115+0000 mgr.x (mgr.34562) 173 : cluster [DBG] pgmap v107: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:42:15.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:42:15 smithi188 bash[23329]: audit 2020-07-16T13:42:15.109833+0000 mon.b (mon.2) 189 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:42:16.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:42:15 smithi132 bash[27079]: audit 2020-07-16T13:42:15.109833+0000 mon.b (mon.2) 189 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:42:16.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:42:16 smithi188 bash[23329]: cephadm 2020-07-16T13:42:15.110618+0000 mgr.x (mgr.34562) 174 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:42:16.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:42:16 smithi188 bash[23329]: cephadm 2020-07-16T13:42:15.111022+0000 mgr.x (mgr.34562) 175 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:42:16.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:42:16 smithi188 bash[23329]: cluster 2020-07-16T13:42:15.542468+0000 mgr.x (mgr.34562) 176 : cluster [DBG] pgmap v108: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:42:17.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:42:16 smithi132 bash[27079]: cephadm 2020-07-16T13:42:15.110618+0000 mgr.x (mgr.34562) 174 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:42:17.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:42:16 smithi132 bash[27079]: cephadm 2020-07-16T13:42:15.111022+0000 mgr.x (mgr.34562) 175 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:42:17.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:42:16 smithi132 bash[27079]: cluster 2020-07-16T13:42:15.542468+0000 mgr.x (mgr.34562) 176 : cluster [DBG] pgmap v108: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:42:18.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:42:18 smithi188 bash[23329]: cluster 2020-07-16T13:42:17.542876+0000 mgr.x (mgr.34562) 177 : cluster [DBG] pgmap v109: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:42:19.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:42:18 smithi132 bash[27079]: cluster 2020-07-16T13:42:17.542876+0000 mgr.x (mgr.34562) 177 : cluster [DBG] pgmap v109: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:42:20.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:42:19 smithi132 bash[27079]: cluster 2020-07-16T13:42:19.543347+0000 mgr.x (mgr.34562) 178 : cluster [DBG] pgmap v110: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:42:20.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:42:19 smithi188 bash[23329]: cluster 2020-07-16T13:42:19.543347+0000 mgr.x (mgr.34562) 178 : cluster [DBG] pgmap v110: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:42:22.607 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T13:42:22.866 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T13:42:22.867 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (5m) 3m ago 8m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T13:42:22.867 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (7m) 3m ago 7m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T13:42:22.867 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (5m) 3m ago 10m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T13:42:22.868 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (4m) 3m ago 12m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T13:42:22.868 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 3m ago 12m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T13:42:22.868 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (11m) 3m ago 11m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T13:42:22.869 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (11m) 3m ago 11m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T13:42:22.869 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (8m) 3m ago 8m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T13:42:22.869 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (8m) 3m ago 8m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T13:42:22.869 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (10m) 3m ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T13:42:22.870 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (10m) 3m ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T13:42:22.870 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (10m) 3m ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T13:42:22.870 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (9m) 3m ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T13:42:22.870 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (9m) 3m ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T13:42:22.871 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (9m) 3m ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T13:42:22.871 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (9m) 3m ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T13:42:22.871 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (8m) 3m ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T13:42:22.871 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (7m) 3m ago 8m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T13:42:22.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:42:22 smithi188 bash[23329]: cluster 2020-07-16T13:42:21.543789+0000 mgr.x (mgr.34562) 179 : cluster [DBG] pgmap v111: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:42:23.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:42:22 smithi132 bash[27079]: cluster 2020-07-16T13:42:21.543789+0000 mgr.x (mgr.34562) 179 : cluster [DBG] pgmap v111: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:42:23.165 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T13:42:23.166 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T13:42:23.166 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T13:42:23.166 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T13:42:23.166 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:42:23.167 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T13:42:23.167 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T13:42:23.167 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:42:23.167 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T13:42:23.167 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T13:42:23.168 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:42:23.168 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T13:42:23.168 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T13:42:23.168 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T13:42:23.169 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T13:42:23.169 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T13:42:23.169 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T13:42:23.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:42:23 smithi188 bash[23329]: audit 2020-07-16T13:42:22.595305+0000 mgr.x (mgr.34562) 180 : audit [DBG] from='client.24766 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:42:23.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:42:23 smithi188 bash[23329]: audit 2020-07-16T13:42:22.862095+0000 mgr.x (mgr.34562) 181 : audit [DBG] from='client.24772 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:42:23.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:42:23 smithi188 bash[23329]: audit 2020-07-16T13:42:23.164696+0000 mon.c (mon.1) 73 : audit [DBG] from='client.? 172.21.15.132:0/2202492748' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:42:24.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:42:23 smithi132 bash[27079]: audit 2020-07-16T13:42:22.595305+0000 mgr.x (mgr.34562) 180 : audit [DBG] from='client.24766 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:42:24.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:42:23 smithi132 bash[27079]: audit 2020-07-16T13:42:22.862095+0000 mgr.x (mgr.34562) 181 : audit [DBG] from='client.24772 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:42:24.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:42:23 smithi132 bash[27079]: audit 2020-07-16T13:42:23.164696+0000 mon.c (mon.1) 73 : audit [DBG] from='client.? 172.21.15.132:0/2202492748' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:42:24.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:42:24 smithi188 bash[23329]: cluster 2020-07-16T13:42:23.544347+0000 mgr.x (mgr.34562) 182 : cluster [DBG] pgmap v112: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:42:25.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:42:24 smithi132 bash[27079]: cluster 2020-07-16T13:42:23.544347+0000 mgr.x (mgr.34562) 182 : cluster [DBG] pgmap v112: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:42:26.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:42:26 smithi188 bash[23329]: cluster 2020-07-16T13:42:25.544703+0000 mgr.x (mgr.34562) 183 : cluster [DBG] pgmap v113: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:42:27.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:42:26 smithi132 bash[27079]: cluster 2020-07-16T13:42:25.544703+0000 mgr.x (mgr.34562) 183 : cluster [DBG] pgmap v113: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:42:28.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:42:28 smithi188 bash[23329]: cluster 2020-07-16T13:42:27.545086+0000 mgr.x (mgr.34562) 184 : cluster [DBG] pgmap v114: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:42:29.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:42:28 smithi132 bash[27079]: cluster 2020-07-16T13:42:27.545086+0000 mgr.x (mgr.34562) 184 : cluster [DBG] pgmap v114: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:42:30.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:42:29 smithi132 bash[27079]: cluster 2020-07-16T13:42:29.545464+0000 mgr.x (mgr.34562) 185 : cluster [DBG] pgmap v115: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:42:30.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:42:29 smithi188 bash[23329]: cluster 2020-07-16T13:42:29.545464+0000 mgr.x (mgr.34562) 185 : cluster [DBG] pgmap v115: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:42:31.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:42:30 smithi132 bash[27079]: audit 2020-07-16T13:42:30.126527+0000 mon.b (mon.2) 190 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:42:31.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:42:30 smithi132 bash[27079]: cephadm 2020-07-16T13:42:30.127237+0000 mgr.x (mgr.34562) 186 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:42:31.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:42:30 smithi132 bash[27079]: cephadm 2020-07-16T13:42:30.127610+0000 mgr.x (mgr.34562) 187 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:42:31.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:42:30 smithi188 bash[23329]: audit 2020-07-16T13:42:30.126527+0000 mon.b (mon.2) 190 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:42:31.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:42:30 smithi188 bash[23329]: cephadm 2020-07-16T13:42:30.127237+0000 mgr.x (mgr.34562) 186 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:42:31.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:42:30 smithi188 bash[23329]: cephadm 2020-07-16T13:42:30.127610+0000 mgr.x (mgr.34562) 187 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:42:32.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:42:31 smithi132 bash[27079]: cluster 2020-07-16T13:42:31.545879+0000 mgr.x (mgr.34562) 188 : cluster [DBG] pgmap v116: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:42:32.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:42:31 smithi188 bash[23329]: cluster 2020-07-16T13:42:31.545879+0000 mgr.x (mgr.34562) 188 : cluster [DBG] pgmap v116: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:42:34.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:42:34 smithi188 bash[23329]: cluster 2020-07-16T13:42:33.546380+0000 mgr.x (mgr.34562) 189 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:42:35.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:42:34 smithi132 bash[27079]: cluster 2020-07-16T13:42:33.546380+0000 mgr.x (mgr.34562) 189 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:42:36.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:42:36 smithi188 bash[23329]: cluster 2020-07-16T13:42:35.546961+0000 mgr.x (mgr.34562) 190 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:42:37.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:42:36 smithi132 bash[27079]: cluster 2020-07-16T13:42:35.546961+0000 mgr.x (mgr.34562) 190 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:42:38.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:42:38 smithi188 bash[23329]: cluster 2020-07-16T13:42:37.547495+0000 mgr.x (mgr.34562) 191 : cluster [DBG] pgmap v119: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:42:39.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:42:38 smithi132 bash[27079]: cluster 2020-07-16T13:42:37.547495+0000 mgr.x (mgr.34562) 191 : cluster [DBG] pgmap v119: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:42:40.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:42:39 smithi132 bash[27079]: cluster 2020-07-16T13:42:39.547949+0000 mgr.x (mgr.34562) 192 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:42:40.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:42:39 smithi188 bash[23329]: cluster 2020-07-16T13:42:39.547949+0000 mgr.x (mgr.34562) 192 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:42:42.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:42:42 smithi188 bash[23329]: cluster 2020-07-16T13:42:41.548367+0000 mgr.x (mgr.34562) 193 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:42:43.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:42:42 smithi132 bash[27079]: cluster 2020-07-16T13:42:41.548367+0000 mgr.x (mgr.34562) 193 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:42:44.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:42:44 smithi188 bash[23329]: cluster 2020-07-16T13:42:43.548696+0000 mgr.x (mgr.34562) 194 : cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:42:45.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:42:44 smithi132 bash[27079]: cluster 2020-07-16T13:42:43.548696+0000 mgr.x (mgr.34562) 194 : cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:42:45.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:42:45 smithi188 bash[23329]: audit 2020-07-16T13:42:45.143148+0000 mon.b (mon.2) 191 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:42:46.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:42:45 smithi132 bash[27079]: audit 2020-07-16T13:42:45.143148+0000 mon.b (mon.2) 191 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:42:46.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:42:46 smithi188 bash[23329]: cephadm 2020-07-16T13:42:45.143947+0000 mgr.x (mgr.34562) 195 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:42:46.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:42:46 smithi188 bash[23329]: cephadm 2020-07-16T13:42:45.144401+0000 mgr.x (mgr.34562) 196 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:42:46.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:42:46 smithi188 bash[23329]: cluster 2020-07-16T13:42:45.549149+0000 mgr.x (mgr.34562) 197 : cluster [DBG] pgmap v123: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:42:47.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:42:46 smithi132 bash[27079]: cephadm 2020-07-16T13:42:45.143947+0000 mgr.x (mgr.34562) 195 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:42:47.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:42:46 smithi132 bash[27079]: cephadm 2020-07-16T13:42:45.144401+0000 mgr.x (mgr.34562) 196 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:42:47.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:42:46 smithi132 bash[27079]: cluster 2020-07-16T13:42:45.549149+0000 mgr.x (mgr.34562) 197 : cluster [DBG] pgmap v123: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:42:48.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:42:48 smithi188 bash[23329]: cluster 2020-07-16T13:42:47.549656+0000 mgr.x (mgr.34562) 198 : cluster [DBG] pgmap v124: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:42:49.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:42:48 smithi132 bash[27079]: cluster 2020-07-16T13:42:47.549656+0000 mgr.x (mgr.34562) 198 : cluster [DBG] pgmap v124: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:42:50.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:42:49 smithi132 bash[27079]: cluster 2020-07-16T13:42:49.550167+0000 mgr.x (mgr.34562) 199 : cluster [DBG] pgmap v125: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:42:50.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:42:49 smithi188 bash[23329]: cluster 2020-07-16T13:42:49.550167+0000 mgr.x (mgr.34562) 199 : cluster [DBG] pgmap v125: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:42:52.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:42:52 smithi188 bash[23329]: cluster 2020-07-16T13:42:51.550773+0000 mgr.x (mgr.34562) 200 : cluster [DBG] pgmap v126: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:42:53.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:42:52 smithi132 bash[27079]: cluster 2020-07-16T13:42:51.550773+0000 mgr.x (mgr.34562) 200 : cluster [DBG] pgmap v126: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:42:53.463 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T13:42:53.725 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T13:42:53.726 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (5m) 4m ago 8m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T13:42:53.726 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (8m) 4m ago 8m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T13:42:53.726 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (5m) 4m ago 11m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T13:42:53.726 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (5m) 4m ago 13m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T13:42:53.727 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 4m ago 13m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T13:42:53.727 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (11m) 4m ago 11m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T13:42:53.727 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (11m) 4m ago 11m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T13:42:53.727 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (8m) 4m ago 8m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T13:42:53.727 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (8m) 4m ago 8m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T13:42:53.728 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (11m) 4m ago 11m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T13:42:53.728 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (10m) 4m ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T13:42:53.728 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (10m) 4m ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T13:42:53.728 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (10m) 4m ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T13:42:53.728 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (9m) 4m ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T13:42:53.729 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (9m) 4m ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T13:42:53.729 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (9m) 4m ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T13:42:53.729 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (9m) 4m ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T13:42:53.729 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (8m) 4m ago 8m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T13:42:54.021 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T13:42:54.021 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T13:42:54.022 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T13:42:54.022 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T13:42:54.022 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:42:54.022 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T13:42:54.022 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T13:42:54.023 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:42:54.023 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T13:42:54.023 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T13:42:54.023 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:42:54.023 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T13:42:54.024 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T13:42:54.024 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T13:42:54.024 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T13:42:54.024 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T13:42:54.024 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T13:42:54.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:42:54 smithi188 bash[23329]: audit 2020-07-16T13:42:53.451456+0000 mgr.x (mgr.34562) 201 : audit [DBG] from='client.24784 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:42:54.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:42:54 smithi188 bash[23329]: cluster 2020-07-16T13:42:53.551135+0000 mgr.x (mgr.34562) 202 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:42:54.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:42:54 smithi188 bash[23329]: audit 2020-07-16T13:42:53.721100+0000 mgr.x (mgr.34562) 203 : audit [DBG] from='client.24790 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:42:54.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:42:54 smithi188 bash[23329]: audit 2020-07-16T13:42:54.020512+0000 mon.c (mon.1) 74 : audit [DBG] from='client.? 172.21.15.132:0/512492917' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:42:55.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:42:54 smithi132 bash[27079]: audit 2020-07-16T13:42:53.451456+0000 mgr.x (mgr.34562) 201 : audit [DBG] from='client.24784 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:42:55.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:42:54 smithi132 bash[27079]: cluster 2020-07-16T13:42:53.551135+0000 mgr.x (mgr.34562) 202 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:42:55.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:42:54 smithi132 bash[27079]: audit 2020-07-16T13:42:53.721100+0000 mgr.x (mgr.34562) 203 : audit [DBG] from='client.24790 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:42:55.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:42:54 smithi132 bash[27079]: audit 2020-07-16T13:42:54.020512+0000 mon.c (mon.1) 74 : audit [DBG] from='client.? 172.21.15.132:0/512492917' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:42:56.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:42:56 smithi188 bash[23329]: cluster 2020-07-16T13:42:55.551557+0000 mgr.x (mgr.34562) 204 : cluster [DBG] pgmap v128: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:42:57.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:42:56 smithi132 bash[27079]: cluster 2020-07-16T13:42:55.551557+0000 mgr.x (mgr.34562) 204 : cluster [DBG] pgmap v128: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:42:58.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:42:58 smithi188 bash[23329]: cluster 2020-07-16T13:42:57.551982+0000 mgr.x (mgr.34562) 205 : cluster [DBG] pgmap v129: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:42:59.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:42:58 smithi132 bash[27079]: cluster 2020-07-16T13:42:57.551982+0000 mgr.x (mgr.34562) 205 : cluster [DBG] pgmap v129: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:43:00.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:42:59 smithi132 bash[27079]: cluster 2020-07-16T13:42:59.552527+0000 mgr.x (mgr.34562) 206 : cluster [DBG] pgmap v130: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:43:00.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:42:59 smithi188 bash[23329]: cluster 2020-07-16T13:42:59.552527+0000 mgr.x (mgr.34562) 206 : cluster [DBG] pgmap v130: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:43:01.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:43:00 smithi132 bash[27079]: audit 2020-07-16T13:43:00.162331+0000 mon.b (mon.2) 192 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:43:01.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:43:00 smithi132 bash[27079]: audit 2020-07-16T13:43:00.162818+0000 mgr.x (mgr.34562) 207 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:43:01.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:43:00 smithi132 bash[27079]: audit 2020-07-16T13:43:00.163860+0000 mon.b (mon.2) 193 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:43:01.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:43:00 smithi132 bash[27079]: audit 2020-07-16T13:43:00.164176+0000 mgr.x (mgr.34562) 208 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:43:01.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:43:00 smithi132 bash[27079]: audit 2020-07-16T13:43:00.165130+0000 mon.b (mon.2) 194 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:43:01.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:43:00 smithi132 bash[27079]: audit 2020-07-16T13:43:00.165418+0000 mgr.x (mgr.34562) 209 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:43:01.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:43:00 smithi132 bash[27079]: cephadm 2020-07-16T13:43:00.166135+0000 mgr.x (mgr.34562) 210 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T13:43:01.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:43:00 smithi132 bash[27079]: audit 2020-07-16T13:43:00.166550+0000 mon.b (mon.2) 195 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T13:43:01.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:43:00 smithi132 bash[27079]: cephadm 2020-07-16T13:43:00.167414+0000 mgr.x (mgr.34562) 211 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T13:43:01.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:43:00 smithi132 bash[27079]: audit 2020-07-16T13:43:00.167878+0000 mon.b (mon.2) 196 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:43:01.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:43:00 smithi132 bash[27079]: cephadm 2020-07-16T13:43:00.168587+0000 mgr.x (mgr.34562) 212 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T13:43:01.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:43:00 smithi132 bash[27079]: cephadm 2020-07-16T13:43:00.168671+0000 mgr.x (mgr.34562) 213 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T13:43:01.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:43:00 smithi188 bash[23329]: audit 2020-07-16T13:43:00.162331+0000 mon.b (mon.2) 192 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:43:01.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:43:00 smithi188 bash[23329]: audit 2020-07-16T13:43:00.162818+0000 mgr.x (mgr.34562) 207 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:43:01.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:43:00 smithi188 bash[23329]: audit 2020-07-16T13:43:00.163860+0000 mon.b (mon.2) 193 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:43:01.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:43:00 smithi188 bash[23329]: audit 2020-07-16T13:43:00.164176+0000 mgr.x (mgr.34562) 208 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:43:01.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:43:00 smithi188 bash[23329]: audit 2020-07-16T13:43:00.165130+0000 mon.b (mon.2) 194 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:43:01.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:43:00 smithi188 bash[23329]: audit 2020-07-16T13:43:00.165418+0000 mgr.x (mgr.34562) 209 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:43:01.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:43:00 smithi188 bash[23329]: cephadm 2020-07-16T13:43:00.166135+0000 mgr.x (mgr.34562) 210 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T13:43:01.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:43:00 smithi188 bash[23329]: audit 2020-07-16T13:43:00.166550+0000 mon.b (mon.2) 195 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T13:43:01.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:43:00 smithi188 bash[23329]: cephadm 2020-07-16T13:43:00.167414+0000 mgr.x (mgr.34562) 211 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T13:43:01.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:43:00 smithi188 bash[23329]: audit 2020-07-16T13:43:00.167878+0000 mon.b (mon.2) 196 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:43:01.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:43:00 smithi188 bash[23329]: cephadm 2020-07-16T13:43:00.168587+0000 mgr.x (mgr.34562) 212 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T13:43:01.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:43:00 smithi188 bash[23329]: cephadm 2020-07-16T13:43:00.168671+0000 mgr.x (mgr.34562) 213 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T13:43:02.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:43:01 smithi132 bash[27079]: cluster 2020-07-16T13:43:01.552926+0000 mgr.x (mgr.34562) 214 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:43:02.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:43:01 smithi188 bash[23329]: cluster 2020-07-16T13:43:01.552926+0000 mgr.x (mgr.34562) 214 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:43:03.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:43:03 smithi132 bash[27079]: audit 2020-07-16T13:43:03.021402+0000 mon.b (mon.2) 197 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:43:03.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:43:03 smithi188 bash[23329]: audit 2020-07-16T13:43:03.021402+0000 mon.b (mon.2) 197 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:43:04.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:43:04 smithi188 bash[23329]: cephadm 2020-07-16T13:43:03.022055+0000 mgr.x (mgr.34562) 215 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:43:04.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:43:04 smithi188 bash[23329]: cephadm 2020-07-16T13:43:03.022371+0000 mgr.x (mgr.34562) 216 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:43:04.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:43:04 smithi188 bash[23329]: cluster 2020-07-16T13:43:03.553446+0000 mgr.x (mgr.34562) 217 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:43:04.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:43:04 smithi132 bash[27079]: cephadm 2020-07-16T13:43:03.022055+0000 mgr.x (mgr.34562) 215 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:43:04.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:43:04 smithi132 bash[27079]: cephadm 2020-07-16T13:43:03.022371+0000 mgr.x (mgr.34562) 216 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:43:04.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:43:04 smithi132 bash[27079]: cluster 2020-07-16T13:43:03.553446+0000 mgr.x (mgr.34562) 217 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:43:06.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:43:06 smithi188 bash[23329]: cluster 2020-07-16T13:43:05.553889+0000 mgr.x (mgr.34562) 218 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:43:07.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:43:06 smithi132 bash[27079]: cluster 2020-07-16T13:43:05.553889+0000 mgr.x (mgr.34562) 218 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:43:08.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:43:08 smithi188 bash[23329]: cluster 2020-07-16T13:43:07.554314+0000 mgr.x (mgr.34562) 219 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:43:09.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:43:08 smithi132 bash[27079]: cluster 2020-07-16T13:43:07.554314+0000 mgr.x (mgr.34562) 219 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:43:10.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:43:09 smithi132 bash[27079]: cluster 2020-07-16T13:43:09.554715+0000 mgr.x (mgr.34562) 220 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:43:10.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:43:09 smithi188 bash[23329]: cluster 2020-07-16T13:43:09.554715+0000 mgr.x (mgr.34562) 220 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:43:12.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:43:12 smithi188 bash[23329]: cluster 2020-07-16T13:43:11.555321+0000 mgr.x (mgr.34562) 221 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:43:13.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:43:12 smithi132 bash[27079]: cluster 2020-07-16T13:43:11.555321+0000 mgr.x (mgr.34562) 221 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:43:14.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:43:14 smithi188 bash[23329]: cluster 2020-07-16T13:43:13.555741+0000 mgr.x (mgr.34562) 222 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:43:15.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:43:14 smithi132 bash[27079]: cluster 2020-07-16T13:43:13.555741+0000 mgr.x (mgr.34562) 222 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:43:16.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:43:16 smithi188 bash[23329]: cluster 2020-07-16T13:43:15.556132+0000 mgr.x (mgr.34562) 223 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:43:17.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:43:16 smithi132 bash[27079]: cluster 2020-07-16T13:43:15.556132+0000 mgr.x (mgr.34562) 223 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:43:18.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:43:18 smithi188 bash[23329]: cluster 2020-07-16T13:43:17.556601+0000 mgr.x (mgr.34562) 224 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:43:18.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:43:18 smithi188 bash[23329]: audit 2020-07-16T13:43:18.037944+0000 mon.b (mon.2) 198 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:43:19.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:43:18 smithi132 bash[27079]: cluster 2020-07-16T13:43:17.556601+0000 mgr.x (mgr.34562) 224 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:43:19.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:43:18 smithi132 bash[27079]: audit 2020-07-16T13:43:18.037944+0000 mon.b (mon.2) 198 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:43:19.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:43:19 smithi188 bash[23329]: cephadm 2020-07-16T13:43:18.038622+0000 mgr.x (mgr.34562) 225 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:43:19.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:43:19 smithi188 bash[23329]: cephadm 2020-07-16T13:43:18.038884+0000 mgr.x (mgr.34562) 226 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:43:20.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:43:19 smithi132 bash[27079]: cephadm 2020-07-16T13:43:18.038622+0000 mgr.x (mgr.34562) 225 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:43:20.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:43:19 smithi132 bash[27079]: cephadm 2020-07-16T13:43:18.038884+0000 mgr.x (mgr.34562) 226 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:43:20.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:43:20 smithi188 bash[23329]: cluster 2020-07-16T13:43:19.556997+0000 mgr.x (mgr.34562) 227 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:43:21.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:43:20 smithi132 bash[27079]: cluster 2020-07-16T13:43:19.556997+0000 mgr.x (mgr.34562) 227 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:43:22.926 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:43:22 smithi188 bash[23329]: cluster 2020-07-16T13:43:21.557365+0000 mgr.x (mgr.34562) 228 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:43:23.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:43:22 smithi132 bash[27079]: cluster 2020-07-16T13:43:21.557365+0000 mgr.x (mgr.34562) 228 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:43:24.322 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T13:43:24.583 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T13:43:24.583 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (6m) 4m ago 9m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T13:43:24.583 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (8m) 4m ago 8m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T13:43:24.583 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (6m) 4m ago 12m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T13:43:24.584 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (5m) 4m ago 13m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T13:43:24.584 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 4m ago 13m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T13:43:24.584 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (12m) 4m ago 12m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T13:43:24.584 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (12m) 4m ago 12m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T13:43:24.584 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (9m) 4m ago 9m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T13:43:24.585 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (9m) 4m ago 9m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T13:43:24.585 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (11m) 4m ago 11m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T13:43:24.585 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (11m) 4m ago 11m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T13:43:24.585 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (11m) 4m ago 11m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T13:43:24.585 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (10m) 4m ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T13:43:24.586 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (10m) 4m ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T13:43:24.586 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (10m) 4m ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T13:43:24.586 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (10m) 4m ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T13:43:24.586 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (9m) 4m ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T13:43:24.586 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (8m) 4m ago 9m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T13:43:24.896 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T13:43:24.896 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T13:43:24.896 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T13:43:24.896 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T13:43:24.897 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:43:24.897 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T13:43:24.897 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T13:43:24.897 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:43:24.897 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T13:43:24.898 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T13:43:24.898 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:43:24.898 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T13:43:24.898 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T13:43:24.898 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T13:43:24.898 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T13:43:24.899 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T13:43:24.899 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T13:43:24.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:43:24 smithi188 bash[23329]: cluster 2020-07-16T13:43:23.557775+0000 mgr.x (mgr.34562) 229 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:43:25.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:43:24 smithi132 bash[27079]: cluster 2020-07-16T13:43:23.557775+0000 mgr.x (mgr.34562) 229 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:43:25.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:43:25 smithi188 bash[23329]: audit 2020-07-16T13:43:24.309177+0000 mgr.x (mgr.34562) 230 : audit [DBG] from='client.24802 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:43:25.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:43:25 smithi188 bash[23329]: audit 2020-07-16T13:43:24.578353+0000 mgr.x (mgr.34562) 231 : audit [DBG] from='client.24808 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:43:25.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:43:25 smithi188 bash[23329]: audit 2020-07-16T13:43:24.895031+0000 mon.c (mon.1) 75 : audit [DBG] from='client.? 172.21.15.132:0/2679871659' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:43:26.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:43:25 smithi132 bash[27079]: audit 2020-07-16T13:43:24.309177+0000 mgr.x (mgr.34562) 230 : audit [DBG] from='client.24802 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:43:26.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:43:25 smithi132 bash[27079]: audit 2020-07-16T13:43:24.578353+0000 mgr.x (mgr.34562) 231 : audit [DBG] from='client.24808 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:43:26.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:43:25 smithi132 bash[27079]: audit 2020-07-16T13:43:24.895031+0000 mon.c (mon.1) 75 : audit [DBG] from='client.? 172.21.15.132:0/2679871659' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:43:26.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:43:26 smithi188 bash[23329]: cluster 2020-07-16T13:43:25.558145+0000 mgr.x (mgr.34562) 232 : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:43:27.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:43:26 smithi132 bash[27079]: cluster 2020-07-16T13:43:25.558145+0000 mgr.x (mgr.34562) 232 : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:43:28.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:43:28 smithi188 bash[23329]: cluster 2020-07-16T13:43:27.558625+0000 mgr.x (mgr.34562) 233 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:43:29.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:43:28 smithi132 bash[27079]: cluster 2020-07-16T13:43:27.558625+0000 mgr.x (mgr.34562) 233 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:43:30.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:43:29 smithi132 bash[27079]: cluster 2020-07-16T13:43:29.559059+0000 mgr.x (mgr.34562) 234 : cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:43:30.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:43:29 smithi188 bash[23329]: cluster 2020-07-16T13:43:29.559059+0000 mgr.x (mgr.34562) 234 : cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:43:32.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:43:32 smithi188 bash[23329]: cluster 2020-07-16T13:43:31.559413+0000 mgr.x (mgr.34562) 235 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:43:33.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:43:32 smithi132 bash[27079]: cluster 2020-07-16T13:43:31.559413+0000 mgr.x (mgr.34562) 235 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:43:33.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:43:33 smithi188 bash[23329]: audit 2020-07-16T13:43:33.054465+0000 mon.b (mon.2) 199 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:43:34.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:43:33 smithi132 bash[27079]: audit 2020-07-16T13:43:33.054465+0000 mon.b (mon.2) 199 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:43:34.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:43:34 smithi188 bash[23329]: cephadm 2020-07-16T13:43:33.055162+0000 mgr.x (mgr.34562) 236 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:43:34.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:43:34 smithi188 bash[23329]: cephadm 2020-07-16T13:43:33.055421+0000 mgr.x (mgr.34562) 237 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:43:34.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:43:34 smithi188 bash[23329]: cluster 2020-07-16T13:43:33.559888+0000 mgr.x (mgr.34562) 238 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:43:35.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:43:34 smithi132 bash[27079]: cephadm 2020-07-16T13:43:33.055162+0000 mgr.x (mgr.34562) 236 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:43:35.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:43:34 smithi132 bash[27079]: cephadm 2020-07-16T13:43:33.055421+0000 mgr.x (mgr.34562) 237 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:43:35.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:43:34 smithi132 bash[27079]: cluster 2020-07-16T13:43:33.559888+0000 mgr.x (mgr.34562) 238 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:43:36.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:43:36 smithi188 bash[23329]: cluster 2020-07-16T13:43:35.560391+0000 mgr.x (mgr.34562) 239 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:43:37.034 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:43:36 smithi132 bash[27079]: cluster 2020-07-16T13:43:35.560391+0000 mgr.x (mgr.34562) 239 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:43:38.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:43:38 smithi188 bash[23329]: cluster 2020-07-16T13:43:37.560752+0000 mgr.x (mgr.34562) 240 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:43:39.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:43:38 smithi132 bash[27079]: cluster 2020-07-16T13:43:37.560752+0000 mgr.x (mgr.34562) 240 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:43:40.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:43:39 smithi132 bash[27079]: cluster 2020-07-16T13:43:39.561265+0000 mgr.x (mgr.34562) 241 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:43:40.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:43:39 smithi188 bash[23329]: cluster 2020-07-16T13:43:39.561265+0000 mgr.x (mgr.34562) 241 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:43:42.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:43:42 smithi188 bash[23329]: cluster 2020-07-16T13:43:41.561761+0000 mgr.x (mgr.34562) 242 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:43:43.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:43:42 smithi132 bash[27079]: cluster 2020-07-16T13:43:41.561761+0000 mgr.x (mgr.34562) 242 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:43:44.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:43:44 smithi188 bash[23329]: cluster 2020-07-16T13:43:43.562242+0000 mgr.x (mgr.34562) 243 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:43:45.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:43:44 smithi132 bash[27079]: cluster 2020-07-16T13:43:43.562242+0000 mgr.x (mgr.34562) 243 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:43:46.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:43:46 smithi188 bash[23329]: cluster 2020-07-16T13:43:45.562787+0000 mgr.x (mgr.34562) 244 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:43:47.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:43:46 smithi132 bash[27079]: cluster 2020-07-16T13:43:45.562787+0000 mgr.x (mgr.34562) 244 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:43:48.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:43:48 smithi188 bash[23329]: cluster 2020-07-16T13:43:47.563349+0000 mgr.x (mgr.34562) 245 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:43:48.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:43:48 smithi188 bash[23329]: audit 2020-07-16T13:43:48.071067+0000 mon.b (mon.2) 200 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:43:49.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:43:48 smithi132 bash[27079]: cluster 2020-07-16T13:43:47.563349+0000 mgr.x (mgr.34562) 245 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:43:49.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:43:48 smithi132 bash[27079]: audit 2020-07-16T13:43:48.071067+0000 mon.b (mon.2) 200 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:43:49.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:43:49 smithi188 bash[23329]: cephadm 2020-07-16T13:43:48.071788+0000 mgr.x (mgr.34562) 246 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:43:49.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:43:49 smithi188 bash[23329]: cephadm 2020-07-16T13:43:48.071887+0000 mgr.x (mgr.34562) 247 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:43:50.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:43:49 smithi132 bash[27079]: cephadm 2020-07-16T13:43:48.071788+0000 mgr.x (mgr.34562) 246 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:43:50.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:43:49 smithi132 bash[27079]: cephadm 2020-07-16T13:43:48.071887+0000 mgr.x (mgr.34562) 247 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:43:50.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:43:50 smithi188 bash[23329]: cluster 2020-07-16T13:43:49.563849+0000 mgr.x (mgr.34562) 248 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:43:51.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:43:50 smithi132 bash[27079]: cluster 2020-07-16T13:43:49.563849+0000 mgr.x (mgr.34562) 248 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:43:52.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:43:52 smithi188 bash[23329]: cluster 2020-07-16T13:43:51.564526+0000 mgr.x (mgr.34562) 249 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:43:53.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:43:52 smithi132 bash[27079]: cluster 2020-07-16T13:43:51.564526+0000 mgr.x (mgr.34562) 249 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:43:54.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:43:54 smithi188 bash[23329]: cluster 2020-07-16T13:43:53.565061+0000 mgr.x (mgr.34562) 250 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:43:55.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:43:54 smithi132 bash[27079]: cluster 2020-07-16T13:43:53.565061+0000 mgr.x (mgr.34562) 250 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:43:55.202 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T13:43:55.460 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T13:43:55.460 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (6m) 5m ago 9m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T13:43:55.460 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (9m) 5m ago 9m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T13:43:55.460 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (6m) 5m ago 12m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T13:43:55.461 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (6m) 5m ago 14m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T13:43:55.461 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 5m ago 14m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T13:43:55.461 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (12m) 5m ago 12m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T13:43:55.461 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (12m) 5m ago 12m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T13:43:55.461 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (9m) 5m ago 9m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T13:43:55.462 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (9m) 5m ago 9m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T13:43:55.462 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (12m) 5m ago 12m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T13:43:55.462 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (11m) 5m ago 12m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T13:43:55.462 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (11m) 5m ago 11m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T13:43:55.462 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (11m) 5m ago 11m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T13:43:55.463 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (10m) 5m ago 11m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T13:43:55.463 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (10m) 5m ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T13:43:55.463 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (10m) 5m ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T13:43:55.463 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (10m) 5m ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T13:43:55.463 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (9m) 5m ago 9m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T13:43:55.758 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T13:43:55.758 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T13:43:55.758 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T13:43:55.759 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T13:43:55.759 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:43:55.759 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T13:43:55.760 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T13:43:55.760 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:43:55.760 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T13:43:55.760 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T13:43:55.761 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:43:55.761 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T13:43:55.761 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T13:43:55.761 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T13:43:55.762 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T13:43:55.762 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T13:43:55.762 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T13:43:56.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:43:56 smithi188 bash[23329]: audit 2020-07-16T13:43:55.188345+0000 mgr.x (mgr.34562) 251 : audit [DBG] from='client.24820 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:43:56.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:43:56 smithi188 bash[23329]: audit 2020-07-16T13:43:55.455489+0000 mgr.x (mgr.34562) 252 : audit [DBG] from='client.24826 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:43:56.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:43:56 smithi188 bash[23329]: cluster 2020-07-16T13:43:55.565599+0000 mgr.x (mgr.34562) 253 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:43:56.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:43:56 smithi188 bash[23329]: audit 2020-07-16T13:43:55.757274+0000 mon.c (mon.1) 76 : audit [DBG] from='client.? 172.21.15.132:0/851231539' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:43:57.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:43:56 smithi132 bash[27079]: audit 2020-07-16T13:43:55.188345+0000 mgr.x (mgr.34562) 251 : audit [DBG] from='client.24820 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:43:57.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:43:56 smithi132 bash[27079]: audit 2020-07-16T13:43:55.455489+0000 mgr.x (mgr.34562) 252 : audit [DBG] from='client.24826 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:43:57.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:43:56 smithi132 bash[27079]: cluster 2020-07-16T13:43:55.565599+0000 mgr.x (mgr.34562) 253 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:43:57.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:43:56 smithi132 bash[27079]: audit 2020-07-16T13:43:55.757274+0000 mon.c (mon.1) 76 : audit [DBG] from='client.? 172.21.15.132:0/851231539' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:43:58.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:43:58 smithi188 bash[23329]: cluster 2020-07-16T13:43:57.566022+0000 mgr.x (mgr.34562) 254 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:43:59.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:43:58 smithi132 bash[27079]: cluster 2020-07-16T13:43:57.566022+0000 mgr.x (mgr.34562) 254 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:44:00.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:43:59 smithi132 bash[27079]: cluster 2020-07-16T13:43:59.566485+0000 mgr.x (mgr.34562) 255 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:44:00.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:43:59 smithi188 bash[23329]: cluster 2020-07-16T13:43:59.566485+0000 mgr.x (mgr.34562) 255 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:44:02.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:44:02 smithi188 bash[23329]: cluster 2020-07-16T13:44:01.566993+0000 mgr.x (mgr.34562) 256 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:44:03.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:44:02 smithi132 bash[27079]: cluster 2020-07-16T13:44:01.566993+0000 mgr.x (mgr.34562) 256 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:44:03.870 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:44:03 smithi132 bash[27079]: audit 2020-07-16T13:44:03.090321+0000 mon.b (mon.2) 201 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:44:03.870 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:44:03 smithi132 bash[27079]: audit 2020-07-16T13:44:03.091644+0000 mon.b (mon.2) 202 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:44:03.871 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:44:03 smithi132 bash[27079]: audit 2020-07-16T13:44:03.092820+0000 mon.b (mon.2) 203 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:44:03.871 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:44:03 smithi132 bash[27079]: audit 2020-07-16T13:44:03.094241+0000 mon.b (mon.2) 204 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T13:44:03.871 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:44:03 smithi132 bash[27079]: audit 2020-07-16T13:44:03.095472+0000 mon.b (mon.2) 205 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:44:03.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:44:03 smithi188 bash[23329]: audit 2020-07-16T13:44:03.090321+0000 mon.b (mon.2) 201 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:44:03.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:44:03 smithi188 bash[23329]: audit 2020-07-16T13:44:03.091644+0000 mon.b (mon.2) 202 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:44:03.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:44:03 smithi188 bash[23329]: audit 2020-07-16T13:44:03.092820+0000 mon.b (mon.2) 203 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:44:03.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:44:03 smithi188 bash[23329]: audit 2020-07-16T13:44:03.094241+0000 mon.b (mon.2) 204 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T13:44:03.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:44:03 smithi188 bash[23329]: audit 2020-07-16T13:44:03.095472+0000 mon.b (mon.2) 205 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:44:04.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:44:04 smithi188 bash[23329]: audit 2020-07-16T13:44:03.090689+0000 mgr.x (mgr.34562) 257 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:44:04.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:44:04 smithi188 bash[23329]: audit 2020-07-16T13:44:03.091970+0000 mgr.x (mgr.34562) 258 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:44:04.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:44:04 smithi188 bash[23329]: audit 2020-07-16T13:44:03.093086+0000 mgr.x (mgr.34562) 259 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:44:04.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:44:04 smithi188 bash[23329]: cephadm 2020-07-16T13:44:03.093883+0000 mgr.x (mgr.34562) 260 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T13:44:04.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:44:04 smithi188 bash[23329]: cephadm 2020-07-16T13:44:03.095147+0000 mgr.x (mgr.34562) 261 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T13:44:04.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:44:04 smithi188 bash[23329]: cephadm 2020-07-16T13:44:03.096220+0000 mgr.x (mgr.34562) 262 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T13:44:04.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:44:04 smithi188 bash[23329]: cephadm 2020-07-16T13:44:03.096418+0000 mgr.x (mgr.34562) 263 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T13:44:04.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:44:04 smithi188 bash[23329]: cluster 2020-07-16T13:44:03.567491+0000 mgr.x (mgr.34562) 264 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:44:05.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:44:04 smithi132 bash[27079]: audit 2020-07-16T13:44:03.090689+0000 mgr.x (mgr.34562) 257 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:44:05.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:44:04 smithi132 bash[27079]: audit 2020-07-16T13:44:03.091970+0000 mgr.x (mgr.34562) 258 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:44:05.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:44:04 smithi132 bash[27079]: audit 2020-07-16T13:44:03.093086+0000 mgr.x (mgr.34562) 259 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:44:05.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:44:04 smithi132 bash[27079]: cephadm 2020-07-16T13:44:03.093883+0000 mgr.x (mgr.34562) 260 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T13:44:05.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:44:04 smithi132 bash[27079]: cephadm 2020-07-16T13:44:03.095147+0000 mgr.x (mgr.34562) 261 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T13:44:05.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:44:04 smithi132 bash[27079]: cephadm 2020-07-16T13:44:03.096220+0000 mgr.x (mgr.34562) 262 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T13:44:05.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:44:04 smithi132 bash[27079]: cephadm 2020-07-16T13:44:03.096418+0000 mgr.x (mgr.34562) 263 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T13:44:05.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:44:04 smithi132 bash[27079]: cluster 2020-07-16T13:44:03.567491+0000 mgr.x (mgr.34562) 264 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:44:06.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:44:06 smithi188 bash[23329]: cluster 2020-07-16T13:44:05.567887+0000 mgr.x (mgr.34562) 265 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:44:06.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:44:06 smithi188 bash[23329]: audit 2020-07-16T13:44:06.048835+0000 mon.b (mon.2) 206 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:44:07.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:44:06 smithi132 bash[27079]: cluster 2020-07-16T13:44:05.567887+0000 mgr.x (mgr.34562) 265 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:44:07.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:44:06 smithi132 bash[27079]: audit 2020-07-16T13:44:06.048835+0000 mon.b (mon.2) 206 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:44:07.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:44:07 smithi188 bash[23329]: cephadm 2020-07-16T13:44:06.049488+0000 mgr.x (mgr.34562) 266 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:44:07.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:44:07 smithi188 bash[23329]: cephadm 2020-07-16T13:44:06.049581+0000 mgr.x (mgr.34562) 267 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:44:08.036 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:44:07 smithi132 bash[27079]: cephadm 2020-07-16T13:44:06.049488+0000 mgr.x (mgr.34562) 266 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:44:08.037 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:44:07 smithi132 bash[27079]: cephadm 2020-07-16T13:44:06.049581+0000 mgr.x (mgr.34562) 267 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:44:08.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:44:08 smithi188 bash[23329]: cluster 2020-07-16T13:44:07.568362+0000 mgr.x (mgr.34562) 268 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:44:09.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:44:08 smithi132 bash[27079]: cluster 2020-07-16T13:44:07.568362+0000 mgr.x (mgr.34562) 268 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:44:10.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:44:10 smithi132 bash[27079]: cluster 2020-07-16T13:44:09.568730+0000 mgr.x (mgr.34562) 269 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:44:10.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:44:10 smithi188 bash[23329]: cluster 2020-07-16T13:44:09.568730+0000 mgr.x (mgr.34562) 269 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:44:12.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:44:12 smithi188 bash[23329]: cluster 2020-07-16T13:44:11.569205+0000 mgr.x (mgr.34562) 270 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:44:13.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:44:12 smithi132 bash[27079]: cluster 2020-07-16T13:44:11.569205+0000 mgr.x (mgr.34562) 270 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:44:14.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:44:14 smithi188 bash[23329]: cluster 2020-07-16T13:44:13.569542+0000 mgr.x (mgr.34562) 271 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:44:15.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:44:14 smithi132 bash[27079]: cluster 2020-07-16T13:44:13.569542+0000 mgr.x (mgr.34562) 271 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:44:16.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:44:16 smithi188 bash[23329]: cluster 2020-07-16T13:44:15.569980+0000 mgr.x (mgr.34562) 272 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:44:17.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:44:16 smithi132 bash[27079]: cluster 2020-07-16T13:44:15.569980+0000 mgr.x (mgr.34562) 272 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:44:18.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:44:18 smithi188 bash[23329]: cluster 2020-07-16T13:44:17.570461+0000 mgr.x (mgr.34562) 273 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:44:19.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:44:18 smithi132 bash[27079]: cluster 2020-07-16T13:44:17.570461+0000 mgr.x (mgr.34562) 273 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:44:20.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:44:20 smithi132 bash[27079]: cluster 2020-07-16T13:44:19.570919+0000 mgr.x (mgr.34562) 274 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:44:20.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:44:20 smithi188 bash[23329]: cluster 2020-07-16T13:44:19.570919+0000 mgr.x (mgr.34562) 274 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:44:21.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:44:21 smithi188 bash[23329]: audit 2020-07-16T13:44:21.065350+0000 mon.b (mon.2) 207 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:44:21.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:44:21 smithi132 bash[27079]: audit 2020-07-16T13:44:21.065350+0000 mon.b (mon.2) 207 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:44:22.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:44:22 smithi188 bash[23329]: cephadm 2020-07-16T13:44:21.066015+0000 mgr.x (mgr.34562) 275 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:44:22.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:44:22 smithi188 bash[23329]: cephadm 2020-07-16T13:44:21.066295+0000 mgr.x (mgr.34562) 276 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:44:22.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:44:22 smithi188 bash[23329]: cluster 2020-07-16T13:44:21.571369+0000 mgr.x (mgr.34562) 277 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:44:22.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:44:22 smithi132 bash[27079]: cephadm 2020-07-16T13:44:21.066015+0000 mgr.x (mgr.34562) 275 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:44:22.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:44:22 smithi132 bash[27079]: cephadm 2020-07-16T13:44:21.066295+0000 mgr.x (mgr.34562) 276 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:44:22.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:44:22 smithi132 bash[27079]: cluster 2020-07-16T13:44:21.571369+0000 mgr.x (mgr.34562) 277 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:44:24.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:44:24 smithi188 bash[23329]: cluster 2020-07-16T13:44:23.571861+0000 mgr.x (mgr.34562) 278 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:44:25.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:44:24 smithi132 bash[27079]: cluster 2020-07-16T13:44:23.571861+0000 mgr.x (mgr.34562) 278 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:44:26.064 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T13:44:26.318 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T13:44:26.319 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (7m) 5m ago 10m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T13:44:26.319 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (9m) 5m ago 9m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T13:44:26.320 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (7m) 5m ago 13m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T13:44:26.320 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (6m) 5m ago 14m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T13:44:26.320 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 5m ago 14m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T13:44:26.321 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (13m) 5m ago 13m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T13:44:26.321 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (13m) 5m ago 13m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T13:44:26.321 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (10m) 5m ago 10m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T13:44:26.322 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (10m) 5m ago 10m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T13:44:26.322 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (12m) 5m ago 12m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T13:44:26.322 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (12m) 5m ago 12m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T13:44:26.323 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (12m) 5m ago 12m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T13:44:26.323 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (11m) 5m ago 11m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T13:44:26.323 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (11m) 5m ago 11m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T13:44:26.324 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (11m) 5m ago 11m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T13:44:26.324 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (11m) 5m ago 11m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T13:44:26.324 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (10m) 5m ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T13:44:26.325 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (9m) 5m ago 10m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T13:44:26.618 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T13:44:26.618 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T13:44:26.618 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T13:44:26.618 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T13:44:26.619 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:44:26.619 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T13:44:26.619 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T13:44:26.619 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:44:26.619 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T13:44:26.620 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T13:44:26.620 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:44:26.620 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T13:44:26.620 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T13:44:26.620 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T13:44:26.621 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T13:44:26.621 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T13:44:26.621 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T13:44:26.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:44:26 smithi188 bash[23329]: cluster 2020-07-16T13:44:25.572336+0000 mgr.x (mgr.34562) 279 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:44:26.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:44:26 smithi188 bash[23329]: audit 2020-07-16T13:44:26.616983+0000 mon.c (mon.1) 77 : audit [DBG] from='client.? 172.21.15.132:0/3881716780' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:44:27.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:44:26 smithi132 bash[27079]: cluster 2020-07-16T13:44:25.572336+0000 mgr.x (mgr.34562) 279 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:44:27.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:44:26 smithi132 bash[27079]: audit 2020-07-16T13:44:26.616983+0000 mon.c (mon.1) 77 : audit [DBG] from='client.? 172.21.15.132:0/3881716780' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:44:27.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:44:27 smithi188 bash[23329]: audit 2020-07-16T13:44:26.047431+0000 mgr.x (mgr.34562) 280 : audit [DBG] from='client.24838 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:44:27.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:44:27 smithi188 bash[23329]: audit 2020-07-16T13:44:26.314033+0000 mgr.x (mgr.34562) 281 : audit [DBG] from='client.24844 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:44:28.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:44:27 smithi132 bash[27079]: audit 2020-07-16T13:44:26.047431+0000 mgr.x (mgr.34562) 280 : audit [DBG] from='client.24838 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:44:28.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:44:27 smithi132 bash[27079]: audit 2020-07-16T13:44:26.314033+0000 mgr.x (mgr.34562) 281 : audit [DBG] from='client.24844 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:44:28.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:44:28 smithi188 bash[23329]: cluster 2020-07-16T13:44:27.572824+0000 mgr.x (mgr.34562) 282 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:44:29.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:44:28 smithi132 bash[27079]: cluster 2020-07-16T13:44:27.572824+0000 mgr.x (mgr.34562) 282 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:44:30.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:44:30 smithi132 bash[27079]: cluster 2020-07-16T13:44:29.573259+0000 mgr.x (mgr.34562) 283 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:44:30.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:44:30 smithi188 bash[23329]: cluster 2020-07-16T13:44:29.573259+0000 mgr.x (mgr.34562) 283 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:44:32.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:44:32 smithi188 bash[23329]: cluster 2020-07-16T13:44:31.573703+0000 mgr.x (mgr.34562) 284 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:44:33.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:44:32 smithi132 bash[27079]: cluster 2020-07-16T13:44:31.573703+0000 mgr.x (mgr.34562) 284 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:44:34.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:44:34 smithi188 bash[23329]: cluster 2020-07-16T13:44:33.574261+0000 mgr.x (mgr.34562) 285 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:44:35.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:44:34 smithi132 bash[27079]: cluster 2020-07-16T13:44:33.574261+0000 mgr.x (mgr.34562) 285 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:44:36.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:44:36 smithi188 bash[23329]: cluster 2020-07-16T13:44:35.574830+0000 mgr.x (mgr.34562) 286 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:44:36.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:44:36 smithi188 bash[23329]: audit 2020-07-16T13:44:36.073484+0000 mon.b (mon.2) 208 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:44:37.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:44:36 smithi132 bash[27079]: cluster 2020-07-16T13:44:35.574830+0000 mgr.x (mgr.34562) 286 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:44:37.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:44:36 smithi132 bash[27079]: audit 2020-07-16T13:44:36.073484+0000 mon.b (mon.2) 208 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:44:37.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:44:37 smithi188 bash[23329]: cephadm 2020-07-16T13:44:36.074142+0000 mgr.x (mgr.34562) 287 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:44:37.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:44:37 smithi188 bash[23329]: cephadm 2020-07-16T13:44:36.074463+0000 mgr.x (mgr.34562) 288 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:44:38.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:44:37 smithi132 bash[27079]: cephadm 2020-07-16T13:44:36.074142+0000 mgr.x (mgr.34562) 287 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:44:38.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:44:37 smithi132 bash[27079]: cephadm 2020-07-16T13:44:36.074463+0000 mgr.x (mgr.34562) 288 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:44:38.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:44:38 smithi188 bash[23329]: cluster 2020-07-16T13:44:37.575390+0000 mgr.x (mgr.34562) 289 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:44:39.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:44:38 smithi132 bash[27079]: cluster 2020-07-16T13:44:37.575390+0000 mgr.x (mgr.34562) 289 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:44:40.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:44:40 smithi132 bash[27079]: cluster 2020-07-16T13:44:39.575906+0000 mgr.x (mgr.34562) 290 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:44:40.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:44:40 smithi188 bash[23329]: cluster 2020-07-16T13:44:39.575906+0000 mgr.x (mgr.34562) 290 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:44:42.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:44:42 smithi188 bash[23329]: cluster 2020-07-16T13:44:41.576392+0000 mgr.x (mgr.34562) 291 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:44:43.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:44:42 smithi132 bash[27079]: cluster 2020-07-16T13:44:41.576392+0000 mgr.x (mgr.34562) 291 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:44:44.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:44:44 smithi188 bash[23329]: cluster 2020-07-16T13:44:43.576752+0000 mgr.x (mgr.34562) 292 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:44:45.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:44:44 smithi132 bash[27079]: cluster 2020-07-16T13:44:43.576752+0000 mgr.x (mgr.34562) 292 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:44:46.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:44:46 smithi188 bash[23329]: cluster 2020-07-16T13:44:45.577089+0000 mgr.x (mgr.34562) 293 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:44:47.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:44:46 smithi132 bash[27079]: cluster 2020-07-16T13:44:45.577089+0000 mgr.x (mgr.34562) 293 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:44:48.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:44:48 smithi188 bash[23329]: cluster 2020-07-16T13:44:47.577614+0000 mgr.x (mgr.34562) 294 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:44:49.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:44:48 smithi132 bash[27079]: cluster 2020-07-16T13:44:47.577614+0000 mgr.x (mgr.34562) 294 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:44:50.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:44:50 smithi132 bash[27079]: cluster 2020-07-16T13:44:49.578026+0000 mgr.x (mgr.34562) 295 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:44:50.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:44:50 smithi188 bash[23329]: cluster 2020-07-16T13:44:49.578026+0000 mgr.x (mgr.34562) 295 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:44:51.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:44:51 smithi188 bash[23329]: audit 2020-07-16T13:44:51.090032+0000 mon.b (mon.2) 209 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:44:51.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:44:51 smithi132 bash[27079]: audit 2020-07-16T13:44:51.090032+0000 mon.b (mon.2) 209 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:44:52.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:44:52 smithi188 bash[23329]: cephadm 2020-07-16T13:44:51.090838+0000 mgr.x (mgr.34562) 296 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:44:52.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:44:52 smithi188 bash[23329]: cephadm 2020-07-16T13:44:51.091133+0000 mgr.x (mgr.34562) 297 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:44:52.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:44:52 smithi188 bash[23329]: cluster 2020-07-16T13:44:51.578561+0000 mgr.x (mgr.34562) 298 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:44:52.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:44:52 smithi132 bash[27079]: cephadm 2020-07-16T13:44:51.090838+0000 mgr.x (mgr.34562) 296 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:44:52.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:44:52 smithi132 bash[27079]: cephadm 2020-07-16T13:44:51.091133+0000 mgr.x (mgr.34562) 297 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:44:52.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:44:52 smithi132 bash[27079]: cluster 2020-07-16T13:44:51.578561+0000 mgr.x (mgr.34562) 298 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:44:54.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:44:54 smithi188 bash[23329]: cluster 2020-07-16T13:44:53.579010+0000 mgr.x (mgr.34562) 299 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:44:55.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:44:54 smithi132 bash[27079]: cluster 2020-07-16T13:44:53.579010+0000 mgr.x (mgr.34562) 299 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:44:56.915 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T13:44:56.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:44:56 smithi188 bash[23329]: cluster 2020-07-16T13:44:55.579494+0000 mgr.x (mgr.34562) 300 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:44:57.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:44:56 smithi132 bash[27079]: cluster 2020-07-16T13:44:55.579494+0000 mgr.x (mgr.34562) 300 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:44:57.178 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T13:44:57.178 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (7m) 6m ago 10m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T13:44:57.179 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (10m) 6m ago 10m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T13:44:57.179 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (8m) 6m ago 13m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T13:44:57.179 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (7m) 6m ago 15m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T13:44:57.179 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 6m ago 15m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T13:44:57.180 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (13m) 6m ago 13m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T13:44:57.180 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (13m) 6m ago 13m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T13:44:57.180 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (10m) 6m ago 10m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T13:44:57.181 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (10m) 6m ago 10m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T13:44:57.181 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (13m) 6m ago 13m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T13:44:57.181 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (13m) 6m ago 13m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T13:44:57.182 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (12m) 6m ago 12m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T13:44:57.182 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (12m) 6m ago 12m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T13:44:57.182 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (11m) 6m ago 12m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T13:44:57.182 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (11m) 6m ago 11m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T13:44:57.183 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (11m) 6m ago 11m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T13:44:57.183 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (11m) 6m ago 11m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T13:44:57.183 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (10m) 6m ago 11m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T13:44:57.475 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T13:44:57.476 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T13:44:57.476 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T13:44:57.476 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T13:44:57.477 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:44:57.477 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T13:44:57.477 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T13:44:57.477 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:44:57.477 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T13:44:57.478 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T13:44:57.478 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:44:57.478 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T13:44:57.478 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T13:44:57.478 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T13:44:57.479 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T13:44:57.479 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T13:44:57.479 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T13:44:57.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:44:57 smithi188 bash[23329]: audit 2020-07-16T13:44:56.903171+0000 mgr.x (mgr.34562) 301 : audit [DBG] from='client.24856 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:44:57.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:44:57 smithi188 bash[23329]: audit 2020-07-16T13:44:57.474763+0000 mon.c (mon.1) 78 : audit [DBG] from='client.? 172.21.15.132:0/1136646810' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:44:58.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:44:57 smithi132 bash[27079]: audit 2020-07-16T13:44:56.903171+0000 mgr.x (mgr.34562) 301 : audit [DBG] from='client.24856 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:44:58.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:44:57 smithi132 bash[27079]: audit 2020-07-16T13:44:57.474763+0000 mon.c (mon.1) 78 : audit [DBG] from='client.? 172.21.15.132:0/1136646810' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:44:58.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:44:58 smithi188 bash[23329]: audit 2020-07-16T13:44:57.173463+0000 mgr.x (mgr.34562) 302 : audit [DBG] from='client.24862 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:44:58.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:44:58 smithi188 bash[23329]: cluster 2020-07-16T13:44:57.579971+0000 mgr.x (mgr.34562) 303 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:44:59.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:44:58 smithi132 bash[27079]: audit 2020-07-16T13:44:57.173463+0000 mgr.x (mgr.34562) 302 : audit [DBG] from='client.24862 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:44:59.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:44:58 smithi132 bash[27079]: cluster 2020-07-16T13:44:57.579971+0000 mgr.x (mgr.34562) 303 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:45:00.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:45:00 smithi132 bash[27079]: cluster 2020-07-16T13:44:59.580435+0000 mgr.x (mgr.34562) 304 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:45:00.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:45:00 smithi188 bash[23329]: cluster 2020-07-16T13:44:59.580435+0000 mgr.x (mgr.34562) 304 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:45:02.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:45:02 smithi188 bash[23329]: cluster 2020-07-16T13:45:01.580948+0000 mgr.x (mgr.34562) 305 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:45:03.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:45:02 smithi132 bash[27079]: cluster 2020-07-16T13:45:01.580948+0000 mgr.x (mgr.34562) 305 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:45:04.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:45:04 smithi188 bash[23329]: cluster 2020-07-16T13:45:03.581442+0000 mgr.x (mgr.34562) 306 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:45:05.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:45:04 smithi132 bash[27079]: cluster 2020-07-16T13:45:03.581442+0000 mgr.x (mgr.34562) 306 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:45:06.877 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:45:06 smithi132 bash[27079]: cluster 2020-07-16T13:45:05.581910+0000 mgr.x (mgr.34562) 307 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:45:06.877 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:45:06 smithi132 bash[27079]: audit 2020-07-16T13:45:06.098209+0000 mon.b (mon.2) 210 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:45:06.877 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:45:06 smithi132 bash[27079]: audit 2020-07-16T13:45:06.099511+0000 mon.b (mon.2) 211 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:45:06.878 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:45:06 smithi132 bash[27079]: audit 2020-07-16T13:45:06.100731+0000 mon.b (mon.2) 212 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:45:06.878 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:45:06 smithi132 bash[27079]: audit 2020-07-16T13:45:06.102129+0000 mon.b (mon.2) 213 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T13:45:06.878 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:45:06 smithi132 bash[27079]: audit 2020-07-16T13:45:06.103598+0000 mon.b (mon.2) 214 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:45:06.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:45:06 smithi188 bash[23329]: cluster 2020-07-16T13:45:05.581910+0000 mgr.x (mgr.34562) 307 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:45:06.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:45:06 smithi188 bash[23329]: audit 2020-07-16T13:45:06.098209+0000 mon.b (mon.2) 210 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:45:06.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:45:06 smithi188 bash[23329]: audit 2020-07-16T13:45:06.099511+0000 mon.b (mon.2) 211 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:45:06.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:45:06 smithi188 bash[23329]: audit 2020-07-16T13:45:06.100731+0000 mon.b (mon.2) 212 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:45:06.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:45:06 smithi188 bash[23329]: audit 2020-07-16T13:45:06.102129+0000 mon.b (mon.2) 213 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T13:45:06.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:45:06 smithi188 bash[23329]: audit 2020-07-16T13:45:06.103598+0000 mon.b (mon.2) 214 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:45:07.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:45:07 smithi188 bash[23329]: audit 2020-07-16T13:45:06.098570+0000 mgr.x (mgr.34562) 308 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:45:07.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:45:07 smithi188 bash[23329]: audit 2020-07-16T13:45:06.099820+0000 mgr.x (mgr.34562) 309 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:45:07.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:45:07 smithi188 bash[23329]: audit 2020-07-16T13:45:06.101004+0000 mgr.x (mgr.34562) 310 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:45:07.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:45:07 smithi188 bash[23329]: cephadm 2020-07-16T13:45:06.101746+0000 mgr.x (mgr.34562) 311 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T13:45:07.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:45:07 smithi188 bash[23329]: cephadm 2020-07-16T13:45:06.103040+0000 mgr.x (mgr.34562) 312 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T13:45:07.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:45:07 smithi188 bash[23329]: cephadm 2020-07-16T13:45:06.104346+0000 mgr.x (mgr.34562) 313 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T13:45:07.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:45:07 smithi188 bash[23329]: cephadm 2020-07-16T13:45:06.104642+0000 mgr.x (mgr.34562) 314 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T13:45:08.026 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:45:07 smithi132 bash[27079]: audit 2020-07-16T13:45:06.098570+0000 mgr.x (mgr.34562) 308 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:45:08.027 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:45:07 smithi132 bash[27079]: audit 2020-07-16T13:45:06.099820+0000 mgr.x (mgr.34562) 309 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:45:08.027 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:45:07 smithi132 bash[27079]: audit 2020-07-16T13:45:06.101004+0000 mgr.x (mgr.34562) 310 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:45:08.027 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:45:07 smithi132 bash[27079]: cephadm 2020-07-16T13:45:06.101746+0000 mgr.x (mgr.34562) 311 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T13:45:08.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:45:07 smithi132 bash[27079]: cephadm 2020-07-16T13:45:06.103040+0000 mgr.x (mgr.34562) 312 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T13:45:08.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:45:07 smithi132 bash[27079]: cephadm 2020-07-16T13:45:06.104346+0000 mgr.x (mgr.34562) 313 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T13:45:08.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:45:07 smithi132 bash[27079]: cephadm 2020-07-16T13:45:06.104642+0000 mgr.x (mgr.34562) 314 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T13:45:08.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:45:08 smithi188 bash[23329]: cluster 2020-07-16T13:45:07.582376+0000 mgr.x (mgr.34562) 315 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:45:09.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:45:08 smithi132 bash[27079]: cluster 2020-07-16T13:45:07.582376+0000 mgr.x (mgr.34562) 315 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:45:09.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:45:09 smithi188 bash[23329]: audit 2020-07-16T13:45:08.893471+0000 mon.b (mon.2) 215 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:45:09.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:45:09 smithi188 bash[23329]: cephadm 2020-07-16T13:45:08.894115+0000 mgr.x (mgr.34562) 316 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:45:09.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:45:09 smithi188 bash[23329]: cephadm 2020-07-16T13:45:08.894351+0000 mgr.x (mgr.34562) 317 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:45:10.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:45:09 smithi132 bash[27079]: audit 2020-07-16T13:45:08.893471+0000 mon.b (mon.2) 215 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:45:10.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:45:09 smithi132 bash[27079]: cephadm 2020-07-16T13:45:08.894115+0000 mgr.x (mgr.34562) 316 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:45:10.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:45:09 smithi132 bash[27079]: cephadm 2020-07-16T13:45:08.894351+0000 mgr.x (mgr.34562) 317 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:45:10.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:45:10 smithi188 bash[23329]: cluster 2020-07-16T13:45:09.582802+0000 mgr.x (mgr.34562) 318 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:45:11.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:45:10 smithi132 bash[27079]: cluster 2020-07-16T13:45:09.582802+0000 mgr.x (mgr.34562) 318 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:45:12.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:45:12 smithi188 bash[23329]: cluster 2020-07-16T13:45:11.583266+0000 mgr.x (mgr.34562) 319 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:45:13.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:45:12 smithi132 bash[27079]: cluster 2020-07-16T13:45:11.583266+0000 mgr.x (mgr.34562) 319 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:45:14.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:45:14 smithi188 bash[23329]: cluster 2020-07-16T13:45:13.583652+0000 mgr.x (mgr.34562) 320 : cluster [DBG] pgmap v197: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:45:15.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:45:14 smithi132 bash[27079]: cluster 2020-07-16T13:45:13.583652+0000 mgr.x (mgr.34562) 320 : cluster [DBG] pgmap v197: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:45:16.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:45:16 smithi188 bash[23329]: cluster 2020-07-16T13:45:15.584010+0000 mgr.x (mgr.34562) 321 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:45:17.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:45:16 smithi132 bash[27079]: cluster 2020-07-16T13:45:15.584010+0000 mgr.x (mgr.34562) 321 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:45:18.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:45:18 smithi188 bash[23329]: cluster 2020-07-16T13:45:17.584423+0000 mgr.x (mgr.34562) 322 : cluster [DBG] pgmap v199: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:45:19.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:45:18 smithi132 bash[27079]: cluster 2020-07-16T13:45:17.584423+0000 mgr.x (mgr.34562) 322 : cluster [DBG] pgmap v199: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:45:20.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:45:20 smithi132 bash[27079]: cluster 2020-07-16T13:45:19.584828+0000 mgr.x (mgr.34562) 323 : cluster [DBG] pgmap v200: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:45:20.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:45:20 smithi188 bash[23329]: cluster 2020-07-16T13:45:19.584828+0000 mgr.x (mgr.34562) 323 : cluster [DBG] pgmap v200: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:45:22.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:45:22 smithi188 bash[23329]: cluster 2020-07-16T13:45:21.585369+0000 mgr.x (mgr.34562) 324 : cluster [DBG] pgmap v201: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:45:23.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:45:22 smithi132 bash[27079]: cluster 2020-07-16T13:45:21.585369+0000 mgr.x (mgr.34562) 324 : cluster [DBG] pgmap v201: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:45:24.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:45:24 smithi188 bash[23329]: cluster 2020-07-16T13:45:23.585821+0000 mgr.x (mgr.34562) 325 : cluster [DBG] pgmap v202: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:45:24.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:45:24 smithi188 bash[23329]: audit 2020-07-16T13:45:23.897891+0000 mon.b (mon.2) 216 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:45:24.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:45:24 smithi188 bash[23329]: cephadm 2020-07-16T13:45:23.898617+0000 mgr.x (mgr.34562) 326 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:45:24.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:45:24 smithi188 bash[23329]: cephadm 2020-07-16T13:45:23.898749+0000 mgr.x (mgr.34562) 327 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:45:25.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:45:24 smithi132 bash[27079]: cluster 2020-07-16T13:45:23.585821+0000 mgr.x (mgr.34562) 325 : cluster [DBG] pgmap v202: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:45:25.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:45:24 smithi132 bash[27079]: audit 2020-07-16T13:45:23.897891+0000 mon.b (mon.2) 216 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:45:25.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:45:24 smithi132 bash[27079]: cephadm 2020-07-16T13:45:23.898617+0000 mgr.x (mgr.34562) 326 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:45:25.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:45:24 smithi132 bash[27079]: cephadm 2020-07-16T13:45:23.898749+0000 mgr.x (mgr.34562) 327 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:45:26.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:45:26 smithi188 bash[23329]: cluster 2020-07-16T13:45:25.586207+0000 mgr.x (mgr.34562) 328 : cluster [DBG] pgmap v203: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:45:27.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:45:26 smithi132 bash[27079]: cluster 2020-07-16T13:45:25.586207+0000 mgr.x (mgr.34562) 328 : cluster [DBG] pgmap v203: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:45:27.774 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T13:45:28.034 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T13:45:28.034 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (8m) 6m ago 11m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T13:45:28.035 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (10m) 6m ago 10m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T13:45:28.035 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (8m) 6m ago 14m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T13:45:28.035 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (7m) 6m ago 15m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T13:45:28.035 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 6m ago 15m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T13:45:28.035 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (14m) 6m ago 14m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T13:45:28.036 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (14m) 6m ago 14m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T13:45:28.036 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (11m) 6m ago 11m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T13:45:28.036 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (11m) 6m ago 11m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T13:45:28.036 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (13m) 6m ago 13m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T13:45:28.037 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (13m) 6m ago 13m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T13:45:28.037 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (13m) 6m ago 13m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T13:45:28.037 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (12m) 6m ago 13m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T13:45:28.037 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (12m) 6m ago 12m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T13:45:28.037 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (12m) 6m ago 12m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T13:45:28.038 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (12m) 6m ago 12m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T13:45:28.038 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (11m) 6m ago 11m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T13:45:28.038 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (10m) 6m ago 11m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T13:45:28.330 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T13:45:28.331 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T13:45:28.331 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T13:45:28.331 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T13:45:28.331 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:45:28.331 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T13:45:28.332 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T13:45:28.332 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:45:28.332 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T13:45:28.332 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T13:45:28.332 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:45:28.333 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T13:45:28.333 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T13:45:28.333 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T13:45:28.333 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T13:45:28.333 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T13:45:28.334 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T13:45:28.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:45:28 smithi188 bash[23329]: cluster 2020-07-16T13:45:27.586595+0000 mgr.x (mgr.34562) 329 : cluster [DBG] pgmap v204: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:45:28.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:45:28 smithi188 bash[23329]: audit 2020-07-16T13:45:27.761198+0000 mgr.x (mgr.34562) 330 : audit [DBG] from='client.24874 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:45:28.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:45:28 smithi188 bash[23329]: audit 2020-07-16T13:45:28.329452+0000 mon.c (mon.1) 79 : audit [DBG] from='client.? 172.21.15.132:0/2164080230' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:45:29.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:45:28 smithi132 bash[27079]: cluster 2020-07-16T13:45:27.586595+0000 mgr.x (mgr.34562) 329 : cluster [DBG] pgmap v204: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:45:29.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:45:28 smithi132 bash[27079]: audit 2020-07-16T13:45:27.761198+0000 mgr.x (mgr.34562) 330 : audit [DBG] from='client.24874 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:45:29.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:45:28 smithi132 bash[27079]: audit 2020-07-16T13:45:28.329452+0000 mon.c (mon.1) 79 : audit [DBG] from='client.? 172.21.15.132:0/2164080230' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:45:29.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:45:29 smithi188 bash[23329]: audit 2020-07-16T13:45:28.029898+0000 mgr.x (mgr.34562) 331 : audit [DBG] from='client.24880 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:45:30.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:45:29 smithi132 bash[27079]: audit 2020-07-16T13:45:28.029898+0000 mgr.x (mgr.34562) 331 : audit [DBG] from='client.24880 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:45:30.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:45:30 smithi188 bash[23329]: cluster 2020-07-16T13:45:29.586971+0000 mgr.x (mgr.34562) 332 : cluster [DBG] pgmap v205: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:45:31.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:45:30 smithi132 bash[27079]: cluster 2020-07-16T13:45:29.586971+0000 mgr.x (mgr.34562) 332 : cluster [DBG] pgmap v205: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:45:32.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:45:32 smithi188 bash[23329]: cluster 2020-07-16T13:45:31.587343+0000 mgr.x (mgr.34562) 333 : cluster [DBG] pgmap v206: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:45:33.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:45:32 smithi132 bash[27079]: cluster 2020-07-16T13:45:31.587343+0000 mgr.x (mgr.34562) 333 : cluster [DBG] pgmap v206: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:45:34.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:45:34 smithi188 bash[23329]: cluster 2020-07-16T13:45:33.587730+0000 mgr.x (mgr.34562) 334 : cluster [DBG] pgmap v207: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:45:35.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:45:34 smithi132 bash[27079]: cluster 2020-07-16T13:45:33.587730+0000 mgr.x (mgr.34562) 334 : cluster [DBG] pgmap v207: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:45:36.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:45:36 smithi188 bash[23329]: cluster 2020-07-16T13:45:35.588233+0000 mgr.x (mgr.34562) 335 : cluster [DBG] pgmap v208: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:45:37.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:45:36 smithi132 bash[27079]: cluster 2020-07-16T13:45:35.588233+0000 mgr.x (mgr.34562) 335 : cluster [DBG] pgmap v208: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:45:38.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:45:38 smithi188 bash[23329]: cluster 2020-07-16T13:45:37.588817+0000 mgr.x (mgr.34562) 336 : cluster [DBG] pgmap v209: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:45:39.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:45:38 smithi132 bash[27079]: cluster 2020-07-16T13:45:37.588817+0000 mgr.x (mgr.34562) 336 : cluster [DBG] pgmap v209: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:45:39.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:45:39 smithi188 bash[23329]: audit 2020-07-16T13:45:38.902752+0000 mon.b (mon.2) 217 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:45:39.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:45:39 smithi188 bash[23329]: cephadm 2020-07-16T13:45:38.903453+0000 mgr.x (mgr.34562) 337 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:45:39.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:45:39 smithi188 bash[23329]: cephadm 2020-07-16T13:45:38.903600+0000 mgr.x (mgr.34562) 338 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:45:40.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:45:39 smithi132 bash[27079]: audit 2020-07-16T13:45:38.902752+0000 mon.b (mon.2) 217 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:45:40.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:45:39 smithi132 bash[27079]: cephadm 2020-07-16T13:45:38.903453+0000 mgr.x (mgr.34562) 337 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:45:40.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:45:39 smithi132 bash[27079]: cephadm 2020-07-16T13:45:38.903600+0000 mgr.x (mgr.34562) 338 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:45:41.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:45:40 smithi132 bash[27079]: cluster 2020-07-16T13:45:39.589320+0000 mgr.x (mgr.34562) 339 : cluster [DBG] pgmap v210: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:45:41.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:45:40 smithi188 bash[23329]: cluster 2020-07-16T13:45:39.589320+0000 mgr.x (mgr.34562) 339 : cluster [DBG] pgmap v210: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:45:43.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:45:42 smithi132 bash[27079]: cluster 2020-07-16T13:45:41.589696+0000 mgr.x (mgr.34562) 340 : cluster [DBG] pgmap v211: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:45:43.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:45:42 smithi188 bash[23329]: cluster 2020-07-16T13:45:41.589696+0000 mgr.x (mgr.34562) 340 : cluster [DBG] pgmap v211: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:45:45.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:45:44 smithi132 bash[27079]: cluster 2020-07-16T13:45:43.590158+0000 mgr.x (mgr.34562) 341 : cluster [DBG] pgmap v212: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:45:45.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:45:44 smithi188 bash[23329]: cluster 2020-07-16T13:45:43.590158+0000 mgr.x (mgr.34562) 341 : cluster [DBG] pgmap v212: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:45:47.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:45:46 smithi132 bash[27079]: cluster 2020-07-16T13:45:45.590528+0000 mgr.x (mgr.34562) 342 : cluster [DBG] pgmap v213: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:45:47.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:45:46 smithi188 bash[23329]: cluster 2020-07-16T13:45:45.590528+0000 mgr.x (mgr.34562) 342 : cluster [DBG] pgmap v213: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:45:49.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:45:48 smithi132 bash[27079]: cluster 2020-07-16T13:45:47.591053+0000 mgr.x (mgr.34562) 343 : cluster [DBG] pgmap v214: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:45:49.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:45:48 smithi188 bash[23329]: cluster 2020-07-16T13:45:47.591053+0000 mgr.x (mgr.34562) 343 : cluster [DBG] pgmap v214: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:45:50.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:45:50 smithi132 bash[27079]: cluster 2020-07-16T13:45:49.591568+0000 mgr.x (mgr.34562) 344 : cluster [DBG] pgmap v215: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:45:50.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:45:50 smithi188 bash[23329]: cluster 2020-07-16T13:45:49.591568+0000 mgr.x (mgr.34562) 344 : cluster [DBG] pgmap v215: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:45:52.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:45:52 smithi188 bash[23329]: cluster 2020-07-16T13:45:51.592094+0000 mgr.x (mgr.34562) 345 : cluster [DBG] pgmap v216: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:45:53.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:45:52 smithi132 bash[27079]: cluster 2020-07-16T13:45:51.592094+0000 mgr.x (mgr.34562) 345 : cluster [DBG] pgmap v216: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:45:54.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:45:54 smithi188 bash[23329]: cluster 2020-07-16T13:45:53.592607+0000 mgr.x (mgr.34562) 346 : cluster [DBG] pgmap v217: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:45:54.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:45:54 smithi188 bash[23329]: audit 2020-07-16T13:45:53.919381+0000 mon.b (mon.2) 218 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:45:54.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:45:54 smithi188 bash[23329]: cephadm 2020-07-16T13:45:53.920115+0000 mgr.x (mgr.34562) 347 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:45:54.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:45:54 smithi188 bash[23329]: cephadm 2020-07-16T13:45:53.920596+0000 mgr.x (mgr.34562) 348 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:45:55.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:45:54 smithi132 bash[27079]: cluster 2020-07-16T13:45:53.592607+0000 mgr.x (mgr.34562) 346 : cluster [DBG] pgmap v217: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:45:55.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:45:54 smithi132 bash[27079]: audit 2020-07-16T13:45:53.919381+0000 mon.b (mon.2) 218 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:45:55.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:45:54 smithi132 bash[27079]: cephadm 2020-07-16T13:45:53.920115+0000 mgr.x (mgr.34562) 347 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:45:55.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:45:54 smithi132 bash[27079]: cephadm 2020-07-16T13:45:53.920596+0000 mgr.x (mgr.34562) 348 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:45:56.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:45:56 smithi188 bash[23329]: cluster 2020-07-16T13:45:55.593004+0000 mgr.x (mgr.34562) 349 : cluster [DBG] pgmap v218: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:45:57.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:45:56 smithi132 bash[27079]: cluster 2020-07-16T13:45:55.593004+0000 mgr.x (mgr.34562) 349 : cluster [DBG] pgmap v218: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:45:58.628 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T13:45:58.891 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T13:45:58.891 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (8m) 7m ago 11m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T13:45:58.892 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (11m) 7m ago 11m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T13:45:58.892 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (9m) 7m ago 14m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T13:45:58.892 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (8m) 7m ago 16m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T13:45:58.892 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 7m ago 16m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T13:45:58.893 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (14m) 7m ago 14m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T13:45:58.893 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (15m) 7m ago 15m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T13:45:58.893 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (11m) 7m ago 12m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T13:45:58.893 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (11m) 7m ago 12m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T13:45:58.893 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (14m) 7m ago 14m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T13:45:58.894 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (14m) 7m ago 14m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T13:45:58.894 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (13m) 7m ago 13m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T13:45:58.894 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (13m) 7m ago 13m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T13:45:58.894 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (12m) 7m ago 13m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T13:45:58.894 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (12m) 7m ago 12m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T13:45:58.894 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (12m) 7m ago 12m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T13:45:58.895 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (12m) 7m ago 12m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T13:45:58.895 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (11m) 7m ago 12m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T13:45:58.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:45:58 smithi188 bash[23329]: cluster 2020-07-16T13:45:57.593414+0000 mgr.x (mgr.34562) 350 : cluster [DBG] pgmap v219: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:45:59.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:45:58 smithi132 bash[27079]: cluster 2020-07-16T13:45:57.593414+0000 mgr.x (mgr.34562) 350 : cluster [DBG] pgmap v219: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:45:59.191 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T13:45:59.191 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T13:45:59.192 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T13:45:59.192 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T13:45:59.192 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:45:59.192 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T13:45:59.192 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T13:45:59.193 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:45:59.193 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T13:45:59.193 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T13:45:59.193 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:45:59.193 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T13:45:59.194 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T13:45:59.194 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T13:45:59.194 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T13:45:59.194 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T13:45:59.194 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T13:45:59.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:45:59 smithi188 bash[23329]: audit 2020-07-16T13:45:58.616654+0000 mgr.x (mgr.34562) 351 : audit [DBG] from='client.24892 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:45:59.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:45:59 smithi188 bash[23329]: audit 2020-07-16T13:45:58.886930+0000 mgr.x (mgr.34562) 352 : audit [DBG] from='client.24898 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:45:59.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:45:59 smithi188 bash[23329]: audit 2020-07-16T13:45:59.190538+0000 mon.c (mon.1) 80 : audit [DBG] from='client.? 172.21.15.132:0/3856428884' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:46:00.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:45:59 smithi132 bash[27079]: audit 2020-07-16T13:45:58.616654+0000 mgr.x (mgr.34562) 351 : audit [DBG] from='client.24892 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:46:00.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:45:59 smithi132 bash[27079]: audit 2020-07-16T13:45:58.886930+0000 mgr.x (mgr.34562) 352 : audit [DBG] from='client.24898 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:46:00.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:45:59 smithi132 bash[27079]: audit 2020-07-16T13:45:59.190538+0000 mon.c (mon.1) 80 : audit [DBG] from='client.? 172.21.15.132:0/3856428884' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:46:00.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:46:00 smithi188 bash[23329]: cluster 2020-07-16T13:45:59.593790+0000 mgr.x (mgr.34562) 353 : cluster [DBG] pgmap v220: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:46:01.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:46:00 smithi132 bash[27079]: cluster 2020-07-16T13:45:59.593790+0000 mgr.x (mgr.34562) 353 : cluster [DBG] pgmap v220: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:46:02.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:46:02 smithi188 bash[23329]: cluster 2020-07-16T13:46:01.594232+0000 mgr.x (mgr.34562) 354 : cluster [DBG] pgmap v221: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:46:03.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:46:02 smithi132 bash[27079]: cluster 2020-07-16T13:46:01.594232+0000 mgr.x (mgr.34562) 354 : cluster [DBG] pgmap v221: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:46:04.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:46:04 smithi188 bash[23329]: cluster 2020-07-16T13:46:03.594611+0000 mgr.x (mgr.34562) 355 : cluster [DBG] pgmap v222: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:46:05.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:46:04 smithi132 bash[27079]: cluster 2020-07-16T13:46:03.594611+0000 mgr.x (mgr.34562) 355 : cluster [DBG] pgmap v222: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:46:06.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:46:06 smithi188 bash[23329]: cluster 2020-07-16T13:46:05.594974+0000 mgr.x (mgr.34562) 356 : cluster [DBG] pgmap v223: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:46:07.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:46:06 smithi132 bash[27079]: cluster 2020-07-16T13:46:05.594974+0000 mgr.x (mgr.34562) 356 : cluster [DBG] pgmap v223: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:46:09.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:46:08 smithi132 bash[27079]: cluster 2020-07-16T13:46:07.595516+0000 mgr.x (mgr.34562) 357 : cluster [DBG] pgmap v224: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:46:09.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:46:08 smithi188 bash[23329]: cluster 2020-07-16T13:46:07.595516+0000 mgr.x (mgr.34562) 357 : cluster [DBG] pgmap v224: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:46:09.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:46:09 smithi132 bash[27079]: audit 2020-07-16T13:46:08.938611+0000 mon.b (mon.2) 219 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:46:09.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:46:09 smithi132 bash[27079]: audit 2020-07-16T13:46:08.939939+0000 mon.b (mon.2) 220 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:46:09.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:46:09 smithi132 bash[27079]: audit 2020-07-16T13:46:08.941099+0000 mon.b (mon.2) 221 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:46:09.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:46:09 smithi132 bash[27079]: audit 2020-07-16T13:46:08.942356+0000 mon.b (mon.2) 222 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T13:46:09.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:46:09 smithi132 bash[27079]: audit 2020-07-16T13:46:08.943489+0000 mon.b (mon.2) 223 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:46:10.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:46:09 smithi188 bash[23329]: audit 2020-07-16T13:46:08.938611+0000 mon.b (mon.2) 219 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:46:10.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:46:09 smithi188 bash[23329]: audit 2020-07-16T13:46:08.939939+0000 mon.b (mon.2) 220 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:46:10.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:46:09 smithi188 bash[23329]: audit 2020-07-16T13:46:08.941099+0000 mon.b (mon.2) 221 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:46:10.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:46:09 smithi188 bash[23329]: audit 2020-07-16T13:46:08.942356+0000 mon.b (mon.2) 222 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T13:46:10.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:46:09 smithi188 bash[23329]: audit 2020-07-16T13:46:08.943489+0000 mon.b (mon.2) 223 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:46:11.025 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:46:10 smithi132 bash[27079]: audit 2020-07-16T13:46:08.938963+0000 mgr.x (mgr.34562) 358 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:46:11.025 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:46:10 smithi132 bash[27079]: audit 2020-07-16T13:46:08.940251+0000 mgr.x (mgr.34562) 359 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:46:11.025 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:46:10 smithi132 bash[27079]: audit 2020-07-16T13:46:08.941384+0000 mgr.x (mgr.34562) 360 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:46:11.026 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:46:10 smithi132 bash[27079]: cephadm 2020-07-16T13:46:08.942072+0000 mgr.x (mgr.34562) 361 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T13:46:11.026 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:46:10 smithi132 bash[27079]: cephadm 2020-07-16T13:46:08.943148+0000 mgr.x (mgr.34562) 362 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T13:46:11.026 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:46:10 smithi132 bash[27079]: cephadm 2020-07-16T13:46:08.944114+0000 mgr.x (mgr.34562) 363 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T13:46:11.026 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:46:10 smithi132 bash[27079]: cephadm 2020-07-16T13:46:08.944186+0000 mgr.x (mgr.34562) 364 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T13:46:11.027 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:46:10 smithi132 bash[27079]: cluster 2020-07-16T13:46:09.596067+0000 mgr.x (mgr.34562) 365 : cluster [DBG] pgmap v225: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:46:11.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:46:10 smithi188 bash[23329]: audit 2020-07-16T13:46:08.938963+0000 mgr.x (mgr.34562) 358 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:46:11.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:46:10 smithi188 bash[23329]: audit 2020-07-16T13:46:08.940251+0000 mgr.x (mgr.34562) 359 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:46:11.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:46:10 smithi188 bash[23329]: audit 2020-07-16T13:46:08.941384+0000 mgr.x (mgr.34562) 360 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:46:11.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:46:10 smithi188 bash[23329]: cephadm 2020-07-16T13:46:08.942072+0000 mgr.x (mgr.34562) 361 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T13:46:11.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:46:10 smithi188 bash[23329]: cephadm 2020-07-16T13:46:08.943148+0000 mgr.x (mgr.34562) 362 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T13:46:11.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:46:10 smithi188 bash[23329]: cephadm 2020-07-16T13:46:08.944114+0000 mgr.x (mgr.34562) 363 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T13:46:11.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:46:10 smithi188 bash[23329]: cephadm 2020-07-16T13:46:08.944186+0000 mgr.x (mgr.34562) 364 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T13:46:11.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:46:10 smithi188 bash[23329]: cluster 2020-07-16T13:46:09.596067+0000 mgr.x (mgr.34562) 365 : cluster [DBG] pgmap v225: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:46:13.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:46:12 smithi132 bash[27079]: cluster 2020-07-16T13:46:11.596639+0000 mgr.x (mgr.34562) 366 : cluster [DBG] pgmap v226: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:46:13.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:46:12 smithi132 bash[27079]: audit 2020-07-16T13:46:11.904480+0000 mon.b (mon.2) 224 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:46:13.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:46:12 smithi132 bash[27079]: cephadm 2020-07-16T13:46:11.905090+0000 mgr.x (mgr.34562) 367 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:46:13.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:46:12 smithi132 bash[27079]: cephadm 2020-07-16T13:46:11.905162+0000 mgr.x (mgr.34562) 368 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:46:13.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:46:12 smithi188 bash[23329]: cluster 2020-07-16T13:46:11.596639+0000 mgr.x (mgr.34562) 366 : cluster [DBG] pgmap v226: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:46:13.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:46:12 smithi188 bash[23329]: audit 2020-07-16T13:46:11.904480+0000 mon.b (mon.2) 224 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:46:13.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:46:12 smithi188 bash[23329]: cephadm 2020-07-16T13:46:11.905090+0000 mgr.x (mgr.34562) 367 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:46:13.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:46:12 smithi188 bash[23329]: cephadm 2020-07-16T13:46:11.905162+0000 mgr.x (mgr.34562) 368 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:46:15.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:46:14 smithi132 bash[27079]: cluster 2020-07-16T13:46:13.597067+0000 mgr.x (mgr.34562) 369 : cluster [DBG] pgmap v227: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:46:15.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:46:14 smithi188 bash[23329]: cluster 2020-07-16T13:46:13.597067+0000 mgr.x (mgr.34562) 369 : cluster [DBG] pgmap v227: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:46:17.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:46:16 smithi132 bash[27079]: cluster 2020-07-16T13:46:15.597466+0000 mgr.x (mgr.34562) 370 : cluster [DBG] pgmap v228: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:46:17.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:46:16 smithi188 bash[23329]: cluster 2020-07-16T13:46:15.597466+0000 mgr.x (mgr.34562) 370 : cluster [DBG] pgmap v228: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:46:19.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:46:18 smithi132 bash[27079]: cluster 2020-07-16T13:46:17.597937+0000 mgr.x (mgr.34562) 371 : cluster [DBG] pgmap v229: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:46:19.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:46:18 smithi188 bash[23329]: cluster 2020-07-16T13:46:17.597937+0000 mgr.x (mgr.34562) 371 : cluster [DBG] pgmap v229: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:46:20.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:46:20 smithi132 bash[27079]: cluster 2020-07-16T13:46:19.598487+0000 mgr.x (mgr.34562) 372 : cluster [DBG] pgmap v230: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:46:20.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:46:20 smithi188 bash[23329]: cluster 2020-07-16T13:46:19.598487+0000 mgr.x (mgr.34562) 372 : cluster [DBG] pgmap v230: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:46:22.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:46:22 smithi188 bash[23329]: cluster 2020-07-16T13:46:21.598834+0000 mgr.x (mgr.34562) 373 : cluster [DBG] pgmap v231: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:46:23.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:46:22 smithi132 bash[27079]: cluster 2020-07-16T13:46:21.598834+0000 mgr.x (mgr.34562) 373 : cluster [DBG] pgmap v231: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:46:24.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:46:24 smithi188 bash[23329]: cluster 2020-07-16T13:46:23.599221+0000 mgr.x (mgr.34562) 374 : cluster [DBG] pgmap v232: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:46:25.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:46:24 smithi132 bash[27079]: cluster 2020-07-16T13:46:23.599221+0000 mgr.x (mgr.34562) 374 : cluster [DBG] pgmap v232: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:46:26.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:46:26 smithi188 bash[23329]: cluster 2020-07-16T13:46:25.599668+0000 mgr.x (mgr.34562) 375 : cluster [DBG] pgmap v233: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:46:27.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:46:26 smithi132 bash[27079]: cluster 2020-07-16T13:46:25.599668+0000 mgr.x (mgr.34562) 375 : cluster [DBG] pgmap v233: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:46:27.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:46:27 smithi188 bash[23329]: audit 2020-07-16T13:46:26.909980+0000 mon.b (mon.2) 225 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:46:27.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:46:27 smithi188 bash[23329]: cephadm 2020-07-16T13:46:26.910746+0000 mgr.x (mgr.34562) 376 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:46:27.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:46:27 smithi188 bash[23329]: cephadm 2020-07-16T13:46:26.911225+0000 mgr.x (mgr.34562) 377 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:46:28.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:46:27 smithi132 bash[27079]: audit 2020-07-16T13:46:26.909980+0000 mon.b (mon.2) 225 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:46:28.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:46:27 smithi132 bash[27079]: cephadm 2020-07-16T13:46:26.910746+0000 mgr.x (mgr.34562) 376 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:46:28.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:46:27 smithi132 bash[27079]: cephadm 2020-07-16T13:46:26.911225+0000 mgr.x (mgr.34562) 377 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:46:28.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:46:28 smithi188 bash[23329]: cluster 2020-07-16T13:46:27.600128+0000 mgr.x (mgr.34562) 378 : cluster [DBG] pgmap v234: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:46:29.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:46:28 smithi132 bash[27079]: cluster 2020-07-16T13:46:27.600128+0000 mgr.x (mgr.34562) 378 : cluster [DBG] pgmap v234: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:46:29.492 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T13:46:29.766 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T13:46:29.767 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (9m) 7m ago 12m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T13:46:29.767 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (11m) 7m ago 11m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T13:46:29.767 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (9m) 7m ago 15m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T13:46:29.767 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (8m) 7m ago 16m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T13:46:29.768 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 7m ago 16m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T13:46:29.768 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (15m) 7m ago 15m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T13:46:29.768 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (15m) 7m ago 15m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T13:46:29.768 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (12m) 7m ago 12m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T13:46:29.768 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (12m) 7m ago 12m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T13:46:29.768 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (14m) 7m ago 14m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T13:46:29.769 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (14m) 7m ago 14m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T13:46:29.769 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (14m) 7m ago 14m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T13:46:29.769 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (14m) 7m ago 14m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T13:46:29.769 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (13m) 7m ago 13m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T13:46:29.769 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (13m) 7m ago 13m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T13:46:29.770 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (13m) 7m ago 13m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T13:46:29.770 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (12m) 7m ago 12m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T13:46:29.770 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (11m) 7m ago 12m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T13:46:30.070 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T13:46:30.071 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T13:46:30.071 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T13:46:30.071 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T13:46:30.071 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:46:30.072 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T13:46:30.072 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T13:46:30.072 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:46:30.072 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T13:46:30.072 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T13:46:30.073 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:46:30.073 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T13:46:30.073 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T13:46:30.073 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T13:46:30.073 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T13:46:30.074 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T13:46:30.074 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T13:46:30.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:46:30 smithi188 bash[23329]: audit 2020-07-16T13:46:29.480894+0000 mgr.x (mgr.34562) 379 : audit [DBG] from='client.24910 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:46:30.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:46:30 smithi188 bash[23329]: cluster 2020-07-16T13:46:29.600582+0000 mgr.x (mgr.34562) 380 : cluster [DBG] pgmap v235: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:46:30.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:46:30 smithi188 bash[23329]: audit 2020-07-16T13:46:29.762350+0000 mgr.x (mgr.34562) 381 : audit [DBG] from='client.24916 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:46:30.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:46:30 smithi132 bash[27079]: audit 2020-07-16T13:46:29.480894+0000 mgr.x (mgr.34562) 379 : audit [DBG] from='client.24910 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:46:30.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:46:30 smithi132 bash[27079]: cluster 2020-07-16T13:46:29.600582+0000 mgr.x (mgr.34562) 380 : cluster [DBG] pgmap v235: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:46:30.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:46:30 smithi132 bash[27079]: audit 2020-07-16T13:46:29.762350+0000 mgr.x (mgr.34562) 381 : audit [DBG] from='client.24916 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:46:31.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:46:31 smithi188 bash[23329]: audit 2020-07-16T13:46:30.070056+0000 mon.c (mon.1) 81 : audit [DBG] from='client.? 172.21.15.132:0/1241799384' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:46:31.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:46:31 smithi132 bash[27079]: audit 2020-07-16T13:46:30.070056+0000 mon.c (mon.1) 81 : audit [DBG] from='client.? 172.21.15.132:0/1241799384' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:46:32.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:46:32 smithi188 bash[23329]: cluster 2020-07-16T13:46:31.600978+0000 mgr.x (mgr.34562) 382 : cluster [DBG] pgmap v236: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:46:32.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:46:32 smithi132 bash[27079]: cluster 2020-07-16T13:46:31.600978+0000 mgr.x (mgr.34562) 382 : cluster [DBG] pgmap v236: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:46:34.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:46:34 smithi188 bash[23329]: cluster 2020-07-16T13:46:33.601445+0000 mgr.x (mgr.34562) 383 : cluster [DBG] pgmap v237: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:46:35.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:46:34 smithi132 bash[27079]: cluster 2020-07-16T13:46:33.601445+0000 mgr.x (mgr.34562) 383 : cluster [DBG] pgmap v237: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:46:36.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:46:36 smithi188 bash[23329]: cluster 2020-07-16T13:46:35.601809+0000 mgr.x (mgr.34562) 384 : cluster [DBG] pgmap v238: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:46:37.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:46:36 smithi132 bash[27079]: cluster 2020-07-16T13:46:35.601809+0000 mgr.x (mgr.34562) 384 : cluster [DBG] pgmap v238: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:46:38.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:46:38 smithi188 bash[23329]: cluster 2020-07-16T13:46:37.602254+0000 mgr.x (mgr.34562) 385 : cluster [DBG] pgmap v239: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:46:39.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:46:38 smithi132 bash[27079]: cluster 2020-07-16T13:46:37.602254+0000 mgr.x (mgr.34562) 385 : cluster [DBG] pgmap v239: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:46:40.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:46:40 smithi188 bash[23329]: cluster 2020-07-16T13:46:39.602674+0000 mgr.x (mgr.34562) 386 : cluster [DBG] pgmap v240: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:46:40.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:46:40 smithi132 bash[27079]: cluster 2020-07-16T13:46:39.602674+0000 mgr.x (mgr.34562) 386 : cluster [DBG] pgmap v240: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:46:42.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:46:42 smithi188 bash[23329]: cluster 2020-07-16T13:46:41.603113+0000 mgr.x (mgr.34562) 387 : cluster [DBG] pgmap v241: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:46:42.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:46:42 smithi188 bash[23329]: audit 2020-07-16T13:46:41.926709+0000 mon.b (mon.2) 226 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:46:42.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:46:42 smithi188 bash[23329]: cephadm 2020-07-16T13:46:41.927417+0000 mgr.x (mgr.34562) 388 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:46:42.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:46:42 smithi188 bash[23329]: cephadm 2020-07-16T13:46:41.927839+0000 mgr.x (mgr.34562) 389 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:46:43.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:46:42 smithi132 bash[27079]: cluster 2020-07-16T13:46:41.603113+0000 mgr.x (mgr.34562) 387 : cluster [DBG] pgmap v241: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:46:43.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:46:42 smithi132 bash[27079]: audit 2020-07-16T13:46:41.926709+0000 mon.b (mon.2) 226 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:46:43.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:46:42 smithi132 bash[27079]: cephadm 2020-07-16T13:46:41.927417+0000 mgr.x (mgr.34562) 388 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:46:43.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:46:42 smithi132 bash[27079]: cephadm 2020-07-16T13:46:41.927839+0000 mgr.x (mgr.34562) 389 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:46:44.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:46:44 smithi188 bash[23329]: cluster 2020-07-16T13:46:43.603475+0000 mgr.x (mgr.34562) 390 : cluster [DBG] pgmap v242: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:46:45.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:46:44 smithi132 bash[27079]: cluster 2020-07-16T13:46:43.603475+0000 mgr.x (mgr.34562) 390 : cluster [DBG] pgmap v242: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:46:46.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:46:46 smithi188 bash[23329]: cluster 2020-07-16T13:46:45.603799+0000 mgr.x (mgr.34562) 391 : cluster [DBG] pgmap v243: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:46:47.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:46:46 smithi132 bash[27079]: cluster 2020-07-16T13:46:45.603799+0000 mgr.x (mgr.34562) 391 : cluster [DBG] pgmap v243: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:46:48.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:46:48 smithi188 bash[23329]: cluster 2020-07-16T13:46:47.604234+0000 mgr.x (mgr.34562) 392 : cluster [DBG] pgmap v244: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:46:49.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:46:48 smithi132 bash[27079]: cluster 2020-07-16T13:46:47.604234+0000 mgr.x (mgr.34562) 392 : cluster [DBG] pgmap v244: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:46:50.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:46:50 smithi188 bash[23329]: cluster 2020-07-16T13:46:49.604680+0000 mgr.x (mgr.34562) 393 : cluster [DBG] pgmap v245: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:46:50.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:46:50 smithi132 bash[27079]: cluster 2020-07-16T13:46:49.604680+0000 mgr.x (mgr.34562) 393 : cluster [DBG] pgmap v245: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:46:52.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:46:52 smithi188 bash[23329]: cluster 2020-07-16T13:46:51.605060+0000 mgr.x (mgr.34562) 394 : cluster [DBG] pgmap v246: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:46:53.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:46:52 smithi132 bash[27079]: cluster 2020-07-16T13:46:51.605060+0000 mgr.x (mgr.34562) 394 : cluster [DBG] pgmap v246: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:46:54.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:46:54 smithi188 bash[23329]: cluster 2020-07-16T13:46:53.605454+0000 mgr.x (mgr.34562) 395 : cluster [DBG] pgmap v247: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:46:55.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:46:54 smithi132 bash[27079]: cluster 2020-07-16T13:46:53.605454+0000 mgr.x (mgr.34562) 395 : cluster [DBG] pgmap v247: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:46:56.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:46:56 smithi188 bash[23329]: cluster 2020-07-16T13:46:55.605842+0000 mgr.x (mgr.34562) 396 : cluster [DBG] pgmap v248: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:46:57.033 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:46:56 smithi132 bash[27079]: cluster 2020-07-16T13:46:55.605842+0000 mgr.x (mgr.34562) 396 : cluster [DBG] pgmap v248: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:46:58.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:46:57 smithi132 bash[27079]: audit 2020-07-16T13:46:56.943369+0000 mon.b (mon.2) 227 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:46:58.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:46:57 smithi188 bash[23329]: audit 2020-07-16T13:46:56.943369+0000 mon.b (mon.2) 227 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:46:59.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:46:58 smithi132 bash[27079]: cephadm 2020-07-16T13:46:56.944066+0000 mgr.x (mgr.34562) 397 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:46:59.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:46:58 smithi132 bash[27079]: cephadm 2020-07-16T13:46:56.944480+0000 mgr.x (mgr.34562) 398 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:46:59.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:46:58 smithi132 bash[27079]: cluster 2020-07-16T13:46:57.606310+0000 mgr.x (mgr.34562) 399 : cluster [DBG] pgmap v249: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:46:59.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:46:58 smithi188 bash[23329]: cephadm 2020-07-16T13:46:56.944066+0000 mgr.x (mgr.34562) 397 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:46:59.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:46:58 smithi188 bash[23329]: cephadm 2020-07-16T13:46:56.944480+0000 mgr.x (mgr.34562) 398 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:46:59.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:46:58 smithi188 bash[23329]: cluster 2020-07-16T13:46:57.606310+0000 mgr.x (mgr.34562) 399 : cluster [DBG] pgmap v249: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:47:00.367 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T13:47:00.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:47:00 smithi188 bash[23329]: cluster 2020-07-16T13:46:59.606677+0000 mgr.x (mgr.34562) 400 : cluster [DBG] pgmap v250: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:47:00.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:47:00 smithi132 bash[27079]: cluster 2020-07-16T13:46:59.606677+0000 mgr.x (mgr.34562) 400 : cluster [DBG] pgmap v250: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:47:00.637 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T13:47:00.638 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (9m) 8m ago 12m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T13:47:00.638 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (12m) 8m ago 12m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T13:47:00.638 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (10m) 8m ago 15m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T13:47:00.638 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (9m) 8m ago 17m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T13:47:00.638 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 8m ago 17m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T13:47:00.639 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (15m) 8m ago 15m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T13:47:00.639 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (16m) 8m ago 16m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T13:47:00.639 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (12m) 8m ago 13m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T13:47:00.639 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (12m) 8m ago 13m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T13:47:00.639 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (15m) 8m ago 15m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T13:47:00.639 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (15m) 8m ago 15m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T13:47:00.640 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (14m) 8m ago 14m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T13:47:00.640 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (14m) 8m ago 14m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T13:47:00.640 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (13m) 8m ago 14m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T13:47:00.640 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (13m) 8m ago 13m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T13:47:00.641 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (13m) 8m ago 13m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T13:47:00.641 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (13m) 8m ago 13m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T13:47:00.641 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (12m) 8m ago 13m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T13:47:00.927 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T13:47:00.928 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T13:47:00.928 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T13:47:00.928 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T13:47:00.928 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:47:00.929 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T13:47:00.929 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T13:47:00.929 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:47:00.929 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T13:47:00.929 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T13:47:00.930 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:47:00.930 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T13:47:00.930 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T13:47:00.930 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T13:47:00.931 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T13:47:00.931 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T13:47:00.931 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T13:47:01.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:47:01 smithi188 bash[23329]: audit 2020-07-16T13:47:00.355985+0000 mgr.x (mgr.34562) 401 : audit [DBG] from='client.24928 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:47:01.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:47:01 smithi188 bash[23329]: audit 2020-07-16T13:47:00.625931+0000 mgr.x (mgr.34562) 402 : audit [DBG] from='client.24934 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:47:01.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:47:01 smithi188 bash[23329]: audit 2020-07-16T13:47:00.926793+0000 mon.c (mon.1) 82 : audit [DBG] from='client.? 172.21.15.132:0/1355110213' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:47:01.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:47:01 smithi132 bash[27079]: audit 2020-07-16T13:47:00.355985+0000 mgr.x (mgr.34562) 401 : audit [DBG] from='client.24928 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:47:01.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:47:01 smithi132 bash[27079]: audit 2020-07-16T13:47:00.625931+0000 mgr.x (mgr.34562) 402 : audit [DBG] from='client.24934 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:47:01.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:47:01 smithi132 bash[27079]: audit 2020-07-16T13:47:00.926793+0000 mon.c (mon.1) 82 : audit [DBG] from='client.? 172.21.15.132:0/1355110213' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:47:02.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:47:02 smithi188 bash[23329]: cluster 2020-07-16T13:47:01.607120+0000 mgr.x (mgr.34562) 403 : cluster [DBG] pgmap v251: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:47:02.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:47:02 smithi132 bash[27079]: cluster 2020-07-16T13:47:01.607120+0000 mgr.x (mgr.34562) 403 : cluster [DBG] pgmap v251: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:47:04.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:47:04 smithi188 bash[23329]: cluster 2020-07-16T13:47:03.607509+0000 mgr.x (mgr.34562) 404 : cluster [DBG] pgmap v252: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:47:05.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:47:04 smithi132 bash[27079]: cluster 2020-07-16T13:47:03.607509+0000 mgr.x (mgr.34562) 404 : cluster [DBG] pgmap v252: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:47:06.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:47:06 smithi188 bash[23329]: cluster 2020-07-16T13:47:05.607938+0000 mgr.x (mgr.34562) 405 : cluster [DBG] pgmap v253: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:47:07.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:47:06 smithi132 bash[27079]: cluster 2020-07-16T13:47:05.607938+0000 mgr.x (mgr.34562) 405 : cluster [DBG] pgmap v253: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:47:08.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:47:08 smithi188 bash[23329]: cluster 2020-07-16T13:47:07.608476+0000 mgr.x (mgr.34562) 406 : cluster [DBG] pgmap v254: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:47:09.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:47:08 smithi132 bash[27079]: cluster 2020-07-16T13:47:07.608476+0000 mgr.x (mgr.34562) 406 : cluster [DBG] pgmap v254: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:47:10.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:47:10 smithi188 bash[23329]: cluster 2020-07-16T13:47:09.608919+0000 mgr.x (mgr.34562) 407 : cluster [DBG] pgmap v255: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:47:10.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:47:10 smithi132 bash[27079]: cluster 2020-07-16T13:47:09.608919+0000 mgr.x (mgr.34562) 407 : cluster [DBG] pgmap v255: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:47:12.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:47:12 smithi188 bash[23329]: cluster 2020-07-16T13:47:11.609345+0000 mgr.x (mgr.34562) 408 : cluster [DBG] pgmap v256: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:47:12.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:47:12 smithi188 bash[23329]: audit 2020-07-16T13:47:11.960827+0000 mon.b (mon.2) 228 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:47:12.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:47:12 smithi188 bash[23329]: audit 2020-07-16T13:47:11.962204+0000 mon.b (mon.2) 229 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:47:12.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:47:12 smithi188 bash[23329]: audit 2020-07-16T13:47:11.963421+0000 mon.b (mon.2) 230 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:47:12.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:47:12 smithi188 bash[23329]: audit 2020-07-16T13:47:11.964812+0000 mon.b (mon.2) 231 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T13:47:12.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:47:12 smithi188 bash[23329]: audit 2020-07-16T13:47:11.965989+0000 mon.b (mon.2) 232 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:47:13.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:47:12 smithi132 bash[27079]: cluster 2020-07-16T13:47:11.609345+0000 mgr.x (mgr.34562) 408 : cluster [DBG] pgmap v256: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:47:13.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:47:12 smithi132 bash[27079]: audit 2020-07-16T13:47:11.960827+0000 mon.b (mon.2) 228 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:47:13.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:47:12 smithi132 bash[27079]: audit 2020-07-16T13:47:11.962204+0000 mon.b (mon.2) 229 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:47:13.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:47:12 smithi132 bash[27079]: audit 2020-07-16T13:47:11.963421+0000 mon.b (mon.2) 230 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:47:13.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:47:12 smithi132 bash[27079]: audit 2020-07-16T13:47:11.964812+0000 mon.b (mon.2) 231 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T13:47:13.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:47:12 smithi132 bash[27079]: audit 2020-07-16T13:47:11.965989+0000 mon.b (mon.2) 232 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:47:13.922 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:47:13 smithi132 bash[27079]: audit 2020-07-16T13:47:11.961170+0000 mgr.x (mgr.34562) 409 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:47:13.923 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:47:13 smithi132 bash[27079]: audit 2020-07-16T13:47:11.962492+0000 mgr.x (mgr.34562) 410 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:47:13.923 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:47:13 smithi132 bash[27079]: audit 2020-07-16T13:47:11.963725+0000 mgr.x (mgr.34562) 411 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:47:13.923 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:47:13 smithi132 bash[27079]: cephadm 2020-07-16T13:47:11.964439+0000 mgr.x (mgr.34562) 412 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T13:47:13.924 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:47:13 smithi132 bash[27079]: cephadm 2020-07-16T13:47:11.965669+0000 mgr.x (mgr.34562) 413 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T13:47:13.924 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:47:13 smithi132 bash[27079]: cephadm 2020-07-16T13:47:11.966717+0000 mgr.x (mgr.34562) 414 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T13:47:13.924 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:47:13 smithi132 bash[27079]: cephadm 2020-07-16T13:47:11.966999+0000 mgr.x (mgr.34562) 415 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T13:47:14.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:47:13 smithi188 bash[23329]: audit 2020-07-16T13:47:11.961170+0000 mgr.x (mgr.34562) 409 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:47:14.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:47:13 smithi188 bash[23329]: audit 2020-07-16T13:47:11.962492+0000 mgr.x (mgr.34562) 410 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:47:14.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:47:13 smithi188 bash[23329]: audit 2020-07-16T13:47:11.963725+0000 mgr.x (mgr.34562) 411 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:47:14.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:47:13 smithi188 bash[23329]: cephadm 2020-07-16T13:47:11.964439+0000 mgr.x (mgr.34562) 412 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T13:47:14.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:47:13 smithi188 bash[23329]: cephadm 2020-07-16T13:47:11.965669+0000 mgr.x (mgr.34562) 413 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T13:47:14.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:47:13 smithi188 bash[23329]: cephadm 2020-07-16T13:47:11.966717+0000 mgr.x (mgr.34562) 414 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T13:47:14.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:47:13 smithi188 bash[23329]: cephadm 2020-07-16T13:47:11.966999+0000 mgr.x (mgr.34562) 415 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T13:47:15.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:47:14 smithi132 bash[27079]: cluster 2020-07-16T13:47:13.609771+0000 mgr.x (mgr.34562) 416 : cluster [DBG] pgmap v257: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:47:15.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:47:14 smithi188 bash[23329]: cluster 2020-07-16T13:47:13.609771+0000 mgr.x (mgr.34562) 416 : cluster [DBG] pgmap v257: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:47:16.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:47:15 smithi132 bash[27079]: audit 2020-07-16T13:47:14.857769+0000 mon.b (mon.2) 233 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:47:16.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:47:15 smithi132 bash[27079]: cephadm 2020-07-16T13:47:14.858411+0000 mgr.x (mgr.34562) 417 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:47:16.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:47:15 smithi132 bash[27079]: cephadm 2020-07-16T13:47:14.858489+0000 mgr.x (mgr.34562) 418 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:47:16.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:47:15 smithi188 bash[23329]: audit 2020-07-16T13:47:14.857769+0000 mon.b (mon.2) 233 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:47:16.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:47:15 smithi188 bash[23329]: cephadm 2020-07-16T13:47:14.858411+0000 mgr.x (mgr.34562) 417 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:47:16.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:47:15 smithi188 bash[23329]: cephadm 2020-07-16T13:47:14.858489+0000 mgr.x (mgr.34562) 418 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:47:17.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:47:16 smithi132 bash[27079]: cluster 2020-07-16T13:47:15.610158+0000 mgr.x (mgr.34562) 419 : cluster [DBG] pgmap v258: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:47:17.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:47:16 smithi188 bash[23329]: cluster 2020-07-16T13:47:15.610158+0000 mgr.x (mgr.34562) 419 : cluster [DBG] pgmap v258: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:47:19.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:47:18 smithi132 bash[27079]: cluster 2020-07-16T13:47:17.610718+0000 mgr.x (mgr.34562) 420 : cluster [DBG] pgmap v259: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:47:19.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:47:18 smithi188 bash[23329]: cluster 2020-07-16T13:47:17.610718+0000 mgr.x (mgr.34562) 420 : cluster [DBG] pgmap v259: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:47:20.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:47:20 smithi188 bash[23329]: cluster 2020-07-16T13:47:19.611261+0000 mgr.x (mgr.34562) 421 : cluster [DBG] pgmap v260: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:47:20.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:47:20 smithi132 bash[27079]: cluster 2020-07-16T13:47:19.611261+0000 mgr.x (mgr.34562) 421 : cluster [DBG] pgmap v260: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:47:22.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:47:22 smithi188 bash[23329]: cluster 2020-07-16T13:47:21.611642+0000 mgr.x (mgr.34562) 422 : cluster [DBG] pgmap v261: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:47:23.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:47:22 smithi132 bash[27079]: cluster 2020-07-16T13:47:21.611642+0000 mgr.x (mgr.34562) 422 : cluster [DBG] pgmap v261: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:47:25.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:47:24 smithi132 bash[27079]: cluster 2020-07-16T13:47:23.612141+0000 mgr.x (mgr.34562) 423 : cluster [DBG] pgmap v262: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:47:25.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:47:24 smithi188 bash[23329]: cluster 2020-07-16T13:47:23.612141+0000 mgr.x (mgr.34562) 423 : cluster [DBG] pgmap v262: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:47:27.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:47:26 smithi132 bash[27079]: cluster 2020-07-16T13:47:25.612531+0000 mgr.x (mgr.34562) 424 : cluster [DBG] pgmap v263: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:47:27.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:47:26 smithi188 bash[23329]: cluster 2020-07-16T13:47:25.612531+0000 mgr.x (mgr.34562) 424 : cluster [DBG] pgmap v263: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:47:28.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:47:28 smithi188 bash[23329]: cluster 2020-07-16T13:47:27.613089+0000 mgr.x (mgr.34562) 425 : cluster [DBG] pgmap v264: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:47:29.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:47:28 smithi132 bash[27079]: cluster 2020-07-16T13:47:27.613089+0000 mgr.x (mgr.34562) 425 : cluster [DBG] pgmap v264: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:47:30.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:47:30 smithi188 bash[23329]: cluster 2020-07-16T13:47:29.613488+0000 mgr.x (mgr.34562) 426 : cluster [DBG] pgmap v265: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:47:30.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:47:30 smithi188 bash[23329]: audit 2020-07-16T13:47:29.869497+0000 mon.b (mon.2) 234 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:47:30.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:47:30 smithi188 bash[23329]: cephadm 2020-07-16T13:47:29.870022+0000 mgr.x (mgr.34562) 427 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:47:30.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:47:30 smithi188 bash[23329]: cephadm 2020-07-16T13:47:29.870279+0000 mgr.x (mgr.34562) 428 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:47:30.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:47:30 smithi132 bash[27079]: cluster 2020-07-16T13:47:29.613488+0000 mgr.x (mgr.34562) 426 : cluster [DBG] pgmap v265: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:47:30.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:47:30 smithi132 bash[27079]: audit 2020-07-16T13:47:29.869497+0000 mon.b (mon.2) 234 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:47:30.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:47:30 smithi132 bash[27079]: cephadm 2020-07-16T13:47:29.870022+0000 mgr.x (mgr.34562) 427 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:47:30.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:47:30 smithi132 bash[27079]: cephadm 2020-07-16T13:47:29.870279+0000 mgr.x (mgr.34562) 428 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:47:31.227 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T13:47:31.489 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T13:47:31.489 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (10m) 8m ago 13m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T13:47:31.489 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (12m) 8m ago 12m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T13:47:31.489 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (10m) 8m ago 16m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T13:47:31.490 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (10m) 8m ago 17m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T13:47:31.490 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 8m ago 17m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T13:47:31.490 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (16m) 8m ago 16m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T13:47:31.490 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (16m) 8m ago 16m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T13:47:31.490 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (13m) 8m ago 13m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T13:47:31.491 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (13m) 8m ago 13m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T13:47:31.491 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (15m) 8m ago 15m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T13:47:31.491 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (15m) 8m ago 15m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T13:47:31.491 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (15m) 8m ago 15m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T13:47:31.491 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (15m) 8m ago 15m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T13:47:31.492 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (14m) 8m ago 14m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T13:47:31.492 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (14m) 8m ago 14m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T13:47:31.492 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (14m) 8m ago 14m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T13:47:31.492 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (13m) 8m ago 13m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T13:47:31.492 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (12m) 8m ago 13m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T13:47:31.791 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T13:47:31.792 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T13:47:31.792 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T13:47:31.792 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T13:47:31.792 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:47:31.792 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T13:47:31.793 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T13:47:31.793 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:47:31.793 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T13:47:31.793 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T13:47:31.793 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:47:31.794 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T13:47:31.794 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T13:47:31.798 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T13:47:31.798 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T13:47:31.799 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T13:47:31.799 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T13:47:32.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:47:32 smithi188 bash[23329]: audit 2020-07-16T13:47:31.215484+0000 mgr.x (mgr.34562) 429 : audit [DBG] from='client.24946 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:47:32.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:47:32 smithi188 bash[23329]: audit 2020-07-16T13:47:31.484415+0000 mgr.x (mgr.34562) 430 : audit [DBG] from='client.24952 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:47:32.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:47:32 smithi188 bash[23329]: cluster 2020-07-16T13:47:31.613801+0000 mgr.x (mgr.34562) 431 : cluster [DBG] pgmap v266: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:47:32.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:47:32 smithi188 bash[23329]: audit 2020-07-16T13:47:31.790770+0000 mon.c (mon.1) 83 : audit [DBG] from='client.? 172.21.15.132:0/928745045' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:47:33.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:47:32 smithi132 bash[27079]: audit 2020-07-16T13:47:31.215484+0000 mgr.x (mgr.34562) 429 : audit [DBG] from='client.24946 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:47:33.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:47:32 smithi132 bash[27079]: audit 2020-07-16T13:47:31.484415+0000 mgr.x (mgr.34562) 430 : audit [DBG] from='client.24952 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:47:33.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:47:32 smithi132 bash[27079]: cluster 2020-07-16T13:47:31.613801+0000 mgr.x (mgr.34562) 431 : cluster [DBG] pgmap v266: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:47:33.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:47:32 smithi132 bash[27079]: audit 2020-07-16T13:47:31.790770+0000 mon.c (mon.1) 83 : audit [DBG] from='client.? 172.21.15.132:0/928745045' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:47:35.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:47:34 smithi132 bash[27079]: cluster 2020-07-16T13:47:33.614183+0000 mgr.x (mgr.34562) 432 : cluster [DBG] pgmap v267: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:47:35.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:47:34 smithi188 bash[23329]: cluster 2020-07-16T13:47:33.614183+0000 mgr.x (mgr.34562) 432 : cluster [DBG] pgmap v267: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:47:37.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:47:36 smithi132 bash[27079]: cluster 2020-07-16T13:47:35.614547+0000 mgr.x (mgr.34562) 433 : cluster [DBG] pgmap v268: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:47:37.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:47:36 smithi188 bash[23329]: cluster 2020-07-16T13:47:35.614547+0000 mgr.x (mgr.34562) 433 : cluster [DBG] pgmap v268: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:47:39.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:47:38 smithi132 bash[27079]: cluster 2020-07-16T13:47:37.614928+0000 mgr.x (mgr.34562) 434 : cluster [DBG] pgmap v269: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:47:39.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:47:38 smithi188 bash[23329]: cluster 2020-07-16T13:47:37.614928+0000 mgr.x (mgr.34562) 434 : cluster [DBG] pgmap v269: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:47:40.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:47:40 smithi188 bash[23329]: cluster 2020-07-16T13:47:39.615448+0000 mgr.x (mgr.34562) 435 : cluster [DBG] pgmap v270: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:47:40.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:47:40 smithi132 bash[27079]: cluster 2020-07-16T13:47:39.615448+0000 mgr.x (mgr.34562) 435 : cluster [DBG] pgmap v270: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:47:43.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:47:42 smithi132 bash[27079]: cluster 2020-07-16T13:47:41.615945+0000 mgr.x (mgr.34562) 436 : cluster [DBG] pgmap v271: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:47:43.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:47:42 smithi188 bash[23329]: cluster 2020-07-16T13:47:41.615945+0000 mgr.x (mgr.34562) 436 : cluster [DBG] pgmap v271: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:47:45.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:47:44 smithi132 bash[27079]: cluster 2020-07-16T13:47:43.616336+0000 mgr.x (mgr.34562) 437 : cluster [DBG] pgmap v272: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:47:45.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:47:44 smithi188 bash[23329]: cluster 2020-07-16T13:47:43.616336+0000 mgr.x (mgr.34562) 437 : cluster [DBG] pgmap v272: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:47:46.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:47:45 smithi132 bash[27079]: audit 2020-07-16T13:47:44.885710+0000 mon.b (mon.2) 235 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:47:46.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:47:45 smithi132 bash[27079]: cephadm 2020-07-16T13:47:44.886411+0000 mgr.x (mgr.34562) 438 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:47:46.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:47:45 smithi132 bash[27079]: cephadm 2020-07-16T13:47:44.886816+0000 mgr.x (mgr.34562) 439 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:47:46.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:47:45 smithi188 bash[23329]: audit 2020-07-16T13:47:44.885710+0000 mon.b (mon.2) 235 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:47:46.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:47:45 smithi188 bash[23329]: cephadm 2020-07-16T13:47:44.886411+0000 mgr.x (mgr.34562) 438 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:47:46.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:47:45 smithi188 bash[23329]: cephadm 2020-07-16T13:47:44.886816+0000 mgr.x (mgr.34562) 439 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:47:47.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:47:46 smithi132 bash[27079]: cluster 2020-07-16T13:47:45.616821+0000 mgr.x (mgr.34562) 440 : cluster [DBG] pgmap v273: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:47:47.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:47:46 smithi188 bash[23329]: cluster 2020-07-16T13:47:45.616821+0000 mgr.x (mgr.34562) 440 : cluster [DBG] pgmap v273: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:47:49.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:47:48 smithi132 bash[27079]: cluster 2020-07-16T13:47:47.617243+0000 mgr.x (mgr.34562) 441 : cluster [DBG] pgmap v274: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:47:49.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:47:48 smithi188 bash[23329]: cluster 2020-07-16T13:47:47.617243+0000 mgr.x (mgr.34562) 441 : cluster [DBG] pgmap v274: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:47:50.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:47:50 smithi188 bash[23329]: cluster 2020-07-16T13:47:49.617750+0000 mgr.x (mgr.34562) 442 : cluster [DBG] pgmap v275: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:47:50.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:47:50 smithi132 bash[27079]: cluster 2020-07-16T13:47:49.617750+0000 mgr.x (mgr.34562) 442 : cluster [DBG] pgmap v275: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:47:53.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:47:52 smithi132 bash[27079]: cluster 2020-07-16T13:47:51.618121+0000 mgr.x (mgr.34562) 443 : cluster [DBG] pgmap v276: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:47:53.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:47:52 smithi188 bash[23329]: cluster 2020-07-16T13:47:51.618121+0000 mgr.x (mgr.34562) 443 : cluster [DBG] pgmap v276: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:47:55.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:47:54 smithi132 bash[27079]: cluster 2020-07-16T13:47:53.618623+0000 mgr.x (mgr.34562) 444 : cluster [DBG] pgmap v277: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:47:55.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:47:54 smithi188 bash[23329]: cluster 2020-07-16T13:47:53.618623+0000 mgr.x (mgr.34562) 444 : cluster [DBG] pgmap v277: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:47:57.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:47:56 smithi132 bash[27079]: cluster 2020-07-16T13:47:55.619002+0000 mgr.x (mgr.34562) 445 : cluster [DBG] pgmap v278: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:47:57.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:47:56 smithi188 bash[23329]: cluster 2020-07-16T13:47:55.619002+0000 mgr.x (mgr.34562) 445 : cluster [DBG] pgmap v278: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:47:59.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:47:58 smithi132 bash[27079]: cluster 2020-07-16T13:47:57.619525+0000 mgr.x (mgr.34562) 446 : cluster [DBG] pgmap v279: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:47:59.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:47:58 smithi188 bash[23329]: cluster 2020-07-16T13:47:57.619525+0000 mgr.x (mgr.34562) 446 : cluster [DBG] pgmap v279: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:48:00.428 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:48:00 smithi188 bash[23329]: cluster 2020-07-16T13:47:59.619901+0000 mgr.x (mgr.34562) 447 : cluster [DBG] pgmap v280: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:48:00.428 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:48:00 smithi188 bash[23329]: audit 2020-07-16T13:47:59.897555+0000 mon.b (mon.2) 236 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:48:00.428 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:48:00 smithi188 bash[23329]: cephadm 2020-07-16T13:47:59.898307+0000 mgr.x (mgr.34562) 448 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:48:00.429 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:48:00 smithi188 bash[23329]: cephadm 2020-07-16T13:47:59.898753+0000 mgr.x (mgr.34562) 449 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:48:00.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:48:00 smithi132 bash[27079]: cluster 2020-07-16T13:47:59.619901+0000 mgr.x (mgr.34562) 447 : cluster [DBG] pgmap v280: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:48:00.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:48:00 smithi132 bash[27079]: audit 2020-07-16T13:47:59.897555+0000 mon.b (mon.2) 236 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:48:00.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:48:00 smithi132 bash[27079]: cephadm 2020-07-16T13:47:59.898307+0000 mgr.x (mgr.34562) 448 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:48:00.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:48:00 smithi132 bash[27079]: cephadm 2020-07-16T13:47:59.898753+0000 mgr.x (mgr.34562) 449 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:48:02.088 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T13:48:02.350 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T13:48:02.350 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (10m) 9m ago 13m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T13:48:02.351 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (13m) 9m ago 13m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T13:48:02.351 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (11m) 9m ago 16m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T13:48:02.351 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (10m) 9m ago 18m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T13:48:02.352 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 9m ago 18m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T13:48:02.352 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (16m) 9m ago 16m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T13:48:02.352 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (17m) 9m ago 17m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T13:48:02.353 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (14m) 9m ago 14m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T13:48:02.353 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (14m) 9m ago 14m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T13:48:02.353 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (16m) 9m ago 16m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T13:48:02.354 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (16m) 9m ago 16m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T13:48:02.354 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (15m) 9m ago 15m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T13:48:02.355 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (15m) 9m ago 15m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T13:48:02.355 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (15m) 9m ago 15m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T13:48:02.355 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (14m) 9m ago 15m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T13:48:02.355 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (14m) 9m ago 14m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T13:48:02.356 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (14m) 9m ago 14m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T13:48:02.356 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (13m) 9m ago 14m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T13:48:02.649 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T13:48:02.649 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T13:48:02.650 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T13:48:02.650 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T13:48:02.650 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:48:02.651 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T13:48:02.651 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T13:48:02.651 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:48:02.651 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T13:48:02.651 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T13:48:02.652 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:48:02.652 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T13:48:02.652 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T13:48:02.652 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T13:48:02.652 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T13:48:02.653 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T13:48:02.653 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T13:48:03.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:48:02 smithi132 bash[27079]: cluster 2020-07-16T13:48:01.620521+0000 mgr.x (mgr.34562) 450 : cluster [DBG] pgmap v281: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:48:03.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:48:02 smithi132 bash[27079]: audit 2020-07-16T13:48:02.648628+0000 mon.c (mon.1) 84 : audit [DBG] from='client.? 172.21.15.132:0/2611497820' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:48:03.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:48:02 smithi188 bash[23329]: cluster 2020-07-16T13:48:01.620521+0000 mgr.x (mgr.34562) 450 : cluster [DBG] pgmap v281: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:48:03.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:48:02 smithi188 bash[23329]: audit 2020-07-16T13:48:02.648628+0000 mon.c (mon.1) 84 : audit [DBG] from='client.? 172.21.15.132:0/2611497820' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:48:04.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:48:03 smithi132 bash[27079]: audit 2020-07-16T13:48:02.077267+0000 mgr.x (mgr.34562) 451 : audit [DBG] from='client.24964 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:48:04.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:48:03 smithi132 bash[27079]: audit 2020-07-16T13:48:02.345795+0000 mgr.x (mgr.34562) 452 : audit [DBG] from='client.24970 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:48:04.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:48:03 smithi188 bash[23329]: audit 2020-07-16T13:48:02.077267+0000 mgr.x (mgr.34562) 451 : audit [DBG] from='client.24964 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:48:04.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:48:03 smithi188 bash[23329]: audit 2020-07-16T13:48:02.345795+0000 mgr.x (mgr.34562) 452 : audit [DBG] from='client.24970 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:48:05.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:48:04 smithi132 bash[27079]: cluster 2020-07-16T13:48:03.620910+0000 mgr.x (mgr.34562) 453 : cluster [DBG] pgmap v282: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:48:05.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:48:04 smithi188 bash[23329]: cluster 2020-07-16T13:48:03.620910+0000 mgr.x (mgr.34562) 453 : cluster [DBG] pgmap v282: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:48:07.042 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:48:06 smithi132 bash[27079]: cluster 2020-07-16T13:48:05.621374+0000 mgr.x (mgr.34562) 454 : cluster [DBG] pgmap v283: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:48:07.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:48:06 smithi188 bash[23329]: cluster 2020-07-16T13:48:05.621374+0000 mgr.x (mgr.34562) 454 : cluster [DBG] pgmap v283: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:48:09.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:48:08 smithi132 bash[27079]: cluster 2020-07-16T13:48:07.621851+0000 mgr.x (mgr.34562) 455 : cluster [DBG] pgmap v284: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:48:09.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:48:08 smithi188 bash[23329]: cluster 2020-07-16T13:48:07.621851+0000 mgr.x (mgr.34562) 455 : cluster [DBG] pgmap v284: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:48:10.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:48:10 smithi188 bash[23329]: cluster 2020-07-16T13:48:09.622388+0000 mgr.x (mgr.34562) 456 : cluster [DBG] pgmap v285: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:48:10.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:48:10 smithi132 bash[27079]: cluster 2020-07-16T13:48:09.622388+0000 mgr.x (mgr.34562) 456 : cluster [DBG] pgmap v285: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:48:13.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:48:12 smithi132 bash[27079]: cluster 2020-07-16T13:48:11.622882+0000 mgr.x (mgr.34562) 457 : cluster [DBG] pgmap v286: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:48:13.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:48:12 smithi188 bash[23329]: cluster 2020-07-16T13:48:11.622882+0000 mgr.x (mgr.34562) 457 : cluster [DBG] pgmap v286: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:48:15.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:48:14 smithi132 bash[27079]: cluster 2020-07-16T13:48:13.623240+0000 mgr.x (mgr.34562) 458 : cluster [DBG] pgmap v287: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:48:15.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:48:14 smithi188 bash[23329]: cluster 2020-07-16T13:48:13.623240+0000 mgr.x (mgr.34562) 458 : cluster [DBG] pgmap v287: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:48:16.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:48:15 smithi132 bash[27079]: audit 2020-07-16T13:48:14.916730+0000 mon.b (mon.2) 237 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:48:16.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:48:15 smithi132 bash[27079]: audit 2020-07-16T13:48:14.917083+0000 mgr.x (mgr.34562) 459 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:48:16.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:48:15 smithi132 bash[27079]: audit 2020-07-16T13:48:14.918064+0000 mon.b (mon.2) 238 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:48:16.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:48:15 smithi132 bash[27079]: audit 2020-07-16T13:48:14.918361+0000 mgr.x (mgr.34562) 460 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:48:16.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:48:15 smithi132 bash[27079]: audit 2020-07-16T13:48:14.919192+0000 mon.b (mon.2) 239 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:48:16.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:48:15 smithi132 bash[27079]: audit 2020-07-16T13:48:14.919478+0000 mgr.x (mgr.34562) 461 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:48:16.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:48:15 smithi132 bash[27079]: cephadm 2020-07-16T13:48:14.920187+0000 mgr.x (mgr.34562) 462 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T13:48:16.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:48:15 smithi132 bash[27079]: audit 2020-07-16T13:48:14.920452+0000 mon.b (mon.2) 240 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T13:48:16.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:48:15 smithi132 bash[27079]: cephadm 2020-07-16T13:48:14.921336+0000 mgr.x (mgr.34562) 463 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T13:48:16.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:48:15 smithi132 bash[27079]: audit 2020-07-16T13:48:14.921840+0000 mon.b (mon.2) 241 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:48:16.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:48:15 smithi132 bash[27079]: cephadm 2020-07-16T13:48:14.922605+0000 mgr.x (mgr.34562) 464 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T13:48:16.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:48:15 smithi132 bash[27079]: cephadm 2020-07-16T13:48:14.922847+0000 mgr.x (mgr.34562) 465 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T13:48:16.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:48:15 smithi188 bash[23329]: audit 2020-07-16T13:48:14.916730+0000 mon.b (mon.2) 237 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:48:16.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:48:15 smithi188 bash[23329]: audit 2020-07-16T13:48:14.917083+0000 mgr.x (mgr.34562) 459 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:48:16.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:48:15 smithi188 bash[23329]: audit 2020-07-16T13:48:14.918064+0000 mon.b (mon.2) 238 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:48:16.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:48:15 smithi188 bash[23329]: audit 2020-07-16T13:48:14.918361+0000 mgr.x (mgr.34562) 460 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:48:16.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:48:15 smithi188 bash[23329]: audit 2020-07-16T13:48:14.919192+0000 mon.b (mon.2) 239 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:48:16.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:48:15 smithi188 bash[23329]: audit 2020-07-16T13:48:14.919478+0000 mgr.x (mgr.34562) 461 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:48:16.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:48:15 smithi188 bash[23329]: cephadm 2020-07-16T13:48:14.920187+0000 mgr.x (mgr.34562) 462 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T13:48:16.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:48:15 smithi188 bash[23329]: audit 2020-07-16T13:48:14.920452+0000 mon.b (mon.2) 240 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T13:48:16.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:48:15 smithi188 bash[23329]: cephadm 2020-07-16T13:48:14.921336+0000 mgr.x (mgr.34562) 463 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T13:48:16.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:48:15 smithi188 bash[23329]: audit 2020-07-16T13:48:14.921840+0000 mon.b (mon.2) 241 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:48:16.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:48:15 smithi188 bash[23329]: cephadm 2020-07-16T13:48:14.922605+0000 mgr.x (mgr.34562) 464 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T13:48:16.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:48:15 smithi188 bash[23329]: cephadm 2020-07-16T13:48:14.922847+0000 mgr.x (mgr.34562) 465 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T13:48:17.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:48:16 smithi132 bash[27079]: cluster 2020-07-16T13:48:15.623611+0000 mgr.x (mgr.34562) 466 : cluster [DBG] pgmap v288: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:48:17.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:48:16 smithi188 bash[23329]: cluster 2020-07-16T13:48:15.623611+0000 mgr.x (mgr.34562) 466 : cluster [DBG] pgmap v288: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:48:19.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:48:18 smithi132 bash[27079]: cluster 2020-07-16T13:48:17.624193+0000 mgr.x (mgr.34562) 467 : cluster [DBG] pgmap v289: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:48:19.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:48:18 smithi132 bash[27079]: audit 2020-07-16T13:48:17.736497+0000 mon.b (mon.2) 242 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:48:19.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:48:18 smithi132 bash[27079]: cephadm 2020-07-16T13:48:17.737154+0000 mgr.x (mgr.34562) 468 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:48:19.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:48:18 smithi132 bash[27079]: cephadm 2020-07-16T13:48:17.737598+0000 mgr.x (mgr.34562) 469 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:48:19.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:48:18 smithi188 bash[23329]: cluster 2020-07-16T13:48:17.624193+0000 mgr.x (mgr.34562) 467 : cluster [DBG] pgmap v289: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:48:19.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:48:18 smithi188 bash[23329]: audit 2020-07-16T13:48:17.736497+0000 mon.b (mon.2) 242 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:48:19.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:48:18 smithi188 bash[23329]: cephadm 2020-07-16T13:48:17.737154+0000 mgr.x (mgr.34562) 468 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:48:19.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:48:18 smithi188 bash[23329]: cephadm 2020-07-16T13:48:17.737598+0000 mgr.x (mgr.34562) 469 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:48:20.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:48:20 smithi188 bash[23329]: cluster 2020-07-16T13:48:19.624534+0000 mgr.x (mgr.34562) 470 : cluster [DBG] pgmap v290: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:48:20.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:48:20 smithi132 bash[27079]: cluster 2020-07-16T13:48:19.624534+0000 mgr.x (mgr.34562) 470 : cluster [DBG] pgmap v290: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:48:23.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:48:22 smithi132 bash[27079]: cluster 2020-07-16T13:48:21.624872+0000 mgr.x (mgr.34562) 471 : cluster [DBG] pgmap v291: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:48:23.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:48:22 smithi188 bash[23329]: cluster 2020-07-16T13:48:21.624872+0000 mgr.x (mgr.34562) 471 : cluster [DBG] pgmap v291: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:48:25.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:48:24 smithi132 bash[27079]: cluster 2020-07-16T13:48:23.625387+0000 mgr.x (mgr.34562) 472 : cluster [DBG] pgmap v292: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:48:25.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:48:24 smithi188 bash[23329]: cluster 2020-07-16T13:48:23.625387+0000 mgr.x (mgr.34562) 472 : cluster [DBG] pgmap v292: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:48:27.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:48:26 smithi132 bash[27079]: cluster 2020-07-16T13:48:25.625900+0000 mgr.x (mgr.34562) 473 : cluster [DBG] pgmap v293: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:48:27.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:48:26 smithi188 bash[23329]: cluster 2020-07-16T13:48:25.625900+0000 mgr.x (mgr.34562) 473 : cluster [DBG] pgmap v293: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:48:29.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:48:28 smithi132 bash[27079]: cluster 2020-07-16T13:48:27.626395+0000 mgr.x (mgr.34562) 474 : cluster [DBG] pgmap v294: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:48:29.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:48:28 smithi188 bash[23329]: cluster 2020-07-16T13:48:27.626395+0000 mgr.x (mgr.34562) 474 : cluster [DBG] pgmap v294: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:48:30.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:48:30 smithi188 bash[23329]: cluster 2020-07-16T13:48:29.626825+0000 mgr.x (mgr.34562) 475 : cluster [DBG] pgmap v295: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:48:30.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:48:30 smithi132 bash[27079]: cluster 2020-07-16T13:48:29.626825+0000 mgr.x (mgr.34562) 475 : cluster [DBG] pgmap v295: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:48:32.947 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T13:48:33.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:48:32 smithi132 bash[27079]: cluster 2020-07-16T13:48:31.627193+0000 mgr.x (mgr.34562) 476 : cluster [DBG] pgmap v296: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:48:33.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:48:32 smithi188 bash[23329]: cluster 2020-07-16T13:48:31.627193+0000 mgr.x (mgr.34562) 476 : cluster [DBG] pgmap v296: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:48:33.210 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T13:48:33.210 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (11m) 9m ago 14m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T13:48:33.211 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (14m) 9m ago 14m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T13:48:33.211 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (11m) 9m ago 17m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T13:48:33.211 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (11m) 9m ago 18m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T13:48:33.211 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 9m ago 18m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T13:48:33.211 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (17m) 9m ago 17m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T13:48:33.212 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (17m) 9m ago 17m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T13:48:33.212 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (14m) 9m ago 14m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T13:48:33.212 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (14m) 9m ago 14m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T13:48:33.212 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (16m) 9m ago 16m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T13:48:33.212 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (16m) 9m ago 16m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T13:48:33.213 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (16m) 9m ago 16m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T13:48:33.213 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (16m) 9m ago 16m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T13:48:33.213 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (15m) 9m ago 15m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T13:48:33.213 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (15m) 9m ago 15m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T13:48:33.213 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (15m) 9m ago 15m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T13:48:33.214 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (14m) 9m ago 14m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T13:48:33.214 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (13m) 9m ago 14m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T13:48:33.506 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T13:48:33.506 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T13:48:33.506 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T13:48:33.507 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T13:48:33.507 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:48:33.507 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T13:48:33.507 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T13:48:33.507 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:48:33.508 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T13:48:33.508 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T13:48:33.508 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:48:33.508 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T13:48:33.508 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T13:48:33.509 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T13:48:33.509 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T13:48:33.509 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T13:48:33.509 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T13:48:34.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:48:33 smithi132 bash[27079]: audit 2020-07-16T13:48:32.752883+0000 mon.b (mon.2) 243 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:48:34.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:48:33 smithi132 bash[27079]: cephadm 2020-07-16T13:48:32.753626+0000 mgr.x (mgr.34562) 477 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:48:34.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:48:33 smithi132 bash[27079]: cephadm 2020-07-16T13:48:32.754059+0000 mgr.x (mgr.34562) 478 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:48:34.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:48:33 smithi132 bash[27079]: audit 2020-07-16T13:48:32.935883+0000 mgr.x (mgr.34562) 479 : audit [DBG] from='client.24982 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:48:34.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:48:33 smithi132 bash[27079]: audit 2020-07-16T13:48:33.505383+0000 mon.c (mon.1) 85 : audit [DBG] from='client.? 172.21.15.132:0/1874603148' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:48:34.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:48:33 smithi188 bash[23329]: audit 2020-07-16T13:48:32.752883+0000 mon.b (mon.2) 243 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:48:34.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:48:33 smithi188 bash[23329]: cephadm 2020-07-16T13:48:32.753626+0000 mgr.x (mgr.34562) 477 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:48:34.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:48:33 smithi188 bash[23329]: cephadm 2020-07-16T13:48:32.754059+0000 mgr.x (mgr.34562) 478 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:48:34.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:48:33 smithi188 bash[23329]: audit 2020-07-16T13:48:32.935883+0000 mgr.x (mgr.34562) 479 : audit [DBG] from='client.24982 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:48:34.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:48:33 smithi188 bash[23329]: audit 2020-07-16T13:48:33.505383+0000 mon.c (mon.1) 85 : audit [DBG] from='client.? 172.21.15.132:0/1874603148' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:48:35.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:48:34 smithi132 bash[27079]: audit 2020-07-16T13:48:33.206003+0000 mgr.x (mgr.34562) 480 : audit [DBG] from='client.24988 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:48:35.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:48:34 smithi132 bash[27079]: cluster 2020-07-16T13:48:33.627541+0000 mgr.x (mgr.34562) 481 : cluster [DBG] pgmap v297: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:48:35.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:48:34 smithi188 bash[23329]: audit 2020-07-16T13:48:33.206003+0000 mgr.x (mgr.34562) 480 : audit [DBG] from='client.24988 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:48:35.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:48:34 smithi188 bash[23329]: cluster 2020-07-16T13:48:33.627541+0000 mgr.x (mgr.34562) 481 : cluster [DBG] pgmap v297: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:48:37.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:48:36 smithi132 bash[27079]: cluster 2020-07-16T13:48:35.627888+0000 mgr.x (mgr.34562) 482 : cluster [DBG] pgmap v298: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:48:37.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:48:36 smithi188 bash[23329]: cluster 2020-07-16T13:48:35.627888+0000 mgr.x (mgr.34562) 482 : cluster [DBG] pgmap v298: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:48:39.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:48:38 smithi132 bash[27079]: cluster 2020-07-16T13:48:37.628429+0000 mgr.x (mgr.34562) 483 : cluster [DBG] pgmap v299: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:48:39.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:48:38 smithi188 bash[23329]: cluster 2020-07-16T13:48:37.628429+0000 mgr.x (mgr.34562) 483 : cluster [DBG] pgmap v299: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:48:40.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:48:40 smithi188 bash[23329]: cluster 2020-07-16T13:48:39.628858+0000 mgr.x (mgr.34562) 484 : cluster [DBG] pgmap v300: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:48:40.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:48:40 smithi132 bash[27079]: cluster 2020-07-16T13:48:39.628858+0000 mgr.x (mgr.34562) 484 : cluster [DBG] pgmap v300: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:48:43.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:48:42 smithi132 bash[27079]: cluster 2020-07-16T13:48:41.629216+0000 mgr.x (mgr.34562) 485 : cluster [DBG] pgmap v301: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:48:43.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:48:42 smithi188 bash[23329]: cluster 2020-07-16T13:48:41.629216+0000 mgr.x (mgr.34562) 485 : cluster [DBG] pgmap v301: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:48:45.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:48:44 smithi132 bash[27079]: cluster 2020-07-16T13:48:43.629691+0000 mgr.x (mgr.34562) 486 : cluster [DBG] pgmap v302: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:48:45.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:48:44 smithi188 bash[23329]: cluster 2020-07-16T13:48:43.629691+0000 mgr.x (mgr.34562) 486 : cluster [DBG] pgmap v302: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:48:47.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:48:46 smithi132 bash[27079]: cluster 2020-07-16T13:48:45.630023+0000 mgr.x (mgr.34562) 487 : cluster [DBG] pgmap v303: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:48:47.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:48:46 smithi188 bash[23329]: cluster 2020-07-16T13:48:45.630023+0000 mgr.x (mgr.34562) 487 : cluster [DBG] pgmap v303: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:48:49.038 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:48:48 smithi132 bash[27079]: cluster 2020-07-16T13:48:47.630520+0000 mgr.x (mgr.34562) 488 : cluster [DBG] pgmap v304: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:48:49.046 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:48:48 smithi132 bash[27079]: audit 2020-07-16T13:48:47.763184+0000 mon.b (mon.2) 244 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:48:49.046 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:48:48 smithi132 bash[27079]: cephadm 2020-07-16T13:48:47.763944+0000 mgr.x (mgr.34562) 489 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:48:49.047 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:48:48 smithi132 bash[27079]: cephadm 2020-07-16T13:48:47.764039+0000 mgr.x (mgr.34562) 490 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:48:49.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:48:48 smithi188 bash[23329]: cluster 2020-07-16T13:48:47.630520+0000 mgr.x (mgr.34562) 488 : cluster [DBG] pgmap v304: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:48:49.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:48:48 smithi188 bash[23329]: audit 2020-07-16T13:48:47.763184+0000 mon.b (mon.2) 244 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:48:49.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:48:48 smithi188 bash[23329]: cephadm 2020-07-16T13:48:47.763944+0000 mgr.x (mgr.34562) 489 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:48:49.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:48:48 smithi188 bash[23329]: cephadm 2020-07-16T13:48:47.764039+0000 mgr.x (mgr.34562) 490 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:48:50.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:48:50 smithi188 bash[23329]: cluster 2020-07-16T13:48:49.630903+0000 mgr.x (mgr.34562) 491 : cluster [DBG] pgmap v305: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:48:50.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:48:50 smithi132 bash[27079]: cluster 2020-07-16T13:48:49.630903+0000 mgr.x (mgr.34562) 491 : cluster [DBG] pgmap v305: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:48:53.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:48:52 smithi132 bash[27079]: cluster 2020-07-16T13:48:51.631463+0000 mgr.x (mgr.34562) 492 : cluster [DBG] pgmap v306: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:48:53.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:48:52 smithi188 bash[23329]: cluster 2020-07-16T13:48:51.631463+0000 mgr.x (mgr.34562) 492 : cluster [DBG] pgmap v306: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:48:55.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:48:54 smithi132 bash[27079]: cluster 2020-07-16T13:48:53.631850+0000 mgr.x (mgr.34562) 493 : cluster [DBG] pgmap v307: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:48:55.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:48:54 smithi188 bash[23329]: cluster 2020-07-16T13:48:53.631850+0000 mgr.x (mgr.34562) 493 : cluster [DBG] pgmap v307: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:48:57.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:48:56 smithi132 bash[27079]: cluster 2020-07-16T13:48:55.632230+0000 mgr.x (mgr.34562) 494 : cluster [DBG] pgmap v308: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:48:57.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:48:56 smithi188 bash[23329]: cluster 2020-07-16T13:48:55.632230+0000 mgr.x (mgr.34562) 494 : cluster [DBG] pgmap v308: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:48:59.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:48:58 smithi132 bash[27079]: cluster 2020-07-16T13:48:57.632708+0000 mgr.x (mgr.34562) 495 : cluster [DBG] pgmap v309: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:48:59.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:48:58 smithi188 bash[23329]: cluster 2020-07-16T13:48:57.632708+0000 mgr.x (mgr.34562) 495 : cluster [DBG] pgmap v309: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:49:00.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:00 smithi188 bash[23329]: cluster 2020-07-16T13:48:59.633111+0000 mgr.x (mgr.34562) 496 : cluster [DBG] pgmap v310: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:49:00.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:00 smithi132 bash[27079]: cluster 2020-07-16T13:48:59.633111+0000 mgr.x (mgr.34562) 496 : cluster [DBG] pgmap v310: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:49:03.036 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:02 smithi132 bash[27079]: cluster 2020-07-16T13:49:01.633519+0000 mgr.x (mgr.34562) 497 : cluster [DBG] pgmap v311: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:49:03.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:02 smithi188 bash[23329]: cluster 2020-07-16T13:49:01.633519+0000 mgr.x (mgr.34562) 497 : cluster [DBG] pgmap v311: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:49:03.807 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T13:49:04.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:03 smithi132 bash[27079]: audit 2020-07-16T13:49:02.779881+0000 mon.b (mon.2) 245 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:49:04.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:03 smithi132 bash[27079]: cephadm 2020-07-16T13:49:02.780589+0000 mgr.x (mgr.34562) 498 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:49:04.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:03 smithi132 bash[27079]: cephadm 2020-07-16T13:49:02.780982+0000 mgr.x (mgr.34562) 499 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:49:04.070 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T13:49:04.071 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (11m) 10m ago 14m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T13:49:04.071 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (14m) 10m ago 14m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T13:49:04.071 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (12m) 10m ago 17m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T13:49:04.071 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (11m) 10m ago 19m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T13:49:04.072 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 10m ago 19m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T13:49:04.072 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (17m) 10m ago 17m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T13:49:04.072 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (18m) 10m ago 18m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T13:49:04.072 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (15m) 10m ago 15m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T13:49:04.072 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (15m) 10m ago 15m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T13:49:04.073 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (17m) 10m ago 17m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T13:49:04.073 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (17m) 10m ago 17m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T13:49:04.073 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (16m) 10m ago 16m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T13:49:04.073 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (16m) 10m ago 16m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T13:49:04.073 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (16m) 10m ago 16m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T13:49:04.074 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (15m) 10m ago 16m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T13:49:04.074 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (15m) 10m ago 15m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T13:49:04.074 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (15m) 10m ago 15m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T13:49:04.074 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (14m) 10m ago 15m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T13:49:04.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:03 smithi188 bash[23329]: audit 2020-07-16T13:49:02.779881+0000 mon.b (mon.2) 245 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:49:04.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:03 smithi188 bash[23329]: cephadm 2020-07-16T13:49:02.780589+0000 mgr.x (mgr.34562) 498 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:49:04.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:03 smithi188 bash[23329]: cephadm 2020-07-16T13:49:02.780982+0000 mgr.x (mgr.34562) 499 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:49:04.366 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T13:49:04.366 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T13:49:04.366 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T13:49:04.367 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T13:49:04.367 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:49:04.367 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T13:49:04.367 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T13:49:04.367 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:49:04.368 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T13:49:04.368 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T13:49:04.368 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:49:04.368 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T13:49:04.368 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T13:49:04.368 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T13:49:04.369 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T13:49:04.369 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T13:49:04.369 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T13:49:05.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:04 smithi132 bash[27079]: cluster 2020-07-16T13:49:03.633974+0000 mgr.x (mgr.34562) 500 : cluster [DBG] pgmap v312: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:49:05.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:04 smithi132 bash[27079]: audit 2020-07-16T13:49:03.796000+0000 mgr.x (mgr.34562) 501 : audit [DBG] from='client.25000 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:49:05.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:04 smithi132 bash[27079]: audit 2020-07-16T13:49:04.365209+0000 mon.c (mon.1) 86 : audit [DBG] from='client.? 172.21.15.132:0/523497412' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:49:05.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:04 smithi188 bash[23329]: cluster 2020-07-16T13:49:03.633974+0000 mgr.x (mgr.34562) 500 : cluster [DBG] pgmap v312: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:49:05.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:04 smithi188 bash[23329]: audit 2020-07-16T13:49:03.796000+0000 mgr.x (mgr.34562) 501 : audit [DBG] from='client.25000 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:49:05.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:04 smithi188 bash[23329]: audit 2020-07-16T13:49:04.365209+0000 mon.c (mon.1) 86 : audit [DBG] from='client.? 172.21.15.132:0/523497412' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:49:06.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:05 smithi132 bash[27079]: audit 2020-07-16T13:49:04.066132+0000 mgr.x (mgr.34562) 502 : audit [DBG] from='client.25006 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:49:06.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:05 smithi188 bash[23329]: audit 2020-07-16T13:49:04.066132+0000 mgr.x (mgr.34562) 502 : audit [DBG] from='client.25006 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:49:07.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:06 smithi132 bash[27079]: cluster 2020-07-16T13:49:05.634506+0000 mgr.x (mgr.34562) 503 : cluster [DBG] pgmap v313: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:49:07.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:06 smithi188 bash[23329]: cluster 2020-07-16T13:49:05.634506+0000 mgr.x (mgr.34562) 503 : cluster [DBG] pgmap v313: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:49:09.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:08 smithi132 bash[27079]: cluster 2020-07-16T13:49:07.635176+0000 mgr.x (mgr.34562) 504 : cluster [DBG] pgmap v314: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:49:09.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:08 smithi188 bash[23329]: cluster 2020-07-16T13:49:07.635176+0000 mgr.x (mgr.34562) 504 : cluster [DBG] pgmap v314: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:49:10.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:10 smithi188 bash[23329]: cluster 2020-07-16T13:49:09.635765+0000 mgr.x (mgr.34562) 505 : cluster [DBG] pgmap v315: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:49:10.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:10 smithi132 bash[27079]: cluster 2020-07-16T13:49:09.635765+0000 mgr.x (mgr.34562) 505 : cluster [DBG] pgmap v315: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:49:13.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:12 smithi132 bash[27079]: cluster 2020-07-16T13:49:11.636193+0000 mgr.x (mgr.34562) 506 : cluster [DBG] pgmap v316: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:49:13.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:12 smithi188 bash[23329]: cluster 2020-07-16T13:49:11.636193+0000 mgr.x (mgr.34562) 506 : cluster [DBG] pgmap v316: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:49:15.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:14 smithi132 bash[27079]: cluster 2020-07-16T13:49:13.636650+0000 mgr.x (mgr.34562) 507 : cluster [DBG] pgmap v317: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:49:15.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:14 smithi188 bash[23329]: cluster 2020-07-16T13:49:13.636650+0000 mgr.x (mgr.34562) 507 : cluster [DBG] pgmap v317: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:49:17.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:16 smithi132 bash[27079]: cluster 2020-07-16T13:49:15.637102+0000 mgr.x (mgr.34562) 508 : cluster [DBG] pgmap v318: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:49:17.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:16 smithi188 bash[23329]: cluster 2020-07-16T13:49:15.637102+0000 mgr.x (mgr.34562) 508 : cluster [DBG] pgmap v318: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:49:19.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:18 smithi132 bash[27079]: cluster 2020-07-16T13:49:17.637475+0000 mgr.x (mgr.34562) 509 : cluster [DBG] pgmap v319: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:49:19.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:18 smithi132 bash[27079]: audit 2020-07-16T13:49:17.786471+0000 mon.b (mon.2) 246 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:49:19.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:18 smithi132 bash[27079]: audit 2020-07-16T13:49:17.786706+0000 mon.b (mon.2) 247 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:49:19.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:18 smithi188 bash[23329]: cluster 2020-07-16T13:49:17.637475+0000 mgr.x (mgr.34562) 509 : cluster [DBG] pgmap v319: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:49:19.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:18 smithi188 bash[23329]: audit 2020-07-16T13:49:17.786471+0000 mon.b (mon.2) 246 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:49:19.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:18 smithi188 bash[23329]: audit 2020-07-16T13:49:17.786706+0000 mon.b (mon.2) 247 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:49:20.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:20 smithi188 bash[23329]: cluster 2020-07-16T13:49:19.637818+0000 mgr.x (mgr.34562) 510 : cluster [DBG] pgmap v320: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:49:20.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:20 smithi188 bash[23329]: audit 2020-07-16T13:49:20.027294+0000 mon.b (mon.2) 248 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T13:49:20.025754\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.025813\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.025850\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.025880\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.026050\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.026158\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.026267\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.026381\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.026415\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T13:49:20.026493\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:40:54.402888\"}"}]: dispatch 2020-07-16T13:49:20.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:20 smithi188 bash[23329]: audit 2020-07-16T13:49:20.027892+0000 mon.c (mon.1) 87 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T13:49:20.025754\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.025813\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.025850\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.025880\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.026050\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.026158\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.026267\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.026381\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.026415\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T13:49:20.026493\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:40:54.402888\"}"}]: dispatch 2020-07-16T13:49:20.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:20 smithi188 bash[23329]: audit 2020-07-16T13:49:20.030517+0000 mon.c (mon.1) 88 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T13:49:20.025754\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.025813\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.025850\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.025880\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.026050\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.026158\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.026267\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.026381\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.026415\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T13:49:20.026493\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:40:54.402888\"}"}]': finished 2020-07-16T13:49:20.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:20 smithi132 bash[27079]: cluster 2020-07-16T13:49:19.637818+0000 mgr.x (mgr.34562) 510 : cluster [DBG] pgmap v320: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:49:20.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:20 smithi132 bash[27079]: audit 2020-07-16T13:49:20.027294+0000 mon.b (mon.2) 248 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T13:49:20.025754\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.025813\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.025850\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.025880\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.026050\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.026158\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.026267\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.026381\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.026415\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T13:49:20.026493\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:40:54.402888\"}"}]: dispatch 2020-07-16T13:49:20.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:20 smithi132 bash[27079]: audit 2020-07-16T13:49:20.027892+0000 mon.c (mon.1) 87 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T13:49:20.025754\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.025813\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.025850\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.025880\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.026050\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.026158\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.026267\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.026381\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.026415\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T13:49:20.026493\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:40:54.402888\"}"}]: dispatch 2020-07-16T13:49:20.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:20 smithi132 bash[27079]: audit 2020-07-16T13:49:20.030517+0000 mon.c (mon.1) 88 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T13:49:20.025754\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.025813\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.025850\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.025880\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.026050\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.026158\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.026267\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.026381\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.026415\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T13:49:20.026493\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:40:54.402888\"}"}]': finished 2020-07-16T13:49:21.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:21 smithi132 bash[27079]: audit 2020-07-16T13:49:20.450393+0000 mon.b (mon.2) 249 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.448858\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.448928\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.448959\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449118\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449221\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449349\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449454\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449488\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449517\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:49:20.449606\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:40:54.407611\"}"}]: dispatch 2020-07-16T13:49:21.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:21 smithi132 bash[27079]: audit 2020-07-16T13:49:20.450944+0000 mon.c (mon.1) 89 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.448858\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.448928\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.448959\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449118\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449221\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449349\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449454\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449488\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449517\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:49:20.449606\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:40:54.407611\"}"}]: dispatch 2020-07-16T13:49:21.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:21 smithi132 bash[27079]: audit 2020-07-16T13:49:20.453694+0000 mon.c (mon.1) 90 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.448858\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.448928\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.448959\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449118\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449221\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449349\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449454\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449488\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449517\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:49:20.449606\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:40:54.407611\"}"}]': finished 2020-07-16T13:49:21.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:21 smithi132 bash[27079]: audit 2020-07-16T13:49:20.458248+0000 mon.b (mon.2) 250 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:49:21.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:21 smithi132 bash[27079]: audit 2020-07-16T13:49:20.458511+0000 mgr.x (mgr.34562) 511 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:49:21.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:21 smithi132 bash[27079]: audit 2020-07-16T13:49:20.459157+0000 mon.b (mon.2) 251 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:49:21.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:21 smithi132 bash[27079]: audit 2020-07-16T13:49:20.459394+0000 mgr.x (mgr.34562) 512 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:49:21.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:21 smithi132 bash[27079]: audit 2020-07-16T13:49:20.459999+0000 mon.b (mon.2) 252 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:49:21.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:21 smithi132 bash[27079]: audit 2020-07-16T13:49:20.460216+0000 mgr.x (mgr.34562) 513 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:49:21.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:21 smithi132 bash[27079]: cephadm 2020-07-16T13:49:20.460731+0000 mgr.x (mgr.34562) 514 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T13:49:21.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:21 smithi132 bash[27079]: audit 2020-07-16T13:49:20.461023+0000 mon.b (mon.2) 253 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T13:49:21.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:21 smithi132 bash[27079]: cephadm 2020-07-16T13:49:20.461625+0000 mgr.x (mgr.34562) 515 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T13:49:21.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:21 smithi132 bash[27079]: audit 2020-07-16T13:49:20.461915+0000 mon.b (mon.2) 254 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:49:21.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:21 smithi132 bash[27079]: cephadm 2020-07-16T13:49:20.462448+0000 mgr.x (mgr.34562) 516 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T13:49:21.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:21 smithi132 bash[27079]: cephadm 2020-07-16T13:49:20.462590+0000 mgr.x (mgr.34562) 517 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T13:49:21.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:21 smithi188 bash[23329]: audit 2020-07-16T13:49:20.450393+0000 mon.b (mon.2) 249 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.448858\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.448928\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.448959\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449118\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449221\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449349\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449454\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449488\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449517\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:49:20.449606\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:40:54.407611\"}"}]: dispatch 2020-07-16T13:49:21.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:21 smithi188 bash[23329]: audit 2020-07-16T13:49:20.450944+0000 mon.c (mon.1) 89 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.448858\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.448928\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.448959\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449118\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449221\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449349\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449454\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449488\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449517\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:49:20.449606\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:40:54.407611\"}"}]: dispatch 2020-07-16T13:49:21.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:21 smithi188 bash[23329]: audit 2020-07-16T13:49:20.453694+0000 mon.c (mon.1) 90 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.448858\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.448928\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.448959\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449118\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449221\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449349\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449454\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449488\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449517\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:49:20.449606\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:40:54.407611\"}"}]': finished 2020-07-16T13:49:21.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:21 smithi188 bash[23329]: audit 2020-07-16T13:49:20.458248+0000 mon.b (mon.2) 250 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:49:21.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:21 smithi188 bash[23329]: audit 2020-07-16T13:49:20.458511+0000 mgr.x (mgr.34562) 511 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:49:21.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:21 smithi188 bash[23329]: audit 2020-07-16T13:49:20.459157+0000 mon.b (mon.2) 251 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:49:21.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:21 smithi188 bash[23329]: audit 2020-07-16T13:49:20.459394+0000 mgr.x (mgr.34562) 512 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:49:21.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:21 smithi188 bash[23329]: audit 2020-07-16T13:49:20.459999+0000 mon.b (mon.2) 252 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:49:21.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:21 smithi188 bash[23329]: audit 2020-07-16T13:49:20.460216+0000 mgr.x (mgr.34562) 513 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:49:21.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:21 smithi188 bash[23329]: cephadm 2020-07-16T13:49:20.460731+0000 mgr.x (mgr.34562) 514 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T13:49:21.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:21 smithi188 bash[23329]: audit 2020-07-16T13:49:20.461023+0000 mon.b (mon.2) 253 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T13:49:21.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:21 smithi188 bash[23329]: cephadm 2020-07-16T13:49:20.461625+0000 mgr.x (mgr.34562) 515 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T13:49:21.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:21 smithi188 bash[23329]: audit 2020-07-16T13:49:20.461915+0000 mon.b (mon.2) 254 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:49:21.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:21 smithi188 bash[23329]: cephadm 2020-07-16T13:49:20.462448+0000 mgr.x (mgr.34562) 516 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T13:49:21.425 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:21 smithi188 bash[23329]: cephadm 2020-07-16T13:49:20.462590+0000 mgr.x (mgr.34562) 517 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T13:49:22.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:22 smithi132 bash[27079]: cluster 2020-07-16T13:49:21.638241+0000 mgr.x (mgr.34562) 518 : cluster [DBG] pgmap v321: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:49:22.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:22 smithi188 bash[23329]: cluster 2020-07-16T13:49:21.638241+0000 mgr.x (mgr.34562) 518 : cluster [DBG] pgmap v321: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:49:23.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:23 smithi132 bash[27079]: audit 2020-07-16T13:49:23.392838+0000 mon.b (mon.2) 255 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:49:23.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:23 smithi188 bash[23329]: audit 2020-07-16T13:49:23.392838+0000 mon.b (mon.2) 255 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:49:24.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:24 smithi132 bash[27079]: cephadm 2020-07-16T13:49:23.393454+0000 mgr.x (mgr.34562) 519 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:49:24.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:24 smithi132 bash[27079]: cephadm 2020-07-16T13:49:23.393870+0000 mgr.x (mgr.34562) 520 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:49:24.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:24 smithi132 bash[27079]: cluster 2020-07-16T13:49:23.638763+0000 mgr.x (mgr.34562) 521 : cluster [DBG] pgmap v322: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:49:24.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:24 smithi188 bash[23329]: cephadm 2020-07-16T13:49:23.393454+0000 mgr.x (mgr.34562) 519 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:49:24.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:24 smithi188 bash[23329]: cephadm 2020-07-16T13:49:23.393870+0000 mgr.x (mgr.34562) 520 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:49:24.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:24 smithi188 bash[23329]: cluster 2020-07-16T13:49:23.638763+0000 mgr.x (mgr.34562) 521 : cluster [DBG] pgmap v322: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:49:27.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:26 smithi132 bash[27079]: cluster 2020-07-16T13:49:25.639209+0000 mgr.x (mgr.34562) 522 : cluster [DBG] pgmap v323: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:49:27.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:26 smithi188 bash[23329]: cluster 2020-07-16T13:49:25.639209+0000 mgr.x (mgr.34562) 522 : cluster [DBG] pgmap v323: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:49:29.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:28 smithi132 bash[27079]: cluster 2020-07-16T13:49:27.639567+0000 mgr.x (mgr.34562) 523 : cluster [DBG] pgmap v324: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:49:29.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:28 smithi188 bash[23329]: cluster 2020-07-16T13:49:27.639567+0000 mgr.x (mgr.34562) 523 : cluster [DBG] pgmap v324: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:49:30.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:30 smithi188 bash[23329]: cluster 2020-07-16T13:49:29.640062+0000 mgr.x (mgr.34562) 524 : cluster [DBG] pgmap v325: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:49:30.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:30 smithi132 bash[27079]: cluster 2020-07-16T13:49:29.640062+0000 mgr.x (mgr.34562) 524 : cluster [DBG] pgmap v325: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:49:33.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:32 smithi132 bash[27079]: cluster 2020-07-16T13:49:31.640484+0000 mgr.x (mgr.34562) 525 : cluster [DBG] pgmap v326: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:49:33.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:32 smithi188 bash[23329]: cluster 2020-07-16T13:49:31.640484+0000 mgr.x (mgr.34562) 525 : cluster [DBG] pgmap v326: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:49:34.665 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T13:49:34.929 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T13:49:34.929 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (12m) 14s ago 15m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T13:49:34.929 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (15m) 14s ago 15m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T13:49:34.930 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (12m) 14s ago 18m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T13:49:34.930 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (12m) 14s ago 19m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T13:49:34.930 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 14s ago 20m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T13:49:34.931 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (18m) 14s ago 18m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T13:49:34.931 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (18m) 14s ago 18m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T13:49:34.931 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (15m) 14s ago 15m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T13:49:34.932 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (15m) 14s ago 15m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T13:49:34.932 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (17m) 14s ago 17m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T13:49:34.932 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (17m) 14s ago 17m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T13:49:34.933 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (17m) 14s ago 17m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T13:49:34.933 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (17m) 14s ago 17m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T13:49:34.933 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (16m) 14s ago 16m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T13:49:34.934 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (16m) 14s ago 16m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T13:49:34.934 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (16m) 14s ago 16m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T13:49:34.934 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (15m) 14s ago 15m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T13:49:34.935 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (14m) 14s ago 15m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T13:49:35.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:34 smithi132 bash[27079]: cluster 2020-07-16T13:49:33.640900+0000 mgr.x (mgr.34562) 526 : cluster [DBG] pgmap v327: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:49:35.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:34 smithi188 bash[23329]: cluster 2020-07-16T13:49:33.640900+0000 mgr.x (mgr.34562) 526 : cluster [DBG] pgmap v327: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:49:35.226 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T13:49:35.226 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T13:49:35.227 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T13:49:35.227 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T13:49:35.227 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:49:35.227 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T13:49:35.227 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T13:49:35.228 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:49:35.228 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T13:49:35.228 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T13:49:35.228 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:49:35.228 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T13:49:35.229 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T13:49:35.229 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T13:49:35.229 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T13:49:35.229 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T13:49:35.229 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T13:49:36.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:35 smithi132 bash[27079]: audit 2020-07-16T13:49:34.652494+0000 mgr.x (mgr.34562) 527 : audit [DBG] from='client.25018 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:49:36.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:35 smithi132 bash[27079]: audit 2020-07-16T13:49:34.924174+0000 mgr.x (mgr.34562) 528 : audit [DBG] from='client.25024 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:49:36.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:35 smithi132 bash[27079]: audit 2020-07-16T13:49:35.225606+0000 mon.c (mon.1) 91 : audit [DBG] from='client.? 172.21.15.132:0/622636088' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:49:36.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:35 smithi188 bash[23329]: audit 2020-07-16T13:49:34.652494+0000 mgr.x (mgr.34562) 527 : audit [DBG] from='client.25018 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:49:36.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:35 smithi188 bash[23329]: audit 2020-07-16T13:49:34.924174+0000 mgr.x (mgr.34562) 528 : audit [DBG] from='client.25024 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:49:36.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:35 smithi188 bash[23329]: audit 2020-07-16T13:49:35.225606+0000 mon.c (mon.1) 91 : audit [DBG] from='client.? 172.21.15.132:0/622636088' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:49:37.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:36 smithi132 bash[27079]: cluster 2020-07-16T13:49:35.641360+0000 mgr.x (mgr.34562) 529 : cluster [DBG] pgmap v328: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:49:37.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:36 smithi188 bash[23329]: cluster 2020-07-16T13:49:35.641360+0000 mgr.x (mgr.34562) 529 : cluster [DBG] pgmap v328: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:49:39.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:38 smithi132 bash[27079]: cluster 2020-07-16T13:49:37.641795+0000 mgr.x (mgr.34562) 530 : cluster [DBG] pgmap v329: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:49:39.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:38 smithi132 bash[27079]: audit 2020-07-16T13:49:38.409408+0000 mon.b (mon.2) 256 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:49:39.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:38 smithi188 bash[23329]: cluster 2020-07-16T13:49:37.641795+0000 mgr.x (mgr.34562) 530 : cluster [DBG] pgmap v329: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:49:39.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:38 smithi188 bash[23329]: audit 2020-07-16T13:49:38.409408+0000 mon.b (mon.2) 256 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:49:40.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:39 smithi132 bash[27079]: cephadm 2020-07-16T13:49:38.410105+0000 mgr.x (mgr.34562) 531 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:49:40.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:39 smithi132 bash[27079]: cephadm 2020-07-16T13:49:38.410506+0000 mgr.x (mgr.34562) 532 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:49:40.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:39 smithi188 bash[23329]: cephadm 2020-07-16T13:49:38.410105+0000 mgr.x (mgr.34562) 531 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:49:40.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:39 smithi188 bash[23329]: cephadm 2020-07-16T13:49:38.410506+0000 mgr.x (mgr.34562) 532 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:49:41.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:40 smithi132 bash[27079]: cluster 2020-07-16T13:49:39.642229+0000 mgr.x (mgr.34562) 533 : cluster [DBG] pgmap v330: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:49:41.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:40 smithi188 bash[23329]: cluster 2020-07-16T13:49:39.642229+0000 mgr.x (mgr.34562) 533 : cluster [DBG] pgmap v330: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:49:43.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:42 smithi132 bash[27079]: cluster 2020-07-16T13:49:41.642674+0000 mgr.x (mgr.34562) 534 : cluster [DBG] pgmap v331: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:49:43.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:42 smithi188 bash[23329]: cluster 2020-07-16T13:49:41.642674+0000 mgr.x (mgr.34562) 534 : cluster [DBG] pgmap v331: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:49:45.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:44 smithi132 bash[27079]: cluster 2020-07-16T13:49:43.643155+0000 mgr.x (mgr.34562) 535 : cluster [DBG] pgmap v332: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:49:45.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:44 smithi188 bash[23329]: cluster 2020-07-16T13:49:43.643155+0000 mgr.x (mgr.34562) 535 : cluster [DBG] pgmap v332: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:49:47.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:46 smithi132 bash[27079]: cluster 2020-07-16T13:49:45.643635+0000 mgr.x (mgr.34562) 536 : cluster [DBG] pgmap v333: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:49:47.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:46 smithi188 bash[23329]: cluster 2020-07-16T13:49:45.643635+0000 mgr.x (mgr.34562) 536 : cluster [DBG] pgmap v333: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:49:49.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:48 smithi132 bash[27079]: cluster 2020-07-16T13:49:47.644218+0000 mgr.x (mgr.34562) 537 : cluster [DBG] pgmap v334: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:49:49.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:48 smithi188 bash[23329]: cluster 2020-07-16T13:49:47.644218+0000 mgr.x (mgr.34562) 537 : cluster [DBG] pgmap v334: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:49:50.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:50 smithi188 bash[23329]: cluster 2020-07-16T13:49:49.644634+0000 mgr.x (mgr.34562) 538 : cluster [DBG] pgmap v335: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:49:50.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:50 smithi132 bash[27079]: cluster 2020-07-16T13:49:49.644634+0000 mgr.x (mgr.34562) 538 : cluster [DBG] pgmap v335: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:49:53.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:52 smithi132 bash[27079]: cluster 2020-07-16T13:49:51.645168+0000 mgr.x (mgr.34562) 539 : cluster [DBG] pgmap v336: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:49:53.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:52 smithi188 bash[23329]: cluster 2020-07-16T13:49:51.645168+0000 mgr.x (mgr.34562) 539 : cluster [DBG] pgmap v336: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:49:54.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:53 smithi132 bash[27079]: audit 2020-07-16T13:49:53.411237+0000 mon.b (mon.2) 257 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:49:54.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:53 smithi188 bash[23329]: audit 2020-07-16T13:49:53.411237+0000 mon.b (mon.2) 257 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:49:55.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:54 smithi132 bash[27079]: cephadm 2020-07-16T13:49:53.411949+0000 mgr.x (mgr.34562) 540 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:49:55.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:54 smithi132 bash[27079]: cephadm 2020-07-16T13:49:53.412415+0000 mgr.x (mgr.34562) 541 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:49:55.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:54 smithi132 bash[27079]: cluster 2020-07-16T13:49:53.645689+0000 mgr.x (mgr.34562) 542 : cluster [DBG] pgmap v337: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:49:55.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:54 smithi188 bash[23329]: cephadm 2020-07-16T13:49:53.411949+0000 mgr.x (mgr.34562) 540 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:49:55.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:54 smithi188 bash[23329]: cephadm 2020-07-16T13:49:53.412415+0000 mgr.x (mgr.34562) 541 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:49:55.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:54 smithi188 bash[23329]: cluster 2020-07-16T13:49:53.645689+0000 mgr.x (mgr.34562) 542 : cluster [DBG] pgmap v337: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:49:57.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:56 smithi132 bash[27079]: cluster 2020-07-16T13:49:55.646128+0000 mgr.x (mgr.34562) 543 : cluster [DBG] pgmap v338: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:49:57.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:56 smithi188 bash[23329]: cluster 2020-07-16T13:49:55.646128+0000 mgr.x (mgr.34562) 543 : cluster [DBG] pgmap v338: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:49:59.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:49:58 smithi132 bash[27079]: cluster 2020-07-16T13:49:57.646569+0000 mgr.x (mgr.34562) 544 : cluster [DBG] pgmap v339: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:49:59.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:49:58 smithi188 bash[23329]: cluster 2020-07-16T13:49:57.646569+0000 mgr.x (mgr.34562) 544 : cluster [DBG] pgmap v339: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:50:00.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:50:00 smithi188 bash[23329]: cluster 2020-07-16T13:49:59.647085+0000 mgr.x (mgr.34562) 545 : cluster [DBG] pgmap v340: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:50:00.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:50:00 smithi132 bash[27079]: cluster 2020-07-16T13:49:59.647085+0000 mgr.x (mgr.34562) 545 : cluster [DBG] pgmap v340: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:50:03.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:50:02 smithi132 bash[27079]: cluster 2020-07-16T13:50:01.647522+0000 mgr.x (mgr.34562) 546 : cluster [DBG] pgmap v341: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:50:03.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:50:02 smithi188 bash[23329]: cluster 2020-07-16T13:50:01.647522+0000 mgr.x (mgr.34562) 546 : cluster [DBG] pgmap v341: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:50:05.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:50:04 smithi132 bash[27079]: cluster 2020-07-16T13:50:03.648090+0000 mgr.x (mgr.34562) 547 : cluster [DBG] pgmap v342: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:50:05.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:50:04 smithi188 bash[23329]: cluster 2020-07-16T13:50:03.648090+0000 mgr.x (mgr.34562) 547 : cluster [DBG] pgmap v342: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:50:05.521 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T13:50:05.780 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T13:50:05.781 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (12m) 45s ago 15m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T13:50:05.781 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (15m) 45s ago 15m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T13:50:05.781 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (13m) 45s ago 18m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T13:50:05.782 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (12m) 45s ago 20m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T13:50:05.782 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 45s ago 20m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T13:50:05.782 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (18m) 45s ago 18m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T13:50:05.782 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (19m) 45s ago 19m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T13:50:05.782 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (16m) 45s ago 16m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T13:50:05.783 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (16m) 45s ago 16m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T13:50:05.783 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (18m) 45s ago 18m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T13:50:05.783 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (18m) 45s ago 18m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T13:50:05.783 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (17m) 45s ago 17m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T13:50:05.784 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (17m) 45s ago 17m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T13:50:05.784 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (17m) 45s ago 17m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T13:50:05.784 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (17m) 45s ago 17m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T13:50:05.784 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (16m) 45s ago 16m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T13:50:05.784 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (16m) 45s ago 16m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T13:50:05.785 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (15m) 45s ago 16m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T13:50:06.078 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T13:50:06.079 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T13:50:06.079 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T13:50:06.079 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T13:50:06.079 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:50:06.079 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T13:50:06.080 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T13:50:06.080 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:50:06.080 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T13:50:06.080 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T13:50:06.080 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:50:06.081 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T13:50:06.081 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T13:50:06.081 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T13:50:06.081 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T13:50:06.081 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T13:50:06.082 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T13:50:07.033 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:50:06 smithi132 bash[27079]: audit 2020-07-16T13:50:05.509551+0000 mgr.x (mgr.34562) 548 : audit [DBG] from='client.25036 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:50:07.034 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:50:06 smithi132 bash[27079]: cluster 2020-07-16T13:50:05.648446+0000 mgr.x (mgr.34562) 549 : cluster [DBG] pgmap v343: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:50:07.034 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:50:06 smithi132 bash[27079]: audit 2020-07-16T13:50:05.776411+0000 mgr.x (mgr.34562) 550 : audit [DBG] from='client.25042 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:50:07.035 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:50:06 smithi132 bash[27079]: audit 2020-07-16T13:50:06.077826+0000 mon.c (mon.1) 92 : audit [DBG] from='client.? 172.21.15.132:0/3753033763' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:50:07.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:50:06 smithi188 bash[23329]: audit 2020-07-16T13:50:05.509551+0000 mgr.x (mgr.34562) 548 : audit [DBG] from='client.25036 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:50:07.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:50:06 smithi188 bash[23329]: cluster 2020-07-16T13:50:05.648446+0000 mgr.x (mgr.34562) 549 : cluster [DBG] pgmap v343: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:50:07.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:50:06 smithi188 bash[23329]: audit 2020-07-16T13:50:05.776411+0000 mgr.x (mgr.34562) 550 : audit [DBG] from='client.25042 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:50:07.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:50:06 smithi188 bash[23329]: audit 2020-07-16T13:50:06.077826+0000 mon.c (mon.1) 92 : audit [DBG] from='client.? 172.21.15.132:0/3753033763' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:50:09.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:50:08 smithi132 bash[27079]: cluster 2020-07-16T13:50:07.648888+0000 mgr.x (mgr.34562) 551 : cluster [DBG] pgmap v344: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:50:09.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:50:08 smithi132 bash[27079]: audit 2020-07-16T13:50:08.414733+0000 mon.b (mon.2) 258 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:50:09.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:50:08 smithi188 bash[23329]: cluster 2020-07-16T13:50:07.648888+0000 mgr.x (mgr.34562) 551 : cluster [DBG] pgmap v344: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:50:09.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:50:08 smithi188 bash[23329]: audit 2020-07-16T13:50:08.414733+0000 mon.b (mon.2) 258 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:50:10.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:50:09 smithi132 bash[27079]: cephadm 2020-07-16T13:50:08.415377+0000 mgr.x (mgr.34562) 552 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:50:10.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:50:09 smithi132 bash[27079]: cephadm 2020-07-16T13:50:08.415768+0000 mgr.x (mgr.34562) 553 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:50:10.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:50:09 smithi188 bash[23329]: cephadm 2020-07-16T13:50:08.415377+0000 mgr.x (mgr.34562) 552 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:50:10.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:50:09 smithi188 bash[23329]: cephadm 2020-07-16T13:50:08.415768+0000 mgr.x (mgr.34562) 553 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:50:11.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:50:10 smithi132 bash[27079]: cluster 2020-07-16T13:50:09.649424+0000 mgr.x (mgr.34562) 554 : cluster [DBG] pgmap v345: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:50:11.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:50:10 smithi188 bash[23329]: cluster 2020-07-16T13:50:09.649424+0000 mgr.x (mgr.34562) 554 : cluster [DBG] pgmap v345: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:50:13.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:50:12 smithi132 bash[27079]: cluster 2020-07-16T13:50:11.649815+0000 mgr.x (mgr.34562) 555 : cluster [DBG] pgmap v346: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:50:13.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:50:12 smithi188 bash[23329]: cluster 2020-07-16T13:50:11.649815+0000 mgr.x (mgr.34562) 555 : cluster [DBG] pgmap v346: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:50:15.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:50:14 smithi132 bash[27079]: cluster 2020-07-16T13:50:13.650308+0000 mgr.x (mgr.34562) 556 : cluster [DBG] pgmap v347: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:50:15.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:50:14 smithi188 bash[23329]: cluster 2020-07-16T13:50:13.650308+0000 mgr.x (mgr.34562) 556 : cluster [DBG] pgmap v347: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:50:17.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:50:16 smithi132 bash[27079]: cluster 2020-07-16T13:50:15.650756+0000 mgr.x (mgr.34562) 557 : cluster [DBG] pgmap v348: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:50:17.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:50:16 smithi188 bash[23329]: cluster 2020-07-16T13:50:15.650756+0000 mgr.x (mgr.34562) 557 : cluster [DBG] pgmap v348: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:50:18.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:50:18 smithi188 bash[23329]: cluster 2020-07-16T13:50:17.651262+0000 mgr.x (mgr.34562) 558 : cluster [DBG] pgmap v349: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:50:19.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:50:18 smithi132 bash[27079]: cluster 2020-07-16T13:50:17.651262+0000 mgr.x (mgr.34562) 558 : cluster [DBG] pgmap v349: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:50:20.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:50:20 smithi188 bash[23329]: cluster 2020-07-16T13:50:19.651638+0000 mgr.x (mgr.34562) 559 : cluster [DBG] pgmap v350: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:50:20.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:50:20 smithi132 bash[27079]: cluster 2020-07-16T13:50:19.651638+0000 mgr.x (mgr.34562) 559 : cluster [DBG] pgmap v350: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:50:23.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:50:22 smithi132 bash[27079]: cluster 2020-07-16T13:50:21.652147+0000 mgr.x (mgr.34562) 560 : cluster [DBG] pgmap v351: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:50:23.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:50:22 smithi188 bash[23329]: cluster 2020-07-16T13:50:21.652147+0000 mgr.x (mgr.34562) 560 : cluster [DBG] pgmap v351: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:50:23.976 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:50:23 smithi132 bash[27079]: audit 2020-07-16T13:50:23.420182+0000 mon.b (mon.2) 259 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:50:23.976 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:50:23 smithi132 bash[27079]: audit 2020-07-16T13:50:23.421475+0000 mon.b (mon.2) 260 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:50:23.976 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:50:23 smithi132 bash[27079]: audit 2020-07-16T13:50:23.422501+0000 mon.b (mon.2) 261 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:50:23.976 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:50:23 smithi132 bash[27079]: audit 2020-07-16T13:50:23.423771+0000 mon.b (mon.2) 262 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T13:50:23.977 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:50:23 smithi132 bash[27079]: audit 2020-07-16T13:50:23.425022+0000 mon.b (mon.2) 263 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:50:24.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:50:23 smithi188 bash[23329]: audit 2020-07-16T13:50:23.420182+0000 mon.b (mon.2) 259 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:50:24.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:50:23 smithi188 bash[23329]: audit 2020-07-16T13:50:23.421475+0000 mon.b (mon.2) 260 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:50:24.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:50:23 smithi188 bash[23329]: audit 2020-07-16T13:50:23.422501+0000 mon.b (mon.2) 261 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:50:24.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:50:23 smithi188 bash[23329]: audit 2020-07-16T13:50:23.423771+0000 mon.b (mon.2) 262 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T13:50:24.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:50:23 smithi188 bash[23329]: audit 2020-07-16T13:50:23.425022+0000 mon.b (mon.2) 263 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:50:25.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:50:24 smithi132 bash[27079]: audit 2020-07-16T13:50:23.420564+0000 mgr.x (mgr.34562) 561 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:50:25.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:50:24 smithi132 bash[27079]: audit 2020-07-16T13:50:23.421749+0000 mgr.x (mgr.34562) 562 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:50:25.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:50:24 smithi132 bash[27079]: audit 2020-07-16T13:50:23.422747+0000 mgr.x (mgr.34562) 563 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:50:25.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:50:24 smithi132 bash[27079]: cephadm 2020-07-16T13:50:23.423382+0000 mgr.x (mgr.34562) 564 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T13:50:25.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:50:24 smithi132 bash[27079]: cephadm 2020-07-16T13:50:23.424553+0000 mgr.x (mgr.34562) 565 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T13:50:25.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:50:24 smithi132 bash[27079]: cephadm 2020-07-16T13:50:23.425657+0000 mgr.x (mgr.34562) 566 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T13:50:25.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:50:24 smithi132 bash[27079]: cephadm 2020-07-16T13:50:23.425844+0000 mgr.x (mgr.34562) 567 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T13:50:25.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:50:24 smithi132 bash[27079]: cluster 2020-07-16T13:50:23.652658+0000 mgr.x (mgr.34562) 568 : cluster [DBG] pgmap v352: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:50:25.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:50:24 smithi188 bash[23329]: audit 2020-07-16T13:50:23.420564+0000 mgr.x (mgr.34562) 561 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:50:25.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:50:24 smithi188 bash[23329]: audit 2020-07-16T13:50:23.421749+0000 mgr.x (mgr.34562) 562 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:50:25.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:50:24 smithi188 bash[23329]: audit 2020-07-16T13:50:23.422747+0000 mgr.x (mgr.34562) 563 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:50:25.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:50:24 smithi188 bash[23329]: cephadm 2020-07-16T13:50:23.423382+0000 mgr.x (mgr.34562) 564 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T13:50:25.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:50:24 smithi188 bash[23329]: cephadm 2020-07-16T13:50:23.424553+0000 mgr.x (mgr.34562) 565 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T13:50:25.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:50:24 smithi188 bash[23329]: cephadm 2020-07-16T13:50:23.425657+0000 mgr.x (mgr.34562) 566 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T13:50:25.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:50:24 smithi188 bash[23329]: cephadm 2020-07-16T13:50:23.425844+0000 mgr.x (mgr.34562) 567 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T13:50:25.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:50:24 smithi188 bash[23329]: cluster 2020-07-16T13:50:23.652658+0000 mgr.x (mgr.34562) 568 : cluster [DBG] pgmap v352: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:50:27.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:50:26 smithi132 bash[27079]: cluster 2020-07-16T13:50:25.653099+0000 mgr.x (mgr.34562) 569 : cluster [DBG] pgmap v353: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:50:27.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:50:26 smithi132 bash[27079]: audit 2020-07-16T13:50:26.354434+0000 mon.b (mon.2) 264 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:50:27.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:50:26 smithi188 bash[23329]: cluster 2020-07-16T13:50:25.653099+0000 mgr.x (mgr.34562) 569 : cluster [DBG] pgmap v353: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:50:27.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:50:26 smithi188 bash[23329]: audit 2020-07-16T13:50:26.354434+0000 mon.b (mon.2) 264 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:50:28.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:50:27 smithi132 bash[27079]: cephadm 2020-07-16T13:50:26.355035+0000 mgr.x (mgr.34562) 570 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:50:28.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:50:27 smithi132 bash[27079]: cephadm 2020-07-16T13:50:26.355391+0000 mgr.x (mgr.34562) 571 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:50:28.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:50:27 smithi188 bash[23329]: cephadm 2020-07-16T13:50:26.355035+0000 mgr.x (mgr.34562) 570 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:50:28.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:50:27 smithi188 bash[23329]: cephadm 2020-07-16T13:50:26.355391+0000 mgr.x (mgr.34562) 571 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:50:29.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:50:28 smithi132 bash[27079]: cluster 2020-07-16T13:50:27.653460+0000 mgr.x (mgr.34562) 572 : cluster [DBG] pgmap v354: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:50:29.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:50:28 smithi188 bash[23329]: cluster 2020-07-16T13:50:27.653460+0000 mgr.x (mgr.34562) 572 : cluster [DBG] pgmap v354: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:50:30.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:50:30 smithi188 bash[23329]: cluster 2020-07-16T13:50:29.653934+0000 mgr.x (mgr.34562) 573 : cluster [DBG] pgmap v355: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:50:30.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:50:30 smithi132 bash[27079]: cluster 2020-07-16T13:50:29.653934+0000 mgr.x (mgr.34562) 573 : cluster [DBG] pgmap v355: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:50:33.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:50:32 smithi132 bash[27079]: cluster 2020-07-16T13:50:31.654419+0000 mgr.x (mgr.34562) 574 : cluster [DBG] pgmap v356: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:50:33.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:50:32 smithi188 bash[23329]: cluster 2020-07-16T13:50:31.654419+0000 mgr.x (mgr.34562) 574 : cluster [DBG] pgmap v356: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:50:35.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:50:34 smithi132 bash[27079]: cluster 2020-07-16T13:50:33.654905+0000 mgr.x (mgr.34562) 575 : cluster [DBG] pgmap v357: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:50:35.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:50:34 smithi188 bash[23329]: cluster 2020-07-16T13:50:33.654905+0000 mgr.x (mgr.34562) 575 : cluster [DBG] pgmap v357: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:50:36.385 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T13:50:36.638 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T13:50:36.639 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (13m) 76s ago 16m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T13:50:36.639 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (16m) 76s ago 16m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T13:50:36.639 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (13m) 76s ago 19m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T13:50:36.639 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (13m) 76s ago 20m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T13:50:36.640 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 76s ago 21m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T13:50:36.640 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (19m) 76s ago 19m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T13:50:36.640 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (19m) 76s ago 19m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T13:50:36.640 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (16m) 76s ago 16m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T13:50:36.640 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (16m) 76s ago 16m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T13:50:36.641 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (18m) 76s ago 18m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T13:50:36.641 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (18m) 76s ago 18m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T13:50:36.641 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (18m) 76s ago 18m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T13:50:36.641 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (18m) 76s ago 18m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T13:50:36.641 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (17m) 76s ago 17m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T13:50:36.642 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (17m) 76s ago 17m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T13:50:36.642 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (17m) 76s ago 17m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T13:50:36.642 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (16m) 76s ago 16m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T13:50:36.642 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (15m) 76s ago 16m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T13:50:36.937 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T13:50:36.937 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T13:50:36.938 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T13:50:36.938 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T13:50:36.938 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:50:36.938 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T13:50:36.939 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T13:50:36.939 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:50:36.939 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T13:50:36.939 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T13:50:36.939 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:50:36.940 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T13:50:36.940 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T13:50:36.940 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T13:50:36.940 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T13:50:36.940 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T13:50:36.941 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T13:50:37.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:50:36 smithi132 bash[27079]: cluster 2020-07-16T13:50:35.655466+0000 mgr.x (mgr.34562) 576 : cluster [DBG] pgmap v358: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:50:37.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:50:36 smithi188 bash[23329]: cluster 2020-07-16T13:50:35.655466+0000 mgr.x (mgr.34562) 576 : cluster [DBG] pgmap v358: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:50:38.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:50:37 smithi132 bash[27079]: audit 2020-07-16T13:50:36.366123+0000 mgr.x (mgr.34562) 577 : audit [DBG] from='client.25054 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:50:38.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:50:37 smithi132 bash[27079]: audit 2020-07-16T13:50:36.634484+0000 mgr.x (mgr.34562) 578 : audit [DBG] from='client.25060 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:50:38.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:50:37 smithi132 bash[27079]: audit 2020-07-16T13:50:36.936516+0000 mon.c (mon.1) 93 : audit [DBG] from='client.? 172.21.15.132:0/1459703599' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:50:38.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:50:37 smithi188 bash[23329]: audit 2020-07-16T13:50:36.366123+0000 mgr.x (mgr.34562) 577 : audit [DBG] from='client.25054 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:50:38.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:50:37 smithi188 bash[23329]: audit 2020-07-16T13:50:36.634484+0000 mgr.x (mgr.34562) 578 : audit [DBG] from='client.25060 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:50:38.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:50:37 smithi188 bash[23329]: audit 2020-07-16T13:50:36.936516+0000 mon.c (mon.1) 93 : audit [DBG] from='client.? 172.21.15.132:0/1459703599' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:50:39.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:50:38 smithi132 bash[27079]: cluster 2020-07-16T13:50:37.655877+0000 mgr.x (mgr.34562) 579 : cluster [DBG] pgmap v359: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:50:39.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:50:38 smithi188 bash[23329]: cluster 2020-07-16T13:50:37.655877+0000 mgr.x (mgr.34562) 579 : cluster [DBG] pgmap v359: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:50:40.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:50:40 smithi188 bash[23329]: cluster 2020-07-16T13:50:39.656321+0000 mgr.x (mgr.34562) 580 : cluster [DBG] pgmap v360: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:50:40.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:50:40 smithi132 bash[27079]: cluster 2020-07-16T13:50:39.656321+0000 mgr.x (mgr.34562) 580 : cluster [DBG] pgmap v360: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:50:41.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:50:41 smithi132 bash[27079]: audit 2020-07-16T13:50:41.370945+0000 mon.b (mon.2) 265 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:50:41.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:50:41 smithi188 bash[23329]: audit 2020-07-16T13:50:41.370945+0000 mon.b (mon.2) 265 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:50:42.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:50:42 smithi132 bash[27079]: cephadm 2020-07-16T13:50:41.371667+0000 mgr.x (mgr.34562) 581 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:50:42.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:50:42 smithi132 bash[27079]: cephadm 2020-07-16T13:50:41.372070+0000 mgr.x (mgr.34562) 582 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:50:42.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:50:42 smithi132 bash[27079]: cluster 2020-07-16T13:50:41.656711+0000 mgr.x (mgr.34562) 583 : cluster [DBG] pgmap v361: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:50:42.925 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:50:42 smithi188 bash[23329]: cephadm 2020-07-16T13:50:41.371667+0000 mgr.x (mgr.34562) 581 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:50:42.925 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:50:42 smithi188 bash[23329]: cephadm 2020-07-16T13:50:41.372070+0000 mgr.x (mgr.34562) 582 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:50:42.925 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:50:42 smithi188 bash[23329]: cluster 2020-07-16T13:50:41.656711+0000 mgr.x (mgr.34562) 583 : cluster [DBG] pgmap v361: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:50:45.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:50:44 smithi132 bash[27079]: cluster 2020-07-16T13:50:43.657209+0000 mgr.x (mgr.34562) 584 : cluster [DBG] pgmap v362: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:50:45.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:50:44 smithi188 bash[23329]: cluster 2020-07-16T13:50:43.657209+0000 mgr.x (mgr.34562) 584 : cluster [DBG] pgmap v362: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:50:47.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:50:46 smithi132 bash[27079]: cluster 2020-07-16T13:50:45.657553+0000 mgr.x (mgr.34562) 585 : cluster [DBG] pgmap v363: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:50:47.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:50:46 smithi188 bash[23329]: cluster 2020-07-16T13:50:45.657553+0000 mgr.x (mgr.34562) 585 : cluster [DBG] pgmap v363: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:50:49.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:50:48 smithi132 bash[27079]: cluster 2020-07-16T13:50:47.658053+0000 mgr.x (mgr.34562) 586 : cluster [DBG] pgmap v364: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:50:49.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:50:48 smithi188 bash[23329]: cluster 2020-07-16T13:50:47.658053+0000 mgr.x (mgr.34562) 586 : cluster [DBG] pgmap v364: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:50:50.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:50:50 smithi188 bash[23329]: cluster 2020-07-16T13:50:49.658483+0000 mgr.x (mgr.34562) 587 : cluster [DBG] pgmap v365: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:50:50.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:50:50 smithi132 bash[27079]: cluster 2020-07-16T13:50:49.658483+0000 mgr.x (mgr.34562) 587 : cluster [DBG] pgmap v365: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:50:53.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:50:52 smithi132 bash[27079]: cluster 2020-07-16T13:50:51.659006+0000 mgr.x (mgr.34562) 588 : cluster [DBG] pgmap v366: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:50:53.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:50:52 smithi188 bash[23329]: cluster 2020-07-16T13:50:51.659006+0000 mgr.x (mgr.34562) 588 : cluster [DBG] pgmap v366: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:50:55.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:50:54 smithi132 bash[27079]: cluster 2020-07-16T13:50:53.659533+0000 mgr.x (mgr.34562) 589 : cluster [DBG] pgmap v367: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:50:55.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:50:54 smithi188 bash[23329]: cluster 2020-07-16T13:50:53.659533+0000 mgr.x (mgr.34562) 589 : cluster [DBG] pgmap v367: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:50:57.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:50:56 smithi132 bash[27079]: cluster 2020-07-16T13:50:55.659975+0000 mgr.x (mgr.34562) 590 : cluster [DBG] pgmap v368: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:50:57.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:50:56 smithi132 bash[27079]: audit 2020-07-16T13:50:56.377837+0000 mon.b (mon.2) 266 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:50:57.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:50:56 smithi188 bash[23329]: cluster 2020-07-16T13:50:55.659975+0000 mgr.x (mgr.34562) 590 : cluster [DBG] pgmap v368: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:50:57.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:50:56 smithi188 bash[23329]: audit 2020-07-16T13:50:56.377837+0000 mon.b (mon.2) 266 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:50:58.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:50:57 smithi132 bash[27079]: cephadm 2020-07-16T13:50:56.378500+0000 mgr.x (mgr.34562) 591 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:50:58.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:50:57 smithi132 bash[27079]: cephadm 2020-07-16T13:50:56.378566+0000 mgr.x (mgr.34562) 592 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:50:58.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:50:57 smithi188 bash[23329]: cephadm 2020-07-16T13:50:56.378500+0000 mgr.x (mgr.34562) 591 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:50:58.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:50:57 smithi188 bash[23329]: cephadm 2020-07-16T13:50:56.378566+0000 mgr.x (mgr.34562) 592 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:50:59.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:50:58 smithi132 bash[27079]: cluster 2020-07-16T13:50:57.660455+0000 mgr.x (mgr.34562) 593 : cluster [DBG] pgmap v369: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:50:59.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:50:58 smithi188 bash[23329]: cluster 2020-07-16T13:50:57.660455+0000 mgr.x (mgr.34562) 593 : cluster [DBG] pgmap v369: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:51:00.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:51:00 smithi188 bash[23329]: cluster 2020-07-16T13:50:59.660882+0000 mgr.x (mgr.34562) 594 : cluster [DBG] pgmap v370: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:51:00.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:51:00 smithi132 bash[27079]: cluster 2020-07-16T13:50:59.660882+0000 mgr.x (mgr.34562) 594 : cluster [DBG] pgmap v370: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:51:03.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:51:02 smithi132 bash[27079]: cluster 2020-07-16T13:51:01.661278+0000 mgr.x (mgr.34562) 595 : cluster [DBG] pgmap v371: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:51:03.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:51:02 smithi188 bash[23329]: cluster 2020-07-16T13:51:01.661278+0000 mgr.x (mgr.34562) 595 : cluster [DBG] pgmap v371: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:51:05.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:51:04 smithi132 bash[27079]: cluster 2020-07-16T13:51:03.661747+0000 mgr.x (mgr.34562) 596 : cluster [DBG] pgmap v372: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:51:05.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:51:04 smithi188 bash[23329]: cluster 2020-07-16T13:51:03.661747+0000 mgr.x (mgr.34562) 596 : cluster [DBG] pgmap v372: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:51:07.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:51:06 smithi132 bash[27079]: cluster 2020-07-16T13:51:05.662228+0000 mgr.x (mgr.34562) 597 : cluster [DBG] pgmap v373: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:51:07.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:51:06 smithi188 bash[23329]: cluster 2020-07-16T13:51:05.662228+0000 mgr.x (mgr.34562) 597 : cluster [DBG] pgmap v373: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:51:07.237 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T13:51:07.497 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T13:51:07.497 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (13m) 107s ago 16m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T13:51:07.498 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (16m) 107s ago 16m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T13:51:07.498 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (14m) 107s ago 19m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T13:51:07.498 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (13m) 107s ago 21m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T13:51:07.498 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 107s ago 21m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T13:51:07.498 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (19m) 107s ago 19m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T13:51:07.499 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (20m) 107s ago 20m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T13:51:07.499 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (17m) 107s ago 17m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T13:51:07.499 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (17m) 107s ago 17m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T13:51:07.499 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (19m) 107s ago 19m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T13:51:07.499 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (19m) 107s ago 19m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T13:51:07.500 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (18m) 107s ago 18m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T13:51:07.500 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (18m) 107s ago 18m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T13:51:07.500 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (18m) 107s ago 18m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T13:51:07.500 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (18m) 107s ago 18m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T13:51:07.500 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (17m) 107s ago 17m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T13:51:07.501 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (17m) 107s ago 17m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T13:51:07.501 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (16m) 107s ago 17m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T13:51:07.793 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T13:51:07.794 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T13:51:07.794 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T13:51:07.794 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T13:51:07.794 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:51:07.795 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T13:51:07.795 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T13:51:07.795 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:51:07.795 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T13:51:07.795 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T13:51:07.796 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:51:07.796 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T13:51:07.796 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T13:51:07.796 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T13:51:07.796 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T13:51:07.796 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T13:51:07.797 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T13:51:09.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:51:08 smithi132 bash[27079]: audit 2020-07-16T13:51:07.225016+0000 mgr.x (mgr.34562) 598 : audit [DBG] from='client.25072 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:51:09.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:51:08 smithi132 bash[27079]: audit 2020-07-16T13:51:07.492947+0000 mgr.x (mgr.34562) 599 : audit [DBG] from='client.25078 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:51:09.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:51:08 smithi132 bash[27079]: cluster 2020-07-16T13:51:07.662614+0000 mgr.x (mgr.34562) 600 : cluster [DBG] pgmap v374: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:51:09.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:51:08 smithi132 bash[27079]: audit 2020-07-16T13:51:07.792781+0000 mon.c (mon.1) 94 : audit [DBG] from='client.? 172.21.15.132:0/3207678359' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:51:09.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:51:08 smithi188 bash[23329]: audit 2020-07-16T13:51:07.225016+0000 mgr.x (mgr.34562) 598 : audit [DBG] from='client.25072 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:51:09.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:51:08 smithi188 bash[23329]: audit 2020-07-16T13:51:07.492947+0000 mgr.x (mgr.34562) 599 : audit [DBG] from='client.25078 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:51:09.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:51:08 smithi188 bash[23329]: cluster 2020-07-16T13:51:07.662614+0000 mgr.x (mgr.34562) 600 : cluster [DBG] pgmap v374: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:51:09.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:51:08 smithi188 bash[23329]: audit 2020-07-16T13:51:07.792781+0000 mon.c (mon.1) 94 : audit [DBG] from='client.? 172.21.15.132:0/3207678359' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:51:10.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:51:10 smithi188 bash[23329]: cluster 2020-07-16T13:51:09.663071+0000 mgr.x (mgr.34562) 601 : cluster [DBG] pgmap v375: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:51:10.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:51:10 smithi132 bash[27079]: cluster 2020-07-16T13:51:09.663071+0000 mgr.x (mgr.34562) 601 : cluster [DBG] pgmap v375: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:51:11.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:51:11 smithi132 bash[27079]: audit 2020-07-16T13:51:11.393979+0000 mon.b (mon.2) 267 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:51:11.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:51:11 smithi188 bash[23329]: audit 2020-07-16T13:51:11.393979+0000 mon.b (mon.2) 267 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:51:12.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:51:12 smithi132 bash[27079]: cephadm 2020-07-16T13:51:11.394756+0000 mgr.x (mgr.34562) 602 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:51:12.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:51:12 smithi132 bash[27079]: cephadm 2020-07-16T13:51:11.395174+0000 mgr.x (mgr.34562) 603 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:51:12.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:51:12 smithi132 bash[27079]: cluster 2020-07-16T13:51:11.663513+0000 mgr.x (mgr.34562) 604 : cluster [DBG] pgmap v376: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:51:12.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:51:12 smithi188 bash[23329]: cephadm 2020-07-16T13:51:11.394756+0000 mgr.x (mgr.34562) 602 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:51:12.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:51:12 smithi188 bash[23329]: cephadm 2020-07-16T13:51:11.395174+0000 mgr.x (mgr.34562) 603 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:51:12.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:51:12 smithi188 bash[23329]: cluster 2020-07-16T13:51:11.663513+0000 mgr.x (mgr.34562) 604 : cluster [DBG] pgmap v376: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:51:15.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:51:14 smithi132 bash[27079]: cluster 2020-07-16T13:51:13.663912+0000 mgr.x (mgr.34562) 605 : cluster [DBG] pgmap v377: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:51:15.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:51:14 smithi188 bash[23329]: cluster 2020-07-16T13:51:13.663912+0000 mgr.x (mgr.34562) 605 : cluster [DBG] pgmap v377: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:51:17.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:51:16 smithi132 bash[27079]: cluster 2020-07-16T13:51:15.664423+0000 mgr.x (mgr.34562) 606 : cluster [DBG] pgmap v378: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:51:17.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:51:16 smithi188 bash[23329]: cluster 2020-07-16T13:51:15.664423+0000 mgr.x (mgr.34562) 606 : cluster [DBG] pgmap v378: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:51:19.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:51:18 smithi132 bash[27079]: cluster 2020-07-16T13:51:17.664972+0000 mgr.x (mgr.34562) 607 : cluster [DBG] pgmap v379: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:51:19.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:51:18 smithi188 bash[23329]: cluster 2020-07-16T13:51:17.664972+0000 mgr.x (mgr.34562) 607 : cluster [DBG] pgmap v379: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:51:20.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:51:20 smithi188 bash[23329]: cluster 2020-07-16T13:51:19.665506+0000 mgr.x (mgr.34562) 608 : cluster [DBG] pgmap v380: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:51:20.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:51:20 smithi132 bash[27079]: cluster 2020-07-16T13:51:19.665506+0000 mgr.x (mgr.34562) 608 : cluster [DBG] pgmap v380: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:51:23.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:51:22 smithi132 bash[27079]: cluster 2020-07-16T13:51:21.665908+0000 mgr.x (mgr.34562) 609 : cluster [DBG] pgmap v381: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:51:23.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:51:22 smithi188 bash[23329]: cluster 2020-07-16T13:51:21.665908+0000 mgr.x (mgr.34562) 609 : cluster [DBG] pgmap v381: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:51:25.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:51:24 smithi132 bash[27079]: cluster 2020-07-16T13:51:23.666421+0000 mgr.x (mgr.34562) 610 : cluster [DBG] pgmap v382: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:51:25.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:51:24 smithi188 bash[23329]: cluster 2020-07-16T13:51:23.666421+0000 mgr.x (mgr.34562) 610 : cluster [DBG] pgmap v382: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:51:27.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:51:26 smithi132 bash[27079]: cluster 2020-07-16T13:51:25.666760+0000 mgr.x (mgr.34562) 611 : cluster [DBG] pgmap v383: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:51:27.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:51:26 smithi132 bash[27079]: audit 2020-07-16T13:51:26.639671+0000 mon.b (mon.2) 268 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T13:49:20.025754\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.025813\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.025850\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.025880\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.026050\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.026158\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.026267\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.026381\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.026415\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T13:49:20.026493\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:51:26.638503\"}"}]: dispatch 2020-07-16T13:51:27.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:51:26 smithi132 bash[27079]: audit 2020-07-16T13:51:26.640495+0000 mon.c (mon.1) 95 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T13:49:20.025754\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.025813\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.025850\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.025880\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.026050\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.026158\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.026267\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.026381\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.026415\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T13:49:20.026493\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:51:26.638503\"}"}]: dispatch 2020-07-16T13:51:27.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:51:26 smithi132 bash[27079]: audit 2020-07-16T13:51:26.643102+0000 mon.c (mon.1) 96 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T13:49:20.025754\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.025813\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.025850\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.025880\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.026050\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.026158\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.026267\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.026381\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.026415\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T13:49:20.026493\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:51:26.638503\"}"}]': finished 2020-07-16T13:51:27.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:51:26 smithi132 bash[27079]: audit 2020-07-16T13:51:26.647340+0000 mon.b (mon.2) 269 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.448858\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.448928\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.448959\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449118\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449221\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449349\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449454\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449488\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449517\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:49:20.449606\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:51:26.646579\"}"}]: dispatch 2020-07-16T13:51:27.033 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:51:26 smithi132 bash[27079]: audit 2020-07-16T13:51:26.647867+0000 mon.c (mon.1) 97 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.448858\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.448928\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.448959\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449118\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449221\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449349\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449454\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449488\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449517\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:49:20.449606\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:51:26.646579\"}"}]: dispatch 2020-07-16T13:51:27.033 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:51:26 smithi132 bash[27079]: audit 2020-07-16T13:51:26.649880+0000 mon.c (mon.1) 98 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.448858\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.448928\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.448959\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449118\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449221\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449349\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449454\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449488\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449517\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:49:20.449606\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:51:26.646579\"}"}]': finished 2020-07-16T13:51:27.034 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:51:26 smithi132 bash[27079]: audit 2020-07-16T13:51:26.652696+0000 mon.b (mon.2) 270 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:51:27.034 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:51:26 smithi132 bash[27079]: audit 2020-07-16T13:51:26.653664+0000 mon.b (mon.2) 271 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:51:27.035 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:51:26 smithi132 bash[27079]: audit 2020-07-16T13:51:26.654530+0000 mon.b (mon.2) 272 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:51:27.035 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:51:26 smithi132 bash[27079]: audit 2020-07-16T13:51:26.655548+0000 mon.b (mon.2) 273 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T13:51:27.035 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:51:26 smithi132 bash[27079]: audit 2020-07-16T13:51:26.656475+0000 mon.b (mon.2) 274 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:51:27.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:51:26 smithi188 bash[23329]: cluster 2020-07-16T13:51:25.666760+0000 mgr.x (mgr.34562) 611 : cluster [DBG] pgmap v383: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:51:27.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:51:26 smithi188 bash[23329]: audit 2020-07-16T13:51:26.639671+0000 mon.b (mon.2) 268 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T13:49:20.025754\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.025813\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.025850\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.025880\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.026050\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.026158\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.026267\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.026381\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.026415\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T13:49:20.026493\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:51:26.638503\"}"}]: dispatch 2020-07-16T13:51:27.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:51:26 smithi188 bash[23329]: audit 2020-07-16T13:51:26.640495+0000 mon.c (mon.1) 95 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T13:49:20.025754\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.025813\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.025850\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.025880\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.026050\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.026158\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.026267\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.026381\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.026415\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T13:49:20.026493\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:51:26.638503\"}"}]: dispatch 2020-07-16T13:51:27.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:51:26 smithi188 bash[23329]: audit 2020-07-16T13:51:26.643102+0000 mon.c (mon.1) 96 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T13:49:20.025754\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.025813\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.025850\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.025880\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.026050\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.026158\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.026267\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.026381\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.026415\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T13:49:20.026493\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:51:26.638503\"}"}]': finished 2020-07-16T13:51:27.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:51:26 smithi188 bash[23329]: audit 2020-07-16T13:51:26.647340+0000 mon.b (mon.2) 269 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.448858\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.448928\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.448959\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449118\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449221\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449349\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449454\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449488\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449517\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:49:20.449606\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:51:26.646579\"}"}]: dispatch 2020-07-16T13:51:27.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:51:26 smithi188 bash[23329]: audit 2020-07-16T13:51:26.647867+0000 mon.c (mon.1) 97 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.448858\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.448928\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.448959\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449118\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449221\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449349\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449454\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449488\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449517\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:49:20.449606\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:51:26.646579\"}"}]: dispatch 2020-07-16T13:51:27.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:51:26 smithi188 bash[23329]: audit 2020-07-16T13:51:26.649880+0000 mon.c (mon.1) 98 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.448858\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.448928\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.448959\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449118\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449221\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449349\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449454\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449488\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:49:20.449517\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:49:20.449606\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:51:26.646579\"}"}]': finished 2020-07-16T13:51:27.175 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:51:26 smithi188 bash[23329]: audit 2020-07-16T13:51:26.652696+0000 mon.b (mon.2) 270 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:51:27.175 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:51:26 smithi188 bash[23329]: audit 2020-07-16T13:51:26.653664+0000 mon.b (mon.2) 271 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:51:27.175 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:51:26 smithi188 bash[23329]: audit 2020-07-16T13:51:26.654530+0000 mon.b (mon.2) 272 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:51:27.175 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:51:26 smithi188 bash[23329]: audit 2020-07-16T13:51:26.655548+0000 mon.b (mon.2) 273 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T13:51:27.176 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:51:26 smithi188 bash[23329]: audit 2020-07-16T13:51:26.656475+0000 mon.b (mon.2) 274 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:51:27.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:51:27 smithi132 bash[27079]: audit 2020-07-16T13:51:26.652981+0000 mgr.x (mgr.34562) 612 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:51:27.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:51:27 smithi132 bash[27079]: audit 2020-07-16T13:51:26.653920+0000 mgr.x (mgr.34562) 613 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:51:27.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:51:27 smithi132 bash[27079]: audit 2020-07-16T13:51:26.654760+0000 mgr.x (mgr.34562) 614 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:51:27.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:51:27 smithi132 bash[27079]: cephadm 2020-07-16T13:51:26.655247+0000 mgr.x (mgr.34562) 615 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T13:51:27.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:51:27 smithi132 bash[27079]: cephadm 2020-07-16T13:51:26.656139+0000 mgr.x (mgr.34562) 616 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T13:51:27.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:51:27 smithi132 bash[27079]: cephadm 2020-07-16T13:51:26.656969+0000 mgr.x (mgr.34562) 617 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T13:51:27.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:51:27 smithi132 bash[27079]: cephadm 2020-07-16T13:51:26.657082+0000 mgr.x (mgr.34562) 618 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T13:51:28.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:51:27 smithi188 bash[23329]: audit 2020-07-16T13:51:26.652981+0000 mgr.x (mgr.34562) 612 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:51:28.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:51:27 smithi188 bash[23329]: audit 2020-07-16T13:51:26.653920+0000 mgr.x (mgr.34562) 613 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:51:28.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:51:27 smithi188 bash[23329]: audit 2020-07-16T13:51:26.654760+0000 mgr.x (mgr.34562) 614 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:51:28.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:51:27 smithi188 bash[23329]: cephadm 2020-07-16T13:51:26.655247+0000 mgr.x (mgr.34562) 615 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T13:51:28.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:51:27 smithi188 bash[23329]: cephadm 2020-07-16T13:51:26.656139+0000 mgr.x (mgr.34562) 616 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T13:51:28.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:51:27 smithi188 bash[23329]: cephadm 2020-07-16T13:51:26.656969+0000 mgr.x (mgr.34562) 617 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T13:51:28.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:51:27 smithi188 bash[23329]: cephadm 2020-07-16T13:51:26.657082+0000 mgr.x (mgr.34562) 618 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T13:51:28.992 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:51:28 smithi132 bash[27079]: cluster 2020-07-16T13:51:27.667135+0000 mgr.x (mgr.34562) 619 : cluster [DBG] pgmap v384: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:51:29.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:51:28 smithi188 bash[23329]: cluster 2020-07-16T13:51:27.667135+0000 mgr.x (mgr.34562) 619 : cluster [DBG] pgmap v384: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:51:30.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:51:30 smithi188 bash[23329]: audit 2020-07-16T13:51:29.582667+0000 mon.b (mon.2) 275 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:51:30.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:51:30 smithi188 bash[23329]: cephadm 2020-07-16T13:51:29.583391+0000 mgr.x (mgr.34562) 620 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:51:30.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:51:30 smithi188 bash[23329]: cephadm 2020-07-16T13:51:29.583630+0000 mgr.x (mgr.34562) 621 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:51:30.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:51:30 smithi188 bash[23329]: cluster 2020-07-16T13:51:29.667631+0000 mgr.x (mgr.34562) 622 : cluster [DBG] pgmap v385: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:51:30.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:51:30 smithi132 bash[27079]: audit 2020-07-16T13:51:29.582667+0000 mon.b (mon.2) 275 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:51:30.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:51:30 smithi132 bash[27079]: cephadm 2020-07-16T13:51:29.583391+0000 mgr.x (mgr.34562) 620 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:51:30.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:51:30 smithi132 bash[27079]: cephadm 2020-07-16T13:51:29.583630+0000 mgr.x (mgr.34562) 621 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:51:30.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:51:30 smithi132 bash[27079]: cluster 2020-07-16T13:51:29.667631+0000 mgr.x (mgr.34562) 622 : cluster [DBG] pgmap v385: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:51:33.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:51:32 smithi132 bash[27079]: cluster 2020-07-16T13:51:31.668007+0000 mgr.x (mgr.34562) 623 : cluster [DBG] pgmap v386: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:51:33.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:51:32 smithi188 bash[23329]: cluster 2020-07-16T13:51:31.668007+0000 mgr.x (mgr.34562) 623 : cluster [DBG] pgmap v386: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:51:35.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:51:34 smithi132 bash[27079]: cluster 2020-07-16T13:51:33.668510+0000 mgr.x (mgr.34562) 624 : cluster [DBG] pgmap v387: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:51:35.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:51:34 smithi188 bash[23329]: cluster 2020-07-16T13:51:33.668510+0000 mgr.x (mgr.34562) 624 : cluster [DBG] pgmap v387: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:51:37.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:51:36 smithi132 bash[27079]: cluster 2020-07-16T13:51:35.668918+0000 mgr.x (mgr.34562) 625 : cluster [DBG] pgmap v388: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:51:37.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:51:36 smithi188 bash[23329]: cluster 2020-07-16T13:51:35.668918+0000 mgr.x (mgr.34562) 625 : cluster [DBG] pgmap v388: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:51:38.092 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T13:51:38.353 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T13:51:38.353 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (14m) 2m ago 17m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T13:51:38.354 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (17m) 2m ago 17m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T13:51:38.354 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (14m) 2m ago 20m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T13:51:38.354 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (14m) 2m ago 21m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T13:51:38.354 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 2m ago 22m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T13:51:38.355 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (20m) 2m ago 20m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T13:51:38.355 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (20m) 2m ago 20m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T13:51:38.355 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (17m) 2m ago 17m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T13:51:38.355 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (17m) 2m ago 17m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T13:51:38.355 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (19m) 2m ago 20m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T13:51:38.356 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (19m) 2m ago 19m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T13:51:38.356 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (19m) 2m ago 19m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T13:51:38.356 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (19m) 2m ago 19m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T13:51:38.356 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (18m) 2m ago 18m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T13:51:38.356 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (18m) 2m ago 18m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T13:51:38.357 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (18m) 2m ago 18m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T13:51:38.357 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (17m) 2m ago 18m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T13:51:38.357 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (16m) 2m ago 17m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T13:51:38.647 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T13:51:38.648 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T13:51:38.648 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T13:51:38.648 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T13:51:38.648 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:51:38.649 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T13:51:38.649 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T13:51:38.649 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:51:38.649 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T13:51:38.649 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T13:51:38.650 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:51:38.650 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T13:51:38.650 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T13:51:38.650 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T13:51:38.650 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T13:51:38.651 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T13:51:38.651 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T13:51:39.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:51:38 smithi132 bash[27079]: cluster 2020-07-16T13:51:37.669341+0000 mgr.x (mgr.34562) 626 : cluster [DBG] pgmap v389: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:51:39.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:51:38 smithi132 bash[27079]: audit 2020-07-16T13:51:38.646843+0000 mon.c (mon.1) 99 : audit [DBG] from='client.? 172.21.15.132:0/3577845830' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:51:39.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:51:38 smithi188 bash[23329]: cluster 2020-07-16T13:51:37.669341+0000 mgr.x (mgr.34562) 626 : cluster [DBG] pgmap v389: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:51:39.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:51:38 smithi188 bash[23329]: audit 2020-07-16T13:51:38.646843+0000 mon.c (mon.1) 99 : audit [DBG] from='client.? 172.21.15.132:0/3577845830' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:51:40.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:51:39 smithi132 bash[27079]: audit 2020-07-16T13:51:38.080818+0000 mgr.x (mgr.34562) 627 : audit [DBG] from='client.25090 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:51:40.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:51:39 smithi132 bash[27079]: audit 2020-07-16T13:51:38.348464+0000 mgr.x (mgr.34562) 628 : audit [DBG] from='client.25096 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:51:40.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:51:39 smithi188 bash[23329]: audit 2020-07-16T13:51:38.080818+0000 mgr.x (mgr.34562) 627 : audit [DBG] from='client.25090 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:51:40.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:51:39 smithi188 bash[23329]: audit 2020-07-16T13:51:38.348464+0000 mgr.x (mgr.34562) 628 : audit [DBG] from='client.25096 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:51:41.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:51:40 smithi132 bash[27079]: cluster 2020-07-16T13:51:39.669834+0000 mgr.x (mgr.34562) 629 : cluster [DBG] pgmap v390: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:51:41.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:51:40 smithi188 bash[23329]: cluster 2020-07-16T13:51:39.669834+0000 mgr.x (mgr.34562) 629 : cluster [DBG] pgmap v390: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:51:43.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:51:42 smithi132 bash[27079]: cluster 2020-07-16T13:51:41.670436+0000 mgr.x (mgr.34562) 630 : cluster [DBG] pgmap v391: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:51:43.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:51:42 smithi188 bash[23329]: cluster 2020-07-16T13:51:41.670436+0000 mgr.x (mgr.34562) 630 : cluster [DBG] pgmap v391: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:51:45.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:51:44 smithi132 bash[27079]: cluster 2020-07-16T13:51:43.670830+0000 mgr.x (mgr.34562) 631 : cluster [DBG] pgmap v392: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:51:45.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:51:44 smithi132 bash[27079]: audit 2020-07-16T13:51:44.599311+0000 mon.b (mon.2) 276 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:51:45.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:51:44 smithi188 bash[23329]: cluster 2020-07-16T13:51:43.670830+0000 mgr.x (mgr.34562) 631 : cluster [DBG] pgmap v392: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:51:45.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:51:44 smithi188 bash[23329]: audit 2020-07-16T13:51:44.599311+0000 mon.b (mon.2) 276 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:51:46.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:51:45 smithi132 bash[27079]: cephadm 2020-07-16T13:51:44.600079+0000 mgr.x (mgr.34562) 632 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:51:46.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:51:45 smithi132 bash[27079]: cephadm 2020-07-16T13:51:44.600521+0000 mgr.x (mgr.34562) 633 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:51:46.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:51:45 smithi188 bash[23329]: cephadm 2020-07-16T13:51:44.600079+0000 mgr.x (mgr.34562) 632 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:51:46.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:51:45 smithi188 bash[23329]: cephadm 2020-07-16T13:51:44.600521+0000 mgr.x (mgr.34562) 633 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:51:47.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:51:46 smithi132 bash[27079]: cluster 2020-07-16T13:51:45.671314+0000 mgr.x (mgr.34562) 634 : cluster [DBG] pgmap v393: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:51:47.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:51:46 smithi188 bash[23329]: cluster 2020-07-16T13:51:45.671314+0000 mgr.x (mgr.34562) 634 : cluster [DBG] pgmap v393: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:51:49.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:51:48 smithi132 bash[27079]: cluster 2020-07-16T13:51:47.671893+0000 mgr.x (mgr.34562) 635 : cluster [DBG] pgmap v394: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:51:49.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:51:48 smithi188 bash[23329]: cluster 2020-07-16T13:51:47.671893+0000 mgr.x (mgr.34562) 635 : cluster [DBG] pgmap v394: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:51:50.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:51:50 smithi188 bash[23329]: cluster 2020-07-16T13:51:49.672336+0000 mgr.x (mgr.34562) 636 : cluster [DBG] pgmap v395: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:51:50.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:51:50 smithi132 bash[27079]: cluster 2020-07-16T13:51:49.672336+0000 mgr.x (mgr.34562) 636 : cluster [DBG] pgmap v395: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:51:53.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:51:52 smithi132 bash[27079]: cluster 2020-07-16T13:51:51.672692+0000 mgr.x (mgr.34562) 637 : cluster [DBG] pgmap v396: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:51:53.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:51:52 smithi188 bash[23329]: cluster 2020-07-16T13:51:51.672692+0000 mgr.x (mgr.34562) 637 : cluster [DBG] pgmap v396: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:51:55.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:51:54 smithi132 bash[27079]: cluster 2020-07-16T13:51:53.673187+0000 mgr.x (mgr.34562) 638 : cluster [DBG] pgmap v397: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:51:55.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:51:54 smithi188 bash[23329]: cluster 2020-07-16T13:51:53.673187+0000 mgr.x (mgr.34562) 638 : cluster [DBG] pgmap v397: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:51:57.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:51:56 smithi132 bash[27079]: cluster 2020-07-16T13:51:55.673752+0000 mgr.x (mgr.34562) 639 : cluster [DBG] pgmap v398: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:51:57.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:51:56 smithi188 bash[23329]: cluster 2020-07-16T13:51:55.673752+0000 mgr.x (mgr.34562) 639 : cluster [DBG] pgmap v398: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:51:59.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:51:58 smithi132 bash[27079]: cluster 2020-07-16T13:51:57.674312+0000 mgr.x (mgr.34562) 640 : cluster [DBG] pgmap v399: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:51:59.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:51:58 smithi188 bash[23329]: cluster 2020-07-16T13:51:57.674312+0000 mgr.x (mgr.34562) 640 : cluster [DBG] pgmap v399: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:52:00.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:52:00 smithi188 bash[23329]: audit 2020-07-16T13:51:59.616104+0000 mon.b (mon.2) 277 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:52:00.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:52:00 smithi188 bash[23329]: cephadm 2020-07-16T13:51:59.616843+0000 mgr.x (mgr.34562) 641 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:52:00.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:52:00 smithi188 bash[23329]: cephadm 2020-07-16T13:51:59.616935+0000 mgr.x (mgr.34562) 642 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:52:00.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:52:00 smithi188 bash[23329]: cluster 2020-07-16T13:51:59.674717+0000 mgr.x (mgr.34562) 643 : cluster [DBG] pgmap v400: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:52:00.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:52:00 smithi132 bash[27079]: audit 2020-07-16T13:51:59.616104+0000 mon.b (mon.2) 277 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:52:00.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:52:00 smithi132 bash[27079]: cephadm 2020-07-16T13:51:59.616843+0000 mgr.x (mgr.34562) 641 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:52:00.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:52:00 smithi132 bash[27079]: cephadm 2020-07-16T13:51:59.616935+0000 mgr.x (mgr.34562) 642 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:52:00.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:52:00 smithi132 bash[27079]: cluster 2020-07-16T13:51:59.674717+0000 mgr.x (mgr.34562) 643 : cluster [DBG] pgmap v400: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:52:03.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:52:02 smithi132 bash[27079]: cluster 2020-07-16T13:52:01.675082+0000 mgr.x (mgr.34562) 644 : cluster [DBG] pgmap v401: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:52:03.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:52:02 smithi188 bash[23329]: cluster 2020-07-16T13:52:01.675082+0000 mgr.x (mgr.34562) 644 : cluster [DBG] pgmap v401: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:52:05.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:52:04 smithi132 bash[27079]: cluster 2020-07-16T13:52:03.675595+0000 mgr.x (mgr.34562) 645 : cluster [DBG] pgmap v402: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:52:05.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:52:04 smithi188 bash[23329]: cluster 2020-07-16T13:52:03.675595+0000 mgr.x (mgr.34562) 645 : cluster [DBG] pgmap v402: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:52:07.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:52:06 smithi132 bash[27079]: cluster 2020-07-16T13:52:05.676113+0000 mgr.x (mgr.34562) 646 : cluster [DBG] pgmap v403: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:52:07.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:52:06 smithi188 bash[23329]: cluster 2020-07-16T13:52:05.676113+0000 mgr.x (mgr.34562) 646 : cluster [DBG] pgmap v403: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:52:08.945 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T13:52:09.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:52:08 smithi132 bash[27079]: cluster 2020-07-16T13:52:07.676528+0000 mgr.x (mgr.34562) 647 : cluster [DBG] pgmap v404: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:52:09.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:52:08 smithi188 bash[23329]: cluster 2020-07-16T13:52:07.676528+0000 mgr.x (mgr.34562) 647 : cluster [DBG] pgmap v404: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:52:09.205 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T13:52:09.205 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (14m) 2m ago 17m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T13:52:09.205 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (17m) 2m ago 17m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T13:52:09.206 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (15m) 2m ago 20m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T13:52:09.206 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (14m) 2m ago 22m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T13:52:09.206 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 2m ago 22m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T13:52:09.206 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (20m) 2m ago 20m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T13:52:09.206 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (21m) 2m ago 21m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T13:52:09.207 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (18m) 2m ago 18m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T13:52:09.207 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (18m) 2m ago 18m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T13:52:09.207 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (20m) 2m ago 20m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T13:52:09.207 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (20m) 2m ago 20m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T13:52:09.207 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (19m) 2m ago 19m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T13:52:09.207 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (19m) 2m ago 19m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T13:52:09.208 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (19m) 2m ago 19m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T13:52:09.208 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (19m) 2m ago 19m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T13:52:09.208 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (18m) 2m ago 18m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T13:52:09.208 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (18m) 2m ago 18m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T13:52:09.208 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (17m) 2m ago 18m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T13:52:09.504 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T13:52:09.504 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T13:52:09.504 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T13:52:09.505 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T13:52:09.505 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:52:09.505 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T13:52:09.505 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T13:52:09.505 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:52:09.506 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T13:52:09.506 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T13:52:09.506 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:52:09.506 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T13:52:09.507 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T13:52:09.507 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T13:52:09.507 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T13:52:09.507 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T13:52:09.507 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T13:52:10.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:52:09 smithi132 bash[27079]: audit 2020-07-16T13:52:08.933129+0000 mgr.x (mgr.34562) 648 : audit [DBG] from='client.25108 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:52:10.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:52:09 smithi132 bash[27079]: audit 2020-07-16T13:52:09.503259+0000 mon.c (mon.1) 100 : audit [DBG] from='client.? 172.21.15.132:0/1289788612' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:52:10.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:52:09 smithi188 bash[23329]: audit 2020-07-16T13:52:08.933129+0000 mgr.x (mgr.34562) 648 : audit [DBG] from='client.25108 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:52:10.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:52:09 smithi188 bash[23329]: audit 2020-07-16T13:52:09.503259+0000 mon.c (mon.1) 100 : audit [DBG] from='client.? 172.21.15.132:0/1289788612' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:52:11.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:52:10 smithi132 bash[27079]: audit 2020-07-16T13:52:09.200661+0000 mgr.x (mgr.34562) 649 : audit [DBG] from='client.25114 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:52:11.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:52:10 smithi132 bash[27079]: cluster 2020-07-16T13:52:09.676942+0000 mgr.x (mgr.34562) 650 : cluster [DBG] pgmap v405: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:52:11.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:52:10 smithi188 bash[23329]: audit 2020-07-16T13:52:09.200661+0000 mgr.x (mgr.34562) 649 : audit [DBG] from='client.25114 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:52:11.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:52:10 smithi188 bash[23329]: cluster 2020-07-16T13:52:09.676942+0000 mgr.x (mgr.34562) 650 : cluster [DBG] pgmap v405: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:52:13.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:52:12 smithi132 bash[27079]: cluster 2020-07-16T13:52:11.677408+0000 mgr.x (mgr.34562) 651 : cluster [DBG] pgmap v406: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:52:13.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:52:12 smithi188 bash[23329]: cluster 2020-07-16T13:52:11.677408+0000 mgr.x (mgr.34562) 651 : cluster [DBG] pgmap v406: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:52:15.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:52:14 smithi132 bash[27079]: cluster 2020-07-16T13:52:13.677789+0000 mgr.x (mgr.34562) 652 : cluster [DBG] pgmap v407: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:52:15.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:52:14 smithi132 bash[27079]: audit 2020-07-16T13:52:14.632849+0000 mon.b (mon.2) 278 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:52:15.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:52:14 smithi188 bash[23329]: cluster 2020-07-16T13:52:13.677789+0000 mgr.x (mgr.34562) 652 : cluster [DBG] pgmap v407: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:52:15.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:52:14 smithi188 bash[23329]: audit 2020-07-16T13:52:14.632849+0000 mon.b (mon.2) 278 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:52:16.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:52:15 smithi132 bash[27079]: cephadm 2020-07-16T13:52:14.633590+0000 mgr.x (mgr.34562) 653 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:52:16.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:52:15 smithi132 bash[27079]: cephadm 2020-07-16T13:52:14.633807+0000 mgr.x (mgr.34562) 654 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:52:16.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:52:15 smithi188 bash[23329]: cephadm 2020-07-16T13:52:14.633590+0000 mgr.x (mgr.34562) 653 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:52:16.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:52:15 smithi188 bash[23329]: cephadm 2020-07-16T13:52:14.633807+0000 mgr.x (mgr.34562) 654 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:52:17.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:52:16 smithi132 bash[27079]: cluster 2020-07-16T13:52:15.678210+0000 mgr.x (mgr.34562) 655 : cluster [DBG] pgmap v408: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:52:17.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:52:16 smithi188 bash[23329]: cluster 2020-07-16T13:52:15.678210+0000 mgr.x (mgr.34562) 655 : cluster [DBG] pgmap v408: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:52:19.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:52:18 smithi132 bash[27079]: cluster 2020-07-16T13:52:17.678783+0000 mgr.x (mgr.34562) 656 : cluster [DBG] pgmap v409: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:52:19.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:52:18 smithi188 bash[23329]: cluster 2020-07-16T13:52:17.678783+0000 mgr.x (mgr.34562) 656 : cluster [DBG] pgmap v409: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:52:20.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:52:20 smithi188 bash[23329]: cluster 2020-07-16T13:52:19.679115+0000 mgr.x (mgr.34562) 657 : cluster [DBG] pgmap v410: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:52:20.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:52:20 smithi132 bash[27079]: cluster 2020-07-16T13:52:19.679115+0000 mgr.x (mgr.34562) 657 : cluster [DBG] pgmap v410: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:52:23.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:52:22 smithi132 bash[27079]: cluster 2020-07-16T13:52:21.679494+0000 mgr.x (mgr.34562) 658 : cluster [DBG] pgmap v411: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:52:23.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:52:22 smithi188 bash[23329]: cluster 2020-07-16T13:52:21.679494+0000 mgr.x (mgr.34562) 658 : cluster [DBG] pgmap v411: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:52:25.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:52:24 smithi132 bash[27079]: cluster 2020-07-16T13:52:23.679863+0000 mgr.x (mgr.34562) 659 : cluster [DBG] pgmap v412: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:52:25.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:52:24 smithi188 bash[23329]: cluster 2020-07-16T13:52:23.679863+0000 mgr.x (mgr.34562) 659 : cluster [DBG] pgmap v412: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:52:27.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:52:26 smithi132 bash[27079]: cluster 2020-07-16T13:52:25.680355+0000 mgr.x (mgr.34562) 660 : cluster [DBG] pgmap v413: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:52:27.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:52:26 smithi188 bash[23329]: cluster 2020-07-16T13:52:25.680355+0000 mgr.x (mgr.34562) 660 : cluster [DBG] pgmap v413: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:52:29.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:52:28 smithi132 bash[27079]: cluster 2020-07-16T13:52:27.680715+0000 mgr.x (mgr.34562) 661 : cluster [DBG] pgmap v414: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:52:29.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:52:28 smithi188 bash[23329]: cluster 2020-07-16T13:52:27.680715+0000 mgr.x (mgr.34562) 661 : cluster [DBG] pgmap v414: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:52:30.399 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:52:30 smithi132 bash[27079]: audit 2020-07-16T13:52:29.644360+0000 mon.b (mon.2) 279 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:52:30.400 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:52:30 smithi132 bash[27079]: audit 2020-07-16T13:52:29.644763+0000 mgr.x (mgr.34562) 662 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:52:30.400 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:52:30 smithi132 bash[27079]: audit 2020-07-16T13:52:29.645755+0000 mon.b (mon.2) 280 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:52:30.400 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:52:30 smithi132 bash[27079]: audit 2020-07-16T13:52:29.646058+0000 mgr.x (mgr.34562) 663 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:52:30.400 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:52:30 smithi132 bash[27079]: audit 2020-07-16T13:52:29.646963+0000 mon.b (mon.2) 281 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:52:30.400 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:52:30 smithi132 bash[27079]: audit 2020-07-16T13:52:29.647265+0000 mgr.x (mgr.34562) 664 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:52:30.401 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:52:30 smithi132 bash[27079]: cephadm 2020-07-16T13:52:29.647999+0000 mgr.x (mgr.34562) 665 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T13:52:30.401 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:52:30 smithi132 bash[27079]: audit 2020-07-16T13:52:29.648490+0000 mon.b (mon.2) 282 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T13:52:30.401 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:52:30 smithi132 bash[27079]: cephadm 2020-07-16T13:52:29.649365+0000 mgr.x (mgr.34562) 666 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T13:52:30.401 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:52:30 smithi132 bash[27079]: audit 2020-07-16T13:52:29.649779+0000 mon.b (mon.2) 283 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:52:30.401 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:52:30 smithi132 bash[27079]: cephadm 2020-07-16T13:52:29.650514+0000 mgr.x (mgr.34562) 667 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T13:52:30.402 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:52:30 smithi132 bash[27079]: cephadm 2020-07-16T13:52:29.650824+0000 mgr.x (mgr.34562) 668 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T13:52:30.402 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:52:30 smithi132 bash[27079]: cluster 2020-07-16T13:52:29.681029+0000 mgr.x (mgr.34562) 669 : cluster [DBG] pgmap v415: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:52:30.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:52:30 smithi188 bash[23329]: audit 2020-07-16T13:52:29.644360+0000 mon.b (mon.2) 279 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:52:30.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:52:30 smithi188 bash[23329]: audit 2020-07-16T13:52:29.644763+0000 mgr.x (mgr.34562) 662 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:52:30.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:52:30 smithi188 bash[23329]: audit 2020-07-16T13:52:29.645755+0000 mon.b (mon.2) 280 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:52:30.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:52:30 smithi188 bash[23329]: audit 2020-07-16T13:52:29.646058+0000 mgr.x (mgr.34562) 663 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:52:30.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:52:30 smithi188 bash[23329]: audit 2020-07-16T13:52:29.646963+0000 mon.b (mon.2) 281 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:52:30.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:52:30 smithi188 bash[23329]: audit 2020-07-16T13:52:29.647265+0000 mgr.x (mgr.34562) 664 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:52:30.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:52:30 smithi188 bash[23329]: cephadm 2020-07-16T13:52:29.647999+0000 mgr.x (mgr.34562) 665 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T13:52:30.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:52:30 smithi188 bash[23329]: audit 2020-07-16T13:52:29.648490+0000 mon.b (mon.2) 282 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T13:52:30.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:52:30 smithi188 bash[23329]: cephadm 2020-07-16T13:52:29.649365+0000 mgr.x (mgr.34562) 666 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T13:52:30.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:52:30 smithi188 bash[23329]: audit 2020-07-16T13:52:29.649779+0000 mon.b (mon.2) 283 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:52:30.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:52:30 smithi188 bash[23329]: cephadm 2020-07-16T13:52:29.650514+0000 mgr.x (mgr.34562) 667 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T13:52:30.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:52:30 smithi188 bash[23329]: cephadm 2020-07-16T13:52:29.650824+0000 mgr.x (mgr.34562) 668 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T13:52:30.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:52:30 smithi188 bash[23329]: cluster 2020-07-16T13:52:29.681029+0000 mgr.x (mgr.34562) 669 : cluster [DBG] pgmap v415: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:52:33.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:52:32 smithi132 bash[27079]: cluster 2020-07-16T13:52:31.681487+0000 mgr.x (mgr.34562) 670 : cluster [DBG] pgmap v416: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:52:33.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:52:32 smithi132 bash[27079]: audit 2020-07-16T13:52:32.361074+0000 mon.b (mon.2) 284 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:52:33.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:52:32 smithi188 bash[23329]: cluster 2020-07-16T13:52:31.681487+0000 mgr.x (mgr.34562) 670 : cluster [DBG] pgmap v416: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:52:33.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:52:32 smithi188 bash[23329]: audit 2020-07-16T13:52:32.361074+0000 mon.b (mon.2) 284 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:52:34.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:52:33 smithi132 bash[27079]: cephadm 2020-07-16T13:52:32.361724+0000 mgr.x (mgr.34562) 671 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:52:34.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:52:33 smithi132 bash[27079]: cephadm 2020-07-16T13:52:32.362111+0000 mgr.x (mgr.34562) 672 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:52:34.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:52:33 smithi188 bash[23329]: cephadm 2020-07-16T13:52:32.361724+0000 mgr.x (mgr.34562) 671 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:52:34.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:52:33 smithi188 bash[23329]: cephadm 2020-07-16T13:52:32.362111+0000 mgr.x (mgr.34562) 672 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:52:35.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:52:34 smithi132 bash[27079]: cluster 2020-07-16T13:52:33.681890+0000 mgr.x (mgr.34562) 673 : cluster [DBG] pgmap v417: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:52:35.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:52:34 smithi188 bash[23329]: cluster 2020-07-16T13:52:33.681890+0000 mgr.x (mgr.34562) 673 : cluster [DBG] pgmap v417: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:52:37.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:52:36 smithi132 bash[27079]: cluster 2020-07-16T13:52:35.682376+0000 mgr.x (mgr.34562) 674 : cluster [DBG] pgmap v418: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:52:37.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:52:36 smithi188 bash[23329]: cluster 2020-07-16T13:52:35.682376+0000 mgr.x (mgr.34562) 674 : cluster [DBG] pgmap v418: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:52:39.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:52:38 smithi132 bash[27079]: cluster 2020-07-16T13:52:37.682800+0000 mgr.x (mgr.34562) 675 : cluster [DBG] pgmap v419: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:52:39.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:52:38 smithi188 bash[23329]: cluster 2020-07-16T13:52:37.682800+0000 mgr.x (mgr.34562) 675 : cluster [DBG] pgmap v419: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:52:39.808 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T13:52:40.067 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T13:52:40.068 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (15m) 3m ago 18m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T13:52:40.068 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (18m) 3m ago 18m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T13:52:40.068 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (15m) 3m ago 21m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T13:52:40.068 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (15m) 3m ago 22m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T13:52:40.069 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 3m ago 23m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T13:52:40.069 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (21m) 3m ago 21m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T13:52:40.069 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (21m) 3m ago 21m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T13:52:40.069 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (18m) 3m ago 18m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T13:52:40.069 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (18m) 3m ago 18m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T13:52:40.070 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (21m) 3m ago 21m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T13:52:40.070 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (20m) 3m ago 20m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T13:52:40.070 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (20m) 3m ago 20m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T13:52:40.070 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (20m) 3m ago 20m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T13:52:40.070 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (19m) 3m ago 19m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T13:52:40.071 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (19m) 3m ago 19m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T13:52:40.071 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (19m) 3m ago 19m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T13:52:40.071 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (19m) 3m ago 19m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T13:52:40.071 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (17m) 3m ago 18m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T13:52:40.366 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T13:52:40.366 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T13:52:40.366 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T13:52:40.367 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T13:52:40.367 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:52:40.367 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T13:52:40.367 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T13:52:40.367 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:52:40.368 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T13:52:40.368 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T13:52:40.368 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:52:40.368 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T13:52:40.368 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T13:52:40.369 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T13:52:40.369 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T13:52:40.369 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T13:52:40.369 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T13:52:40.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:52:40 smithi188 bash[23329]: cluster 2020-07-16T13:52:39.683356+0000 mgr.x (mgr.34562) 676 : cluster [DBG] pgmap v420: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:52:40.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:52:40 smithi188 bash[23329]: audit 2020-07-16T13:52:39.796218+0000 mgr.x (mgr.34562) 677 : audit [DBG] from='client.25126 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:52:40.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:52:40 smithi132 bash[27079]: cluster 2020-07-16T13:52:39.683356+0000 mgr.x (mgr.34562) 676 : cluster [DBG] pgmap v420: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:52:40.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:52:40 smithi132 bash[27079]: audit 2020-07-16T13:52:39.796218+0000 mgr.x (mgr.34562) 677 : audit [DBG] from='client.25126 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:52:41.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:52:41 smithi188 bash[23329]: audit 2020-07-16T13:52:40.063258+0000 mgr.x (mgr.34562) 678 : audit [DBG] from='client.25132 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:52:41.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:52:41 smithi188 bash[23329]: audit 2020-07-16T13:52:40.365252+0000 mon.c (mon.1) 101 : audit [DBG] from='client.? 172.21.15.132:0/1621499963' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:52:41.534 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:52:41 smithi132 bash[27079]: audit 2020-07-16T13:52:40.063258+0000 mgr.x (mgr.34562) 678 : audit [DBG] from='client.25132 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:52:41.535 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:52:41 smithi132 bash[27079]: audit 2020-07-16T13:52:40.365252+0000 mon.c (mon.1) 101 : audit [DBG] from='client.? 172.21.15.132:0/1621499963' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:52:42.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:52:42 smithi188 bash[23329]: cluster 2020-07-16T13:52:41.683693+0000 mgr.x (mgr.34562) 679 : cluster [DBG] pgmap v421: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:52:42.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:52:42 smithi132 bash[27079]: cluster 2020-07-16T13:52:41.683693+0000 mgr.x (mgr.34562) 679 : cluster [DBG] pgmap v421: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:52:45.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:52:44 smithi132 bash[27079]: cluster 2020-07-16T13:52:43.684047+0000 mgr.x (mgr.34562) 680 : cluster [DBG] pgmap v422: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:52:45.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:52:44 smithi188 bash[23329]: cluster 2020-07-16T13:52:43.684047+0000 mgr.x (mgr.34562) 680 : cluster [DBG] pgmap v422: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:52:47.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:52:46 smithi132 bash[27079]: cluster 2020-07-16T13:52:45.684513+0000 mgr.x (mgr.34562) 681 : cluster [DBG] pgmap v423: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:52:47.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:52:46 smithi188 bash[23329]: cluster 2020-07-16T13:52:45.684513+0000 mgr.x (mgr.34562) 681 : cluster [DBG] pgmap v423: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:52:48.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:52:47 smithi132 bash[27079]: audit 2020-07-16T13:52:47.377733+0000 mon.b (mon.2) 285 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:52:48.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:52:47 smithi188 bash[23329]: audit 2020-07-16T13:52:47.377733+0000 mon.b (mon.2) 285 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:52:49.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:52:48 smithi132 bash[27079]: cephadm 2020-07-16T13:52:47.378633+0000 mgr.x (mgr.34562) 682 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:52:49.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:52:48 smithi132 bash[27079]: cephadm 2020-07-16T13:52:47.378712+0000 mgr.x (mgr.34562) 683 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:52:49.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:52:48 smithi132 bash[27079]: cluster 2020-07-16T13:52:47.684975+0000 mgr.x (mgr.34562) 684 : cluster [DBG] pgmap v424: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:52:49.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:52:48 smithi188 bash[23329]: cephadm 2020-07-16T13:52:47.378633+0000 mgr.x (mgr.34562) 682 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:52:49.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:52:48 smithi188 bash[23329]: cephadm 2020-07-16T13:52:47.378712+0000 mgr.x (mgr.34562) 683 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:52:49.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:52:48 smithi188 bash[23329]: cluster 2020-07-16T13:52:47.684975+0000 mgr.x (mgr.34562) 684 : cluster [DBG] pgmap v424: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:52:50.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:52:50 smithi188 bash[23329]: cluster 2020-07-16T13:52:49.685374+0000 mgr.x (mgr.34562) 685 : cluster [DBG] pgmap v425: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:52:50.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:52:50 smithi132 bash[27079]: cluster 2020-07-16T13:52:49.685374+0000 mgr.x (mgr.34562) 685 : cluster [DBG] pgmap v425: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:52:53.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:52:52 smithi132 bash[27079]: cluster 2020-07-16T13:52:51.685880+0000 mgr.x (mgr.34562) 686 : cluster [DBG] pgmap v426: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:52:53.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:52:52 smithi188 bash[23329]: cluster 2020-07-16T13:52:51.685880+0000 mgr.x (mgr.34562) 686 : cluster [DBG] pgmap v426: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:52:55.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:52:54 smithi132 bash[27079]: cluster 2020-07-16T13:52:53.686397+0000 mgr.x (mgr.34562) 687 : cluster [DBG] pgmap v427: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:52:55.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:52:54 smithi188 bash[23329]: cluster 2020-07-16T13:52:53.686397+0000 mgr.x (mgr.34562) 687 : cluster [DBG] pgmap v427: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:52:57.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:52:56 smithi132 bash[27079]: cluster 2020-07-16T13:52:55.686698+0000 mgr.x (mgr.34562) 688 : cluster [DBG] pgmap v428: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:52:57.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:52:56 smithi188 bash[23329]: cluster 2020-07-16T13:52:55.686698+0000 mgr.x (mgr.34562) 688 : cluster [DBG] pgmap v428: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:52:59.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:52:58 smithi132 bash[27079]: cluster 2020-07-16T13:52:57.687190+0000 mgr.x (mgr.34562) 689 : cluster [DBG] pgmap v429: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:52:59.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:52:58 smithi188 bash[23329]: cluster 2020-07-16T13:52:57.687190+0000 mgr.x (mgr.34562) 689 : cluster [DBG] pgmap v429: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:53:00.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:53:00 smithi188 bash[23329]: cluster 2020-07-16T13:52:59.687651+0000 mgr.x (mgr.34562) 690 : cluster [DBG] pgmap v430: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:53:00.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:53:00 smithi132 bash[27079]: cluster 2020-07-16T13:52:59.687651+0000 mgr.x (mgr.34562) 690 : cluster [DBG] pgmap v430: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:53:03.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:53:02 smithi132 bash[27079]: cluster 2020-07-16T13:53:01.688041+0000 mgr.x (mgr.34562) 691 : cluster [DBG] pgmap v431: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:53:03.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:53:02 smithi132 bash[27079]: audit 2020-07-16T13:53:02.394388+0000 mon.b (mon.2) 286 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:53:03.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:53:02 smithi188 bash[23329]: cluster 2020-07-16T13:53:01.688041+0000 mgr.x (mgr.34562) 691 : cluster [DBG] pgmap v431: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:53:03.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:53:02 smithi188 bash[23329]: audit 2020-07-16T13:53:02.394388+0000 mon.b (mon.2) 286 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:53:04.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:53:03 smithi132 bash[27079]: cephadm 2020-07-16T13:53:02.395103+0000 mgr.x (mgr.34562) 692 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:53:04.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:53:03 smithi132 bash[27079]: cephadm 2020-07-16T13:53:02.395259+0000 mgr.x (mgr.34562) 693 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:53:04.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:53:03 smithi188 bash[23329]: cephadm 2020-07-16T13:53:02.395103+0000 mgr.x (mgr.34562) 692 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:53:04.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:53:03 smithi188 bash[23329]: cephadm 2020-07-16T13:53:02.395259+0000 mgr.x (mgr.34562) 693 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:53:05.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:53:04 smithi132 bash[27079]: cluster 2020-07-16T13:53:03.688398+0000 mgr.x (mgr.34562) 694 : cluster [DBG] pgmap v432: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:53:05.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:53:04 smithi188 bash[23329]: cluster 2020-07-16T13:53:03.688398+0000 mgr.x (mgr.34562) 694 : cluster [DBG] pgmap v432: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:53:07.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:53:06 smithi132 bash[27079]: cluster 2020-07-16T13:53:05.688710+0000 mgr.x (mgr.34562) 695 : cluster [DBG] pgmap v433: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:53:07.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:53:06 smithi188 bash[23329]: cluster 2020-07-16T13:53:05.688710+0000 mgr.x (mgr.34562) 695 : cluster [DBG] pgmap v433: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:53:09.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:53:08 smithi132 bash[27079]: cluster 2020-07-16T13:53:07.689112+0000 mgr.x (mgr.34562) 696 : cluster [DBG] pgmap v434: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:53:09.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:53:08 smithi188 bash[23329]: cluster 2020-07-16T13:53:07.689112+0000 mgr.x (mgr.34562) 696 : cluster [DBG] pgmap v434: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:53:10.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:53:10 smithi188 bash[23329]: cluster 2020-07-16T13:53:09.689445+0000 mgr.x (mgr.34562) 697 : cluster [DBG] pgmap v435: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:53:10.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:53:10 smithi132 bash[27079]: cluster 2020-07-16T13:53:09.689445+0000 mgr.x (mgr.34562) 697 : cluster [DBG] pgmap v435: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:53:10.664 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T13:53:10.925 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T13:53:10.926 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (15m) 3m ago 18m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T13:53:10.926 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (18m) 3m ago 18m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T13:53:10.926 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (16m) 3m ago 21m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T13:53:10.926 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (15m) 3m ago 23m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T13:53:10.927 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 3m ago 23m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T13:53:10.927 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (22m) 3m ago 22m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T13:53:10.927 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (22m) 3m ago 22m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T13:53:10.927 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (19m) 3m ago 19m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T13:53:10.927 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (19m) 3m ago 19m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T13:53:10.928 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (21m) 3m ago 21m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T13:53:10.928 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (21m) 3m ago 21m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T13:53:10.928 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (20m) 3m ago 21m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T13:53:10.928 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (20m) 3m ago 20m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T13:53:10.928 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (20m) 3m ago 20m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T13:53:10.929 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (20m) 3m ago 20m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T13:53:10.929 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (19m) 3m ago 19m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T13:53:10.929 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (19m) 3m ago 19m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T13:53:10.929 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (18m) 3m ago 19m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T13:53:11.225 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T13:53:11.225 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T13:53:11.226 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T13:53:11.226 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T13:53:11.226 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:53:11.227 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T13:53:11.227 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T13:53:11.227 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:53:11.228 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T13:53:11.228 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T13:53:11.228 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:53:11.229 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T13:53:11.229 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T13:53:11.229 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T13:53:11.230 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T13:53:11.230 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T13:53:11.230 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T13:53:11.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:53:11 smithi188 bash[23329]: audit 2020-07-16T13:53:10.652355+0000 mgr.x (mgr.34562) 698 : audit [DBG] from='client.25144 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:53:11.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:53:11 smithi188 bash[23329]: audit 2020-07-16T13:53:10.921004+0000 mgr.x (mgr.34562) 699 : audit [DBG] from='client.25150 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:53:11.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:53:11 smithi132 bash[27079]: audit 2020-07-16T13:53:10.652355+0000 mgr.x (mgr.34562) 698 : audit [DBG] from='client.25144 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:53:11.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:53:11 smithi132 bash[27079]: audit 2020-07-16T13:53:10.921004+0000 mgr.x (mgr.34562) 699 : audit [DBG] from='client.25150 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:53:12.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:53:12 smithi188 bash[23329]: audit 2020-07-16T13:53:11.223760+0000 mon.c (mon.1) 102 : audit [DBG] from='client.? 172.21.15.132:0/1682968272' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:53:12.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:53:12 smithi188 bash[23329]: cluster 2020-07-16T13:53:11.689814+0000 mgr.x (mgr.34562) 700 : cluster [DBG] pgmap v436: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:53:12.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:53:12 smithi132 bash[27079]: audit 2020-07-16T13:53:11.223760+0000 mon.c (mon.1) 102 : audit [DBG] from='client.? 172.21.15.132:0/1682968272' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:53:12.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:53:12 smithi132 bash[27079]: cluster 2020-07-16T13:53:11.689814+0000 mgr.x (mgr.34562) 700 : cluster [DBG] pgmap v436: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:53:15.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:53:14 smithi132 bash[27079]: cluster 2020-07-16T13:53:13.690339+0000 mgr.x (mgr.34562) 701 : cluster [DBG] pgmap v437: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:53:15.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:53:14 smithi188 bash[23329]: cluster 2020-07-16T13:53:13.690339+0000 mgr.x (mgr.34562) 701 : cluster [DBG] pgmap v437: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:53:17.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:53:16 smithi132 bash[27079]: cluster 2020-07-16T13:53:15.690656+0000 mgr.x (mgr.34562) 702 : cluster [DBG] pgmap v438: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:53:17.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:53:16 smithi188 bash[23329]: cluster 2020-07-16T13:53:15.690656+0000 mgr.x (mgr.34562) 702 : cluster [DBG] pgmap v438: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:53:18.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:53:17 smithi132 bash[27079]: audit 2020-07-16T13:53:17.398406+0000 mon.b (mon.2) 287 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:53:18.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:53:17 smithi188 bash[23329]: audit 2020-07-16T13:53:17.398406+0000 mon.b (mon.2) 287 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:53:19.037 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:53:18 smithi132 bash[27079]: cephadm 2020-07-16T13:53:17.399099+0000 mgr.x (mgr.34562) 703 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:53:19.038 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:53:18 smithi132 bash[27079]: cephadm 2020-07-16T13:53:17.399517+0000 mgr.x (mgr.34562) 704 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:53:19.038 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:53:18 smithi132 bash[27079]: cluster 2020-07-16T13:53:17.690987+0000 mgr.x (mgr.34562) 705 : cluster [DBG] pgmap v439: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:53:19.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:53:18 smithi188 bash[23329]: cephadm 2020-07-16T13:53:17.399099+0000 mgr.x (mgr.34562) 703 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:53:19.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:53:18 smithi188 bash[23329]: cephadm 2020-07-16T13:53:17.399517+0000 mgr.x (mgr.34562) 704 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:53:19.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:53:18 smithi188 bash[23329]: cluster 2020-07-16T13:53:17.690987+0000 mgr.x (mgr.34562) 705 : cluster [DBG] pgmap v439: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:53:20.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:53:20 smithi188 bash[23329]: cluster 2020-07-16T13:53:19.691445+0000 mgr.x (mgr.34562) 706 : cluster [DBG] pgmap v440: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:53:20.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:53:20 smithi132 bash[27079]: cluster 2020-07-16T13:53:19.691445+0000 mgr.x (mgr.34562) 706 : cluster [DBG] pgmap v440: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:53:23.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:53:22 smithi132 bash[27079]: cluster 2020-07-16T13:53:21.691844+0000 mgr.x (mgr.34562) 707 : cluster [DBG] pgmap v441: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:53:23.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:53:22 smithi188 bash[23329]: cluster 2020-07-16T13:53:21.691844+0000 mgr.x (mgr.34562) 707 : cluster [DBG] pgmap v441: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:53:25.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:53:24 smithi132 bash[27079]: cluster 2020-07-16T13:53:23.692224+0000 mgr.x (mgr.34562) 708 : cluster [DBG] pgmap v442: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:53:25.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:53:24 smithi188 bash[23329]: cluster 2020-07-16T13:53:23.692224+0000 mgr.x (mgr.34562) 708 : cluster [DBG] pgmap v442: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:53:27.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:53:26 smithi132 bash[27079]: cluster 2020-07-16T13:53:25.692706+0000 mgr.x (mgr.34562) 709 : cluster [DBG] pgmap v443: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:53:27.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:53:26 smithi188 bash[23329]: cluster 2020-07-16T13:53:25.692706+0000 mgr.x (mgr.34562) 709 : cluster [DBG] pgmap v443: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:53:29.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:53:28 smithi132 bash[27079]: cluster 2020-07-16T13:53:27.693217+0000 mgr.x (mgr.34562) 710 : cluster [DBG] pgmap v444: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:53:29.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:53:28 smithi188 bash[23329]: cluster 2020-07-16T13:53:27.693217+0000 mgr.x (mgr.34562) 710 : cluster [DBG] pgmap v444: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:53:30.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:53:30 smithi188 bash[23329]: cluster 2020-07-16T13:53:29.693686+0000 mgr.x (mgr.34562) 711 : cluster [DBG] pgmap v445: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:53:30.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:53:30 smithi132 bash[27079]: cluster 2020-07-16T13:53:29.693686+0000 mgr.x (mgr.34562) 711 : cluster [DBG] pgmap v445: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:53:33.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:53:32 smithi132 bash[27079]: cluster 2020-07-16T13:53:31.694072+0000 mgr.x (mgr.34562) 712 : cluster [DBG] pgmap v446: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:53:33.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:53:32 smithi132 bash[27079]: audit 2020-07-16T13:53:32.417584+0000 mon.b (mon.2) 288 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:53:33.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:53:32 smithi132 bash[27079]: audit 2020-07-16T13:53:32.419048+0000 mon.b (mon.2) 289 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:53:33.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:53:32 smithi132 bash[27079]: audit 2020-07-16T13:53:32.420193+0000 mon.b (mon.2) 290 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:53:33.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:53:32 smithi132 bash[27079]: audit 2020-07-16T13:53:32.421381+0000 mon.b (mon.2) 291 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T13:53:33.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:53:32 smithi132 bash[27079]: audit 2020-07-16T13:53:32.422528+0000 mon.b (mon.2) 292 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:53:33.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:53:32 smithi188 bash[23329]: cluster 2020-07-16T13:53:31.694072+0000 mgr.x (mgr.34562) 712 : cluster [DBG] pgmap v446: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:53:33.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:53:32 smithi188 bash[23329]: audit 2020-07-16T13:53:32.417584+0000 mon.b (mon.2) 288 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:53:33.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:53:32 smithi188 bash[23329]: audit 2020-07-16T13:53:32.419048+0000 mon.b (mon.2) 289 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:53:33.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:53:32 smithi188 bash[23329]: audit 2020-07-16T13:53:32.420193+0000 mon.b (mon.2) 290 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:53:33.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:53:32 smithi188 bash[23329]: audit 2020-07-16T13:53:32.421381+0000 mon.b (mon.2) 291 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T13:53:33.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:53:32 smithi188 bash[23329]: audit 2020-07-16T13:53:32.422528+0000 mon.b (mon.2) 292 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:53:34.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:53:33 smithi132 bash[27079]: audit 2020-07-16T13:53:32.417981+0000 mgr.x (mgr.34562) 713 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:53:34.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:53:33 smithi132 bash[27079]: audit 2020-07-16T13:53:32.419389+0000 mgr.x (mgr.34562) 714 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:53:34.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:53:33 smithi132 bash[27079]: audit 2020-07-16T13:53:32.420466+0000 mgr.x (mgr.34562) 715 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:53:34.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:53:33 smithi132 bash[27079]: cephadm 2020-07-16T13:53:32.421110+0000 mgr.x (mgr.34562) 716 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T13:53:34.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:53:33 smithi132 bash[27079]: cephadm 2020-07-16T13:53:32.422192+0000 mgr.x (mgr.34562) 717 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T13:53:34.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:53:33 smithi132 bash[27079]: cephadm 2020-07-16T13:53:32.423170+0000 mgr.x (mgr.34562) 718 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T13:53:34.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:53:33 smithi132 bash[27079]: cephadm 2020-07-16T13:53:32.423390+0000 mgr.x (mgr.34562) 719 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T13:53:34.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:53:33 smithi188 bash[23329]: audit 2020-07-16T13:53:32.417981+0000 mgr.x (mgr.34562) 713 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:53:34.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:53:33 smithi188 bash[23329]: audit 2020-07-16T13:53:32.419389+0000 mgr.x (mgr.34562) 714 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:53:34.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:53:33 smithi188 bash[23329]: audit 2020-07-16T13:53:32.420466+0000 mgr.x (mgr.34562) 715 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:53:34.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:53:33 smithi188 bash[23329]: cephadm 2020-07-16T13:53:32.421110+0000 mgr.x (mgr.34562) 716 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T13:53:34.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:53:33 smithi188 bash[23329]: cephadm 2020-07-16T13:53:32.422192+0000 mgr.x (mgr.34562) 717 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T13:53:34.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:53:33 smithi188 bash[23329]: cephadm 2020-07-16T13:53:32.423170+0000 mgr.x (mgr.34562) 718 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T13:53:34.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:53:33 smithi188 bash[23329]: cephadm 2020-07-16T13:53:32.423390+0000 mgr.x (mgr.34562) 719 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T13:53:35.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:53:34 smithi132 bash[27079]: cluster 2020-07-16T13:53:33.694497+0000 mgr.x (mgr.34562) 720 : cluster [DBG] pgmap v447: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:53:35.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:53:34 smithi188 bash[23329]: cluster 2020-07-16T13:53:33.694497+0000 mgr.x (mgr.34562) 720 : cluster [DBG] pgmap v447: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:53:36.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:53:35 smithi132 bash[27079]: audit 2020-07-16T13:53:35.305472+0000 mon.b (mon.2) 293 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:53:36.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:53:35 smithi188 bash[23329]: audit 2020-07-16T13:53:35.305472+0000 mon.b (mon.2) 293 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:53:37.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:53:36 smithi132 bash[27079]: cephadm 2020-07-16T13:53:35.306062+0000 mgr.x (mgr.34562) 721 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:53:37.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:53:36 smithi132 bash[27079]: cephadm 2020-07-16T13:53:35.306139+0000 mgr.x (mgr.34562) 722 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:53:37.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:53:36 smithi132 bash[27079]: cluster 2020-07-16T13:53:35.694881+0000 mgr.x (mgr.34562) 723 : cluster [DBG] pgmap v448: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:53:37.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:53:36 smithi188 bash[23329]: cephadm 2020-07-16T13:53:35.306062+0000 mgr.x (mgr.34562) 721 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:53:37.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:53:36 smithi188 bash[23329]: cephadm 2020-07-16T13:53:35.306139+0000 mgr.x (mgr.34562) 722 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:53:37.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:53:36 smithi188 bash[23329]: cluster 2020-07-16T13:53:35.694881+0000 mgr.x (mgr.34562) 723 : cluster [DBG] pgmap v448: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:53:39.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:53:38 smithi132 bash[27079]: cluster 2020-07-16T13:53:37.695238+0000 mgr.x (mgr.34562) 724 : cluster [DBG] pgmap v449: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:53:39.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:53:38 smithi188 bash[23329]: cluster 2020-07-16T13:53:37.695238+0000 mgr.x (mgr.34562) 724 : cluster [DBG] pgmap v449: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:53:40.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:53:40 smithi188 bash[23329]: cluster 2020-07-16T13:53:39.695625+0000 mgr.x (mgr.34562) 725 : cluster [DBG] pgmap v450: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:53:40.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:53:40 smithi132 bash[27079]: cluster 2020-07-16T13:53:39.695625+0000 mgr.x (mgr.34562) 725 : cluster [DBG] pgmap v450: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:53:41.523 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T13:53:41.786 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T13:53:41.787 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (16m) 4m ago 19m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T13:53:41.787 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (19m) 4m ago 19m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T13:53:41.787 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (16m) 4m ago 22m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T13:53:41.787 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (16m) 4m ago 24m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T13:53:41.788 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 4m ago 24m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T13:53:41.788 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (22m) 4m ago 22m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T13:53:41.788 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (22m) 4m ago 22m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T13:53:41.788 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (19m) 4m ago 19m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T13:53:41.788 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (19m) 4m ago 19m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T13:53:41.789 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (22m) 4m ago 22m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T13:53:41.789 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (21m) 4m ago 21m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T13:53:41.789 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (21m) 4m ago 21m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T13:53:41.789 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (21m) 4m ago 21m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T13:53:41.790 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (20m) 4m ago 20m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T13:53:41.790 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (20m) 4m ago 20m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T13:53:41.790 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (20m) 4m ago 20m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T13:53:41.790 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (20m) 4m ago 20m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T13:53:41.790 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (18m) 4m ago 19m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T13:53:42.082 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T13:53:42.083 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T13:53:42.083 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T13:53:42.083 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T13:53:42.083 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:53:42.084 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T13:53:42.084 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T13:53:42.084 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:53:42.084 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T13:53:42.084 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T13:53:42.085 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:53:42.085 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T13:53:42.085 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T13:53:42.085 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T13:53:42.085 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T13:53:42.086 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T13:53:42.086 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T13:53:43.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:53:42 smithi132 bash[27079]: audit 2020-07-16T13:53:41.511265+0000 mgr.x (mgr.34562) 726 : audit [DBG] from='client.25162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:53:43.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:53:42 smithi132 bash[27079]: cluster 2020-07-16T13:53:41.695944+0000 mgr.x (mgr.34562) 727 : cluster [DBG] pgmap v451: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:53:43.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:53:42 smithi132 bash[27079]: audit 2020-07-16T13:53:41.782022+0000 mgr.x (mgr.34562) 728 : audit [DBG] from='client.25168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:53:43.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:53:42 smithi132 bash[27079]: audit 2020-07-16T13:53:42.081472+0000 mon.c (mon.1) 103 : audit [DBG] from='client.? 172.21.15.132:0/821956719' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:53:43.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:53:42 smithi188 bash[23329]: audit 2020-07-16T13:53:41.511265+0000 mgr.x (mgr.34562) 726 : audit [DBG] from='client.25162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:53:43.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:53:42 smithi188 bash[23329]: cluster 2020-07-16T13:53:41.695944+0000 mgr.x (mgr.34562) 727 : cluster [DBG] pgmap v451: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:53:43.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:53:42 smithi188 bash[23329]: audit 2020-07-16T13:53:41.782022+0000 mgr.x (mgr.34562) 728 : audit [DBG] from='client.25168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:53:43.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:53:42 smithi188 bash[23329]: audit 2020-07-16T13:53:42.081472+0000 mon.c (mon.1) 103 : audit [DBG] from='client.? 172.21.15.132:0/821956719' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:53:45.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:53:44 smithi132 bash[27079]: cluster 2020-07-16T13:53:43.696420+0000 mgr.x (mgr.34562) 729 : cluster [DBG] pgmap v452: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:53:45.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:53:44 smithi188 bash[23329]: cluster 2020-07-16T13:53:43.696420+0000 mgr.x (mgr.34562) 729 : cluster [DBG] pgmap v452: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:53:47.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:53:46 smithi132 bash[27079]: cluster 2020-07-16T13:53:45.696732+0000 mgr.x (mgr.34562) 730 : cluster [DBG] pgmap v453: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:53:47.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:53:46 smithi188 bash[23329]: cluster 2020-07-16T13:53:45.696732+0000 mgr.x (mgr.34562) 730 : cluster [DBG] pgmap v453: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:53:49.034 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:53:48 smithi132 bash[27079]: cluster 2020-07-16T13:53:47.697079+0000 mgr.x (mgr.34562) 731 : cluster [DBG] pgmap v454: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:53:49.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:53:48 smithi188 bash[23329]: cluster 2020-07-16T13:53:47.697079+0000 mgr.x (mgr.34562) 731 : cluster [DBG] pgmap v454: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:53:50.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:53:50 smithi188 bash[23329]: cluster 2020-07-16T13:53:49.697455+0000 mgr.x (mgr.34562) 732 : cluster [DBG] pgmap v455: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:53:50.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:53:50 smithi132 bash[27079]: cluster 2020-07-16T13:53:49.697455+0000 mgr.x (mgr.34562) 732 : cluster [DBG] pgmap v455: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:53:51.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:53:51 smithi188 bash[23329]: audit 2020-07-16T13:53:50.321958+0000 mon.b (mon.2) 294 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:53:51.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:53:51 smithi188 bash[23329]: cephadm 2020-07-16T13:53:50.322693+0000 mgr.x (mgr.34562) 733 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:53:51.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:53:51 smithi188 bash[23329]: cephadm 2020-07-16T13:53:50.323051+0000 mgr.x (mgr.34562) 734 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:53:51.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:53:51 smithi132 bash[27079]: audit 2020-07-16T13:53:50.321958+0000 mon.b (mon.2) 294 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:53:51.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:53:51 smithi132 bash[27079]: cephadm 2020-07-16T13:53:50.322693+0000 mgr.x (mgr.34562) 733 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:53:51.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:53:51 smithi132 bash[27079]: cephadm 2020-07-16T13:53:50.323051+0000 mgr.x (mgr.34562) 734 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:53:52.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:53:52 smithi188 bash[23329]: cluster 2020-07-16T13:53:51.697959+0000 mgr.x (mgr.34562) 735 : cluster [DBG] pgmap v456: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:53:52.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:53:52 smithi132 bash[27079]: cluster 2020-07-16T13:53:51.697959+0000 mgr.x (mgr.34562) 735 : cluster [DBG] pgmap v456: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:53:55.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:53:54 smithi132 bash[27079]: cluster 2020-07-16T13:53:53.698373+0000 mgr.x (mgr.34562) 736 : cluster [DBG] pgmap v457: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:53:55.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:53:54 smithi188 bash[23329]: cluster 2020-07-16T13:53:53.698373+0000 mgr.x (mgr.34562) 736 : cluster [DBG] pgmap v457: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:53:57.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:53:56 smithi132 bash[27079]: cluster 2020-07-16T13:53:55.698745+0000 mgr.x (mgr.34562) 737 : cluster [DBG] pgmap v458: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:53:57.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:53:56 smithi188 bash[23329]: cluster 2020-07-16T13:53:55.698745+0000 mgr.x (mgr.34562) 737 : cluster [DBG] pgmap v458: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:53:59.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:53:58 smithi132 bash[27079]: cluster 2020-07-16T13:53:57.699157+0000 mgr.x (mgr.34562) 738 : cluster [DBG] pgmap v459: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:53:59.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:53:58 smithi188 bash[23329]: cluster 2020-07-16T13:53:57.699157+0000 mgr.x (mgr.34562) 738 : cluster [DBG] pgmap v459: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:54:00.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:54:00 smithi188 bash[23329]: cluster 2020-07-16T13:53:59.699701+0000 mgr.x (mgr.34562) 739 : cluster [DBG] pgmap v460: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:54:00.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:54:00 smithi132 bash[27079]: cluster 2020-07-16T13:53:59.699701+0000 mgr.x (mgr.34562) 739 : cluster [DBG] pgmap v460: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:54:03.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:54:02 smithi132 bash[27079]: cluster 2020-07-16T13:54:01.700263+0000 mgr.x (mgr.34562) 740 : cluster [DBG] pgmap v461: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:54:03.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:54:02 smithi188 bash[23329]: cluster 2020-07-16T13:54:01.700263+0000 mgr.x (mgr.34562) 740 : cluster [DBG] pgmap v461: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:54:05.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:54:04 smithi132 bash[27079]: cluster 2020-07-16T13:54:03.700776+0000 mgr.x (mgr.34562) 741 : cluster [DBG] pgmap v462: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:54:05.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:54:04 smithi188 bash[23329]: cluster 2020-07-16T13:54:03.700776+0000 mgr.x (mgr.34562) 741 : cluster [DBG] pgmap v462: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:54:06.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:54:05 smithi132 bash[27079]: audit 2020-07-16T13:54:05.338530+0000 mon.b (mon.2) 295 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:54:06.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:54:05 smithi188 bash[23329]: audit 2020-07-16T13:54:05.338530+0000 mon.b (mon.2) 295 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:54:07.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:54:06 smithi132 bash[27079]: cephadm 2020-07-16T13:54:05.339200+0000 mgr.x (mgr.34562) 742 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:54:07.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:54:06 smithi132 bash[27079]: cephadm 2020-07-16T13:54:05.339625+0000 mgr.x (mgr.34562) 743 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:54:07.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:54:06 smithi132 bash[27079]: cluster 2020-07-16T13:54:05.701311+0000 mgr.x (mgr.34562) 744 : cluster [DBG] pgmap v463: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:54:07.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:54:06 smithi188 bash[23329]: cephadm 2020-07-16T13:54:05.339200+0000 mgr.x (mgr.34562) 742 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:54:07.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:54:06 smithi188 bash[23329]: cephadm 2020-07-16T13:54:05.339625+0000 mgr.x (mgr.34562) 743 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:54:07.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:54:06 smithi188 bash[23329]: cluster 2020-07-16T13:54:05.701311+0000 mgr.x (mgr.34562) 744 : cluster [DBG] pgmap v463: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:54:09.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:54:08 smithi132 bash[27079]: cluster 2020-07-16T13:54:07.701713+0000 mgr.x (mgr.34562) 745 : cluster [DBG] pgmap v464: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:54:09.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:54:08 smithi188 bash[23329]: cluster 2020-07-16T13:54:07.701713+0000 mgr.x (mgr.34562) 745 : cluster [DBG] pgmap v464: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:54:10.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:54:10 smithi188 bash[23329]: cluster 2020-07-16T13:54:09.702175+0000 mgr.x (mgr.34562) 746 : cluster [DBG] pgmap v465: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:54:10.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:54:10 smithi132 bash[27079]: cluster 2020-07-16T13:54:09.702175+0000 mgr.x (mgr.34562) 746 : cluster [DBG] pgmap v465: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:54:12.381 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T13:54:12.641 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T13:54:12.641 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (16m) 4m ago 19m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T13:54:12.642 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (19m) 4m ago 19m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T13:54:12.642 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (17m) 4m ago 22m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T13:54:12.642 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (16m) 4m ago 24m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T13:54:12.643 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 4m ago 24m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T13:54:12.643 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (23m) 4m ago 23m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T13:54:12.643 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (23m) 4m ago 23m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T13:54:12.643 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (20m) 4m ago 20m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T13:54:12.644 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (20m) 4m ago 20m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T13:54:12.644 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (22m) 4m ago 22m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T13:54:12.644 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (22m) 4m ago 22m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T13:54:12.644 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (22m) 4m ago 22m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T13:54:12.645 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (21m) 4m ago 21m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T13:54:12.645 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (21m) 4m ago 21m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T13:54:12.645 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (21m) 4m ago 21m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T13:54:12.646 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (20m) 4m ago 20m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T13:54:12.646 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (20m) 4m ago 20m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T13:54:12.646 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (19m) 4m ago 20m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T13:54:12.945 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T13:54:12.946 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T13:54:12.946 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T13:54:12.946 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T13:54:12.946 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:54:12.947 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T13:54:12.947 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T13:54:12.947 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:54:12.947 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T13:54:12.947 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T13:54:12.948 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:54:12.948 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T13:54:12.948 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T13:54:12.948 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T13:54:12.948 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T13:54:12.949 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T13:54:12.949 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T13:54:13.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:54:12 smithi132 bash[27079]: cluster 2020-07-16T13:54:11.702665+0000 mgr.x (mgr.34562) 747 : cluster [DBG] pgmap v466: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:54:13.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:54:12 smithi188 bash[23329]: cluster 2020-07-16T13:54:11.702665+0000 mgr.x (mgr.34562) 747 : cluster [DBG] pgmap v466: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:54:14.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:54:13 smithi132 bash[27079]: audit 2020-07-16T13:54:12.369410+0000 mgr.x (mgr.34562) 748 : audit [DBG] from='client.25180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:54:14.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:54:13 smithi132 bash[27079]: audit 2020-07-16T13:54:12.636604+0000 mgr.x (mgr.34562) 749 : audit [DBG] from='client.25186 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:54:14.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:54:13 smithi132 bash[27079]: audit 2020-07-16T13:54:12.941693+0000 mon.c (mon.1) 104 : audit [DBG] from='client.? 172.21.15.132:0/311389783' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:54:14.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:54:13 smithi188 bash[23329]: audit 2020-07-16T13:54:12.369410+0000 mgr.x (mgr.34562) 748 : audit [DBG] from='client.25180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:54:14.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:54:13 smithi188 bash[23329]: audit 2020-07-16T13:54:12.636604+0000 mgr.x (mgr.34562) 749 : audit [DBG] from='client.25186 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:54:14.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:54:13 smithi188 bash[23329]: audit 2020-07-16T13:54:12.941693+0000 mon.c (mon.1) 104 : audit [DBG] from='client.? 172.21.15.132:0/311389783' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:54:15.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:54:14 smithi132 bash[27079]: cluster 2020-07-16T13:54:13.702991+0000 mgr.x (mgr.34562) 750 : cluster [DBG] pgmap v467: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:54:15.177 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:54:14 smithi188 bash[23329]: cluster 2020-07-16T13:54:13.702991+0000 mgr.x (mgr.34562) 750 : cluster [DBG] pgmap v467: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:54:17.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:54:16 smithi132 bash[27079]: cluster 2020-07-16T13:54:15.703479+0000 mgr.x (mgr.34562) 751 : cluster [DBG] pgmap v468: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:54:17.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:54:16 smithi188 bash[23329]: cluster 2020-07-16T13:54:15.703479+0000 mgr.x (mgr.34562) 751 : cluster [DBG] pgmap v468: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:54:19.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:54:18 smithi132 bash[27079]: cluster 2020-07-16T13:54:17.703951+0000 mgr.x (mgr.34562) 752 : cluster [DBG] pgmap v469: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:54:19.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:54:18 smithi188 bash[23329]: cluster 2020-07-16T13:54:17.703951+0000 mgr.x (mgr.34562) 752 : cluster [DBG] pgmap v469: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:54:20.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:54:20 smithi188 bash[23329]: cluster 2020-07-16T13:54:19.704361+0000 mgr.x (mgr.34562) 753 : cluster [DBG] pgmap v470: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:54:20.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:54:20 smithi132 bash[27079]: cluster 2020-07-16T13:54:19.704361+0000 mgr.x (mgr.34562) 753 : cluster [DBG] pgmap v470: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:54:21.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:54:21 smithi188 bash[23329]: audit 2020-07-16T13:54:20.355060+0000 mon.b (mon.2) 296 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:54:21.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:54:21 smithi188 bash[23329]: cephadm 2020-07-16T13:54:20.355745+0000 mgr.x (mgr.34562) 754 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:54:21.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:54:21 smithi188 bash[23329]: cephadm 2020-07-16T13:54:20.356163+0000 mgr.x (mgr.34562) 755 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:54:21.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:54:21 smithi132 bash[27079]: audit 2020-07-16T13:54:20.355060+0000 mon.b (mon.2) 296 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:54:21.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:54:21 smithi132 bash[27079]: cephadm 2020-07-16T13:54:20.355745+0000 mgr.x (mgr.34562) 754 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:54:21.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:54:21 smithi132 bash[27079]: cephadm 2020-07-16T13:54:20.356163+0000 mgr.x (mgr.34562) 755 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:54:22.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:54:22 smithi188 bash[23329]: cluster 2020-07-16T13:54:21.704889+0000 mgr.x (mgr.34562) 756 : cluster [DBG] pgmap v471: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:54:22.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:54:22 smithi132 bash[27079]: cluster 2020-07-16T13:54:21.704889+0000 mgr.x (mgr.34562) 756 : cluster [DBG] pgmap v471: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:54:25.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:54:24 smithi132 bash[27079]: cluster 2020-07-16T13:54:23.705337+0000 mgr.x (mgr.34562) 757 : cluster [DBG] pgmap v472: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:54:25.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:54:24 smithi188 bash[23329]: cluster 2020-07-16T13:54:23.705337+0000 mgr.x (mgr.34562) 757 : cluster [DBG] pgmap v472: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:54:27.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:54:26 smithi132 bash[27079]: cluster 2020-07-16T13:54:25.705652+0000 mgr.x (mgr.34562) 758 : cluster [DBG] pgmap v473: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:54:27.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:54:26 smithi188 bash[23329]: cluster 2020-07-16T13:54:25.705652+0000 mgr.x (mgr.34562) 758 : cluster [DBG] pgmap v473: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:54:29.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:54:28 smithi132 bash[27079]: cluster 2020-07-16T13:54:27.706124+0000 mgr.x (mgr.34562) 759 : cluster [DBG] pgmap v474: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:54:29.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:54:28 smithi188 bash[23329]: cluster 2020-07-16T13:54:27.706124+0000 mgr.x (mgr.34562) 759 : cluster [DBG] pgmap v474: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:54:30.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:54:30 smithi188 bash[23329]: cluster 2020-07-16T13:54:29.706534+0000 mgr.x (mgr.34562) 760 : cluster [DBG] pgmap v475: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:54:30.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:54:30 smithi132 bash[27079]: cluster 2020-07-16T13:54:29.706534+0000 mgr.x (mgr.34562) 760 : cluster [DBG] pgmap v475: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:54:33.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:54:32 smithi132 bash[27079]: cluster 2020-07-16T13:54:31.707112+0000 mgr.x (mgr.34562) 761 : cluster [DBG] pgmap v476: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:54:33.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:54:32 smithi188 bash[23329]: cluster 2020-07-16T13:54:31.707112+0000 mgr.x (mgr.34562) 761 : cluster [DBG] pgmap v476: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:54:35.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:54:34 smithi132 bash[27079]: cluster 2020-07-16T13:54:33.707620+0000 mgr.x (mgr.34562) 762 : cluster [DBG] pgmap v477: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:54:35.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:54:34 smithi188 bash[23329]: cluster 2020-07-16T13:54:33.707620+0000 mgr.x (mgr.34562) 762 : cluster [DBG] pgmap v477: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:54:36.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:54:35 smithi132 bash[27079]: audit 2020-07-16T13:54:35.374239+0000 mon.b (mon.2) 297 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:54:36.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:54:35 smithi132 bash[27079]: audit 2020-07-16T13:54:35.375673+0000 mon.b (mon.2) 298 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:54:36.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:54:35 smithi132 bash[27079]: audit 2020-07-16T13:54:35.376818+0000 mon.b (mon.2) 299 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:54:36.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:54:35 smithi132 bash[27079]: audit 2020-07-16T13:54:35.378264+0000 mon.b (mon.2) 300 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T13:54:36.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:54:35 smithi132 bash[27079]: audit 2020-07-16T13:54:35.379484+0000 mon.b (mon.2) 301 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:54:36.176 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:54:35 smithi188 bash[23329]: audit 2020-07-16T13:54:35.374239+0000 mon.b (mon.2) 297 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:54:36.177 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:54:35 smithi188 bash[23329]: audit 2020-07-16T13:54:35.375673+0000 mon.b (mon.2) 298 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:54:36.177 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:54:35 smithi188 bash[23329]: audit 2020-07-16T13:54:35.376818+0000 mon.b (mon.2) 299 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:54:36.179 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:54:35 smithi188 bash[23329]: audit 2020-07-16T13:54:35.378264+0000 mon.b (mon.2) 300 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T13:54:36.180 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:54:35 smithi188 bash[23329]: audit 2020-07-16T13:54:35.379484+0000 mon.b (mon.2) 301 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:54:37.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:54:36 smithi132 bash[27079]: audit 2020-07-16T13:54:35.374663+0000 mgr.x (mgr.34562) 763 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:54:37.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:54:36 smithi132 bash[27079]: audit 2020-07-16T13:54:35.375991+0000 mgr.x (mgr.34562) 764 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:54:37.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:54:36 smithi132 bash[27079]: audit 2020-07-16T13:54:35.377110+0000 mgr.x (mgr.34562) 765 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:54:37.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:54:36 smithi132 bash[27079]: cephadm 2020-07-16T13:54:35.377842+0000 mgr.x (mgr.34562) 766 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T13:54:37.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:54:36 smithi132 bash[27079]: cephadm 2020-07-16T13:54:35.379132+0000 mgr.x (mgr.34562) 767 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T13:54:37.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:54:36 smithi132 bash[27079]: cephadm 2020-07-16T13:54:35.380263+0000 mgr.x (mgr.34562) 768 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T13:54:37.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:54:36 smithi132 bash[27079]: cephadm 2020-07-16T13:54:35.380386+0000 mgr.x (mgr.34562) 769 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T13:54:37.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:54:36 smithi132 bash[27079]: cluster 2020-07-16T13:54:35.707984+0000 mgr.x (mgr.34562) 770 : cluster [DBG] pgmap v478: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:54:37.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:54:36 smithi188 bash[23329]: audit 2020-07-16T13:54:35.374663+0000 mgr.x (mgr.34562) 763 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:54:37.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:54:36 smithi188 bash[23329]: audit 2020-07-16T13:54:35.375991+0000 mgr.x (mgr.34562) 764 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:54:37.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:54:36 smithi188 bash[23329]: audit 2020-07-16T13:54:35.377110+0000 mgr.x (mgr.34562) 765 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:54:37.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:54:36 smithi188 bash[23329]: cephadm 2020-07-16T13:54:35.377842+0000 mgr.x (mgr.34562) 766 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T13:54:37.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:54:36 smithi188 bash[23329]: cephadm 2020-07-16T13:54:35.379132+0000 mgr.x (mgr.34562) 767 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T13:54:37.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:54:36 smithi188 bash[23329]: cephadm 2020-07-16T13:54:35.380263+0000 mgr.x (mgr.34562) 768 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T13:54:37.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:54:36 smithi188 bash[23329]: cephadm 2020-07-16T13:54:35.380386+0000 mgr.x (mgr.34562) 769 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T13:54:37.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:54:36 smithi188 bash[23329]: cluster 2020-07-16T13:54:35.707984+0000 mgr.x (mgr.34562) 770 : cluster [DBG] pgmap v478: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:54:39.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:54:38 smithi132 bash[27079]: cluster 2020-07-16T13:54:37.708358+0000 mgr.x (mgr.34562) 771 : cluster [DBG] pgmap v479: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:54:39.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:54:38 smithi132 bash[27079]: audit 2020-07-16T13:54:38.250809+0000 mon.b (mon.2) 302 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:54:39.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:54:38 smithi188 bash[23329]: cluster 2020-07-16T13:54:37.708358+0000 mgr.x (mgr.34562) 771 : cluster [DBG] pgmap v479: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:54:39.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:54:38 smithi188 bash[23329]: audit 2020-07-16T13:54:38.250809+0000 mon.b (mon.2) 302 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:54:40.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:54:39 smithi132 bash[27079]: cephadm 2020-07-16T13:54:38.251474+0000 mgr.x (mgr.34562) 772 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:54:40.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:54:39 smithi132 bash[27079]: cephadm 2020-07-16T13:54:38.251909+0000 mgr.x (mgr.34562) 773 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:54:40.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:54:39 smithi188 bash[23329]: cephadm 2020-07-16T13:54:38.251474+0000 mgr.x (mgr.34562) 772 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:54:40.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:54:39 smithi188 bash[23329]: cephadm 2020-07-16T13:54:38.251909+0000 mgr.x (mgr.34562) 773 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:54:41.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:54:40 smithi188 bash[23329]: cluster 2020-07-16T13:54:39.708727+0000 mgr.x (mgr.34562) 774 : cluster [DBG] pgmap v480: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:54:41.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:54:40 smithi132 bash[27079]: cluster 2020-07-16T13:54:39.708727+0000 mgr.x (mgr.34562) 774 : cluster [DBG] pgmap v480: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:54:43.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:54:42 smithi188 bash[23329]: cluster 2020-07-16T13:54:41.709248+0000 mgr.x (mgr.34562) 775 : cluster [DBG] pgmap v481: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:54:43.243 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T13:54:43.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:54:42 smithi132 bash[27079]: cluster 2020-07-16T13:54:41.709248+0000 mgr.x (mgr.34562) 775 : cluster [DBG] pgmap v481: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:54:43.504 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T13:54:43.505 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (17m) 5m ago 20m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T13:54:43.505 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (20m) 5m ago 20m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T13:54:43.505 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (17m) 5m ago 23m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T13:54:43.505 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (17m) 5m ago 25m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T13:54:43.506 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 5m ago 25m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T13:54:43.506 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (23m) 5m ago 23m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T13:54:43.506 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (23m) 5m ago 23m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T13:54:43.506 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (20m) 5m ago 20m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T13:54:43.507 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (20m) 5m ago 20m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T13:54:43.507 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (23m) 5m ago 23m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T13:54:43.507 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (22m) 5m ago 22m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T13:54:43.507 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (22m) 5m ago 22m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T13:54:43.507 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (22m) 5m ago 22m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T13:54:43.508 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (21m) 5m ago 22m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T13:54:43.508 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (21m) 5m ago 21m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T13:54:43.508 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (21m) 5m ago 21m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T13:54:43.508 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (21m) 5m ago 21m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T13:54:43.508 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (19m) 5m ago 20m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T13:54:43.802 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T13:54:43.802 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T13:54:43.803 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T13:54:43.803 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T13:54:43.803 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:54:43.803 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T13:54:43.803 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T13:54:43.804 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:54:43.804 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T13:54:43.804 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T13:54:43.804 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:54:43.804 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T13:54:43.804 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T13:54:43.805 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T13:54:43.805 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T13:54:43.805 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T13:54:43.805 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T13:54:45.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:54:44 smithi188 bash[23329]: audit 2020-07-16T13:54:43.231724+0000 mgr.x (mgr.34562) 776 : audit [DBG] from='client.25198 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:54:45.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:54:44 smithi188 bash[23329]: audit 2020-07-16T13:54:43.499958+0000 mgr.x (mgr.34562) 777 : audit [DBG] from='client.25204 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:54:45.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:54:44 smithi188 bash[23329]: cluster 2020-07-16T13:54:43.709660+0000 mgr.x (mgr.34562) 778 : cluster [DBG] pgmap v482: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:54:45.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:54:44 smithi188 bash[23329]: audit 2020-07-16T13:54:43.801025+0000 mon.c (mon.1) 105 : audit [DBG] from='client.? 172.21.15.132:0/125038082' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:54:45.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:54:44 smithi132 bash[27079]: audit 2020-07-16T13:54:43.231724+0000 mgr.x (mgr.34562) 776 : audit [DBG] from='client.25198 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:54:45.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:54:44 smithi132 bash[27079]: audit 2020-07-16T13:54:43.499958+0000 mgr.x (mgr.34562) 777 : audit [DBG] from='client.25204 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:54:45.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:54:44 smithi132 bash[27079]: cluster 2020-07-16T13:54:43.709660+0000 mgr.x (mgr.34562) 778 : cluster [DBG] pgmap v482: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:54:45.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:54:44 smithi132 bash[27079]: audit 2020-07-16T13:54:43.801025+0000 mon.c (mon.1) 105 : audit [DBG] from='client.? 172.21.15.132:0/125038082' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:54:47.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:54:46 smithi188 bash[23329]: cluster 2020-07-16T13:54:45.710058+0000 mgr.x (mgr.34562) 779 : cluster [DBG] pgmap v483: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:54:47.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:54:46 smithi132 bash[27079]: cluster 2020-07-16T13:54:45.710058+0000 mgr.x (mgr.34562) 779 : cluster [DBG] pgmap v483: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:54:49.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:54:48 smithi188 bash[23329]: cluster 2020-07-16T13:54:47.710634+0000 mgr.x (mgr.34562) 780 : cluster [DBG] pgmap v484: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:54:49.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:54:48 smithi132 bash[27079]: cluster 2020-07-16T13:54:47.710634+0000 mgr.x (mgr.34562) 780 : cluster [DBG] pgmap v484: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:54:50.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:54:50 smithi188 bash[23329]: cluster 2020-07-16T13:54:49.711143+0000 mgr.x (mgr.34562) 781 : cluster [DBG] pgmap v485: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:54:50.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:54:50 smithi132 bash[27079]: cluster 2020-07-16T13:54:49.711143+0000 mgr.x (mgr.34562) 781 : cluster [DBG] pgmap v485: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:54:53.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:54:52 smithi132 bash[27079]: cluster 2020-07-16T13:54:51.711573+0000 mgr.x (mgr.34562) 782 : cluster [DBG] pgmap v486: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:54:53.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:54:52 smithi188 bash[23329]: cluster 2020-07-16T13:54:51.711573+0000 mgr.x (mgr.34562) 782 : cluster [DBG] pgmap v486: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:54:54.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:54:53 smithi132 bash[27079]: audit 2020-07-16T13:54:53.267422+0000 mon.b (mon.2) 303 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:54:54.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:54:53 smithi188 bash[23329]: audit 2020-07-16T13:54:53.267422+0000 mon.b (mon.2) 303 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:54:55.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:54:54 smithi132 bash[27079]: cephadm 2020-07-16T13:54:53.268153+0000 mgr.x (mgr.34562) 783 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:54:55.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:54:54 smithi132 bash[27079]: cephadm 2020-07-16T13:54:53.268575+0000 mgr.x (mgr.34562) 784 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:54:55.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:54:54 smithi132 bash[27079]: cluster 2020-07-16T13:54:53.711910+0000 mgr.x (mgr.34562) 785 : cluster [DBG] pgmap v487: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:54:55.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:54:54 smithi188 bash[23329]: cephadm 2020-07-16T13:54:53.268153+0000 mgr.x (mgr.34562) 783 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:54:55.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:54:54 smithi188 bash[23329]: cephadm 2020-07-16T13:54:53.268575+0000 mgr.x (mgr.34562) 784 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:54:55.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:54:54 smithi188 bash[23329]: cluster 2020-07-16T13:54:53.711910+0000 mgr.x (mgr.34562) 785 : cluster [DBG] pgmap v487: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:54:57.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:54:56 smithi132 bash[27079]: cluster 2020-07-16T13:54:55.712244+0000 mgr.x (mgr.34562) 786 : cluster [DBG] pgmap v488: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:54:57.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:54:56 smithi188 bash[23329]: cluster 2020-07-16T13:54:55.712244+0000 mgr.x (mgr.34562) 786 : cluster [DBG] pgmap v488: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:54:59.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:54:58 smithi188 bash[23329]: cluster 2020-07-16T13:54:57.712706+0000 mgr.x (mgr.34562) 787 : cluster [DBG] pgmap v489: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:54:59.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:54:58 smithi132 bash[27079]: cluster 2020-07-16T13:54:57.712706+0000 mgr.x (mgr.34562) 787 : cluster [DBG] pgmap v489: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:55:00.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:55:00 smithi188 bash[23329]: cluster 2020-07-16T13:54:59.713175+0000 mgr.x (mgr.34562) 788 : cluster [DBG] pgmap v490: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:55:00.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:55:00 smithi132 bash[27079]: cluster 2020-07-16T13:54:59.713175+0000 mgr.x (mgr.34562) 788 : cluster [DBG] pgmap v490: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:55:03.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:55:02 smithi132 bash[27079]: cluster 2020-07-16T13:55:01.713701+0000 mgr.x (mgr.34562) 789 : cluster [DBG] pgmap v491: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:55:03.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:55:02 smithi188 bash[23329]: cluster 2020-07-16T13:55:01.713701+0000 mgr.x (mgr.34562) 789 : cluster [DBG] pgmap v491: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:55:05.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:55:04 smithi132 bash[27079]: cluster 2020-07-16T13:55:03.714176+0000 mgr.x (mgr.34562) 790 : cluster [DBG] pgmap v492: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:55:05.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:55:04 smithi188 bash[23329]: cluster 2020-07-16T13:55:03.714176+0000 mgr.x (mgr.34562) 790 : cluster [DBG] pgmap v492: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:55:07.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:55:06 smithi132 bash[27079]: cluster 2020-07-16T13:55:05.714641+0000 mgr.x (mgr.34562) 791 : cluster [DBG] pgmap v493: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:55:07.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:55:06 smithi188 bash[23329]: cluster 2020-07-16T13:55:05.714641+0000 mgr.x (mgr.34562) 791 : cluster [DBG] pgmap v493: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:55:09.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:55:08 smithi188 bash[23329]: cluster 2020-07-16T13:55:07.715126+0000 mgr.x (mgr.34562) 792 : cluster [DBG] pgmap v494: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:55:09.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:55:08 smithi188 bash[23329]: audit 2020-07-16T13:55:08.281802+0000 mon.b (mon.2) 304 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:55:09.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:55:08 smithi132 bash[27079]: cluster 2020-07-16T13:55:07.715126+0000 mgr.x (mgr.34562) 792 : cluster [DBG] pgmap v494: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:55:09.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:55:08 smithi132 bash[27079]: audit 2020-07-16T13:55:08.281802+0000 mon.b (mon.2) 304 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:55:10.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:55:09 smithi188 bash[23329]: cephadm 2020-07-16T13:55:08.282504+0000 mgr.x (mgr.34562) 793 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:55:10.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:55:09 smithi188 bash[23329]: cephadm 2020-07-16T13:55:08.282813+0000 mgr.x (mgr.34562) 794 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:55:10.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:55:09 smithi132 bash[27079]: cephadm 2020-07-16T13:55:08.282504+0000 mgr.x (mgr.34562) 793 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:55:10.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:55:09 smithi132 bash[27079]: cephadm 2020-07-16T13:55:08.282813+0000 mgr.x (mgr.34562) 794 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:55:11.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:55:10 smithi188 bash[23329]: cluster 2020-07-16T13:55:09.715556+0000 mgr.x (mgr.34562) 795 : cluster [DBG] pgmap v495: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:55:11.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:55:10 smithi132 bash[27079]: cluster 2020-07-16T13:55:09.715556+0000 mgr.x (mgr.34562) 795 : cluster [DBG] pgmap v495: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:55:13.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:55:12 smithi188 bash[23329]: cluster 2020-07-16T13:55:11.716032+0000 mgr.x (mgr.34562) 796 : cluster [DBG] pgmap v496: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:55:13.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:55:12 smithi132 bash[27079]: cluster 2020-07-16T13:55:11.716032+0000 mgr.x (mgr.34562) 796 : cluster [DBG] pgmap v496: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:55:14.099 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T13:55:14.362 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T13:55:14.363 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (17m) 5m ago 21m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T13:55:14.363 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (20m) 5m ago 20m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T13:55:14.363 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (18m) 5m ago 23m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T13:55:14.363 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (17m) 5m ago 25m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T13:55:14.363 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 5m ago 25m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T13:55:14.364 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (24m) 5m ago 24m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T13:55:14.364 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (24m) 5m ago 24m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T13:55:14.364 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (21m) 5m ago 21m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T13:55:14.364 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (21m) 5m ago 21m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T13:55:14.364 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (23m) 5m ago 23m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T13:55:14.365 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (23m) 5m ago 23m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T13:55:14.365 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (23m) 5m ago 23m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T13:55:14.365 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (22m) 5m ago 22m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T13:55:14.365 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (22m) 5m ago 22m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T13:55:14.365 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (22m) 5m ago 22m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T13:55:14.366 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (21m) 5m ago 21m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T13:55:14.366 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (21m) 5m ago 21m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T13:55:14.366 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (20m) 5m ago 21m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T13:55:14.661 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T13:55:14.661 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T13:55:14.661 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T13:55:14.661 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T13:55:14.662 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:55:14.662 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T13:55:14.662 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T13:55:14.662 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:55:14.662 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T13:55:14.663 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T13:55:14.663 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:55:14.663 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T13:55:14.663 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T13:55:14.663 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T13:55:14.663 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T13:55:14.664 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T13:55:14.664 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T13:55:15.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:55:14 smithi188 bash[23329]: cluster 2020-07-16T13:55:13.716409+0000 mgr.x (mgr.34562) 797 : cluster [DBG] pgmap v497: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:55:15.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:55:14 smithi188 bash[23329]: audit 2020-07-16T13:55:14.659924+0000 mon.c (mon.1) 106 : audit [DBG] from='client.? 172.21.15.132:0/21213943' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:55:15.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:55:14 smithi132 bash[27079]: cluster 2020-07-16T13:55:13.716409+0000 mgr.x (mgr.34562) 797 : cluster [DBG] pgmap v497: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:55:15.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:55:14 smithi132 bash[27079]: audit 2020-07-16T13:55:14.659924+0000 mon.c (mon.1) 106 : audit [DBG] from='client.? 172.21.15.132:0/21213943' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:55:16.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:55:15 smithi188 bash[23329]: audit 2020-07-16T13:55:14.087639+0000 mgr.x (mgr.34562) 798 : audit [DBG] from='client.25216 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:55:16.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:55:15 smithi188 bash[23329]: audit 2020-07-16T13:55:14.357971+0000 mgr.x (mgr.34562) 799 : audit [DBG] from='client.25222 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:55:16.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:55:15 smithi132 bash[27079]: audit 2020-07-16T13:55:14.087639+0000 mgr.x (mgr.34562) 798 : audit [DBG] from='client.25216 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:55:16.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:55:15 smithi132 bash[27079]: audit 2020-07-16T13:55:14.357971+0000 mgr.x (mgr.34562) 799 : audit [DBG] from='client.25222 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:55:17.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:55:16 smithi188 bash[23329]: cluster 2020-07-16T13:55:15.716810+0000 mgr.x (mgr.34562) 800 : cluster [DBG] pgmap v498: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:55:17.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:55:16 smithi132 bash[27079]: cluster 2020-07-16T13:55:15.716810+0000 mgr.x (mgr.34562) 800 : cluster [DBG] pgmap v498: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:55:19.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:55:18 smithi188 bash[23329]: cluster 2020-07-16T13:55:17.717220+0000 mgr.x (mgr.34562) 801 : cluster [DBG] pgmap v499: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:55:19.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:55:18 smithi132 bash[27079]: cluster 2020-07-16T13:55:17.717220+0000 mgr.x (mgr.34562) 801 : cluster [DBG] pgmap v499: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:55:20.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:55:20 smithi188 bash[23329]: cluster 2020-07-16T13:55:19.717584+0000 mgr.x (mgr.34562) 802 : cluster [DBG] pgmap v500: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:55:20.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:55:20 smithi132 bash[27079]: cluster 2020-07-16T13:55:19.717584+0000 mgr.x (mgr.34562) 802 : cluster [DBG] pgmap v500: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:55:23.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:55:22 smithi132 bash[27079]: cluster 2020-07-16T13:55:21.718068+0000 mgr.x (mgr.34562) 803 : cluster [DBG] pgmap v501: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:55:23.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:55:22 smithi188 bash[23329]: cluster 2020-07-16T13:55:21.718068+0000 mgr.x (mgr.34562) 803 : cluster [DBG] pgmap v501: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:55:24.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:55:23 smithi132 bash[27079]: audit 2020-07-16T13:55:23.298486+0000 mon.b (mon.2) 305 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:55:24.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:55:23 smithi188 bash[23329]: audit 2020-07-16T13:55:23.298486+0000 mon.b (mon.2) 305 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:55:25.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:55:24 smithi188 bash[23329]: cephadm 2020-07-16T13:55:23.299231+0000 mgr.x (mgr.34562) 804 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:55:25.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:55:24 smithi188 bash[23329]: cephadm 2020-07-16T13:55:23.299654+0000 mgr.x (mgr.34562) 805 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:55:25.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:55:24 smithi188 bash[23329]: cluster 2020-07-16T13:55:23.718427+0000 mgr.x (mgr.34562) 806 : cluster [DBG] pgmap v502: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:55:25.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:55:24 smithi132 bash[27079]: cephadm 2020-07-16T13:55:23.299231+0000 mgr.x (mgr.34562) 804 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:55:25.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:55:24 smithi132 bash[27079]: cephadm 2020-07-16T13:55:23.299654+0000 mgr.x (mgr.34562) 805 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:55:25.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:55:24 smithi132 bash[27079]: cluster 2020-07-16T13:55:23.718427+0000 mgr.x (mgr.34562) 806 : cluster [DBG] pgmap v502: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:55:27.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:55:26 smithi188 bash[23329]: cluster 2020-07-16T13:55:25.718874+0000 mgr.x (mgr.34562) 807 : cluster [DBG] pgmap v503: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:55:27.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:55:26 smithi132 bash[27079]: cluster 2020-07-16T13:55:25.718874+0000 mgr.x (mgr.34562) 807 : cluster [DBG] pgmap v503: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:55:29.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:55:28 smithi188 bash[23329]: cluster 2020-07-16T13:55:27.719333+0000 mgr.x (mgr.34562) 808 : cluster [DBG] pgmap v504: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:55:29.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:55:28 smithi132 bash[27079]: cluster 2020-07-16T13:55:27.719333+0000 mgr.x (mgr.34562) 808 : cluster [DBG] pgmap v504: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:55:30.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:55:30 smithi188 bash[23329]: cluster 2020-07-16T13:55:29.719712+0000 mgr.x (mgr.34562) 809 : cluster [DBG] pgmap v505: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:55:30.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:55:30 smithi132 bash[27079]: cluster 2020-07-16T13:55:29.719712+0000 mgr.x (mgr.34562) 809 : cluster [DBG] pgmap v505: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:55:33.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:55:32 smithi132 bash[27079]: cluster 2020-07-16T13:55:31.720148+0000 mgr.x (mgr.34562) 810 : cluster [DBG] pgmap v506: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:55:33.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:55:32 smithi188 bash[23329]: cluster 2020-07-16T13:55:31.720148+0000 mgr.x (mgr.34562) 810 : cluster [DBG] pgmap v506: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:55:35.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:55:34 smithi132 bash[27079]: cluster 2020-07-16T13:55:33.720550+0000 mgr.x (mgr.34562) 811 : cluster [DBG] pgmap v507: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:55:35.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:55:34 smithi188 bash[23329]: cluster 2020-07-16T13:55:33.720550+0000 mgr.x (mgr.34562) 811 : cluster [DBG] pgmap v507: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:55:37.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:55:36 smithi188 bash[23329]: cluster 2020-07-16T13:55:35.720867+0000 mgr.x (mgr.34562) 812 : cluster [DBG] pgmap v508: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:55:37.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:55:36 smithi132 bash[27079]: cluster 2020-07-16T13:55:35.720867+0000 mgr.x (mgr.34562) 812 : cluster [DBG] pgmap v508: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:55:39.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:55:38 smithi188 bash[23329]: cluster 2020-07-16T13:55:37.721294+0000 mgr.x (mgr.34562) 813 : cluster [DBG] pgmap v509: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:55:39.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:55:38 smithi188 bash[23329]: audit 2020-07-16T13:55:38.317628+0000 mon.b (mon.2) 306 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:55:39.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:55:38 smithi188 bash[23329]: audit 2020-07-16T13:55:38.319484+0000 mon.b (mon.2) 307 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:55:39.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:55:38 smithi188 bash[23329]: audit 2020-07-16T13:55:38.320708+0000 mon.b (mon.2) 308 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:55:39.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:55:38 smithi188 bash[23329]: audit 2020-07-16T13:55:38.322136+0000 mon.b (mon.2) 309 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T13:55:39.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:55:38 smithi188 bash[23329]: audit 2020-07-16T13:55:38.323504+0000 mon.b (mon.2) 310 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:55:39.183 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:55:38 smithi132 bash[27079]: cluster 2020-07-16T13:55:37.721294+0000 mgr.x (mgr.34562) 813 : cluster [DBG] pgmap v509: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:55:39.183 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:55:38 smithi132 bash[27079]: audit 2020-07-16T13:55:38.317628+0000 mon.b (mon.2) 306 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:55:39.185 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:55:38 smithi132 bash[27079]: audit 2020-07-16T13:55:38.319484+0000 mon.b (mon.2) 307 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:55:39.185 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:55:38 smithi132 bash[27079]: audit 2020-07-16T13:55:38.320708+0000 mon.b (mon.2) 308 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:55:39.186 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:55:38 smithi132 bash[27079]: audit 2020-07-16T13:55:38.322136+0000 mon.b (mon.2) 309 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T13:55:39.186 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:55:38 smithi132 bash[27079]: audit 2020-07-16T13:55:38.323504+0000 mon.b (mon.2) 310 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:55:40.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:55:39 smithi188 bash[23329]: audit 2020-07-16T13:55:38.318038+0000 mgr.x (mgr.34562) 814 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:55:40.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:55:39 smithi188 bash[23329]: audit 2020-07-16T13:55:38.319766+0000 mgr.x (mgr.34562) 815 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:55:40.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:55:39 smithi188 bash[23329]: audit 2020-07-16T13:55:38.321012+0000 mgr.x (mgr.34562) 816 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:55:40.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:55:39 smithi188 bash[23329]: cephadm 2020-07-16T13:55:38.321758+0000 mgr.x (mgr.34562) 817 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T13:55:40.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:55:39 smithi188 bash[23329]: cephadm 2020-07-16T13:55:38.323000+0000 mgr.x (mgr.34562) 818 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T13:55:40.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:55:39 smithi188 bash[23329]: cephadm 2020-07-16T13:55:38.324199+0000 mgr.x (mgr.34562) 819 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T13:55:40.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:55:39 smithi188 bash[23329]: cephadm 2020-07-16T13:55:38.324528+0000 mgr.x (mgr.34562) 820 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T13:55:40.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:55:39 smithi132 bash[27079]: audit 2020-07-16T13:55:38.318038+0000 mgr.x (mgr.34562) 814 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:55:40.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:55:39 smithi132 bash[27079]: audit 2020-07-16T13:55:38.319766+0000 mgr.x (mgr.34562) 815 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:55:40.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:55:39 smithi132 bash[27079]: audit 2020-07-16T13:55:38.321012+0000 mgr.x (mgr.34562) 816 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:55:40.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:55:39 smithi132 bash[27079]: cephadm 2020-07-16T13:55:38.321758+0000 mgr.x (mgr.34562) 817 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T13:55:40.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:55:39 smithi132 bash[27079]: cephadm 2020-07-16T13:55:38.323000+0000 mgr.x (mgr.34562) 818 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T13:55:40.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:55:39 smithi132 bash[27079]: cephadm 2020-07-16T13:55:38.324199+0000 mgr.x (mgr.34562) 819 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T13:55:40.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:55:39 smithi132 bash[27079]: cephadm 2020-07-16T13:55:38.324528+0000 mgr.x (mgr.34562) 820 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T13:55:41.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:55:40 smithi132 bash[27079]: cluster 2020-07-16T13:55:39.721716+0000 mgr.x (mgr.34562) 821 : cluster [DBG] pgmap v510: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:55:41.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:55:40 smithi188 bash[23329]: cluster 2020-07-16T13:55:39.721716+0000 mgr.x (mgr.34562) 821 : cluster [DBG] pgmap v510: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:55:42.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:55:41 smithi188 bash[23329]: audit 2020-07-16T13:55:41.271057+0000 mon.b (mon.2) 311 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:55:42.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:55:41 smithi132 bash[27079]: audit 2020-07-16T13:55:41.271057+0000 mon.b (mon.2) 311 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:55:43.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:55:42 smithi188 bash[23329]: cephadm 2020-07-16T13:55:41.271778+0000 mgr.x (mgr.34562) 822 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:55:43.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:55:42 smithi188 bash[23329]: cephadm 2020-07-16T13:55:41.272083+0000 mgr.x (mgr.34562) 823 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:55:43.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:55:42 smithi188 bash[23329]: cluster 2020-07-16T13:55:41.722169+0000 mgr.x (mgr.34562) 824 : cluster [DBG] pgmap v511: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:55:43.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:55:42 smithi132 bash[27079]: cephadm 2020-07-16T13:55:41.271778+0000 mgr.x (mgr.34562) 822 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:55:43.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:55:42 smithi132 bash[27079]: cephadm 2020-07-16T13:55:41.272083+0000 mgr.x (mgr.34562) 823 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:55:43.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:55:42 smithi132 bash[27079]: cluster 2020-07-16T13:55:41.722169+0000 mgr.x (mgr.34562) 824 : cluster [DBG] pgmap v511: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:55:44.971 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T13:55:45.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:55:44 smithi188 bash[23329]: cluster 2020-07-16T13:55:43.722535+0000 mgr.x (mgr.34562) 825 : cluster [DBG] pgmap v512: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:55:45.232 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T13:55:45.232 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (18m) 6m ago 21m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T13:55:45.232 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (21m) 6m ago 21m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T13:55:45.233 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (18m) 6m ago 24m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T13:55:45.233 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (18m) 6m ago 26m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T13:55:45.233 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 6m ago 26m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T13:55:45.233 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (24m) 6m ago 24m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T13:55:45.234 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (24m) 6m ago 24m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T13:55:45.234 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (21m) 6m ago 21m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T13:55:45.234 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (21m) 6m ago 21m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T13:55:45.234 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (24m) 6m ago 24m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T13:55:45.234 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (23m) 6m ago 23m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T13:55:45.235 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (23m) 6m ago 23m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T13:55:45.235 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (23m) 6m ago 23m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T13:55:45.235 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (22m) 6m ago 23m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T13:55:45.235 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (22m) 6m ago 22m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T13:55:45.235 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (22m) 6m ago 22m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T13:55:45.236 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (22m) 6m ago 22m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T13:55:45.236 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (20m) 6m ago 21m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T13:55:45.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:55:44 smithi132 bash[27079]: cluster 2020-07-16T13:55:43.722535+0000 mgr.x (mgr.34562) 825 : cluster [DBG] pgmap v512: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:55:45.529 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T13:55:45.529 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T13:55:45.530 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T13:55:45.530 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T13:55:45.530 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:55:45.530 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T13:55:45.530 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T13:55:45.531 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:55:45.531 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T13:55:45.531 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T13:55:45.531 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:55:45.531 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T13:55:45.532 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T13:55:45.532 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T13:55:45.532 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T13:55:45.532 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T13:55:45.532 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T13:55:46.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:55:45 smithi188 bash[23329]: audit 2020-07-16T13:55:44.959477+0000 mgr.x (mgr.34562) 826 : audit [DBG] from='client.25234 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:55:46.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:55:45 smithi188 bash[23329]: audit 2020-07-16T13:55:45.528119+0000 mon.c (mon.1) 107 : audit [DBG] from='client.? 172.21.15.132:0/666773305' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:55:46.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:55:45 smithi132 bash[27079]: audit 2020-07-16T13:55:44.959477+0000 mgr.x (mgr.34562) 826 : audit [DBG] from='client.25234 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:55:46.296 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:55:45 smithi132 bash[27079]: audit 2020-07-16T13:55:45.528119+0000 mon.c (mon.1) 107 : audit [DBG] from='client.? 172.21.15.132:0/666773305' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:55:47.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:55:46 smithi188 bash[23329]: audit 2020-07-16T13:55:45.227648+0000 mgr.x (mgr.34562) 827 : audit [DBG] from='client.25240 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:55:47.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:55:46 smithi188 bash[23329]: cluster 2020-07-16T13:55:45.722962+0000 mgr.x (mgr.34562) 828 : cluster [DBG] pgmap v513: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:55:47.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:55:46 smithi132 bash[27079]: audit 2020-07-16T13:55:45.227648+0000 mgr.x (mgr.34562) 827 : audit [DBG] from='client.25240 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:55:47.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:55:46 smithi132 bash[27079]: cluster 2020-07-16T13:55:45.722962+0000 mgr.x (mgr.34562) 828 : cluster [DBG] pgmap v513: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:55:49.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:55:48 smithi188 bash[23329]: cluster 2020-07-16T13:55:47.723541+0000 mgr.x (mgr.34562) 829 : cluster [DBG] pgmap v514: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:55:49.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:55:48 smithi132 bash[27079]: cluster 2020-07-16T13:55:47.723541+0000 mgr.x (mgr.34562) 829 : cluster [DBG] pgmap v514: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:55:50.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:55:50 smithi188 bash[23329]: cluster 2020-07-16T13:55:49.723959+0000 mgr.x (mgr.34562) 830 : cluster [DBG] pgmap v515: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:55:50.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:55:50 smithi132 bash[27079]: cluster 2020-07-16T13:55:49.723959+0000 mgr.x (mgr.34562) 830 : cluster [DBG] pgmap v515: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:55:53.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:55:52 smithi188 bash[23329]: cluster 2020-07-16T13:55:51.724551+0000 mgr.x (mgr.34562) 831 : cluster [DBG] pgmap v516: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:55:53.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:55:52 smithi132 bash[27079]: cluster 2020-07-16T13:55:51.724551+0000 mgr.x (mgr.34562) 831 : cluster [DBG] pgmap v516: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:55:55.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:55:54 smithi188 bash[23329]: cluster 2020-07-16T13:55:53.724954+0000 mgr.x (mgr.34562) 832 : cluster [DBG] pgmap v517: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:55:55.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:55:54 smithi132 bash[27079]: cluster 2020-07-16T13:55:53.724954+0000 mgr.x (mgr.34562) 832 : cluster [DBG] pgmap v517: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:55:57.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:55:56 smithi188 bash[23329]: cluster 2020-07-16T13:55:55.725445+0000 mgr.x (mgr.34562) 833 : cluster [DBG] pgmap v518: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:55:57.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:55:56 smithi188 bash[23329]: audit 2020-07-16T13:55:56.274792+0000 mon.b (mon.2) 312 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:55:57.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:55:56 smithi132 bash[27079]: cluster 2020-07-16T13:55:55.725445+0000 mgr.x (mgr.34562) 833 : cluster [DBG] pgmap v518: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:55:57.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:55:56 smithi132 bash[27079]: audit 2020-07-16T13:55:56.274792+0000 mon.b (mon.2) 312 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:55:58.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:55:57 smithi188 bash[23329]: cephadm 2020-07-16T13:55:56.275457+0000 mgr.x (mgr.34562) 834 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:55:58.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:55:57 smithi188 bash[23329]: cephadm 2020-07-16T13:55:56.275764+0000 mgr.x (mgr.34562) 835 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:55:58.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:55:57 smithi132 bash[27079]: cephadm 2020-07-16T13:55:56.275457+0000 mgr.x (mgr.34562) 834 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:55:58.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:55:57 smithi132 bash[27079]: cephadm 2020-07-16T13:55:56.275764+0000 mgr.x (mgr.34562) 835 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:55:59.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:55:58 smithi188 bash[23329]: cluster 2020-07-16T13:55:57.725856+0000 mgr.x (mgr.34562) 836 : cluster [DBG] pgmap v519: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:55:59.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:55:58 smithi132 bash[27079]: cluster 2020-07-16T13:55:57.725856+0000 mgr.x (mgr.34562) 836 : cluster [DBG] pgmap v519: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:56:00.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:56:00 smithi188 bash[23329]: cluster 2020-07-16T13:55:59.726246+0000 mgr.x (mgr.34562) 837 : cluster [DBG] pgmap v520: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:56:00.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:56:00 smithi132 bash[27079]: cluster 2020-07-16T13:55:59.726246+0000 mgr.x (mgr.34562) 837 : cluster [DBG] pgmap v520: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:56:03.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:56:02 smithi188 bash[23329]: cluster 2020-07-16T13:56:01.726662+0000 mgr.x (mgr.34562) 838 : cluster [DBG] pgmap v521: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:56:03.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:56:02 smithi132 bash[27079]: cluster 2020-07-16T13:56:01.726662+0000 mgr.x (mgr.34562) 838 : cluster [DBG] pgmap v521: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:56:05.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:56:04 smithi188 bash[23329]: cluster 2020-07-16T13:56:03.727083+0000 mgr.x (mgr.34562) 839 : cluster [DBG] pgmap v522: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:56:05.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:56:04 smithi132 bash[27079]: cluster 2020-07-16T13:56:03.727083+0000 mgr.x (mgr.34562) 839 : cluster [DBG] pgmap v522: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:56:07.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:56:06 smithi188 bash[23329]: cluster 2020-07-16T13:56:05.727431+0000 mgr.x (mgr.34562) 840 : cluster [DBG] pgmap v523: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:56:07.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:56:06 smithi132 bash[27079]: cluster 2020-07-16T13:56:05.727431+0000 mgr.x (mgr.34562) 840 : cluster [DBG] pgmap v523: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:56:09.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:56:08 smithi188 bash[23329]: cluster 2020-07-16T13:56:07.727840+0000 mgr.x (mgr.34562) 841 : cluster [DBG] pgmap v524: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:56:09.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:56:08 smithi132 bash[27079]: cluster 2020-07-16T13:56:07.727840+0000 mgr.x (mgr.34562) 841 : cluster [DBG] pgmap v524: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:56:10.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:56:10 smithi188 bash[23329]: cluster 2020-07-16T13:56:09.728233+0000 mgr.x (mgr.34562) 842 : cluster [DBG] pgmap v525: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:56:10.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:56:10 smithi132 bash[27079]: cluster 2020-07-16T13:56:09.728233+0000 mgr.x (mgr.34562) 842 : cluster [DBG] pgmap v525: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:56:11.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:56:11 smithi188 bash[23329]: audit 2020-07-16T13:56:11.291226+0000 mon.b (mon.2) 313 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:56:11.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:56:11 smithi132 bash[27079]: audit 2020-07-16T13:56:11.291226+0000 mon.b (mon.2) 313 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:56:12.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:56:12 smithi188 bash[23329]: cephadm 2020-07-16T13:56:11.291941+0000 mgr.x (mgr.34562) 843 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:56:12.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:56:12 smithi188 bash[23329]: cephadm 2020-07-16T13:56:11.292311+0000 mgr.x (mgr.34562) 844 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:56:12.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:56:12 smithi188 bash[23329]: cluster 2020-07-16T13:56:11.728664+0000 mgr.x (mgr.34562) 845 : cluster [DBG] pgmap v526: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:56:12.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:56:12 smithi132 bash[27079]: cephadm 2020-07-16T13:56:11.291941+0000 mgr.x (mgr.34562) 843 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:56:12.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:56:12 smithi132 bash[27079]: cephadm 2020-07-16T13:56:11.292311+0000 mgr.x (mgr.34562) 844 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:56:12.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:56:12 smithi132 bash[27079]: cluster 2020-07-16T13:56:11.728664+0000 mgr.x (mgr.34562) 845 : cluster [DBG] pgmap v526: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:56:15.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:56:14 smithi188 bash[23329]: cluster 2020-07-16T13:56:13.729161+0000 mgr.x (mgr.34562) 846 : cluster [DBG] pgmap v527: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:56:15.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:56:14 smithi132 bash[27079]: cluster 2020-07-16T13:56:13.729161+0000 mgr.x (mgr.34562) 846 : cluster [DBG] pgmap v527: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:56:15.829 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T13:56:16.088 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T13:56:16.088 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (19m) 6m ago 22m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T13:56:16.088 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (21m) 6m ago 21m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T13:56:16.089 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (19m) 6m ago 24m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T13:56:16.089 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (18m) 6m ago 26m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T13:56:16.089 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 6m ago 26m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T13:56:16.089 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (25m) 6m ago 25m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T13:56:16.089 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (25m) 6m ago 25m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T13:56:16.090 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (22m) 6m ago 22m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T13:56:16.090 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (22m) 6m ago 22m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T13:56:16.090 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (24m) 6m ago 24m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T13:56:16.090 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (24m) 6m ago 24m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T13:56:16.090 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (24m) 6m ago 24m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T13:56:16.090 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (23m) 6m ago 23m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T13:56:16.091 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (23m) 6m ago 23m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T13:56:16.091 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (23m) 6m ago 23m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T13:56:16.091 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (22m) 6m ago 22m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T13:56:16.091 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (22m) 6m ago 22m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T13:56:16.091 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (21m) 6m ago 22m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T13:56:16.383 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T13:56:16.383 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T13:56:16.383 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T13:56:16.383 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T13:56:16.384 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:56:16.384 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T13:56:16.384 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T13:56:16.384 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:56:16.384 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T13:56:16.385 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T13:56:16.385 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:56:16.385 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T13:56:16.385 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T13:56:16.385 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T13:56:16.391 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T13:56:16.391 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T13:56:16.391 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T13:56:17.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:56:16 smithi188 bash[23329]: cluster 2020-07-16T13:56:15.729549+0000 mgr.x (mgr.34562) 847 : cluster [DBG] pgmap v528: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:56:17.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:56:16 smithi188 bash[23329]: audit 2020-07-16T13:56:15.816627+0000 mgr.x (mgr.34562) 848 : audit [DBG] from='client.25252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:56:17.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:56:16 smithi188 bash[23329]: audit 2020-07-16T13:56:16.382093+0000 mon.c (mon.1) 108 : audit [DBG] from='client.? 172.21.15.132:0/2930791372' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:56:17.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:56:16 smithi132 bash[27079]: cluster 2020-07-16T13:56:15.729549+0000 mgr.x (mgr.34562) 847 : cluster [DBG] pgmap v528: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:56:17.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:56:16 smithi132 bash[27079]: audit 2020-07-16T13:56:15.816627+0000 mgr.x (mgr.34562) 848 : audit [DBG] from='client.25252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:56:17.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:56:16 smithi132 bash[27079]: audit 2020-07-16T13:56:16.382093+0000 mon.c (mon.1) 108 : audit [DBG] from='client.? 172.21.15.132:0/2930791372' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:56:18.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:56:17 smithi188 bash[23329]: audit 2020-07-16T13:56:16.083407+0000 mgr.x (mgr.34562) 849 : audit [DBG] from='client.25258 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:56:18.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:56:17 smithi132 bash[27079]: audit 2020-07-16T13:56:16.083407+0000 mgr.x (mgr.34562) 849 : audit [DBG] from='client.25258 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:56:19.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:56:18 smithi188 bash[23329]: cluster 2020-07-16T13:56:17.730082+0000 mgr.x (mgr.34562) 850 : cluster [DBG] pgmap v529: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:56:19.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:56:18 smithi132 bash[27079]: cluster 2020-07-16T13:56:17.730082+0000 mgr.x (mgr.34562) 850 : cluster [DBG] pgmap v529: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:56:20.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:56:20 smithi188 bash[23329]: cluster 2020-07-16T13:56:19.730542+0000 mgr.x (mgr.34562) 851 : cluster [DBG] pgmap v530: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:56:20.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:56:20 smithi132 bash[27079]: cluster 2020-07-16T13:56:19.730542+0000 mgr.x (mgr.34562) 851 : cluster [DBG] pgmap v530: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:56:23.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:56:22 smithi188 bash[23329]: cluster 2020-07-16T13:56:21.730994+0000 mgr.x (mgr.34562) 852 : cluster [DBG] pgmap v531: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:56:23.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:56:22 smithi132 bash[27079]: cluster 2020-07-16T13:56:21.730994+0000 mgr.x (mgr.34562) 852 : cluster [DBG] pgmap v531: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:56:25.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:56:24 smithi188 bash[23329]: cluster 2020-07-16T13:56:23.731510+0000 mgr.x (mgr.34562) 853 : cluster [DBG] pgmap v532: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:56:25.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:56:24 smithi132 bash[27079]: cluster 2020-07-16T13:56:23.731510+0000 mgr.x (mgr.34562) 853 : cluster [DBG] pgmap v532: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:56:27.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:56:26 smithi188 bash[23329]: cluster 2020-07-16T13:56:25.731919+0000 mgr.x (mgr.34562) 854 : cluster [DBG] pgmap v533: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:56:27.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:56:26 smithi188 bash[23329]: audit 2020-07-16T13:56:26.302817+0000 mon.b (mon.2) 314 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:56:27.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:56:26 smithi132 bash[27079]: cluster 2020-07-16T13:56:25.731919+0000 mgr.x (mgr.34562) 854 : cluster [DBG] pgmap v533: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:56:27.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:56:26 smithi132 bash[27079]: audit 2020-07-16T13:56:26.302817+0000 mon.b (mon.2) 314 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:56:28.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:56:27 smithi188 bash[23329]: cephadm 2020-07-16T13:56:26.303503+0000 mgr.x (mgr.34562) 855 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:56:28.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:56:27 smithi188 bash[23329]: cephadm 2020-07-16T13:56:26.303586+0000 mgr.x (mgr.34562) 856 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:56:28.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:56:27 smithi132 bash[27079]: cephadm 2020-07-16T13:56:26.303503+0000 mgr.x (mgr.34562) 855 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:56:28.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:56:27 smithi132 bash[27079]: cephadm 2020-07-16T13:56:26.303586+0000 mgr.x (mgr.34562) 856 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:56:29.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:56:28 smithi188 bash[23329]: cluster 2020-07-16T13:56:27.732338+0000 mgr.x (mgr.34562) 857 : cluster [DBG] pgmap v534: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:56:29.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:56:28 smithi132 bash[27079]: cluster 2020-07-16T13:56:27.732338+0000 mgr.x (mgr.34562) 857 : cluster [DBG] pgmap v534: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:56:30.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:56:30 smithi188 bash[23329]: cluster 2020-07-16T13:56:29.732876+0000 mgr.x (mgr.34562) 858 : cluster [DBG] pgmap v535: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:56:30.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:56:30 smithi132 bash[27079]: cluster 2020-07-16T13:56:29.732876+0000 mgr.x (mgr.34562) 858 : cluster [DBG] pgmap v535: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:56:33.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:56:32 smithi188 bash[23329]: cluster 2020-07-16T13:56:31.733466+0000 mgr.x (mgr.34562) 859 : cluster [DBG] pgmap v536: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:56:33.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:56:32 smithi132 bash[27079]: cluster 2020-07-16T13:56:31.733466+0000 mgr.x (mgr.34562) 859 : cluster [DBG] pgmap v536: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:56:35.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:56:34 smithi188 bash[23329]: cluster 2020-07-16T13:56:33.733850+0000 mgr.x (mgr.34562) 860 : cluster [DBG] pgmap v537: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:56:35.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:56:34 smithi132 bash[27079]: cluster 2020-07-16T13:56:33.733850+0000 mgr.x (mgr.34562) 860 : cluster [DBG] pgmap v537: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:56:37.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:56:36 smithi188 bash[23329]: cluster 2020-07-16T13:56:35.734247+0000 mgr.x (mgr.34562) 861 : cluster [DBG] pgmap v538: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:56:37.287 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:56:36 smithi132 bash[27079]: cluster 2020-07-16T13:56:35.734247+0000 mgr.x (mgr.34562) 861 : cluster [DBG] pgmap v538: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:56:39.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:56:38 smithi188 bash[23329]: cluster 2020-07-16T13:56:37.734662+0000 mgr.x (mgr.34562) 862 : cluster [DBG] pgmap v539: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:56:39.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:56:38 smithi132 bash[27079]: cluster 2020-07-16T13:56:37.734662+0000 mgr.x (mgr.34562) 862 : cluster [DBG] pgmap v539: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:56:40.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:56:40 smithi188 bash[23329]: cluster 2020-07-16T13:56:39.735076+0000 mgr.x (mgr.34562) 863 : cluster [DBG] pgmap v540: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:56:40.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:56:40 smithi132 bash[27079]: cluster 2020-07-16T13:56:39.735076+0000 mgr.x (mgr.34562) 863 : cluster [DBG] pgmap v540: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:56:41.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:56:41 smithi188 bash[23329]: audit 2020-07-16T13:56:41.321983+0000 mon.b (mon.2) 315 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:56:41.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:56:41 smithi188 bash[23329]: audit 2020-07-16T13:56:41.323343+0000 mon.b (mon.2) 316 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:56:41.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:56:41 smithi188 bash[23329]: audit 2020-07-16T13:56:41.324611+0000 mon.b (mon.2) 317 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:56:41.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:56:41 smithi188 bash[23329]: audit 2020-07-16T13:56:41.326157+0000 mon.b (mon.2) 318 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T13:56:41.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:56:41 smithi188 bash[23329]: audit 2020-07-16T13:56:41.327401+0000 mon.b (mon.2) 319 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:56:41.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:56:41 smithi132 bash[27079]: audit 2020-07-16T13:56:41.321983+0000 mon.b (mon.2) 315 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:56:41.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:56:41 smithi132 bash[27079]: audit 2020-07-16T13:56:41.323343+0000 mon.b (mon.2) 316 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:56:41.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:56:41 smithi132 bash[27079]: audit 2020-07-16T13:56:41.324611+0000 mon.b (mon.2) 317 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:56:41.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:56:41 smithi132 bash[27079]: audit 2020-07-16T13:56:41.326157+0000 mon.b (mon.2) 318 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T13:56:41.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:56:41 smithi132 bash[27079]: audit 2020-07-16T13:56:41.327401+0000 mon.b (mon.2) 319 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:56:42.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:56:42 smithi188 bash[23329]: audit 2020-07-16T13:56:41.322360+0000 mgr.x (mgr.34562) 864 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:56:42.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:56:42 smithi188 bash[23329]: audit 2020-07-16T13:56:41.323652+0000 mgr.x (mgr.34562) 865 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:56:42.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:56:42 smithi188 bash[23329]: audit 2020-07-16T13:56:41.324906+0000 mgr.x (mgr.34562) 866 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:56:42.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:56:42 smithi188 bash[23329]: cephadm 2020-07-16T13:56:41.325672+0000 mgr.x (mgr.34562) 867 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T13:56:42.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:56:42 smithi188 bash[23329]: cephadm 2020-07-16T13:56:41.327068+0000 mgr.x (mgr.34562) 868 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T13:56:42.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:56:42 smithi188 bash[23329]: cephadm 2020-07-16T13:56:41.328082+0000 mgr.x (mgr.34562) 869 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T13:56:42.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:56:42 smithi188 bash[23329]: cephadm 2020-07-16T13:56:41.328321+0000 mgr.x (mgr.34562) 870 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T13:56:42.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:56:42 smithi188 bash[23329]: cluster 2020-07-16T13:56:41.735560+0000 mgr.x (mgr.34562) 871 : cluster [DBG] pgmap v541: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:56:42.691 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:56:42 smithi132 bash[27079]: audit 2020-07-16T13:56:41.322360+0000 mgr.x (mgr.34562) 864 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:56:42.691 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:56:42 smithi132 bash[27079]: audit 2020-07-16T13:56:41.323652+0000 mgr.x (mgr.34562) 865 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:56:42.691 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:56:42 smithi132 bash[27079]: audit 2020-07-16T13:56:41.324906+0000 mgr.x (mgr.34562) 866 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:56:42.692 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:56:42 smithi132 bash[27079]: cephadm 2020-07-16T13:56:41.325672+0000 mgr.x (mgr.34562) 867 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T13:56:42.692 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:56:42 smithi132 bash[27079]: cephadm 2020-07-16T13:56:41.327068+0000 mgr.x (mgr.34562) 868 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T13:56:42.692 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:56:42 smithi132 bash[27079]: cephadm 2020-07-16T13:56:41.328082+0000 mgr.x (mgr.34562) 869 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T13:56:42.692 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:56:42 smithi132 bash[27079]: cephadm 2020-07-16T13:56:41.328321+0000 mgr.x (mgr.34562) 870 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T13:56:42.692 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:56:42 smithi132 bash[27079]: cluster 2020-07-16T13:56:41.735560+0000 mgr.x (mgr.34562) 871 : cluster [DBG] pgmap v541: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:56:45.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:56:44 smithi188 bash[23329]: cluster 2020-07-16T13:56:43.735972+0000 mgr.x (mgr.34562) 872 : cluster [DBG] pgmap v542: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:56:45.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:56:44 smithi188 bash[23329]: audit 2020-07-16T13:56:44.059690+0000 mon.b (mon.2) 320 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:56:45.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:56:44 smithi132 bash[27079]: cluster 2020-07-16T13:56:43.735972+0000 mgr.x (mgr.34562) 872 : cluster [DBG] pgmap v542: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:56:45.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:56:44 smithi132 bash[27079]: audit 2020-07-16T13:56:44.059690+0000 mon.b (mon.2) 320 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:56:46.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:56:45 smithi188 bash[23329]: cephadm 2020-07-16T13:56:44.060342+0000 mgr.x (mgr.34562) 873 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:56:46.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:56:45 smithi188 bash[23329]: cephadm 2020-07-16T13:56:44.060420+0000 mgr.x (mgr.34562) 874 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:56:46.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:56:45 smithi132 bash[27079]: cephadm 2020-07-16T13:56:44.060342+0000 mgr.x (mgr.34562) 873 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:56:46.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:56:45 smithi132 bash[27079]: cephadm 2020-07-16T13:56:44.060420+0000 mgr.x (mgr.34562) 874 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:56:46.684 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T13:56:46.945 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T13:56:46.946 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (19m) 7m ago 22m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T13:56:46.946 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (22m) 7m ago 22m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T13:56:46.946 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (19m) 7m ago 25m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T13:56:46.946 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (19m) 7m ago 27m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T13:56:46.947 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 7m ago 27m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T13:56:46.947 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (25m) 7m ago 25m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T13:56:46.947 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (25m) 7m ago 25m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T13:56:46.947 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (22m) 7m ago 22m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T13:56:46.948 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (22m) 7m ago 22m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T13:56:46.948 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (25m) 7m ago 25m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T13:56:46.948 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (24m) 7m ago 24m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T13:56:46.948 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (24m) 7m ago 24m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T13:56:46.948 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (24m) 7m ago 24m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T13:56:46.949 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (23m) 7m ago 24m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T13:56:46.949 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (23m) 7m ago 23m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T13:56:46.949 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (23m) 7m ago 23m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T13:56:46.949 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (23m) 7m ago 23m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T13:56:46.949 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (22m) 7m ago 22m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T13:56:47.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:56:46 smithi188 bash[23329]: cluster 2020-07-16T13:56:45.736458+0000 mgr.x (mgr.34562) 875 : cluster [DBG] pgmap v543: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:56:47.241 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T13:56:47.241 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T13:56:47.242 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T13:56:47.242 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T13:56:47.242 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:56:47.243 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T13:56:47.243 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T13:56:47.243 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:56:47.244 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T13:56:47.244 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T13:56:47.244 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:56:47.245 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T13:56:47.245 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T13:56:47.245 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T13:56:47.246 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T13:56:47.246 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T13:56:47.246 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T13:56:47.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:56:46 smithi132 bash[27079]: cluster 2020-07-16T13:56:45.736458+0000 mgr.x (mgr.34562) 875 : cluster [DBG] pgmap v543: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:56:48.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:56:47 smithi188 bash[23329]: audit 2020-07-16T13:56:46.672159+0000 mgr.x (mgr.34562) 876 : audit [DBG] from='client.25270 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:56:48.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:56:47 smithi188 bash[23329]: audit 2020-07-16T13:56:46.941100+0000 mgr.x (mgr.34562) 877 : audit [DBG] from='client.25276 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:56:48.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:56:47 smithi188 bash[23329]: audit 2020-07-16T13:56:47.240118+0000 mon.c (mon.1) 109 : audit [DBG] from='client.? 172.21.15.132:0/1032015026' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:56:48.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:56:47 smithi132 bash[27079]: audit 2020-07-16T13:56:46.672159+0000 mgr.x (mgr.34562) 876 : audit [DBG] from='client.25270 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:56:48.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:56:47 smithi132 bash[27079]: audit 2020-07-16T13:56:46.941100+0000 mgr.x (mgr.34562) 877 : audit [DBG] from='client.25276 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:56:48.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:56:47 smithi132 bash[27079]: audit 2020-07-16T13:56:47.240118+0000 mon.c (mon.1) 109 : audit [DBG] from='client.? 172.21.15.132:0/1032015026' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:56:49.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:56:48 smithi188 bash[23329]: cluster 2020-07-16T13:56:47.736932+0000 mgr.x (mgr.34562) 878 : cluster [DBG] pgmap v544: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:56:49.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:56:48 smithi132 bash[27079]: cluster 2020-07-16T13:56:47.736932+0000 mgr.x (mgr.34562) 878 : cluster [DBG] pgmap v544: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:56:50.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:56:50 smithi188 bash[23329]: cluster 2020-07-16T13:56:49.737350+0000 mgr.x (mgr.34562) 879 : cluster [DBG] pgmap v545: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:56:50.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:56:50 smithi132 bash[27079]: cluster 2020-07-16T13:56:49.737350+0000 mgr.x (mgr.34562) 879 : cluster [DBG] pgmap v545: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:56:53.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:56:52 smithi188 bash[23329]: cluster 2020-07-16T13:56:51.737706+0000 mgr.x (mgr.34562) 880 : cluster [DBG] pgmap v546: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:56:53.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:56:52 smithi132 bash[27079]: cluster 2020-07-16T13:56:51.737706+0000 mgr.x (mgr.34562) 880 : cluster [DBG] pgmap v546: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:56:55.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:56:54 smithi188 bash[23329]: cluster 2020-07-16T13:56:53.738121+0000 mgr.x (mgr.34562) 881 : cluster [DBG] pgmap v547: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:56:55.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:56:54 smithi132 bash[27079]: cluster 2020-07-16T13:56:53.738121+0000 mgr.x (mgr.34562) 881 : cluster [DBG] pgmap v547: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:56:57.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:56:56 smithi188 bash[23329]: cluster 2020-07-16T13:56:55.738622+0000 mgr.x (mgr.34562) 882 : cluster [DBG] pgmap v548: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:56:57.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:56:56 smithi132 bash[27079]: cluster 2020-07-16T13:56:55.738622+0000 mgr.x (mgr.34562) 882 : cluster [DBG] pgmap v548: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:56:59.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:56:58 smithi188 bash[23329]: cluster 2020-07-16T13:56:57.739036+0000 mgr.x (mgr.34562) 883 : cluster [DBG] pgmap v549: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:56:59.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:56:58 smithi132 bash[27079]: cluster 2020-07-16T13:56:57.739036+0000 mgr.x (mgr.34562) 883 : cluster [DBG] pgmap v549: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:57:00.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:56:59 smithi188 bash[23329]: audit 2020-07-16T13:56:59.071301+0000 mon.b (mon.2) 321 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:57:00.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:56:59 smithi132 bash[27079]: audit 2020-07-16T13:56:59.071301+0000 mon.b (mon.2) 321 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:57:01.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:57:00 smithi188 bash[23329]: cephadm 2020-07-16T13:56:59.071985+0000 mgr.x (mgr.34562) 884 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:57:01.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:57:00 smithi188 bash[23329]: cephadm 2020-07-16T13:56:59.072061+0000 mgr.x (mgr.34562) 885 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:57:01.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:57:00 smithi188 bash[23329]: cluster 2020-07-16T13:56:59.739442+0000 mgr.x (mgr.34562) 886 : cluster [DBG] pgmap v550: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:57:01.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:57:00 smithi132 bash[27079]: cephadm 2020-07-16T13:56:59.071985+0000 mgr.x (mgr.34562) 884 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:57:01.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:57:00 smithi132 bash[27079]: cephadm 2020-07-16T13:56:59.072061+0000 mgr.x (mgr.34562) 885 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:57:01.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:57:00 smithi132 bash[27079]: cluster 2020-07-16T13:56:59.739442+0000 mgr.x (mgr.34562) 886 : cluster [DBG] pgmap v550: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:57:03.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:57:02 smithi188 bash[23329]: cluster 2020-07-16T13:57:01.739833+0000 mgr.x (mgr.34562) 887 : cluster [DBG] pgmap v551: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:57:03.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:57:02 smithi132 bash[27079]: cluster 2020-07-16T13:57:01.739833+0000 mgr.x (mgr.34562) 887 : cluster [DBG] pgmap v551: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:57:05.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:57:04 smithi188 bash[23329]: cluster 2020-07-16T13:57:03.740333+0000 mgr.x (mgr.34562) 888 : cluster [DBG] pgmap v552: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:57:05.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:57:04 smithi132 bash[27079]: cluster 2020-07-16T13:57:03.740333+0000 mgr.x (mgr.34562) 888 : cluster [DBG] pgmap v552: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:57:07.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:57:06 smithi188 bash[23329]: cluster 2020-07-16T13:57:05.740782+0000 mgr.x (mgr.34562) 889 : cluster [DBG] pgmap v553: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:57:07.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:57:06 smithi132 bash[27079]: cluster 2020-07-16T13:57:05.740782+0000 mgr.x (mgr.34562) 889 : cluster [DBG] pgmap v553: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:57:09.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:57:08 smithi188 bash[23329]: cluster 2020-07-16T13:57:07.741169+0000 mgr.x (mgr.34562) 890 : cluster [DBG] pgmap v554: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:57:09.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:57:08 smithi132 bash[27079]: cluster 2020-07-16T13:57:07.741169+0000 mgr.x (mgr.34562) 890 : cluster [DBG] pgmap v554: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:57:10.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:57:10 smithi132 bash[27079]: cluster 2020-07-16T13:57:09.741576+0000 mgr.x (mgr.34562) 891 : cluster [DBG] pgmap v555: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:57:10.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:57:10 smithi188 bash[23329]: cluster 2020-07-16T13:57:09.741576+0000 mgr.x (mgr.34562) 891 : cluster [DBG] pgmap v555: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:57:13.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:57:12 smithi188 bash[23329]: cluster 2020-07-16T13:57:11.741969+0000 mgr.x (mgr.34562) 892 : cluster [DBG] pgmap v556: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:57:13.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:57:12 smithi132 bash[27079]: cluster 2020-07-16T13:57:11.741969+0000 mgr.x (mgr.34562) 892 : cluster [DBG] pgmap v556: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:57:15.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:57:14 smithi188 bash[23329]: cluster 2020-07-16T13:57:13.742341+0000 mgr.x (mgr.34562) 893 : cluster [DBG] pgmap v557: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:57:15.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:57:14 smithi188 bash[23329]: audit 2020-07-16T13:57:14.087656+0000 mon.b (mon.2) 322 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:57:15.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:57:14 smithi132 bash[27079]: cluster 2020-07-16T13:57:13.742341+0000 mgr.x (mgr.34562) 893 : cluster [DBG] pgmap v557: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:57:15.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:57:14 smithi132 bash[27079]: audit 2020-07-16T13:57:14.087656+0000 mon.b (mon.2) 322 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:57:16.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:57:15 smithi188 bash[23329]: cephadm 2020-07-16T13:57:14.088371+0000 mgr.x (mgr.34562) 894 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:57:16.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:57:15 smithi188 bash[23329]: cephadm 2020-07-16T13:57:14.088859+0000 mgr.x (mgr.34562) 895 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:57:16.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:57:15 smithi132 bash[27079]: cephadm 2020-07-16T13:57:14.088371+0000 mgr.x (mgr.34562) 894 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:57:16.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:57:15 smithi132 bash[27079]: cephadm 2020-07-16T13:57:14.088859+0000 mgr.x (mgr.34562) 895 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:57:17.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:57:16 smithi188 bash[23329]: cluster 2020-07-16T13:57:15.742793+0000 mgr.x (mgr.34562) 896 : cluster [DBG] pgmap v558: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:57:17.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:57:16 smithi132 bash[27079]: cluster 2020-07-16T13:57:15.742793+0000 mgr.x (mgr.34562) 896 : cluster [DBG] pgmap v558: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:57:17.537 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T13:57:17.795 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T13:57:17.796 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (20m) 7m ago 23m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T13:57:17.796 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (22m) 7m ago 22m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T13:57:17.796 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (20m) 7m ago 25m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T13:57:17.796 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (19m) 7m ago 27m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T13:57:17.797 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 7m ago 27m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T13:57:17.797 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (26m) 7m ago 26m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T13:57:17.798 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (26m) 7m ago 26m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T13:57:17.798 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (23m) 7m ago 23m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T13:57:17.798 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (23m) 7m ago 23m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T13:57:17.798 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (25m) 7m ago 25m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T13:57:17.798 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (25m) 7m ago 25m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T13:57:17.799 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (25m) 7m ago 25m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T13:57:17.799 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (24m) 7m ago 24m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T13:57:17.799 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (24m) 7m ago 24m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T13:57:17.799 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (24m) 7m ago 24m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T13:57:17.799 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (23m) 7m ago 23m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T13:57:17.799 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (23m) 7m ago 23m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T13:57:17.800 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (22m) 7m ago 23m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T13:57:18.091 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T13:57:18.091 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T13:57:18.092 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T13:57:18.092 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T13:57:18.092 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:57:18.093 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T13:57:18.093 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T13:57:18.093 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:57:18.094 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T13:57:18.094 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T13:57:18.094 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:57:18.095 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T13:57:18.095 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T13:57:18.095 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T13:57:18.096 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T13:57:18.096 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T13:57:18.096 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T13:57:19.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:57:18 smithi188 bash[23329]: audit 2020-07-16T13:57:17.525484+0000 mgr.x (mgr.34562) 897 : audit [DBG] from='client.25288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:57:19.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:57:18 smithi188 bash[23329]: cluster 2020-07-16T13:57:17.743280+0000 mgr.x (mgr.34562) 898 : cluster [DBG] pgmap v559: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:57:19.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:57:18 smithi188 bash[23329]: audit 2020-07-16T13:57:17.791156+0000 mgr.x (mgr.34562) 899 : audit [DBG] from='client.25294 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:57:19.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:57:18 smithi188 bash[23329]: audit 2020-07-16T13:57:18.090138+0000 mon.c (mon.1) 110 : audit [DBG] from='client.? 172.21.15.132:0/1819422241' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:57:19.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:57:18 smithi132 bash[27079]: audit 2020-07-16T13:57:17.525484+0000 mgr.x (mgr.34562) 897 : audit [DBG] from='client.25288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:57:19.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:57:18 smithi132 bash[27079]: cluster 2020-07-16T13:57:17.743280+0000 mgr.x (mgr.34562) 898 : cluster [DBG] pgmap v559: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:57:19.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:57:18 smithi132 bash[27079]: audit 2020-07-16T13:57:17.791156+0000 mgr.x (mgr.34562) 899 : audit [DBG] from='client.25294 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:57:19.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:57:18 smithi132 bash[27079]: audit 2020-07-16T13:57:18.090138+0000 mon.c (mon.1) 110 : audit [DBG] from='client.? 172.21.15.132:0/1819422241' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:57:20.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:57:20 smithi188 bash[23329]: cluster 2020-07-16T13:57:19.743669+0000 mgr.x (mgr.34562) 900 : cluster [DBG] pgmap v560: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:57:20.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:57:20 smithi132 bash[27079]: cluster 2020-07-16T13:57:19.743669+0000 mgr.x (mgr.34562) 900 : cluster [DBG] pgmap v560: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:57:23.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:57:22 smithi188 bash[23329]: cluster 2020-07-16T13:57:21.744087+0000 mgr.x (mgr.34562) 901 : cluster [DBG] pgmap v561: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:57:23.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:57:22 smithi132 bash[27079]: cluster 2020-07-16T13:57:21.744087+0000 mgr.x (mgr.34562) 901 : cluster [DBG] pgmap v561: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:57:25.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:57:24 smithi188 bash[23329]: cluster 2020-07-16T13:57:23.744420+0000 mgr.x (mgr.34562) 902 : cluster [DBG] pgmap v562: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:57:25.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:57:24 smithi132 bash[27079]: cluster 2020-07-16T13:57:23.744420+0000 mgr.x (mgr.34562) 902 : cluster [DBG] pgmap v562: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:57:27.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:57:26 smithi188 bash[23329]: cluster 2020-07-16T13:57:25.744769+0000 mgr.x (mgr.34562) 903 : cluster [DBG] pgmap v563: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:57:27.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:57:26 smithi132 bash[27079]: cluster 2020-07-16T13:57:25.744769+0000 mgr.x (mgr.34562) 903 : cluster [DBG] pgmap v563: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:57:29.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:57:28 smithi188 bash[23329]: cluster 2020-07-16T13:57:27.745306+0000 mgr.x (mgr.34562) 904 : cluster [DBG] pgmap v564: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:57:29.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:57:28 smithi132 bash[27079]: cluster 2020-07-16T13:57:27.745306+0000 mgr.x (mgr.34562) 904 : cluster [DBG] pgmap v564: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:57:30.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:57:29 smithi188 bash[23329]: audit 2020-07-16T13:57:29.104319+0000 mon.b (mon.2) 323 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:57:30.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:57:29 smithi132 bash[27079]: audit 2020-07-16T13:57:29.104319+0000 mon.b (mon.2) 323 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:57:31.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:57:30 smithi188 bash[23329]: cephadm 2020-07-16T13:57:29.104971+0000 mgr.x (mgr.34562) 905 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:57:31.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:57:30 smithi188 bash[23329]: cephadm 2020-07-16T13:57:29.105212+0000 mgr.x (mgr.34562) 906 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:57:31.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:57:30 smithi188 bash[23329]: cluster 2020-07-16T13:57:29.745704+0000 mgr.x (mgr.34562) 907 : cluster [DBG] pgmap v565: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:57:31.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:57:30 smithi132 bash[27079]: cephadm 2020-07-16T13:57:29.104971+0000 mgr.x (mgr.34562) 905 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:57:31.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:57:30 smithi132 bash[27079]: cephadm 2020-07-16T13:57:29.105212+0000 mgr.x (mgr.34562) 906 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:57:31.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:57:30 smithi132 bash[27079]: cluster 2020-07-16T13:57:29.745704+0000 mgr.x (mgr.34562) 907 : cluster [DBG] pgmap v565: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:57:33.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:57:32 smithi188 bash[23329]: cluster 2020-07-16T13:57:31.746078+0000 mgr.x (mgr.34562) 908 : cluster [DBG] pgmap v566: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:57:33.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:57:32 smithi132 bash[27079]: cluster 2020-07-16T13:57:31.746078+0000 mgr.x (mgr.34562) 908 : cluster [DBG] pgmap v566: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:57:35.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:57:34 smithi188 bash[23329]: cluster 2020-07-16T13:57:33.746380+0000 mgr.x (mgr.34562) 909 : cluster [DBG] pgmap v567: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:57:35.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:57:34 smithi132 bash[27079]: cluster 2020-07-16T13:57:33.746380+0000 mgr.x (mgr.34562) 909 : cluster [DBG] pgmap v567: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:57:37.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:57:36 smithi188 bash[23329]: cluster 2020-07-16T13:57:35.746711+0000 mgr.x (mgr.34562) 910 : cluster [DBG] pgmap v568: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:57:37.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:57:36 smithi132 bash[27079]: cluster 2020-07-16T13:57:35.746711+0000 mgr.x (mgr.34562) 910 : cluster [DBG] pgmap v568: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:57:39.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:57:38 smithi188 bash[23329]: cluster 2020-07-16T13:57:37.747212+0000 mgr.x (mgr.34562) 911 : cluster [DBG] pgmap v569: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:57:39.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:57:38 smithi132 bash[27079]: cluster 2020-07-16T13:57:37.747212+0000 mgr.x (mgr.34562) 911 : cluster [DBG] pgmap v569: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:57:40.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:57:40 smithi132 bash[27079]: cluster 2020-07-16T13:57:39.747765+0000 mgr.x (mgr.34562) 912 : cluster [DBG] pgmap v570: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:57:40.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:57:40 smithi188 bash[23329]: cluster 2020-07-16T13:57:39.747765+0000 mgr.x (mgr.34562) 912 : cluster [DBG] pgmap v570: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:57:43.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:57:42 smithi188 bash[23329]: cluster 2020-07-16T13:57:41.748360+0000 mgr.x (mgr.34562) 913 : cluster [DBG] pgmap v571: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:57:43.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:57:42 smithi132 bash[27079]: cluster 2020-07-16T13:57:41.748360+0000 mgr.x (mgr.34562) 913 : cluster [DBG] pgmap v571: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:57:44.983 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:57:44 smithi132 bash[27079]: cluster 2020-07-16T13:57:43.748725+0000 mgr.x (mgr.34562) 914 : cluster [DBG] pgmap v572: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:57:44.983 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:57:44 smithi132 bash[27079]: audit 2020-07-16T13:57:44.123415+0000 mon.b (mon.2) 324 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:57:44.983 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:57:44 smithi132 bash[27079]: audit 2020-07-16T13:57:44.124819+0000 mon.b (mon.2) 325 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:57:44.984 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:57:44 smithi132 bash[27079]: audit 2020-07-16T13:57:44.125983+0000 mon.b (mon.2) 326 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:57:44.984 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:57:44 smithi132 bash[27079]: audit 2020-07-16T13:57:44.127345+0000 mon.b (mon.2) 327 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T13:57:44.984 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:57:44 smithi132 bash[27079]: audit 2020-07-16T13:57:44.128585+0000 mon.b (mon.2) 328 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:57:45.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:57:44 smithi188 bash[23329]: cluster 2020-07-16T13:57:43.748725+0000 mgr.x (mgr.34562) 914 : cluster [DBG] pgmap v572: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:57:45.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:57:44 smithi188 bash[23329]: audit 2020-07-16T13:57:44.123415+0000 mon.b (mon.2) 324 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:57:45.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:57:44 smithi188 bash[23329]: audit 2020-07-16T13:57:44.124819+0000 mon.b (mon.2) 325 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:57:45.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:57:44 smithi188 bash[23329]: audit 2020-07-16T13:57:44.125983+0000 mon.b (mon.2) 326 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:57:45.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:57:44 smithi188 bash[23329]: audit 2020-07-16T13:57:44.127345+0000 mon.b (mon.2) 327 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T13:57:45.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:57:44 smithi188 bash[23329]: audit 2020-07-16T13:57:44.128585+0000 mon.b (mon.2) 328 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:57:46.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:57:45 smithi132 bash[27079]: audit 2020-07-16T13:57:44.123774+0000 mgr.x (mgr.34562) 915 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:57:46.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:57:45 smithi132 bash[27079]: audit 2020-07-16T13:57:44.125120+0000 mgr.x (mgr.34562) 916 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:57:46.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:57:45 smithi132 bash[27079]: audit 2020-07-16T13:57:44.126273+0000 mgr.x (mgr.34562) 917 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:57:46.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:57:45 smithi132 bash[27079]: cephadm 2020-07-16T13:57:44.127062+0000 mgr.x (mgr.34562) 918 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T13:57:46.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:57:45 smithi132 bash[27079]: cephadm 2020-07-16T13:57:44.128229+0000 mgr.x (mgr.34562) 919 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T13:57:46.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:57:45 smithi132 bash[27079]: cephadm 2020-07-16T13:57:44.129381+0000 mgr.x (mgr.34562) 920 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T13:57:46.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:57:45 smithi132 bash[27079]: cephadm 2020-07-16T13:57:44.129498+0000 mgr.x (mgr.34562) 921 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T13:57:46.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:57:45 smithi188 bash[23329]: audit 2020-07-16T13:57:44.123774+0000 mgr.x (mgr.34562) 915 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:57:46.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:57:45 smithi188 bash[23329]: audit 2020-07-16T13:57:44.125120+0000 mgr.x (mgr.34562) 916 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:57:46.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:57:45 smithi188 bash[23329]: audit 2020-07-16T13:57:44.126273+0000 mgr.x (mgr.34562) 917 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:57:46.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:57:45 smithi188 bash[23329]: cephadm 2020-07-16T13:57:44.127062+0000 mgr.x (mgr.34562) 918 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T13:57:46.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:57:45 smithi188 bash[23329]: cephadm 2020-07-16T13:57:44.128229+0000 mgr.x (mgr.34562) 919 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T13:57:46.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:57:45 smithi188 bash[23329]: cephadm 2020-07-16T13:57:44.129381+0000 mgr.x (mgr.34562) 920 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T13:57:46.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:57:45 smithi188 bash[23329]: cephadm 2020-07-16T13:57:44.129498+0000 mgr.x (mgr.34562) 921 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T13:57:47.107 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:57:46 smithi132 bash[27079]: cluster 2020-07-16T13:57:45.749098+0000 mgr.x (mgr.34562) 922 : cluster [DBG] pgmap v573: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:57:47.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:57:46 smithi188 bash[23329]: cluster 2020-07-16T13:57:45.749098+0000 mgr.x (mgr.34562) 922 : cluster [DBG] pgmap v573: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:57:48.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:57:47 smithi188 bash[23329]: audit 2020-07-16T13:57:47.120523+0000 mon.b (mon.2) 329 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:57:48.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:57:47 smithi132 bash[27079]: audit 2020-07-16T13:57:47.120523+0000 mon.b (mon.2) 329 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:57:48.391 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T13:57:48.651 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T13:57:48.651 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (20m) 8m ago 23m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T13:57:48.651 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (23m) 8m ago 23m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T13:57:48.652 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (20m) 8m ago 26m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T13:57:48.652 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (20m) 8m ago 28m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T13:57:48.652 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 8m ago 28m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T13:57:48.652 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (26m) 8m ago 26m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T13:57:48.652 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (26m) 8m ago 26m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T13:57:48.653 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (23m) 8m ago 23m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T13:57:48.653 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (23m) 8m ago 23m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T13:57:48.653 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (26m) 8m ago 26m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T13:57:48.653 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (25m) 8m ago 25m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T13:57:48.653 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (25m) 8m ago 25m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T13:57:48.654 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (25m) 8m ago 25m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T13:57:48.658 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (24m) 8m ago 25m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T13:57:48.659 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (24m) 8m ago 24m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T13:57:48.659 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (24m) 8m ago 24m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T13:57:48.659 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (24m) 8m ago 24m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T13:57:48.659 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (23m) 8m ago 23m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T13:57:48.949 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T13:57:48.950 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T13:57:48.950 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T13:57:48.950 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T13:57:48.950 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:57:48.950 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T13:57:48.951 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T13:57:48.951 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:57:48.951 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T13:57:48.951 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T13:57:48.951 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:57:48.951 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T13:57:48.952 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T13:57:48.952 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T13:57:48.952 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T13:57:48.952 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T13:57:48.952 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T13:57:49.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:57:48 smithi188 bash[23329]: cephadm 2020-07-16T13:57:47.121193+0000 mgr.x (mgr.34562) 923 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:57:49.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:57:48 smithi188 bash[23329]: cephadm 2020-07-16T13:57:47.121599+0000 mgr.x (mgr.34562) 924 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:57:49.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:57:48 smithi188 bash[23329]: cluster 2020-07-16T13:57:47.749540+0000 mgr.x (mgr.34562) 925 : cluster [DBG] pgmap v574: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:57:49.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:57:48 smithi132 bash[27079]: cephadm 2020-07-16T13:57:47.121193+0000 mgr.x (mgr.34562) 923 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:57:49.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:57:48 smithi132 bash[27079]: cephadm 2020-07-16T13:57:47.121599+0000 mgr.x (mgr.34562) 924 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:57:49.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:57:48 smithi132 bash[27079]: cluster 2020-07-16T13:57:47.749540+0000 mgr.x (mgr.34562) 925 : cluster [DBG] pgmap v574: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:57:50.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:57:49 smithi188 bash[23329]: audit 2020-07-16T13:57:48.379158+0000 mgr.x (mgr.34562) 926 : audit [DBG] from='client.25306 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:57:50.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:57:49 smithi188 bash[23329]: audit 2020-07-16T13:57:48.646644+0000 mgr.x (mgr.34562) 927 : audit [DBG] from='client.25312 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:57:50.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:57:49 smithi188 bash[23329]: audit 2020-07-16T13:57:48.948567+0000 mon.c (mon.1) 111 : audit [DBG] from='client.? 172.21.15.132:0/1063625400' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:57:50.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:57:49 smithi132 bash[27079]: audit 2020-07-16T13:57:48.379158+0000 mgr.x (mgr.34562) 926 : audit [DBG] from='client.25306 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:57:50.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:57:49 smithi132 bash[27079]: audit 2020-07-16T13:57:48.646644+0000 mgr.x (mgr.34562) 927 : audit [DBG] from='client.25312 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:57:50.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:57:49 smithi132 bash[27079]: audit 2020-07-16T13:57:48.948567+0000 mon.c (mon.1) 111 : audit [DBG] from='client.? 172.21.15.132:0/1063625400' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:57:51.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:57:50 smithi188 bash[23329]: cluster 2020-07-16T13:57:49.749992+0000 mgr.x (mgr.34562) 928 : cluster [DBG] pgmap v575: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:57:51.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:57:50 smithi132 bash[27079]: cluster 2020-07-16T13:57:49.749992+0000 mgr.x (mgr.34562) 928 : cluster [DBG] pgmap v575: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:57:53.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:57:52 smithi188 bash[23329]: cluster 2020-07-16T13:57:51.750463+0000 mgr.x (mgr.34562) 929 : cluster [DBG] pgmap v576: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:57:53.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:57:52 smithi132 bash[27079]: cluster 2020-07-16T13:57:51.750463+0000 mgr.x (mgr.34562) 929 : cluster [DBG] pgmap v576: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:57:55.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:57:54 smithi188 bash[23329]: cluster 2020-07-16T13:57:53.750955+0000 mgr.x (mgr.34562) 930 : cluster [DBG] pgmap v577: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:57:55.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:57:54 smithi132 bash[27079]: cluster 2020-07-16T13:57:53.750955+0000 mgr.x (mgr.34562) 930 : cluster [DBG] pgmap v577: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:57:57.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:57:56 smithi188 bash[23329]: cluster 2020-07-16T13:57:55.751456+0000 mgr.x (mgr.34562) 931 : cluster [DBG] pgmap v578: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:57:57.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:57:56 smithi132 bash[27079]: cluster 2020-07-16T13:57:55.751456+0000 mgr.x (mgr.34562) 931 : cluster [DBG] pgmap v578: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:57:59.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:57:58 smithi188 bash[23329]: cluster 2020-07-16T13:57:57.751942+0000 mgr.x (mgr.34562) 932 : cluster [DBG] pgmap v579: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:57:59.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:57:58 smithi132 bash[27079]: cluster 2020-07-16T13:57:57.751942+0000 mgr.x (mgr.34562) 932 : cluster [DBG] pgmap v579: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:58:00.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:58:00 smithi132 bash[27079]: cluster 2020-07-16T13:57:59.752412+0000 mgr.x (mgr.34562) 933 : cluster [DBG] pgmap v580: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:58:00.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:58:00 smithi188 bash[23329]: cluster 2020-07-16T13:57:59.752412+0000 mgr.x (mgr.34562) 933 : cluster [DBG] pgmap v580: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:58:03.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:58:02 smithi188 bash[23329]: cluster 2020-07-16T13:58:01.752770+0000 mgr.x (mgr.34562) 934 : cluster [DBG] pgmap v581: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:58:03.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:58:02 smithi188 bash[23329]: audit 2020-07-16T13:58:02.137042+0000 mon.b (mon.2) 330 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:58:03.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:58:02 smithi132 bash[27079]: cluster 2020-07-16T13:58:01.752770+0000 mgr.x (mgr.34562) 934 : cluster [DBG] pgmap v581: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:58:03.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:58:02 smithi132 bash[27079]: audit 2020-07-16T13:58:02.137042+0000 mon.b (mon.2) 330 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:58:04.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:58:03 smithi188 bash[23329]: cephadm 2020-07-16T13:58:02.137725+0000 mgr.x (mgr.34562) 935 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:58:04.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:58:03 smithi188 bash[23329]: cephadm 2020-07-16T13:58:02.138141+0000 mgr.x (mgr.34562) 936 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:58:04.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:58:03 smithi132 bash[27079]: cephadm 2020-07-16T13:58:02.137725+0000 mgr.x (mgr.34562) 935 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:58:04.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:58:03 smithi132 bash[27079]: cephadm 2020-07-16T13:58:02.138141+0000 mgr.x (mgr.34562) 936 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:58:05.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:58:04 smithi188 bash[23329]: cluster 2020-07-16T13:58:03.753173+0000 mgr.x (mgr.34562) 937 : cluster [DBG] pgmap v582: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:58:05.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:58:04 smithi132 bash[27079]: cluster 2020-07-16T13:58:03.753173+0000 mgr.x (mgr.34562) 937 : cluster [DBG] pgmap v582: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:58:07.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:58:06 smithi188 bash[23329]: cluster 2020-07-16T13:58:05.753499+0000 mgr.x (mgr.34562) 938 : cluster [DBG] pgmap v583: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:58:07.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:58:06 smithi132 bash[27079]: cluster 2020-07-16T13:58:05.753499+0000 mgr.x (mgr.34562) 938 : cluster [DBG] pgmap v583: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:58:09.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:58:08 smithi188 bash[23329]: cluster 2020-07-16T13:58:07.753988+0000 mgr.x (mgr.34562) 939 : cluster [DBG] pgmap v584: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:58:09.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:58:08 smithi132 bash[27079]: cluster 2020-07-16T13:58:07.753988+0000 mgr.x (mgr.34562) 939 : cluster [DBG] pgmap v584: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:58:10.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:58:10 smithi132 bash[27079]: cluster 2020-07-16T13:58:09.754380+0000 mgr.x (mgr.34562) 940 : cluster [DBG] pgmap v585: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:58:10.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:58:10 smithi188 bash[23329]: cluster 2020-07-16T13:58:09.754380+0000 mgr.x (mgr.34562) 940 : cluster [DBG] pgmap v585: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:58:13.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:58:12 smithi188 bash[23329]: cluster 2020-07-16T13:58:11.754755+0000 mgr.x (mgr.34562) 941 : cluster [DBG] pgmap v586: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:58:13.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:58:12 smithi132 bash[27079]: cluster 2020-07-16T13:58:11.754755+0000 mgr.x (mgr.34562) 941 : cluster [DBG] pgmap v586: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:58:15.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:58:14 smithi188 bash[23329]: cluster 2020-07-16T13:58:13.755137+0000 mgr.x (mgr.34562) 942 : cluster [DBG] pgmap v587: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:58:15.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:58:14 smithi132 bash[27079]: cluster 2020-07-16T13:58:13.755137+0000 mgr.x (mgr.34562) 942 : cluster [DBG] pgmap v587: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:58:17.179 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:58:16 smithi188 bash[23329]: cluster 2020-07-16T13:58:15.755643+0000 mgr.x (mgr.34562) 943 : cluster [DBG] pgmap v588: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:58:17.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:58:16 smithi132 bash[27079]: cluster 2020-07-16T13:58:15.755643+0000 mgr.x (mgr.34562) 943 : cluster [DBG] pgmap v588: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:58:18.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:58:17 smithi188 bash[23329]: audit 2020-07-16T13:58:17.152762+0000 mon.b (mon.2) 331 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:58:18.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:58:17 smithi132 bash[27079]: audit 2020-07-16T13:58:17.152762+0000 mon.b (mon.2) 331 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:58:19.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:58:18 smithi188 bash[23329]: cephadm 2020-07-16T13:58:17.153512+0000 mgr.x (mgr.34562) 944 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:58:19.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:58:18 smithi188 bash[23329]: cephadm 2020-07-16T13:58:17.153911+0000 mgr.x (mgr.34562) 945 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:58:19.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:58:18 smithi188 bash[23329]: cluster 2020-07-16T13:58:17.756188+0000 mgr.x (mgr.34562) 946 : cluster [DBG] pgmap v589: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:58:19.246 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T13:58:19.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:58:18 smithi132 bash[27079]: cephadm 2020-07-16T13:58:17.153512+0000 mgr.x (mgr.34562) 944 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:58:19.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:58:18 smithi132 bash[27079]: cephadm 2020-07-16T13:58:17.153911+0000 mgr.x (mgr.34562) 945 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:58:19.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:58:18 smithi132 bash[27079]: cluster 2020-07-16T13:58:17.756188+0000 mgr.x (mgr.34562) 946 : cluster [DBG] pgmap v589: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:58:19.509 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T13:58:19.510 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (21m) 8m ago 24m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T13:58:19.510 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (23m) 8m ago 23m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T13:58:19.510 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (21m) 8m ago 26m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T13:58:19.510 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (20m) 8m ago 28m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T13:58:19.511 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 8m ago 28m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T13:58:19.511 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (27m) 8m ago 27m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T13:58:19.511 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (27m) 8m ago 27m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T13:58:19.511 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (24m) 8m ago 24m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T13:58:19.511 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (24m) 8m ago 24m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T13:58:19.511 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (26m) 8m ago 26m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T13:58:19.512 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (26m) 8m ago 26m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T13:58:19.512 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (26m) 8m ago 26m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T13:58:19.512 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (25m) 8m ago 25m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T13:58:19.512 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (25m) 8m ago 25m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T13:58:19.512 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (25m) 8m ago 25m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T13:58:19.513 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (24m) 8m ago 25m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T13:58:19.513 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (24m) 8m ago 24m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T13:58:19.513 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (23m) 8m ago 24m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T13:58:19.810 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T13:58:19.811 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T13:58:19.811 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T13:58:19.811 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T13:58:19.811 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:58:19.812 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T13:58:19.812 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T13:58:19.812 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:58:19.812 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T13:58:19.813 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T13:58:19.813 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:58:19.813 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T13:58:19.813 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T13:58:19.814 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T13:58:19.814 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T13:58:19.814 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T13:58:19.814 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T13:58:20.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:58:20 smithi132 bash[27079]: audit 2020-07-16T13:58:19.234686+0000 mgr.x (mgr.34562) 947 : audit [DBG] from='client.25324 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:58:20.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:58:20 smithi132 bash[27079]: audit 2020-07-16T13:58:19.505119+0000 mgr.x (mgr.34562) 948 : audit [DBG] from='client.25330 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:58:20.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:58:20 smithi132 bash[27079]: cluster 2020-07-16T13:58:19.756716+0000 mgr.x (mgr.34562) 949 : cluster [DBG] pgmap v590: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:58:20.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:58:20 smithi132 bash[27079]: audit 2020-07-16T13:58:19.809571+0000 mon.c (mon.1) 112 : audit [DBG] from='client.? 172.21.15.132:0/3877770862' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:58:20.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:58:20 smithi188 bash[23329]: audit 2020-07-16T13:58:19.234686+0000 mgr.x (mgr.34562) 947 : audit [DBG] from='client.25324 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:58:20.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:58:20 smithi188 bash[23329]: audit 2020-07-16T13:58:19.505119+0000 mgr.x (mgr.34562) 948 : audit [DBG] from='client.25330 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:58:20.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:58:20 smithi188 bash[23329]: cluster 2020-07-16T13:58:19.756716+0000 mgr.x (mgr.34562) 949 : cluster [DBG] pgmap v590: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:58:20.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:58:20 smithi188 bash[23329]: audit 2020-07-16T13:58:19.809571+0000 mon.c (mon.1) 112 : audit [DBG] from='client.? 172.21.15.132:0/3877770862' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:58:23.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:58:22 smithi188 bash[23329]: cluster 2020-07-16T13:58:21.757206+0000 mgr.x (mgr.34562) 950 : cluster [DBG] pgmap v591: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:58:23.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:58:22 smithi132 bash[27079]: cluster 2020-07-16T13:58:21.757206+0000 mgr.x (mgr.34562) 950 : cluster [DBG] pgmap v591: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:58:25.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:58:24 smithi188 bash[23329]: cluster 2020-07-16T13:58:23.757654+0000 mgr.x (mgr.34562) 951 : cluster [DBG] pgmap v592: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:58:25.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:58:24 smithi132 bash[27079]: cluster 2020-07-16T13:58:23.757654+0000 mgr.x (mgr.34562) 951 : cluster [DBG] pgmap v592: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:58:27.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:58:26 smithi188 bash[23329]: cluster 2020-07-16T13:58:25.758122+0000 mgr.x (mgr.34562) 952 : cluster [DBG] pgmap v593: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:58:27.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:58:26 smithi132 bash[27079]: cluster 2020-07-16T13:58:25.758122+0000 mgr.x (mgr.34562) 952 : cluster [DBG] pgmap v593: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:58:29.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:58:28 smithi188 bash[23329]: cluster 2020-07-16T13:58:27.758741+0000 mgr.x (mgr.34562) 953 : cluster [DBG] pgmap v594: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:58:29.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:58:28 smithi132 bash[27079]: cluster 2020-07-16T13:58:27.758741+0000 mgr.x (mgr.34562) 953 : cluster [DBG] pgmap v594: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:58:30.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:58:30 smithi132 bash[27079]: cluster 2020-07-16T13:58:29.759353+0000 mgr.x (mgr.34562) 954 : cluster [DBG] pgmap v595: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:58:30.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:58:30 smithi188 bash[23329]: cluster 2020-07-16T13:58:29.759353+0000 mgr.x (mgr.34562) 954 : cluster [DBG] pgmap v595: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:58:33.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:58:32 smithi188 bash[23329]: cluster 2020-07-16T13:58:31.759971+0000 mgr.x (mgr.34562) 955 : cluster [DBG] pgmap v596: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:58:33.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:58:32 smithi188 bash[23329]: audit 2020-07-16T13:58:32.165218+0000 mon.b (mon.2) 332 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:58:33.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:58:32 smithi132 bash[27079]: cluster 2020-07-16T13:58:31.759971+0000 mgr.x (mgr.34562) 955 : cluster [DBG] pgmap v596: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:58:33.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:58:32 smithi132 bash[27079]: audit 2020-07-16T13:58:32.165218+0000 mon.b (mon.2) 332 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:58:34.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:58:33 smithi188 bash[23329]: cephadm 2020-07-16T13:58:32.165917+0000 mgr.x (mgr.34562) 956 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:58:34.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:58:33 smithi188 bash[23329]: cephadm 2020-07-16T13:58:32.166328+0000 mgr.x (mgr.34562) 957 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:58:34.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:58:33 smithi132 bash[27079]: cephadm 2020-07-16T13:58:32.165917+0000 mgr.x (mgr.34562) 956 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:58:34.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:58:33 smithi132 bash[27079]: cephadm 2020-07-16T13:58:32.166328+0000 mgr.x (mgr.34562) 957 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:58:35.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:58:34 smithi188 bash[23329]: cluster 2020-07-16T13:58:33.760596+0000 mgr.x (mgr.34562) 958 : cluster [DBG] pgmap v597: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:58:35.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:58:34 smithi132 bash[27079]: cluster 2020-07-16T13:58:33.760596+0000 mgr.x (mgr.34562) 958 : cluster [DBG] pgmap v597: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:58:37.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:58:36 smithi188 bash[23329]: cluster 2020-07-16T13:58:35.761031+0000 mgr.x (mgr.34562) 959 : cluster [DBG] pgmap v598: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:58:37.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:58:36 smithi132 bash[27079]: cluster 2020-07-16T13:58:35.761031+0000 mgr.x (mgr.34562) 959 : cluster [DBG] pgmap v598: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:58:39.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:58:38 smithi188 bash[23329]: cluster 2020-07-16T13:58:37.761481+0000 mgr.x (mgr.34562) 960 : cluster [DBG] pgmap v599: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:58:39.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:58:38 smithi132 bash[27079]: cluster 2020-07-16T13:58:37.761481+0000 mgr.x (mgr.34562) 960 : cluster [DBG] pgmap v599: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:58:40.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:58:40 smithi132 bash[27079]: cluster 2020-07-16T13:58:39.761821+0000 mgr.x (mgr.34562) 961 : cluster [DBG] pgmap v600: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:58:40.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:58:40 smithi188 bash[23329]: cluster 2020-07-16T13:58:39.761821+0000 mgr.x (mgr.34562) 961 : cluster [DBG] pgmap v600: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:58:43.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:58:42 smithi188 bash[23329]: cluster 2020-07-16T13:58:41.762392+0000 mgr.x (mgr.34562) 962 : cluster [DBG] pgmap v601: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:58:43.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:58:42 smithi132 bash[27079]: cluster 2020-07-16T13:58:41.762392+0000 mgr.x (mgr.34562) 962 : cluster [DBG] pgmap v601: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:58:45.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:58:44 smithi188 bash[23329]: cluster 2020-07-16T13:58:43.762756+0000 mgr.x (mgr.34562) 963 : cluster [DBG] pgmap v602: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:58:45.290 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:58:44 smithi132 bash[27079]: cluster 2020-07-16T13:58:43.762756+0000 mgr.x (mgr.34562) 963 : cluster [DBG] pgmap v602: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:58:47.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:58:46 smithi188 bash[23329]: cluster 2020-07-16T13:58:45.763079+0000 mgr.x (mgr.34562) 964 : cluster [DBG] pgmap v603: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:58:47.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:58:46 smithi132 bash[27079]: cluster 2020-07-16T13:58:45.763079+0000 mgr.x (mgr.34562) 964 : cluster [DBG] pgmap v603: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:58:48.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:58:47 smithi132 bash[27079]: audit 2020-07-16T13:58:47.173019+0000 mon.b (mon.2) 333 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:58:48.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:58:47 smithi132 bash[27079]: audit 2020-07-16T13:58:47.174455+0000 mon.b (mon.2) 334 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:58:48.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:58:47 smithi132 bash[27079]: audit 2020-07-16T13:58:47.175632+0000 mon.b (mon.2) 335 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:58:48.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:58:47 smithi132 bash[27079]: audit 2020-07-16T13:58:47.177189+0000 mon.b (mon.2) 336 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T13:58:48.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:58:47 smithi132 bash[27079]: audit 2020-07-16T13:58:47.178429+0000 mon.b (mon.2) 337 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:58:48.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:58:47 smithi188 bash[23329]: audit 2020-07-16T13:58:47.173019+0000 mon.b (mon.2) 333 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:58:48.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:58:47 smithi188 bash[23329]: audit 2020-07-16T13:58:47.174455+0000 mon.b (mon.2) 334 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:58:48.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:58:47 smithi188 bash[23329]: audit 2020-07-16T13:58:47.175632+0000 mon.b (mon.2) 335 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:58:48.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:58:47 smithi188 bash[23329]: audit 2020-07-16T13:58:47.177189+0000 mon.b (mon.2) 336 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T13:58:48.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:58:47 smithi188 bash[23329]: audit 2020-07-16T13:58:47.178429+0000 mon.b (mon.2) 337 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:58:49.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:58:48 smithi188 bash[23329]: audit 2020-07-16T13:58:47.173451+0000 mgr.x (mgr.34562) 965 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:58:49.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:58:48 smithi188 bash[23329]: audit 2020-07-16T13:58:47.174738+0000 mgr.x (mgr.34562) 966 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:58:49.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:58:48 smithi188 bash[23329]: audit 2020-07-16T13:58:47.175942+0000 mgr.x (mgr.34562) 967 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:58:49.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:58:48 smithi188 bash[23329]: cephadm 2020-07-16T13:58:47.176697+0000 mgr.x (mgr.34562) 968 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T13:58:49.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:58:48 smithi188 bash[23329]: cephadm 2020-07-16T13:58:47.178093+0000 mgr.x (mgr.34562) 969 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T13:58:49.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:58:48 smithi188 bash[23329]: cephadm 2020-07-16T13:58:47.179151+0000 mgr.x (mgr.34562) 970 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T13:58:49.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:58:48 smithi188 bash[23329]: cephadm 2020-07-16T13:58:47.179290+0000 mgr.x (mgr.34562) 971 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T13:58:49.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:58:48 smithi188 bash[23329]: cluster 2020-07-16T13:58:47.763637+0000 mgr.x (mgr.34562) 972 : cluster [DBG] pgmap v604: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:58:49.264 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:58:48 smithi132 bash[27079]: audit 2020-07-16T13:58:47.173451+0000 mgr.x (mgr.34562) 965 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:58:49.265 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:58:48 smithi132 bash[27079]: audit 2020-07-16T13:58:47.174738+0000 mgr.x (mgr.34562) 966 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:58:49.265 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:58:48 smithi132 bash[27079]: audit 2020-07-16T13:58:47.175942+0000 mgr.x (mgr.34562) 967 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:58:49.265 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:58:48 smithi132 bash[27079]: cephadm 2020-07-16T13:58:47.176697+0000 mgr.x (mgr.34562) 968 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T13:58:49.265 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:58:48 smithi132 bash[27079]: cephadm 2020-07-16T13:58:47.178093+0000 mgr.x (mgr.34562) 969 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T13:58:49.265 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:58:48 smithi132 bash[27079]: cephadm 2020-07-16T13:58:47.179151+0000 mgr.x (mgr.34562) 970 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T13:58:49.266 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:58:48 smithi132 bash[27079]: cephadm 2020-07-16T13:58:47.179290+0000 mgr.x (mgr.34562) 971 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T13:58:49.266 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:58:48 smithi132 bash[27079]: cluster 2020-07-16T13:58:47.763637+0000 mgr.x (mgr.34562) 972 : cluster [DBG] pgmap v604: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:58:50.108 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T13:58:50.381 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T13:58:50.381 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (21m) 9m ago 24m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T13:58:50.381 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (24m) 9m ago 24m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T13:58:50.382 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (21m) 9m ago 27m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T13:58:50.382 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (21m) 9m ago 29m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T13:58:50.382 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 9m ago 29m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T13:58:50.382 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (27m) 9m ago 27m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T13:58:50.382 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (27m) 9m ago 27m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T13:58:50.383 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (24m) 9m ago 24m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T13:58:50.383 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (24m) 9m ago 24m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T13:58:50.383 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (27m) 9m ago 27m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T13:58:50.383 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (26m) 9m ago 26m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T13:58:50.383 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (26m) 9m ago 26m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T13:58:50.384 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (26m) 9m ago 26m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T13:58:50.384 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (25m) 9m ago 26m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T13:58:50.384 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (25m) 9m ago 25m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T13:58:50.384 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (25m) 9m ago 25m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T13:58:50.384 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (25m) 9m ago 25m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T13:58:50.384 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (24m) 9m ago 24m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T13:58:50.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:58:50 smithi132 bash[27079]: cluster 2020-07-16T13:58:49.764088+0000 mgr.x (mgr.34562) 973 : cluster [DBG] pgmap v605: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:58:50.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:58:50 smithi132 bash[27079]: audit 2020-07-16T13:58:50.170385+0000 mon.b (mon.2) 338 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:58:50.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:58:50 smithi188 bash[23329]: cluster 2020-07-16T13:58:49.764088+0000 mgr.x (mgr.34562) 973 : cluster [DBG] pgmap v605: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:58:50.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:58:50 smithi188 bash[23329]: audit 2020-07-16T13:58:50.170385+0000 mon.b (mon.2) 338 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:58:50.680 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T13:58:50.680 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T13:58:50.681 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T13:58:50.681 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T13:58:50.681 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:58:50.681 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T13:58:50.682 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T13:58:50.682 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:58:50.682 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T13:58:50.682 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T13:58:50.682 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:58:50.682 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T13:58:50.683 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T13:58:50.683 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T13:58:50.683 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T13:58:50.683 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T13:58:50.683 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T13:58:51.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:58:51 smithi132 bash[27079]: audit 2020-07-16T13:58:50.096615+0000 mgr.x (mgr.34562) 974 : audit [DBG] from='client.25342 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:58:51.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:58:51 smithi132 bash[27079]: cephadm 2020-07-16T13:58:50.170973+0000 mgr.x (mgr.34562) 975 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:58:51.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:58:51 smithi132 bash[27079]: cephadm 2020-07-16T13:58:50.171167+0000 mgr.x (mgr.34562) 976 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:58:51.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:58:51 smithi132 bash[27079]: audit 2020-07-16T13:58:50.376405+0000 mgr.x (mgr.34562) 977 : audit [DBG] from='client.25348 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:58:51.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:58:51 smithi132 bash[27079]: audit 2020-07-16T13:58:50.679584+0000 mon.c (mon.1) 113 : audit [DBG] from='client.? 172.21.15.132:0/2753609320' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:58:51.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:58:51 smithi188 bash[23329]: audit 2020-07-16T13:58:50.096615+0000 mgr.x (mgr.34562) 974 : audit [DBG] from='client.25342 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:58:51.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:58:51 smithi188 bash[23329]: cephadm 2020-07-16T13:58:50.170973+0000 mgr.x (mgr.34562) 975 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:58:51.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:58:51 smithi188 bash[23329]: cephadm 2020-07-16T13:58:50.171167+0000 mgr.x (mgr.34562) 976 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:58:51.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:58:51 smithi188 bash[23329]: audit 2020-07-16T13:58:50.376405+0000 mgr.x (mgr.34562) 977 : audit [DBG] from='client.25348 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:58:51.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:58:51 smithi188 bash[23329]: audit 2020-07-16T13:58:50.679584+0000 mon.c (mon.1) 113 : audit [DBG] from='client.? 172.21.15.132:0/2753609320' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:58:52.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:58:52 smithi132 bash[27079]: cluster 2020-07-16T13:58:51.764468+0000 mgr.x (mgr.34562) 978 : cluster [DBG] pgmap v606: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:58:52.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:58:52 smithi188 bash[23329]: cluster 2020-07-16T13:58:51.764468+0000 mgr.x (mgr.34562) 978 : cluster [DBG] pgmap v606: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:58:55.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:58:54 smithi188 bash[23329]: cluster 2020-07-16T13:58:53.764832+0000 mgr.x (mgr.34562) 979 : cluster [DBG] pgmap v607: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:58:55.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:58:54 smithi132 bash[27079]: cluster 2020-07-16T13:58:53.764832+0000 mgr.x (mgr.34562) 979 : cluster [DBG] pgmap v607: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:58:57.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:58:56 smithi188 bash[23329]: cluster 2020-07-16T13:58:55.765330+0000 mgr.x (mgr.34562) 980 : cluster [DBG] pgmap v608: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:58:57.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:58:56 smithi132 bash[27079]: cluster 2020-07-16T13:58:55.765330+0000 mgr.x (mgr.34562) 980 : cluster [DBG] pgmap v608: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:58:59.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:58:58 smithi188 bash[23329]: cluster 2020-07-16T13:58:57.765745+0000 mgr.x (mgr.34562) 981 : cluster [DBG] pgmap v609: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:58:59.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:58:58 smithi132 bash[27079]: cluster 2020-07-16T13:58:57.765745+0000 mgr.x (mgr.34562) 981 : cluster [DBG] pgmap v609: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:59:00.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:00 smithi132 bash[27079]: cluster 2020-07-16T13:58:59.766190+0000 mgr.x (mgr.34562) 982 : cluster [DBG] pgmap v610: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:59:00.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:00 smithi188 bash[23329]: cluster 2020-07-16T13:58:59.766190+0000 mgr.x (mgr.34562) 982 : cluster [DBG] pgmap v610: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:59:03.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:02 smithi188 bash[23329]: cluster 2020-07-16T13:59:01.766809+0000 mgr.x (mgr.34562) 983 : cluster [DBG] pgmap v611: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:59:03.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:02 smithi132 bash[27079]: cluster 2020-07-16T13:59:01.766809+0000 mgr.x (mgr.34562) 983 : cluster [DBG] pgmap v611: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:59:05.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:04 smithi188 bash[23329]: cluster 2020-07-16T13:59:03.767375+0000 mgr.x (mgr.34562) 984 : cluster [DBG] pgmap v612: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:59:05.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:04 smithi132 bash[27079]: cluster 2020-07-16T13:59:03.767375+0000 mgr.x (mgr.34562) 984 : cluster [DBG] pgmap v612: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:59:06.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:05 smithi188 bash[23329]: audit 2020-07-16T13:59:05.178747+0000 mon.b (mon.2) 339 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:59:06.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:05 smithi132 bash[27079]: audit 2020-07-16T13:59:05.178747+0000 mon.b (mon.2) 339 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:59:07.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:06 smithi188 bash[23329]: cephadm 2020-07-16T13:59:05.179429+0000 mgr.x (mgr.34562) 985 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:59:07.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:06 smithi188 bash[23329]: cephadm 2020-07-16T13:59:05.179845+0000 mgr.x (mgr.34562) 986 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:59:07.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:06 smithi188 bash[23329]: cluster 2020-07-16T13:59:05.767759+0000 mgr.x (mgr.34562) 987 : cluster [DBG] pgmap v613: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:59:07.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:06 smithi132 bash[27079]: cephadm 2020-07-16T13:59:05.179429+0000 mgr.x (mgr.34562) 985 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:59:07.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:06 smithi132 bash[27079]: cephadm 2020-07-16T13:59:05.179845+0000 mgr.x (mgr.34562) 986 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:59:07.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:06 smithi132 bash[27079]: cluster 2020-07-16T13:59:05.767759+0000 mgr.x (mgr.34562) 987 : cluster [DBG] pgmap v613: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:59:09.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:08 smithi188 bash[23329]: cluster 2020-07-16T13:59:07.768165+0000 mgr.x (mgr.34562) 988 : cluster [DBG] pgmap v614: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:59:09.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:08 smithi132 bash[27079]: cluster 2020-07-16T13:59:07.768165+0000 mgr.x (mgr.34562) 988 : cluster [DBG] pgmap v614: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:59:10.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:10 smithi132 bash[27079]: cluster 2020-07-16T13:59:09.768504+0000 mgr.x (mgr.34562) 989 : cluster [DBG] pgmap v615: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:59:10.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:10 smithi188 bash[23329]: cluster 2020-07-16T13:59:09.768504+0000 mgr.x (mgr.34562) 989 : cluster [DBG] pgmap v615: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:59:13.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:12 smithi188 bash[23329]: cluster 2020-07-16T13:59:11.768895+0000 mgr.x (mgr.34562) 990 : cluster [DBG] pgmap v616: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:59:13.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:12 smithi132 bash[27079]: cluster 2020-07-16T13:59:11.768895+0000 mgr.x (mgr.34562) 990 : cluster [DBG] pgmap v616: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:59:15.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:14 smithi188 bash[23329]: cluster 2020-07-16T13:59:13.769346+0000 mgr.x (mgr.34562) 991 : cluster [DBG] pgmap v617: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:59:15.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:14 smithi132 bash[27079]: cluster 2020-07-16T13:59:13.769346+0000 mgr.x (mgr.34562) 991 : cluster [DBG] pgmap v617: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:59:17.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:16 smithi188 bash[23329]: cluster 2020-07-16T13:59:15.769674+0000 mgr.x (mgr.34562) 992 : cluster [DBG] pgmap v618: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:59:17.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:16 smithi132 bash[27079]: cluster 2020-07-16T13:59:15.769674+0000 mgr.x (mgr.34562) 992 : cluster [DBG] pgmap v618: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:59:19.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:18 smithi188 bash[23329]: cluster 2020-07-16T13:59:17.770080+0000 mgr.x (mgr.34562) 993 : cluster [DBG] pgmap v619: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:59:19.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:18 smithi132 bash[27079]: cluster 2020-07-16T13:59:17.770080+0000 mgr.x (mgr.34562) 993 : cluster [DBG] pgmap v619: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:59:20.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:20 smithi132 bash[27079]: cluster 2020-07-16T13:59:19.770425+0000 mgr.x (mgr.34562) 994 : cluster [DBG] pgmap v620: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:59:20.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:20 smithi132 bash[27079]: audit 2020-07-16T13:59:20.180713+0000 mon.b (mon.2) 340 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:59:20.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:20 smithi188 bash[23329]: cluster 2020-07-16T13:59:19.770425+0000 mgr.x (mgr.34562) 994 : cluster [DBG] pgmap v620: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:59:20.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:20 smithi188 bash[23329]: audit 2020-07-16T13:59:20.180713+0000 mon.b (mon.2) 340 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:59:20.984 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T13:59:21.244 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T13:59:21.245 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (22m) 10m ago 25m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T13:59:21.245 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (24m) 10m ago 24m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T13:59:21.245 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (22m) 10m ago 27m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T13:59:21.245 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (21m) 10m ago 29m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T13:59:21.246 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 10m ago 29m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T13:59:21.246 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (28m) 10m ago 28m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T13:59:21.246 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (28m) 10m ago 28m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T13:59:21.246 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (25m) 10m ago 25m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T13:59:21.246 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (25m) 10m ago 25m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T13:59:21.247 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (27m) 10m ago 27m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T13:59:21.247 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (27m) 10m ago 27m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T13:59:21.247 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (27m) 10m ago 27m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T13:59:21.247 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (26m) 10m ago 26m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T13:59:21.247 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (26m) 10m ago 26m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T13:59:21.248 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (26m) 10m ago 26m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T13:59:21.248 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (26m) 10m ago 26m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T13:59:21.248 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (25m) 10m ago 25m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T13:59:21.248 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (24m) 10m ago 25m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T13:59:21.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:21 smithi132 bash[27079]: cephadm 2020-07-16T13:59:20.181361+0000 mgr.x (mgr.34562) 995 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:59:21.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:21 smithi132 bash[27079]: cephadm 2020-07-16T13:59:20.181436+0000 mgr.x (mgr.34562) 996 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:59:21.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:21 smithi132 bash[27079]: audit 2020-07-16T13:59:20.968126+0000 mgr.x (mgr.34562) 997 : audit [DBG] from='client.25360 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:59:21.543 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T13:59:21.543 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T13:59:21.544 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T13:59:21.544 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T13:59:21.544 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:59:21.544 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T13:59:21.544 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T13:59:21.545 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:59:21.545 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T13:59:21.545 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T13:59:21.545 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:59:21.546 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T13:59:21.546 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T13:59:21.546 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T13:59:21.546 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T13:59:21.546 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T13:59:21.547 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T13:59:21.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:21 smithi188 bash[23329]: cephadm 2020-07-16T13:59:20.181361+0000 mgr.x (mgr.34562) 995 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:59:21.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:21 smithi188 bash[23329]: cephadm 2020-07-16T13:59:20.181436+0000 mgr.x (mgr.34562) 996 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:59:21.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:21 smithi188 bash[23329]: audit 2020-07-16T13:59:20.968126+0000 mgr.x (mgr.34562) 997 : audit [DBG] from='client.25360 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:59:22.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:22 smithi132 bash[27079]: audit 2020-07-16T13:59:21.240121+0000 mgr.x (mgr.34562) 998 : audit [DBG] from='client.25366 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:59:22.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:22 smithi132 bash[27079]: audit 2020-07-16T13:59:21.542211+0000 mon.c (mon.1) 114 : audit [DBG] from='client.? 172.21.15.132:0/3037152369' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:59:22.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:22 smithi132 bash[27079]: cluster 2020-07-16T13:59:21.770898+0000 mgr.x (mgr.34562) 999 : cluster [DBG] pgmap v621: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:59:22.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:22 smithi188 bash[23329]: audit 2020-07-16T13:59:21.240121+0000 mgr.x (mgr.34562) 998 : audit [DBG] from='client.25366 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:59:22.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:22 smithi188 bash[23329]: audit 2020-07-16T13:59:21.542211+0000 mon.c (mon.1) 114 : audit [DBG] from='client.? 172.21.15.132:0/3037152369' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:59:22.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:22 smithi188 bash[23329]: cluster 2020-07-16T13:59:21.770898+0000 mgr.x (mgr.34562) 999 : cluster [DBG] pgmap v621: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:59:25.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:24 smithi188 bash[23329]: cluster 2020-07-16T13:59:23.771195+0000 mgr.x (mgr.34562) 1000 : cluster [DBG] pgmap v622: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:59:25.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:24 smithi132 bash[27079]: cluster 2020-07-16T13:59:23.771195+0000 mgr.x (mgr.34562) 1000 : cluster [DBG] pgmap v622: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:59:27.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:26 smithi188 bash[23329]: cluster 2020-07-16T13:59:25.771540+0000 mgr.x (mgr.34562) 1001 : cluster [DBG] pgmap v623: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:59:27.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:26 smithi132 bash[27079]: cluster 2020-07-16T13:59:25.771540+0000 mgr.x (mgr.34562) 1001 : cluster [DBG] pgmap v623: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:59:29.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:28 smithi188 bash[23329]: cluster 2020-07-16T13:59:27.772063+0000 mgr.x (mgr.34562) 1002 : cluster [DBG] pgmap v624: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:59:29.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:28 smithi132 bash[27079]: cluster 2020-07-16T13:59:27.772063+0000 mgr.x (mgr.34562) 1002 : cluster [DBG] pgmap v624: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:59:30.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:30 smithi132 bash[27079]: cluster 2020-07-16T13:59:29.772487+0000 mgr.x (mgr.34562) 1003 : cluster [DBG] pgmap v625: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:59:30.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:30 smithi188 bash[23329]: cluster 2020-07-16T13:59:29.772487+0000 mgr.x (mgr.34562) 1003 : cluster [DBG] pgmap v625: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:59:33.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:32 smithi188 bash[23329]: cluster 2020-07-16T13:59:31.772912+0000 mgr.x (mgr.34562) 1004 : cluster [DBG] pgmap v626: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:59:33.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:32 smithi132 bash[27079]: cluster 2020-07-16T13:59:31.772912+0000 mgr.x (mgr.34562) 1004 : cluster [DBG] pgmap v626: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:59:35.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:34 smithi188 bash[23329]: cluster 2020-07-16T13:59:33.773426+0000 mgr.x (mgr.34562) 1005 : cluster [DBG] pgmap v627: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:59:35.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:34 smithi132 bash[27079]: cluster 2020-07-16T13:59:33.773426+0000 mgr.x (mgr.34562) 1005 : cluster [DBG] pgmap v627: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:59:36.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:35 smithi188 bash[23329]: audit 2020-07-16T13:59:35.182734+0000 mon.b (mon.2) 341 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:59:36.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:35 smithi132 bash[27079]: audit 2020-07-16T13:59:35.182734+0000 mon.b (mon.2) 341 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:59:37.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:36 smithi188 bash[23329]: cephadm 2020-07-16T13:59:35.183405+0000 mgr.x (mgr.34562) 1006 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:59:37.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:36 smithi188 bash[23329]: cephadm 2020-07-16T13:59:35.183768+0000 mgr.x (mgr.34562) 1007 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:59:37.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:36 smithi188 bash[23329]: cluster 2020-07-16T13:59:35.773816+0000 mgr.x (mgr.34562) 1008 : cluster [DBG] pgmap v628: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:59:37.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:36 smithi132 bash[27079]: cephadm 2020-07-16T13:59:35.183405+0000 mgr.x (mgr.34562) 1006 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:59:37.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:36 smithi132 bash[27079]: cephadm 2020-07-16T13:59:35.183768+0000 mgr.x (mgr.34562) 1007 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:59:37.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:36 smithi132 bash[27079]: cluster 2020-07-16T13:59:35.773816+0000 mgr.x (mgr.34562) 1008 : cluster [DBG] pgmap v628: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:59:39.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:38 smithi188 bash[23329]: cluster 2020-07-16T13:59:37.774221+0000 mgr.x (mgr.34562) 1009 : cluster [DBG] pgmap v629: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:59:39.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:38 smithi132 bash[27079]: cluster 2020-07-16T13:59:37.774221+0000 mgr.x (mgr.34562) 1009 : cluster [DBG] pgmap v629: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:59:40.532 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:40 smithi132 bash[27079]: cluster 2020-07-16T13:59:39.774574+0000 mgr.x (mgr.34562) 1010 : cluster [DBG] pgmap v630: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:59:40.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:40 smithi188 bash[23329]: cluster 2020-07-16T13:59:39.774574+0000 mgr.x (mgr.34562) 1010 : cluster [DBG] pgmap v630: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:59:43.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:42 smithi188 bash[23329]: cluster 2020-07-16T13:59:41.774989+0000 mgr.x (mgr.34562) 1011 : cluster [DBG] pgmap v631: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:59:43.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:42 smithi132 bash[27079]: cluster 2020-07-16T13:59:41.774989+0000 mgr.x (mgr.34562) 1011 : cluster [DBG] pgmap v631: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:59:45.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:44 smithi188 bash[23329]: cluster 2020-07-16T13:59:43.775331+0000 mgr.x (mgr.34562) 1012 : cluster [DBG] pgmap v632: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:59:45.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:44 smithi132 bash[27079]: cluster 2020-07-16T13:59:43.775331+0000 mgr.x (mgr.34562) 1012 : cluster [DBG] pgmap v632: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:59:47.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:46 smithi188 bash[23329]: cluster 2020-07-16T13:59:45.775611+0000 mgr.x (mgr.34562) 1013 : cluster [DBG] pgmap v633: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:59:47.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:46 smithi132 bash[27079]: cluster 2020-07-16T13:59:45.775611+0000 mgr.x (mgr.34562) 1013 : cluster [DBG] pgmap v633: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:59:49.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:48 smithi188 bash[23329]: cluster 2020-07-16T13:59:47.776105+0000 mgr.x (mgr.34562) 1014 : cluster [DBG] pgmap v634: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:59:49.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:48 smithi132 bash[27079]: cluster 2020-07-16T13:59:47.776105+0000 mgr.x (mgr.34562) 1014 : cluster [DBG] pgmap v634: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:59:50.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:50 smithi132 bash[27079]: cluster 2020-07-16T13:59:49.776595+0000 mgr.x (mgr.34562) 1015 : cluster [DBG] pgmap v635: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:59:50.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:50 smithi132 bash[27079]: audit 2020-07-16T13:59:50.191690+0000 mon.b (mon.2) 342 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:59:50.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:50 smithi132 bash[27079]: audit 2020-07-16T13:59:50.191967+0000 mon.b (mon.2) 343 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:59:50.662 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:50 smithi188 bash[23329]: cluster 2020-07-16T13:59:49.776595+0000 mgr.x (mgr.34562) 1015 : cluster [DBG] pgmap v635: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:59:50.662 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:50 smithi188 bash[23329]: audit 2020-07-16T13:59:50.191690+0000 mon.b (mon.2) 342 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:59:50.663 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:50 smithi188 bash[23329]: audit 2020-07-16T13:59:50.191967+0000 mon.b (mon.2) 343 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T13:59:51.855 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T13:59:52.152 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T13:59:52.152 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (22m) 10m ago 25m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T13:59:52.153 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (25m) 10m ago 25m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T13:59:52.153 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (22m) 10m ago 28m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T13:59:52.153 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (22m) 10m ago 30m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T13:59:52.154 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 10m ago 30m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T13:59:52.154 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (28m) 10m ago 28m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T13:59:52.154 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (28m) 10m ago 28m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T13:59:52.155 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (25m) 10m ago 25m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T13:59:52.155 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (25m) 10m ago 25m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T13:59:52.155 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (28m) 10m ago 28m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T13:59:52.155 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (27m) 10m ago 27m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T13:59:52.156 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (27m) 10m ago 27m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T13:59:52.156 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (27m) 10m ago 27m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T13:59:52.156 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (26m) 10m ago 27m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T13:59:52.157 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (26m) 10m ago 26m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T13:59:52.157 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (26m) 10m ago 26m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T13:59:52.157 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (26m) 10m ago 26m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T13:59:52.158 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (25m) 10m ago 25m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T13:59:52.475 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T13:59:52.475 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T13:59:52.476 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T13:59:52.476 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T13:59:52.476 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:59:52.476 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T13:59:52.476 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T13:59:52.477 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:59:52.477 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T13:59:52.477 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T13:59:52.477 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T13:59:52.477 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T13:59:52.478 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T13:59:52.478 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T13:59:52.478 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T13:59:52.478 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T13:59:52.478 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T13:59:52.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:52 smithi188 bash[23329]: cluster 2020-07-16T13:59:51.776991+0000 mgr.x (mgr.34562) 1016 : cluster [DBG] pgmap v636: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:59:52.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:52 smithi188 bash[23329]: audit 2020-07-16T13:59:51.842719+0000 mgr.x (mgr.34562) 1017 : audit [DBG] from='client.25378 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:59:52.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:52 smithi188 bash[23329]: audit 2020-07-16T13:59:52.411308+0000 mon.b (mon.2) 344 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T13:59:52.409762\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.409823\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.409858\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.409894\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410117\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410237\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410349\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410455\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410489\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T13:59:52.410562\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:51:26.638503\"}"}]: dispatch 2020-07-16T13:59:52.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:52 smithi188 bash[23329]: audit 2020-07-16T13:59:52.411931+0000 mon.c (mon.1) 115 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T13:59:52.409762\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.409823\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.409858\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.409894\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410117\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410237\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410349\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410455\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410489\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T13:59:52.410562\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:51:26.638503\"}"}]: dispatch 2020-07-16T13:59:52.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:52 smithi188 bash[23329]: audit 2020-07-16T13:59:52.414471+0000 mon.c (mon.1) 116 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T13:59:52.409762\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.409823\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.409858\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.409894\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410117\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410237\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410349\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410455\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410489\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T13:59:52.410562\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:51:26.638503\"}"}]': finished 2020-07-16T13:59:52.925 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:52 smithi188 bash[23329]: audit 2020-07-16T13:59:52.473999+0000 mon.c (mon.1) 117 : audit [DBG] from='client.? 172.21.15.132:0/2530207454' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:59:52.926 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:52 smithi188 bash[23329]: audit 2020-07-16T13:59:52.711910+0000 mon.b (mon.2) 345 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710380\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710452\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710485\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710667\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710772\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710871\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710971\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.711004\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.711031\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:59:52.711098\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:51:26.646579\"}"}]: dispatch 2020-07-16T13:59:52.926 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:52 smithi188 bash[23329]: audit 2020-07-16T13:59:52.712817+0000 mon.c (mon.1) 118 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710380\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710452\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710485\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710667\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710772\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710871\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710971\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.711004\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.711031\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:59:52.711098\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:51:26.646579\"}"}]: dispatch 2020-07-16T13:59:52.927 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:52 smithi188 bash[23329]: audit 2020-07-16T13:59:52.715600+0000 mon.c (mon.1) 119 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710380\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710452\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710485\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710667\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710772\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710871\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710971\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.711004\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.711031\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:59:52.711098\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:51:26.646579\"}"}]': finished 2020-07-16T13:59:52.927 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:52 smithi188 bash[23329]: audit 2020-07-16T13:59:52.717835+0000 mon.b (mon.2) 346 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:59:52.927 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:52 smithi188 bash[23329]: audit 2020-07-16T13:59:52.718791+0000 mon.b (mon.2) 347 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:59:52.928 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:52 smithi188 bash[23329]: audit 2020-07-16T13:59:52.719622+0000 mon.b (mon.2) 348 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:59:52.928 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:52 smithi188 bash[23329]: audit 2020-07-16T13:59:52.720521+0000 mon.b (mon.2) 349 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T13:59:52.931 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:52 smithi188 bash[23329]: audit 2020-07-16T13:59:52.721441+0000 mon.b (mon.2) 350 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:59:53.215 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:52 smithi132 bash[27079]: cluster 2020-07-16T13:59:51.776991+0000 mgr.x (mgr.34562) 1016 : cluster [DBG] pgmap v636: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:59:53.216 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:52 smithi132 bash[27079]: audit 2020-07-16T13:59:51.842719+0000 mgr.x (mgr.34562) 1017 : audit [DBG] from='client.25378 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:59:53.216 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:52 smithi132 bash[27079]: audit 2020-07-16T13:59:52.411308+0000 mon.b (mon.2) 344 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T13:59:52.409762\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.409823\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.409858\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.409894\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410117\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410237\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410349\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410455\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410489\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T13:59:52.410562\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:51:26.638503\"}"}]: dispatch 2020-07-16T13:59:53.217 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:52 smithi132 bash[27079]: audit 2020-07-16T13:59:52.411931+0000 mon.c (mon.1) 115 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T13:59:52.409762\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.409823\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.409858\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.409894\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410117\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410237\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410349\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410455\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410489\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T13:59:52.410562\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:51:26.638503\"}"}]: dispatch 2020-07-16T13:59:53.218 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:52 smithi132 bash[27079]: audit 2020-07-16T13:59:52.414471+0000 mon.c (mon.1) 116 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T13:59:52.409762\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.409823\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.409858\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.409894\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410117\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410237\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410349\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410455\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410489\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T13:59:52.410562\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T13:51:26.638503\"}"}]': finished 2020-07-16T13:59:53.229 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:52 smithi132 bash[27079]: audit 2020-07-16T13:59:52.473999+0000 mon.c (mon.1) 117 : audit [DBG] from='client.? 172.21.15.132:0/2530207454' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:59:53.229 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:52 smithi132 bash[27079]: audit 2020-07-16T13:59:52.711910+0000 mon.b (mon.2) 345 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710380\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710452\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710485\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710667\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710772\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710871\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710971\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.711004\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.711031\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:59:52.711098\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:51:26.646579\"}"}]: dispatch 2020-07-16T13:59:53.230 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:52 smithi132 bash[27079]: audit 2020-07-16T13:59:52.712817+0000 mon.c (mon.1) 118 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710380\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710452\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710485\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710667\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710772\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710871\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710971\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.711004\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.711031\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:59:52.711098\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:51:26.646579\"}"}]: dispatch 2020-07-16T13:59:53.230 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:52 smithi132 bash[27079]: audit 2020-07-16T13:59:52.715600+0000 mon.c (mon.1) 119 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710380\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710452\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710485\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710667\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710772\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710871\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710971\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.711004\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.711031\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:59:52.711098\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T13:51:26.646579\"}"}]': finished 2020-07-16T13:59:53.231 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:52 smithi132 bash[27079]: audit 2020-07-16T13:59:52.717835+0000 mon.b (mon.2) 346 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:59:53.231 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:52 smithi132 bash[27079]: audit 2020-07-16T13:59:52.718791+0000 mon.b (mon.2) 347 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:59:53.231 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:52 smithi132 bash[27079]: audit 2020-07-16T13:59:52.719622+0000 mon.b (mon.2) 348 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:59:53.231 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:52 smithi132 bash[27079]: audit 2020-07-16T13:59:52.720521+0000 mon.b (mon.2) 349 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T13:59:53.232 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:52 smithi132 bash[27079]: audit 2020-07-16T13:59:52.721441+0000 mon.b (mon.2) 350 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T13:59:54.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:53 smithi188 bash[23329]: audit 2020-07-16T13:59:52.147537+0000 mgr.x (mgr.34562) 1018 : audit [DBG] from='client.25384 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:59:54.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:53 smithi188 bash[23329]: audit 2020-07-16T13:59:52.718096+0000 mgr.x (mgr.34562) 1019 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:59:54.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:53 smithi188 bash[23329]: audit 2020-07-16T13:59:52.719045+0000 mgr.x (mgr.34562) 1020 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:59:54.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:53 smithi188 bash[23329]: audit 2020-07-16T13:59:52.719837+0000 mgr.x (mgr.34562) 1021 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:59:54.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:53 smithi188 bash[23329]: cephadm 2020-07-16T13:59:52.720357+0000 mgr.x (mgr.34562) 1022 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T13:59:54.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:53 smithi188 bash[23329]: cephadm 2020-07-16T13:59:52.721120+0000 mgr.x (mgr.34562) 1023 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T13:59:54.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:53 smithi188 bash[23329]: cephadm 2020-07-16T13:59:52.721894+0000 mgr.x (mgr.34562) 1024 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T13:59:54.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:53 smithi188 bash[23329]: cephadm 2020-07-16T13:59:52.721943+0000 mgr.x (mgr.34562) 1025 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T13:59:54.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:53 smithi132 bash[27079]: audit 2020-07-16T13:59:52.147537+0000 mgr.x (mgr.34562) 1018 : audit [DBG] from='client.25384 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T13:59:54.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:53 smithi132 bash[27079]: audit 2020-07-16T13:59:52.718096+0000 mgr.x (mgr.34562) 1019 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T13:59:54.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:53 smithi132 bash[27079]: audit 2020-07-16T13:59:52.719045+0000 mgr.x (mgr.34562) 1020 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T13:59:54.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:53 smithi132 bash[27079]: audit 2020-07-16T13:59:52.719837+0000 mgr.x (mgr.34562) 1021 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T13:59:54.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:53 smithi132 bash[27079]: cephadm 2020-07-16T13:59:52.720357+0000 mgr.x (mgr.34562) 1022 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T13:59:54.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:53 smithi132 bash[27079]: cephadm 2020-07-16T13:59:52.721120+0000 mgr.x (mgr.34562) 1023 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T13:59:54.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:53 smithi132 bash[27079]: cephadm 2020-07-16T13:59:52.721894+0000 mgr.x (mgr.34562) 1024 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T13:59:54.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:53 smithi132 bash[27079]: cephadm 2020-07-16T13:59:52.721943+0000 mgr.x (mgr.34562) 1025 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T13:59:55.162 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:54 smithi132 bash[27079]: cluster 2020-07-16T13:59:53.777273+0000 mgr.x (mgr.34562) 1026 : cluster [DBG] pgmap v637: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:59:55.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:54 smithi188 bash[23329]: cluster 2020-07-16T13:59:53.777273+0000 mgr.x (mgr.34562) 1026 : cluster [DBG] pgmap v637: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:59:56.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:55 smithi132 bash[27079]: audit 2020-07-16T13:59:55.688276+0000 mon.b (mon.2) 351 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:59:56.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:55 smithi188 bash[23329]: audit 2020-07-16T13:59:55.688276+0000 mon.b (mon.2) 351 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T13:59:57.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:56 smithi188 bash[23329]: cephadm 2020-07-16T13:59:55.688891+0000 mgr.x (mgr.34562) 1027 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:59:57.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:56 smithi188 bash[23329]: cephadm 2020-07-16T13:59:55.689320+0000 mgr.x (mgr.34562) 1028 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:59:57.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:56 smithi188 bash[23329]: cluster 2020-07-16T13:59:55.777729+0000 mgr.x (mgr.34562) 1029 : cluster [DBG] pgmap v638: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:59:57.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:56 smithi132 bash[27079]: cephadm 2020-07-16T13:59:55.688891+0000 mgr.x (mgr.34562) 1027 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T13:59:57.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:56 smithi132 bash[27079]: cephadm 2020-07-16T13:59:55.689320+0000 mgr.x (mgr.34562) 1028 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T13:59:57.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:56 smithi132 bash[27079]: cluster 2020-07-16T13:59:55.777729+0000 mgr.x (mgr.34562) 1029 : cluster [DBG] pgmap v638: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:59:59.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 13:59:58 smithi188 bash[23329]: cluster 2020-07-16T13:59:57.778155+0000 mgr.x (mgr.34562) 1030 : cluster [DBG] pgmap v639: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T13:59:59.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 13:59:58 smithi132 bash[27079]: cluster 2020-07-16T13:59:57.778155+0000 mgr.x (mgr.34562) 1030 : cluster [DBG] pgmap v639: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:00:00.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:00:00 smithi132 bash[27079]: cluster 2020-07-16T13:59:59.778551+0000 mgr.x (mgr.34562) 1031 : cluster [DBG] pgmap v640: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:00:00.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:00:00 smithi132 bash[27079]: cluster 2020-07-16T14:00:00.000154+0000 mon.c (mon.1) 120 : cluster [WRN] overall HEALTH_WARN 1/3 mons down, quorum c,b 2020-07-16T14:00:00.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:00:00 smithi188 bash[23329]: cluster 2020-07-16T13:59:59.778551+0000 mgr.x (mgr.34562) 1031 : cluster [DBG] pgmap v640: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:00:00.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:00:00 smithi188 bash[23329]: cluster 2020-07-16T14:00:00.000154+0000 mon.c (mon.1) 120 : cluster [WRN] overall HEALTH_WARN 1/3 mons down, quorum c,b 2020-07-16T14:00:03.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:00:02 smithi188 bash[23329]: cluster 2020-07-16T14:00:01.778886+0000 mgr.x (mgr.34562) 1032 : cluster [DBG] pgmap v641: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:00:03.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:00:02 smithi132 bash[27079]: cluster 2020-07-16T14:00:01.778886+0000 mgr.x (mgr.34562) 1032 : cluster [DBG] pgmap v641: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:00:05.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:00:04 smithi188 bash[23329]: cluster 2020-07-16T14:00:03.779201+0000 mgr.x (mgr.34562) 1033 : cluster [DBG] pgmap v642: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:00:05.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:00:04 smithi132 bash[27079]: cluster 2020-07-16T14:00:03.779201+0000 mgr.x (mgr.34562) 1033 : cluster [DBG] pgmap v642: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:00:07.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:00:06 smithi188 bash[23329]: cluster 2020-07-16T14:00:05.779561+0000 mgr.x (mgr.34562) 1034 : cluster [DBG] pgmap v643: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:00:07.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:00:06 smithi132 bash[27079]: cluster 2020-07-16T14:00:05.779561+0000 mgr.x (mgr.34562) 1034 : cluster [DBG] pgmap v643: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:00:09.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:00:08 smithi188 bash[23329]: cluster 2020-07-16T14:00:07.779980+0000 mgr.x (mgr.34562) 1035 : cluster [DBG] pgmap v644: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:00:09.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:00:08 smithi132 bash[27079]: cluster 2020-07-16T14:00:07.779980+0000 mgr.x (mgr.34562) 1035 : cluster [DBG] pgmap v644: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:00:10.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:00:10 smithi132 bash[27079]: cluster 2020-07-16T14:00:09.780376+0000 mgr.x (mgr.34562) 1036 : cluster [DBG] pgmap v645: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:00:10.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:00:10 smithi188 bash[23329]: cluster 2020-07-16T14:00:09.780376+0000 mgr.x (mgr.34562) 1036 : cluster [DBG] pgmap v645: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:00:11.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:00:11 smithi132 bash[27079]: audit 2020-07-16T14:00:10.704870+0000 mon.b (mon.2) 352 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:00:11.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:00:11 smithi132 bash[27079]: cephadm 2020-07-16T14:00:10.705576+0000 mgr.x (mgr.34562) 1037 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:00:11.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:00:11 smithi132 bash[27079]: cephadm 2020-07-16T14:00:10.705832+0000 mgr.x (mgr.34562) 1038 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:00:11.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:00:11 smithi188 bash[23329]: audit 2020-07-16T14:00:10.704870+0000 mon.b (mon.2) 352 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:00:11.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:00:11 smithi188 bash[23329]: cephadm 2020-07-16T14:00:10.705576+0000 mgr.x (mgr.34562) 1037 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:00:11.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:00:11 smithi188 bash[23329]: cephadm 2020-07-16T14:00:10.705832+0000 mgr.x (mgr.34562) 1038 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:00:12.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:00:12 smithi132 bash[27079]: cluster 2020-07-16T14:00:11.780897+0000 mgr.x (mgr.34562) 1039 : cluster [DBG] pgmap v646: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:00:12.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:00:12 smithi188 bash[23329]: cluster 2020-07-16T14:00:11.780897+0000 mgr.x (mgr.34562) 1039 : cluster [DBG] pgmap v646: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:00:15.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:00:14 smithi188 bash[23329]: cluster 2020-07-16T14:00:13.781315+0000 mgr.x (mgr.34562) 1040 : cluster [DBG] pgmap v647: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:00:15.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:00:14 smithi132 bash[27079]: cluster 2020-07-16T14:00:13.781315+0000 mgr.x (mgr.34562) 1040 : cluster [DBG] pgmap v647: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:00:17.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:00:16 smithi188 bash[23329]: cluster 2020-07-16T14:00:15.781633+0000 mgr.x (mgr.34562) 1041 : cluster [DBG] pgmap v648: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:00:17.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:00:16 smithi132 bash[27079]: cluster 2020-07-16T14:00:15.781633+0000 mgr.x (mgr.34562) 1041 : cluster [DBG] pgmap v648: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:00:19.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:00:18 smithi188 bash[23329]: cluster 2020-07-16T14:00:17.782138+0000 mgr.x (mgr.34562) 1042 : cluster [DBG] pgmap v649: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:00:19.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:00:18 smithi132 bash[27079]: cluster 2020-07-16T14:00:17.782138+0000 mgr.x (mgr.34562) 1042 : cluster [DBG] pgmap v649: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:00:20.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:00:20 smithi132 bash[27079]: cluster 2020-07-16T14:00:19.782455+0000 mgr.x (mgr.34562) 1043 : cluster [DBG] pgmap v650: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:00:20.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:00:20 smithi188 bash[23329]: cluster 2020-07-16T14:00:19.782455+0000 mgr.x (mgr.34562) 1043 : cluster [DBG] pgmap v650: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:00:22.774 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:00:23.036 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:00:23.036 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (23m) 30s ago 26m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:00:23.036 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (25m) 30s ago 25m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:00:23.037 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (23m) 30s ago 28m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:00:23.037 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (22m) 30s ago 30m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:00:23.037 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 30s ago 30m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:00:23.037 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (29m) 30s ago 29m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:00:23.037 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (29m) 30s ago 29m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:00:23.038 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (26m) 30s ago 26m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:00:23.038 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (26m) 30s ago 26m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:00:23.038 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (28m) 30s ago 28m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:00:23.038 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (28m) 30s ago 28m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:00:23.038 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (28m) 30s ago 28m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:00:23.039 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (27m) 30s ago 27m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:00:23.039 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (27m) 30s ago 27m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:00:23.039 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (27m) 30s ago 27m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:00:23.039 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (27m) 30s ago 27m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:00:23.039 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (26m) 30s ago 26m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:00:23.040 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (25m) 30s ago 26m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:00:23.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:00:22 smithi188 bash[23329]: cluster 2020-07-16T14:00:21.782878+0000 mgr.x (mgr.34562) 1044 : cluster [DBG] pgmap v651: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:00:23.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:00:22 smithi132 bash[27079]: cluster 2020-07-16T14:00:21.782878+0000 mgr.x (mgr.34562) 1044 : cluster [DBG] pgmap v651: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:00:23.333 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:00:23.334 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:00:23.334 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:00:23.334 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:00:23.335 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:00:23.335 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:00:23.335 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:00:23.336 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:00:23.336 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:00:23.336 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:00:23.337 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:00:23.337 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:00:23.337 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:00:23.337 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:00:23.337 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:00:23.338 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:00:23.338 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:00:24.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:00:23 smithi188 bash[23329]: audit 2020-07-16T14:00:22.762553+0000 mgr.x (mgr.34562) 1045 : audit [DBG] from='client.25396 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:00:24.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:00:23 smithi188 bash[23329]: audit 2020-07-16T14:00:23.031135+0000 mgr.x (mgr.34562) 1046 : audit [DBG] from='client.25402 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:00:24.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:00:23 smithi188 bash[23329]: audit 2020-07-16T14:00:23.332311+0000 mon.c (mon.1) 121 : audit [DBG] from='client.? 172.21.15.132:0/2104807852' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:00:24.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:00:23 smithi132 bash[27079]: audit 2020-07-16T14:00:22.762553+0000 mgr.x (mgr.34562) 1045 : audit [DBG] from='client.25396 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:00:24.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:00:23 smithi132 bash[27079]: audit 2020-07-16T14:00:23.031135+0000 mgr.x (mgr.34562) 1046 : audit [DBG] from='client.25402 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:00:24.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:00:23 smithi132 bash[27079]: audit 2020-07-16T14:00:23.332311+0000 mon.c (mon.1) 121 : audit [DBG] from='client.? 172.21.15.132:0/2104807852' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:00:25.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:00:24 smithi188 bash[23329]: cluster 2020-07-16T14:00:23.783367+0000 mgr.x (mgr.34562) 1047 : cluster [DBG] pgmap v652: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:00:25.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:00:24 smithi132 bash[27079]: cluster 2020-07-16T14:00:23.783367+0000 mgr.x (mgr.34562) 1047 : cluster [DBG] pgmap v652: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:00:26.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:00:25 smithi188 bash[23329]: audit 2020-07-16T14:00:25.716131+0000 mon.b (mon.2) 353 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:00:26.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:00:25 smithi132 bash[27079]: audit 2020-07-16T14:00:25.716131+0000 mon.b (mon.2) 353 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:00:27.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:00:26 smithi188 bash[23329]: cephadm 2020-07-16T14:00:25.716800+0000 mgr.x (mgr.34562) 1048 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:00:27.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:00:26 smithi188 bash[23329]: cephadm 2020-07-16T14:00:25.717100+0000 mgr.x (mgr.34562) 1049 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:00:27.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:00:26 smithi188 bash[23329]: cluster 2020-07-16T14:00:25.783733+0000 mgr.x (mgr.34562) 1050 : cluster [DBG] pgmap v653: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:00:27.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:00:26 smithi132 bash[27079]: cephadm 2020-07-16T14:00:25.716800+0000 mgr.x (mgr.34562) 1048 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:00:27.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:00:26 smithi132 bash[27079]: cephadm 2020-07-16T14:00:25.717100+0000 mgr.x (mgr.34562) 1049 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:00:27.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:00:26 smithi132 bash[27079]: cluster 2020-07-16T14:00:25.783733+0000 mgr.x (mgr.34562) 1050 : cluster [DBG] pgmap v653: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:00:29.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:00:28 smithi188 bash[23329]: cluster 2020-07-16T14:00:27.784130+0000 mgr.x (mgr.34562) 1051 : cluster [DBG] pgmap v654: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:00:29.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:00:28 smithi132 bash[27079]: cluster 2020-07-16T14:00:27.784130+0000 mgr.x (mgr.34562) 1051 : cluster [DBG] pgmap v654: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:00:30.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:00:30 smithi132 bash[27079]: cluster 2020-07-16T14:00:29.784615+0000 mgr.x (mgr.34562) 1052 : cluster [DBG] pgmap v655: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:00:30.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:00:30 smithi188 bash[23329]: cluster 2020-07-16T14:00:29.784615+0000 mgr.x (mgr.34562) 1052 : cluster [DBG] pgmap v655: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:00:33.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:00:32 smithi188 bash[23329]: cluster 2020-07-16T14:00:31.785032+0000 mgr.x (mgr.34562) 1053 : cluster [DBG] pgmap v656: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:00:33.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:00:32 smithi132 bash[27079]: cluster 2020-07-16T14:00:31.785032+0000 mgr.x (mgr.34562) 1053 : cluster [DBG] pgmap v656: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:00:35.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:00:34 smithi188 bash[23329]: cluster 2020-07-16T14:00:33.785481+0000 mgr.x (mgr.34562) 1054 : cluster [DBG] pgmap v657: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:00:35.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:00:34 smithi132 bash[27079]: cluster 2020-07-16T14:00:33.785481+0000 mgr.x (mgr.34562) 1054 : cluster [DBG] pgmap v657: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:00:37.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:00:36 smithi188 bash[23329]: cluster 2020-07-16T14:00:35.785940+0000 mgr.x (mgr.34562) 1055 : cluster [DBG] pgmap v658: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:00:37.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:00:36 smithi132 bash[27079]: cluster 2020-07-16T14:00:35.785940+0000 mgr.x (mgr.34562) 1055 : cluster [DBG] pgmap v658: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:00:39.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:00:38 smithi188 bash[23329]: cluster 2020-07-16T14:00:37.786474+0000 mgr.x (mgr.34562) 1056 : cluster [DBG] pgmap v659: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:00:39.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:00:38 smithi132 bash[27079]: cluster 2020-07-16T14:00:37.786474+0000 mgr.x (mgr.34562) 1056 : cluster [DBG] pgmap v659: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:00:40.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:00:40 smithi132 bash[27079]: cluster 2020-07-16T14:00:39.787036+0000 mgr.x (mgr.34562) 1057 : cluster [DBG] pgmap v660: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:00:40.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:00:40 smithi188 bash[23329]: cluster 2020-07-16T14:00:39.787036+0000 mgr.x (mgr.34562) 1057 : cluster [DBG] pgmap v660: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:00:41.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:00:41 smithi132 bash[27079]: audit 2020-07-16T14:00:40.730777+0000 mon.b (mon.2) 354 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:00:41.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:00:41 smithi132 bash[27079]: cephadm 2020-07-16T14:00:40.731466+0000 mgr.x (mgr.34562) 1058 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:00:41.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:00:41 smithi132 bash[27079]: cephadm 2020-07-16T14:00:40.731798+0000 mgr.x (mgr.34562) 1059 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:00:41.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:00:41 smithi188 bash[23329]: audit 2020-07-16T14:00:40.730777+0000 mon.b (mon.2) 354 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:00:41.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:00:41 smithi188 bash[23329]: cephadm 2020-07-16T14:00:40.731466+0000 mgr.x (mgr.34562) 1058 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:00:41.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:00:41 smithi188 bash[23329]: cephadm 2020-07-16T14:00:40.731798+0000 mgr.x (mgr.34562) 1059 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:00:42.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:00:42 smithi132 bash[27079]: cluster 2020-07-16T14:00:41.787386+0000 mgr.x (mgr.34562) 1060 : cluster [DBG] pgmap v661: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:00:42.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:00:42 smithi188 bash[23329]: cluster 2020-07-16T14:00:41.787386+0000 mgr.x (mgr.34562) 1060 : cluster [DBG] pgmap v661: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:00:45.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:00:44 smithi188 bash[23329]: cluster 2020-07-16T14:00:43.787810+0000 mgr.x (mgr.34562) 1061 : cluster [DBG] pgmap v662: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:00:45.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:00:44 smithi132 bash[27079]: cluster 2020-07-16T14:00:43.787810+0000 mgr.x (mgr.34562) 1061 : cluster [DBG] pgmap v662: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:00:47.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:00:46 smithi188 bash[23329]: cluster 2020-07-16T14:00:45.788145+0000 mgr.x (mgr.34562) 1062 : cluster [DBG] pgmap v663: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:00:47.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:00:46 smithi132 bash[27079]: cluster 2020-07-16T14:00:45.788145+0000 mgr.x (mgr.34562) 1062 : cluster [DBG] pgmap v663: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:00:49.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:00:48 smithi188 bash[23329]: cluster 2020-07-16T14:00:47.788546+0000 mgr.x (mgr.34562) 1063 : cluster [DBG] pgmap v664: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:00:49.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:00:48 smithi132 bash[27079]: cluster 2020-07-16T14:00:47.788546+0000 mgr.x (mgr.34562) 1063 : cluster [DBG] pgmap v664: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:00:50.538 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:00:50 smithi132 bash[27079]: cluster 2020-07-16T14:00:49.788915+0000 mgr.x (mgr.34562) 1064 : cluster [DBG] pgmap v665: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:00:50.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:00:50 smithi188 bash[23329]: cluster 2020-07-16T14:00:49.788915+0000 mgr.x (mgr.34562) 1064 : cluster [DBG] pgmap v665: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:00:53.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:00:52 smithi188 bash[23329]: cluster 2020-07-16T14:00:51.789382+0000 mgr.x (mgr.34562) 1065 : cluster [DBG] pgmap v666: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:00:53.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:00:52 smithi132 bash[27079]: cluster 2020-07-16T14:00:51.789382+0000 mgr.x (mgr.34562) 1065 : cluster [DBG] pgmap v666: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:00:53.629 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:00:53.891 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:00:53.891 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (23m) 61s ago 26m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:00:53.891 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (26m) 61s ago 26m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:00:53.892 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (23m) 61s ago 29m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:00:53.892 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (23m) 61s ago 31m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:00:53.892 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 61s ago 31m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:00:53.892 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (29m) 61s ago 29m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:00:53.892 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (29m) 61s ago 29m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:00:53.893 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (26m) 61s ago 26m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:00:53.893 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (26m) 61s ago 26m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:00:53.893 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (29m) 61s ago 29m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:00:53.893 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (28m) 61s ago 29m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:00:53.893 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (28m) 61s ago 28m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:00:53.894 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (28m) 61s ago 28m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:00:53.894 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (27m) 61s ago 28m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:00:53.894 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (27m) 61s ago 27m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:00:53.894 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (27m) 61s ago 27m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:00:53.894 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (27m) 61s ago 27m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:00:53.895 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (26m) 61s ago 26m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:00:54.189 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:00:54.190 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:00:54.190 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:00:54.190 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:00:54.190 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:00:54.191 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:00:54.191 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:00:54.191 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:00:54.191 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:00:54.191 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:00:54.192 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:00:54.192 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:00:54.192 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:00:54.192 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:00:54.192 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:00:54.193 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:00:54.193 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:00:55.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:00:54 smithi188 bash[23329]: audit 2020-07-16T14:00:53.617992+0000 mgr.x (mgr.34562) 1066 : audit [DBG] from='client.25414 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:00:55.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:00:54 smithi188 bash[23329]: cluster 2020-07-16T14:00:53.789772+0000 mgr.x (mgr.34562) 1067 : cluster [DBG] pgmap v667: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:00:55.175 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:00:54 smithi188 bash[23329]: audit 2020-07-16T14:00:53.886304+0000 mgr.x (mgr.34562) 1068 : audit [DBG] from='client.25420 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:00:55.175 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:00:54 smithi188 bash[23329]: audit 2020-07-16T14:00:54.188570+0000 mon.c (mon.1) 122 : audit [DBG] from='client.? 172.21.15.132:0/2158328727' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:00:55.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:00:54 smithi132 bash[27079]: audit 2020-07-16T14:00:53.617992+0000 mgr.x (mgr.34562) 1066 : audit [DBG] from='client.25414 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:00:55.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:00:54 smithi132 bash[27079]: cluster 2020-07-16T14:00:53.789772+0000 mgr.x (mgr.34562) 1067 : cluster [DBG] pgmap v667: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:00:55.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:00:54 smithi132 bash[27079]: audit 2020-07-16T14:00:53.886304+0000 mgr.x (mgr.34562) 1068 : audit [DBG] from='client.25420 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:00:55.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:00:54 smithi132 bash[27079]: audit 2020-07-16T14:00:54.188570+0000 mon.c (mon.1) 122 : audit [DBG] from='client.? 172.21.15.132:0/2158328727' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:00:56.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:00:55 smithi188 bash[23329]: audit 2020-07-16T14:00:55.747739+0000 mon.b (mon.2) 355 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:00:56.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:00:55 smithi188 bash[23329]: audit 2020-07-16T14:00:55.749125+0000 mon.b (mon.2) 356 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:00:56.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:00:55 smithi188 bash[23329]: audit 2020-07-16T14:00:55.750384+0000 mon.b (mon.2) 357 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:00:56.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:00:55 smithi188 bash[23329]: audit 2020-07-16T14:00:55.752064+0000 mon.b (mon.2) 358 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:00:56.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:00:55 smithi188 bash[23329]: audit 2020-07-16T14:00:55.753601+0000 mon.b (mon.2) 359 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:00:56.270 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:00:55 smithi132 bash[27079]: audit 2020-07-16T14:00:55.747739+0000 mon.b (mon.2) 355 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:00:56.270 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:00:55 smithi132 bash[27079]: audit 2020-07-16T14:00:55.749125+0000 mon.b (mon.2) 356 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:00:56.270 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:00:55 smithi132 bash[27079]: audit 2020-07-16T14:00:55.750384+0000 mon.b (mon.2) 357 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:00:56.271 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:00:55 smithi132 bash[27079]: audit 2020-07-16T14:00:55.752064+0000 mon.b (mon.2) 358 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:00:56.271 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:00:55 smithi132 bash[27079]: audit 2020-07-16T14:00:55.753601+0000 mon.b (mon.2) 359 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:00:57.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:00:56 smithi132 bash[27079]: audit 2020-07-16T14:00:55.748105+0000 mgr.x (mgr.34562) 1069 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:00:57.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:00:56 smithi132 bash[27079]: audit 2020-07-16T14:00:55.749445+0000 mgr.x (mgr.34562) 1070 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:00:57.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:00:56 smithi132 bash[27079]: audit 2020-07-16T14:00:55.750666+0000 mgr.x (mgr.34562) 1071 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:00:57.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:00:56 smithi132 bash[27079]: cephadm 2020-07-16T14:00:55.751471+0000 mgr.x (mgr.34562) 1072 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:00:57.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:00:56 smithi132 bash[27079]: cephadm 2020-07-16T14:00:55.753026+0000 mgr.x (mgr.34562) 1073 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:00:57.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:00:56 smithi132 bash[27079]: cephadm 2020-07-16T14:00:55.754359+0000 mgr.x (mgr.34562) 1074 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:00:57.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:00:56 smithi132 bash[27079]: cephadm 2020-07-16T14:00:55.754634+0000 mgr.x (mgr.34562) 1075 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:00:57.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:00:56 smithi132 bash[27079]: cluster 2020-07-16T14:00:55.790142+0000 mgr.x (mgr.34562) 1076 : cluster [DBG] pgmap v668: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:00:57.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:00:56 smithi188 bash[23329]: audit 2020-07-16T14:00:55.748105+0000 mgr.x (mgr.34562) 1069 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:00:57.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:00:56 smithi188 bash[23329]: audit 2020-07-16T14:00:55.749445+0000 mgr.x (mgr.34562) 1070 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:00:57.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:00:56 smithi188 bash[23329]: audit 2020-07-16T14:00:55.750666+0000 mgr.x (mgr.34562) 1071 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:00:57.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:00:56 smithi188 bash[23329]: cephadm 2020-07-16T14:00:55.751471+0000 mgr.x (mgr.34562) 1072 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:00:57.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:00:56 smithi188 bash[23329]: cephadm 2020-07-16T14:00:55.753026+0000 mgr.x (mgr.34562) 1073 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:00:57.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:00:56 smithi188 bash[23329]: cephadm 2020-07-16T14:00:55.754359+0000 mgr.x (mgr.34562) 1074 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:00:57.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:00:56 smithi188 bash[23329]: cephadm 2020-07-16T14:00:55.754634+0000 mgr.x (mgr.34562) 1075 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:00:57.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:00:56 smithi188 bash[23329]: cluster 2020-07-16T14:00:55.790142+0000 mgr.x (mgr.34562) 1076 : cluster [DBG] pgmap v668: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:00:59.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:00:58 smithi132 bash[27079]: cluster 2020-07-16T14:00:57.790526+0000 mgr.x (mgr.34562) 1077 : cluster [DBG] pgmap v669: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:00:59.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:00:58 smithi132 bash[27079]: audit 2020-07-16T14:00:58.659317+0000 mon.b (mon.2) 360 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:00:59.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:00:58 smithi188 bash[23329]: cluster 2020-07-16T14:00:57.790526+0000 mgr.x (mgr.34562) 1077 : cluster [DBG] pgmap v669: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:00:59.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:00:58 smithi188 bash[23329]: audit 2020-07-16T14:00:58.659317+0000 mon.b (mon.2) 360 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:01:00.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:00:59 smithi188 bash[23329]: cephadm 2020-07-16T14:00:58.659997+0000 mgr.x (mgr.34562) 1078 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:01:00.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:00:59 smithi188 bash[23329]: cephadm 2020-07-16T14:00:58.660434+0000 mgr.x (mgr.34562) 1079 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:01:00.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:00:59 smithi132 bash[27079]: cephadm 2020-07-16T14:00:58.659997+0000 mgr.x (mgr.34562) 1078 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:01:00.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:00:59 smithi132 bash[27079]: cephadm 2020-07-16T14:00:58.660434+0000 mgr.x (mgr.34562) 1079 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:01:01.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:01:00 smithi188 bash[23329]: cluster 2020-07-16T14:00:59.791011+0000 mgr.x (mgr.34562) 1080 : cluster [DBG] pgmap v670: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:01:01.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:01:00 smithi132 bash[27079]: cluster 2020-07-16T14:00:59.791011+0000 mgr.x (mgr.34562) 1080 : cluster [DBG] pgmap v670: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:01:03.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:01:02 smithi188 bash[23329]: cluster 2020-07-16T14:01:01.791474+0000 mgr.x (mgr.34562) 1081 : cluster [DBG] pgmap v671: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:01:03.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:01:02 smithi132 bash[27079]: cluster 2020-07-16T14:01:01.791474+0000 mgr.x (mgr.34562) 1081 : cluster [DBG] pgmap v671: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:01:05.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:01:04 smithi188 bash[23329]: cluster 2020-07-16T14:01:03.791904+0000 mgr.x (mgr.34562) 1082 : cluster [DBG] pgmap v672: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:01:05.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:01:04 smithi132 bash[27079]: cluster 2020-07-16T14:01:03.791904+0000 mgr.x (mgr.34562) 1082 : cluster [DBG] pgmap v672: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:01:07.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:01:06 smithi188 bash[23329]: cluster 2020-07-16T14:01:05.792258+0000 mgr.x (mgr.34562) 1083 : cluster [DBG] pgmap v673: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:01:07.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:01:06 smithi132 bash[27079]: cluster 2020-07-16T14:01:05.792258+0000 mgr.x (mgr.34562) 1083 : cluster [DBG] pgmap v673: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:01:09.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:01:08 smithi188 bash[23329]: cluster 2020-07-16T14:01:07.792818+0000 mgr.x (mgr.34562) 1084 : cluster [DBG] pgmap v674: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:01:09.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:01:08 smithi132 bash[27079]: cluster 2020-07-16T14:01:07.792818+0000 mgr.x (mgr.34562) 1084 : cluster [DBG] pgmap v674: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:01:10.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:01:10 smithi132 bash[27079]: cluster 2020-07-16T14:01:09.793327+0000 mgr.x (mgr.34562) 1085 : cluster [DBG] pgmap v675: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:01:10.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:01:10 smithi188 bash[23329]: cluster 2020-07-16T14:01:09.793327+0000 mgr.x (mgr.34562) 1085 : cluster [DBG] pgmap v675: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:01:13.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:01:12 smithi188 bash[23329]: cluster 2020-07-16T14:01:11.793878+0000 mgr.x (mgr.34562) 1086 : cluster [DBG] pgmap v676: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:01:13.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:01:12 smithi132 bash[27079]: cluster 2020-07-16T14:01:11.793878+0000 mgr.x (mgr.34562) 1086 : cluster [DBG] pgmap v676: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:01:14.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:01:13 smithi188 bash[23329]: audit 2020-07-16T14:01:13.676027+0000 mon.b (mon.2) 361 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:01:14.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:01:13 smithi132 bash[27079]: audit 2020-07-16T14:01:13.676027+0000 mon.b (mon.2) 361 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:01:15.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:01:14 smithi188 bash[23329]: cephadm 2020-07-16T14:01:13.676799+0000 mgr.x (mgr.34562) 1087 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:01:15.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:01:14 smithi188 bash[23329]: cephadm 2020-07-16T14:01:13.677267+0000 mgr.x (mgr.34562) 1088 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:01:15.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:01:14 smithi188 bash[23329]: cluster 2020-07-16T14:01:13.794314+0000 mgr.x (mgr.34562) 1089 : cluster [DBG] pgmap v677: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:01:15.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:01:14 smithi132 bash[27079]: cephadm 2020-07-16T14:01:13.676799+0000 mgr.x (mgr.34562) 1087 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:01:15.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:01:14 smithi132 bash[27079]: cephadm 2020-07-16T14:01:13.677267+0000 mgr.x (mgr.34562) 1088 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:01:15.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:01:14 smithi132 bash[27079]: cluster 2020-07-16T14:01:13.794314+0000 mgr.x (mgr.34562) 1089 : cluster [DBG] pgmap v677: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:01:17.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:01:16 smithi188 bash[23329]: cluster 2020-07-16T14:01:15.794790+0000 mgr.x (mgr.34562) 1090 : cluster [DBG] pgmap v678: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:01:17.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:01:16 smithi132 bash[27079]: cluster 2020-07-16T14:01:15.794790+0000 mgr.x (mgr.34562) 1090 : cluster [DBG] pgmap v678: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:01:19.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:01:18 smithi188 bash[23329]: cluster 2020-07-16T14:01:17.795397+0000 mgr.x (mgr.34562) 1091 : cluster [DBG] pgmap v679: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:01:19.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:01:18 smithi132 bash[27079]: cluster 2020-07-16T14:01:17.795397+0000 mgr.x (mgr.34562) 1091 : cluster [DBG] pgmap v679: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:01:20.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:01:20 smithi132 bash[27079]: cluster 2020-07-16T14:01:19.795872+0000 mgr.x (mgr.34562) 1092 : cluster [DBG] pgmap v680: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:01:20.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:01:20 smithi188 bash[23329]: cluster 2020-07-16T14:01:19.795872+0000 mgr.x (mgr.34562) 1092 : cluster [DBG] pgmap v680: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:01:23.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:01:22 smithi188 bash[23329]: cluster 2020-07-16T14:01:21.796457+0000 mgr.x (mgr.34562) 1093 : cluster [DBG] pgmap v681: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:01:23.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:01:22 smithi132 bash[27079]: cluster 2020-07-16T14:01:21.796457+0000 mgr.x (mgr.34562) 1093 : cluster [DBG] pgmap v681: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:01:24.488 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:01:24.758 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:01:24.758 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (24m) 92s ago 27m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:01:24.759 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (26m) 92s ago 26m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:01:24.759 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (24m) 92s ago 30m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:01:24.759 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (23m) 92s ago 31m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:01:24.759 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 92s ago 31m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:01:24.760 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (30m) 92s ago 30m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:01:24.760 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (30m) 92s ago 30m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:01:24.760 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (27m) 92s ago 27m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:01:24.760 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (27m) 92s ago 27m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:01:24.760 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (29m) 92s ago 29m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:01:24.761 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (29m) 92s ago 29m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:01:24.761 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (29m) 92s ago 29m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:01:24.761 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (28m) 92s ago 28m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:01:24.761 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (28m) 92s ago 28m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:01:24.761 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (28m) 92s ago 28m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:01:24.762 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (28m) 92s ago 28m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:01:24.762 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (27m) 92s ago 27m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:01:24.762 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (26m) 92s ago 27m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:01:25.064 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:01:25.065 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:01:25.065 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:01:25.065 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:01:25.065 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:01:25.066 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:01:25.066 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:01:25.066 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:01:25.066 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:01:25.066 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:01:25.066 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:01:25.067 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:01:25.067 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:01:25.067 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:01:25.067 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:01:25.067 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:01:25.068 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:01:25.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:01:24 smithi188 bash[23329]: cluster 2020-07-16T14:01:23.796849+0000 mgr.x (mgr.34562) 1094 : cluster [DBG] pgmap v682: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:01:25.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:01:24 smithi132 bash[27079]: cluster 2020-07-16T14:01:23.796849+0000 mgr.x (mgr.34562) 1094 : cluster [DBG] pgmap v682: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:01:26.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:01:25 smithi188 bash[23329]: audit 2020-07-16T14:01:24.476328+0000 mgr.x (mgr.34562) 1095 : audit [DBG] from='client.25432 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:01:26.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:01:25 smithi188 bash[23329]: audit 2020-07-16T14:01:24.753140+0000 mgr.x (mgr.34562) 1096 : audit [DBG] from='client.25438 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:01:26.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:01:25 smithi188 bash[23329]: audit 2020-07-16T14:01:25.054919+0000 mon.c (mon.1) 123 : audit [DBG] from='client.? 172.21.15.132:0/1829437040' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:01:26.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:01:25 smithi132 bash[27079]: audit 2020-07-16T14:01:24.476328+0000 mgr.x (mgr.34562) 1095 : audit [DBG] from='client.25432 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:01:26.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:01:25 smithi132 bash[27079]: audit 2020-07-16T14:01:24.753140+0000 mgr.x (mgr.34562) 1096 : audit [DBG] from='client.25438 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:01:26.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:01:25 smithi132 bash[27079]: audit 2020-07-16T14:01:25.054919+0000 mon.c (mon.1) 123 : audit [DBG] from='client.? 172.21.15.132:0/1829437040' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:01:27.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:01:26 smithi188 bash[23329]: cluster 2020-07-16T14:01:25.797222+0000 mgr.x (mgr.34562) 1097 : cluster [DBG] pgmap v683: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:01:27.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:01:26 smithi132 bash[27079]: cluster 2020-07-16T14:01:25.797222+0000 mgr.x (mgr.34562) 1097 : cluster [DBG] pgmap v683: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:01:29.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:01:28 smithi188 bash[23329]: cluster 2020-07-16T14:01:27.797694+0000 mgr.x (mgr.34562) 1098 : cluster [DBG] pgmap v684: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:01:29.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:01:28 smithi188 bash[23329]: audit 2020-07-16T14:01:28.692921+0000 mon.b (mon.2) 362 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:01:29.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:01:28 smithi132 bash[27079]: cluster 2020-07-16T14:01:27.797694+0000 mgr.x (mgr.34562) 1098 : cluster [DBG] pgmap v684: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:01:29.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:01:28 smithi132 bash[27079]: audit 2020-07-16T14:01:28.692921+0000 mon.b (mon.2) 362 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:01:30.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:01:29 smithi188 bash[23329]: cephadm 2020-07-16T14:01:28.693684+0000 mgr.x (mgr.34562) 1099 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:01:30.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:01:29 smithi188 bash[23329]: cephadm 2020-07-16T14:01:28.694108+0000 mgr.x (mgr.34562) 1100 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:01:30.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:01:29 smithi132 bash[27079]: cephadm 2020-07-16T14:01:28.693684+0000 mgr.x (mgr.34562) 1099 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:01:30.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:01:29 smithi132 bash[27079]: cephadm 2020-07-16T14:01:28.694108+0000 mgr.x (mgr.34562) 1100 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:01:31.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:01:30 smithi188 bash[23329]: cluster 2020-07-16T14:01:29.798106+0000 mgr.x (mgr.34562) 1101 : cluster [DBG] pgmap v685: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:01:31.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:01:30 smithi132 bash[27079]: cluster 2020-07-16T14:01:29.798106+0000 mgr.x (mgr.34562) 1101 : cluster [DBG] pgmap v685: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:01:33.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:01:32 smithi188 bash[23329]: cluster 2020-07-16T14:01:31.798639+0000 mgr.x (mgr.34562) 1102 : cluster [DBG] pgmap v686: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:01:33.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:01:32 smithi132 bash[27079]: cluster 2020-07-16T14:01:31.798639+0000 mgr.x (mgr.34562) 1102 : cluster [DBG] pgmap v686: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:01:35.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:01:34 smithi188 bash[23329]: cluster 2020-07-16T14:01:33.799056+0000 mgr.x (mgr.34562) 1103 : cluster [DBG] pgmap v687: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:01:35.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:01:34 smithi132 bash[27079]: cluster 2020-07-16T14:01:33.799056+0000 mgr.x (mgr.34562) 1103 : cluster [DBG] pgmap v687: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:01:37.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:01:36 smithi188 bash[23329]: cluster 2020-07-16T14:01:35.799443+0000 mgr.x (mgr.34562) 1104 : cluster [DBG] pgmap v688: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:01:37.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:01:36 smithi132 bash[27079]: cluster 2020-07-16T14:01:35.799443+0000 mgr.x (mgr.34562) 1104 : cluster [DBG] pgmap v688: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:01:39.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:01:38 smithi188 bash[23329]: cluster 2020-07-16T14:01:37.799868+0000 mgr.x (mgr.34562) 1105 : cluster [DBG] pgmap v689: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:01:39.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:01:38 smithi132 bash[27079]: cluster 2020-07-16T14:01:37.799868+0000 mgr.x (mgr.34562) 1105 : cluster [DBG] pgmap v689: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:01:40.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:01:40 smithi132 bash[27079]: cluster 2020-07-16T14:01:39.800336+0000 mgr.x (mgr.34562) 1106 : cluster [DBG] pgmap v690: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:01:40.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:01:40 smithi188 bash[23329]: cluster 2020-07-16T14:01:39.800336+0000 mgr.x (mgr.34562) 1106 : cluster [DBG] pgmap v690: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:01:43.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:01:42 smithi188 bash[23329]: cluster 2020-07-16T14:01:41.800859+0000 mgr.x (mgr.34562) 1107 : cluster [DBG] pgmap v691: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:01:43.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:01:42 smithi132 bash[27079]: cluster 2020-07-16T14:01:41.800859+0000 mgr.x (mgr.34562) 1107 : cluster [DBG] pgmap v691: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:01:44.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:01:43 smithi188 bash[23329]: audit 2020-07-16T14:01:43.699892+0000 mon.b (mon.2) 363 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:01:44.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:01:43 smithi132 bash[27079]: audit 2020-07-16T14:01:43.699892+0000 mon.b (mon.2) 363 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:01:45.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:01:44 smithi188 bash[23329]: cephadm 2020-07-16T14:01:43.700665+0000 mgr.x (mgr.34562) 1108 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:01:45.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:01:44 smithi188 bash[23329]: cephadm 2020-07-16T14:01:43.701025+0000 mgr.x (mgr.34562) 1109 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:01:45.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:01:44 smithi188 bash[23329]: cluster 2020-07-16T14:01:43.801359+0000 mgr.x (mgr.34562) 1110 : cluster [DBG] pgmap v692: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:01:45.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:01:44 smithi132 bash[27079]: cephadm 2020-07-16T14:01:43.700665+0000 mgr.x (mgr.34562) 1108 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:01:45.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:01:44 smithi132 bash[27079]: cephadm 2020-07-16T14:01:43.701025+0000 mgr.x (mgr.34562) 1109 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:01:45.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:01:44 smithi132 bash[27079]: cluster 2020-07-16T14:01:43.801359+0000 mgr.x (mgr.34562) 1110 : cluster [DBG] pgmap v692: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:01:47.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:01:46 smithi188 bash[23329]: cluster 2020-07-16T14:01:45.801826+0000 mgr.x (mgr.34562) 1111 : cluster [DBG] pgmap v693: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:01:47.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:01:46 smithi132 bash[27079]: cluster 2020-07-16T14:01:45.801826+0000 mgr.x (mgr.34562) 1111 : cluster [DBG] pgmap v693: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:01:49.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:01:48 smithi188 bash[23329]: cluster 2020-07-16T14:01:47.802295+0000 mgr.x (mgr.34562) 1112 : cluster [DBG] pgmap v694: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:01:49.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:01:48 smithi132 bash[27079]: cluster 2020-07-16T14:01:47.802295+0000 mgr.x (mgr.34562) 1112 : cluster [DBG] pgmap v694: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:01:50.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:01:50 smithi132 bash[27079]: cluster 2020-07-16T14:01:49.802695+0000 mgr.x (mgr.34562) 1113 : cluster [DBG] pgmap v695: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:01:50.678 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:01:50 smithi188 bash[23329]: cluster 2020-07-16T14:01:49.802695+0000 mgr.x (mgr.34562) 1113 : cluster [DBG] pgmap v695: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:01:53.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:01:52 smithi188 bash[23329]: cluster 2020-07-16T14:01:51.803230+0000 mgr.x (mgr.34562) 1114 : cluster [DBG] pgmap v696: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:01:53.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:01:52 smithi132 bash[27079]: cluster 2020-07-16T14:01:51.803230+0000 mgr.x (mgr.34562) 1114 : cluster [DBG] pgmap v696: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:01:55.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:01:54 smithi188 bash[23329]: cluster 2020-07-16T14:01:53.803758+0000 mgr.x (mgr.34562) 1115 : cluster [DBG] pgmap v697: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:01:55.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:01:54 smithi132 bash[27079]: cluster 2020-07-16T14:01:53.803758+0000 mgr.x (mgr.34562) 1115 : cluster [DBG] pgmap v697: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:01:55.353 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:01:55.615 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:01:55.615 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (24m) 2m ago 27m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:01:55.616 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (27m) 2m ago 27m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:01:55.616 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (24m) 2m ago 30m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:01:55.616 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (24m) 2m ago 32m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:01:55.616 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 2m ago 32m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:01:55.616 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (30m) 2m ago 30m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:01:55.617 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (30m) 2m ago 30m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:01:55.617 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (27m) 2m ago 27m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:01:55.617 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (27m) 2m ago 27m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:01:55.617 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (30m) 2m ago 30m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:01:55.617 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (30m) 2m ago 30m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:01:55.617 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (29m) 2m ago 29m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:01:55.618 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (29m) 2m ago 29m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:01:55.618 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (28m) 2m ago 29m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:01:55.618 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (28m) 2m ago 28m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:01:55.618 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (28m) 2m ago 28m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:01:55.618 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (28m) 2m ago 28m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:01:55.619 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (27m) 2m ago 27m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:01:55.912 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:01:55.912 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:01:55.913 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:01:55.913 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:01:55.913 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:01:55.913 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:01:55.914 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:01:55.914 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:01:55.914 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:01:55.914 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:01:55.914 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:01:55.915 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:01:55.915 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:01:55.915 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:01:55.915 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:01:55.915 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:01:55.916 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:01:57.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:01:56 smithi188 bash[23329]: audit 2020-07-16T14:01:55.341646+0000 mgr.x (mgr.34562) 1116 : audit [DBG] from='client.25450 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:01:57.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:01:56 smithi188 bash[23329]: audit 2020-07-16T14:01:55.610553+0000 mgr.x (mgr.34562) 1117 : audit [DBG] from='client.25456 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:01:57.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:01:56 smithi188 bash[23329]: cluster 2020-07-16T14:01:55.804232+0000 mgr.x (mgr.34562) 1118 : cluster [DBG] pgmap v698: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:01:57.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:01:56 smithi188 bash[23329]: audit 2020-07-16T14:01:55.911368+0000 mon.c (mon.1) 124 : audit [DBG] from='client.? 172.21.15.132:0/1358638112' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:01:57.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:01:56 smithi132 bash[27079]: audit 2020-07-16T14:01:55.341646+0000 mgr.x (mgr.34562) 1116 : audit [DBG] from='client.25450 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:01:57.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:01:56 smithi132 bash[27079]: audit 2020-07-16T14:01:55.610553+0000 mgr.x (mgr.34562) 1117 : audit [DBG] from='client.25456 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:01:57.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:01:56 smithi132 bash[27079]: cluster 2020-07-16T14:01:55.804232+0000 mgr.x (mgr.34562) 1118 : cluster [DBG] pgmap v698: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:01:57.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:01:56 smithi132 bash[27079]: audit 2020-07-16T14:01:55.911368+0000 mon.c (mon.1) 124 : audit [DBG] from='client.? 172.21.15.132:0/1358638112' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:01:59.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:01:58 smithi188 bash[23329]: cluster 2020-07-16T14:01:57.804788+0000 mgr.x (mgr.34562) 1119 : cluster [DBG] pgmap v699: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:01:59.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:01:58 smithi132 bash[27079]: cluster 2020-07-16T14:01:57.804788+0000 mgr.x (mgr.34562) 1119 : cluster [DBG] pgmap v699: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:02:00.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:01:59 smithi132 bash[27079]: audit 2020-07-16T14:01:58.947307+0000 mon.b (mon.2) 364 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710380\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710452\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710485\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710667\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710772\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710871\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710971\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.711004\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.711031\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:59:52.711098\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T14:01:58.946423\"}"}]: dispatch 2020-07-16T14:02:00.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:01:59 smithi132 bash[27079]: audit 2020-07-16T14:01:58.947716+0000 mon.b (mon.2) 365 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T13:59:52.409762\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.409823\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.409858\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.409894\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410117\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410237\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410349\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410455\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410489\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T13:59:52.410562\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T14:01:58.947052\"}"}]: dispatch 2020-07-16T14:02:00.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:01:59 smithi132 bash[27079]: audit 2020-07-16T14:01:58.947955+0000 mon.c (mon.1) 125 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710380\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710452\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710485\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710667\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710772\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710871\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710971\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.711004\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.711031\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:59:52.711098\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T14:01:58.946423\"}"}]: dispatch 2020-07-16T14:02:00.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:01:59 smithi132 bash[27079]: audit 2020-07-16T14:01:58.948572+0000 mon.c (mon.1) 126 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T13:59:52.409762\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.409823\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.409858\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.409894\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410117\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410237\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410349\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410455\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410489\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T13:59:52.410562\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T14:01:58.947052\"}"}]: dispatch 2020-07-16T14:02:00.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:01:59 smithi132 bash[27079]: audit 2020-07-16T14:01:58.950742+0000 mon.c (mon.1) 127 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710380\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710452\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710485\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710667\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710772\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710871\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710971\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.711004\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.711031\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:59:52.711098\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T14:01:58.946423\"}"}]': finished 2020-07-16T14:02:00.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:01:59 smithi132 bash[27079]: audit 2020-07-16T14:01:58.955422+0000 mon.c (mon.1) 128 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T13:59:52.409762\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.409823\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.409858\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.409894\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410117\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410237\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410349\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410455\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410489\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T13:59:52.410562\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T14:01:58.947052\"}"}]': finished 2020-07-16T14:02:00.033 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:01:59 smithi132 bash[27079]: audit 2020-07-16T14:01:58.959858+0000 mon.b (mon.2) 366 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:02:00.033 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:01:59 smithi132 bash[27079]: audit 2020-07-16T14:01:58.960207+0000 mgr.x (mgr.34562) 1120 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:02:00.033 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:01:59 smithi132 bash[27079]: audit 2020-07-16T14:01:58.960887+0000 mon.b (mon.2) 367 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:02:00.033 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:01:59 smithi132 bash[27079]: audit 2020-07-16T14:01:58.961132+0000 mgr.x (mgr.34562) 1121 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:02:00.033 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:01:59 smithi132 bash[27079]: audit 2020-07-16T14:01:58.961751+0000 mon.b (mon.2) 368 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:02:00.034 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:01:59 smithi132 bash[27079]: audit 2020-07-16T14:01:58.961976+0000 mgr.x (mgr.34562) 1122 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:02:00.034 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:01:59 smithi132 bash[27079]: cephadm 2020-07-16T14:01:58.962507+0000 mgr.x (mgr.34562) 1123 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:02:00.034 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:01:59 smithi132 bash[27079]: audit 2020-07-16T14:01:58.962823+0000 mon.b (mon.2) 369 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:02:00.034 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:01:59 smithi132 bash[27079]: cephadm 2020-07-16T14:01:58.963564+0000 mgr.x (mgr.34562) 1124 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:02:00.034 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:01:59 smithi132 bash[27079]: audit 2020-07-16T14:01:58.963770+0000 mon.b (mon.2) 370 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:02:00.035 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:01:59 smithi132 bash[27079]: cephadm 2020-07-16T14:01:58.964294+0000 mgr.x (mgr.34562) 1125 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:02:00.035 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:01:59 smithi132 bash[27079]: cephadm 2020-07-16T14:01:58.964490+0000 mgr.x (mgr.34562) 1126 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:02:00.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:01:59 smithi188 bash[23329]: audit 2020-07-16T14:01:58.947307+0000 mon.b (mon.2) 364 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710380\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710452\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710485\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710667\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710772\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710871\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710971\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.711004\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.711031\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:59:52.711098\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T14:01:58.946423\"}"}]: dispatch 2020-07-16T14:02:00.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:01:59 smithi188 bash[23329]: audit 2020-07-16T14:01:58.947716+0000 mon.b (mon.2) 365 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T13:59:52.409762\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.409823\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.409858\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.409894\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410117\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410237\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410349\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410455\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410489\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T13:59:52.410562\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T14:01:58.947052\"}"}]: dispatch 2020-07-16T14:02:00.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:01:59 smithi188 bash[23329]: audit 2020-07-16T14:01:58.947955+0000 mon.c (mon.1) 125 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710380\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710452\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710485\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710667\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710772\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710871\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710971\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.711004\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.711031\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:59:52.711098\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T14:01:58.946423\"}"}]: dispatch 2020-07-16T14:02:00.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:01:59 smithi188 bash[23329]: audit 2020-07-16T14:01:58.948572+0000 mon.c (mon.1) 126 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T13:59:52.409762\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.409823\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.409858\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.409894\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410117\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410237\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410349\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410455\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410489\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T13:59:52.410562\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T14:01:58.947052\"}"}]: dispatch 2020-07-16T14:02:00.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:01:59 smithi188 bash[23329]: audit 2020-07-16T14:01:58.950742+0000 mon.c (mon.1) 127 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710380\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710452\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710485\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710667\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710772\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710871\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710971\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.711004\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.711031\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:59:52.711098\", \"last_device_update\": \"2020-07-16T13:33:43.540230\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"]}, \"last_host_check\": \"2020-07-16T14:01:58.946423\"}"}]': finished 2020-07-16T14:02:00.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:01:59 smithi188 bash[23329]: audit 2020-07-16T14:01:58.955422+0000 mon.c (mon.1) 128 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T13:59:52.409762\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.409823\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.409858\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.409894\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410117\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410237\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410349\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410455\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410489\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T13:59:52.410562\", \"last_device_update\": \"2020-07-16T13:32:32.460975\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"]}, \"last_host_check\": \"2020-07-16T14:01:58.947052\"}"}]': finished 2020-07-16T14:02:00.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:01:59 smithi188 bash[23329]: audit 2020-07-16T14:01:58.959858+0000 mon.b (mon.2) 366 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:02:00.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:01:59 smithi188 bash[23329]: audit 2020-07-16T14:01:58.960207+0000 mgr.x (mgr.34562) 1120 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:02:00.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:01:59 smithi188 bash[23329]: audit 2020-07-16T14:01:58.960887+0000 mon.b (mon.2) 367 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:02:00.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:01:59 smithi188 bash[23329]: audit 2020-07-16T14:01:58.961132+0000 mgr.x (mgr.34562) 1121 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:02:00.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:01:59 smithi188 bash[23329]: audit 2020-07-16T14:01:58.961751+0000 mon.b (mon.2) 368 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:02:00.175 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:01:59 smithi188 bash[23329]: audit 2020-07-16T14:01:58.961976+0000 mgr.x (mgr.34562) 1122 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:02:00.175 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:01:59 smithi188 bash[23329]: cephadm 2020-07-16T14:01:58.962507+0000 mgr.x (mgr.34562) 1123 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:02:00.175 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:01:59 smithi188 bash[23329]: audit 2020-07-16T14:01:58.962823+0000 mon.b (mon.2) 369 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:02:00.175 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:01:59 smithi188 bash[23329]: cephadm 2020-07-16T14:01:58.963564+0000 mgr.x (mgr.34562) 1124 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:02:00.175 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:01:59 smithi188 bash[23329]: audit 2020-07-16T14:01:58.963770+0000 mon.b (mon.2) 370 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:02:00.176 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:01:59 smithi188 bash[23329]: cephadm 2020-07-16T14:01:58.964294+0000 mgr.x (mgr.34562) 1125 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:02:00.176 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:01:59 smithi188 bash[23329]: cephadm 2020-07-16T14:01:58.964490+0000 mgr.x (mgr.34562) 1126 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:02:01.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:02:00 smithi188 bash[23329]: cluster 2020-07-16T14:01:59.805218+0000 mgr.x (mgr.34562) 1127 : cluster [DBG] pgmap v700: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:02:01.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:02:00 smithi132 bash[27079]: cluster 2020-07-16T14:01:59.805218+0000 mgr.x (mgr.34562) 1127 : cluster [DBG] pgmap v700: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:02:03.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:02:02 smithi188 bash[23329]: cluster 2020-07-16T14:02:01.805778+0000 mgr.x (mgr.34562) 1128 : cluster [DBG] pgmap v701: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:02:03.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:02:02 smithi188 bash[23329]: audit 2020-07-16T14:02:01.971193+0000 mon.b (mon.2) 371 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:02:03.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:02:02 smithi188 bash[23329]: cephadm 2020-07-16T14:02:01.971839+0000 mgr.x (mgr.34562) 1129 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:02:03.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:02:02 smithi188 bash[23329]: cephadm 2020-07-16T14:02:01.972297+0000 mgr.x (mgr.34562) 1130 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:02:03.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:02:02 smithi132 bash[27079]: cluster 2020-07-16T14:02:01.805778+0000 mgr.x (mgr.34562) 1128 : cluster [DBG] pgmap v701: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:02:03.936 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:02:02 smithi132 bash[27079]: audit 2020-07-16T14:02:01.971193+0000 mon.b (mon.2) 371 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:02:03.936 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:02:02 smithi132 bash[27079]: cephadm 2020-07-16T14:02:01.971839+0000 mgr.x (mgr.34562) 1129 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:02:03.937 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:02:02 smithi132 bash[27079]: cephadm 2020-07-16T14:02:01.972297+0000 mgr.x (mgr.34562) 1130 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:02:05.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:02:04 smithi188 bash[23329]: cluster 2020-07-16T14:02:03.806175+0000 mgr.x (mgr.34562) 1131 : cluster [DBG] pgmap v702: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:02:05.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:02:04 smithi132 bash[27079]: cluster 2020-07-16T14:02:03.806175+0000 mgr.x (mgr.34562) 1131 : cluster [DBG] pgmap v702: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:02:07.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:02:06 smithi188 bash[23329]: cluster 2020-07-16T14:02:05.806517+0000 mgr.x (mgr.34562) 1132 : cluster [DBG] pgmap v703: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:02:07.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:02:06 smithi132 bash[27079]: cluster 2020-07-16T14:02:05.806517+0000 mgr.x (mgr.34562) 1132 : cluster [DBG] pgmap v703: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:02:09.181 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:02:08 smithi188 bash[23329]: cluster 2020-07-16T14:02:07.807072+0000 mgr.x (mgr.34562) 1133 : cluster [DBG] pgmap v704: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:02:09.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:02:08 smithi132 bash[27079]: cluster 2020-07-16T14:02:07.807072+0000 mgr.x (mgr.34562) 1133 : cluster [DBG] pgmap v704: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:02:10.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:02:10 smithi132 bash[27079]: cluster 2020-07-16T14:02:09.807559+0000 mgr.x (mgr.34562) 1134 : cluster [DBG] pgmap v705: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:02:10.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:02:10 smithi188 bash[23329]: cluster 2020-07-16T14:02:09.807559+0000 mgr.x (mgr.34562) 1134 : cluster [DBG] pgmap v705: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:02:13.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:02:12 smithi188 bash[23329]: cluster 2020-07-16T14:02:11.807892+0000 mgr.x (mgr.34562) 1135 : cluster [DBG] pgmap v706: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:02:13.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:02:12 smithi132 bash[27079]: cluster 2020-07-16T14:02:11.807892+0000 mgr.x (mgr.34562) 1135 : cluster [DBG] pgmap v706: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:02:15.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:02:14 smithi188 bash[23329]: cluster 2020-07-16T14:02:13.808415+0000 mgr.x (mgr.34562) 1136 : cluster [DBG] pgmap v707: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:02:15.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:02:14 smithi132 bash[27079]: cluster 2020-07-16T14:02:13.808415+0000 mgr.x (mgr.34562) 1136 : cluster [DBG] pgmap v707: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:02:17.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:02:16 smithi188 bash[23329]: cluster 2020-07-16T14:02:15.808810+0000 mgr.x (mgr.34562) 1137 : cluster [DBG] pgmap v708: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:02:17.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:02:16 smithi132 bash[27079]: cluster 2020-07-16T14:02:15.808810+0000 mgr.x (mgr.34562) 1137 : cluster [DBG] pgmap v708: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:02:18.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:02:17 smithi188 bash[23329]: audit 2020-07-16T14:02:16.987776+0000 mon.b (mon.2) 372 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:02:18.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:02:17 smithi188 bash[23329]: cephadm 2020-07-16T14:02:16.988520+0000 mgr.x (mgr.34562) 1138 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:02:18.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:02:17 smithi188 bash[23329]: cephadm 2020-07-16T14:02:16.988844+0000 mgr.x (mgr.34562) 1139 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:02:18.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:02:17 smithi132 bash[27079]: audit 2020-07-16T14:02:16.987776+0000 mon.b (mon.2) 372 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:02:18.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:02:17 smithi132 bash[27079]: cephadm 2020-07-16T14:02:16.988520+0000 mgr.x (mgr.34562) 1138 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:02:18.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:02:17 smithi132 bash[27079]: cephadm 2020-07-16T14:02:16.988844+0000 mgr.x (mgr.34562) 1139 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:02:19.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:02:18 smithi188 bash[23329]: cluster 2020-07-16T14:02:17.809374+0000 mgr.x (mgr.34562) 1140 : cluster [DBG] pgmap v709: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:02:19.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:02:18 smithi132 bash[27079]: cluster 2020-07-16T14:02:17.809374+0000 mgr.x (mgr.34562) 1140 : cluster [DBG] pgmap v709: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:02:20.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:02:20 smithi132 bash[27079]: cluster 2020-07-16T14:02:19.809873+0000 mgr.x (mgr.34562) 1141 : cluster [DBG] pgmap v710: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:02:20.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:02:20 smithi188 bash[23329]: cluster 2020-07-16T14:02:19.809873+0000 mgr.x (mgr.34562) 1141 : cluster [DBG] pgmap v710: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:02:23.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:02:22 smithi188 bash[23329]: cluster 2020-07-16T14:02:21.810443+0000 mgr.x (mgr.34562) 1142 : cluster [DBG] pgmap v711: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:02:23.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:02:22 smithi132 bash[27079]: cluster 2020-07-16T14:02:21.810443+0000 mgr.x (mgr.34562) 1142 : cluster [DBG] pgmap v711: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:02:25.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:02:24 smithi188 bash[23329]: cluster 2020-07-16T14:02:23.810872+0000 mgr.x (mgr.34562) 1143 : cluster [DBG] pgmap v712: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:02:25.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:02:24 smithi132 bash[27079]: cluster 2020-07-16T14:02:23.810872+0000 mgr.x (mgr.34562) 1143 : cluster [DBG] pgmap v712: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:02:26.211 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:02:26.471 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:02:26.471 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (25m) 2m ago 28m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:02:26.472 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (27m) 2m ago 27m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:02:26.472 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (25m) 2m ago 31m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:02:26.472 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (24m) 2m ago 32m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:02:26.472 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 2m ago 32m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:02:26.473 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (31m) 2m ago 31m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:02:26.473 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (31m) 2m ago 31m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:02:26.473 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (28m) 2m ago 28m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:02:26.474 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (28m) 2m ago 28m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:02:26.474 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (30m) 2m ago 30m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:02:26.474 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (30m) 2m ago 30m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:02:26.474 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (30m) 2m ago 30m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:02:26.475 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (29m) 2m ago 29m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:02:26.475 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (29m) 2m ago 29m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:02:26.475 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (29m) 2m ago 29m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:02:26.475 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (29m) 2m ago 29m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:02:26.476 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (28m) 2m ago 28m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:02:26.476 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (27m) 2m ago 28m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:02:26.770 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:02:26.770 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:02:26.771 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:02:26.771 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:02:26.771 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:02:26.771 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:02:26.772 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:02:26.772 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:02:26.772 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:02:26.772 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:02:26.773 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:02:26.773 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:02:26.773 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:02:26.773 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:02:26.774 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:02:26.774 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:02:26.774 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:02:27.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:02:26 smithi188 bash[23329]: cluster 2020-07-16T14:02:25.811443+0000 mgr.x (mgr.34562) 1144 : cluster [DBG] pgmap v713: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:02:27.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:02:26 smithi188 bash[23329]: audit 2020-07-16T14:02:26.769188+0000 mon.c (mon.1) 129 : audit [DBG] from='client.? 172.21.15.132:0/330579560' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:02:27.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:02:26 smithi132 bash[27079]: cluster 2020-07-16T14:02:25.811443+0000 mgr.x (mgr.34562) 1144 : cluster [DBG] pgmap v713: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:02:27.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:02:26 smithi132 bash[27079]: audit 2020-07-16T14:02:26.769188+0000 mon.c (mon.1) 129 : audit [DBG] from='client.? 172.21.15.132:0/330579560' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:02:28.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:02:27 smithi188 bash[23329]: audit 2020-07-16T14:02:26.199065+0000 mgr.x (mgr.34562) 1145 : audit [DBG] from='client.25468 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:02:28.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:02:27 smithi188 bash[23329]: audit 2020-07-16T14:02:26.466068+0000 mgr.x (mgr.34562) 1146 : audit [DBG] from='client.25474 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:02:28.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:02:27 smithi132 bash[27079]: audit 2020-07-16T14:02:26.199065+0000 mgr.x (mgr.34562) 1145 : audit [DBG] from='client.25468 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:02:28.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:02:27 smithi132 bash[27079]: audit 2020-07-16T14:02:26.466068+0000 mgr.x (mgr.34562) 1146 : audit [DBG] from='client.25474 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:02:29.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:02:28 smithi188 bash[23329]: cluster 2020-07-16T14:02:27.811864+0000 mgr.x (mgr.34562) 1147 : cluster [DBG] pgmap v714: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:02:29.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:02:28 smithi132 bash[27079]: cluster 2020-07-16T14:02:27.811864+0000 mgr.x (mgr.34562) 1147 : cluster [DBG] pgmap v714: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:02:30.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:02:30 smithi132 bash[27079]: cluster 2020-07-16T14:02:29.812251+0000 mgr.x (mgr.34562) 1148 : cluster [DBG] pgmap v715: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:02:30.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:02:30 smithi188 bash[23329]: cluster 2020-07-16T14:02:29.812251+0000 mgr.x (mgr.34562) 1148 : cluster [DBG] pgmap v715: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:02:33.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:02:32 smithi188 bash[23329]: cluster 2020-07-16T14:02:31.812607+0000 mgr.x (mgr.34562) 1149 : cluster [DBG] pgmap v716: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:02:33.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:02:32 smithi188 bash[23329]: audit 2020-07-16T14:02:32.003710+0000 mon.b (mon.2) 373 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:02:33.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:02:32 smithi188 bash[23329]: cephadm 2020-07-16T14:02:32.004375+0000 mgr.x (mgr.34562) 1150 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:02:33.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:02:32 smithi188 bash[23329]: cephadm 2020-07-16T14:02:32.004790+0000 mgr.x (mgr.34562) 1151 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:02:33.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:02:32 smithi132 bash[27079]: cluster 2020-07-16T14:02:31.812607+0000 mgr.x (mgr.34562) 1149 : cluster [DBG] pgmap v716: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:02:33.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:02:32 smithi132 bash[27079]: audit 2020-07-16T14:02:32.003710+0000 mon.b (mon.2) 373 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:02:33.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:02:32 smithi132 bash[27079]: cephadm 2020-07-16T14:02:32.004375+0000 mgr.x (mgr.34562) 1150 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:02:33.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:02:32 smithi132 bash[27079]: cephadm 2020-07-16T14:02:32.004790+0000 mgr.x (mgr.34562) 1151 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:02:35.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:02:34 smithi188 bash[23329]: cluster 2020-07-16T14:02:33.813090+0000 mgr.x (mgr.34562) 1152 : cluster [DBG] pgmap v717: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:02:35.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:02:34 smithi132 bash[27079]: cluster 2020-07-16T14:02:33.813090+0000 mgr.x (mgr.34562) 1152 : cluster [DBG] pgmap v717: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:02:37.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:02:36 smithi188 bash[23329]: cluster 2020-07-16T14:02:35.813581+0000 mgr.x (mgr.34562) 1153 : cluster [DBG] pgmap v718: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:02:37.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:02:36 smithi132 bash[27079]: cluster 2020-07-16T14:02:35.813581+0000 mgr.x (mgr.34562) 1153 : cluster [DBG] pgmap v718: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:02:39.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:02:38 smithi188 bash[23329]: cluster 2020-07-16T14:02:37.814107+0000 mgr.x (mgr.34562) 1154 : cluster [DBG] pgmap v719: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:02:39.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:02:38 smithi132 bash[27079]: cluster 2020-07-16T14:02:37.814107+0000 mgr.x (mgr.34562) 1154 : cluster [DBG] pgmap v719: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:02:40.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:02:40 smithi132 bash[27079]: cluster 2020-07-16T14:02:39.814507+0000 mgr.x (mgr.34562) 1155 : cluster [DBG] pgmap v720: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:02:40.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:02:40 smithi188 bash[23329]: cluster 2020-07-16T14:02:39.814507+0000 mgr.x (mgr.34562) 1155 : cluster [DBG] pgmap v720: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:02:43.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:02:42 smithi188 bash[23329]: cluster 2020-07-16T14:02:41.815007+0000 mgr.x (mgr.34562) 1156 : cluster [DBG] pgmap v721: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:02:43.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:02:42 smithi132 bash[27079]: cluster 2020-07-16T14:02:41.815007+0000 mgr.x (mgr.34562) 1156 : cluster [DBG] pgmap v721: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:02:45.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:02:44 smithi188 bash[23329]: cluster 2020-07-16T14:02:43.815512+0000 mgr.x (mgr.34562) 1157 : cluster [DBG] pgmap v722: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:02:45.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:02:44 smithi132 bash[27079]: cluster 2020-07-16T14:02:43.815512+0000 mgr.x (mgr.34562) 1157 : cluster [DBG] pgmap v722: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:02:47.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:02:46 smithi188 bash[23329]: cluster 2020-07-16T14:02:45.815995+0000 mgr.x (mgr.34562) 1158 : cluster [DBG] pgmap v723: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:02:47.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:02:46 smithi132 bash[27079]: cluster 2020-07-16T14:02:45.815995+0000 mgr.x (mgr.34562) 1158 : cluster [DBG] pgmap v723: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:02:48.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:02:47 smithi188 bash[23329]: audit 2020-07-16T14:02:47.020351+0000 mon.b (mon.2) 374 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:02:48.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:02:47 smithi188 bash[23329]: cephadm 2020-07-16T14:02:47.021050+0000 mgr.x (mgr.34562) 1159 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:02:48.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:02:47 smithi188 bash[23329]: cephadm 2020-07-16T14:02:47.021131+0000 mgr.x (mgr.34562) 1160 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:02:48.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:02:47 smithi132 bash[27079]: audit 2020-07-16T14:02:47.020351+0000 mon.b (mon.2) 374 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:02:48.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:02:47 smithi132 bash[27079]: cephadm 2020-07-16T14:02:47.021050+0000 mgr.x (mgr.34562) 1159 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:02:48.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:02:47 smithi132 bash[27079]: cephadm 2020-07-16T14:02:47.021131+0000 mgr.x (mgr.34562) 1160 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:02:49.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:02:48 smithi188 bash[23329]: cluster 2020-07-16T14:02:47.816549+0000 mgr.x (mgr.34562) 1161 : cluster [DBG] pgmap v724: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:02:49.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:02:48 smithi132 bash[27079]: cluster 2020-07-16T14:02:47.816549+0000 mgr.x (mgr.34562) 1161 : cluster [DBG] pgmap v724: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:02:50.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:02:50 smithi132 bash[27079]: cluster 2020-07-16T14:02:49.816971+0000 mgr.x (mgr.34562) 1162 : cluster [DBG] pgmap v725: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:02:50.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:02:50 smithi188 bash[23329]: cluster 2020-07-16T14:02:49.816971+0000 mgr.x (mgr.34562) 1162 : cluster [DBG] pgmap v725: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:02:53.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:02:52 smithi188 bash[23329]: cluster 2020-07-16T14:02:51.817515+0000 mgr.x (mgr.34562) 1163 : cluster [DBG] pgmap v726: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:02:53.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:02:52 smithi132 bash[27079]: cluster 2020-07-16T14:02:51.817515+0000 mgr.x (mgr.34562) 1163 : cluster [DBG] pgmap v726: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:02:55.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:02:54 smithi188 bash[23329]: cluster 2020-07-16T14:02:53.818049+0000 mgr.x (mgr.34562) 1164 : cluster [DBG] pgmap v727: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:02:55.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:02:54 smithi132 bash[27079]: cluster 2020-07-16T14:02:53.818049+0000 mgr.x (mgr.34562) 1164 : cluster [DBG] pgmap v727: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:02:57.066 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:02:57.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:02:56 smithi188 bash[23329]: cluster 2020-07-16T14:02:55.818526+0000 mgr.x (mgr.34562) 1165 : cluster [DBG] pgmap v728: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:02:57.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:02:56 smithi132 bash[27079]: cluster 2020-07-16T14:02:55.818526+0000 mgr.x (mgr.34562) 1165 : cluster [DBG] pgmap v728: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:02:57.328 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:02:57.328 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (25m) 3m ago 28m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:02:57.328 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (28m) 3m ago 28m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:02:57.329 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (26m) 3m ago 31m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:02:57.329 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (25m) 3m ago 33m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:02:57.329 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 3m ago 33m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:02:57.330 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (31m) 3m ago 31m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:02:57.330 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (31m) 3m ago 31m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:02:57.330 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (28m) 3m ago 28m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:02:57.331 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (28m) 3m ago 28m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:02:57.331 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (31m) 3m ago 31m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:02:57.331 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (31m) 3m ago 31m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:02:57.332 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (30m) 3m ago 30m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:02:57.332 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (30m) 3m ago 30m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:02:57.332 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (29m) 3m ago 30m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:02:57.333 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (29m) 3m ago 29m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:02:57.333 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (29m) 3m ago 29m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:02:57.333 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (29m) 3m ago 29m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:02:57.334 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (28m) 3m ago 29m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:02:57.626 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:02:57.627 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:02:57.627 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:02:57.627 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:02:57.628 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:02:57.628 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:02:57.628 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:02:57.629 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:02:57.629 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:02:57.629 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:02:57.630 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:02:57.630 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:02:57.630 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:02:57.630 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:02:57.631 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:02:57.631 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:02:57.631 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:02:58.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:02:57 smithi188 bash[23329]: audit 2020-07-16T14:02:57.054465+0000 mgr.x (mgr.34562) 1166 : audit [DBG] from='client.25486 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:02:58.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:02:57 smithi188 bash[23329]: audit 2020-07-16T14:02:57.625270+0000 mon.c (mon.1) 130 : audit [DBG] from='client.? 172.21.15.132:0/2391187090' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:02:58.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:02:57 smithi132 bash[27079]: audit 2020-07-16T14:02:57.054465+0000 mgr.x (mgr.34562) 1166 : audit [DBG] from='client.25486 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:02:58.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:02:57 smithi132 bash[27079]: audit 2020-07-16T14:02:57.625270+0000 mon.c (mon.1) 130 : audit [DBG] from='client.? 172.21.15.132:0/2391187090' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:02:59.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:02:58 smithi188 bash[23329]: audit 2020-07-16T14:02:57.323317+0000 mgr.x (mgr.34562) 1167 : audit [DBG] from='client.25492 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:02:59.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:02:58 smithi188 bash[23329]: cluster 2020-07-16T14:02:57.818878+0000 mgr.x (mgr.34562) 1168 : cluster [DBG] pgmap v729: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:02:59.284 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:02:58 smithi132 bash[27079]: audit 2020-07-16T14:02:57.323317+0000 mgr.x (mgr.34562) 1167 : audit [DBG] from='client.25492 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:02:59.284 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:02:58 smithi132 bash[27079]: cluster 2020-07-16T14:02:57.818878+0000 mgr.x (mgr.34562) 1168 : cluster [DBG] pgmap v729: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:03:00.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:00 smithi132 bash[27079]: cluster 2020-07-16T14:02:59.819334+0000 mgr.x (mgr.34562) 1169 : cluster [DBG] pgmap v730: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:03:00.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:00 smithi188 bash[23329]: cluster 2020-07-16T14:02:59.819334+0000 mgr.x (mgr.34562) 1169 : cluster [DBG] pgmap v730: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:03:03.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:02 smithi188 bash[23329]: cluster 2020-07-16T14:03:01.819871+0000 mgr.x (mgr.34562) 1170 : cluster [DBG] pgmap v731: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:03:03.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:02 smithi188 bash[23329]: audit 2020-07-16T14:03:02.034496+0000 mon.b (mon.2) 375 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T14:03:03.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:02 smithi132 bash[27079]: cluster 2020-07-16T14:03:01.819871+0000 mgr.x (mgr.34562) 1170 : cluster [DBG] pgmap v731: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:03:03.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:02 smithi132 bash[27079]: audit 2020-07-16T14:03:02.034496+0000 mon.b (mon.2) 375 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T14:03:05.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:04 smithi188 bash[23329]: cluster 2020-07-16T14:03:03.820245+0000 mgr.x (mgr.34562) 1171 : cluster [DBG] pgmap v732: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:03:05.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:04 smithi132 bash[27079]: cluster 2020-07-16T14:03:03.820245+0000 mgr.x (mgr.34562) 1171 : cluster [DBG] pgmap v732: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:03:06.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:05 smithi188 bash[23329]: audit 2020-07-16T14:03:04.950066+0000 mon.b (mon.2) 376 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T14:03:06.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:05 smithi188 bash[23329]: audit 2020-07-16T14:03:05.155707+0000 mon.b (mon.2) 377 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T13:59:52.409762\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.409823\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.409858\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.409894\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410117\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410237\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410349\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410455\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410489\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T13:59:52.410562\", \"last_device_update\": \"2020-07-16T14:03:05.154706\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:01:58.947052\"}"}]: dispatch 2020-07-16T14:03:06.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:05 smithi188 bash[23329]: audit 2020-07-16T14:03:05.156449+0000 mon.c (mon.1) 131 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T13:59:52.409762\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.409823\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.409858\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.409894\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410117\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410237\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410349\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410455\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410489\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T13:59:52.410562\", \"last_device_update\": \"2020-07-16T14:03:05.154706\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:01:58.947052\"}"}]: dispatch 2020-07-16T14:03:06.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:05 smithi188 bash[23329]: audit 2020-07-16T14:03:05.161136+0000 mon.c (mon.1) 132 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T13:59:52.409762\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.409823\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.409858\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.409894\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410117\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410237\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410349\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410455\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410489\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T13:59:52.410562\", \"last_device_update\": \"2020-07-16T14:03:05.154706\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:01:58.947052\"}"}]': finished 2020-07-16T14:03:06.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:05 smithi188 bash[23329]: audit 2020-07-16T14:03:05.164656+0000 mon.b (mon.2) 378 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:03:06.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:05 smithi188 bash[23329]: audit 2020-07-16T14:03:05.165954+0000 mon.b (mon.2) 379 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:03:06.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:05 smithi188 bash[23329]: audit 2020-07-16T14:03:05.167097+0000 mon.b (mon.2) 380 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:03:06.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:05 smithi188 bash[23329]: audit 2020-07-16T14:03:05.168465+0000 mon.b (mon.2) 381 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:03:06.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:05 smithi188 bash[23329]: audit 2020-07-16T14:03:05.169795+0000 mon.b (mon.2) 382 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:03:06.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:05 smithi132 bash[27079]: audit 2020-07-16T14:03:04.950066+0000 mon.b (mon.2) 376 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T14:03:06.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:05 smithi132 bash[27079]: audit 2020-07-16T14:03:05.155707+0000 mon.b (mon.2) 377 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T13:59:52.409762\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.409823\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.409858\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.409894\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410117\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410237\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410349\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410455\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410489\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T13:59:52.410562\", \"last_device_update\": \"2020-07-16T14:03:05.154706\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:01:58.947052\"}"}]: dispatch 2020-07-16T14:03:06.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:05 smithi132 bash[27079]: audit 2020-07-16T14:03:05.156449+0000 mon.c (mon.1) 131 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T13:59:52.409762\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.409823\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.409858\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.409894\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410117\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410237\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410349\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410455\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410489\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T13:59:52.410562\", \"last_device_update\": \"2020-07-16T14:03:05.154706\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:01:58.947052\"}"}]: dispatch 2020-07-16T14:03:06.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:05 smithi132 bash[27079]: audit 2020-07-16T14:03:05.161136+0000 mon.c (mon.1) 132 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T13:59:52.409762\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.409823\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.409858\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.409894\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410117\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410237\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410349\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410455\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.410489\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T13:59:52.410562\", \"last_device_update\": \"2020-07-16T14:03:05.154706\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:01:58.947052\"}"}]': finished 2020-07-16T14:03:06.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:05 smithi132 bash[27079]: audit 2020-07-16T14:03:05.164656+0000 mon.b (mon.2) 378 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:03:06.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:05 smithi132 bash[27079]: audit 2020-07-16T14:03:05.165954+0000 mon.b (mon.2) 379 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:03:06.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:05 smithi132 bash[27079]: audit 2020-07-16T14:03:05.167097+0000 mon.b (mon.2) 380 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:03:06.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:05 smithi132 bash[27079]: audit 2020-07-16T14:03:05.168465+0000 mon.b (mon.2) 381 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:03:06.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:05 smithi132 bash[27079]: audit 2020-07-16T14:03:05.169795+0000 mon.b (mon.2) 382 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:03:07.147 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:06 smithi132 bash[27079]: audit 2020-07-16T14:03:05.165010+0000 mgr.x (mgr.34562) 1172 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:03:07.147 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:06 smithi132 bash[27079]: audit 2020-07-16T14:03:05.166275+0000 mgr.x (mgr.34562) 1173 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:03:07.147 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:06 smithi132 bash[27079]: audit 2020-07-16T14:03:05.167379+0000 mgr.x (mgr.34562) 1174 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:03:07.147 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:06 smithi132 bash[27079]: cephadm 2020-07-16T14:03:05.168115+0000 mgr.x (mgr.34562) 1175 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:03:07.148 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:06 smithi132 bash[27079]: cephadm 2020-07-16T14:03:05.169301+0000 mgr.x (mgr.34562) 1176 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:03:07.148 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:06 smithi132 bash[27079]: cephadm 2020-07-16T14:03:05.170522+0000 mgr.x (mgr.34562) 1177 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:03:07.148 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:06 smithi132 bash[27079]: cephadm 2020-07-16T14:03:05.170795+0000 mgr.x (mgr.34562) 1178 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:03:07.148 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:06 smithi132 bash[27079]: cluster 2020-07-16T14:03:05.820621+0000 mgr.x (mgr.34562) 1179 : cluster [DBG] pgmap v733: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:03:07.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:06 smithi188 bash[23329]: audit 2020-07-16T14:03:05.165010+0000 mgr.x (mgr.34562) 1172 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:03:07.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:06 smithi188 bash[23329]: audit 2020-07-16T14:03:05.166275+0000 mgr.x (mgr.34562) 1173 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:03:07.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:06 smithi188 bash[23329]: audit 2020-07-16T14:03:05.167379+0000 mgr.x (mgr.34562) 1174 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:03:07.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:06 smithi188 bash[23329]: cephadm 2020-07-16T14:03:05.168115+0000 mgr.x (mgr.34562) 1175 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:03:07.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:06 smithi188 bash[23329]: cephadm 2020-07-16T14:03:05.169301+0000 mgr.x (mgr.34562) 1176 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:03:07.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:06 smithi188 bash[23329]: cephadm 2020-07-16T14:03:05.170522+0000 mgr.x (mgr.34562) 1177 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:03:07.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:06 smithi188 bash[23329]: cephadm 2020-07-16T14:03:05.170795+0000 mgr.x (mgr.34562) 1178 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:03:07.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:06 smithi188 bash[23329]: cluster 2020-07-16T14:03:05.820621+0000 mgr.x (mgr.34562) 1179 : cluster [DBG] pgmap v733: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:03:09.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:08 smithi188 bash[23329]: cluster 2020-07-16T14:03:07.821141+0000 mgr.x (mgr.34562) 1180 : cluster [DBG] pgmap v734: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:03:09.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:08 smithi188 bash[23329]: audit 2020-07-16T14:03:08.050752+0000 mon.b (mon.2) 383 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:03:09.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:08 smithi188 bash[23329]: cephadm 2020-07-16T14:03:08.051419+0000 mgr.x (mgr.34562) 1181 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:03:09.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:08 smithi188 bash[23329]: cephadm 2020-07-16T14:03:08.051850+0000 mgr.x (mgr.34562) 1182 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:03:09.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:08 smithi132 bash[27079]: cluster 2020-07-16T14:03:07.821141+0000 mgr.x (mgr.34562) 1180 : cluster [DBG] pgmap v734: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:03:09.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:08 smithi132 bash[27079]: audit 2020-07-16T14:03:08.050752+0000 mon.b (mon.2) 383 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:03:09.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:08 smithi132 bash[27079]: cephadm 2020-07-16T14:03:08.051419+0000 mgr.x (mgr.34562) 1181 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:03:09.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:08 smithi132 bash[27079]: cephadm 2020-07-16T14:03:08.051850+0000 mgr.x (mgr.34562) 1182 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:03:10.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:10 smithi132 bash[27079]: cluster 2020-07-16T14:03:09.821636+0000 mgr.x (mgr.34562) 1183 : cluster [DBG] pgmap v735: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:03:10.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:10 smithi188 bash[23329]: cluster 2020-07-16T14:03:09.821636+0000 mgr.x (mgr.34562) 1183 : cluster [DBG] pgmap v735: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:03:13.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:12 smithi188 bash[23329]: cluster 2020-07-16T14:03:11.822159+0000 mgr.x (mgr.34562) 1184 : cluster [DBG] pgmap v736: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:03:13.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:12 smithi132 bash[27079]: cluster 2020-07-16T14:03:11.822159+0000 mgr.x (mgr.34562) 1184 : cluster [DBG] pgmap v736: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:03:15.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:14 smithi188 bash[23329]: cluster 2020-07-16T14:03:13.822694+0000 mgr.x (mgr.34562) 1185 : cluster [DBG] pgmap v737: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:03:15.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:14 smithi132 bash[27079]: cluster 2020-07-16T14:03:13.822694+0000 mgr.x (mgr.34562) 1185 : cluster [DBG] pgmap v737: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:03:17.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:16 smithi188 bash[23329]: cluster 2020-07-16T14:03:15.823114+0000 mgr.x (mgr.34562) 1186 : cluster [DBG] pgmap v738: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:03:17.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:16 smithi132 bash[27079]: cluster 2020-07-16T14:03:15.823114+0000 mgr.x (mgr.34562) 1186 : cluster [DBG] pgmap v738: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:03:19.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:18 smithi188 bash[23329]: cluster 2020-07-16T14:03:17.823590+0000 mgr.x (mgr.34562) 1187 : cluster [DBG] pgmap v739: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:03:19.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:18 smithi132 bash[27079]: cluster 2020-07-16T14:03:17.823590+0000 mgr.x (mgr.34562) 1187 : cluster [DBG] pgmap v739: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:03:20.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:20 smithi132 bash[27079]: cluster 2020-07-16T14:03:19.823997+0000 mgr.x (mgr.34562) 1188 : cluster [DBG] pgmap v740: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:03:20.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:20 smithi188 bash[23329]: cluster 2020-07-16T14:03:19.823997+0000 mgr.x (mgr.34562) 1188 : cluster [DBG] pgmap v740: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:03:23.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:22 smithi188 bash[23329]: cluster 2020-07-16T14:03:21.824421+0000 mgr.x (mgr.34562) 1189 : cluster [DBG] pgmap v741: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:03:23.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:22 smithi132 bash[27079]: cluster 2020-07-16T14:03:21.824421+0000 mgr.x (mgr.34562) 1189 : cluster [DBG] pgmap v741: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:03:24.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:23 smithi188 bash[23329]: audit 2020-07-16T14:03:23.067375+0000 mon.b (mon.2) 384 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:03:24.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:23 smithi188 bash[23329]: cephadm 2020-07-16T14:03:23.068062+0000 mgr.x (mgr.34562) 1190 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:03:24.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:23 smithi188 bash[23329]: cephadm 2020-07-16T14:03:23.068321+0000 mgr.x (mgr.34562) 1191 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:03:24.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:23 smithi132 bash[27079]: audit 2020-07-16T14:03:23.067375+0000 mon.b (mon.2) 384 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:03:24.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:23 smithi132 bash[27079]: cephadm 2020-07-16T14:03:23.068062+0000 mgr.x (mgr.34562) 1190 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:03:24.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:23 smithi132 bash[27079]: cephadm 2020-07-16T14:03:23.068321+0000 mgr.x (mgr.34562) 1191 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:03:25.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:24 smithi188 bash[23329]: cluster 2020-07-16T14:03:23.824783+0000 mgr.x (mgr.34562) 1192 : cluster [DBG] pgmap v742: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:03:25.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:24 smithi132 bash[27079]: cluster 2020-07-16T14:03:23.824783+0000 mgr.x (mgr.34562) 1192 : cluster [DBG] pgmap v742: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:03:27.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:26 smithi188 bash[23329]: cluster 2020-07-16T14:03:25.825146+0000 mgr.x (mgr.34562) 1193 : cluster [DBG] pgmap v743: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:03:27.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:26 smithi132 bash[27079]: cluster 2020-07-16T14:03:25.825146+0000 mgr.x (mgr.34562) 1193 : cluster [DBG] pgmap v743: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:03:27.923 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:03:28.184 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:03:28.185 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (26m) 3m ago 29m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:03:28.185 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (28m) 3m ago 28m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:03:28.185 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (26m) 3m ago 32m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:03:28.185 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (25m) 3m ago 33m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:03:28.186 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 3m ago 33m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:03:28.186 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (32m) 3m ago 32m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:03:28.186 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (32m) 3m ago 32m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:03:28.186 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (29m) 3m ago 29m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:03:28.186 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (29m) 3m ago 29m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:03:28.187 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (31m) 3m ago 31m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:03:28.187 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (31m) 3m ago 31m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:03:28.187 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (31m) 3m ago 31m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:03:28.187 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (30m) 3m ago 31m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:03:28.187 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (30m) 3m ago 30m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:03:28.187 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (30m) 3m ago 30m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:03:28.188 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (30m) 3m ago 30m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:03:28.188 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (29m) 3m ago 29m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:03:28.188 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (28m) 3m ago 29m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:03:28.482 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:03:28.482 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:03:28.483 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:03:28.483 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:03:28.483 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:03:28.483 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:03:28.483 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:03:28.484 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:03:28.484 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:03:28.484 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:03:28.484 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:03:28.484 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:03:28.485 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:03:28.485 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:03:28.485 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:03:28.485 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:03:28.485 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:03:29.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:28 smithi188 bash[23329]: cluster 2020-07-16T14:03:27.825641+0000 mgr.x (mgr.34562) 1194 : cluster [DBG] pgmap v744: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:03:29.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:28 smithi188 bash[23329]: audit 2020-07-16T14:03:27.911627+0000 mgr.x (mgr.34562) 1195 : audit [DBG] from='client.25504 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:03:29.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:28 smithi188 bash[23329]: audit 2020-07-16T14:03:28.481338+0000 mon.c (mon.1) 133 : audit [DBG] from='client.? 172.21.15.132:0/3953251592' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:03:29.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:28 smithi132 bash[27079]: cluster 2020-07-16T14:03:27.825641+0000 mgr.x (mgr.34562) 1194 : cluster [DBG] pgmap v744: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:03:29.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:28 smithi132 bash[27079]: audit 2020-07-16T14:03:27.911627+0000 mgr.x (mgr.34562) 1195 : audit [DBG] from='client.25504 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:03:29.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:28 smithi132 bash[27079]: audit 2020-07-16T14:03:28.481338+0000 mon.c (mon.1) 133 : audit [DBG] from='client.? 172.21.15.132:0/3953251592' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:03:30.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:29 smithi188 bash[23329]: audit 2020-07-16T14:03:28.180145+0000 mgr.x (mgr.34562) 1196 : audit [DBG] from='client.25510 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:03:30.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:29 smithi132 bash[27079]: audit 2020-07-16T14:03:28.180145+0000 mgr.x (mgr.34562) 1196 : audit [DBG] from='client.25510 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:03:31.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:30 smithi188 bash[23329]: cluster 2020-07-16T14:03:29.826168+0000 mgr.x (mgr.34562) 1197 : cluster [DBG] pgmap v745: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:03:31.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:30 smithi132 bash[27079]: cluster 2020-07-16T14:03:29.826168+0000 mgr.x (mgr.34562) 1197 : cluster [DBG] pgmap v745: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:03:33.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:32 smithi188 bash[23329]: cluster 2020-07-16T14:03:31.826685+0000 mgr.x (mgr.34562) 1198 : cluster [DBG] pgmap v746: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:03:33.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:32 smithi132 bash[27079]: cluster 2020-07-16T14:03:31.826685+0000 mgr.x (mgr.34562) 1198 : cluster [DBG] pgmap v746: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:03:35.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:34 smithi188 bash[23329]: cluster 2020-07-16T14:03:33.827212+0000 mgr.x (mgr.34562) 1199 : cluster [DBG] pgmap v747: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:03:35.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:34 smithi132 bash[27079]: cluster 2020-07-16T14:03:33.827212+0000 mgr.x (mgr.34562) 1199 : cluster [DBG] pgmap v747: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:03:37.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:36 smithi188 bash[23329]: cluster 2020-07-16T14:03:35.827740+0000 mgr.x (mgr.34562) 1200 : cluster [DBG] pgmap v748: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:03:37.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:36 smithi132 bash[27079]: cluster 2020-07-16T14:03:35.827740+0000 mgr.x (mgr.34562) 1200 : cluster [DBG] pgmap v748: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:03:39.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:38 smithi188 bash[23329]: cluster 2020-07-16T14:03:37.828189+0000 mgr.x (mgr.34562) 1201 : cluster [DBG] pgmap v749: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:03:39.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:38 smithi188 bash[23329]: audit 2020-07-16T14:03:38.083926+0000 mon.b (mon.2) 385 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:03:39.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:38 smithi188 bash[23329]: cephadm 2020-07-16T14:03:38.084678+0000 mgr.x (mgr.34562) 1202 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:03:39.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:38 smithi188 bash[23329]: cephadm 2020-07-16T14:03:38.084780+0000 mgr.x (mgr.34562) 1203 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:03:39.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:38 smithi132 bash[27079]: cluster 2020-07-16T14:03:37.828189+0000 mgr.x (mgr.34562) 1201 : cluster [DBG] pgmap v749: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:03:39.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:38 smithi132 bash[27079]: audit 2020-07-16T14:03:38.083926+0000 mon.b (mon.2) 385 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:03:39.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:38 smithi132 bash[27079]: cephadm 2020-07-16T14:03:38.084678+0000 mgr.x (mgr.34562) 1202 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:03:39.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:38 smithi132 bash[27079]: cephadm 2020-07-16T14:03:38.084780+0000 mgr.x (mgr.34562) 1203 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:03:40.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:40 smithi132 bash[27079]: cluster 2020-07-16T14:03:39.828640+0000 mgr.x (mgr.34562) 1204 : cluster [DBG] pgmap v750: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:03:40.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:40 smithi188 bash[23329]: cluster 2020-07-16T14:03:39.828640+0000 mgr.x (mgr.34562) 1204 : cluster [DBG] pgmap v750: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:03:43.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:42 smithi188 bash[23329]: cluster 2020-07-16T14:03:41.829171+0000 mgr.x (mgr.34562) 1205 : cluster [DBG] pgmap v751: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:03:43.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:42 smithi132 bash[27079]: cluster 2020-07-16T14:03:41.829171+0000 mgr.x (mgr.34562) 1205 : cluster [DBG] pgmap v751: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:03:45.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:44 smithi188 bash[23329]: cluster 2020-07-16T14:03:43.829547+0000 mgr.x (mgr.34562) 1206 : cluster [DBG] pgmap v752: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:03:45.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:44 smithi132 bash[27079]: cluster 2020-07-16T14:03:43.829547+0000 mgr.x (mgr.34562) 1206 : cluster [DBG] pgmap v752: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:03:47.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:46 smithi188 bash[23329]: cluster 2020-07-16T14:03:45.829889+0000 mgr.x (mgr.34562) 1207 : cluster [DBG] pgmap v753: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:03:47.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:46 smithi132 bash[27079]: cluster 2020-07-16T14:03:45.829889+0000 mgr.x (mgr.34562) 1207 : cluster [DBG] pgmap v753: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:03:49.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:48 smithi188 bash[23329]: cluster 2020-07-16T14:03:47.830372+0000 mgr.x (mgr.34562) 1208 : cluster [DBG] pgmap v754: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:03:49.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:48 smithi132 bash[27079]: cluster 2020-07-16T14:03:47.830372+0000 mgr.x (mgr.34562) 1208 : cluster [DBG] pgmap v754: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:03:50.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:50 smithi132 bash[27079]: cluster 2020-07-16T14:03:49.830771+0000 mgr.x (mgr.34562) 1209 : cluster [DBG] pgmap v755: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:03:50.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:50 smithi188 bash[23329]: cluster 2020-07-16T14:03:49.830771+0000 mgr.x (mgr.34562) 1209 : cluster [DBG] pgmap v755: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:03:53.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:52 smithi188 bash[23329]: cluster 2020-07-16T14:03:51.831379+0000 mgr.x (mgr.34562) 1210 : cluster [DBG] pgmap v756: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:03:53.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:52 smithi132 bash[27079]: cluster 2020-07-16T14:03:51.831379+0000 mgr.x (mgr.34562) 1210 : cluster [DBG] pgmap v756: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:03:54.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:53 smithi188 bash[23329]: audit 2020-07-16T14:03:53.097874+0000 mon.b (mon.2) 386 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:03:54.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:53 smithi188 bash[23329]: cephadm 2020-07-16T14:03:53.098573+0000 mgr.x (mgr.34562) 1211 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:03:54.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:53 smithi188 bash[23329]: cephadm 2020-07-16T14:03:53.098964+0000 mgr.x (mgr.34562) 1212 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:03:54.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:53 smithi132 bash[27079]: audit 2020-07-16T14:03:53.097874+0000 mon.b (mon.2) 386 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:03:54.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:53 smithi132 bash[27079]: cephadm 2020-07-16T14:03:53.098573+0000 mgr.x (mgr.34562) 1211 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:03:54.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:53 smithi132 bash[27079]: cephadm 2020-07-16T14:03:53.098964+0000 mgr.x (mgr.34562) 1212 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:03:55.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:54 smithi188 bash[23329]: cluster 2020-07-16T14:03:53.831898+0000 mgr.x (mgr.34562) 1213 : cluster [DBG] pgmap v757: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:03:55.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:54 smithi132 bash[27079]: cluster 2020-07-16T14:03:53.831898+0000 mgr.x (mgr.34562) 1213 : cluster [DBG] pgmap v757: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:03:57.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:56 smithi188 bash[23329]: cluster 2020-07-16T14:03:55.832302+0000 mgr.x (mgr.34562) 1214 : cluster [DBG] pgmap v758: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:03:57.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:56 smithi132 bash[27079]: cluster 2020-07-16T14:03:55.832302+0000 mgr.x (mgr.34562) 1214 : cluster [DBG] pgmap v758: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:03:58.779 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:03:59.041 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:03:59.042 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (26m) 4m ago 29m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:03:59.042 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (29m) 4m ago 29m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:03:59.042 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (27m) 4m ago 32m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:03:59.043 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (26m) 4m ago 34m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:03:59.043 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 4m ago 34m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:03:59.043 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (32m) 4m ago 32m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:03:59.043 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (33m) 4m ago 33m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:03:59.043 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (29m) 4m ago 30m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:03:59.044 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (29m) 4m ago 30m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:03:59.044 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (32m) 4m ago 32m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:03:59.044 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (32m) 4m ago 32m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:03:59.044 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (31m) 4m ago 31m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:03:59.044 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (31m) 4m ago 31m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:03:59.045 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (30m) 4m ago 31m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:03:59.045 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (30m) 4m ago 30m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:03:59.045 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (30m) 4m ago 30m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:03:59.045 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (30m) 4m ago 30m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:03:59.045 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (29m) 4m ago 30m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:03:59.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:58 smithi188 bash[23329]: cluster 2020-07-16T14:03:57.832707+0000 mgr.x (mgr.34562) 1215 : cluster [DBG] pgmap v759: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:03:59.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:58 smithi132 bash[27079]: cluster 2020-07-16T14:03:57.832707+0000 mgr.x (mgr.34562) 1215 : cluster [DBG] pgmap v759: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:03:59.342 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:03:59.343 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:03:59.343 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:03:59.343 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:03:59.343 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:03:59.344 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:03:59.344 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:03:59.344 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:03:59.344 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:03:59.344 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:03:59.344 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:03:59.345 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:03:59.345 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:03:59.345 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:03:59.345 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:03:59.345 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:03:59.346 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:04:00.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:59 smithi188 bash[23329]: audit 2020-07-16T14:03:58.767585+0000 mgr.x (mgr.34562) 1216 : audit [DBG] from='client.25522 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:04:00.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:59 smithi188 bash[23329]: audit 2020-07-16T14:03:59.036631+0000 mgr.x (mgr.34562) 1217 : audit [DBG] from='client.25528 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:04:00.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:03:59 smithi188 bash[23329]: audit 2020-07-16T14:03:59.341437+0000 mon.c (mon.1) 134 : audit [DBG] from='client.? 172.21.15.132:0/3689664520' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:04:00.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:59 smithi132 bash[27079]: audit 2020-07-16T14:03:58.767585+0000 mgr.x (mgr.34562) 1216 : audit [DBG] from='client.25522 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:04:00.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:59 smithi132 bash[27079]: audit 2020-07-16T14:03:59.036631+0000 mgr.x (mgr.34562) 1217 : audit [DBG] from='client.25528 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:04:00.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:03:59 smithi132 bash[27079]: audit 2020-07-16T14:03:59.341437+0000 mon.c (mon.1) 134 : audit [DBG] from='client.? 172.21.15.132:0/3689664520' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:04:01.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:04:00 smithi188 bash[23329]: cluster 2020-07-16T14:03:59.833222+0000 mgr.x (mgr.34562) 1218 : cluster [DBG] pgmap v760: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:04:01.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:04:00 smithi132 bash[27079]: cluster 2020-07-16T14:03:59.833222+0000 mgr.x (mgr.34562) 1218 : cluster [DBG] pgmap v760: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:04:03.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:04:02 smithi188 bash[23329]: cluster 2020-07-16T14:04:01.833671+0000 mgr.x (mgr.34562) 1219 : cluster [DBG] pgmap v761: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:04:03.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:04:02 smithi132 bash[27079]: cluster 2020-07-16T14:04:01.833671+0000 mgr.x (mgr.34562) 1219 : cluster [DBG] pgmap v761: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:04:05.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:04:04 smithi188 bash[23329]: cluster 2020-07-16T14:04:03.834174+0000 mgr.x (mgr.34562) 1220 : cluster [DBG] pgmap v762: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:04:05.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:04:04 smithi132 bash[27079]: cluster 2020-07-16T14:04:03.834174+0000 mgr.x (mgr.34562) 1220 : cluster [DBG] pgmap v762: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:04:07.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:04:06 smithi188 bash[23329]: cluster 2020-07-16T14:04:05.834643+0000 mgr.x (mgr.34562) 1221 : cluster [DBG] pgmap v763: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:04:07.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:04:06 smithi132 bash[27079]: cluster 2020-07-16T14:04:05.834643+0000 mgr.x (mgr.34562) 1221 : cluster [DBG] pgmap v763: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:04:09.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:04:08 smithi132 bash[27079]: cluster 2020-07-16T14:04:07.835209+0000 mgr.x (mgr.34562) 1222 : cluster [DBG] pgmap v764: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:04:09.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:04:08 smithi132 bash[27079]: audit 2020-07-16T14:04:08.115227+0000 mon.b (mon.2) 387 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T14:04:09.336 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:04:08 smithi188 bash[23329]: cluster 2020-07-16T14:04:07.835209+0000 mgr.x (mgr.34562) 1222 : cluster [DBG] pgmap v764: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:04:09.336 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:04:08 smithi188 bash[23329]: audit 2020-07-16T14:04:08.115227+0000 mon.b (mon.2) 387 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T14:04:10.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:04:10 smithi132 bash[27079]: cluster 2020-07-16T14:04:09.835551+0000 mgr.x (mgr.34562) 1223 : cluster [DBG] pgmap v765: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:04:10.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:04:10 smithi188 bash[23329]: cluster 2020-07-16T14:04:09.835551+0000 mgr.x (mgr.34562) 1223 : cluster [DBG] pgmap v765: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:04:11.520 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:04:11 smithi132 bash[27079]: audit 2020-07-16T14:04:10.761527+0000 mon.b (mon.2) 388 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T14:04:11.521 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:04:11 smithi132 bash[27079]: audit 2020-07-16T14:04:10.965801+0000 mon.b (mon.2) 389 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710380\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710452\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710485\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710667\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710772\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710871\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710971\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.711004\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.711031\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:59:52.711098\", \"last_device_update\": \"2020-07-16T14:04:10.964865\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:01:58.946423\"}"}]: dispatch 2020-07-16T14:04:11.521 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:04:11 smithi132 bash[27079]: audit 2020-07-16T14:04:10.966678+0000 mon.c (mon.1) 135 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710380\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710452\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710485\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710667\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710772\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710871\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710971\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.711004\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.711031\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:59:52.711098\", \"last_device_update\": \"2020-07-16T14:04:10.964865\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:01:58.946423\"}"}]: dispatch 2020-07-16T14:04:11.521 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:04:11 smithi132 bash[27079]: audit 2020-07-16T14:04:10.969587+0000 mon.c (mon.1) 136 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710380\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710452\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710485\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710667\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710772\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710871\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710971\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.711004\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.711031\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:59:52.711098\", \"last_device_update\": \"2020-07-16T14:04:10.964865\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:01:58.946423\"}"}]': finished 2020-07-16T14:04:11.522 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:04:11 smithi132 bash[27079]: audit 2020-07-16T14:04:10.971751+0000 mon.b (mon.2) 390 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:04:11.522 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:04:11 smithi132 bash[27079]: audit 2020-07-16T14:04:10.972015+0000 mgr.x (mgr.34562) 1224 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:04:11.522 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:04:11 smithi132 bash[27079]: audit 2020-07-16T14:04:10.972710+0000 mon.b (mon.2) 391 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:04:11.522 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:04:11 smithi132 bash[27079]: audit 2020-07-16T14:04:10.972949+0000 mgr.x (mgr.34562) 1225 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:04:11.523 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:04:11 smithi132 bash[27079]: audit 2020-07-16T14:04:10.973511+0000 mon.b (mon.2) 392 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:04:11.523 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:04:11 smithi132 bash[27079]: audit 2020-07-16T14:04:10.973730+0000 mgr.x (mgr.34562) 1226 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:04:11.523 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:04:11 smithi132 bash[27079]: cephadm 2020-07-16T14:04:10.974204+0000 mgr.x (mgr.34562) 1227 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:04:11.523 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:04:11 smithi132 bash[27079]: audit 2020-07-16T14:04:10.974368+0000 mon.b (mon.2) 393 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:04:11.523 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:04:11 smithi132 bash[27079]: cephadm 2020-07-16T14:04:10.974963+0000 mgr.x (mgr.34562) 1228 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:04:11.524 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:04:11 smithi132 bash[27079]: audit 2020-07-16T14:04:10.975246+0000 mon.b (mon.2) 394 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:04:11.524 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:04:11 smithi132 bash[27079]: cephadm 2020-07-16T14:04:10.975735+0000 mgr.x (mgr.34562) 1229 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:04:11.524 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:04:11 smithi132 bash[27079]: cephadm 2020-07-16T14:04:10.975863+0000 mgr.x (mgr.34562) 1230 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:04:11.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:04:11 smithi188 bash[23329]: audit 2020-07-16T14:04:10.761527+0000 mon.b (mon.2) 388 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T14:04:11.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:04:11 smithi188 bash[23329]: audit 2020-07-16T14:04:10.965801+0000 mon.b (mon.2) 389 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710380\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710452\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710485\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710667\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710772\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710871\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710971\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.711004\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.711031\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:59:52.711098\", \"last_device_update\": \"2020-07-16T14:04:10.964865\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:01:58.946423\"}"}]: dispatch 2020-07-16T14:04:11.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:04:11 smithi188 bash[23329]: audit 2020-07-16T14:04:10.966678+0000 mon.c (mon.1) 135 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710380\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710452\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710485\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710667\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710772\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710871\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710971\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.711004\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.711031\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:59:52.711098\", \"last_device_update\": \"2020-07-16T14:04:10.964865\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:01:58.946423\"}"}]: dispatch 2020-07-16T14:04:11.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:04:11 smithi188 bash[23329]: audit 2020-07-16T14:04:10.969587+0000 mon.c (mon.1) 136 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710380\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710452\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710485\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710667\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710772\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710871\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.710971\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.711004\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T13:59:52.711031\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T13:59:52.711098\", \"last_device_update\": \"2020-07-16T14:04:10.964865\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:01:58.946423\"}"}]': finished 2020-07-16T14:04:11.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:04:11 smithi188 bash[23329]: audit 2020-07-16T14:04:10.971751+0000 mon.b (mon.2) 390 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:04:11.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:04:11 smithi188 bash[23329]: audit 2020-07-16T14:04:10.972015+0000 mgr.x (mgr.34562) 1224 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:04:11.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:04:11 smithi188 bash[23329]: audit 2020-07-16T14:04:10.972710+0000 mon.b (mon.2) 391 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:04:11.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:04:11 smithi188 bash[23329]: audit 2020-07-16T14:04:10.972949+0000 mgr.x (mgr.34562) 1225 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:04:11.675 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:04:11 smithi188 bash[23329]: audit 2020-07-16T14:04:10.973511+0000 mon.b (mon.2) 392 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:04:11.676 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:04:11 smithi188 bash[23329]: audit 2020-07-16T14:04:10.973730+0000 mgr.x (mgr.34562) 1226 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:04:11.676 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:04:11 smithi188 bash[23329]: cephadm 2020-07-16T14:04:10.974204+0000 mgr.x (mgr.34562) 1227 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:04:11.676 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:04:11 smithi188 bash[23329]: audit 2020-07-16T14:04:10.974368+0000 mon.b (mon.2) 393 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:04:11.676 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:04:11 smithi188 bash[23329]: cephadm 2020-07-16T14:04:10.974963+0000 mgr.x (mgr.34562) 1228 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:04:11.676 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:04:11 smithi188 bash[23329]: audit 2020-07-16T14:04:10.975246+0000 mon.b (mon.2) 394 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:04:11.677 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:04:11 smithi188 bash[23329]: cephadm 2020-07-16T14:04:10.975735+0000 mgr.x (mgr.34562) 1229 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:04:11.677 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:04:11 smithi188 bash[23329]: cephadm 2020-07-16T14:04:10.975863+0000 mgr.x (mgr.34562) 1230 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:04:12.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:04:12 smithi132 bash[27079]: cluster 2020-07-16T14:04:11.836086+0000 mgr.x (mgr.34562) 1231 : cluster [DBG] pgmap v766: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:04:12.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:04:12 smithi188 bash[23329]: cluster 2020-07-16T14:04:11.836086+0000 mgr.x (mgr.34562) 1231 : cluster [DBG] pgmap v766: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:04:14.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:04:13 smithi132 bash[27079]: audit 2020-07-16T14:04:13.662675+0000 mon.b (mon.2) 395 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:04:14.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:04:13 smithi188 bash[23329]: audit 2020-07-16T14:04:13.662675+0000 mon.b (mon.2) 395 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:04:15.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:04:14 smithi132 bash[27079]: cephadm 2020-07-16T14:04:13.663307+0000 mgr.x (mgr.34562) 1232 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:04:15.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:04:14 smithi132 bash[27079]: cephadm 2020-07-16T14:04:13.663722+0000 mgr.x (mgr.34562) 1233 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:04:15.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:04:14 smithi132 bash[27079]: cluster 2020-07-16T14:04:13.836578+0000 mgr.x (mgr.34562) 1234 : cluster [DBG] pgmap v767: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:04:15.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:04:14 smithi188 bash[23329]: cephadm 2020-07-16T14:04:13.663307+0000 mgr.x (mgr.34562) 1232 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:04:15.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:04:14 smithi188 bash[23329]: cephadm 2020-07-16T14:04:13.663722+0000 mgr.x (mgr.34562) 1233 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:04:15.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:04:14 smithi188 bash[23329]: cluster 2020-07-16T14:04:13.836578+0000 mgr.x (mgr.34562) 1234 : cluster [DBG] pgmap v767: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:04:17.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:04:16 smithi188 bash[23329]: cluster 2020-07-16T14:04:15.836995+0000 mgr.x (mgr.34562) 1235 : cluster [DBG] pgmap v768: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:04:17.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:04:16 smithi132 bash[27079]: cluster 2020-07-16T14:04:15.836995+0000 mgr.x (mgr.34562) 1235 : cluster [DBG] pgmap v768: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:04:19.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:04:18 smithi188 bash[23329]: cluster 2020-07-16T14:04:17.837486+0000 mgr.x (mgr.34562) 1236 : cluster [DBG] pgmap v769: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:04:19.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:04:18 smithi132 bash[27079]: cluster 2020-07-16T14:04:17.837486+0000 mgr.x (mgr.34562) 1236 : cluster [DBG] pgmap v769: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:04:20.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:04:20 smithi132 bash[27079]: cluster 2020-07-16T14:04:19.838008+0000 mgr.x (mgr.34562) 1237 : cluster [DBG] pgmap v770: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:04:20.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:04:20 smithi188 bash[23329]: cluster 2020-07-16T14:04:19.838008+0000 mgr.x (mgr.34562) 1237 : cluster [DBG] pgmap v770: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:04:23.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:04:22 smithi188 bash[23329]: cluster 2020-07-16T14:04:21.838582+0000 mgr.x (mgr.34562) 1238 : cluster [DBG] pgmap v771: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:04:23.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:04:22 smithi132 bash[27079]: cluster 2020-07-16T14:04:21.838582+0000 mgr.x (mgr.34562) 1238 : cluster [DBG] pgmap v771: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:04:25.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:04:24 smithi188 bash[23329]: cluster 2020-07-16T14:04:23.838943+0000 mgr.x (mgr.34562) 1239 : cluster [DBG] pgmap v772: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:04:25.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:04:24 smithi132 bash[27079]: cluster 2020-07-16T14:04:23.838943+0000 mgr.x (mgr.34562) 1239 : cluster [DBG] pgmap v772: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:04:27.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:04:26 smithi188 bash[23329]: cluster 2020-07-16T14:04:25.839346+0000 mgr.x (mgr.34562) 1240 : cluster [DBG] pgmap v773: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:04:27.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:04:26 smithi132 bash[27079]: cluster 2020-07-16T14:04:25.839346+0000 mgr.x (mgr.34562) 1240 : cluster [DBG] pgmap v773: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:04:29.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:04:28 smithi188 bash[23329]: cluster 2020-07-16T14:04:27.839866+0000 mgr.x (mgr.34562) 1241 : cluster [DBG] pgmap v774: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:04:29.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:04:28 smithi188 bash[23329]: audit 2020-07-16T14:04:28.679148+0000 mon.b (mon.2) 396 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:04:29.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:04:28 smithi132 bash[27079]: cluster 2020-07-16T14:04:27.839866+0000 mgr.x (mgr.34562) 1241 : cluster [DBG] pgmap v774: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:04:29.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:04:28 smithi132 bash[27079]: audit 2020-07-16T14:04:28.679148+0000 mon.b (mon.2) 396 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:04:29.640 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:04:29.919 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:04:29.919 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (27m) 4m ago 30m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:04:29.920 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (29m) 4m ago 29m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:04:29.920 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (27m) 4m ago 33m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:04:29.920 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (26m) 4m ago 34m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:04:29.920 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 4m ago 34m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:04:29.921 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (33m) 4m ago 33m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:04:29.921 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (33m) 4m ago 33m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:04:29.921 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (30m) 4m ago 30m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:04:29.921 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (30m) 4m ago 30m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:04:29.921 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (32m) 4m ago 32m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:04:29.922 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (32m) 4m ago 32m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:04:29.922 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (32m) 4m ago 32m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:04:29.922 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (32m) 4m ago 32m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:04:29.922 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (31m) 4m ago 31m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:04:29.923 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (31m) 4m ago 31m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:04:29.923 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (31m) 4m ago 31m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:04:29.923 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (30m) 4m ago 30m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:04:29.923 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (29m) 4m ago 30m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:04:30.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:04:29 smithi188 bash[23329]: cephadm 2020-07-16T14:04:28.679897+0000 mgr.x (mgr.34562) 1242 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:04:30.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:04:29 smithi188 bash[23329]: cephadm 2020-07-16T14:04:28.680259+0000 mgr.x (mgr.34562) 1243 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:04:30.219 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:04:30.219 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:04:30.219 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:04:30.220 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:04:30.220 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:04:30.220 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:04:30.220 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:04:30.220 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:04:30.221 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:04:30.221 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:04:30.221 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:04:30.221 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:04:30.222 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:04:30.222 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:04:30.222 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:04:30.222 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:04:30.223 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:04:30.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:04:29 smithi132 bash[27079]: cephadm 2020-07-16T14:04:28.679897+0000 mgr.x (mgr.34562) 1242 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:04:30.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:04:29 smithi132 bash[27079]: cephadm 2020-07-16T14:04:28.680259+0000 mgr.x (mgr.34562) 1243 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:04:31.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:04:30 smithi188 bash[23329]: audit 2020-07-16T14:04:29.628267+0000 mgr.x (mgr.34562) 1244 : audit [DBG] from='client.25540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:04:31.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:04:30 smithi188 bash[23329]: cluster 2020-07-16T14:04:29.840230+0000 mgr.x (mgr.34562) 1245 : cluster [DBG] pgmap v775: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:04:31.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:04:30 smithi188 bash[23329]: audit 2020-07-16T14:04:29.914695+0000 mgr.x (mgr.34562) 1246 : audit [DBG] from='client.25546 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:04:31.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:04:30 smithi188 bash[23329]: audit 2020-07-16T14:04:30.218101+0000 mon.c (mon.1) 137 : audit [DBG] from='client.? 172.21.15.132:0/1760815809' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:04:31.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:04:30 smithi132 bash[27079]: audit 2020-07-16T14:04:29.628267+0000 mgr.x (mgr.34562) 1244 : audit [DBG] from='client.25540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:04:31.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:04:30 smithi132 bash[27079]: cluster 2020-07-16T14:04:29.840230+0000 mgr.x (mgr.34562) 1245 : cluster [DBG] pgmap v775: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:04:31.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:04:30 smithi132 bash[27079]: audit 2020-07-16T14:04:29.914695+0000 mgr.x (mgr.34562) 1246 : audit [DBG] from='client.25546 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:04:31.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:04:30 smithi132 bash[27079]: audit 2020-07-16T14:04:30.218101+0000 mon.c (mon.1) 137 : audit [DBG] from='client.? 172.21.15.132:0/1760815809' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:04:33.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:04:32 smithi188 bash[23329]: cluster 2020-07-16T14:04:31.840800+0000 mgr.x (mgr.34562) 1247 : cluster [DBG] pgmap v776: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:04:33.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:04:32 smithi132 bash[27079]: cluster 2020-07-16T14:04:31.840800+0000 mgr.x (mgr.34562) 1247 : cluster [DBG] pgmap v776: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:04:35.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:04:34 smithi132 bash[27079]: cluster 2020-07-16T14:04:33.841268+0000 mgr.x (mgr.34562) 1248 : cluster [DBG] pgmap v777: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:04:35.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:04:34 smithi188 bash[23329]: cluster 2020-07-16T14:04:33.841268+0000 mgr.x (mgr.34562) 1248 : cluster [DBG] pgmap v777: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:04:37.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:04:36 smithi132 bash[27079]: cluster 2020-07-16T14:04:35.841814+0000 mgr.x (mgr.34562) 1249 : cluster [DBG] pgmap v778: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:04:37.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:04:36 smithi188 bash[23329]: cluster 2020-07-16T14:04:35.841814+0000 mgr.x (mgr.34562) 1249 : cluster [DBG] pgmap v778: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:04:39.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:04:38 smithi132 bash[27079]: cluster 2020-07-16T14:04:37.842273+0000 mgr.x (mgr.34562) 1250 : cluster [DBG] pgmap v779: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:04:39.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:04:38 smithi188 bash[23329]: cluster 2020-07-16T14:04:37.842273+0000 mgr.x (mgr.34562) 1250 : cluster [DBG] pgmap v779: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:04:40.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:04:40 smithi132 bash[27079]: cluster 2020-07-16T14:04:39.842678+0000 mgr.x (mgr.34562) 1251 : cluster [DBG] pgmap v780: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:04:40.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:04:40 smithi188 bash[23329]: cluster 2020-07-16T14:04:39.842678+0000 mgr.x (mgr.34562) 1251 : cluster [DBG] pgmap v780: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:04:43.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:04:42 smithi188 bash[23329]: cluster 2020-07-16T14:04:41.843136+0000 mgr.x (mgr.34562) 1252 : cluster [DBG] pgmap v781: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:04:43.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:04:42 smithi132 bash[27079]: cluster 2020-07-16T14:04:41.843136+0000 mgr.x (mgr.34562) 1252 : cluster [DBG] pgmap v781: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:04:44.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:04:43 smithi188 bash[23329]: audit 2020-07-16T14:04:43.695836+0000 mon.b (mon.2) 397 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:04:44.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:04:43 smithi132 bash[27079]: audit 2020-07-16T14:04:43.695836+0000 mon.b (mon.2) 397 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:04:45.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:04:44 smithi188 bash[23329]: cephadm 2020-07-16T14:04:43.696605+0000 mgr.x (mgr.34562) 1253 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:04:45.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:04:44 smithi188 bash[23329]: cephadm 2020-07-16T14:04:43.696921+0000 mgr.x (mgr.34562) 1254 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:04:45.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:04:44 smithi188 bash[23329]: cluster 2020-07-16T14:04:43.843516+0000 mgr.x (mgr.34562) 1255 : cluster [DBG] pgmap v782: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:04:45.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:04:44 smithi132 bash[27079]: cephadm 2020-07-16T14:04:43.696605+0000 mgr.x (mgr.34562) 1253 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:04:45.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:04:44 smithi132 bash[27079]: cephadm 2020-07-16T14:04:43.696921+0000 mgr.x (mgr.34562) 1254 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:04:45.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:04:44 smithi132 bash[27079]: cluster 2020-07-16T14:04:43.843516+0000 mgr.x (mgr.34562) 1255 : cluster [DBG] pgmap v782: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:04:47.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:04:46 smithi188 bash[23329]: cluster 2020-07-16T14:04:45.843845+0000 mgr.x (mgr.34562) 1256 : cluster [DBG] pgmap v783: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:04:47.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:04:46 smithi132 bash[27079]: cluster 2020-07-16T14:04:45.843845+0000 mgr.x (mgr.34562) 1256 : cluster [DBG] pgmap v783: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:04:49.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:04:48 smithi188 bash[23329]: cluster 2020-07-16T14:04:47.844413+0000 mgr.x (mgr.34562) 1257 : cluster [DBG] pgmap v784: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:04:49.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:04:48 smithi132 bash[27079]: cluster 2020-07-16T14:04:47.844413+0000 mgr.x (mgr.34562) 1257 : cluster [DBG] pgmap v784: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:04:50.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:04:50 smithi188 bash[23329]: cluster 2020-07-16T14:04:49.844934+0000 mgr.x (mgr.34562) 1258 : cluster [DBG] pgmap v785: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:04:50.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:04:50 smithi132 bash[27079]: cluster 2020-07-16T14:04:49.844934+0000 mgr.x (mgr.34562) 1258 : cluster [DBG] pgmap v785: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:04:53.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:04:52 smithi188 bash[23329]: cluster 2020-07-16T14:04:51.845512+0000 mgr.x (mgr.34562) 1259 : cluster [DBG] pgmap v786: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:04:53.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:04:52 smithi132 bash[27079]: cluster 2020-07-16T14:04:51.845512+0000 mgr.x (mgr.34562) 1259 : cluster [DBG] pgmap v786: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:04:55.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:04:54 smithi188 bash[23329]: cluster 2020-07-16T14:04:53.845874+0000 mgr.x (mgr.34562) 1260 : cluster [DBG] pgmap v787: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:04:55.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:04:54 smithi132 bash[27079]: cluster 2020-07-16T14:04:53.845874+0000 mgr.x (mgr.34562) 1260 : cluster [DBG] pgmap v787: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:04:57.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:04:56 smithi188 bash[23329]: cluster 2020-07-16T14:04:55.846371+0000 mgr.x (mgr.34562) 1261 : cluster [DBG] pgmap v788: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:04:57.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:04:56 smithi132 bash[27079]: cluster 2020-07-16T14:04:55.846371+0000 mgr.x (mgr.34562) 1261 : cluster [DBG] pgmap v788: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:04:59.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:04:58 smithi188 bash[23329]: cluster 2020-07-16T14:04:57.846881+0000 mgr.x (mgr.34562) 1262 : cluster [DBG] pgmap v789: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:04:59.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:04:58 smithi188 bash[23329]: audit 2020-07-16T14:04:58.704364+0000 mon.b (mon.2) 398 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:04:59.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:04:58 smithi132 bash[27079]: cluster 2020-07-16T14:04:57.846881+0000 mgr.x (mgr.34562) 1262 : cluster [DBG] pgmap v789: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:04:59.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:04:58 smithi132 bash[27079]: audit 2020-07-16T14:04:58.704364+0000 mon.b (mon.2) 398 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:05:00.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:04:59 smithi188 bash[23329]: cephadm 2020-07-16T14:04:58.705189+0000 mgr.x (mgr.34562) 1263 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:05:00.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:04:59 smithi188 bash[23329]: cephadm 2020-07-16T14:04:58.705445+0000 mgr.x (mgr.34562) 1264 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:05:00.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:04:59 smithi132 bash[27079]: cephadm 2020-07-16T14:04:58.705189+0000 mgr.x (mgr.34562) 1263 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:05:00.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:04:59 smithi132 bash[27079]: cephadm 2020-07-16T14:04:58.705445+0000 mgr.x (mgr.34562) 1264 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:05:00.517 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:05:00.775 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:05:00.775 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (27m) 5m ago 30m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:05:00.775 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (30m) 5m ago 30m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:05:00.776 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (28m) 5m ago 33m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:05:00.776 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (27m) 5m ago 35m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:05:00.776 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 5m ago 35m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:05:00.776 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (33m) 5m ago 33m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:05:00.776 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (34m) 5m ago 34m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:05:00.777 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (30m) 5m ago 31m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:05:00.777 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (30m) 5m ago 31m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:05:00.777 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (33m) 5m ago 33m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:05:00.777 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (33m) 5m ago 33m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:05:00.777 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (32m) 5m ago 32m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:05:00.778 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (32m) 5m ago 32m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:05:00.778 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (31m) 5m ago 32m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:05:00.778 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (31m) 5m ago 31m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:05:00.778 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (31m) 5m ago 31m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:05:00.779 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (31m) 5m ago 31m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:05:00.779 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (30m) 5m ago 31m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:05:01.076 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:05:01.077 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:05:01.077 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:05:01.077 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:05:01.077 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:05:01.078 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:05:01.078 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:05:01.078 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:05:01.078 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:05:01.078 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:05:01.079 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:05:01.079 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:05:01.079 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:05:01.079 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:05:01.080 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:05:01.080 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:05:01.080 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:05:01.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:05:00 smithi188 bash[23329]: cluster 2020-07-16T14:04:59.847281+0000 mgr.x (mgr.34562) 1265 : cluster [DBG] pgmap v790: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:05:01.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:05:00 smithi132 bash[27079]: cluster 2020-07-16T14:04:59.847281+0000 mgr.x (mgr.34562) 1265 : cluster [DBG] pgmap v790: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:05:02.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:05:01 smithi132 bash[27079]: audit 2020-07-16T14:05:00.504877+0000 mgr.x (mgr.34562) 1266 : audit [DBG] from='client.25558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:05:02.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:05:01 smithi132 bash[27079]: audit 2020-07-16T14:05:00.770727+0000 mgr.x (mgr.34562) 1267 : audit [DBG] from='client.25564 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:05:02.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:05:01 smithi132 bash[27079]: audit 2020-07-16T14:05:01.075614+0000 mon.c (mon.1) 138 : audit [DBG] from='client.? 172.21.15.132:0/936192795' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:05:02.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:05:01 smithi188 bash[23329]: audit 2020-07-16T14:05:00.504877+0000 mgr.x (mgr.34562) 1266 : audit [DBG] from='client.25558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:05:02.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:05:01 smithi188 bash[23329]: audit 2020-07-16T14:05:00.770727+0000 mgr.x (mgr.34562) 1267 : audit [DBG] from='client.25564 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:05:02.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:05:01 smithi188 bash[23329]: audit 2020-07-16T14:05:01.075614+0000 mon.c (mon.1) 138 : audit [DBG] from='client.? 172.21.15.132:0/936192795' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:05:03.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:05:02 smithi132 bash[27079]: cluster 2020-07-16T14:05:01.847728+0000 mgr.x (mgr.34562) 1268 : cluster [DBG] pgmap v791: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:05:03.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:05:02 smithi188 bash[23329]: cluster 2020-07-16T14:05:01.847728+0000 mgr.x (mgr.34562) 1268 : cluster [DBG] pgmap v791: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:05:05.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:05:04 smithi132 bash[27079]: cluster 2020-07-16T14:05:03.848157+0000 mgr.x (mgr.34562) 1269 : cluster [DBG] pgmap v792: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:05:05.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:05:04 smithi188 bash[23329]: cluster 2020-07-16T14:05:03.848157+0000 mgr.x (mgr.34562) 1269 : cluster [DBG] pgmap v792: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:05:07.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:05:06 smithi132 bash[27079]: cluster 2020-07-16T14:05:05.848640+0000 mgr.x (mgr.34562) 1270 : cluster [DBG] pgmap v793: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:05:07.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:05:06 smithi188 bash[23329]: cluster 2020-07-16T14:05:05.848640+0000 mgr.x (mgr.34562) 1270 : cluster [DBG] pgmap v793: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:05:09.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:05:08 smithi132 bash[27079]: cluster 2020-07-16T14:05:07.849223+0000 mgr.x (mgr.34562) 1271 : cluster [DBG] pgmap v794: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:05:09.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:05:08 smithi188 bash[23329]: cluster 2020-07-16T14:05:07.849223+0000 mgr.x (mgr.34562) 1271 : cluster [DBG] pgmap v794: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:05:10.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:05:10 smithi188 bash[23329]: cluster 2020-07-16T14:05:09.849611+0000 mgr.x (mgr.34562) 1272 : cluster [DBG] pgmap v795: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:05:10.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:05:10 smithi132 bash[27079]: cluster 2020-07-16T14:05:09.849611+0000 mgr.x (mgr.34562) 1272 : cluster [DBG] pgmap v795: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:05:13.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:05:12 smithi188 bash[23329]: cluster 2020-07-16T14:05:11.850024+0000 mgr.x (mgr.34562) 1273 : cluster [DBG] pgmap v796: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:05:13.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:05:12 smithi132 bash[27079]: cluster 2020-07-16T14:05:11.850024+0000 mgr.x (mgr.34562) 1273 : cluster [DBG] pgmap v796: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:05:14.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:05:13 smithi188 bash[23329]: audit 2020-07-16T14:05:13.710388+0000 mon.b (mon.2) 399 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:05:14.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:05:13 smithi188 bash[23329]: audit 2020-07-16T14:05:13.711837+0000 mon.b (mon.2) 400 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:05:14.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:05:13 smithi188 bash[23329]: audit 2020-07-16T14:05:13.713036+0000 mon.b (mon.2) 401 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:05:14.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:05:13 smithi188 bash[23329]: audit 2020-07-16T14:05:13.714537+0000 mon.b (mon.2) 402 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:05:14.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:05:13 smithi188 bash[23329]: audit 2020-07-16T14:05:13.715945+0000 mon.b (mon.2) 403 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:05:14.173 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:05:13 smithi132 bash[27079]: audit 2020-07-16T14:05:13.710388+0000 mon.b (mon.2) 399 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:05:14.173 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:05:13 smithi132 bash[27079]: audit 2020-07-16T14:05:13.711837+0000 mon.b (mon.2) 400 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:05:14.173 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:05:13 smithi132 bash[27079]: audit 2020-07-16T14:05:13.713036+0000 mon.b (mon.2) 401 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:05:14.173 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:05:13 smithi132 bash[27079]: audit 2020-07-16T14:05:13.714537+0000 mon.b (mon.2) 402 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:05:14.174 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:05:13 smithi132 bash[27079]: audit 2020-07-16T14:05:13.715945+0000 mon.b (mon.2) 403 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:05:15.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:05:14 smithi188 bash[23329]: audit 2020-07-16T14:05:13.710807+0000 mgr.x (mgr.34562) 1274 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:05:15.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:05:14 smithi188 bash[23329]: audit 2020-07-16T14:05:13.712172+0000 mgr.x (mgr.34562) 1275 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:05:15.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:05:14 smithi188 bash[23329]: audit 2020-07-16T14:05:13.713323+0000 mgr.x (mgr.34562) 1276 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:05:15.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:05:14 smithi188 bash[23329]: cephadm 2020-07-16T14:05:13.714067+0000 mgr.x (mgr.34562) 1277 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:05:15.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:05:14 smithi188 bash[23329]: cephadm 2020-07-16T14:05:13.715407+0000 mgr.x (mgr.34562) 1278 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:05:15.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:05:14 smithi188 bash[23329]: cephadm 2020-07-16T14:05:13.716673+0000 mgr.x (mgr.34562) 1279 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:05:15.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:05:14 smithi188 bash[23329]: cephadm 2020-07-16T14:05:13.716860+0000 mgr.x (mgr.34562) 1280 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:05:15.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:05:14 smithi188 bash[23329]: cluster 2020-07-16T14:05:13.850533+0000 mgr.x (mgr.34562) 1281 : cluster [DBG] pgmap v797: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:05:15.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:05:14 smithi132 bash[27079]: audit 2020-07-16T14:05:13.710807+0000 mgr.x (mgr.34562) 1274 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:05:15.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:05:14 smithi132 bash[27079]: audit 2020-07-16T14:05:13.712172+0000 mgr.x (mgr.34562) 1275 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:05:15.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:05:14 smithi132 bash[27079]: audit 2020-07-16T14:05:13.713323+0000 mgr.x (mgr.34562) 1276 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:05:15.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:05:14 smithi132 bash[27079]: cephadm 2020-07-16T14:05:13.714067+0000 mgr.x (mgr.34562) 1277 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:05:15.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:05:14 smithi132 bash[27079]: cephadm 2020-07-16T14:05:13.715407+0000 mgr.x (mgr.34562) 1278 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:05:15.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:05:14 smithi132 bash[27079]: cephadm 2020-07-16T14:05:13.716673+0000 mgr.x (mgr.34562) 1279 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:05:15.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:05:14 smithi132 bash[27079]: cephadm 2020-07-16T14:05:13.716860+0000 mgr.x (mgr.34562) 1280 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:05:15.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:05:14 smithi132 bash[27079]: cluster 2020-07-16T14:05:13.850533+0000 mgr.x (mgr.34562) 1281 : cluster [DBG] pgmap v797: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:05:17.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:05:16 smithi188 bash[23329]: cluster 2020-07-16T14:05:15.851027+0000 mgr.x (mgr.34562) 1282 : cluster [DBG] pgmap v798: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:05:17.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:05:16 smithi188 bash[23329]: audit 2020-07-16T14:05:16.348710+0000 mon.b (mon.2) 404 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:05:17.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:05:16 smithi132 bash[27079]: cluster 2020-07-16T14:05:15.851027+0000 mgr.x (mgr.34562) 1282 : cluster [DBG] pgmap v798: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:05:17.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:05:16 smithi132 bash[27079]: audit 2020-07-16T14:05:16.348710+0000 mon.b (mon.2) 404 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:05:18.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:05:17 smithi132 bash[27079]: cephadm 2020-07-16T14:05:16.349484+0000 mgr.x (mgr.34562) 1283 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:05:18.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:05:17 smithi132 bash[27079]: cephadm 2020-07-16T14:05:16.349795+0000 mgr.x (mgr.34562) 1284 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:05:18.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:05:17 smithi188 bash[23329]: cephadm 2020-07-16T14:05:16.349484+0000 mgr.x (mgr.34562) 1283 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:05:18.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:05:17 smithi188 bash[23329]: cephadm 2020-07-16T14:05:16.349795+0000 mgr.x (mgr.34562) 1284 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:05:19.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:05:18 smithi132 bash[27079]: cluster 2020-07-16T14:05:17.851495+0000 mgr.x (mgr.34562) 1285 : cluster [DBG] pgmap v799: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:05:19.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:05:18 smithi188 bash[23329]: cluster 2020-07-16T14:05:17.851495+0000 mgr.x (mgr.34562) 1285 : cluster [DBG] pgmap v799: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:05:20.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:05:20 smithi188 bash[23329]: cluster 2020-07-16T14:05:19.851947+0000 mgr.x (mgr.34562) 1286 : cluster [DBG] pgmap v800: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:05:20.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:05:20 smithi132 bash[27079]: cluster 2020-07-16T14:05:19.851947+0000 mgr.x (mgr.34562) 1286 : cluster [DBG] pgmap v800: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:05:23.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:05:22 smithi188 bash[23329]: cluster 2020-07-16T14:05:21.852483+0000 mgr.x (mgr.34562) 1287 : cluster [DBG] pgmap v801: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:05:23.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:05:22 smithi132 bash[27079]: cluster 2020-07-16T14:05:21.852483+0000 mgr.x (mgr.34562) 1287 : cluster [DBG] pgmap v801: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:05:25.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:05:24 smithi188 bash[23329]: cluster 2020-07-16T14:05:23.852850+0000 mgr.x (mgr.34562) 1288 : cluster [DBG] pgmap v802: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:05:25.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:05:24 smithi132 bash[27079]: cluster 2020-07-16T14:05:23.852850+0000 mgr.x (mgr.34562) 1288 : cluster [DBG] pgmap v802: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:05:27.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:05:26 smithi188 bash[23329]: cluster 2020-07-16T14:05:25.853208+0000 mgr.x (mgr.34562) 1289 : cluster [DBG] pgmap v803: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:05:27.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:05:26 smithi132 bash[27079]: cluster 2020-07-16T14:05:25.853208+0000 mgr.x (mgr.34562) 1289 : cluster [DBG] pgmap v803: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:05:29.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:05:28 smithi188 bash[23329]: cluster 2020-07-16T14:05:27.853580+0000 mgr.x (mgr.34562) 1290 : cluster [DBG] pgmap v804: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:05:29.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:05:28 smithi132 bash[27079]: cluster 2020-07-16T14:05:27.853580+0000 mgr.x (mgr.34562) 1290 : cluster [DBG] pgmap v804: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:05:30.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:05:30 smithi188 bash[23329]: cluster 2020-07-16T14:05:29.853958+0000 mgr.x (mgr.34562) 1291 : cluster [DBG] pgmap v805: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:05:30.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:05:30 smithi132 bash[27079]: cluster 2020-07-16T14:05:29.853958+0000 mgr.x (mgr.34562) 1291 : cluster [DBG] pgmap v805: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:05:31.376 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:05:31.640 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:05:31.640 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (28m) 5m ago 31m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:05:31.640 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (31m) 5m ago 31m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:05:31.640 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (28m) 5m ago 34m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:05:31.641 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (28m) 5m ago 35m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:05:31.641 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 5m ago 35m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:05:31.641 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (34m) 5m ago 34m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:05:31.641 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (34m) 5m ago 34m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:05:31.641 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (31m) 5m ago 31m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:05:31.642 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (31m) 5m ago 31m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:05:31.642 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (33m) 5m ago 33m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:05:31.642 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (33m) 5m ago 33m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:05:31.642 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (33m) 5m ago 33m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:05:31.642 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (33m) 5m ago 33m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:05:31.643 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (32m) 5m ago 32m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:05:31.643 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (32m) 5m ago 32m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:05:31.643 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (32m) 5m ago 32m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:05:31.643 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (31m) 5m ago 31m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:05:31.643 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (30m) 5m ago 31m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:05:31.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:05:31 smithi188 bash[23329]: audit 2020-07-16T14:05:31.365305+0000 mon.b (mon.2) 405 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:05:31.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:05:31 smithi132 bash[27079]: audit 2020-07-16T14:05:31.365305+0000 mon.b (mon.2) 405 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:05:31.937 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:05:31.937 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:05:31.937 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:05:31.938 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:05:31.938 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:05:31.938 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:05:31.938 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:05:31.938 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:05:31.939 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:05:31.939 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:05:31.939 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:05:31.939 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:05:31.939 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:05:31.940 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:05:31.940 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:05:31.940 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:05:31.940 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:05:32.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:05:32 smithi132 bash[27079]: audit 2020-07-16T14:05:31.364056+0000 mgr.x (mgr.34562) 1292 : audit [DBG] from='client.25576 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:05:32.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:05:32 smithi132 bash[27079]: cephadm 2020-07-16T14:05:31.365884+0000 mgr.x (mgr.34562) 1293 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:05:32.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:05:32 smithi132 bash[27079]: cephadm 2020-07-16T14:05:31.366253+0000 mgr.x (mgr.34562) 1294 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:05:32.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:05:32 smithi132 bash[27079]: audit 2020-07-16T14:05:31.635448+0000 mgr.x (mgr.34562) 1295 : audit [DBG] from='client.25582 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:05:32.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:05:32 smithi132 bash[27079]: cluster 2020-07-16T14:05:31.854355+0000 mgr.x (mgr.34562) 1296 : cluster [DBG] pgmap v806: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:05:32.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:05:32 smithi132 bash[27079]: audit 2020-07-16T14:05:31.936182+0000 mon.c (mon.1) 139 : audit [DBG] from='client.? 172.21.15.132:0/3077742559' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:05:32.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:05:32 smithi188 bash[23329]: audit 2020-07-16T14:05:31.364056+0000 mgr.x (mgr.34562) 1292 : audit [DBG] from='client.25576 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:05:32.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:05:32 smithi188 bash[23329]: cephadm 2020-07-16T14:05:31.365884+0000 mgr.x (mgr.34562) 1293 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:05:32.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:05:32 smithi188 bash[23329]: cephadm 2020-07-16T14:05:31.366253+0000 mgr.x (mgr.34562) 1294 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:05:32.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:05:32 smithi188 bash[23329]: audit 2020-07-16T14:05:31.635448+0000 mgr.x (mgr.34562) 1295 : audit [DBG] from='client.25582 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:05:32.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:05:32 smithi188 bash[23329]: cluster 2020-07-16T14:05:31.854355+0000 mgr.x (mgr.34562) 1296 : cluster [DBG] pgmap v806: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:05:32.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:05:32 smithi188 bash[23329]: audit 2020-07-16T14:05:31.936182+0000 mon.c (mon.1) 139 : audit [DBG] from='client.? 172.21.15.132:0/3077742559' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:05:35.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:05:34 smithi188 bash[23329]: cluster 2020-07-16T14:05:33.854708+0000 mgr.x (mgr.34562) 1297 : cluster [DBG] pgmap v807: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:05:35.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:05:34 smithi132 bash[27079]: cluster 2020-07-16T14:05:33.854708+0000 mgr.x (mgr.34562) 1297 : cluster [DBG] pgmap v807: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:05:37.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:05:36 smithi188 bash[23329]: cluster 2020-07-16T14:05:35.855055+0000 mgr.x (mgr.34562) 1298 : cluster [DBG] pgmap v808: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:05:37.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:05:36 smithi132 bash[27079]: cluster 2020-07-16T14:05:35.855055+0000 mgr.x (mgr.34562) 1298 : cluster [DBG] pgmap v808: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:05:39.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:05:38 smithi188 bash[23329]: cluster 2020-07-16T14:05:37.855612+0000 mgr.x (mgr.34562) 1299 : cluster [DBG] pgmap v809: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:05:39.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:05:38 smithi132 bash[27079]: cluster 2020-07-16T14:05:37.855612+0000 mgr.x (mgr.34562) 1299 : cluster [DBG] pgmap v809: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:05:40.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:05:40 smithi188 bash[23329]: cluster 2020-07-16T14:05:39.856136+0000 mgr.x (mgr.34562) 1300 : cluster [DBG] pgmap v810: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:05:40.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:05:40 smithi132 bash[27079]: cluster 2020-07-16T14:05:39.856136+0000 mgr.x (mgr.34562) 1300 : cluster [DBG] pgmap v810: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:05:43.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:05:42 smithi188 bash[23329]: cluster 2020-07-16T14:05:41.856544+0000 mgr.x (mgr.34562) 1301 : cluster [DBG] pgmap v811: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:05:43.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:05:42 smithi132 bash[27079]: cluster 2020-07-16T14:05:41.856544+0000 mgr.x (mgr.34562) 1301 : cluster [DBG] pgmap v811: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:05:45.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:05:44 smithi188 bash[23329]: cluster 2020-07-16T14:05:43.856885+0000 mgr.x (mgr.34562) 1302 : cluster [DBG] pgmap v812: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:05:45.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:05:44 smithi132 bash[27079]: cluster 2020-07-16T14:05:43.856885+0000 mgr.x (mgr.34562) 1302 : cluster [DBG] pgmap v812: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:05:47.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:05:46 smithi188 bash[23329]: cluster 2020-07-16T14:05:45.857332+0000 mgr.x (mgr.34562) 1303 : cluster [DBG] pgmap v813: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:05:47.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:05:46 smithi188 bash[23329]: audit 2020-07-16T14:05:46.381203+0000 mon.b (mon.2) 406 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:05:47.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:05:46 smithi132 bash[27079]: cluster 2020-07-16T14:05:45.857332+0000 mgr.x (mgr.34562) 1303 : cluster [DBG] pgmap v813: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:05:47.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:05:46 smithi132 bash[27079]: audit 2020-07-16T14:05:46.381203+0000 mon.b (mon.2) 406 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:05:48.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:05:47 smithi132 bash[27079]: cephadm 2020-07-16T14:05:46.381886+0000 mgr.x (mgr.34562) 1304 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:05:48.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:05:47 smithi132 bash[27079]: cephadm 2020-07-16T14:05:46.381963+0000 mgr.x (mgr.34562) 1305 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:05:48.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:05:47 smithi188 bash[23329]: cephadm 2020-07-16T14:05:46.381886+0000 mgr.x (mgr.34562) 1304 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:05:48.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:05:47 smithi188 bash[23329]: cephadm 2020-07-16T14:05:46.381963+0000 mgr.x (mgr.34562) 1305 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:05:49.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:05:48 smithi132 bash[27079]: cluster 2020-07-16T14:05:47.857840+0000 mgr.x (mgr.34562) 1306 : cluster [DBG] pgmap v814: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:05:49.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:05:48 smithi188 bash[23329]: cluster 2020-07-16T14:05:47.857840+0000 mgr.x (mgr.34562) 1306 : cluster [DBG] pgmap v814: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:05:50.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:05:50 smithi188 bash[23329]: cluster 2020-07-16T14:05:49.858179+0000 mgr.x (mgr.34562) 1307 : cluster [DBG] pgmap v815: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:05:50.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:05:50 smithi132 bash[27079]: cluster 2020-07-16T14:05:49.858179+0000 mgr.x (mgr.34562) 1307 : cluster [DBG] pgmap v815: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:05:53.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:05:52 smithi188 bash[23329]: cluster 2020-07-16T14:05:51.858723+0000 mgr.x (mgr.34562) 1308 : cluster [DBG] pgmap v816: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:05:53.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:05:52 smithi132 bash[27079]: cluster 2020-07-16T14:05:51.858723+0000 mgr.x (mgr.34562) 1308 : cluster [DBG] pgmap v816: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:05:55.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:05:54 smithi188 bash[23329]: cluster 2020-07-16T14:05:53.859207+0000 mgr.x (mgr.34562) 1309 : cluster [DBG] pgmap v817: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:05:55.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:05:54 smithi132 bash[27079]: cluster 2020-07-16T14:05:53.859207+0000 mgr.x (mgr.34562) 1309 : cluster [DBG] pgmap v817: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:05:57.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:05:56 smithi132 bash[27079]: cluster 2020-07-16T14:05:55.859705+0000 mgr.x (mgr.34562) 1310 : cluster [DBG] pgmap v818: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:05:57.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:05:56 smithi188 bash[23329]: cluster 2020-07-16T14:05:55.859705+0000 mgr.x (mgr.34562) 1310 : cluster [DBG] pgmap v818: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:05:59.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:05:58 smithi132 bash[27079]: cluster 2020-07-16T14:05:57.860132+0000 mgr.x (mgr.34562) 1311 : cluster [DBG] pgmap v819: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:05:59.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:05:58 smithi188 bash[23329]: cluster 2020-07-16T14:05:57.860132+0000 mgr.x (mgr.34562) 1311 : cluster [DBG] pgmap v819: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:06:00.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:06:00 smithi188 bash[23329]: cluster 2020-07-16T14:05:59.860573+0000 mgr.x (mgr.34562) 1312 : cluster [DBG] pgmap v820: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:06:00.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:06:00 smithi132 bash[27079]: cluster 2020-07-16T14:05:59.860573+0000 mgr.x (mgr.34562) 1312 : cluster [DBG] pgmap v820: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:06:01.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:06:01 smithi132 bash[27079]: audit 2020-07-16T14:06:01.397713+0000 mon.b (mon.2) 407 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:06:01.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:06:01 smithi188 bash[23329]: audit 2020-07-16T14:06:01.397713+0000 mon.b (mon.2) 407 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:06:02.236 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:06:02.499 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:06:02.500 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (28m) 6m ago 31m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:06:02.500 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (31m) 6m ago 31m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:06:02.500 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (29m) 6m ago 34m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:06:02.500 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (28m) 6m ago 36m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:06:02.500 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 6m ago 36m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:06:02.501 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (34m) 6m ago 34m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:06:02.501 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (35m) 6m ago 35m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:06:02.501 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (32m) 6m ago 32m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:06:02.501 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (32m) 6m ago 32m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:06:02.501 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (34m) 6m ago 34m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:06:02.502 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (34m) 6m ago 34m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:06:02.502 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (33m) 6m ago 33m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:06:02.502 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (33m) 6m ago 33m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:06:02.502 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (33m) 6m ago 33m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:06:02.503 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (32m) 6m ago 33m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:06:02.503 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (32m) 6m ago 32m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:06:02.503 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (32m) 6m ago 32m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:06:02.503 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (31m) 6m ago 32m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:06:02.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:06:02 smithi132 bash[27079]: cephadm 2020-07-16T14:06:01.398453+0000 mgr.x (mgr.34562) 1313 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:06:02.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:06:02 smithi132 bash[27079]: cephadm 2020-07-16T14:06:01.398881+0000 mgr.x (mgr.34562) 1314 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:06:02.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:06:02 smithi132 bash[27079]: cluster 2020-07-16T14:06:01.861209+0000 mgr.x (mgr.34562) 1315 : cluster [DBG] pgmap v821: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:06:02.800 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:06:02.800 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:06:02.800 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:06:02.800 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:06:02.801 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:06:02.801 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:06:02.801 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:06:02.801 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:06:02.801 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:06:02.802 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:06:02.802 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:06:02.802 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:06:02.802 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:06:02.803 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:06:02.803 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:06:02.803 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:06:02.803 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:06:02.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:06:02 smithi188 bash[23329]: cephadm 2020-07-16T14:06:01.398453+0000 mgr.x (mgr.34562) 1313 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:06:02.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:06:02 smithi188 bash[23329]: cephadm 2020-07-16T14:06:01.398881+0000 mgr.x (mgr.34562) 1314 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:06:02.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:06:02 smithi188 bash[23329]: cluster 2020-07-16T14:06:01.861209+0000 mgr.x (mgr.34562) 1315 : cluster [DBG] pgmap v821: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:06:03.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:06:03 smithi132 bash[27079]: audit 2020-07-16T14:06:02.224156+0000 mgr.x (mgr.34562) 1316 : audit [DBG] from='client.25594 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:06:03.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:06:03 smithi132 bash[27079]: audit 2020-07-16T14:06:02.494882+0000 mgr.x (mgr.34562) 1317 : audit [DBG] from='client.25600 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:06:03.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:06:03 smithi132 bash[27079]: audit 2020-07-16T14:06:02.798965+0000 mon.c (mon.1) 140 : audit [DBG] from='client.? 172.21.15.132:0/767151330' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:06:03.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:06:03 smithi188 bash[23329]: audit 2020-07-16T14:06:02.224156+0000 mgr.x (mgr.34562) 1316 : audit [DBG] from='client.25594 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:06:03.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:06:03 smithi188 bash[23329]: audit 2020-07-16T14:06:02.494882+0000 mgr.x (mgr.34562) 1317 : audit [DBG] from='client.25600 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:06:03.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:06:03 smithi188 bash[23329]: audit 2020-07-16T14:06:02.798965+0000 mon.c (mon.1) 140 : audit [DBG] from='client.? 172.21.15.132:0/767151330' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:06:04.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:06:04 smithi132 bash[27079]: cluster 2020-07-16T14:06:03.861549+0000 mgr.x (mgr.34562) 1318 : cluster [DBG] pgmap v822: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:06:04.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:06:04 smithi188 bash[23329]: cluster 2020-07-16T14:06:03.861549+0000 mgr.x (mgr.34562) 1318 : cluster [DBG] pgmap v822: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:06:07.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:06:06 smithi188 bash[23329]: cluster 2020-07-16T14:06:05.861945+0000 mgr.x (mgr.34562) 1319 : cluster [DBG] pgmap v823: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:06:07.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:06:06 smithi132 bash[27079]: cluster 2020-07-16T14:06:05.861945+0000 mgr.x (mgr.34562) 1319 : cluster [DBG] pgmap v823: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:06:09.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:06:08 smithi132 bash[27079]: cluster 2020-07-16T14:06:07.862492+0000 mgr.x (mgr.34562) 1320 : cluster [DBG] pgmap v824: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:06:09.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:06:08 smithi188 bash[23329]: cluster 2020-07-16T14:06:07.862492+0000 mgr.x (mgr.34562) 1320 : cluster [DBG] pgmap v824: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:06:10.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:06:10 smithi188 bash[23329]: cluster 2020-07-16T14:06:09.863010+0000 mgr.x (mgr.34562) 1321 : cluster [DBG] pgmap v825: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:06:10.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:06:10 smithi132 bash[27079]: cluster 2020-07-16T14:06:09.863010+0000 mgr.x (mgr.34562) 1321 : cluster [DBG] pgmap v825: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:06:13.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:06:12 smithi188 bash[23329]: cluster 2020-07-16T14:06:11.863415+0000 mgr.x (mgr.34562) 1322 : cluster [DBG] pgmap v826: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:06:13.286 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:06:12 smithi132 bash[27079]: cluster 2020-07-16T14:06:11.863415+0000 mgr.x (mgr.34562) 1322 : cluster [DBG] pgmap v826: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:06:15.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:06:14 smithi132 bash[27079]: cluster 2020-07-16T14:06:13.863757+0000 mgr.x (mgr.34562) 1323 : cluster [DBG] pgmap v827: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:06:15.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:06:14 smithi188 bash[23329]: cluster 2020-07-16T14:06:13.863757+0000 mgr.x (mgr.34562) 1323 : cluster [DBG] pgmap v827: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:06:17.236 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:06:16 smithi132 bash[27079]: cluster 2020-07-16T14:06:15.864209+0000 mgr.x (mgr.34562) 1324 : cluster [DBG] pgmap v828: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:06:17.237 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:06:16 smithi132 bash[27079]: audit 2020-07-16T14:06:16.417014+0000 mon.b (mon.2) 408 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:06:17.237 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:06:16 smithi132 bash[27079]: audit 2020-07-16T14:06:16.418388+0000 mon.b (mon.2) 409 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:06:17.238 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:06:16 smithi132 bash[27079]: audit 2020-07-16T14:06:16.419561+0000 mon.b (mon.2) 410 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:06:17.238 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:06:16 smithi132 bash[27079]: audit 2020-07-16T14:06:16.420884+0000 mon.b (mon.2) 411 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:06:17.238 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:06:16 smithi132 bash[27079]: audit 2020-07-16T14:06:16.422183+0000 mon.b (mon.2) 412 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:06:17.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:06:16 smithi188 bash[23329]: cluster 2020-07-16T14:06:15.864209+0000 mgr.x (mgr.34562) 1324 : cluster [DBG] pgmap v828: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:06:17.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:06:16 smithi188 bash[23329]: audit 2020-07-16T14:06:16.417014+0000 mon.b (mon.2) 408 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:06:17.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:06:16 smithi188 bash[23329]: audit 2020-07-16T14:06:16.418388+0000 mon.b (mon.2) 409 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:06:17.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:06:16 smithi188 bash[23329]: audit 2020-07-16T14:06:16.419561+0000 mon.b (mon.2) 410 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:06:17.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:06:16 smithi188 bash[23329]: audit 2020-07-16T14:06:16.420884+0000 mon.b (mon.2) 411 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:06:17.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:06:16 smithi188 bash[23329]: audit 2020-07-16T14:06:16.422183+0000 mon.b (mon.2) 412 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:06:18.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:06:17 smithi132 bash[27079]: audit 2020-07-16T14:06:16.417407+0000 mgr.x (mgr.34562) 1325 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:06:18.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:06:17 smithi132 bash[27079]: audit 2020-07-16T14:06:16.418700+0000 mgr.x (mgr.34562) 1326 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:06:18.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:06:17 smithi132 bash[27079]: audit 2020-07-16T14:06:16.419829+0000 mgr.x (mgr.34562) 1327 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:06:18.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:06:17 smithi132 bash[27079]: cephadm 2020-07-16T14:06:16.420548+0000 mgr.x (mgr.34562) 1328 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:06:18.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:06:17 smithi132 bash[27079]: cephadm 2020-07-16T14:06:16.421698+0000 mgr.x (mgr.34562) 1329 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:06:18.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:06:17 smithi132 bash[27079]: cephadm 2020-07-16T14:06:16.422892+0000 mgr.x (mgr.34562) 1330 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:06:18.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:06:17 smithi132 bash[27079]: cephadm 2020-07-16T14:06:16.422983+0000 mgr.x (mgr.34562) 1331 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:06:18.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:06:17 smithi188 bash[23329]: audit 2020-07-16T14:06:16.417407+0000 mgr.x (mgr.34562) 1325 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:06:18.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:06:17 smithi188 bash[23329]: audit 2020-07-16T14:06:16.418700+0000 mgr.x (mgr.34562) 1326 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:06:18.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:06:17 smithi188 bash[23329]: audit 2020-07-16T14:06:16.419829+0000 mgr.x (mgr.34562) 1327 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:06:18.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:06:17 smithi188 bash[23329]: cephadm 2020-07-16T14:06:16.420548+0000 mgr.x (mgr.34562) 1328 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:06:18.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:06:17 smithi188 bash[23329]: cephadm 2020-07-16T14:06:16.421698+0000 mgr.x (mgr.34562) 1329 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:06:18.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:06:17 smithi188 bash[23329]: cephadm 2020-07-16T14:06:16.422892+0000 mgr.x (mgr.34562) 1330 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:06:18.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:06:17 smithi188 bash[23329]: cephadm 2020-07-16T14:06:16.422983+0000 mgr.x (mgr.34562) 1331 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:06:19.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:06:18 smithi132 bash[27079]: cluster 2020-07-16T14:06:17.864691+0000 mgr.x (mgr.34562) 1332 : cluster [DBG] pgmap v829: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:06:19.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:06:18 smithi188 bash[23329]: cluster 2020-07-16T14:06:17.864691+0000 mgr.x (mgr.34562) 1332 : cluster [DBG] pgmap v829: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:06:20.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:06:19 smithi132 bash[27079]: audit 2020-07-16T14:06:19.218341+0000 mon.b (mon.2) 413 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:06:20.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:06:19 smithi188 bash[23329]: audit 2020-07-16T14:06:19.218341+0000 mon.b (mon.2) 413 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:06:21.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:06:20 smithi132 bash[27079]: cephadm 2020-07-16T14:06:19.218977+0000 mgr.x (mgr.34562) 1333 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:06:21.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:06:20 smithi132 bash[27079]: cephadm 2020-07-16T14:06:19.219184+0000 mgr.x (mgr.34562) 1334 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:06:21.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:06:20 smithi132 bash[27079]: cluster 2020-07-16T14:06:19.865036+0000 mgr.x (mgr.34562) 1335 : cluster [DBG] pgmap v830: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:06:21.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:06:20 smithi188 bash[23329]: cephadm 2020-07-16T14:06:19.218977+0000 mgr.x (mgr.34562) 1333 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:06:21.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:06:20 smithi188 bash[23329]: cephadm 2020-07-16T14:06:19.219184+0000 mgr.x (mgr.34562) 1334 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:06:21.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:06:20 smithi188 bash[23329]: cluster 2020-07-16T14:06:19.865036+0000 mgr.x (mgr.34562) 1335 : cluster [DBG] pgmap v830: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:06:23.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:06:22 smithi132 bash[27079]: cluster 2020-07-16T14:06:21.865599+0000 mgr.x (mgr.34562) 1336 : cluster [DBG] pgmap v831: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:06:23.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:06:22 smithi188 bash[23329]: cluster 2020-07-16T14:06:21.865599+0000 mgr.x (mgr.34562) 1336 : cluster [DBG] pgmap v831: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:06:25.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:06:24 smithi132 bash[27079]: cluster 2020-07-16T14:06:23.866078+0000 mgr.x (mgr.34562) 1337 : cluster [DBG] pgmap v832: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:06:25.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:06:24 smithi188 bash[23329]: cluster 2020-07-16T14:06:23.866078+0000 mgr.x (mgr.34562) 1337 : cluster [DBG] pgmap v832: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:06:27.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:06:26 smithi132 bash[27079]: cluster 2020-07-16T14:06:25.866472+0000 mgr.x (mgr.34562) 1338 : cluster [DBG] pgmap v833: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:06:27.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:06:26 smithi188 bash[23329]: cluster 2020-07-16T14:06:25.866472+0000 mgr.x (mgr.34562) 1338 : cluster [DBG] pgmap v833: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:06:29.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:06:28 smithi132 bash[27079]: cluster 2020-07-16T14:06:27.866983+0000 mgr.x (mgr.34562) 1339 : cluster [DBG] pgmap v834: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:06:29.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:06:28 smithi188 bash[23329]: cluster 2020-07-16T14:06:27.866983+0000 mgr.x (mgr.34562) 1339 : cluster [DBG] pgmap v834: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:06:30.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:06:30 smithi188 bash[23329]: cluster 2020-07-16T14:06:29.867431+0000 mgr.x (mgr.34562) 1340 : cluster [DBG] pgmap v835: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:06:30.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:06:30 smithi132 bash[27079]: cluster 2020-07-16T14:06:29.867431+0000 mgr.x (mgr.34562) 1340 : cluster [DBG] pgmap v835: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:06:33.100 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:06:33.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:06:32 smithi132 bash[27079]: cluster 2020-07-16T14:06:31.867798+0000 mgr.x (mgr.34562) 1341 : cluster [DBG] pgmap v836: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:06:33.362 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:06:33.362 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (29m) 6m ago 32m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:06:33.363 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (32m) 6m ago 32m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:06:33.363 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (29m) 6m ago 35m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:06:33.363 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (29m) 6m ago 36m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:06:33.363 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 6m ago 36m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:06:33.363 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (35m) 6m ago 35m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:06:33.364 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (35m) 6m ago 35m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:06:33.364 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (32m) 6m ago 32m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:06:33.364 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (32m) 6m ago 32m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:06:33.364 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (34m) 6m ago 34m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:06:33.364 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (34m) 6m ago 34m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:06:33.365 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (34m) 6m ago 34m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:06:33.365 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (34m) 6m ago 34m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:06:33.365 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (33m) 6m ago 33m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:06:33.365 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (33m) 6m ago 33m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:06:33.365 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (33m) 6m ago 33m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:06:33.366 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (32m) 6m ago 32m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:06:33.366 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (31m) 6m ago 32m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:06:33.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:06:32 smithi188 bash[23329]: cluster 2020-07-16T14:06:31.867798+0000 mgr.x (mgr.34562) 1341 : cluster [DBG] pgmap v836: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:06:33.661 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:06:33.662 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:06:33.662 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:06:33.662 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:06:33.662 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:06:33.662 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:06:33.663 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:06:33.663 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:06:33.663 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:06:33.663 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:06:33.663 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:06:33.664 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:06:33.664 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:06:33.664 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:06:33.664 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:06:33.664 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:06:33.665 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:06:34.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:06:33 smithi132 bash[27079]: audit 2020-07-16T14:06:33.088421+0000 mgr.x (mgr.34562) 1342 : audit [DBG] from='client.25612 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:06:34.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:06:33 smithi132 bash[27079]: audit 2020-07-16T14:06:33.660501+0000 mon.c (mon.1) 141 : audit [DBG] from='client.? 172.21.15.132:0/3546020875' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:06:34.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:06:33 smithi188 bash[23329]: audit 2020-07-16T14:06:33.088421+0000 mgr.x (mgr.34562) 1342 : audit [DBG] from='client.25612 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:06:34.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:06:33 smithi188 bash[23329]: audit 2020-07-16T14:06:33.660501+0000 mon.c (mon.1) 141 : audit [DBG] from='client.? 172.21.15.132:0/3546020875' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:06:35.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:06:34 smithi132 bash[27079]: audit 2020-07-16T14:06:33.357803+0000 mgr.x (mgr.34562) 1343 : audit [DBG] from='client.25618 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:06:35.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:06:34 smithi132 bash[27079]: cluster 2020-07-16T14:06:33.868196+0000 mgr.x (mgr.34562) 1344 : cluster [DBG] pgmap v837: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:06:35.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:06:34 smithi132 bash[27079]: audit 2020-07-16T14:06:34.223709+0000 mon.b (mon.2) 414 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:06:35.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:06:34 smithi188 bash[23329]: audit 2020-07-16T14:06:33.357803+0000 mgr.x (mgr.34562) 1343 : audit [DBG] from='client.25618 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:06:35.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:06:34 smithi188 bash[23329]: cluster 2020-07-16T14:06:33.868196+0000 mgr.x (mgr.34562) 1344 : cluster [DBG] pgmap v837: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:06:35.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:06:34 smithi188 bash[23329]: audit 2020-07-16T14:06:34.223709+0000 mon.b (mon.2) 414 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:06:36.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:06:35 smithi132 bash[27079]: cephadm 2020-07-16T14:06:34.224400+0000 mgr.x (mgr.34562) 1345 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:06:36.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:06:35 smithi132 bash[27079]: cephadm 2020-07-16T14:06:34.224808+0000 mgr.x (mgr.34562) 1346 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:06:36.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:06:35 smithi188 bash[23329]: cephadm 2020-07-16T14:06:34.224400+0000 mgr.x (mgr.34562) 1345 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:06:36.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:06:35 smithi188 bash[23329]: cephadm 2020-07-16T14:06:34.224808+0000 mgr.x (mgr.34562) 1346 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:06:37.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:06:36 smithi132 bash[27079]: cluster 2020-07-16T14:06:35.868575+0000 mgr.x (mgr.34562) 1347 : cluster [DBG] pgmap v838: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:06:37.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:06:36 smithi188 bash[23329]: cluster 2020-07-16T14:06:35.868575+0000 mgr.x (mgr.34562) 1347 : cluster [DBG] pgmap v838: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:06:39.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:06:38 smithi132 bash[27079]: cluster 2020-07-16T14:06:37.869049+0000 mgr.x (mgr.34562) 1348 : cluster [DBG] pgmap v839: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:06:39.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:06:38 smithi188 bash[23329]: cluster 2020-07-16T14:06:37.869049+0000 mgr.x (mgr.34562) 1348 : cluster [DBG] pgmap v839: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:06:40.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:06:40 smithi188 bash[23329]: cluster 2020-07-16T14:06:39.869434+0000 mgr.x (mgr.34562) 1349 : cluster [DBG] pgmap v840: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:06:40.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:06:40 smithi132 bash[27079]: cluster 2020-07-16T14:06:39.869434+0000 mgr.x (mgr.34562) 1349 : cluster [DBG] pgmap v840: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:06:43.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:06:42 smithi132 bash[27079]: cluster 2020-07-16T14:06:41.869835+0000 mgr.x (mgr.34562) 1350 : cluster [DBG] pgmap v841: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:06:43.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:06:42 smithi188 bash[23329]: cluster 2020-07-16T14:06:41.869835+0000 mgr.x (mgr.34562) 1350 : cluster [DBG] pgmap v841: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:06:45.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:06:44 smithi132 bash[27079]: cluster 2020-07-16T14:06:43.870235+0000 mgr.x (mgr.34562) 1351 : cluster [DBG] pgmap v842: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:06:45.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:06:44 smithi188 bash[23329]: cluster 2020-07-16T14:06:43.870235+0000 mgr.x (mgr.34562) 1351 : cluster [DBG] pgmap v842: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:06:47.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:06:46 smithi132 bash[27079]: cluster 2020-07-16T14:06:45.870752+0000 mgr.x (mgr.34562) 1352 : cluster [DBG] pgmap v843: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:06:47.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:06:46 smithi188 bash[23329]: cluster 2020-07-16T14:06:45.870752+0000 mgr.x (mgr.34562) 1352 : cluster [DBG] pgmap v843: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:06:49.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:06:48 smithi132 bash[27079]: cluster 2020-07-16T14:06:47.871224+0000 mgr.x (mgr.34562) 1353 : cluster [DBG] pgmap v844: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:06:49.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:06:48 smithi188 bash[23329]: cluster 2020-07-16T14:06:47.871224+0000 mgr.x (mgr.34562) 1353 : cluster [DBG] pgmap v844: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:06:50.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:06:49 smithi132 bash[27079]: audit 2020-07-16T14:06:49.240399+0000 mon.b (mon.2) 415 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:06:50.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:06:49 smithi188 bash[23329]: audit 2020-07-16T14:06:49.240399+0000 mon.b (mon.2) 415 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:06:51.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:06:50 smithi132 bash[27079]: cephadm 2020-07-16T14:06:49.241115+0000 mgr.x (mgr.34562) 1354 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:06:51.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:06:50 smithi132 bash[27079]: cephadm 2020-07-16T14:06:49.241564+0000 mgr.x (mgr.34562) 1355 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:06:51.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:06:50 smithi132 bash[27079]: cluster 2020-07-16T14:06:49.871694+0000 mgr.x (mgr.34562) 1356 : cluster [DBG] pgmap v845: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:06:51.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:06:50 smithi188 bash[23329]: cephadm 2020-07-16T14:06:49.241115+0000 mgr.x (mgr.34562) 1354 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:06:51.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:06:50 smithi188 bash[23329]: cephadm 2020-07-16T14:06:49.241564+0000 mgr.x (mgr.34562) 1355 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:06:51.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:06:50 smithi188 bash[23329]: cluster 2020-07-16T14:06:49.871694+0000 mgr.x (mgr.34562) 1356 : cluster [DBG] pgmap v845: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:06:53.286 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:06:52 smithi132 bash[27079]: cluster 2020-07-16T14:06:51.872223+0000 mgr.x (mgr.34562) 1357 : cluster [DBG] pgmap v846: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:06:53.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:06:52 smithi188 bash[23329]: cluster 2020-07-16T14:06:51.872223+0000 mgr.x (mgr.34562) 1357 : cluster [DBG] pgmap v846: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:06:55.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:06:54 smithi132 bash[27079]: cluster 2020-07-16T14:06:53.872578+0000 mgr.x (mgr.34562) 1358 : cluster [DBG] pgmap v847: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:06:55.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:06:54 smithi188 bash[23329]: cluster 2020-07-16T14:06:53.872578+0000 mgr.x (mgr.34562) 1358 : cluster [DBG] pgmap v847: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:06:57.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:06:56 smithi132 bash[27079]: cluster 2020-07-16T14:06:55.872933+0000 mgr.x (mgr.34562) 1359 : cluster [DBG] pgmap v848: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:06:57.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:06:56 smithi188 bash[23329]: cluster 2020-07-16T14:06:55.872933+0000 mgr.x (mgr.34562) 1359 : cluster [DBG] pgmap v848: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:06:59.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:06:58 smithi132 bash[27079]: cluster 2020-07-16T14:06:57.873319+0000 mgr.x (mgr.34562) 1360 : cluster [DBG] pgmap v849: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:06:59.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:06:58 smithi188 bash[23329]: cluster 2020-07-16T14:06:57.873319+0000 mgr.x (mgr.34562) 1360 : cluster [DBG] pgmap v849: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:07:00.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:07:00 smithi188 bash[23329]: cluster 2020-07-16T14:06:59.873685+0000 mgr.x (mgr.34562) 1361 : cluster [DBG] pgmap v850: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:07:00.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:07:00 smithi132 bash[27079]: cluster 2020-07-16T14:06:59.873685+0000 mgr.x (mgr.34562) 1361 : cluster [DBG] pgmap v850: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:07:03.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:07:02 smithi132 bash[27079]: cluster 2020-07-16T14:07:01.874045+0000 mgr.x (mgr.34562) 1362 : cluster [DBG] pgmap v851: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:07:03.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:07:02 smithi188 bash[23329]: cluster 2020-07-16T14:07:01.874045+0000 mgr.x (mgr.34562) 1362 : cluster [DBG] pgmap v851: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:07:03.958 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:07:04.219 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:07:04.220 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (29m) 7m ago 32m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:07:04.220 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (32m) 7m ago 32m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:07:04.220 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (30m) 7m ago 35m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:07:04.221 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (29m) 7m ago 37m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:07:04.221 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 7m ago 37m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:07:04.221 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (35m) 7m ago 35m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:07:04.221 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (36m) 7m ago 36m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:07:04.222 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (33m) 7m ago 33m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:07:04.222 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (33m) 7m ago 33m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:07:04.222 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (35m) 7m ago 35m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:07:04.222 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (35m) 7m ago 35m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:07:04.223 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (34m) 7m ago 34m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:07:04.223 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (34m) 7m ago 34m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:07:04.223 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (34m) 7m ago 34m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:07:04.223 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (34m) 7m ago 34m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:07:04.223 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (33m) 7m ago 33m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:07:04.224 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (33m) 7m ago 33m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:07:04.224 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (32m) 7m ago 33m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:07:04.522 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:07:04.523 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:07:04.523 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:07:04.524 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:07:04.524 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:07:04.524 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:07:04.524 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:07:04.524 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:07:04.525 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:07:04.525 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:07:04.525 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:07:04.525 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:07:04.525 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:07:04.526 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:07:04.526 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:07:04.526 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:07:04.526 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:07:05.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:07:04 smithi132 bash[27079]: cluster 2020-07-16T14:07:03.874389+0000 mgr.x (mgr.34562) 1363 : cluster [DBG] pgmap v852: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:07:05.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:07:04 smithi132 bash[27079]: audit 2020-07-16T14:07:03.946786+0000 mgr.x (mgr.34562) 1364 : audit [DBG] from='client.25630 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:07:05.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:07:04 smithi132 bash[27079]: audit 2020-07-16T14:07:04.257167+0000 mon.b (mon.2) 416 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:07:05.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:07:04 smithi132 bash[27079]: audit 2020-07-16T14:07:04.521489+0000 mon.c (mon.1) 142 : audit [DBG] from='client.? 172.21.15.132:0/3488923231' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:07:05.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:07:04 smithi188 bash[23329]: cluster 2020-07-16T14:07:03.874389+0000 mgr.x (mgr.34562) 1363 : cluster [DBG] pgmap v852: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:07:05.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:07:04 smithi188 bash[23329]: audit 2020-07-16T14:07:03.946786+0000 mgr.x (mgr.34562) 1364 : audit [DBG] from='client.25630 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:07:05.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:07:04 smithi188 bash[23329]: audit 2020-07-16T14:07:04.257167+0000 mon.b (mon.2) 416 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:07:05.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:07:04 smithi188 bash[23329]: audit 2020-07-16T14:07:04.521489+0000 mon.c (mon.1) 142 : audit [DBG] from='client.? 172.21.15.132:0/3488923231' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:07:06.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:07:05 smithi132 bash[27079]: audit 2020-07-16T14:07:04.215232+0000 mgr.x (mgr.34562) 1365 : audit [DBG] from='client.25636 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:07:06.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:07:05 smithi132 bash[27079]: cephadm 2020-07-16T14:07:04.257848+0000 mgr.x (mgr.34562) 1366 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:07:06.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:07:05 smithi132 bash[27079]: cephadm 2020-07-16T14:07:04.258052+0000 mgr.x (mgr.34562) 1367 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:07:06.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:07:05 smithi188 bash[23329]: audit 2020-07-16T14:07:04.215232+0000 mgr.x (mgr.34562) 1365 : audit [DBG] from='client.25636 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:07:06.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:07:05 smithi188 bash[23329]: cephadm 2020-07-16T14:07:04.257848+0000 mgr.x (mgr.34562) 1366 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:07:06.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:07:05 smithi188 bash[23329]: cephadm 2020-07-16T14:07:04.258052+0000 mgr.x (mgr.34562) 1367 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:07:07.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:07:06 smithi132 bash[27079]: cluster 2020-07-16T14:07:05.874862+0000 mgr.x (mgr.34562) 1368 : cluster [DBG] pgmap v853: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:07:07.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:07:06 smithi188 bash[23329]: cluster 2020-07-16T14:07:05.874862+0000 mgr.x (mgr.34562) 1368 : cluster [DBG] pgmap v853: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:07:09.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:07:08 smithi132 bash[27079]: cluster 2020-07-16T14:07:07.875266+0000 mgr.x (mgr.34562) 1369 : cluster [DBG] pgmap v854: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:07:09.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:07:08 smithi188 bash[23329]: cluster 2020-07-16T14:07:07.875266+0000 mgr.x (mgr.34562) 1369 : cluster [DBG] pgmap v854: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:07:10.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:07:10 smithi188 bash[23329]: cluster 2020-07-16T14:07:09.875750+0000 mgr.x (mgr.34562) 1370 : cluster [DBG] pgmap v855: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:07:10.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:07:10 smithi132 bash[27079]: cluster 2020-07-16T14:07:09.875750+0000 mgr.x (mgr.34562) 1370 : cluster [DBG] pgmap v855: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:07:13.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:07:12 smithi132 bash[27079]: cluster 2020-07-16T14:07:11.876163+0000 mgr.x (mgr.34562) 1371 : cluster [DBG] pgmap v856: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:07:13.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:07:12 smithi188 bash[23329]: cluster 2020-07-16T14:07:11.876163+0000 mgr.x (mgr.34562) 1371 : cluster [DBG] pgmap v856: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:07:15.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:07:14 smithi132 bash[27079]: cluster 2020-07-16T14:07:13.876597+0000 mgr.x (mgr.34562) 1372 : cluster [DBG] pgmap v857: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:07:15.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:07:14 smithi188 bash[23329]: cluster 2020-07-16T14:07:13.876597+0000 mgr.x (mgr.34562) 1372 : cluster [DBG] pgmap v857: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:07:17.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:07:16 smithi132 bash[27079]: cluster 2020-07-16T14:07:15.876935+0000 mgr.x (mgr.34562) 1373 : cluster [DBG] pgmap v858: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:07:17.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:07:16 smithi188 bash[23329]: cluster 2020-07-16T14:07:15.876935+0000 mgr.x (mgr.34562) 1373 : cluster [DBG] pgmap v858: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:07:19.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:07:18 smithi132 bash[27079]: cluster 2020-07-16T14:07:17.877462+0000 mgr.x (mgr.34562) 1374 : cluster [DBG] pgmap v859: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:07:19.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:07:18 smithi188 bash[23329]: cluster 2020-07-16T14:07:17.877462+0000 mgr.x (mgr.34562) 1374 : cluster [DBG] pgmap v859: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:07:20.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:07:19 smithi132 bash[27079]: audit 2020-07-16T14:07:19.276265+0000 mon.b (mon.2) 417 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:07:20.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:07:19 smithi132 bash[27079]: audit 2020-07-16T14:07:19.277643+0000 mon.b (mon.2) 418 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:07:20.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:07:19 smithi132 bash[27079]: audit 2020-07-16T14:07:19.278879+0000 mon.b (mon.2) 419 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:07:20.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:07:19 smithi132 bash[27079]: audit 2020-07-16T14:07:19.280310+0000 mon.b (mon.2) 420 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:07:20.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:07:19 smithi132 bash[27079]: audit 2020-07-16T14:07:19.281777+0000 mon.b (mon.2) 421 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:07:20.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:07:19 smithi188 bash[23329]: audit 2020-07-16T14:07:19.276265+0000 mon.b (mon.2) 417 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:07:20.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:07:19 smithi188 bash[23329]: audit 2020-07-16T14:07:19.277643+0000 mon.b (mon.2) 418 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:07:20.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:07:19 smithi188 bash[23329]: audit 2020-07-16T14:07:19.278879+0000 mon.b (mon.2) 419 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:07:20.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:07:19 smithi188 bash[23329]: audit 2020-07-16T14:07:19.280310+0000 mon.b (mon.2) 420 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:07:20.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:07:19 smithi188 bash[23329]: audit 2020-07-16T14:07:19.281777+0000 mon.b (mon.2) 421 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:07:21.207 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:07:20 smithi132 bash[27079]: audit 2020-07-16T14:07:19.276655+0000 mgr.x (mgr.34562) 1375 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:07:21.207 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:07:20 smithi132 bash[27079]: audit 2020-07-16T14:07:19.278038+0000 mgr.x (mgr.34562) 1376 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:07:21.207 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:07:20 smithi132 bash[27079]: audit 2020-07-16T14:07:19.279139+0000 mgr.x (mgr.34562) 1377 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:07:21.207 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:07:20 smithi132 bash[27079]: cephadm 2020-07-16T14:07:19.279890+0000 mgr.x (mgr.34562) 1378 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:07:21.208 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:07:20 smithi132 bash[27079]: cephadm 2020-07-16T14:07:19.281169+0000 mgr.x (mgr.34562) 1379 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:07:21.208 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:07:20 smithi132 bash[27079]: cephadm 2020-07-16T14:07:19.282521+0000 mgr.x (mgr.34562) 1380 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:07:21.208 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:07:20 smithi132 bash[27079]: cephadm 2020-07-16T14:07:19.282713+0000 mgr.x (mgr.34562) 1381 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:07:21.208 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:07:20 smithi132 bash[27079]: cluster 2020-07-16T14:07:19.877873+0000 mgr.x (mgr.34562) 1382 : cluster [DBG] pgmap v860: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:07:21.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:07:20 smithi188 bash[23329]: audit 2020-07-16T14:07:19.276655+0000 mgr.x (mgr.34562) 1375 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:07:21.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:07:20 smithi188 bash[23329]: audit 2020-07-16T14:07:19.278038+0000 mgr.x (mgr.34562) 1376 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:07:21.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:07:20 smithi188 bash[23329]: audit 2020-07-16T14:07:19.279139+0000 mgr.x (mgr.34562) 1377 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:07:21.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:07:20 smithi188 bash[23329]: cephadm 2020-07-16T14:07:19.279890+0000 mgr.x (mgr.34562) 1378 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:07:21.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:07:20 smithi188 bash[23329]: cephadm 2020-07-16T14:07:19.281169+0000 mgr.x (mgr.34562) 1379 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:07:21.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:07:20 smithi188 bash[23329]: cephadm 2020-07-16T14:07:19.282521+0000 mgr.x (mgr.34562) 1380 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:07:21.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:07:20 smithi188 bash[23329]: cephadm 2020-07-16T14:07:19.282713+0000 mgr.x (mgr.34562) 1381 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:07:21.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:07:20 smithi188 bash[23329]: cluster 2020-07-16T14:07:19.877873+0000 mgr.x (mgr.34562) 1382 : cluster [DBG] pgmap v860: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:07:23.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:07:22 smithi132 bash[27079]: cluster 2020-07-16T14:07:21.878399+0000 mgr.x (mgr.34562) 1383 : cluster [DBG] pgmap v861: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:07:23.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:07:22 smithi132 bash[27079]: audit 2020-07-16T14:07:21.954780+0000 mon.b (mon.2) 422 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:07:23.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:07:22 smithi132 bash[27079]: cephadm 2020-07-16T14:07:21.955387+0000 mgr.x (mgr.34562) 1384 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:07:23.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:07:22 smithi132 bash[27079]: cephadm 2020-07-16T14:07:21.955809+0000 mgr.x (mgr.34562) 1385 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:07:23.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:07:22 smithi188 bash[23329]: cluster 2020-07-16T14:07:21.878399+0000 mgr.x (mgr.34562) 1383 : cluster [DBG] pgmap v861: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:07:23.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:07:22 smithi188 bash[23329]: audit 2020-07-16T14:07:21.954780+0000 mon.b (mon.2) 422 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:07:23.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:07:22 smithi188 bash[23329]: cephadm 2020-07-16T14:07:21.955387+0000 mgr.x (mgr.34562) 1384 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:07:23.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:07:22 smithi188 bash[23329]: cephadm 2020-07-16T14:07:21.955809+0000 mgr.x (mgr.34562) 1385 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:07:25.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:07:24 smithi132 bash[27079]: cluster 2020-07-16T14:07:23.878817+0000 mgr.x (mgr.34562) 1386 : cluster [DBG] pgmap v862: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:07:25.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:07:24 smithi188 bash[23329]: cluster 2020-07-16T14:07:23.878817+0000 mgr.x (mgr.34562) 1386 : cluster [DBG] pgmap v862: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:07:27.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:07:26 smithi132 bash[27079]: cluster 2020-07-16T14:07:25.879223+0000 mgr.x (mgr.34562) 1387 : cluster [DBG] pgmap v863: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:07:27.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:07:26 smithi188 bash[23329]: cluster 2020-07-16T14:07:25.879223+0000 mgr.x (mgr.34562) 1387 : cluster [DBG] pgmap v863: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:07:29.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:07:28 smithi132 bash[27079]: cluster 2020-07-16T14:07:27.879677+0000 mgr.x (mgr.34562) 1388 : cluster [DBG] pgmap v864: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:07:29.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:07:28 smithi188 bash[23329]: cluster 2020-07-16T14:07:27.879677+0000 mgr.x (mgr.34562) 1388 : cluster [DBG] pgmap v864: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:07:30.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:07:30 smithi188 bash[23329]: cluster 2020-07-16T14:07:29.880213+0000 mgr.x (mgr.34562) 1389 : cluster [DBG] pgmap v865: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:07:30.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:07:30 smithi132 bash[27079]: cluster 2020-07-16T14:07:29.880213+0000 mgr.x (mgr.34562) 1389 : cluster [DBG] pgmap v865: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:07:33.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:07:32 smithi132 bash[27079]: cluster 2020-07-16T14:07:31.880633+0000 mgr.x (mgr.34562) 1390 : cluster [DBG] pgmap v866: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:07:33.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:07:32 smithi188 bash[23329]: cluster 2020-07-16T14:07:31.880633+0000 mgr.x (mgr.34562) 1390 : cluster [DBG] pgmap v866: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:07:34.839 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:07:35.098 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:07:35.099 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (30m) 7m ago 33m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:07:35.099 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (33m) 7m ago 33m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:07:35.099 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (30m) 7m ago 36m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:07:35.099 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (30m) 7m ago 37m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:07:35.099 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 7m ago 38m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:07:35.100 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (36m) 7m ago 36m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:07:35.100 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (36m) 7m ago 36m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:07:35.100 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (33m) 7m ago 33m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:07:35.100 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (33m) 7m ago 33m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:07:35.100 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (35m) 7m ago 35m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:07:35.101 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (35m) 7m ago 35m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:07:35.101 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (35m) 7m ago 35m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:07:35.101 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (35m) 7m ago 35m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:07:35.101 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (34m) 7m ago 34m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:07:35.101 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (34m) 7m ago 34m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:07:35.102 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (34m) 7m ago 34m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:07:35.102 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (33m) 7m ago 33m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:07:35.102 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (32m) 7m ago 33m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:07:35.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:07:34 smithi132 bash[27079]: cluster 2020-07-16T14:07:33.880972+0000 mgr.x (mgr.34562) 1391 : cluster [DBG] pgmap v867: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:07:35.400 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:07:35.400 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:07:35.400 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:07:35.400 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:07:35.401 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:07:35.401 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:07:35.401 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:07:35.401 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:07:35.401 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:07:35.402 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:07:35.402 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:07:35.402 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:07:35.402 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:07:35.402 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:07:35.402 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:07:35.403 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:07:35.403 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:07:35.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:07:34 smithi188 bash[23329]: cluster 2020-07-16T14:07:33.880972+0000 mgr.x (mgr.34562) 1391 : cluster [DBG] pgmap v867: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:07:36.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:07:35 smithi132 bash[27079]: audit 2020-07-16T14:07:34.826676+0000 mgr.x (mgr.34562) 1392 : audit [DBG] from='client.25648 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:07:36.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:07:35 smithi132 bash[27079]: audit 2020-07-16T14:07:35.094101+0000 mgr.x (mgr.34562) 1393 : audit [DBG] from='client.25654 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:07:36.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:07:35 smithi132 bash[27079]: audit 2020-07-16T14:07:35.398787+0000 mon.c (mon.1) 143 : audit [DBG] from='client.? 172.21.15.132:0/1864067131' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:07:36.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:07:35 smithi188 bash[23329]: audit 2020-07-16T14:07:34.826676+0000 mgr.x (mgr.34562) 1392 : audit [DBG] from='client.25648 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:07:36.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:07:35 smithi188 bash[23329]: audit 2020-07-16T14:07:35.094101+0000 mgr.x (mgr.34562) 1393 : audit [DBG] from='client.25654 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:07:36.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:07:35 smithi188 bash[23329]: audit 2020-07-16T14:07:35.398787+0000 mon.c (mon.1) 143 : audit [DBG] from='client.? 172.21.15.132:0/1864067131' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:07:37.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:07:36 smithi132 bash[27079]: cluster 2020-07-16T14:07:35.881420+0000 mgr.x (mgr.34562) 1394 : cluster [DBG] pgmap v868: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:07:37.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:07:36 smithi188 bash[23329]: cluster 2020-07-16T14:07:35.881420+0000 mgr.x (mgr.34562) 1394 : cluster [DBG] pgmap v868: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:07:38.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:07:37 smithi132 bash[27079]: audit 2020-07-16T14:07:36.971318+0000 mon.b (mon.2) 423 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:07:38.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:07:37 smithi132 bash[27079]: cephadm 2020-07-16T14:07:36.972029+0000 mgr.x (mgr.34562) 1395 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:07:38.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:07:37 smithi132 bash[27079]: cephadm 2020-07-16T14:07:36.972189+0000 mgr.x (mgr.34562) 1396 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:07:38.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:07:37 smithi188 bash[23329]: audit 2020-07-16T14:07:36.971318+0000 mon.b (mon.2) 423 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:07:38.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:07:37 smithi188 bash[23329]: cephadm 2020-07-16T14:07:36.972029+0000 mgr.x (mgr.34562) 1395 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:07:38.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:07:37 smithi188 bash[23329]: cephadm 2020-07-16T14:07:36.972189+0000 mgr.x (mgr.34562) 1396 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:07:39.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:07:38 smithi132 bash[27079]: cluster 2020-07-16T14:07:37.881739+0000 mgr.x (mgr.34562) 1397 : cluster [DBG] pgmap v869: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:07:39.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:07:38 smithi188 bash[23329]: cluster 2020-07-16T14:07:37.881739+0000 mgr.x (mgr.34562) 1397 : cluster [DBG] pgmap v869: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:07:40.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:07:40 smithi188 bash[23329]: cluster 2020-07-16T14:07:39.882127+0000 mgr.x (mgr.34562) 1398 : cluster [DBG] pgmap v870: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:07:40.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:07:40 smithi132 bash[27079]: cluster 2020-07-16T14:07:39.882127+0000 mgr.x (mgr.34562) 1398 : cluster [DBG] pgmap v870: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:07:43.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:07:42 smithi132 bash[27079]: cluster 2020-07-16T14:07:41.882580+0000 mgr.x (mgr.34562) 1399 : cluster [DBG] pgmap v871: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:07:43.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:07:42 smithi188 bash[23329]: cluster 2020-07-16T14:07:41.882580+0000 mgr.x (mgr.34562) 1399 : cluster [DBG] pgmap v871: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:07:45.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:07:44 smithi132 bash[27079]: cluster 2020-07-16T14:07:43.883056+0000 mgr.x (mgr.34562) 1400 : cluster [DBG] pgmap v872: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:07:45.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:07:44 smithi188 bash[23329]: cluster 2020-07-16T14:07:43.883056+0000 mgr.x (mgr.34562) 1400 : cluster [DBG] pgmap v872: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:07:47.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:07:46 smithi132 bash[27079]: cluster 2020-07-16T14:07:45.883373+0000 mgr.x (mgr.34562) 1401 : cluster [DBG] pgmap v873: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:07:47.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:07:46 smithi188 bash[23329]: cluster 2020-07-16T14:07:45.883373+0000 mgr.x (mgr.34562) 1401 : cluster [DBG] pgmap v873: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:07:49.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:07:48 smithi132 bash[27079]: cluster 2020-07-16T14:07:47.883745+0000 mgr.x (mgr.34562) 1402 : cluster [DBG] pgmap v874: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:07:49.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:07:48 smithi188 bash[23329]: cluster 2020-07-16T14:07:47.883745+0000 mgr.x (mgr.34562) 1402 : cluster [DBG] pgmap v874: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:07:50.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:07:50 smithi188 bash[23329]: cluster 2020-07-16T14:07:49.884107+0000 mgr.x (mgr.34562) 1403 : cluster [DBG] pgmap v875: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:07:50.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:07:50 smithi132 bash[27079]: cluster 2020-07-16T14:07:49.884107+0000 mgr.x (mgr.34562) 1403 : cluster [DBG] pgmap v875: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:07:53.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:07:52 smithi132 bash[27079]: cluster 2020-07-16T14:07:51.884643+0000 mgr.x (mgr.34562) 1404 : cluster [DBG] pgmap v876: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:07:53.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:07:52 smithi132 bash[27079]: audit 2020-07-16T14:07:51.975579+0000 mon.b (mon.2) 424 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:07:53.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:07:52 smithi132 bash[27079]: cephadm 2020-07-16T14:07:51.976301+0000 mgr.x (mgr.34562) 1405 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:07:53.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:07:52 smithi132 bash[27079]: cephadm 2020-07-16T14:07:51.976801+0000 mgr.x (mgr.34562) 1406 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:07:53.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:07:52 smithi188 bash[23329]: cluster 2020-07-16T14:07:51.884643+0000 mgr.x (mgr.34562) 1404 : cluster [DBG] pgmap v876: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:07:53.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:07:52 smithi188 bash[23329]: audit 2020-07-16T14:07:51.975579+0000 mon.b (mon.2) 424 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:07:53.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:07:52 smithi188 bash[23329]: cephadm 2020-07-16T14:07:51.976301+0000 mgr.x (mgr.34562) 1405 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:07:53.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:07:52 smithi188 bash[23329]: cephadm 2020-07-16T14:07:51.976801+0000 mgr.x (mgr.34562) 1406 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:07:55.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:07:54 smithi132 bash[27079]: cluster 2020-07-16T14:07:53.885190+0000 mgr.x (mgr.34562) 1407 : cluster [DBG] pgmap v877: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:07:55.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:07:54 smithi188 bash[23329]: cluster 2020-07-16T14:07:53.885190+0000 mgr.x (mgr.34562) 1407 : cluster [DBG] pgmap v877: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:07:57.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:07:56 smithi132 bash[27079]: cluster 2020-07-16T14:07:55.885584+0000 mgr.x (mgr.34562) 1408 : cluster [DBG] pgmap v878: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:07:57.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:07:56 smithi188 bash[23329]: cluster 2020-07-16T14:07:55.885584+0000 mgr.x (mgr.34562) 1408 : cluster [DBG] pgmap v878: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:07:59.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:07:58 smithi132 bash[27079]: cluster 2020-07-16T14:07:57.885999+0000 mgr.x (mgr.34562) 1409 : cluster [DBG] pgmap v879: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:07:59.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:07:58 smithi188 bash[23329]: cluster 2020-07-16T14:07:57.885999+0000 mgr.x (mgr.34562) 1409 : cluster [DBG] pgmap v879: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:08:00.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:08:00 smithi188 bash[23329]: cluster 2020-07-16T14:07:59.886510+0000 mgr.x (mgr.34562) 1410 : cluster [DBG] pgmap v880: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:08:00.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:08:00 smithi132 bash[27079]: cluster 2020-07-16T14:07:59.886510+0000 mgr.x (mgr.34562) 1410 : cluster [DBG] pgmap v880: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:08:03.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:08:02 smithi132 bash[27079]: cluster 2020-07-16T14:08:01.887035+0000 mgr.x (mgr.34562) 1411 : cluster [DBG] pgmap v881: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:08:03.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:08:02 smithi188 bash[23329]: cluster 2020-07-16T14:08:01.887035+0000 mgr.x (mgr.34562) 1411 : cluster [DBG] pgmap v881: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:08:05.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:08:04 smithi132 bash[27079]: cluster 2020-07-16T14:08:03.887488+0000 mgr.x (mgr.34562) 1412 : cluster [DBG] pgmap v882: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:08:05.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:08:04 smithi188 bash[23329]: cluster 2020-07-16T14:08:03.887488+0000 mgr.x (mgr.34562) 1412 : cluster [DBG] pgmap v882: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:08:05.697 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:08:05.960 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:08:05.961 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (30m) 8m ago 33m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:08:05.961 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (33m) 8m ago 33m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:08:05.961 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (31m) 8m ago 36m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:08:05.961 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (30m) 8m ago 38m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:08:05.961 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 8m ago 38m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:08:05.962 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (36m) 8m ago 36m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:08:05.962 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (37m) 8m ago 37m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:08:05.962 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (34m) 8m ago 34m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:08:05.962 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (34m) 8m ago 34m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:08:05.963 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (36m) 8m ago 36m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:08:05.963 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (36m) 8m ago 36m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:08:05.963 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (35m) 8m ago 35m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:08:05.963 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (35m) 8m ago 35m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:08:05.963 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (35m) 8m ago 35m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:08:05.963 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (35m) 8m ago 35m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:08:05.964 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (34m) 8m ago 34m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:08:05.964 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (34m) 8m ago 34m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:08:05.964 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (33m) 8m ago 34m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:08:06.260 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:08:06.260 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:08:06.260 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:08:06.261 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:08:06.261 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:08:06.261 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:08:06.261 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:08:06.261 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:08:06.262 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:08:06.262 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:08:06.262 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:08:06.262 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:08:06.262 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:08:06.263 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:08:06.263 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:08:06.263 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:08:06.263 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:08:07.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:08:06 smithi132 bash[27079]: audit 2020-07-16T14:08:05.686026+0000 mgr.x (mgr.34562) 1413 : audit [DBG] from='client.25666 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:08:07.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:08:06 smithi132 bash[27079]: cluster 2020-07-16T14:08:05.887764+0000 mgr.x (mgr.34562) 1414 : cluster [DBG] pgmap v883: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:08:07.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:08:06 smithi132 bash[27079]: audit 2020-07-16T14:08:05.955909+0000 mgr.x (mgr.34562) 1415 : audit [DBG] from='client.25672 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:08:07.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:08:06 smithi132 bash[27079]: audit 2020-07-16T14:08:06.259174+0000 mon.c (mon.1) 144 : audit [DBG] from='client.? 172.21.15.132:0/1927887098' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:08:07.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:08:06 smithi188 bash[23329]: audit 2020-07-16T14:08:05.686026+0000 mgr.x (mgr.34562) 1413 : audit [DBG] from='client.25666 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:08:07.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:08:06 smithi188 bash[23329]: cluster 2020-07-16T14:08:05.887764+0000 mgr.x (mgr.34562) 1414 : cluster [DBG] pgmap v883: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:08:07.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:08:06 smithi188 bash[23329]: audit 2020-07-16T14:08:05.955909+0000 mgr.x (mgr.34562) 1415 : audit [DBG] from='client.25672 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:08:07.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:08:06 smithi188 bash[23329]: audit 2020-07-16T14:08:06.259174+0000 mon.c (mon.1) 144 : audit [DBG] from='client.? 172.21.15.132:0/1927887098' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:08:08.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:08:07 smithi132 bash[27079]: audit 2020-07-16T14:08:06.990778+0000 mon.b (mon.2) 425 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:08:08.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:08:07 smithi132 bash[27079]: cephadm 2020-07-16T14:08:06.991497+0000 mgr.x (mgr.34562) 1416 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:08:08.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:08:07 smithi132 bash[27079]: cephadm 2020-07-16T14:08:06.991942+0000 mgr.x (mgr.34562) 1417 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:08:08.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:08:07 smithi188 bash[23329]: audit 2020-07-16T14:08:06.990778+0000 mon.b (mon.2) 425 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:08:08.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:08:07 smithi188 bash[23329]: cephadm 2020-07-16T14:08:06.991497+0000 mgr.x (mgr.34562) 1416 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:08:08.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:08:07 smithi188 bash[23329]: cephadm 2020-07-16T14:08:06.991942+0000 mgr.x (mgr.34562) 1417 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:08:09.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:08:08 smithi132 bash[27079]: cluster 2020-07-16T14:08:07.888163+0000 mgr.x (mgr.34562) 1418 : cluster [DBG] pgmap v884: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:08:09.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:08:08 smithi188 bash[23329]: cluster 2020-07-16T14:08:07.888163+0000 mgr.x (mgr.34562) 1418 : cluster [DBG] pgmap v884: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:08:10.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:08:10 smithi188 bash[23329]: cluster 2020-07-16T14:08:09.888675+0000 mgr.x (mgr.34562) 1419 : cluster [DBG] pgmap v885: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:08:10.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:08:10 smithi132 bash[27079]: cluster 2020-07-16T14:08:09.888675+0000 mgr.x (mgr.34562) 1419 : cluster [DBG] pgmap v885: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:08:13.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:08:12 smithi132 bash[27079]: cluster 2020-07-16T14:08:11.889036+0000 mgr.x (mgr.34562) 1420 : cluster [DBG] pgmap v886: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:08:13.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:08:12 smithi188 bash[23329]: cluster 2020-07-16T14:08:11.889036+0000 mgr.x (mgr.34562) 1420 : cluster [DBG] pgmap v886: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:08:15.286 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:08:14 smithi132 bash[27079]: cluster 2020-07-16T14:08:13.889467+0000 mgr.x (mgr.34562) 1421 : cluster [DBG] pgmap v887: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:08:15.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:08:14 smithi188 bash[23329]: cluster 2020-07-16T14:08:13.889467+0000 mgr.x (mgr.34562) 1421 : cluster [DBG] pgmap v887: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:08:17.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:08:16 smithi132 bash[27079]: cluster 2020-07-16T14:08:15.889917+0000 mgr.x (mgr.34562) 1422 : cluster [DBG] pgmap v888: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:08:17.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:08:16 smithi188 bash[23329]: cluster 2020-07-16T14:08:15.889917+0000 mgr.x (mgr.34562) 1422 : cluster [DBG] pgmap v888: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:08:19.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:08:18 smithi132 bash[27079]: cluster 2020-07-16T14:08:17.890318+0000 mgr.x (mgr.34562) 1423 : cluster [DBG] pgmap v889: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:08:19.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:08:18 smithi188 bash[23329]: cluster 2020-07-16T14:08:17.890318+0000 mgr.x (mgr.34562) 1423 : cluster [DBG] pgmap v889: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:08:20.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:08:20 smithi188 bash[23329]: cluster 2020-07-16T14:08:19.890639+0000 mgr.x (mgr.34562) 1424 : cluster [DBG] pgmap v890: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:08:20.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:08:20 smithi132 bash[27079]: cluster 2020-07-16T14:08:19.890639+0000 mgr.x (mgr.34562) 1424 : cluster [DBG] pgmap v890: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:08:23.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:08:22 smithi132 bash[27079]: cluster 2020-07-16T14:08:21.891030+0000 mgr.x (mgr.34562) 1425 : cluster [DBG] pgmap v891: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:08:23.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:08:22 smithi132 bash[27079]: audit 2020-07-16T14:08:22.009964+0000 mon.b (mon.2) 426 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:08:23.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:08:22 smithi132 bash[27079]: audit 2020-07-16T14:08:22.010372+0000 mgr.x (mgr.34562) 1426 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:08:23.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:08:22 smithi132 bash[27079]: audit 2020-07-16T14:08:22.011374+0000 mon.b (mon.2) 427 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:08:23.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:08:22 smithi132 bash[27079]: audit 2020-07-16T14:08:22.011684+0000 mgr.x (mgr.34562) 1427 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:08:23.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:08:22 smithi132 bash[27079]: audit 2020-07-16T14:08:22.012590+0000 mon.b (mon.2) 428 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:08:23.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:08:22 smithi132 bash[27079]: audit 2020-07-16T14:08:22.012885+0000 mgr.x (mgr.34562) 1428 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:08:23.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:08:22 smithi132 bash[27079]: cephadm 2020-07-16T14:08:22.013627+0000 mgr.x (mgr.34562) 1429 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:08:23.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:08:22 smithi132 bash[27079]: audit 2020-07-16T14:08:22.014000+0000 mon.b (mon.2) 429 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:08:23.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:08:22 smithi132 bash[27079]: cephadm 2020-07-16T14:08:22.014891+0000 mgr.x (mgr.34562) 1430 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:08:23.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:08:22 smithi132 bash[27079]: audit 2020-07-16T14:08:22.015378+0000 mon.b (mon.2) 430 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:08:23.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:08:22 smithi132 bash[27079]: cephadm 2020-07-16T14:08:22.016076+0000 mgr.x (mgr.34562) 1431 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:08:23.284 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:08:22 smithi132 bash[27079]: cephadm 2020-07-16T14:08:22.016148+0000 mgr.x (mgr.34562) 1432 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:08:23.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:08:22 smithi188 bash[23329]: cluster 2020-07-16T14:08:21.891030+0000 mgr.x (mgr.34562) 1425 : cluster [DBG] pgmap v891: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:08:23.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:08:22 smithi188 bash[23329]: audit 2020-07-16T14:08:22.009964+0000 mon.b (mon.2) 426 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:08:23.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:08:22 smithi188 bash[23329]: audit 2020-07-16T14:08:22.010372+0000 mgr.x (mgr.34562) 1426 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:08:23.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:08:22 smithi188 bash[23329]: audit 2020-07-16T14:08:22.011374+0000 mon.b (mon.2) 427 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:08:23.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:08:22 smithi188 bash[23329]: audit 2020-07-16T14:08:22.011684+0000 mgr.x (mgr.34562) 1427 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:08:23.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:08:22 smithi188 bash[23329]: audit 2020-07-16T14:08:22.012590+0000 mon.b (mon.2) 428 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:08:23.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:08:22 smithi188 bash[23329]: audit 2020-07-16T14:08:22.012885+0000 mgr.x (mgr.34562) 1428 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:08:23.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:08:22 smithi188 bash[23329]: cephadm 2020-07-16T14:08:22.013627+0000 mgr.x (mgr.34562) 1429 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:08:23.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:08:22 smithi188 bash[23329]: audit 2020-07-16T14:08:22.014000+0000 mon.b (mon.2) 429 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:08:23.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:08:22 smithi188 bash[23329]: cephadm 2020-07-16T14:08:22.014891+0000 mgr.x (mgr.34562) 1430 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:08:23.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:08:22 smithi188 bash[23329]: audit 2020-07-16T14:08:22.015378+0000 mon.b (mon.2) 430 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:08:23.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:08:22 smithi188 bash[23329]: cephadm 2020-07-16T14:08:22.016076+0000 mgr.x (mgr.34562) 1431 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:08:23.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:08:22 smithi188 bash[23329]: cephadm 2020-07-16T14:08:22.016148+0000 mgr.x (mgr.34562) 1432 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:08:25.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:08:24 smithi132 bash[27079]: cluster 2020-07-16T14:08:23.891396+0000 mgr.x (mgr.34562) 1433 : cluster [DBG] pgmap v892: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:08:25.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:08:24 smithi132 bash[27079]: audit 2020-07-16T14:08:24.816661+0000 mon.b (mon.2) 431 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:08:25.425 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:08:24 smithi188 bash[23329]: cluster 2020-07-16T14:08:23.891396+0000 mgr.x (mgr.34562) 1433 : cluster [DBG] pgmap v892: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:08:25.426 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:08:24 smithi188 bash[23329]: audit 2020-07-16T14:08:24.816661+0000 mon.b (mon.2) 431 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:08:26.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:08:25 smithi132 bash[27079]: cephadm 2020-07-16T14:08:24.817276+0000 mgr.x (mgr.34562) 1434 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:08:26.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:08:25 smithi132 bash[27079]: cephadm 2020-07-16T14:08:24.817685+0000 mgr.x (mgr.34562) 1435 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:08:26.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:08:25 smithi188 bash[23329]: cephadm 2020-07-16T14:08:24.817276+0000 mgr.x (mgr.34562) 1434 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:08:26.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:08:25 smithi188 bash[23329]: cephadm 2020-07-16T14:08:24.817685+0000 mgr.x (mgr.34562) 1435 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:08:27.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:08:26 smithi132 bash[27079]: cluster 2020-07-16T14:08:25.891885+0000 mgr.x (mgr.34562) 1436 : cluster [DBG] pgmap v893: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:08:27.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:08:26 smithi188 bash[23329]: cluster 2020-07-16T14:08:25.891885+0000 mgr.x (mgr.34562) 1436 : cluster [DBG] pgmap v893: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:08:29.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:08:28 smithi132 bash[27079]: cluster 2020-07-16T14:08:27.892337+0000 mgr.x (mgr.34562) 1437 : cluster [DBG] pgmap v894: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:08:29.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:08:28 smithi188 bash[23329]: cluster 2020-07-16T14:08:27.892337+0000 mgr.x (mgr.34562) 1437 : cluster [DBG] pgmap v894: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:08:30.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:08:30 smithi188 bash[23329]: cluster 2020-07-16T14:08:29.892790+0000 mgr.x (mgr.34562) 1438 : cluster [DBG] pgmap v895: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:08:30.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:08:30 smithi132 bash[27079]: cluster 2020-07-16T14:08:29.892790+0000 mgr.x (mgr.34562) 1438 : cluster [DBG] pgmap v895: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:08:33.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:08:32 smithi132 bash[27079]: cluster 2020-07-16T14:08:31.893191+0000 mgr.x (mgr.34562) 1439 : cluster [DBG] pgmap v896: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:08:33.426 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:08:32 smithi188 bash[23329]: cluster 2020-07-16T14:08:31.893191+0000 mgr.x (mgr.34562) 1439 : cluster [DBG] pgmap v896: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:08:35.286 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:08:34 smithi132 bash[27079]: cluster 2020-07-16T14:08:33.893572+0000 mgr.x (mgr.34562) 1440 : cluster [DBG] pgmap v897: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:08:35.426 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:08:34 smithi188 bash[23329]: cluster 2020-07-16T14:08:33.893572+0000 mgr.x (mgr.34562) 1440 : cluster [DBG] pgmap v897: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:08:36.556 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:08:36.816 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:08:36.817 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (31m) 8m ago 34m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:08:36.817 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (34m) 8m ago 34m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:08:36.817 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (31m) 8m ago 37m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:08:36.818 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (31m) 8m ago 38m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:08:36.818 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 8m ago 39m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:08:36.818 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (37m) 8m ago 37m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:08:36.818 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (37m) 8m ago 37m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:08:36.818 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (34m) 8m ago 34m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:08:36.819 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (34m) 8m ago 34m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:08:36.819 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (36m) 8m ago 36m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:08:36.819 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (36m) 8m ago 36m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:08:36.819 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (36m) 8m ago 36m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:08:36.819 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (36m) 8m ago 36m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:08:36.820 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (35m) 8m ago 35m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:08:36.820 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (35m) 8m ago 35m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:08:36.820 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (35m) 8m ago 35m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:08:36.820 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (34m) 8m ago 35m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:08:36.820 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (33m) 8m ago 34m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:08:37.114 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:08:37.115 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:08:37.115 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:08:37.115 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:08:37.115 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:08:37.115 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:08:37.116 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:08:37.116 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:08:37.116 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:08:37.116 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:08:37.116 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:08:37.117 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:08:37.117 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:08:37.117 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:08:37.117 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:08:37.117 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:08:37.118 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:08:37.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:08:36 smithi132 bash[27079]: cluster 2020-07-16T14:08:35.893930+0000 mgr.x (mgr.34562) 1441 : cluster [DBG] pgmap v898: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:08:37.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:08:36 smithi188 bash[23329]: cluster 2020-07-16T14:08:35.893930+0000 mgr.x (mgr.34562) 1441 : cluster [DBG] pgmap v898: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:08:38.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:08:37 smithi132 bash[27079]: audit 2020-07-16T14:08:36.544111+0000 mgr.x (mgr.34562) 1442 : audit [DBG] from='client.25684 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:08:38.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:08:37 smithi132 bash[27079]: audit 2020-07-16T14:08:36.812147+0000 mgr.x (mgr.34562) 1443 : audit [DBG] from='client.25690 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:08:38.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:08:37 smithi132 bash[27079]: audit 2020-07-16T14:08:37.113432+0000 mon.c (mon.1) 145 : audit [DBG] from='client.? 172.21.15.132:0/3155727967' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:08:38.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:08:37 smithi188 bash[23329]: audit 2020-07-16T14:08:36.544111+0000 mgr.x (mgr.34562) 1442 : audit [DBG] from='client.25684 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:08:38.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:08:37 smithi188 bash[23329]: audit 2020-07-16T14:08:36.812147+0000 mgr.x (mgr.34562) 1443 : audit [DBG] from='client.25690 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:08:38.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:08:37 smithi188 bash[23329]: audit 2020-07-16T14:08:37.113432+0000 mon.c (mon.1) 145 : audit [DBG] from='client.? 172.21.15.132:0/3155727967' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:08:39.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:08:38 smithi132 bash[27079]: cluster 2020-07-16T14:08:37.894487+0000 mgr.x (mgr.34562) 1444 : cluster [DBG] pgmap v899: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:08:39.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:08:38 smithi188 bash[23329]: cluster 2020-07-16T14:08:37.894487+0000 mgr.x (mgr.34562) 1444 : cluster [DBG] pgmap v899: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:08:40.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:08:40 smithi188 bash[23329]: audit 2020-07-16T14:08:39.821361+0000 mon.b (mon.2) 432 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:08:40.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:08:40 smithi188 bash[23329]: cephadm 2020-07-16T14:08:39.822073+0000 mgr.x (mgr.34562) 1445 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:08:40.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:08:40 smithi188 bash[23329]: cephadm 2020-07-16T14:08:39.822203+0000 mgr.x (mgr.34562) 1446 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:08:40.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:08:40 smithi188 bash[23329]: cluster 2020-07-16T14:08:39.894826+0000 mgr.x (mgr.34562) 1447 : cluster [DBG] pgmap v900: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:08:40.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:08:40 smithi132 bash[27079]: audit 2020-07-16T14:08:39.821361+0000 mon.b (mon.2) 432 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:08:40.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:08:40 smithi132 bash[27079]: cephadm 2020-07-16T14:08:39.822073+0000 mgr.x (mgr.34562) 1445 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:08:40.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:08:40 smithi132 bash[27079]: cephadm 2020-07-16T14:08:39.822203+0000 mgr.x (mgr.34562) 1446 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:08:40.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:08:40 smithi132 bash[27079]: cluster 2020-07-16T14:08:39.894826+0000 mgr.x (mgr.34562) 1447 : cluster [DBG] pgmap v900: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:08:43.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:08:42 smithi132 bash[27079]: cluster 2020-07-16T14:08:41.895222+0000 mgr.x (mgr.34562) 1448 : cluster [DBG] pgmap v901: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:08:43.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:08:42 smithi188 bash[23329]: cluster 2020-07-16T14:08:41.895222+0000 mgr.x (mgr.34562) 1448 : cluster [DBG] pgmap v901: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:08:45.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:08:44 smithi132 bash[27079]: cluster 2020-07-16T14:08:43.895601+0000 mgr.x (mgr.34562) 1449 : cluster [DBG] pgmap v902: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:08:45.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:08:44 smithi188 bash[23329]: cluster 2020-07-16T14:08:43.895601+0000 mgr.x (mgr.34562) 1449 : cluster [DBG] pgmap v902: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:08:47.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:08:46 smithi132 bash[27079]: cluster 2020-07-16T14:08:45.896011+0000 mgr.x (mgr.34562) 1450 : cluster [DBG] pgmap v903: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:08:47.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:08:46 smithi188 bash[23329]: cluster 2020-07-16T14:08:45.896011+0000 mgr.x (mgr.34562) 1450 : cluster [DBG] pgmap v903: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:08:49.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:08:48 smithi132 bash[27079]: cluster 2020-07-16T14:08:47.896523+0000 mgr.x (mgr.34562) 1451 : cluster [DBG] pgmap v904: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:08:49.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:08:48 smithi188 bash[23329]: cluster 2020-07-16T14:08:47.896523+0000 mgr.x (mgr.34562) 1451 : cluster [DBG] pgmap v904: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:08:50.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:08:50 smithi188 bash[23329]: cluster 2020-07-16T14:08:49.896991+0000 mgr.x (mgr.34562) 1452 : cluster [DBG] pgmap v905: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:08:50.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:08:50 smithi132 bash[27079]: cluster 2020-07-16T14:08:49.896991+0000 mgr.x (mgr.34562) 1452 : cluster [DBG] pgmap v905: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:08:53.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:08:52 smithi132 bash[27079]: cluster 2020-07-16T14:08:51.897360+0000 mgr.x (mgr.34562) 1453 : cluster [DBG] pgmap v906: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:08:53.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:08:52 smithi188 bash[23329]: cluster 2020-07-16T14:08:51.897360+0000 mgr.x (mgr.34562) 1453 : cluster [DBG] pgmap v906: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:08:55.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:08:54 smithi132 bash[27079]: cluster 2020-07-16T14:08:53.897782+0000 mgr.x (mgr.34562) 1454 : cluster [DBG] pgmap v907: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:08:55.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:08:54 smithi132 bash[27079]: audit 2020-07-16T14:08:54.838046+0000 mon.b (mon.2) 433 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:08:55.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:08:54 smithi188 bash[23329]: cluster 2020-07-16T14:08:53.897782+0000 mgr.x (mgr.34562) 1454 : cluster [DBG] pgmap v907: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:08:55.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:08:54 smithi188 bash[23329]: audit 2020-07-16T14:08:54.838046+0000 mon.b (mon.2) 433 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:08:56.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:08:55 smithi132 bash[27079]: cephadm 2020-07-16T14:08:54.838732+0000 mgr.x (mgr.34562) 1455 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:08:56.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:08:55 smithi132 bash[27079]: cephadm 2020-07-16T14:08:54.838892+0000 mgr.x (mgr.34562) 1456 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:08:56.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:08:55 smithi188 bash[23329]: cephadm 2020-07-16T14:08:54.838732+0000 mgr.x (mgr.34562) 1455 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:08:56.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:08:55 smithi188 bash[23329]: cephadm 2020-07-16T14:08:54.838892+0000 mgr.x (mgr.34562) 1456 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:08:57.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:08:56 smithi132 bash[27079]: cluster 2020-07-16T14:08:55.898266+0000 mgr.x (mgr.34562) 1457 : cluster [DBG] pgmap v908: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:08:57.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:08:56 smithi188 bash[23329]: cluster 2020-07-16T14:08:55.898266+0000 mgr.x (mgr.34562) 1457 : cluster [DBG] pgmap v908: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:08:59.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:08:58 smithi132 bash[27079]: cluster 2020-07-16T14:08:57.898779+0000 mgr.x (mgr.34562) 1458 : cluster [DBG] pgmap v909: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:08:59.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:08:58 smithi188 bash[23329]: cluster 2020-07-16T14:08:57.898779+0000 mgr.x (mgr.34562) 1458 : cluster [DBG] pgmap v909: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:09:00.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:09:00 smithi188 bash[23329]: cluster 2020-07-16T14:08:59.899181+0000 mgr.x (mgr.34562) 1459 : cluster [DBG] pgmap v910: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:09:00.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:09:00 smithi132 bash[27079]: cluster 2020-07-16T14:08:59.899181+0000 mgr.x (mgr.34562) 1459 : cluster [DBG] pgmap v910: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:09:03.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:09:02 smithi132 bash[27079]: cluster 2020-07-16T14:09:01.899730+0000 mgr.x (mgr.34562) 1460 : cluster [DBG] pgmap v911: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:09:03.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:09:02 smithi188 bash[23329]: cluster 2020-07-16T14:09:01.899730+0000 mgr.x (mgr.34562) 1460 : cluster [DBG] pgmap v911: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:09:05.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:09:04 smithi132 bash[27079]: cluster 2020-07-16T14:09:03.900187+0000 mgr.x (mgr.34562) 1461 : cluster [DBG] pgmap v912: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:09:05.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:09:04 smithi188 bash[23329]: cluster 2020-07-16T14:09:03.900187+0000 mgr.x (mgr.34562) 1461 : cluster [DBG] pgmap v912: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:09:07.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:09:06 smithi132 bash[27079]: cluster 2020-07-16T14:09:05.900613+0000 mgr.x (mgr.34562) 1462 : cluster [DBG] pgmap v913: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:09:07.411 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:09:07.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:09:06 smithi188 bash[23329]: cluster 2020-07-16T14:09:05.900613+0000 mgr.x (mgr.34562) 1462 : cluster [DBG] pgmap v913: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:09:07.673 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:09:07.673 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (31m) 9m ago 34m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:09:07.673 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (34m) 9m ago 34m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:09:07.673 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (32m) 9m ago 37m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:09:07.674 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (31m) 9m ago 39m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:09:07.674 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 9m ago 39m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:09:07.674 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (37m) 9m ago 37m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:09:07.674 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (38m) 9m ago 38m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:09:07.674 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (35m) 9m ago 35m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:09:07.675 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (35m) 9m ago 35m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:09:07.675 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (37m) 9m ago 37m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:09:07.675 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (37m) 9m ago 37m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:09:07.675 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (36m) 9m ago 36m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:09:07.675 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (36m) 9m ago 36m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:09:07.676 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (36m) 9m ago 36m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:09:07.676 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (36m) 9m ago 36m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:09:07.676 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (35m) 9m ago 35m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:09:07.676 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (35m) 9m ago 35m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:09:07.676 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (34m) 9m ago 35m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:09:07.971 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:09:07.971 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:09:07.972 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:09:07.972 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:09:07.972 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:09:07.972 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:09:07.972 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:09:07.973 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:09:07.973 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:09:07.973 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:09:07.973 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:09:07.973 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:09:07.974 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:09:07.974 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:09:07.974 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:09:07.974 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:09:07.974 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:09:09.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:09:08 smithi132 bash[27079]: audit 2020-07-16T14:09:07.399657+0000 mgr.x (mgr.34562) 1463 : audit [DBG] from='client.25702 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:09:09.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:09:08 smithi132 bash[27079]: audit 2020-07-16T14:09:07.668385+0000 mgr.x (mgr.34562) 1464 : audit [DBG] from='client.25708 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:09:09.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:09:08 smithi132 bash[27079]: cluster 2020-07-16T14:09:07.900964+0000 mgr.x (mgr.34562) 1465 : cluster [DBG] pgmap v914: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:09:09.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:09:08 smithi132 bash[27079]: audit 2020-07-16T14:09:07.970344+0000 mon.c (mon.1) 146 : audit [DBG] from='client.? 172.21.15.132:0/928523708' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:09:09.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:09:08 smithi188 bash[23329]: audit 2020-07-16T14:09:07.399657+0000 mgr.x (mgr.34562) 1463 : audit [DBG] from='client.25702 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:09:09.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:09:08 smithi188 bash[23329]: audit 2020-07-16T14:09:07.668385+0000 mgr.x (mgr.34562) 1464 : audit [DBG] from='client.25708 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:09:09.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:09:08 smithi188 bash[23329]: cluster 2020-07-16T14:09:07.900964+0000 mgr.x (mgr.34562) 1465 : cluster [DBG] pgmap v914: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:09:09.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:09:08 smithi188 bash[23329]: audit 2020-07-16T14:09:07.970344+0000 mon.c (mon.1) 146 : audit [DBG] from='client.? 172.21.15.132:0/928523708' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:09:10.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:09:10 smithi188 bash[23329]: audit 2020-07-16T14:09:09.839925+0000 mon.b (mon.2) 434 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:09:10.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:09:10 smithi188 bash[23329]: cephadm 2020-07-16T14:09:09.840675+0000 mgr.x (mgr.34562) 1466 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:09:10.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:09:10 smithi188 bash[23329]: cephadm 2020-07-16T14:09:09.841147+0000 mgr.x (mgr.34562) 1467 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:09:10.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:09:10 smithi188 bash[23329]: cluster 2020-07-16T14:09:09.901338+0000 mgr.x (mgr.34562) 1468 : cluster [DBG] pgmap v915: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:09:10.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:09:10 smithi132 bash[27079]: audit 2020-07-16T14:09:09.839925+0000 mon.b (mon.2) 434 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:09:10.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:09:10 smithi132 bash[27079]: cephadm 2020-07-16T14:09:09.840675+0000 mgr.x (mgr.34562) 1466 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:09:10.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:09:10 smithi132 bash[27079]: cephadm 2020-07-16T14:09:09.841147+0000 mgr.x (mgr.34562) 1467 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:09:10.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:09:10 smithi132 bash[27079]: cluster 2020-07-16T14:09:09.901338+0000 mgr.x (mgr.34562) 1468 : cluster [DBG] pgmap v915: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:09:13.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:09:12 smithi132 bash[27079]: cluster 2020-07-16T14:09:11.901668+0000 mgr.x (mgr.34562) 1469 : cluster [DBG] pgmap v916: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:09:13.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:09:12 smithi188 bash[23329]: cluster 2020-07-16T14:09:11.901668+0000 mgr.x (mgr.34562) 1469 : cluster [DBG] pgmap v916: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:09:15.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:09:14 smithi132 bash[27079]: cluster 2020-07-16T14:09:13.902021+0000 mgr.x (mgr.34562) 1470 : cluster [DBG] pgmap v917: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:09:15.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:09:14 smithi188 bash[23329]: cluster 2020-07-16T14:09:13.902021+0000 mgr.x (mgr.34562) 1470 : cluster [DBG] pgmap v917: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:09:17.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:09:16 smithi132 bash[27079]: cluster 2020-07-16T14:09:15.902399+0000 mgr.x (mgr.34562) 1471 : cluster [DBG] pgmap v918: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:09:17.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:09:16 smithi188 bash[23329]: cluster 2020-07-16T14:09:15.902399+0000 mgr.x (mgr.34562) 1471 : cluster [DBG] pgmap v918: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:09:19.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:09:18 smithi132 bash[27079]: cluster 2020-07-16T14:09:17.902877+0000 mgr.x (mgr.34562) 1472 : cluster [DBG] pgmap v919: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:09:19.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:09:18 smithi188 bash[23329]: cluster 2020-07-16T14:09:17.902877+0000 mgr.x (mgr.34562) 1472 : cluster [DBG] pgmap v919: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:09:20.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:09:20 smithi188 bash[23329]: cluster 2020-07-16T14:09:19.903256+0000 mgr.x (mgr.34562) 1473 : cluster [DBG] pgmap v920: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:09:20.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:09:20 smithi132 bash[27079]: cluster 2020-07-16T14:09:19.903256+0000 mgr.x (mgr.34562) 1473 : cluster [DBG] pgmap v920: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:09:23.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:09:22 smithi132 bash[27079]: cluster 2020-07-16T14:09:21.903662+0000 mgr.x (mgr.34562) 1474 : cluster [DBG] pgmap v921: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:09:23.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:09:22 smithi188 bash[23329]: cluster 2020-07-16T14:09:21.903662+0000 mgr.x (mgr.34562) 1474 : cluster [DBG] pgmap v921: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:09:25.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:09:24 smithi132 bash[27079]: cluster 2020-07-16T14:09:23.904224+0000 mgr.x (mgr.34562) 1475 : cluster [DBG] pgmap v922: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:09:25.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:09:24 smithi132 bash[27079]: audit 2020-07-16T14:09:24.846415+0000 mon.b (mon.2) 435 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:09:25.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:09:24 smithi132 bash[27079]: audit 2020-07-16T14:09:24.847849+0000 mon.b (mon.2) 436 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:09:25.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:09:24 smithi132 bash[27079]: audit 2020-07-16T14:09:24.849051+0000 mon.b (mon.2) 437 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:09:25.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:09:24 smithi132 bash[27079]: audit 2020-07-16T14:09:24.850439+0000 mon.b (mon.2) 438 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:09:25.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:09:24 smithi132 bash[27079]: audit 2020-07-16T14:09:24.851851+0000 mon.b (mon.2) 439 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:09:25.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:09:24 smithi188 bash[23329]: cluster 2020-07-16T14:09:23.904224+0000 mgr.x (mgr.34562) 1475 : cluster [DBG] pgmap v922: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:09:25.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:09:24 smithi188 bash[23329]: audit 2020-07-16T14:09:24.846415+0000 mon.b (mon.2) 435 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:09:25.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:09:24 smithi188 bash[23329]: audit 2020-07-16T14:09:24.847849+0000 mon.b (mon.2) 436 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:09:25.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:09:24 smithi188 bash[23329]: audit 2020-07-16T14:09:24.849051+0000 mon.b (mon.2) 437 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:09:25.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:09:24 smithi188 bash[23329]: audit 2020-07-16T14:09:24.850439+0000 mon.b (mon.2) 438 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:09:25.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:09:24 smithi188 bash[23329]: audit 2020-07-16T14:09:24.851851+0000 mon.b (mon.2) 439 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:09:26.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:09:25 smithi132 bash[27079]: audit 2020-07-16T14:09:24.846802+0000 mgr.x (mgr.34562) 1476 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:09:26.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:09:25 smithi132 bash[27079]: audit 2020-07-16T14:09:24.848148+0000 mgr.x (mgr.34562) 1477 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:09:26.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:09:25 smithi132 bash[27079]: audit 2020-07-16T14:09:24.849385+0000 mgr.x (mgr.34562) 1478 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:09:26.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:09:25 smithi132 bash[27079]: cephadm 2020-07-16T14:09:24.850159+0000 mgr.x (mgr.34562) 1479 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:09:26.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:09:25 smithi132 bash[27079]: cephadm 2020-07-16T14:09:24.851323+0000 mgr.x (mgr.34562) 1480 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:09:26.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:09:25 smithi132 bash[27079]: cephadm 2020-07-16T14:09:24.852626+0000 mgr.x (mgr.34562) 1481 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:09:26.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:09:25 smithi132 bash[27079]: cephadm 2020-07-16T14:09:24.852957+0000 mgr.x (mgr.34562) 1482 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:09:26.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:09:25 smithi188 bash[23329]: audit 2020-07-16T14:09:24.846802+0000 mgr.x (mgr.34562) 1476 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:09:26.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:09:25 smithi188 bash[23329]: audit 2020-07-16T14:09:24.848148+0000 mgr.x (mgr.34562) 1477 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:09:26.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:09:25 smithi188 bash[23329]: audit 2020-07-16T14:09:24.849385+0000 mgr.x (mgr.34562) 1478 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:09:26.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:09:25 smithi188 bash[23329]: cephadm 2020-07-16T14:09:24.850159+0000 mgr.x (mgr.34562) 1479 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:09:26.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:09:25 smithi188 bash[23329]: cephadm 2020-07-16T14:09:24.851323+0000 mgr.x (mgr.34562) 1480 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:09:26.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:09:25 smithi188 bash[23329]: cephadm 2020-07-16T14:09:24.852626+0000 mgr.x (mgr.34562) 1481 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:09:26.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:09:25 smithi188 bash[23329]: cephadm 2020-07-16T14:09:24.852957+0000 mgr.x (mgr.34562) 1482 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:09:27.165 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:09:26 smithi132 bash[27079]: cluster 2020-07-16T14:09:25.904633+0000 mgr.x (mgr.34562) 1483 : cluster [DBG] pgmap v923: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:09:27.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:09:26 smithi188 bash[23329]: cluster 2020-07-16T14:09:25.904633+0000 mgr.x (mgr.34562) 1483 : cluster [DBG] pgmap v923: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:09:28.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:09:27 smithi132 bash[27079]: audit 2020-07-16T14:09:27.685379+0000 mon.b (mon.2) 440 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:09:28.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:09:27 smithi188 bash[23329]: audit 2020-07-16T14:09:27.685379+0000 mon.b (mon.2) 440 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:09:29.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:09:28 smithi132 bash[27079]: cephadm 2020-07-16T14:09:27.686015+0000 mgr.x (mgr.34562) 1484 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:09:29.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:09:28 smithi132 bash[27079]: cephadm 2020-07-16T14:09:27.686141+0000 mgr.x (mgr.34562) 1485 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:09:29.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:09:28 smithi132 bash[27079]: cluster 2020-07-16T14:09:27.904992+0000 mgr.x (mgr.34562) 1486 : cluster [DBG] pgmap v924: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:09:29.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:09:28 smithi188 bash[23329]: cephadm 2020-07-16T14:09:27.686015+0000 mgr.x (mgr.34562) 1484 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:09:29.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:09:28 smithi188 bash[23329]: cephadm 2020-07-16T14:09:27.686141+0000 mgr.x (mgr.34562) 1485 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:09:29.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:09:28 smithi188 bash[23329]: cluster 2020-07-16T14:09:27.904992+0000 mgr.x (mgr.34562) 1486 : cluster [DBG] pgmap v924: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:09:30.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:09:30 smithi188 bash[23329]: cluster 2020-07-16T14:09:29.905414+0000 mgr.x (mgr.34562) 1487 : cluster [DBG] pgmap v925: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:09:30.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:09:30 smithi132 bash[27079]: cluster 2020-07-16T14:09:29.905414+0000 mgr.x (mgr.34562) 1487 : cluster [DBG] pgmap v925: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:09:33.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:09:32 smithi132 bash[27079]: cluster 2020-07-16T14:09:31.905838+0000 mgr.x (mgr.34562) 1488 : cluster [DBG] pgmap v926: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:09:33.426 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:09:32 smithi188 bash[23329]: cluster 2020-07-16T14:09:31.905838+0000 mgr.x (mgr.34562) 1488 : cluster [DBG] pgmap v926: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:09:35.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:09:34 smithi132 bash[27079]: cluster 2020-07-16T14:09:33.906345+0000 mgr.x (mgr.34562) 1489 : cluster [DBG] pgmap v927: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:09:35.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:09:34 smithi188 bash[23329]: cluster 2020-07-16T14:09:33.906345+0000 mgr.x (mgr.34562) 1489 : cluster [DBG] pgmap v927: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:09:37.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:09:36 smithi132 bash[27079]: cluster 2020-07-16T14:09:35.906831+0000 mgr.x (mgr.34562) 1490 : cluster [DBG] pgmap v928: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:09:37.427 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:09:36 smithi188 bash[23329]: cluster 2020-07-16T14:09:35.906831+0000 mgr.x (mgr.34562) 1490 : cluster [DBG] pgmap v928: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:09:38.274 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:09:38.532 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:09:38.533 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (32m) 9m ago 35m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:09:38.533 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (35m) 9m ago 35m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:09:38.533 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (32m) 9m ago 38m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:09:38.534 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (32m) 9m ago 39m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:09:38.534 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 9m ago 40m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:09:38.534 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (38m) 9m ago 38m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:09:38.535 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (38m) 9m ago 38m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:09:38.535 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (35m) 9m ago 35m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:09:38.535 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (35m) 9m ago 35m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:09:38.536 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (37m) 9m ago 38m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:09:38.536 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (37m) 9m ago 37m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:09:38.536 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (37m) 9m ago 37m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:09:38.537 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (37m) 9m ago 37m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:09:38.537 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (36m) 9m ago 36m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:09:38.538 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (36m) 9m ago 36m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:09:38.538 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (36m) 9m ago 36m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:09:38.539 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (36m) 9m ago 36m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:09:38.539 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (34m) 9m ago 35m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:09:38.830 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:09:38.830 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:09:38.830 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:09:38.830 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:09:38.831 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:09:38.831 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:09:38.831 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:09:38.831 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:09:38.831 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:09:38.832 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:09:38.832 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:09:38.832 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:09:38.832 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:09:38.832 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:09:38.833 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:09:38.833 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:09:38.833 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:09:39.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:09:38 smithi132 bash[27079]: cluster 2020-07-16T14:09:37.907314+0000 mgr.x (mgr.34562) 1491 : cluster [DBG] pgmap v929: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:09:39.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:09:38 smithi132 bash[27079]: audit 2020-07-16T14:09:38.828907+0000 mon.c (mon.1) 147 : audit [DBG] from='client.? 172.21.15.132:0/313512429' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:09:39.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:09:38 smithi188 bash[23329]: cluster 2020-07-16T14:09:37.907314+0000 mgr.x (mgr.34562) 1491 : cluster [DBG] pgmap v929: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:09:39.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:09:38 smithi188 bash[23329]: audit 2020-07-16T14:09:38.828907+0000 mon.c (mon.1) 147 : audit [DBG] from='client.? 172.21.15.132:0/313512429' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:09:40.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:09:39 smithi132 bash[27079]: audit 2020-07-16T14:09:38.258193+0000 mgr.x (mgr.34562) 1492 : audit [DBG] from='client.25720 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:09:40.284 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:09:39 smithi132 bash[27079]: audit 2020-07-16T14:09:38.527708+0000 mgr.x (mgr.34562) 1493 : audit [DBG] from='client.25726 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:09:40.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:09:39 smithi188 bash[23329]: audit 2020-07-16T14:09:38.258193+0000 mgr.x (mgr.34562) 1492 : audit [DBG] from='client.25720 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:09:40.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:09:39 smithi188 bash[23329]: audit 2020-07-16T14:09:38.527708+0000 mgr.x (mgr.34562) 1493 : audit [DBG] from='client.25726 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:09:41.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:09:40 smithi132 bash[27079]: cluster 2020-07-16T14:09:39.907827+0000 mgr.x (mgr.34562) 1494 : cluster [DBG] pgmap v930: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:09:41.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:09:40 smithi188 bash[23329]: cluster 2020-07-16T14:09:39.907827+0000 mgr.x (mgr.34562) 1494 : cluster [DBG] pgmap v930: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:09:43.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:09:42 smithi132 bash[27079]: cluster 2020-07-16T14:09:41.908395+0000 mgr.x (mgr.34562) 1495 : cluster [DBG] pgmap v931: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:09:43.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:09:42 smithi132 bash[27079]: audit 2020-07-16T14:09:42.701839+0000 mon.b (mon.2) 441 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:09:43.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:09:42 smithi188 bash[23329]: cluster 2020-07-16T14:09:41.908395+0000 mgr.x (mgr.34562) 1495 : cluster [DBG] pgmap v931: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:09:43.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:09:42 smithi188 bash[23329]: audit 2020-07-16T14:09:42.701839+0000 mon.b (mon.2) 441 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:09:44.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:09:43 smithi132 bash[27079]: cephadm 2020-07-16T14:09:42.702552+0000 mgr.x (mgr.34562) 1496 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:09:44.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:09:43 smithi132 bash[27079]: cephadm 2020-07-16T14:09:42.702786+0000 mgr.x (mgr.34562) 1497 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:09:44.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:09:43 smithi188 bash[23329]: cephadm 2020-07-16T14:09:42.702552+0000 mgr.x (mgr.34562) 1496 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:09:44.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:09:43 smithi188 bash[23329]: cephadm 2020-07-16T14:09:42.702786+0000 mgr.x (mgr.34562) 1497 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:09:45.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:09:44 smithi132 bash[27079]: cluster 2020-07-16T14:09:43.908800+0000 mgr.x (mgr.34562) 1498 : cluster [DBG] pgmap v932: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:09:45.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:09:44 smithi188 bash[23329]: cluster 2020-07-16T14:09:43.908800+0000 mgr.x (mgr.34562) 1498 : cluster [DBG] pgmap v932: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:09:47.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:09:46 smithi132 bash[27079]: cluster 2020-07-16T14:09:45.909118+0000 mgr.x (mgr.34562) 1499 : cluster [DBG] pgmap v933: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:09:47.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:09:46 smithi188 bash[23329]: cluster 2020-07-16T14:09:45.909118+0000 mgr.x (mgr.34562) 1499 : cluster [DBG] pgmap v933: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:09:49.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:09:48 smithi132 bash[27079]: cluster 2020-07-16T14:09:47.909663+0000 mgr.x (mgr.34562) 1500 : cluster [DBG] pgmap v934: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:09:49.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:09:48 smithi188 bash[23329]: cluster 2020-07-16T14:09:47.909663+0000 mgr.x (mgr.34562) 1500 : cluster [DBG] pgmap v934: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:09:50.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:09:50 smithi188 bash[23329]: cluster 2020-07-16T14:09:49.910191+0000 mgr.x (mgr.34562) 1501 : cluster [DBG] pgmap v935: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:09:50.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:09:50 smithi132 bash[27079]: cluster 2020-07-16T14:09:49.910191+0000 mgr.x (mgr.34562) 1501 : cluster [DBG] pgmap v935: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:09:53.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:09:52 smithi132 bash[27079]: cluster 2020-07-16T14:09:51.910757+0000 mgr.x (mgr.34562) 1502 : cluster [DBG] pgmap v936: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:09:53.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:09:52 smithi188 bash[23329]: cluster 2020-07-16T14:09:51.910757+0000 mgr.x (mgr.34562) 1502 : cluster [DBG] pgmap v936: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:09:55.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:09:54 smithi132 bash[27079]: cluster 2020-07-16T14:09:53.911124+0000 mgr.x (mgr.34562) 1503 : cluster [DBG] pgmap v937: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:09:55.425 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:09:54 smithi188 bash[23329]: cluster 2020-07-16T14:09:53.911124+0000 mgr.x (mgr.34562) 1503 : cluster [DBG] pgmap v937: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:09:57.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:09:56 smithi132 bash[27079]: cluster 2020-07-16T14:09:55.911469+0000 mgr.x (mgr.34562) 1504 : cluster [DBG] pgmap v938: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:09:57.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:09:56 smithi188 bash[23329]: cluster 2020-07-16T14:09:55.911469+0000 mgr.x (mgr.34562) 1504 : cluster [DBG] pgmap v938: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:09:58.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:09:57 smithi132 bash[27079]: audit 2020-07-16T14:09:57.704381+0000 mon.b (mon.2) 442 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:09:58.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:09:57 smithi188 bash[23329]: audit 2020-07-16T14:09:57.704381+0000 mon.b (mon.2) 442 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:09:59.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:09:58 smithi132 bash[27079]: cephadm 2020-07-16T14:09:57.705047+0000 mgr.x (mgr.34562) 1505 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:09:59.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:09:58 smithi132 bash[27079]: cephadm 2020-07-16T14:09:57.705127+0000 mgr.x (mgr.34562) 1506 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:09:59.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:09:58 smithi132 bash[27079]: cluster 2020-07-16T14:09:57.911880+0000 mgr.x (mgr.34562) 1507 : cluster [DBG] pgmap v939: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:09:59.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:09:58 smithi188 bash[23329]: cephadm 2020-07-16T14:09:57.705047+0000 mgr.x (mgr.34562) 1505 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:09:59.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:09:58 smithi188 bash[23329]: cephadm 2020-07-16T14:09:57.705127+0000 mgr.x (mgr.34562) 1506 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:09:59.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:09:58 smithi188 bash[23329]: cluster 2020-07-16T14:09:57.911880+0000 mgr.x (mgr.34562) 1507 : cluster [DBG] pgmap v939: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:10:00.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:00 smithi188 bash[23329]: cluster 2020-07-16T14:09:59.912247+0000 mgr.x (mgr.34562) 1508 : cluster [DBG] pgmap v940: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:10:00.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:00 smithi132 bash[27079]: cluster 2020-07-16T14:09:59.912247+0000 mgr.x (mgr.34562) 1508 : cluster [DBG] pgmap v940: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:10:03.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:02 smithi132 bash[27079]: cluster 2020-07-16T14:10:01.912664+0000 mgr.x (mgr.34562) 1509 : cluster [DBG] pgmap v941: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:10:03.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:02 smithi188 bash[23329]: cluster 2020-07-16T14:10:01.912664+0000 mgr.x (mgr.34562) 1509 : cluster [DBG] pgmap v941: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:10:05.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:04 smithi132 bash[27079]: cluster 2020-07-16T14:10:03.913051+0000 mgr.x (mgr.34562) 1510 : cluster [DBG] pgmap v942: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:10:05.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:04 smithi188 bash[23329]: cluster 2020-07-16T14:10:03.913051+0000 mgr.x (mgr.34562) 1510 : cluster [DBG] pgmap v942: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:10:07.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:06 smithi132 bash[27079]: cluster 2020-07-16T14:10:05.913556+0000 mgr.x (mgr.34562) 1511 : cluster [DBG] pgmap v943: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:10:07.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:06 smithi188 bash[23329]: cluster 2020-07-16T14:10:05.913556+0000 mgr.x (mgr.34562) 1511 : cluster [DBG] pgmap v943: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:10:09.128 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:10:09.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:08 smithi132 bash[27079]: cluster 2020-07-16T14:10:07.914148+0000 mgr.x (mgr.34562) 1512 : cluster [DBG] pgmap v944: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:10:09.390 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:10:09.390 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (32m) 10m ago 35m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:10:09.391 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (35m) 10m ago 35m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:10:09.391 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (33m) 10m ago 38m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:10:09.391 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (32m) 10m ago 40m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:10:09.391 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 10m ago 40m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:10:09.391 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (38m) 10m ago 38m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:10:09.392 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (39m) 10m ago 39m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:10:09.392 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (36m) 10m ago 36m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:10:09.392 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (36m) 10m ago 36m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:10:09.392 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (38m) 10m ago 38m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:10:09.392 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (38m) 10m ago 38m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:10:09.393 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (37m) 10m ago 37m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:10:09.393 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (37m) 10m ago 37m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:10:09.393 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (37m) 10m ago 37m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:10:09.393 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (37m) 10m ago 37m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:10:09.393 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (36m) 10m ago 36m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:10:09.393 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (36m) 10m ago 36m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:10:09.394 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (35m) 10m ago 36m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:10:09.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:08 smithi188 bash[23329]: cluster 2020-07-16T14:10:07.914148+0000 mgr.x (mgr.34562) 1512 : cluster [DBG] pgmap v944: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:10:09.691 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:10:09.691 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:10:09.692 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:10:09.692 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:10:09.692 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:10:09.692 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:10:09.692 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:10:09.693 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:10:09.693 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:10:09.693 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:10:09.693 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:10:09.693 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:10:09.693 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:10:09.694 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:10:09.694 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:10:09.694 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:10:09.695 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:10:10.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:09 smithi132 bash[27079]: audit 2020-07-16T14:10:09.116243+0000 mgr.x (mgr.34562) 1513 : audit [DBG] from='client.25738 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:10:10.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:09 smithi132 bash[27079]: audit 2020-07-16T14:10:09.690253+0000 mon.c (mon.1) 148 : audit [DBG] from='client.? 172.21.15.132:0/699282459' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:10:10.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:09 smithi188 bash[23329]: audit 2020-07-16T14:10:09.116243+0000 mgr.x (mgr.34562) 1513 : audit [DBG] from='client.25738 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:10:10.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:09 smithi188 bash[23329]: audit 2020-07-16T14:10:09.690253+0000 mon.c (mon.1) 148 : audit [DBG] from='client.? 172.21.15.132:0/699282459' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:10:11.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:10 smithi132 bash[27079]: audit 2020-07-16T14:10:09.385669+0000 mgr.x (mgr.34562) 1514 : audit [DBG] from='client.25744 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:10:11.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:10 smithi132 bash[27079]: cluster 2020-07-16T14:10:09.914502+0000 mgr.x (mgr.34562) 1515 : cluster [DBG] pgmap v945: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:10:11.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:10 smithi188 bash[23329]: audit 2020-07-16T14:10:09.385669+0000 mgr.x (mgr.34562) 1514 : audit [DBG] from='client.25744 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:10:11.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:10 smithi188 bash[23329]: cluster 2020-07-16T14:10:09.914502+0000 mgr.x (mgr.34562) 1515 : cluster [DBG] pgmap v945: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:10:13.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:12 smithi132 bash[27079]: cluster 2020-07-16T14:10:11.914950+0000 mgr.x (mgr.34562) 1516 : cluster [DBG] pgmap v946: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:10:13.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:12 smithi132 bash[27079]: audit 2020-07-16T14:10:12.708980+0000 mon.b (mon.2) 443 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:10:13.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:12 smithi188 bash[23329]: cluster 2020-07-16T14:10:11.914950+0000 mgr.x (mgr.34562) 1516 : cluster [DBG] pgmap v946: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:10:13.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:12 smithi188 bash[23329]: audit 2020-07-16T14:10:12.708980+0000 mon.b (mon.2) 443 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:10:14.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:13 smithi132 bash[27079]: cephadm 2020-07-16T14:10:12.709683+0000 mgr.x (mgr.34562) 1517 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:10:14.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:13 smithi132 bash[27079]: cephadm 2020-07-16T14:10:12.709759+0000 mgr.x (mgr.34562) 1518 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:10:14.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:13 smithi188 bash[23329]: cephadm 2020-07-16T14:10:12.709683+0000 mgr.x (mgr.34562) 1517 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:10:14.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:13 smithi188 bash[23329]: cephadm 2020-07-16T14:10:12.709759+0000 mgr.x (mgr.34562) 1518 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:10:15.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:14 smithi132 bash[27079]: cluster 2020-07-16T14:10:13.915354+0000 mgr.x (mgr.34562) 1519 : cluster [DBG] pgmap v947: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:10:15.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:14 smithi188 bash[23329]: cluster 2020-07-16T14:10:13.915354+0000 mgr.x (mgr.34562) 1519 : cluster [DBG] pgmap v947: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:10:17.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:16 smithi132 bash[27079]: cluster 2020-07-16T14:10:15.915693+0000 mgr.x (mgr.34562) 1520 : cluster [DBG] pgmap v948: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:10:17.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:16 smithi188 bash[23329]: cluster 2020-07-16T14:10:15.915693+0000 mgr.x (mgr.34562) 1520 : cluster [DBG] pgmap v948: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:10:19.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:18 smithi132 bash[27079]: cluster 2020-07-16T14:10:17.916241+0000 mgr.x (mgr.34562) 1521 : cluster [DBG] pgmap v949: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:10:19.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:19 smithi188 bash[23329]: cluster 2020-07-16T14:10:17.916241+0000 mgr.x (mgr.34562) 1521 : cluster [DBG] pgmap v949: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:10:20.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:20 smithi188 bash[23329]: cluster 2020-07-16T14:10:19.916767+0000 mgr.x (mgr.34562) 1522 : cluster [DBG] pgmap v950: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:10:20.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:20 smithi132 bash[27079]: cluster 2020-07-16T14:10:19.916767+0000 mgr.x (mgr.34562) 1522 : cluster [DBG] pgmap v950: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:10:23.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:22 smithi132 bash[27079]: cluster 2020-07-16T14:10:21.917173+0000 mgr.x (mgr.34562) 1523 : cluster [DBG] pgmap v951: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:10:23.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:22 smithi188 bash[23329]: cluster 2020-07-16T14:10:21.917173+0000 mgr.x (mgr.34562) 1523 : cluster [DBG] pgmap v951: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:10:25.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:24 smithi132 bash[27079]: cluster 2020-07-16T14:10:23.917636+0000 mgr.x (mgr.34562) 1524 : cluster [DBG] pgmap v952: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:10:25.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:24 smithi188 bash[23329]: cluster 2020-07-16T14:10:23.917636+0000 mgr.x (mgr.34562) 1524 : cluster [DBG] pgmap v952: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:10:27.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:26 smithi132 bash[27079]: cluster 2020-07-16T14:10:25.918099+0000 mgr.x (mgr.34562) 1525 : cluster [DBG] pgmap v953: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:10:27.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:26 smithi188 bash[23329]: cluster 2020-07-16T14:10:25.918099+0000 mgr.x (mgr.34562) 1525 : cluster [DBG] pgmap v953: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:10:28.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:27 smithi132 bash[27079]: audit 2020-07-16T14:10:27.726230+0000 mon.b (mon.2) 444 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T14:10:28.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:27 smithi132 bash[27079]: audit 2020-07-16T14:10:27.726474+0000 mon.b (mon.2) 445 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T14:10:28.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:27 smithi188 bash[23329]: audit 2020-07-16T14:10:27.726230+0000 mon.b (mon.2) 444 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T14:10:28.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:27 smithi188 bash[23329]: audit 2020-07-16T14:10:27.726474+0000 mon.b (mon.2) 445 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T14:10:29.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:28 smithi132 bash[27079]: cluster 2020-07-16T14:10:27.918453+0000 mgr.x (mgr.34562) 1526 : cluster [DBG] pgmap v954: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:10:29.350 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:28 smithi188 bash[23329]: cluster 2020-07-16T14:10:27.918453+0000 mgr.x (mgr.34562) 1526 : cluster [DBG] pgmap v954: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:10:30.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:30 smithi188 bash[23329]: cluster 2020-07-16T14:10:29.918729+0000 mgr.x (mgr.34562) 1527 : cluster [DBG] pgmap v955: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:10:30.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:30 smithi188 bash[23329]: audit 2020-07-16T14:10:30.078454+0000 mon.b (mon.2) 446 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:10:30.076899\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.076959\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.076995\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077024\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077207\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077334\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077439\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077540\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077574\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:10:30.077644\", \"last_device_update\": \"2020-07-16T14:03:05.154706\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:01:58.947052\"}"}]: dispatch 2020-07-16T14:10:30.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:30 smithi188 bash[23329]: audit 2020-07-16T14:10:30.079143+0000 mon.c (mon.1) 149 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:10:30.076899\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.076959\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.076995\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077024\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077207\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077334\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077439\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077540\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077574\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:10:30.077644\", \"last_device_update\": \"2020-07-16T14:03:05.154706\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:01:58.947052\"}"}]: dispatch 2020-07-16T14:10:30.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:30 smithi188 bash[23329]: audit 2020-07-16T14:10:30.081818+0000 mon.c (mon.1) 150 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:10:30.076899\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.076959\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.076995\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077024\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077207\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077334\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077439\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077540\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077574\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:10:30.077644\", \"last_device_update\": \"2020-07-16T14:03:05.154706\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:01:58.947052\"}"}]': finished 2020-07-16T14:10:30.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:30 smithi188 bash[23329]: audit 2020-07-16T14:10:30.264261+0000 mon.b (mon.2) 447 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.262699\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.262770\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.262801\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.262961\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.263063\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.263161\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.263260\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.263318\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.263348\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:10:30.263421\", \"last_device_update\": \"2020-07-16T14:04:10.964865\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:01:58.946423\"}"}]: dispatch 2020-07-16T14:10:30.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:30 smithi188 bash[23329]: audit 2020-07-16T14:10:30.265058+0000 mon.c (mon.1) 151 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.262699\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.262770\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.262801\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.262961\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.263063\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.263161\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.263260\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.263318\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.263348\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:10:30.263421\", \"last_device_update\": \"2020-07-16T14:04:10.964865\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:01:58.946423\"}"}]: dispatch 2020-07-16T14:10:30.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:30 smithi188 bash[23329]: audit 2020-07-16T14:10:30.267512+0000 mon.c (mon.1) 152 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.262699\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.262770\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.262801\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.262961\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.263063\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.263161\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.263260\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.263318\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.263348\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:10:30.263421\", \"last_device_update\": \"2020-07-16T14:04:10.964865\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:01:58.946423\"}"}]': finished 2020-07-16T14:10:30.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:30 smithi188 bash[23329]: audit 2020-07-16T14:10:30.270281+0000 mon.b (mon.2) 448 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:10:30.675 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:30 smithi188 bash[23329]: audit 2020-07-16T14:10:30.271179+0000 mon.b (mon.2) 449 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:10:30.675 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:30 smithi188 bash[23329]: audit 2020-07-16T14:10:30.272056+0000 mon.b (mon.2) 450 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:10:30.675 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:30 smithi188 bash[23329]: audit 2020-07-16T14:10:30.272961+0000 mon.b (mon.2) 451 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:10:30.675 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:30 smithi188 bash[23329]: audit 2020-07-16T14:10:30.273814+0000 mon.b (mon.2) 452 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:10:30.698 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:30 smithi132 bash[27079]: cluster 2020-07-16T14:10:29.918729+0000 mgr.x (mgr.34562) 1527 : cluster [DBG] pgmap v955: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:10:30.698 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:30 smithi132 bash[27079]: audit 2020-07-16T14:10:30.078454+0000 mon.b (mon.2) 446 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:10:30.076899\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.076959\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.076995\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077024\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077207\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077334\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077439\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077540\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077574\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:10:30.077644\", \"last_device_update\": \"2020-07-16T14:03:05.154706\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:01:58.947052\"}"}]: dispatch 2020-07-16T14:10:30.699 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:30 smithi132 bash[27079]: audit 2020-07-16T14:10:30.079143+0000 mon.c (mon.1) 149 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:10:30.076899\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.076959\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.076995\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077024\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077207\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077334\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077439\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077540\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077574\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:10:30.077644\", \"last_device_update\": \"2020-07-16T14:03:05.154706\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:01:58.947052\"}"}]: dispatch 2020-07-16T14:10:30.699 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:30 smithi132 bash[27079]: audit 2020-07-16T14:10:30.081818+0000 mon.c (mon.1) 150 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:10:30.076899\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.076959\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.076995\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077024\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077207\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077334\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077439\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077540\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077574\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:10:30.077644\", \"last_device_update\": \"2020-07-16T14:03:05.154706\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:01:58.947052\"}"}]': finished 2020-07-16T14:10:30.699 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:30 smithi132 bash[27079]: audit 2020-07-16T14:10:30.264261+0000 mon.b (mon.2) 447 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.262699\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.262770\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.262801\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.262961\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.263063\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.263161\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.263260\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.263318\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.263348\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:10:30.263421\", \"last_device_update\": \"2020-07-16T14:04:10.964865\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:01:58.946423\"}"}]: dispatch 2020-07-16T14:10:30.700 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:30 smithi132 bash[27079]: audit 2020-07-16T14:10:30.265058+0000 mon.c (mon.1) 151 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.262699\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.262770\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.262801\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.262961\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.263063\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.263161\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.263260\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.263318\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.263348\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:10:30.263421\", \"last_device_update\": \"2020-07-16T14:04:10.964865\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:01:58.946423\"}"}]: dispatch 2020-07-16T14:10:30.700 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:30 smithi132 bash[27079]: audit 2020-07-16T14:10:30.267512+0000 mon.c (mon.1) 152 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.262699\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.262770\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.262801\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.262961\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.263063\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.263161\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.263260\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.263318\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.263348\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:10:30.263421\", \"last_device_update\": \"2020-07-16T14:04:10.964865\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:01:58.946423\"}"}]': finished 2020-07-16T14:10:30.700 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:30 smithi132 bash[27079]: audit 2020-07-16T14:10:30.270281+0000 mon.b (mon.2) 448 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:10:30.701 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:30 smithi132 bash[27079]: audit 2020-07-16T14:10:30.271179+0000 mon.b (mon.2) 449 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:10:30.701 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:30 smithi132 bash[27079]: audit 2020-07-16T14:10:30.272056+0000 mon.b (mon.2) 450 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:10:30.701 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:30 smithi132 bash[27079]: audit 2020-07-16T14:10:30.272961+0000 mon.b (mon.2) 451 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:10:30.701 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:30 smithi132 bash[27079]: audit 2020-07-16T14:10:30.273814+0000 mon.b (mon.2) 452 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:10:31.607 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:31 smithi132 bash[27079]: audit 2020-07-16T14:10:30.270551+0000 mgr.x (mgr.34562) 1528 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:10:31.607 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:31 smithi132 bash[27079]: audit 2020-07-16T14:10:30.271499+0000 mgr.x (mgr.34562) 1529 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:10:31.608 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:31 smithi132 bash[27079]: audit 2020-07-16T14:10:30.272256+0000 mgr.x (mgr.34562) 1530 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:10:31.608 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:31 smithi132 bash[27079]: cephadm 2020-07-16T14:10:30.272758+0000 mgr.x (mgr.34562) 1531 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:10:31.608 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:31 smithi132 bash[27079]: cephadm 2020-07-16T14:10:30.273568+0000 mgr.x (mgr.34562) 1532 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:10:31.608 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:31 smithi132 bash[27079]: cephadm 2020-07-16T14:10:30.274375+0000 mgr.x (mgr.34562) 1533 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:10:31.608 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:31 smithi132 bash[27079]: cephadm 2020-07-16T14:10:30.274537+0000 mgr.x (mgr.34562) 1534 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:10:31.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:31 smithi188 bash[23329]: audit 2020-07-16T14:10:30.270551+0000 mgr.x (mgr.34562) 1528 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:10:31.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:31 smithi188 bash[23329]: audit 2020-07-16T14:10:30.271499+0000 mgr.x (mgr.34562) 1529 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:10:31.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:31 smithi188 bash[23329]: audit 2020-07-16T14:10:30.272256+0000 mgr.x (mgr.34562) 1530 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:10:31.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:31 smithi188 bash[23329]: cephadm 2020-07-16T14:10:30.272758+0000 mgr.x (mgr.34562) 1531 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:10:31.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:31 smithi188 bash[23329]: cephadm 2020-07-16T14:10:30.273568+0000 mgr.x (mgr.34562) 1532 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:10:31.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:31 smithi188 bash[23329]: cephadm 2020-07-16T14:10:30.274375+0000 mgr.x (mgr.34562) 1533 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:10:31.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:31 smithi188 bash[23329]: cephadm 2020-07-16T14:10:30.274537+0000 mgr.x (mgr.34562) 1534 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:10:32.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:32 smithi188 bash[23329]: cluster 2020-07-16T14:10:31.919069+0000 mgr.x (mgr.34562) 1535 : cluster [DBG] pgmap v956: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:10:32.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:32 smithi132 bash[27079]: cluster 2020-07-16T14:10:31.919069+0000 mgr.x (mgr.34562) 1535 : cluster [DBG] pgmap v956: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:10:33.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:33 smithi188 bash[23329]: audit 2020-07-16T14:10:32.916402+0000 mon.b (mon.2) 453 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:10:33.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:33 smithi188 bash[23329]: cephadm 2020-07-16T14:10:32.917044+0000 mgr.x (mgr.34562) 1536 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:10:33.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:33 smithi188 bash[23329]: cephadm 2020-07-16T14:10:32.917357+0000 mgr.x (mgr.34562) 1537 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:10:33.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:33 smithi132 bash[27079]: audit 2020-07-16T14:10:32.916402+0000 mon.b (mon.2) 453 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:10:33.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:33 smithi132 bash[27079]: cephadm 2020-07-16T14:10:32.917044+0000 mgr.x (mgr.34562) 1536 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:10:33.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:33 smithi132 bash[27079]: cephadm 2020-07-16T14:10:32.917357+0000 mgr.x (mgr.34562) 1537 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:10:34.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:34 smithi188 bash[23329]: cluster 2020-07-16T14:10:33.919456+0000 mgr.x (mgr.34562) 1538 : cluster [DBG] pgmap v957: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:10:34.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:34 smithi132 bash[27079]: cluster 2020-07-16T14:10:33.919456+0000 mgr.x (mgr.34562) 1538 : cluster [DBG] pgmap v957: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:10:37.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:36 smithi132 bash[27079]: cluster 2020-07-16T14:10:35.919878+0000 mgr.x (mgr.34562) 1539 : cluster [DBG] pgmap v958: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:10:37.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:36 smithi188 bash[23329]: cluster 2020-07-16T14:10:35.919878+0000 mgr.x (mgr.34562) 1539 : cluster [DBG] pgmap v958: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:10:39.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:38 smithi132 bash[27079]: cluster 2020-07-16T14:10:37.920261+0000 mgr.x (mgr.34562) 1540 : cluster [DBG] pgmap v959: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:10:39.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:38 smithi188 bash[23329]: cluster 2020-07-16T14:10:37.920261+0000 mgr.x (mgr.34562) 1540 : cluster [DBG] pgmap v959: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:10:39.995 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:10:40.256 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:10:40.256 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (33m) 10s ago 36m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:10:40.256 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (36m) 9s ago 36m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:10:40.257 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (33m) 9s ago 39m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:10:40.257 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (33m) 10s ago 40m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:10:40.257 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 10s ago 41m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:10:40.257 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (39m) 9s ago 39m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:10:40.258 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (39m) 10s ago 39m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:10:40.258 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (36m) 10s ago 36m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:10:40.258 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (36m) 9s ago 36m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:10:40.258 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (39m) 10s ago 39m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:10:40.258 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (38m) 10s ago 38m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:10:40.259 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (38m) 10s ago 38m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:10:40.259 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (38m) 10s ago 38m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:10:40.259 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (37m) 9s ago 37m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:10:40.259 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (37m) 9s ago 37m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:10:40.259 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (37m) 9s ago 37m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:10:40.260 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (37m) 9s ago 37m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:10:40.260 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (35m) 9s ago 36m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:10:40.559 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:10:40.560 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:10:40.560 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:10:40.560 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:10:40.561 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:10:40.561 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:10:40.561 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:10:40.561 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:10:40.562 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:10:40.562 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:10:40.562 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:10:40.562 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:10:40.563 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:10:40.563 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:10:40.563 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:10:40.563 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:10:40.563 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:10:40.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:40 smithi188 bash[23329]: cluster 2020-07-16T14:10:39.920633+0000 mgr.x (mgr.34562) 1541 : cluster [DBG] pgmap v960: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:10:40.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:40 smithi188 bash[23329]: audit 2020-07-16T14:10:39.982240+0000 mgr.x (mgr.34562) 1542 : audit [DBG] from='client.25756 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:10:40.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:40 smithi132 bash[27079]: cluster 2020-07-16T14:10:39.920633+0000 mgr.x (mgr.34562) 1541 : cluster [DBG] pgmap v960: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:10:40.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:40 smithi132 bash[27079]: audit 2020-07-16T14:10:39.982240+0000 mgr.x (mgr.34562) 1542 : audit [DBG] from='client.25756 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:10:41.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:41 smithi188 bash[23329]: audit 2020-07-16T14:10:40.251732+0000 mgr.x (mgr.34562) 1543 : audit [DBG] from='client.25762 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:10:41.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:41 smithi188 bash[23329]: audit 2020-07-16T14:10:40.558371+0000 mon.c (mon.1) 153 : audit [DBG] from='client.? 172.21.15.132:0/1413866069' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:10:41.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:41 smithi132 bash[27079]: audit 2020-07-16T14:10:40.251732+0000 mgr.x (mgr.34562) 1543 : audit [DBG] from='client.25762 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:10:41.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:41 smithi132 bash[27079]: audit 2020-07-16T14:10:40.558371+0000 mon.c (mon.1) 153 : audit [DBG] from='client.? 172.21.15.132:0/1413866069' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:10:42.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:42 smithi188 bash[23329]: cluster 2020-07-16T14:10:41.920960+0000 mgr.x (mgr.34562) 1544 : cluster [DBG] pgmap v961: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:10:42.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:42 smithi132 bash[27079]: cluster 2020-07-16T14:10:41.920960+0000 mgr.x (mgr.34562) 1544 : cluster [DBG] pgmap v961: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:10:45.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:44 smithi132 bash[27079]: cluster 2020-07-16T14:10:43.921389+0000 mgr.x (mgr.34562) 1545 : cluster [DBG] pgmap v962: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:10:45.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:44 smithi188 bash[23329]: cluster 2020-07-16T14:10:43.921389+0000 mgr.x (mgr.34562) 1545 : cluster [DBG] pgmap v962: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:10:47.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:46 smithi132 bash[27079]: cluster 2020-07-16T14:10:45.921878+0000 mgr.x (mgr.34562) 1546 : cluster [DBG] pgmap v963: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:10:47.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:46 smithi188 bash[23329]: cluster 2020-07-16T14:10:45.921878+0000 mgr.x (mgr.34562) 1546 : cluster [DBG] pgmap v963: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:10:48.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:47 smithi132 bash[27079]: audit 2020-07-16T14:10:47.932948+0000 mon.b (mon.2) 454 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:10:48.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:47 smithi188 bash[23329]: audit 2020-07-16T14:10:47.932948+0000 mon.b (mon.2) 454 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:10:49.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:48 smithi132 bash[27079]: cluster 2020-07-16T14:10:47.922272+0000 mgr.x (mgr.34562) 1547 : cluster [DBG] pgmap v964: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:10:49.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:48 smithi132 bash[27079]: cephadm 2020-07-16T14:10:47.933702+0000 mgr.x (mgr.34562) 1548 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:10:49.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:48 smithi132 bash[27079]: cephadm 2020-07-16T14:10:47.934122+0000 mgr.x (mgr.34562) 1549 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:10:49.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:48 smithi188 bash[23329]: cluster 2020-07-16T14:10:47.922272+0000 mgr.x (mgr.34562) 1547 : cluster [DBG] pgmap v964: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:10:49.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:48 smithi188 bash[23329]: cephadm 2020-07-16T14:10:47.933702+0000 mgr.x (mgr.34562) 1548 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:10:49.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:48 smithi188 bash[23329]: cephadm 2020-07-16T14:10:47.934122+0000 mgr.x (mgr.34562) 1549 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:10:50.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:50 smithi188 bash[23329]: cluster 2020-07-16T14:10:49.922645+0000 mgr.x (mgr.34562) 1550 : cluster [DBG] pgmap v965: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:10:50.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:50 smithi132 bash[27079]: cluster 2020-07-16T14:10:49.922645+0000 mgr.x (mgr.34562) 1550 : cluster [DBG] pgmap v965: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:10:53.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:52 smithi132 bash[27079]: cluster 2020-07-16T14:10:51.923041+0000 mgr.x (mgr.34562) 1551 : cluster [DBG] pgmap v966: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:10:53.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:52 smithi188 bash[23329]: cluster 2020-07-16T14:10:51.923041+0000 mgr.x (mgr.34562) 1551 : cluster [DBG] pgmap v966: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:10:55.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:54 smithi132 bash[27079]: cluster 2020-07-16T14:10:53.923557+0000 mgr.x (mgr.34562) 1552 : cluster [DBG] pgmap v967: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:10:55.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:54 smithi188 bash[23329]: cluster 2020-07-16T14:10:53.923557+0000 mgr.x (mgr.34562) 1552 : cluster [DBG] pgmap v967: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:10:57.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:56 smithi132 bash[27079]: cluster 2020-07-16T14:10:55.923937+0000 mgr.x (mgr.34562) 1553 : cluster [DBG] pgmap v968: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:10:57.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:56 smithi188 bash[23329]: cluster 2020-07-16T14:10:55.923937+0000 mgr.x (mgr.34562) 1553 : cluster [DBG] pgmap v968: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:10:59.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:10:58 smithi132 bash[27079]: cluster 2020-07-16T14:10:57.924498+0000 mgr.x (mgr.34562) 1554 : cluster [DBG] pgmap v969: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:10:59.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:10:58 smithi188 bash[23329]: cluster 2020-07-16T14:10:57.924498+0000 mgr.x (mgr.34562) 1554 : cluster [DBG] pgmap v969: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:11:00.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:11:00 smithi188 bash[23329]: cluster 2020-07-16T14:10:59.924881+0000 mgr.x (mgr.34562) 1555 : cluster [DBG] pgmap v970: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:11:00.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:11:00 smithi132 bash[27079]: cluster 2020-07-16T14:10:59.924881+0000 mgr.x (mgr.34562) 1555 : cluster [DBG] pgmap v970: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:11:03.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:11:02 smithi132 bash[27079]: cluster 2020-07-16T14:11:01.925257+0000 mgr.x (mgr.34562) 1556 : cluster [DBG] pgmap v971: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:11:03.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:11:02 smithi132 bash[27079]: audit 2020-07-16T14:11:02.949632+0000 mon.b (mon.2) 455 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:11:03.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:11:02 smithi188 bash[23329]: cluster 2020-07-16T14:11:01.925257+0000 mgr.x (mgr.34562) 1556 : cluster [DBG] pgmap v971: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:11:03.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:11:02 smithi188 bash[23329]: audit 2020-07-16T14:11:02.949632+0000 mon.b (mon.2) 455 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:11:04.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:11:03 smithi132 bash[27079]: cephadm 2020-07-16T14:11:02.950366+0000 mgr.x (mgr.34562) 1557 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:11:04.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:11:03 smithi132 bash[27079]: cephadm 2020-07-16T14:11:02.950728+0000 mgr.x (mgr.34562) 1558 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:11:04.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:11:03 smithi188 bash[23329]: cephadm 2020-07-16T14:11:02.950366+0000 mgr.x (mgr.34562) 1557 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:11:04.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:11:03 smithi188 bash[23329]: cephadm 2020-07-16T14:11:02.950728+0000 mgr.x (mgr.34562) 1558 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:11:05.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:11:04 smithi132 bash[27079]: cluster 2020-07-16T14:11:03.925755+0000 mgr.x (mgr.34562) 1559 : cluster [DBG] pgmap v972: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:11:05.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:11:04 smithi188 bash[23329]: cluster 2020-07-16T14:11:03.925755+0000 mgr.x (mgr.34562) 1559 : cluster [DBG] pgmap v972: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:11:07.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:11:06 smithi132 bash[27079]: cluster 2020-07-16T14:11:05.926266+0000 mgr.x (mgr.34562) 1560 : cluster [DBG] pgmap v973: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:11:07.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:11:06 smithi188 bash[23329]: cluster 2020-07-16T14:11:05.926266+0000 mgr.x (mgr.34562) 1560 : cluster [DBG] pgmap v973: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:11:09.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:11:08 smithi132 bash[27079]: cluster 2020-07-16T14:11:07.926797+0000 mgr.x (mgr.34562) 1561 : cluster [DBG] pgmap v974: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:11:09.430 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:11:08 smithi188 bash[23329]: cluster 2020-07-16T14:11:07.926797+0000 mgr.x (mgr.34562) 1561 : cluster [DBG] pgmap v974: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:11:10.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:11:10 smithi188 bash[23329]: cluster 2020-07-16T14:11:09.927193+0000 mgr.x (mgr.34562) 1562 : cluster [DBG] pgmap v975: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:11:10.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:11:10 smithi132 bash[27079]: cluster 2020-07-16T14:11:09.927193+0000 mgr.x (mgr.34562) 1562 : cluster [DBG] pgmap v975: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:11:10.855 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:11:11.117 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:11:11.118 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (33m) 41s ago 36m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:11:11.118 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (36m) 40s ago 36m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:11:11.118 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (34m) 40s ago 39m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:11:11.118 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (33m) 41s ago 41m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:11:11.118 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 41s ago 41m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:11:11.119 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (40m) 40s ago 40m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:11:11.119 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (40m) 41s ago 40m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:11:11.119 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (37m) 41s ago 37m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:11:11.120 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (37m) 40s ago 37m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:11:11.120 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (39m) 41s ago 39m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:11:11.120 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (39m) 41s ago 39m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:11:11.120 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (38m) 41s ago 39m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:11:11.120 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (38m) 41s ago 38m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:11:11.121 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (38m) 40s ago 38m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:11:11.121 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (38m) 40s ago 38m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:11:11.122 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (37m) 40s ago 37m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:11:11.122 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (37m) 40s ago 37m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:11:11.122 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (36m) 40s ago 37m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:11:11.416 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:11:11.416 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:11:11.416 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:11:11.417 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:11:11.417 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:11:11.417 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:11:11.417 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:11:11.417 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:11:11.418 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:11:11.418 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:11:11.418 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:11:11.418 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:11:11.418 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:11:11.418 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:11:11.419 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:11:11.419 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:11:11.419 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:11:11.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:11:11 smithi188 bash[23329]: audit 2020-07-16T14:11:10.843213+0000 mgr.x (mgr.34562) 1563 : audit [DBG] from='client.25774 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:11:11.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:11:11 smithi188 bash[23329]: audit 2020-07-16T14:11:11.112793+0000 mgr.x (mgr.34562) 1564 : audit [DBG] from='client.25780 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:11:11.784 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:11:11 smithi132 bash[27079]: audit 2020-07-16T14:11:10.843213+0000 mgr.x (mgr.34562) 1563 : audit [DBG] from='client.25774 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:11:11.785 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:11:11 smithi132 bash[27079]: audit 2020-07-16T14:11:11.112793+0000 mgr.x (mgr.34562) 1564 : audit [DBG] from='client.25780 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:11:12.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:11:12 smithi188 bash[23329]: audit 2020-07-16T14:11:11.415070+0000 mon.c (mon.1) 154 : audit [DBG] from='client.? 172.21.15.132:0/3387736609' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:11:12.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:11:12 smithi188 bash[23329]: cluster 2020-07-16T14:11:11.927675+0000 mgr.x (mgr.34562) 1565 : cluster [DBG] pgmap v976: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:11:12.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:11:12 smithi132 bash[27079]: audit 2020-07-16T14:11:11.415070+0000 mon.c (mon.1) 154 : audit [DBG] from='client.? 172.21.15.132:0/3387736609' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:11:12.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:11:12 smithi132 bash[27079]: cluster 2020-07-16T14:11:11.927675+0000 mgr.x (mgr.34562) 1565 : cluster [DBG] pgmap v976: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:11:15.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:11:14 smithi132 bash[27079]: cluster 2020-07-16T14:11:13.928058+0000 mgr.x (mgr.34562) 1566 : cluster [DBG] pgmap v977: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:11:15.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:11:14 smithi188 bash[23329]: cluster 2020-07-16T14:11:13.928058+0000 mgr.x (mgr.34562) 1566 : cluster [DBG] pgmap v977: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:11:17.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:11:16 smithi132 bash[27079]: cluster 2020-07-16T14:11:15.928559+0000 mgr.x (mgr.34562) 1567 : cluster [DBG] pgmap v978: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:11:17.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:11:16 smithi188 bash[23329]: cluster 2020-07-16T14:11:15.928559+0000 mgr.x (mgr.34562) 1567 : cluster [DBG] pgmap v978: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:11:18.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:11:17 smithi132 bash[27079]: audit 2020-07-16T14:11:17.966204+0000 mon.b (mon.2) 456 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:11:18.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:11:17 smithi188 bash[23329]: audit 2020-07-16T14:11:17.966204+0000 mon.b (mon.2) 456 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:11:19.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:11:18 smithi132 bash[27079]: cluster 2020-07-16T14:11:17.929088+0000 mgr.x (mgr.34562) 1568 : cluster [DBG] pgmap v979: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:11:19.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:11:18 smithi132 bash[27079]: cephadm 2020-07-16T14:11:17.966890+0000 mgr.x (mgr.34562) 1569 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:11:19.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:11:18 smithi132 bash[27079]: cephadm 2020-07-16T14:11:17.967324+0000 mgr.x (mgr.34562) 1570 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:11:19.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:11:18 smithi188 bash[23329]: cluster 2020-07-16T14:11:17.929088+0000 mgr.x (mgr.34562) 1568 : cluster [DBG] pgmap v979: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:11:19.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:11:18 smithi188 bash[23329]: cephadm 2020-07-16T14:11:17.966890+0000 mgr.x (mgr.34562) 1569 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:11:19.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:11:18 smithi188 bash[23329]: cephadm 2020-07-16T14:11:17.967324+0000 mgr.x (mgr.34562) 1570 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:11:20.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:11:20 smithi188 bash[23329]: cluster 2020-07-16T14:11:19.929545+0000 mgr.x (mgr.34562) 1571 : cluster [DBG] pgmap v980: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:11:20.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:11:20 smithi132 bash[27079]: cluster 2020-07-16T14:11:19.929545+0000 mgr.x (mgr.34562) 1571 : cluster [DBG] pgmap v980: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:11:23.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:11:22 smithi132 bash[27079]: cluster 2020-07-16T14:11:21.929934+0000 mgr.x (mgr.34562) 1572 : cluster [DBG] pgmap v981: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:11:23.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:11:22 smithi188 bash[23329]: cluster 2020-07-16T14:11:21.929934+0000 mgr.x (mgr.34562) 1572 : cluster [DBG] pgmap v981: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:11:25.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:11:24 smithi132 bash[27079]: cluster 2020-07-16T14:11:23.930455+0000 mgr.x (mgr.34562) 1573 : cluster [DBG] pgmap v982: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:11:25.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:11:24 smithi188 bash[23329]: cluster 2020-07-16T14:11:23.930455+0000 mgr.x (mgr.34562) 1573 : cluster [DBG] pgmap v982: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:11:27.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:11:26 smithi132 bash[27079]: cluster 2020-07-16T14:11:25.930985+0000 mgr.x (mgr.34562) 1574 : cluster [DBG] pgmap v983: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:11:27.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:11:26 smithi188 bash[23329]: cluster 2020-07-16T14:11:25.930985+0000 mgr.x (mgr.34562) 1574 : cluster [DBG] pgmap v983: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:11:29.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:11:28 smithi132 bash[27079]: cluster 2020-07-16T14:11:27.931499+0000 mgr.x (mgr.34562) 1575 : cluster [DBG] pgmap v984: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:11:29.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:11:28 smithi188 bash[23329]: cluster 2020-07-16T14:11:27.931499+0000 mgr.x (mgr.34562) 1575 : cluster [DBG] pgmap v984: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:11:30.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:11:30 smithi188 bash[23329]: cluster 2020-07-16T14:11:29.931901+0000 mgr.x (mgr.34562) 1576 : cluster [DBG] pgmap v985: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:11:30.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:11:30 smithi132 bash[27079]: cluster 2020-07-16T14:11:29.931901+0000 mgr.x (mgr.34562) 1576 : cluster [DBG] pgmap v985: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:11:33.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:11:32 smithi132 bash[27079]: cluster 2020-07-16T14:11:31.932333+0000 mgr.x (mgr.34562) 1577 : cluster [DBG] pgmap v986: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:11:33.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:11:32 smithi188 bash[23329]: cluster 2020-07-16T14:11:31.932333+0000 mgr.x (mgr.34562) 1577 : cluster [DBG] pgmap v986: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:11:34.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:11:33 smithi132 bash[27079]: audit 2020-07-16T14:11:32.985488+0000 mon.b (mon.2) 457 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:11:34.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:11:33 smithi132 bash[27079]: audit 2020-07-16T14:11:32.985923+0000 mgr.x (mgr.34562) 1578 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:11:34.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:11:33 smithi132 bash[27079]: audit 2020-07-16T14:11:32.990683+0000 mon.b (mon.2) 458 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:11:34.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:11:33 smithi132 bash[27079]: audit 2020-07-16T14:11:32.991039+0000 mgr.x (mgr.34562) 1579 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:11:34.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:11:33 smithi132 bash[27079]: audit 2020-07-16T14:11:32.991939+0000 mon.b (mon.2) 459 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:11:34.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:11:33 smithi132 bash[27079]: audit 2020-07-16T14:11:32.992220+0000 mgr.x (mgr.34562) 1580 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:11:34.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:11:33 smithi132 bash[27079]: cephadm 2020-07-16T14:11:32.992956+0000 mgr.x (mgr.34562) 1581 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:11:34.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:11:33 smithi132 bash[27079]: audit 2020-07-16T14:11:32.993405+0000 mon.b (mon.2) 460 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:11:34.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:11:33 smithi132 bash[27079]: cephadm 2020-07-16T14:11:32.994261+0000 mgr.x (mgr.34562) 1582 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:11:34.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:11:33 smithi132 bash[27079]: audit 2020-07-16T14:11:32.994818+0000 mon.b (mon.2) 461 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:11:34.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:11:33 smithi132 bash[27079]: cephadm 2020-07-16T14:11:32.995540+0000 mgr.x (mgr.34562) 1583 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:11:34.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:11:33 smithi132 bash[27079]: cephadm 2020-07-16T14:11:32.995608+0000 mgr.x (mgr.34562) 1584 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:11:34.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:11:33 smithi188 bash[23329]: audit 2020-07-16T14:11:32.985488+0000 mon.b (mon.2) 457 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:11:34.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:11:33 smithi188 bash[23329]: audit 2020-07-16T14:11:32.985923+0000 mgr.x (mgr.34562) 1578 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:11:34.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:11:33 smithi188 bash[23329]: audit 2020-07-16T14:11:32.990683+0000 mon.b (mon.2) 458 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:11:34.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:11:33 smithi188 bash[23329]: audit 2020-07-16T14:11:32.991039+0000 mgr.x (mgr.34562) 1579 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:11:34.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:11:33 smithi188 bash[23329]: audit 2020-07-16T14:11:32.991939+0000 mon.b (mon.2) 459 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:11:34.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:11:33 smithi188 bash[23329]: audit 2020-07-16T14:11:32.992220+0000 mgr.x (mgr.34562) 1580 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:11:34.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:11:33 smithi188 bash[23329]: cephadm 2020-07-16T14:11:32.992956+0000 mgr.x (mgr.34562) 1581 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:11:34.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:11:33 smithi188 bash[23329]: audit 2020-07-16T14:11:32.993405+0000 mon.b (mon.2) 460 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:11:34.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:11:33 smithi188 bash[23329]: cephadm 2020-07-16T14:11:32.994261+0000 mgr.x (mgr.34562) 1582 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:11:34.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:11:33 smithi188 bash[23329]: audit 2020-07-16T14:11:32.994818+0000 mon.b (mon.2) 461 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:11:34.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:11:33 smithi188 bash[23329]: cephadm 2020-07-16T14:11:32.995540+0000 mgr.x (mgr.34562) 1583 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:11:34.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:11:33 smithi188 bash[23329]: cephadm 2020-07-16T14:11:32.995608+0000 mgr.x (mgr.34562) 1584 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:11:35.261 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:11:34 smithi132 bash[27079]: cluster 2020-07-16T14:11:33.932650+0000 mgr.x (mgr.34562) 1585 : cluster [DBG] pgmap v987: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:11:35.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:11:34 smithi188 bash[23329]: cluster 2020-07-16T14:11:33.932650+0000 mgr.x (mgr.34562) 1585 : cluster [DBG] pgmap v987: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:11:36.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:11:35 smithi132 bash[27079]: audit 2020-07-16T14:11:35.836201+0000 mon.b (mon.2) 462 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:11:36.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:11:35 smithi188 bash[23329]: audit 2020-07-16T14:11:35.836201+0000 mon.b (mon.2) 462 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:11:37.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:11:37 smithi132 bash[27079]: cephadm 2020-07-16T14:11:35.836898+0000 mgr.x (mgr.34562) 1586 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:11:37.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:11:37 smithi132 bash[27079]: cephadm 2020-07-16T14:11:35.837144+0000 mgr.x (mgr.34562) 1587 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:11:37.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:11:37 smithi132 bash[27079]: cluster 2020-07-16T14:11:35.933032+0000 mgr.x (mgr.34562) 1588 : cluster [DBG] pgmap v988: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:11:37.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:11:37 smithi188 bash[23329]: cephadm 2020-07-16T14:11:35.836898+0000 mgr.x (mgr.34562) 1586 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:11:37.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:11:37 smithi188 bash[23329]: cephadm 2020-07-16T14:11:35.837144+0000 mgr.x (mgr.34562) 1587 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:11:37.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:11:37 smithi188 bash[23329]: cluster 2020-07-16T14:11:35.933032+0000 mgr.x (mgr.34562) 1588 : cluster [DBG] pgmap v988: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:11:39.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:11:39 smithi132 bash[27079]: cluster 2020-07-16T14:11:37.933416+0000 mgr.x (mgr.34562) 1589 : cluster [DBG] pgmap v989: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:11:39.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:11:39 smithi188 bash[23329]: cluster 2020-07-16T14:11:37.933416+0000 mgr.x (mgr.34562) 1589 : cluster [DBG] pgmap v989: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:11:40.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:11:40 smithi188 bash[23329]: cluster 2020-07-16T14:11:39.933892+0000 mgr.x (mgr.34562) 1590 : cluster [DBG] pgmap v990: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:11:40.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:11:40 smithi132 bash[27079]: cluster 2020-07-16T14:11:39.933892+0000 mgr.x (mgr.34562) 1590 : cluster [DBG] pgmap v990: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:11:41.713 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:11:41.973 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:11:41.973 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (34m) 71s ago 37m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:11:41.973 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (37m) 71s ago 37m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:11:41.974 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (34m) 71s ago 40m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:11:41.974 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (34m) 71s ago 42m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:11:41.974 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 71s ago 42m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:11:41.974 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (40m) 71s ago 40m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:11:41.974 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (40m) 71s ago 40m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:11:41.975 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (37m) 71s ago 37m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:11:41.975 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (37m) 71s ago 37m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:11:41.975 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (40m) 71s ago 40m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:11:41.975 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (39m) 71s ago 39m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:11:41.975 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (39m) 71s ago 39m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:11:41.976 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (39m) 71s ago 39m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:11:41.976 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (38m) 71s ago 38m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:11:41.976 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (38m) 71s ago 38m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:11:41.976 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (38m) 71s ago 38m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:11:41.976 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (38m) 71s ago 38m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:11:41.977 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (36m) 71s ago 37m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:11:42.269 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:11:42.270 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:11:42.270 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:11:42.270 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:11:42.270 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:11:42.270 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:11:42.271 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:11:42.271 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:11:42.271 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:11:42.271 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:11:42.271 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:11:42.272 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:11:42.272 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:11:42.272 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:11:42.272 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:11:42.273 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:11:42.273 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:11:43.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:11:42 smithi132 bash[27079]: audit 2020-07-16T14:11:41.700934+0000 mgr.x (mgr.34562) 1591 : audit [DBG] from='client.25792 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:11:43.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:11:42 smithi132 bash[27079]: cluster 2020-07-16T14:11:41.934385+0000 mgr.x (mgr.34562) 1592 : cluster [DBG] pgmap v991: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:11:43.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:11:42 smithi132 bash[27079]: audit 2020-07-16T14:11:41.968399+0000 mgr.x (mgr.34562) 1593 : audit [DBG] from='client.25798 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:11:43.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:11:42 smithi132 bash[27079]: audit 2020-07-16T14:11:42.268494+0000 mon.c (mon.1) 155 : audit [DBG] from='client.? 172.21.15.132:0/4206159105' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:11:43.425 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:11:42 smithi188 bash[23329]: audit 2020-07-16T14:11:41.700934+0000 mgr.x (mgr.34562) 1591 : audit [DBG] from='client.25792 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:11:43.425 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:11:42 smithi188 bash[23329]: cluster 2020-07-16T14:11:41.934385+0000 mgr.x (mgr.34562) 1592 : cluster [DBG] pgmap v991: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:11:43.425 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:11:42 smithi188 bash[23329]: audit 2020-07-16T14:11:41.968399+0000 mgr.x (mgr.34562) 1593 : audit [DBG] from='client.25798 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:11:43.425 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:11:42 smithi188 bash[23329]: audit 2020-07-16T14:11:42.268494+0000 mon.c (mon.1) 155 : audit [DBG] from='client.? 172.21.15.132:0/4206159105' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:11:45.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:11:44 smithi132 bash[27079]: cluster 2020-07-16T14:11:43.934737+0000 mgr.x (mgr.34562) 1594 : cluster [DBG] pgmap v992: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:11:45.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:11:44 smithi188 bash[23329]: cluster 2020-07-16T14:11:43.934737+0000 mgr.x (mgr.34562) 1594 : cluster [DBG] pgmap v992: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:11:47.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:11:46 smithi132 bash[27079]: cluster 2020-07-16T14:11:45.935137+0000 mgr.x (mgr.34562) 1595 : cluster [DBG] pgmap v993: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:11:47.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:11:46 smithi188 bash[23329]: cluster 2020-07-16T14:11:45.935137+0000 mgr.x (mgr.34562) 1595 : cluster [DBG] pgmap v993: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:11:49.288 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:11:48 smithi132 bash[27079]: cluster 2020-07-16T14:11:47.935664+0000 mgr.x (mgr.34562) 1596 : cluster [DBG] pgmap v994: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:11:49.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:11:49 smithi188 bash[23329]: cluster 2020-07-16T14:11:47.935664+0000 mgr.x (mgr.34562) 1596 : cluster [DBG] pgmap v994: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:11:50.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:11:50 smithi188 bash[23329]: cluster 2020-07-16T14:11:49.936190+0000 mgr.x (mgr.34562) 1597 : cluster [DBG] pgmap v995: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:11:50.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:11:50 smithi132 bash[27079]: cluster 2020-07-16T14:11:49.936190+0000 mgr.x (mgr.34562) 1597 : cluster [DBG] pgmap v995: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:11:51.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:11:51 smithi188 bash[23329]: audit 2020-07-16T14:11:50.852868+0000 mon.b (mon.2) 463 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:11:51.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:11:51 smithi188 bash[23329]: cephadm 2020-07-16T14:11:50.853527+0000 mgr.x (mgr.34562) 1598 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:11:51.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:11:51 smithi188 bash[23329]: cephadm 2020-07-16T14:11:50.853843+0000 mgr.x (mgr.34562) 1599 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:11:51.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:11:51 smithi132 bash[27079]: audit 2020-07-16T14:11:50.852868+0000 mon.b (mon.2) 463 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:11:51.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:11:51 smithi132 bash[27079]: cephadm 2020-07-16T14:11:50.853527+0000 mgr.x (mgr.34562) 1598 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:11:51.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:11:51 smithi132 bash[27079]: cephadm 2020-07-16T14:11:50.853843+0000 mgr.x (mgr.34562) 1599 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:11:52.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:11:52 smithi188 bash[23329]: cluster 2020-07-16T14:11:51.936718+0000 mgr.x (mgr.34562) 1600 : cluster [DBG] pgmap v996: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:11:52.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:11:52 smithi132 bash[27079]: cluster 2020-07-16T14:11:51.936718+0000 mgr.x (mgr.34562) 1600 : cluster [DBG] pgmap v996: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:11:55.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:11:54 smithi132 bash[27079]: cluster 2020-07-16T14:11:53.937184+0000 mgr.x (mgr.34562) 1601 : cluster [DBG] pgmap v997: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:11:55.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:11:54 smithi188 bash[23329]: cluster 2020-07-16T14:11:53.937184+0000 mgr.x (mgr.34562) 1601 : cluster [DBG] pgmap v997: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:11:57.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:11:56 smithi132 bash[27079]: cluster 2020-07-16T14:11:55.937650+0000 mgr.x (mgr.34562) 1602 : cluster [DBG] pgmap v998: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:11:57.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:11:56 smithi188 bash[23329]: cluster 2020-07-16T14:11:55.937650+0000 mgr.x (mgr.34562) 1602 : cluster [DBG] pgmap v998: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:11:59.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:11:58 smithi132 bash[27079]: cluster 2020-07-16T14:11:57.938160+0000 mgr.x (mgr.34562) 1603 : cluster [DBG] pgmap v999: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:11:59.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:11:58 smithi188 bash[23329]: cluster 2020-07-16T14:11:57.938160+0000 mgr.x (mgr.34562) 1603 : cluster [DBG] pgmap v999: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:12:00.677 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:00 smithi188 bash[23329]: cluster 2020-07-16T14:11:59.938627+0000 mgr.x (mgr.34562) 1604 : cluster [DBG] pgmap v1000: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:12:00.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:00 smithi132 bash[27079]: cluster 2020-07-16T14:11:59.938627+0000 mgr.x (mgr.34562) 1604 : cluster [DBG] pgmap v1000: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:12:03.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:02 smithi132 bash[27079]: cluster 2020-07-16T14:12:01.939162+0000 mgr.x (mgr.34562) 1605 : cluster [DBG] pgmap v1001: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:12:03.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:02 smithi188 bash[23329]: cluster 2020-07-16T14:12:01.939162+0000 mgr.x (mgr.34562) 1605 : cluster [DBG] pgmap v1001: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:12:05.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:04 smithi132 bash[27079]: cluster 2020-07-16T14:12:03.939679+0000 mgr.x (mgr.34562) 1606 : cluster [DBG] pgmap v1002: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:12:05.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:04 smithi188 bash[23329]: cluster 2020-07-16T14:12:03.939679+0000 mgr.x (mgr.34562) 1606 : cluster [DBG] pgmap v1002: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:12:06.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:06 smithi132 bash[27079]: audit 2020-07-16T14:12:05.869257+0000 mon.b (mon.2) 464 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:12:06.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:06 smithi188 bash[23329]: audit 2020-07-16T14:12:05.869257+0000 mon.b (mon.2) 464 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:12:07.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:07 smithi132 bash[27079]: cephadm 2020-07-16T14:12:05.869957+0000 mgr.x (mgr.34562) 1607 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:12:07.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:07 smithi132 bash[27079]: cephadm 2020-07-16T14:12:05.870302+0000 mgr.x (mgr.34562) 1608 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:12:07.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:07 smithi132 bash[27079]: cluster 2020-07-16T14:12:05.940118+0000 mgr.x (mgr.34562) 1609 : cluster [DBG] pgmap v1003: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:12:07.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:07 smithi188 bash[23329]: cephadm 2020-07-16T14:12:05.869957+0000 mgr.x (mgr.34562) 1607 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:12:07.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:07 smithi188 bash[23329]: cephadm 2020-07-16T14:12:05.870302+0000 mgr.x (mgr.34562) 1608 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:12:07.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:07 smithi188 bash[23329]: cluster 2020-07-16T14:12:05.940118+0000 mgr.x (mgr.34562) 1609 : cluster [DBG] pgmap v1003: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:12:09.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:09 smithi132 bash[27079]: cluster 2020-07-16T14:12:07.940638+0000 mgr.x (mgr.34562) 1610 : cluster [DBG] pgmap v1004: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:12:09.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:09 smithi188 bash[23329]: cluster 2020-07-16T14:12:07.940638+0000 mgr.x (mgr.34562) 1610 : cluster [DBG] pgmap v1004: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:12:10.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:10 smithi188 bash[23329]: cluster 2020-07-16T14:12:09.941071+0000 mgr.x (mgr.34562) 1611 : cluster [DBG] pgmap v1005: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:12:10.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:10 smithi132 bash[27079]: cluster 2020-07-16T14:12:09.941071+0000 mgr.x (mgr.34562) 1611 : cluster [DBG] pgmap v1005: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:12:12.571 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:12:12.832 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:12:12.833 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (34m) 102s ago 37m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:12:12.833 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (37m) 102s ago 37m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:12:12.833 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (35m) 102s ago 40m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:12:12.833 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (34m) 102s ago 42m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:12:12.834 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 102s ago 42m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:12:12.834 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (41m) 102s ago 41m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:12:12.834 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (41m) 102s ago 41m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:12:12.834 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (38m) 102s ago 38m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:12:12.834 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (38m) 102s ago 38m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:12:12.835 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (40m) 102s ago 40m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:12:12.835 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (40m) 102s ago 40m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:12:12.835 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (40m) 102s ago 40m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:12:12.835 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (39m) 102s ago 39m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:12:12.835 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (39m) 102s ago 39m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:12:12.836 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (39m) 102s ago 39m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:12:12.836 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (38m) 102s ago 38m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:12:12.836 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (38m) 102s ago 38m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:12:12.836 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (37m) 102s ago 38m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:12:13.131 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:12:13.132 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:12:13.132 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:12:13.132 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:12:13.133 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:12:13.133 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:12:13.133 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:12:13.134 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:12:13.134 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:12:13.134 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:12:13.134 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:12:13.134 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:12:13.135 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:12:13.135 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:12:13.135 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:12:13.135 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:12:13.135 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:12:13.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:12 smithi132 bash[27079]: cluster 2020-07-16T14:12:11.941455+0000 mgr.x (mgr.34562) 1612 : cluster [DBG] pgmap v1006: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:12:13.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:12 smithi188 bash[23329]: cluster 2020-07-16T14:12:11.941455+0000 mgr.x (mgr.34562) 1612 : cluster [DBG] pgmap v1006: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:12:14.261 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:14 smithi132 bash[27079]: audit 2020-07-16T14:12:12.557872+0000 mgr.x (mgr.34562) 1613 : audit [DBG] from='client.25810 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:12:14.262 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:14 smithi132 bash[27079]: audit 2020-07-16T14:12:12.827818+0000 mgr.x (mgr.34562) 1614 : audit [DBG] from='client.25816 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:12:14.262 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:14 smithi132 bash[27079]: audit 2020-07-16T14:12:13.130640+0000 mon.c (mon.1) 156 : audit [DBG] from='client.? 172.21.15.132:0/4096963888' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:12:14.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:14 smithi188 bash[23329]: audit 2020-07-16T14:12:12.557872+0000 mgr.x (mgr.34562) 1613 : audit [DBG] from='client.25810 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:12:14.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:14 smithi188 bash[23329]: audit 2020-07-16T14:12:12.827818+0000 mgr.x (mgr.34562) 1614 : audit [DBG] from='client.25816 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:12:14.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:14 smithi188 bash[23329]: audit 2020-07-16T14:12:13.130640+0000 mon.c (mon.1) 156 : audit [DBG] from='client.? 172.21.15.132:0/4096963888' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:12:15.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:15 smithi132 bash[27079]: cluster 2020-07-16T14:12:13.941790+0000 mgr.x (mgr.34562) 1615 : cluster [DBG] pgmap v1007: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:12:15.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:15 smithi188 bash[23329]: cluster 2020-07-16T14:12:13.941790+0000 mgr.x (mgr.34562) 1615 : cluster [DBG] pgmap v1007: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:12:17.264 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:17 smithi132 bash[27079]: cluster 2020-07-16T14:12:15.942264+0000 mgr.x (mgr.34562) 1616 : cluster [DBG] pgmap v1008: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:12:17.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:17 smithi188 bash[23329]: cluster 2020-07-16T14:12:15.942264+0000 mgr.x (mgr.34562) 1616 : cluster [DBG] pgmap v1008: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:12:19.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:19 smithi132 bash[27079]: cluster 2020-07-16T14:12:17.942780+0000 mgr.x (mgr.34562) 1617 : cluster [DBG] pgmap v1009: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:12:19.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:19 smithi188 bash[23329]: cluster 2020-07-16T14:12:17.942780+0000 mgr.x (mgr.34562) 1617 : cluster [DBG] pgmap v1009: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:12:20.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:20 smithi188 bash[23329]: cluster 2020-07-16T14:12:19.943165+0000 mgr.x (mgr.34562) 1618 : cluster [DBG] pgmap v1010: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:12:20.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:20 smithi132 bash[27079]: cluster 2020-07-16T14:12:19.943165+0000 mgr.x (mgr.34562) 1618 : cluster [DBG] pgmap v1010: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:12:21.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:21 smithi188 bash[23329]: audit 2020-07-16T14:12:20.873784+0000 mon.b (mon.2) 465 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:12:21.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:21 smithi188 bash[23329]: cephadm 2020-07-16T14:12:20.874506+0000 mgr.x (mgr.34562) 1619 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:12:21.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:21 smithi188 bash[23329]: cephadm 2020-07-16T14:12:20.874583+0000 mgr.x (mgr.34562) 1620 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:12:21.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:21 smithi132 bash[27079]: audit 2020-07-16T14:12:20.873784+0000 mon.b (mon.2) 465 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:12:21.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:21 smithi132 bash[27079]: cephadm 2020-07-16T14:12:20.874506+0000 mgr.x (mgr.34562) 1619 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:12:21.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:21 smithi132 bash[27079]: cephadm 2020-07-16T14:12:20.874583+0000 mgr.x (mgr.34562) 1620 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:12:22.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:22 smithi188 bash[23329]: cluster 2020-07-16T14:12:21.943704+0000 mgr.x (mgr.34562) 1621 : cluster [DBG] pgmap v1011: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:12:22.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:22 smithi132 bash[27079]: cluster 2020-07-16T14:12:21.943704+0000 mgr.x (mgr.34562) 1621 : cluster [DBG] pgmap v1011: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:12:25.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:24 smithi132 bash[27079]: cluster 2020-07-16T14:12:23.944156+0000 mgr.x (mgr.34562) 1622 : cluster [DBG] pgmap v1012: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:12:25.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:25 smithi188 bash[23329]: cluster 2020-07-16T14:12:23.944156+0000 mgr.x (mgr.34562) 1622 : cluster [DBG] pgmap v1012: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:12:27.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:27 smithi132 bash[27079]: cluster 2020-07-16T14:12:25.944580+0000 mgr.x (mgr.34562) 1623 : cluster [DBG] pgmap v1013: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:12:27.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:27 smithi188 bash[23329]: cluster 2020-07-16T14:12:25.944580+0000 mgr.x (mgr.34562) 1623 : cluster [DBG] pgmap v1013: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:12:29.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:29 smithi132 bash[27079]: cluster 2020-07-16T14:12:27.945059+0000 mgr.x (mgr.34562) 1624 : cluster [DBG] pgmap v1014: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:12:29.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:29 smithi188 bash[23329]: cluster 2020-07-16T14:12:27.945059+0000 mgr.x (mgr.34562) 1624 : cluster [DBG] pgmap v1014: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:12:30.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:30 smithi188 bash[23329]: cluster 2020-07-16T14:12:29.945461+0000 mgr.x (mgr.34562) 1625 : cluster [DBG] pgmap v1015: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:12:30.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:30 smithi132 bash[27079]: cluster 2020-07-16T14:12:29.945461+0000 mgr.x (mgr.34562) 1625 : cluster [DBG] pgmap v1015: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:12:33.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:33 smithi132 bash[27079]: cluster 2020-07-16T14:12:31.946015+0000 mgr.x (mgr.34562) 1626 : cluster [DBG] pgmap v1016: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:12:33.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:33 smithi188 bash[23329]: cluster 2020-07-16T14:12:31.946015+0000 mgr.x (mgr.34562) 1626 : cluster [DBG] pgmap v1016: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:12:35.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:35 smithi132 bash[27079]: cluster 2020-07-16T14:12:33.946453+0000 mgr.x (mgr.34562) 1627 : cluster [DBG] pgmap v1017: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:12:35.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:35 smithi188 bash[23329]: cluster 2020-07-16T14:12:33.946453+0000 mgr.x (mgr.34562) 1627 : cluster [DBG] pgmap v1017: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:12:37.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:37 smithi132 bash[27079]: cluster 2020-07-16T14:12:35.946779+0000 mgr.x (mgr.34562) 1628 : cluster [DBG] pgmap v1018: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:12:37.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:37 smithi132 bash[27079]: audit 2020-07-16T14:12:36.124617+0000 mon.b (mon.2) 466 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.262699\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.262770\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.262801\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.262961\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.263063\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.263161\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.263260\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.263318\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.263348\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:10:30.263421\", \"last_device_update\": \"2020-07-16T14:04:10.964865\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:12:36.123740\"}"}]: dispatch 2020-07-16T14:12:37.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:37 smithi132 bash[27079]: audit 2020-07-16T14:12:36.124904+0000 mon.b (mon.2) 467 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:10:30.076899\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.076959\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.076995\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077024\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077207\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077334\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077439\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077540\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077574\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:10:30.077644\", \"last_device_update\": \"2020-07-16T14:03:05.154706\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:12:36.124268\"}"}]: dispatch 2020-07-16T14:12:37.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:37 smithi132 bash[27079]: audit 2020-07-16T14:12:36.125519+0000 mon.c (mon.1) 157 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.262699\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.262770\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.262801\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.262961\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.263063\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.263161\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.263260\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.263318\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.263348\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:10:30.263421\", \"last_device_update\": \"2020-07-16T14:04:10.964865\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:12:36.123740\"}"}]: dispatch 2020-07-16T14:12:37.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:37 smithi132 bash[27079]: audit 2020-07-16T14:12:36.126344+0000 mon.c (mon.1) 158 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:10:30.076899\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.076959\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.076995\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077024\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077207\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077334\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077439\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077540\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077574\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:10:30.077644\", \"last_device_update\": \"2020-07-16T14:03:05.154706\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:12:36.124268\"}"}]: dispatch 2020-07-16T14:12:37.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:37 smithi132 bash[27079]: audit 2020-07-16T14:12:36.128539+0000 mon.c (mon.1) 159 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.262699\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.262770\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.262801\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.262961\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.263063\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.263161\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.263260\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.263318\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.263348\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:10:30.263421\", \"last_device_update\": \"2020-07-16T14:04:10.964865\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:12:36.123740\"}"}]': finished 2020-07-16T14:12:37.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:37 smithi132 bash[27079]: audit 2020-07-16T14:12:36.130663+0000 mon.c (mon.1) 160 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:10:30.076899\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.076959\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.076995\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077024\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077207\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077334\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077439\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077540\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077574\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:10:30.077644\", \"last_device_update\": \"2020-07-16T14:03:05.154706\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:12:36.124268\"}"}]': finished 2020-07-16T14:12:37.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:37 smithi132 bash[27079]: audit 2020-07-16T14:12:36.133387+0000 mon.b (mon.2) 468 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:12:37.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:37 smithi132 bash[27079]: audit 2020-07-16T14:12:36.133659+0000 mgr.x (mgr.34562) 1629 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:12:37.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:37 smithi132 bash[27079]: audit 2020-07-16T14:12:36.134325+0000 mon.b (mon.2) 469 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:12:37.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:37 smithi132 bash[27079]: audit 2020-07-16T14:12:36.134562+0000 mgr.x (mgr.34562) 1630 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:12:37.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:37 smithi132 bash[27079]: audit 2020-07-16T14:12:36.135140+0000 mon.b (mon.2) 470 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:12:37.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:37 smithi132 bash[27079]: audit 2020-07-16T14:12:36.135414+0000 mgr.x (mgr.34562) 1631 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:12:37.284 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:37 smithi132 bash[27079]: cephadm 2020-07-16T14:12:36.135913+0000 mgr.x (mgr.34562) 1632 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:12:37.284 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:37 smithi132 bash[27079]: audit 2020-07-16T14:12:36.136185+0000 mon.b (mon.2) 471 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:12:37.284 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:37 smithi132 bash[27079]: cephadm 2020-07-16T14:12:36.136794+0000 mgr.x (mgr.34562) 1633 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:12:37.284 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:37 smithi132 bash[27079]: audit 2020-07-16T14:12:36.137048+0000 mon.b (mon.2) 472 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:12:37.294 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:37 smithi132 bash[27079]: cephadm 2020-07-16T14:12:36.137543+0000 mgr.x (mgr.34562) 1634 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:12:37.294 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:37 smithi132 bash[27079]: cephadm 2020-07-16T14:12:36.137738+0000 mgr.x (mgr.34562) 1635 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:12:37.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:37 smithi188 bash[23329]: cluster 2020-07-16T14:12:35.946779+0000 mgr.x (mgr.34562) 1628 : cluster [DBG] pgmap v1018: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:12:37.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:37 smithi188 bash[23329]: audit 2020-07-16T14:12:36.124617+0000 mon.b (mon.2) 466 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.262699\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.262770\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.262801\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.262961\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.263063\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.263161\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.263260\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.263318\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.263348\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:10:30.263421\", \"last_device_update\": \"2020-07-16T14:04:10.964865\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:12:36.123740\"}"}]: dispatch 2020-07-16T14:12:37.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:37 smithi188 bash[23329]: audit 2020-07-16T14:12:36.124904+0000 mon.b (mon.2) 467 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:10:30.076899\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.076959\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.076995\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077024\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077207\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077334\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077439\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077540\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077574\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:10:30.077644\", \"last_device_update\": \"2020-07-16T14:03:05.154706\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:12:36.124268\"}"}]: dispatch 2020-07-16T14:12:37.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:37 smithi188 bash[23329]: audit 2020-07-16T14:12:36.125519+0000 mon.c (mon.1) 157 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.262699\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.262770\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.262801\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.262961\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.263063\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.263161\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.263260\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.263318\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.263348\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:10:30.263421\", \"last_device_update\": \"2020-07-16T14:04:10.964865\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:12:36.123740\"}"}]: dispatch 2020-07-16T14:12:37.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:37 smithi188 bash[23329]: audit 2020-07-16T14:12:36.126344+0000 mon.c (mon.1) 158 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:10:30.076899\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.076959\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.076995\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077024\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077207\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077334\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077439\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077540\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077574\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:10:30.077644\", \"last_device_update\": \"2020-07-16T14:03:05.154706\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:12:36.124268\"}"}]: dispatch 2020-07-16T14:12:37.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:37 smithi188 bash[23329]: audit 2020-07-16T14:12:36.128539+0000 mon.c (mon.1) 159 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.262699\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.262770\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.262801\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.262961\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.263063\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.263161\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.263260\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.263318\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.263348\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:10:30.263421\", \"last_device_update\": \"2020-07-16T14:04:10.964865\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:12:36.123740\"}"}]': finished 2020-07-16T14:12:37.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:37 smithi188 bash[23329]: audit 2020-07-16T14:12:36.130663+0000 mon.c (mon.1) 160 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:10:30.076899\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.076959\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.076995\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077024\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077207\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077334\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077439\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077540\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:10:30.077574\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:10:30.077644\", \"last_device_update\": \"2020-07-16T14:03:05.154706\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:12:36.124268\"}"}]': finished 2020-07-16T14:12:37.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:37 smithi188 bash[23329]: audit 2020-07-16T14:12:36.133387+0000 mon.b (mon.2) 468 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:12:37.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:37 smithi188 bash[23329]: audit 2020-07-16T14:12:36.133659+0000 mgr.x (mgr.34562) 1629 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:12:37.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:37 smithi188 bash[23329]: audit 2020-07-16T14:12:36.134325+0000 mon.b (mon.2) 469 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:12:37.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:37 smithi188 bash[23329]: audit 2020-07-16T14:12:36.134562+0000 mgr.x (mgr.34562) 1630 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:12:37.425 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:37 smithi188 bash[23329]: audit 2020-07-16T14:12:36.135140+0000 mon.b (mon.2) 470 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:12:37.425 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:37 smithi188 bash[23329]: audit 2020-07-16T14:12:36.135414+0000 mgr.x (mgr.34562) 1631 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:12:37.425 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:37 smithi188 bash[23329]: cephadm 2020-07-16T14:12:36.135913+0000 mgr.x (mgr.34562) 1632 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:12:37.425 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:37 smithi188 bash[23329]: audit 2020-07-16T14:12:36.136185+0000 mon.b (mon.2) 471 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:12:37.425 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:37 smithi188 bash[23329]: cephadm 2020-07-16T14:12:36.136794+0000 mgr.x (mgr.34562) 1633 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:12:37.426 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:37 smithi188 bash[23329]: audit 2020-07-16T14:12:36.137048+0000 mon.b (mon.2) 472 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:12:37.426 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:37 smithi188 bash[23329]: cephadm 2020-07-16T14:12:36.137543+0000 mgr.x (mgr.34562) 1634 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:12:37.426 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:37 smithi188 bash[23329]: cephadm 2020-07-16T14:12:36.137738+0000 mgr.x (mgr.34562) 1635 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:12:39.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:39 smithi132 bash[27079]: cluster 2020-07-16T14:12:37.947223+0000 mgr.x (mgr.34562) 1636 : cluster [DBG] pgmap v1019: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:12:39.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:39 smithi132 bash[27079]: audit 2020-07-16T14:12:38.925012+0000 mon.b (mon.2) 473 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:12:39.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:39 smithi188 bash[23329]: cluster 2020-07-16T14:12:37.947223+0000 mgr.x (mgr.34562) 1636 : cluster [DBG] pgmap v1019: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:12:39.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:39 smithi188 bash[23329]: audit 2020-07-16T14:12:38.925012+0000 mon.b (mon.2) 473 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:12:40.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:40 smithi132 bash[27079]: cephadm 2020-07-16T14:12:38.925737+0000 mgr.x (mgr.34562) 1637 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:12:40.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:40 smithi132 bash[27079]: cephadm 2020-07-16T14:12:38.925828+0000 mgr.x (mgr.34562) 1638 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:12:40.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:40 smithi188 bash[23329]: cephadm 2020-07-16T14:12:38.925737+0000 mgr.x (mgr.34562) 1637 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:12:40.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:40 smithi188 bash[23329]: cephadm 2020-07-16T14:12:38.925828+0000 mgr.x (mgr.34562) 1638 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:12:41.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:41 smithi132 bash[27079]: cluster 2020-07-16T14:12:39.947748+0000 mgr.x (mgr.34562) 1639 : cluster [DBG] pgmap v1020: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:12:41.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:41 smithi188 bash[23329]: cluster 2020-07-16T14:12:39.947748+0000 mgr.x (mgr.34562) 1639 : cluster [DBG] pgmap v1020: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:12:43.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:43 smithi132 bash[27079]: cluster 2020-07-16T14:12:41.948296+0000 mgr.x (mgr.34562) 1640 : cluster [DBG] pgmap v1021: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:12:43.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:43 smithi188 bash[23329]: cluster 2020-07-16T14:12:41.948296+0000 mgr.x (mgr.34562) 1640 : cluster [DBG] pgmap v1021: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:12:43.431 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:12:43.690 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:12:43.690 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (35m) 2m ago 38m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:12:43.690 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (38m) 2m ago 38m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:12:43.691 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (35m) 2m ago 41m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:12:43.691 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (35m) 2m ago 43m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:12:43.691 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 2m ago 43m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:12:43.692 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (41m) 2m ago 41m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:12:43.692 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (41m) 2m ago 41m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:12:43.692 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (38m) 2m ago 38m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:12:43.692 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (38m) 2m ago 38m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:12:43.693 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (41m) 2m ago 41m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:12:43.693 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (40m) 2m ago 40m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:12:43.693 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (40m) 2m ago 40m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:12:43.694 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (40m) 2m ago 40m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:12:43.694 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (39m) 2m ago 40m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:12:43.694 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (39m) 2m ago 39m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:12:43.694 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (39m) 2m ago 39m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:12:43.695 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (39m) 2m ago 39m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:12:43.695 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (37m) 2m ago 38m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:12:43.987 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:12:43.988 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:12:43.988 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:12:43.988 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:12:43.988 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:12:43.988 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:12:43.989 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:12:43.989 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:12:43.989 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:12:43.989 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:12:43.989 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:12:43.990 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:12:43.990 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:12:43.990 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:12:43.990 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:12:43.990 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:12:43.991 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:12:44.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:44 smithi132 bash[27079]: audit 2020-07-16T14:12:43.986536+0000 mon.c (mon.1) 161 : audit [DBG] from='client.? 172.21.15.132:0/2397664642' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:12:44.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:44 smithi188 bash[23329]: audit 2020-07-16T14:12:43.986536+0000 mon.c (mon.1) 161 : audit [DBG] from='client.? 172.21.15.132:0/2397664642' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:12:45.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:45 smithi188 bash[23329]: audit 2020-07-16T14:12:43.418829+0000 mgr.x (mgr.34562) 1641 : audit [DBG] from='client.25828 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:12:45.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:45 smithi188 bash[23329]: audit 2020-07-16T14:12:43.684864+0000 mgr.x (mgr.34562) 1642 : audit [DBG] from='client.25834 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:12:45.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:45 smithi188 bash[23329]: cluster 2020-07-16T14:12:43.948658+0000 mgr.x (mgr.34562) 1643 : cluster [DBG] pgmap v1022: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:12:45.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:45 smithi132 bash[27079]: audit 2020-07-16T14:12:43.418829+0000 mgr.x (mgr.34562) 1641 : audit [DBG] from='client.25828 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:12:45.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:45 smithi132 bash[27079]: audit 2020-07-16T14:12:43.684864+0000 mgr.x (mgr.34562) 1642 : audit [DBG] from='client.25834 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:12:45.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:45 smithi132 bash[27079]: cluster 2020-07-16T14:12:43.948658+0000 mgr.x (mgr.34562) 1643 : cluster [DBG] pgmap v1022: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:12:47.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:47 smithi188 bash[23329]: cluster 2020-07-16T14:12:45.948976+0000 mgr.x (mgr.34562) 1644 : cluster [DBG] pgmap v1023: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:12:47.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:47 smithi132 bash[27079]: cluster 2020-07-16T14:12:45.948976+0000 mgr.x (mgr.34562) 1644 : cluster [DBG] pgmap v1023: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:12:49.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:49 smithi188 bash[23329]: cluster 2020-07-16T14:12:47.949390+0000 mgr.x (mgr.34562) 1645 : cluster [DBG] pgmap v1024: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:12:49.503 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:49 smithi132 bash[27079]: cluster 2020-07-16T14:12:47.949390+0000 mgr.x (mgr.34562) 1645 : cluster [DBG] pgmap v1024: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:12:50.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:50 smithi188 bash[23329]: cluster 2020-07-16T14:12:49.949706+0000 mgr.x (mgr.34562) 1646 : cluster [DBG] pgmap v1025: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:12:50.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:50 smithi132 bash[27079]: cluster 2020-07-16T14:12:49.949706+0000 mgr.x (mgr.34562) 1646 : cluster [DBG] pgmap v1025: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:12:53.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:53 smithi132 bash[27079]: cluster 2020-07-16T14:12:51.950195+0000 mgr.x (mgr.34562) 1647 : cluster [DBG] pgmap v1026: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:12:53.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:53 smithi188 bash[23329]: cluster 2020-07-16T14:12:51.950195+0000 mgr.x (mgr.34562) 1647 : cluster [DBG] pgmap v1026: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:12:54.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:54 smithi132 bash[27079]: audit 2020-07-16T14:12:53.927838+0000 mon.b (mon.2) 474 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:12:54.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:54 smithi188 bash[23329]: audit 2020-07-16T14:12:53.927838+0000 mon.b (mon.2) 474 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:12:55.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:55 smithi132 bash[27079]: cephadm 2020-07-16T14:12:53.928989+0000 mgr.x (mgr.34562) 1648 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:12:55.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:55 smithi132 bash[27079]: cephadm 2020-07-16T14:12:53.929094+0000 mgr.x (mgr.34562) 1649 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:12:55.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:55 smithi132 bash[27079]: cluster 2020-07-16T14:12:53.950628+0000 mgr.x (mgr.34562) 1650 : cluster [DBG] pgmap v1027: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:12:55.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:55 smithi188 bash[23329]: cephadm 2020-07-16T14:12:53.928989+0000 mgr.x (mgr.34562) 1648 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:12:55.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:55 smithi188 bash[23329]: cephadm 2020-07-16T14:12:53.929094+0000 mgr.x (mgr.34562) 1649 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:12:55.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:55 smithi188 bash[23329]: cluster 2020-07-16T14:12:53.950628+0000 mgr.x (mgr.34562) 1650 : cluster [DBG] pgmap v1027: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:12:57.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:57 smithi132 bash[27079]: cluster 2020-07-16T14:12:55.951094+0000 mgr.x (mgr.34562) 1651 : cluster [DBG] pgmap v1028: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:12:57.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:57 smithi188 bash[23329]: cluster 2020-07-16T14:12:55.951094+0000 mgr.x (mgr.34562) 1651 : cluster [DBG] pgmap v1028: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:12:59.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:12:59 smithi132 bash[27079]: cluster 2020-07-16T14:12:57.951652+0000 mgr.x (mgr.34562) 1652 : cluster [DBG] pgmap v1029: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:12:59.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:12:59 smithi188 bash[23329]: cluster 2020-07-16T14:12:57.951652+0000 mgr.x (mgr.34562) 1652 : cluster [DBG] pgmap v1029: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:13:00.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:13:00 smithi188 bash[23329]: cluster 2020-07-16T14:12:59.952216+0000 mgr.x (mgr.34562) 1653 : cluster [DBG] pgmap v1030: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:13:00.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:13:00 smithi132 bash[27079]: cluster 2020-07-16T14:12:59.952216+0000 mgr.x (mgr.34562) 1653 : cluster [DBG] pgmap v1030: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:13:03.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:13:03 smithi132 bash[27079]: cluster 2020-07-16T14:13:01.952651+0000 mgr.x (mgr.34562) 1654 : cluster [DBG] pgmap v1031: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:13:03.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:13:03 smithi188 bash[23329]: cluster 2020-07-16T14:13:01.952651+0000 mgr.x (mgr.34562) 1654 : cluster [DBG] pgmap v1031: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:13:05.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:13:05 smithi132 bash[27079]: cluster 2020-07-16T14:13:03.953143+0000 mgr.x (mgr.34562) 1655 : cluster [DBG] pgmap v1032: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:13:05.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:13:05 smithi188 bash[23329]: cluster 2020-07-16T14:13:03.953143+0000 mgr.x (mgr.34562) 1655 : cluster [DBG] pgmap v1032: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:13:07.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:13:07 smithi132 bash[27079]: cluster 2020-07-16T14:13:05.953657+0000 mgr.x (mgr.34562) 1656 : cluster [DBG] pgmap v1033: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:13:07.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:13:07 smithi188 bash[23329]: cluster 2020-07-16T14:13:05.953657+0000 mgr.x (mgr.34562) 1656 : cluster [DBG] pgmap v1033: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:13:09.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:13:09 smithi132 bash[27079]: cluster 2020-07-16T14:13:07.954228+0000 mgr.x (mgr.34562) 1657 : cluster [DBG] pgmap v1034: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:13:09.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:13:09 smithi132 bash[27079]: audit 2020-07-16T14:13:08.944651+0000 mon.b (mon.2) 475 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:13:09.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:13:09 smithi188 bash[23329]: cluster 2020-07-16T14:13:07.954228+0000 mgr.x (mgr.34562) 1657 : cluster [DBG] pgmap v1034: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:13:09.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:13:09 smithi188 bash[23329]: audit 2020-07-16T14:13:08.944651+0000 mon.b (mon.2) 475 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:13:10.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:13:10 smithi132 bash[27079]: cephadm 2020-07-16T14:13:08.945357+0000 mgr.x (mgr.34562) 1658 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:13:10.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:13:10 smithi132 bash[27079]: cephadm 2020-07-16T14:13:08.945437+0000 mgr.x (mgr.34562) 1659 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:13:10.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:13:10 smithi188 bash[23329]: cephadm 2020-07-16T14:13:08.945357+0000 mgr.x (mgr.34562) 1658 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:13:10.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:13:10 smithi188 bash[23329]: cephadm 2020-07-16T14:13:08.945437+0000 mgr.x (mgr.34562) 1659 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:13:11.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:13:11 smithi132 bash[27079]: cluster 2020-07-16T14:13:09.954777+0000 mgr.x (mgr.34562) 1660 : cluster [DBG] pgmap v1035: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:13:11.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:13:11 smithi188 bash[23329]: cluster 2020-07-16T14:13:09.954777+0000 mgr.x (mgr.34562) 1660 : cluster [DBG] pgmap v1035: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:13:13.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:13:13 smithi132 bash[27079]: cluster 2020-07-16T14:13:11.955353+0000 mgr.x (mgr.34562) 1661 : cluster [DBG] pgmap v1036: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:13:13.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:13:13 smithi188 bash[23329]: cluster 2020-07-16T14:13:11.955353+0000 mgr.x (mgr.34562) 1661 : cluster [DBG] pgmap v1036: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:13:14.286 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:13:14.547 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:13:14.547 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (35m) 2m ago 39m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:13:14.548 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (38m) 2m ago 38m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:13:14.548 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (36m) 2m ago 41m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:13:14.548 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (35m) 2m ago 43m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:13:14.549 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 2m ago 43m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:13:14.549 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (42m) 2m ago 42m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:13:14.549 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (42m) 2m ago 42m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:13:14.550 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (39m) 2m ago 39m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:13:14.550 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (39m) 2m ago 39m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:13:14.550 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (41m) 2m ago 41m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:13:14.550 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (41m) 2m ago 41m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:13:14.551 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (41m) 2m ago 41m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:13:14.551 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (40m) 2m ago 40m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:13:14.551 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (40m) 2m ago 40m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:13:14.552 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (40m) 2m ago 40m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:13:14.552 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (39m) 2m ago 39m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:13:14.552 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (39m) 2m ago 39m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:13:14.553 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (38m) 2m ago 39m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:13:14.865 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:13:14.866 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:13:14.866 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:13:14.866 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:13:14.867 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:13:14.867 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:13:14.867 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:13:14.867 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:13:14.868 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:13:14.868 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:13:14.868 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:13:14.869 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:13:14.869 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:13:14.869 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:13:14.869 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:13:14.870 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:13:14.870 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:13:15.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:13:15 smithi188 bash[23329]: cluster 2020-07-16T14:13:13.955718+0000 mgr.x (mgr.34562) 1662 : cluster [DBG] pgmap v1037: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:13:15.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:13:15 smithi188 bash[23329]: audit 2020-07-16T14:13:14.861127+0000 mon.c (mon.1) 162 : audit [DBG] from='client.? 172.21.15.132:0/2694209880' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:13:15.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:13:15 smithi132 bash[27079]: cluster 2020-07-16T14:13:13.955718+0000 mgr.x (mgr.34562) 1662 : cluster [DBG] pgmap v1037: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:13:15.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:13:15 smithi132 bash[27079]: audit 2020-07-16T14:13:14.861127+0000 mon.c (mon.1) 162 : audit [DBG] from='client.? 172.21.15.132:0/2694209880' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:13:16.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:13:16 smithi188 bash[23329]: audit 2020-07-16T14:13:14.274155+0000 mgr.x (mgr.34562) 1663 : audit [DBG] from='client.25846 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:13:16.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:13:16 smithi188 bash[23329]: audit 2020-07-16T14:13:14.542693+0000 mgr.x (mgr.34562) 1664 : audit [DBG] from='client.25852 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:13:16.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:13:16 smithi132 bash[27079]: audit 2020-07-16T14:13:14.274155+0000 mgr.x (mgr.34562) 1663 : audit [DBG] from='client.25846 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:13:16.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:13:16 smithi132 bash[27079]: audit 2020-07-16T14:13:14.542693+0000 mgr.x (mgr.34562) 1664 : audit [DBG] from='client.25852 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:13:17.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:13:17 smithi188 bash[23329]: cluster 2020-07-16T14:13:15.956049+0000 mgr.x (mgr.34562) 1665 : cluster [DBG] pgmap v1038: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:13:17.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:13:17 smithi132 bash[27079]: cluster 2020-07-16T14:13:15.956049+0000 mgr.x (mgr.34562) 1665 : cluster [DBG] pgmap v1038: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:13:19.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:13:19 smithi188 bash[23329]: cluster 2020-07-16T14:13:17.956459+0000 mgr.x (mgr.34562) 1666 : cluster [DBG] pgmap v1039: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:13:19.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:13:19 smithi132 bash[27079]: cluster 2020-07-16T14:13:17.956459+0000 mgr.x (mgr.34562) 1666 : cluster [DBG] pgmap v1039: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:13:20.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:13:20 smithi188 bash[23329]: cluster 2020-07-16T14:13:19.956887+0000 mgr.x (mgr.34562) 1667 : cluster [DBG] pgmap v1040: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:13:20.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:13:20 smithi132 bash[27079]: cluster 2020-07-16T14:13:19.956887+0000 mgr.x (mgr.34562) 1667 : cluster [DBG] pgmap v1040: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:13:23.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:13:23 smithi132 bash[27079]: cluster 2020-07-16T14:13:21.957257+0000 mgr.x (mgr.34562) 1668 : cluster [DBG] pgmap v1041: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:13:23.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:13:23 smithi188 bash[23329]: cluster 2020-07-16T14:13:21.957257+0000 mgr.x (mgr.34562) 1668 : cluster [DBG] pgmap v1041: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:13:24.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:13:24 smithi132 bash[27079]: audit 2020-07-16T14:13:23.960907+0000 mon.b (mon.2) 476 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:13:24.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:13:24 smithi188 bash[23329]: audit 2020-07-16T14:13:23.960907+0000 mon.b (mon.2) 476 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:13:25.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:13:25 smithi132 bash[27079]: cluster 2020-07-16T14:13:23.957647+0000 mgr.x (mgr.34562) 1669 : cluster [DBG] pgmap v1042: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:13:25.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:13:25 smithi132 bash[27079]: cephadm 2020-07-16T14:13:23.961693+0000 mgr.x (mgr.34562) 1670 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:13:25.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:13:25 smithi132 bash[27079]: cephadm 2020-07-16T14:13:23.961783+0000 mgr.x (mgr.34562) 1671 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:13:25.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:13:25 smithi188 bash[23329]: cluster 2020-07-16T14:13:23.957647+0000 mgr.x (mgr.34562) 1669 : cluster [DBG] pgmap v1042: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:13:25.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:13:25 smithi188 bash[23329]: cephadm 2020-07-16T14:13:23.961693+0000 mgr.x (mgr.34562) 1670 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:13:25.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:13:25 smithi188 bash[23329]: cephadm 2020-07-16T14:13:23.961783+0000 mgr.x (mgr.34562) 1671 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:13:27.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:13:27 smithi132 bash[27079]: cluster 2020-07-16T14:13:25.958031+0000 mgr.x (mgr.34562) 1672 : cluster [DBG] pgmap v1043: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:13:27.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:13:27 smithi188 bash[23329]: cluster 2020-07-16T14:13:25.958031+0000 mgr.x (mgr.34562) 1672 : cluster [DBG] pgmap v1043: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:13:29.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:13:29 smithi188 bash[23329]: cluster 2020-07-16T14:13:27.958503+0000 mgr.x (mgr.34562) 1673 : cluster [DBG] pgmap v1044: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:13:29.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:13:29 smithi132 bash[27079]: cluster 2020-07-16T14:13:27.958503+0000 mgr.x (mgr.34562) 1673 : cluster [DBG] pgmap v1044: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:13:30.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:13:30 smithi188 bash[23329]: cluster 2020-07-16T14:13:29.958963+0000 mgr.x (mgr.34562) 1674 : cluster [DBG] pgmap v1045: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:13:30.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:13:30 smithi132 bash[27079]: cluster 2020-07-16T14:13:29.958963+0000 mgr.x (mgr.34562) 1674 : cluster [DBG] pgmap v1045: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:13:33.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:13:33 smithi132 bash[27079]: cluster 2020-07-16T14:13:31.959495+0000 mgr.x (mgr.34562) 1675 : cluster [DBG] pgmap v1046: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:13:33.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:13:33 smithi188 bash[23329]: cluster 2020-07-16T14:13:31.959495+0000 mgr.x (mgr.34562) 1675 : cluster [DBG] pgmap v1046: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:13:35.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:13:35 smithi132 bash[27079]: cluster 2020-07-16T14:13:33.959962+0000 mgr.x (mgr.34562) 1676 : cluster [DBG] pgmap v1047: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:13:35.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:13:35 smithi188 bash[23329]: cluster 2020-07-16T14:13:33.959962+0000 mgr.x (mgr.34562) 1676 : cluster [DBG] pgmap v1047: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:13:37.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:13:37 smithi132 bash[27079]: cluster 2020-07-16T14:13:35.960373+0000 mgr.x (mgr.34562) 1677 : cluster [DBG] pgmap v1048: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:13:37.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:13:37 smithi188 bash[23329]: cluster 2020-07-16T14:13:35.960373+0000 mgr.x (mgr.34562) 1677 : cluster [DBG] pgmap v1048: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:13:39.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:13:39 smithi132 bash[27079]: cluster 2020-07-16T14:13:37.960877+0000 mgr.x (mgr.34562) 1678 : cluster [DBG] pgmap v1049: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:13:39.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:13:39 smithi132 bash[27079]: audit 2020-07-16T14:13:38.979380+0000 mon.b (mon.2) 477 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:13:39.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:13:39 smithi132 bash[27079]: audit 2020-07-16T14:13:38.980735+0000 mon.b (mon.2) 478 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:13:39.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:13:39 smithi132 bash[27079]: audit 2020-07-16T14:13:38.981900+0000 mon.b (mon.2) 479 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:13:39.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:13:39 smithi132 bash[27079]: audit 2020-07-16T14:13:38.983185+0000 mon.b (mon.2) 480 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:13:39.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:13:39 smithi132 bash[27079]: audit 2020-07-16T14:13:38.984378+0000 mon.b (mon.2) 481 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:13:39.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:13:39 smithi188 bash[23329]: cluster 2020-07-16T14:13:37.960877+0000 mgr.x (mgr.34562) 1678 : cluster [DBG] pgmap v1049: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:13:39.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:13:39 smithi188 bash[23329]: audit 2020-07-16T14:13:38.979380+0000 mon.b (mon.2) 477 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:13:39.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:13:39 smithi188 bash[23329]: audit 2020-07-16T14:13:38.980735+0000 mon.b (mon.2) 478 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:13:39.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:13:39 smithi188 bash[23329]: audit 2020-07-16T14:13:38.981900+0000 mon.b (mon.2) 479 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:13:39.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:13:39 smithi188 bash[23329]: audit 2020-07-16T14:13:38.983185+0000 mon.b (mon.2) 480 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:13:39.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:13:39 smithi188 bash[23329]: audit 2020-07-16T14:13:38.984378+0000 mon.b (mon.2) 481 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:13:40.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:13:40 smithi188 bash[23329]: audit 2020-07-16T14:13:38.979764+0000 mgr.x (mgr.34562) 1679 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:13:40.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:13:40 smithi188 bash[23329]: audit 2020-07-16T14:13:38.981031+0000 mgr.x (mgr.34562) 1680 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:13:40.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:13:40 smithi188 bash[23329]: audit 2020-07-16T14:13:38.982179+0000 mgr.x (mgr.34562) 1681 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:13:40.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:13:40 smithi188 bash[23329]: cephadm 2020-07-16T14:13:38.982909+0000 mgr.x (mgr.34562) 1682 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:13:40.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:13:40 smithi188 bash[23329]: cephadm 2020-07-16T14:13:38.984057+0000 mgr.x (mgr.34562) 1683 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:13:40.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:13:40 smithi188 bash[23329]: cephadm 2020-07-16T14:13:38.985155+0000 mgr.x (mgr.34562) 1684 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:13:40.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:13:40 smithi188 bash[23329]: cephadm 2020-07-16T14:13:38.985466+0000 mgr.x (mgr.34562) 1685 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:13:40.533 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:13:40 smithi132 bash[27079]: audit 2020-07-16T14:13:38.979764+0000 mgr.x (mgr.34562) 1679 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:13:40.533 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:13:40 smithi132 bash[27079]: audit 2020-07-16T14:13:38.981031+0000 mgr.x (mgr.34562) 1680 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:13:40.533 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:13:40 smithi132 bash[27079]: audit 2020-07-16T14:13:38.982179+0000 mgr.x (mgr.34562) 1681 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:13:40.534 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:13:40 smithi132 bash[27079]: cephadm 2020-07-16T14:13:38.982909+0000 mgr.x (mgr.34562) 1682 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:13:40.534 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:13:40 smithi132 bash[27079]: cephadm 2020-07-16T14:13:38.984057+0000 mgr.x (mgr.34562) 1683 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:13:40.534 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:13:40 smithi132 bash[27079]: cephadm 2020-07-16T14:13:38.985155+0000 mgr.x (mgr.34562) 1684 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:13:40.534 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:13:40 smithi132 bash[27079]: cephadm 2020-07-16T14:13:38.985466+0000 mgr.x (mgr.34562) 1685 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:13:41.108 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:13:41 smithi132 bash[27079]: cluster 2020-07-16T14:13:39.961256+0000 mgr.x (mgr.34562) 1686 : cluster [DBG] pgmap v1050: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:13:41.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:13:41 smithi188 bash[23329]: cluster 2020-07-16T14:13:39.961256+0000 mgr.x (mgr.34562) 1686 : cluster [DBG] pgmap v1050: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:13:42.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:13:42 smithi188 bash[23329]: audit 2020-07-16T14:13:41.612738+0000 mon.b (mon.2) 482 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:13:42.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:13:42 smithi132 bash[27079]: audit 2020-07-16T14:13:41.612738+0000 mon.b (mon.2) 482 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:13:43.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:13:43 smithi188 bash[23329]: cephadm 2020-07-16T14:13:41.613475+0000 mgr.x (mgr.34562) 1687 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:13:43.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:13:43 smithi188 bash[23329]: cephadm 2020-07-16T14:13:41.613553+0000 mgr.x (mgr.34562) 1688 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:13:43.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:13:43 smithi188 bash[23329]: cluster 2020-07-16T14:13:41.961678+0000 mgr.x (mgr.34562) 1689 : cluster [DBG] pgmap v1051: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:13:43.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:13:43 smithi132 bash[27079]: cephadm 2020-07-16T14:13:41.613475+0000 mgr.x (mgr.34562) 1687 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:13:43.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:13:43 smithi132 bash[27079]: cephadm 2020-07-16T14:13:41.613553+0000 mgr.x (mgr.34562) 1688 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:13:43.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:13:43 smithi132 bash[27079]: cluster 2020-07-16T14:13:41.961678+0000 mgr.x (mgr.34562) 1689 : cluster [DBG] pgmap v1051: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:13:45.159 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:13:45.420 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:13:45.420 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (36m) 3m ago 39m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:13:45.420 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (39m) 3m ago 39m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:13:45.421 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (36m) 3m ago 42m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:13:45.421 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (36m) 3m ago 44m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:13:45.421 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 3m ago 44m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:13:45.421 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (42m) 3m ago 42m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:13:45.421 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (42m) 3m ago 42m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:13:45.422 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (39m) 3m ago 39m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:13:45.422 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (39m) 3m ago 39m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:13:45.422 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (42m) 3m ago 42m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:13:45.422 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (41m) 3m ago 41m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:13:45.422 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (41m) 3m ago 41m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:13:45.423 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (41m) 3m ago 41m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:13:45.423 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (40m) 3m ago 41m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:13:45.423 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (40m) 3m ago 40m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:13:45.423 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (40m) 3m ago 40m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:13:45.423 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (40m) 3m ago 40m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:13:45.424 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (38m) 3m ago 39m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:13:45.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:13:45 smithi188 bash[23329]: cluster 2020-07-16T14:13:43.962075+0000 mgr.x (mgr.34562) 1690 : cluster [DBG] pgmap v1052: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:13:45.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:13:45 smithi132 bash[27079]: cluster 2020-07-16T14:13:43.962075+0000 mgr.x (mgr.34562) 1690 : cluster [DBG] pgmap v1052: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:13:45.720 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:13:45.720 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:13:45.721 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:13:45.721 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:13:45.721 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:13:45.721 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:13:45.721 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:13:45.722 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:13:45.722 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:13:45.722 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:13:45.722 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:13:45.723 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:13:45.723 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:13:45.723 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:13:45.723 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:13:45.723 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:13:45.724 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:13:46.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:13:46 smithi188 bash[23329]: audit 2020-07-16T14:13:45.146987+0000 mgr.x (mgr.34562) 1691 : audit [DBG] from='client.25864 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:13:46.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:13:46 smithi188 bash[23329]: audit 2020-07-16T14:13:45.719077+0000 mon.c (mon.1) 163 : audit [DBG] from='client.? 172.21.15.132:0/983116676' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:13:46.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:13:46 smithi132 bash[27079]: audit 2020-07-16T14:13:45.146987+0000 mgr.x (mgr.34562) 1691 : audit [DBG] from='client.25864 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:13:46.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:13:46 smithi132 bash[27079]: audit 2020-07-16T14:13:45.719077+0000 mon.c (mon.1) 163 : audit [DBG] from='client.? 172.21.15.132:0/983116676' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:13:47.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:13:47 smithi188 bash[23329]: audit 2020-07-16T14:13:45.415610+0000 mgr.x (mgr.34562) 1692 : audit [DBG] from='client.25870 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:13:47.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:13:47 smithi188 bash[23329]: cluster 2020-07-16T14:13:45.962561+0000 mgr.x (mgr.34562) 1693 : cluster [DBG] pgmap v1053: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:13:47.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:13:47 smithi132 bash[27079]: audit 2020-07-16T14:13:45.415610+0000 mgr.x (mgr.34562) 1692 : audit [DBG] from='client.25870 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:13:47.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:13:47 smithi132 bash[27079]: cluster 2020-07-16T14:13:45.962561+0000 mgr.x (mgr.34562) 1693 : cluster [DBG] pgmap v1053: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:13:49.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:13:49 smithi188 bash[23329]: cluster 2020-07-16T14:13:47.963115+0000 mgr.x (mgr.34562) 1694 : cluster [DBG] pgmap v1054: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:13:49.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:13:49 smithi132 bash[27079]: cluster 2020-07-16T14:13:47.963115+0000 mgr.x (mgr.34562) 1694 : cluster [DBG] pgmap v1054: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:13:50.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:13:50 smithi188 bash[23329]: cluster 2020-07-16T14:13:49.963510+0000 mgr.x (mgr.34562) 1695 : cluster [DBG] pgmap v1055: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:13:50.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:13:50 smithi132 bash[27079]: cluster 2020-07-16T14:13:49.963510+0000 mgr.x (mgr.34562) 1695 : cluster [DBG] pgmap v1055: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:13:53.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:13:53 smithi132 bash[27079]: cluster 2020-07-16T14:13:51.964079+0000 mgr.x (mgr.34562) 1696 : cluster [DBG] pgmap v1056: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:13:53.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:13:53 smithi188 bash[23329]: cluster 2020-07-16T14:13:51.964079+0000 mgr.x (mgr.34562) 1696 : cluster [DBG] pgmap v1056: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:13:55.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:13:55 smithi132 bash[27079]: cluster 2020-07-16T14:13:53.964597+0000 mgr.x (mgr.34562) 1697 : cluster [DBG] pgmap v1057: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:13:55.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:13:55 smithi188 bash[23329]: cluster 2020-07-16T14:13:53.964597+0000 mgr.x (mgr.34562) 1697 : cluster [DBG] pgmap v1057: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:13:57.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:13:57 smithi132 bash[27079]: cluster 2020-07-16T14:13:55.964994+0000 mgr.x (mgr.34562) 1698 : cluster [DBG] pgmap v1058: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:13:57.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:13:57 smithi132 bash[27079]: audit 2020-07-16T14:13:56.629407+0000 mon.b (mon.2) 483 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:13:57.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:13:57 smithi188 bash[23329]: cluster 2020-07-16T14:13:55.964994+0000 mgr.x (mgr.34562) 1698 : cluster [DBG] pgmap v1058: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:13:57.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:13:57 smithi188 bash[23329]: audit 2020-07-16T14:13:56.629407+0000 mon.b (mon.2) 483 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:13:58.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:13:58 smithi188 bash[23329]: cephadm 2020-07-16T14:13:56.630558+0000 mgr.x (mgr.34562) 1699 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:13:58.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:13:58 smithi188 bash[23329]: cephadm 2020-07-16T14:13:56.630632+0000 mgr.x (mgr.34562) 1700 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:13:58.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:13:58 smithi132 bash[27079]: cephadm 2020-07-16T14:13:56.630558+0000 mgr.x (mgr.34562) 1699 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:13:58.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:13:58 smithi132 bash[27079]: cephadm 2020-07-16T14:13:56.630632+0000 mgr.x (mgr.34562) 1700 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:13:59.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:13:59 smithi188 bash[23329]: cluster 2020-07-16T14:13:57.965454+0000 mgr.x (mgr.34562) 1701 : cluster [DBG] pgmap v1059: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:13:59.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:13:59 smithi132 bash[27079]: cluster 2020-07-16T14:13:57.965454+0000 mgr.x (mgr.34562) 1701 : cluster [DBG] pgmap v1059: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:14:00.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:14:00 smithi188 bash[23329]: cluster 2020-07-16T14:13:59.965733+0000 mgr.x (mgr.34562) 1702 : cluster [DBG] pgmap v1060: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:14:00.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:14:00 smithi132 bash[27079]: cluster 2020-07-16T14:13:59.965733+0000 mgr.x (mgr.34562) 1702 : cluster [DBG] pgmap v1060: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:14:03.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:14:03 smithi132 bash[27079]: cluster 2020-07-16T14:14:01.966142+0000 mgr.x (mgr.34562) 1703 : cluster [DBG] pgmap v1061: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:14:03.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:14:03 smithi188 bash[23329]: cluster 2020-07-16T14:14:01.966142+0000 mgr.x (mgr.34562) 1703 : cluster [DBG] pgmap v1061: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:14:05.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:14:05 smithi132 bash[27079]: cluster 2020-07-16T14:14:03.966660+0000 mgr.x (mgr.34562) 1704 : cluster [DBG] pgmap v1062: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:14:05.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:14:05 smithi188 bash[23329]: cluster 2020-07-16T14:14:03.966660+0000 mgr.x (mgr.34562) 1704 : cluster [DBG] pgmap v1062: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:14:07.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:14:07 smithi188 bash[23329]: cluster 2020-07-16T14:14:05.967121+0000 mgr.x (mgr.34562) 1705 : cluster [DBG] pgmap v1063: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:14:07.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:14:07 smithi132 bash[27079]: cluster 2020-07-16T14:14:05.967121+0000 mgr.x (mgr.34562) 1705 : cluster [DBG] pgmap v1063: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:14:09.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:14:09 smithi188 bash[23329]: cluster 2020-07-16T14:14:07.967621+0000 mgr.x (mgr.34562) 1706 : cluster [DBG] pgmap v1064: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:14:09.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:14:09 smithi132 bash[27079]: cluster 2020-07-16T14:14:07.967621+0000 mgr.x (mgr.34562) 1706 : cluster [DBG] pgmap v1064: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:14:10.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:14:10 smithi188 bash[23329]: cluster 2020-07-16T14:14:09.968046+0000 mgr.x (mgr.34562) 1707 : cluster [DBG] pgmap v1065: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:14:10.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:14:10 smithi132 bash[27079]: cluster 2020-07-16T14:14:09.968046+0000 mgr.x (mgr.34562) 1707 : cluster [DBG] pgmap v1065: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:14:12.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:14:11 smithi132 bash[27079]: audit 2020-07-16T14:14:11.631214+0000 mon.b (mon.2) 484 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:14:12.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:14:11 smithi188 bash[23329]: audit 2020-07-16T14:14:11.631214+0000 mon.b (mon.2) 484 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:14:13.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:14:12 smithi132 bash[27079]: cephadm 2020-07-16T14:14:11.631895+0000 mgr.x (mgr.34562) 1708 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:14:13.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:14:12 smithi132 bash[27079]: cephadm 2020-07-16T14:14:11.631973+0000 mgr.x (mgr.34562) 1709 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:14:13.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:14:12 smithi132 bash[27079]: cluster 2020-07-16T14:14:11.968499+0000 mgr.x (mgr.34562) 1710 : cluster [DBG] pgmap v1066: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:14:13.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:14:12 smithi188 bash[23329]: cephadm 2020-07-16T14:14:11.631895+0000 mgr.x (mgr.34562) 1708 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:14:13.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:14:12 smithi188 bash[23329]: cephadm 2020-07-16T14:14:11.631973+0000 mgr.x (mgr.34562) 1709 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:14:13.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:14:12 smithi188 bash[23329]: cluster 2020-07-16T14:14:11.968499+0000 mgr.x (mgr.34562) 1710 : cluster [DBG] pgmap v1066: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:14:15.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:14:15 smithi132 bash[27079]: cluster 2020-07-16T14:14:13.968773+0000 mgr.x (mgr.34562) 1711 : cluster [DBG] pgmap v1067: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:14:15.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:14:15 smithi188 bash[23329]: cluster 2020-07-16T14:14:13.968773+0000 mgr.x (mgr.34562) 1711 : cluster [DBG] pgmap v1067: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:14:16.018 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:14:16.280 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:14:16.280 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (37m) 3m ago 40m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:14:16.281 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (39m) 3m ago 39m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:14:16.281 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (37m) 3m ago 42m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:14:16.281 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (36m) 3m ago 44m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:14:16.281 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 3m ago 44m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:14:16.282 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (43m) 3m ago 43m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:14:16.282 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (43m) 3m ago 43m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:14:16.282 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (40m) 3m ago 40m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:14:16.282 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (40m) 3m ago 40m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:14:16.282 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (42m) 3m ago 42m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:14:16.283 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (42m) 3m ago 42m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:14:16.283 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (42m) 3m ago 42m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:14:16.283 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (41m) 3m ago 41m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:14:16.283 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (41m) 3m ago 41m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:14:16.283 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (41m) 3m ago 41m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:14:16.284 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (40m) 3m ago 40m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:14:16.284 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (40m) 3m ago 40m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:14:16.284 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (39m) 3m ago 40m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:14:16.582 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:14:16.583 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:14:16.583 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:14:16.583 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:14:16.583 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:14:16.583 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:14:16.584 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:14:16.584 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:14:16.584 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:14:16.584 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:14:16.584 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:14:16.584 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:14:16.585 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:14:16.585 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:14:16.585 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:14:16.585 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:14:16.585 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:14:17.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:14:17 smithi132 bash[27079]: cluster 2020-07-16T14:14:15.969186+0000 mgr.x (mgr.34562) 1712 : cluster [DBG] pgmap v1068: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:14:17.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:14:17 smithi132 bash[27079]: audit 2020-07-16T14:14:16.006497+0000 mgr.x (mgr.34562) 1713 : audit [DBG] from='client.25882 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:14:17.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:14:17 smithi132 bash[27079]: audit 2020-07-16T14:14:16.581376+0000 mon.c (mon.1) 164 : audit [DBG] from='client.? 172.21.15.132:0/2721848655' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:14:17.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:14:17 smithi188 bash[23329]: cluster 2020-07-16T14:14:15.969186+0000 mgr.x (mgr.34562) 1712 : cluster [DBG] pgmap v1068: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:14:17.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:14:17 smithi188 bash[23329]: audit 2020-07-16T14:14:16.006497+0000 mgr.x (mgr.34562) 1713 : audit [DBG] from='client.25882 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:14:17.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:14:17 smithi188 bash[23329]: audit 2020-07-16T14:14:16.581376+0000 mon.c (mon.1) 164 : audit [DBG] from='client.? 172.21.15.132:0/2721848655' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:14:18.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:14:18 smithi188 bash[23329]: audit 2020-07-16T14:14:16.275861+0000 mgr.x (mgr.34562) 1714 : audit [DBG] from='client.25888 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:14:18.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:14:18 smithi132 bash[27079]: audit 2020-07-16T14:14:16.275861+0000 mgr.x (mgr.34562) 1714 : audit [DBG] from='client.25888 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:14:19.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:14:19 smithi188 bash[23329]: cluster 2020-07-16T14:14:17.969568+0000 mgr.x (mgr.34562) 1715 : cluster [DBG] pgmap v1069: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:14:19.532 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:14:19 smithi132 bash[27079]: cluster 2020-07-16T14:14:17.969568+0000 mgr.x (mgr.34562) 1715 : cluster [DBG] pgmap v1069: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:14:20.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:14:20 smithi188 bash[23329]: cluster 2020-07-16T14:14:19.969976+0000 mgr.x (mgr.34562) 1716 : cluster [DBG] pgmap v1070: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:14:20.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:14:20 smithi132 bash[27079]: cluster 2020-07-16T14:14:19.969976+0000 mgr.x (mgr.34562) 1716 : cluster [DBG] pgmap v1070: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:14:23.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:14:23 smithi132 bash[27079]: cluster 2020-07-16T14:14:21.970520+0000 mgr.x (mgr.34562) 1717 : cluster [DBG] pgmap v1071: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:14:23.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:14:23 smithi188 bash[23329]: cluster 2020-07-16T14:14:21.970520+0000 mgr.x (mgr.34562) 1717 : cluster [DBG] pgmap v1071: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:14:25.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:14:25 smithi188 bash[23329]: cluster 2020-07-16T14:14:23.971040+0000 mgr.x (mgr.34562) 1718 : cluster [DBG] pgmap v1072: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:14:25.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:14:25 smithi132 bash[27079]: cluster 2020-07-16T14:14:23.971040+0000 mgr.x (mgr.34562) 1718 : cluster [DBG] pgmap v1072: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:14:27.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:14:27 smithi188 bash[23329]: cluster 2020-07-16T14:14:25.971507+0000 mgr.x (mgr.34562) 1719 : cluster [DBG] pgmap v1073: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:14:27.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:14:27 smithi188 bash[23329]: audit 2020-07-16T14:14:26.647804+0000 mon.b (mon.2) 485 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:14:27.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:14:27 smithi132 bash[27079]: cluster 2020-07-16T14:14:25.971507+0000 mgr.x (mgr.34562) 1719 : cluster [DBG] pgmap v1073: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:14:27.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:14:27 smithi132 bash[27079]: audit 2020-07-16T14:14:26.647804+0000 mon.b (mon.2) 485 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:14:28.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:14:28 smithi188 bash[23329]: cephadm 2020-07-16T14:14:26.648527+0000 mgr.x (mgr.34562) 1720 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:14:28.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:14:28 smithi188 bash[23329]: cephadm 2020-07-16T14:14:26.648941+0000 mgr.x (mgr.34562) 1721 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:14:28.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:14:28 smithi132 bash[27079]: cephadm 2020-07-16T14:14:26.648527+0000 mgr.x (mgr.34562) 1720 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:14:28.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:14:28 smithi132 bash[27079]: cephadm 2020-07-16T14:14:26.648941+0000 mgr.x (mgr.34562) 1721 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:14:29.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:14:29 smithi188 bash[23329]: cluster 2020-07-16T14:14:27.971889+0000 mgr.x (mgr.34562) 1722 : cluster [DBG] pgmap v1074: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:14:29.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:14:29 smithi132 bash[27079]: cluster 2020-07-16T14:14:27.971889+0000 mgr.x (mgr.34562) 1722 : cluster [DBG] pgmap v1074: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:14:30.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:14:30 smithi188 bash[23329]: cluster 2020-07-16T14:14:29.972235+0000 mgr.x (mgr.34562) 1723 : cluster [DBG] pgmap v1075: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:14:30.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:14:30 smithi132 bash[27079]: cluster 2020-07-16T14:14:29.972235+0000 mgr.x (mgr.34562) 1723 : cluster [DBG] pgmap v1075: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:14:33.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:14:33 smithi132 bash[27079]: cluster 2020-07-16T14:14:31.972788+0000 mgr.x (mgr.34562) 1724 : cluster [DBG] pgmap v1076: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:14:33.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:14:33 smithi188 bash[23329]: cluster 2020-07-16T14:14:31.972788+0000 mgr.x (mgr.34562) 1724 : cluster [DBG] pgmap v1076: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:14:35.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:14:35 smithi188 bash[23329]: cluster 2020-07-16T14:14:33.973146+0000 mgr.x (mgr.34562) 1725 : cluster [DBG] pgmap v1077: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:14:35.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:14:35 smithi132 bash[27079]: cluster 2020-07-16T14:14:33.973146+0000 mgr.x (mgr.34562) 1725 : cluster [DBG] pgmap v1077: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:14:37.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:14:37 smithi188 bash[23329]: cluster 2020-07-16T14:14:35.973572+0000 mgr.x (mgr.34562) 1726 : cluster [DBG] pgmap v1078: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:14:37.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:14:37 smithi132 bash[27079]: cluster 2020-07-16T14:14:35.973572+0000 mgr.x (mgr.34562) 1726 : cluster [DBG] pgmap v1078: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:14:39.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:14:39 smithi188 bash[23329]: cluster 2020-07-16T14:14:37.973996+0000 mgr.x (mgr.34562) 1727 : cluster [DBG] pgmap v1079: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:14:39.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:14:39 smithi132 bash[27079]: cluster 2020-07-16T14:14:37.973996+0000 mgr.x (mgr.34562) 1727 : cluster [DBG] pgmap v1079: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:14:40.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:14:40 smithi188 bash[23329]: cluster 2020-07-16T14:14:39.974410+0000 mgr.x (mgr.34562) 1728 : cluster [DBG] pgmap v1080: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:14:40.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:14:40 smithi132 bash[27079]: cluster 2020-07-16T14:14:39.974410+0000 mgr.x (mgr.34562) 1728 : cluster [DBG] pgmap v1080: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:14:42.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:14:41 smithi132 bash[27079]: audit 2020-07-16T14:14:41.666515+0000 mon.b (mon.2) 486 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:14:42.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:14:41 smithi132 bash[27079]: audit 2020-07-16T14:14:41.667766+0000 mon.b (mon.2) 487 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:14:42.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:14:41 smithi132 bash[27079]: audit 2020-07-16T14:14:41.668775+0000 mon.b (mon.2) 488 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:14:42.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:14:41 smithi132 bash[27079]: audit 2020-07-16T14:14:41.670017+0000 mon.b (mon.2) 489 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:14:42.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:14:41 smithi132 bash[27079]: audit 2020-07-16T14:14:41.671050+0000 mon.b (mon.2) 490 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:14:42.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:14:41 smithi188 bash[23329]: audit 2020-07-16T14:14:41.666515+0000 mon.b (mon.2) 486 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:14:42.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:14:41 smithi188 bash[23329]: audit 2020-07-16T14:14:41.667766+0000 mon.b (mon.2) 487 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:14:42.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:14:41 smithi188 bash[23329]: audit 2020-07-16T14:14:41.668775+0000 mon.b (mon.2) 488 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:14:42.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:14:41 smithi188 bash[23329]: audit 2020-07-16T14:14:41.670017+0000 mon.b (mon.2) 489 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:14:42.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:14:41 smithi188 bash[23329]: audit 2020-07-16T14:14:41.671050+0000 mon.b (mon.2) 490 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:14:43.016 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:14:42 smithi132 bash[27079]: audit 2020-07-16T14:14:41.666815+0000 mgr.x (mgr.34562) 1729 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:14:43.017 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:14:42 smithi132 bash[27079]: audit 2020-07-16T14:14:41.668005+0000 mgr.x (mgr.34562) 1730 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:14:43.017 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:14:42 smithi132 bash[27079]: audit 2020-07-16T14:14:41.669023+0000 mgr.x (mgr.34562) 1731 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:14:43.017 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:14:42 smithi132 bash[27079]: cephadm 2020-07-16T14:14:41.669683+0000 mgr.x (mgr.34562) 1732 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:14:43.018 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:14:42 smithi132 bash[27079]: cephadm 2020-07-16T14:14:41.670749+0000 mgr.x (mgr.34562) 1733 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:14:43.018 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:14:42 smithi132 bash[27079]: cephadm 2020-07-16T14:14:41.671745+0000 mgr.x (mgr.34562) 1734 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:14:43.018 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:14:42 smithi132 bash[27079]: cephadm 2020-07-16T14:14:41.671824+0000 mgr.x (mgr.34562) 1735 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:14:43.019 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:14:42 smithi132 bash[27079]: cluster 2020-07-16T14:14:41.974735+0000 mgr.x (mgr.34562) 1736 : cluster [DBG] pgmap v1081: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:14:43.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:14:42 smithi188 bash[23329]: audit 2020-07-16T14:14:41.666815+0000 mgr.x (mgr.34562) 1729 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:14:43.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:14:42 smithi188 bash[23329]: audit 2020-07-16T14:14:41.668005+0000 mgr.x (mgr.34562) 1730 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:14:43.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:14:42 smithi188 bash[23329]: audit 2020-07-16T14:14:41.669023+0000 mgr.x (mgr.34562) 1731 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:14:43.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:14:42 smithi188 bash[23329]: cephadm 2020-07-16T14:14:41.669683+0000 mgr.x (mgr.34562) 1732 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:14:43.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:14:42 smithi188 bash[23329]: cephadm 2020-07-16T14:14:41.670749+0000 mgr.x (mgr.34562) 1733 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:14:43.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:14:42 smithi188 bash[23329]: cephadm 2020-07-16T14:14:41.671745+0000 mgr.x (mgr.34562) 1734 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:14:43.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:14:42 smithi188 bash[23329]: cephadm 2020-07-16T14:14:41.671824+0000 mgr.x (mgr.34562) 1735 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:14:43.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:14:42 smithi188 bash[23329]: cluster 2020-07-16T14:14:41.974735+0000 mgr.x (mgr.34562) 1736 : cluster [DBG] pgmap v1081: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:14:45.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:14:45 smithi188 bash[23329]: cluster 2020-07-16T14:14:43.975208+0000 mgr.x (mgr.34562) 1737 : cluster [DBG] pgmap v1082: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:14:45.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:14:45 smithi188 bash[23329]: audit 2020-07-16T14:14:44.342999+0000 mon.b (mon.2) 491 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:14:45.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:14:45 smithi132 bash[27079]: cluster 2020-07-16T14:14:43.975208+0000 mgr.x (mgr.34562) 1737 : cluster [DBG] pgmap v1082: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:14:45.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:14:45 smithi132 bash[27079]: audit 2020-07-16T14:14:44.342999+0000 mon.b (mon.2) 491 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:14:46.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:14:46 smithi188 bash[23329]: cephadm 2020-07-16T14:14:44.343651+0000 mgr.x (mgr.34562) 1738 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:14:46.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:14:46 smithi188 bash[23329]: cephadm 2020-07-16T14:14:44.344045+0000 mgr.x (mgr.34562) 1739 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:14:46.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:14:46 smithi132 bash[27079]: cephadm 2020-07-16T14:14:44.343651+0000 mgr.x (mgr.34562) 1738 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:14:46.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:14:46 smithi132 bash[27079]: cephadm 2020-07-16T14:14:44.344045+0000 mgr.x (mgr.34562) 1739 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:14:46.877 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:14:47.138 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:14:47.139 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (37m) 4m ago 40m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:14:47.139 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (40m) 4m ago 40m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:14:47.140 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (37m) 4m ago 43m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:14:47.140 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (37m) 4m ago 45m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:14:47.140 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 4m ago 45m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:14:47.141 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (43m) 4m ago 43m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:14:47.141 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (43m) 4m ago 43m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:14:47.141 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (40m) 4m ago 40m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:14:47.142 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (40m) 4m ago 40m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:14:47.142 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (43m) 4m ago 43m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:14:47.142 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (42m) 4m ago 42m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:14:47.142 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (42m) 4m ago 42m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:14:47.143 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (42m) 4m ago 42m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:14:47.143 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (41m) 4m ago 42m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:14:47.143 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (41m) 4m ago 41m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:14:47.143 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (41m) 4m ago 41m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:14:47.143 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (41m) 4m ago 41m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:14:47.144 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (40m) 4m ago 40m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:14:47.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:14:47 smithi188 bash[23329]: cluster 2020-07-16T14:14:45.975702+0000 mgr.x (mgr.34562) 1740 : cluster [DBG] pgmap v1083: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:14:47.436 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:14:47.437 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:14:47.437 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:14:47.437 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:14:47.437 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:14:47.437 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:14:47.438 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:14:47.438 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:14:47.438 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:14:47.438 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:14:47.438 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:14:47.439 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:14:47.439 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:14:47.439 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:14:47.439 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:14:47.439 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:14:47.439 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:14:47.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:14:47 smithi132 bash[27079]: cluster 2020-07-16T14:14:45.975702+0000 mgr.x (mgr.34562) 1740 : cluster [DBG] pgmap v1083: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:14:48.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:14:48 smithi188 bash[23329]: audit 2020-07-16T14:14:46.866108+0000 mgr.x (mgr.34562) 1741 : audit [DBG] from='client.25900 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:14:48.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:14:48 smithi188 bash[23329]: audit 2020-07-16T14:14:47.133938+0000 mgr.x (mgr.34562) 1742 : audit [DBG] from='client.25906 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:14:48.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:14:48 smithi188 bash[23329]: audit 2020-07-16T14:14:47.435426+0000 mon.c (mon.1) 165 : audit [DBG] from='client.? 172.21.15.132:0/32957701' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:14:48.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:14:48 smithi132 bash[27079]: audit 2020-07-16T14:14:46.866108+0000 mgr.x (mgr.34562) 1741 : audit [DBG] from='client.25900 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:14:48.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:14:48 smithi132 bash[27079]: audit 2020-07-16T14:14:47.133938+0000 mgr.x (mgr.34562) 1742 : audit [DBG] from='client.25906 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:14:48.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:14:48 smithi132 bash[27079]: audit 2020-07-16T14:14:47.435426+0000 mon.c (mon.1) 165 : audit [DBG] from='client.? 172.21.15.132:0/32957701' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:14:49.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:14:49 smithi188 bash[23329]: cluster 2020-07-16T14:14:47.976265+0000 mgr.x (mgr.34562) 1743 : cluster [DBG] pgmap v1084: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:14:49.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:14:49 smithi132 bash[27079]: cluster 2020-07-16T14:14:47.976265+0000 mgr.x (mgr.34562) 1743 : cluster [DBG] pgmap v1084: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:14:50.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:14:50 smithi188 bash[23329]: cluster 2020-07-16T14:14:49.976791+0000 mgr.x (mgr.34562) 1744 : cluster [DBG] pgmap v1085: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:14:50.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:14:50 smithi132 bash[27079]: cluster 2020-07-16T14:14:49.976791+0000 mgr.x (mgr.34562) 1744 : cluster [DBG] pgmap v1085: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:14:53.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:14:53 smithi188 bash[23329]: cluster 2020-07-16T14:14:51.977222+0000 mgr.x (mgr.34562) 1745 : cluster [DBG] pgmap v1086: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:14:53.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:14:53 smithi132 bash[27079]: cluster 2020-07-16T14:14:51.977222+0000 mgr.x (mgr.34562) 1745 : cluster [DBG] pgmap v1086: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:14:55.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:14:55 smithi188 bash[23329]: cluster 2020-07-16T14:14:53.977663+0000 mgr.x (mgr.34562) 1746 : cluster [DBG] pgmap v1087: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:14:55.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:14:55 smithi132 bash[27079]: cluster 2020-07-16T14:14:53.977663+0000 mgr.x (mgr.34562) 1746 : cluster [DBG] pgmap v1087: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:14:57.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:14:57 smithi188 bash[23329]: cluster 2020-07-16T14:14:55.978099+0000 mgr.x (mgr.34562) 1747 : cluster [DBG] pgmap v1088: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:14:57.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:14:57 smithi132 bash[27079]: cluster 2020-07-16T14:14:55.978099+0000 mgr.x (mgr.34562) 1747 : cluster [DBG] pgmap v1088: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:14:59.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:14:59 smithi188 bash[23329]: cluster 2020-07-16T14:14:57.978657+0000 mgr.x (mgr.34562) 1748 : cluster [DBG] pgmap v1089: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:14:59.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:14:59 smithi132 bash[27079]: cluster 2020-07-16T14:14:57.978657+0000 mgr.x (mgr.34562) 1748 : cluster [DBG] pgmap v1089: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:15:00.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:15:00 smithi188 bash[23329]: audit 2020-07-16T14:14:59.353860+0000 mon.b (mon.2) 492 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:15:00.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:15:00 smithi132 bash[27079]: audit 2020-07-16T14:14:59.353860+0000 mon.b (mon.2) 492 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:15:01.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:15:01 smithi188 bash[23329]: cephadm 2020-07-16T14:14:59.354651+0000 mgr.x (mgr.34562) 1749 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:15:01.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:15:01 smithi188 bash[23329]: cephadm 2020-07-16T14:14:59.355064+0000 mgr.x (mgr.34562) 1750 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:15:01.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:15:01 smithi188 bash[23329]: cluster 2020-07-16T14:14:59.979024+0000 mgr.x (mgr.34562) 1751 : cluster [DBG] pgmap v1090: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:15:01.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:15:01 smithi132 bash[27079]: cephadm 2020-07-16T14:14:59.354651+0000 mgr.x (mgr.34562) 1749 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:15:01.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:15:01 smithi132 bash[27079]: cephadm 2020-07-16T14:14:59.355064+0000 mgr.x (mgr.34562) 1750 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:15:01.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:15:01 smithi132 bash[27079]: cluster 2020-07-16T14:14:59.979024+0000 mgr.x (mgr.34562) 1751 : cluster [DBG] pgmap v1090: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:15:03.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:15:03 smithi188 bash[23329]: cluster 2020-07-16T14:15:01.979506+0000 mgr.x (mgr.34562) 1752 : cluster [DBG] pgmap v1091: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:15:03.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:15:03 smithi132 bash[27079]: cluster 2020-07-16T14:15:01.979506+0000 mgr.x (mgr.34562) 1752 : cluster [DBG] pgmap v1091: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:15:05.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:15:05 smithi188 bash[23329]: cluster 2020-07-16T14:15:03.979917+0000 mgr.x (mgr.34562) 1753 : cluster [DBG] pgmap v1092: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:15:05.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:15:05 smithi132 bash[27079]: cluster 2020-07-16T14:15:03.979917+0000 mgr.x (mgr.34562) 1753 : cluster [DBG] pgmap v1092: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:15:07.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:15:07 smithi188 bash[23329]: cluster 2020-07-16T14:15:05.980451+0000 mgr.x (mgr.34562) 1754 : cluster [DBG] pgmap v1093: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:15:07.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:15:07 smithi132 bash[27079]: cluster 2020-07-16T14:15:05.980451+0000 mgr.x (mgr.34562) 1754 : cluster [DBG] pgmap v1093: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:15:09.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:15:09 smithi188 bash[23329]: cluster 2020-07-16T14:15:07.981024+0000 mgr.x (mgr.34562) 1755 : cluster [DBG] pgmap v1094: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:15:09.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:15:09 smithi132 bash[27079]: cluster 2020-07-16T14:15:07.981024+0000 mgr.x (mgr.34562) 1755 : cluster [DBG] pgmap v1094: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:15:10.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:15:10 smithi188 bash[23329]: cluster 2020-07-16T14:15:09.981554+0000 mgr.x (mgr.34562) 1756 : cluster [DBG] pgmap v1095: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:15:10.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:15:10 smithi132 bash[27079]: cluster 2020-07-16T14:15:09.981554+0000 mgr.x (mgr.34562) 1756 : cluster [DBG] pgmap v1095: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:15:13.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:15:13 smithi188 bash[23329]: cluster 2020-07-16T14:15:11.982033+0000 mgr.x (mgr.34562) 1757 : cluster [DBG] pgmap v1096: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:15:13.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:15:13 smithi132 bash[27079]: cluster 2020-07-16T14:15:11.982033+0000 mgr.x (mgr.34562) 1757 : cluster [DBG] pgmap v1096: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:15:15.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:15:15 smithi188 bash[23329]: cluster 2020-07-16T14:15:13.982426+0000 mgr.x (mgr.34562) 1758 : cluster [DBG] pgmap v1097: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:15:15.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:15:15 smithi188 bash[23329]: audit 2020-07-16T14:15:14.356547+0000 mon.b (mon.2) 493 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:15:15.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:15:15 smithi132 bash[27079]: cluster 2020-07-16T14:15:13.982426+0000 mgr.x (mgr.34562) 1758 : cluster [DBG] pgmap v1097: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:15:15.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:15:15 smithi132 bash[27079]: audit 2020-07-16T14:15:14.356547+0000 mon.b (mon.2) 493 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:15:16.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:15:16 smithi188 bash[23329]: cephadm 2020-07-16T14:15:14.357296+0000 mgr.x (mgr.34562) 1759 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:15:16.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:15:16 smithi188 bash[23329]: cephadm 2020-07-16T14:15:14.357381+0000 mgr.x (mgr.34562) 1760 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:15:16.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:15:16 smithi132 bash[27079]: cephadm 2020-07-16T14:15:14.357296+0000 mgr.x (mgr.34562) 1759 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:15:16.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:15:16 smithi132 bash[27079]: cephadm 2020-07-16T14:15:14.357381+0000 mgr.x (mgr.34562) 1760 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:15:17.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:15:17 smithi188 bash[23329]: cluster 2020-07-16T14:15:15.982712+0000 mgr.x (mgr.34562) 1761 : cluster [DBG] pgmap v1098: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:15:17.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:15:17 smithi132 bash[27079]: cluster 2020-07-16T14:15:15.982712+0000 mgr.x (mgr.34562) 1761 : cluster [DBG] pgmap v1098: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:15:17.735 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:15:17.995 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:15:17.996 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (38m) 4m ago 41m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:15:17.996 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (40m) 4m ago 40m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:15:17.996 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (38m) 4m ago 43m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:15:17.997 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (37m) 4m ago 45m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:15:17.997 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 4m ago 45m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:15:17.997 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (44m) 4m ago 44m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:15:17.997 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (44m) 4m ago 44m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:15:17.997 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (41m) 4m ago 41m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:15:17.998 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (41m) 4m ago 41m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:15:17.998 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (43m) 4m ago 43m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:15:17.998 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (43m) 4m ago 43m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:15:17.998 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (43m) 4m ago 43m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:15:17.999 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (42m) 4m ago 42m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:15:17.999 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (42m) 4m ago 42m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:15:17.999 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (42m) 4m ago 42m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:15:17.999 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (41m) 4m ago 41m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:15:18.000 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (41m) 4m ago 41m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:15:18.000 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (40m) 4m ago 41m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:15:18.291 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:15:18.292 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:15:18.292 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:15:18.292 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:15:18.292 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:15:18.292 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:15:18.293 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:15:18.293 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:15:18.293 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:15:18.293 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:15:18.293 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:15:18.294 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:15:18.294 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:15:18.294 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:15:18.294 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:15:18.294 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:15:18.295 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:15:19.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:15:19 smithi188 bash[23329]: audit 2020-07-16T14:15:17.722854+0000 mgr.x (mgr.34562) 1762 : audit [DBG] from='client.25918 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:15:19.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:15:19 smithi188 bash[23329]: cluster 2020-07-16T14:15:17.983210+0000 mgr.x (mgr.34562) 1763 : cluster [DBG] pgmap v1099: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:15:19.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:15:19 smithi188 bash[23329]: audit 2020-07-16T14:15:17.991212+0000 mgr.x (mgr.34562) 1764 : audit [DBG] from='client.25924 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:15:19.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:15:19 smithi188 bash[23329]: audit 2020-07-16T14:15:18.290451+0000 mon.c (mon.1) 166 : audit [DBG] from='client.? 172.21.15.132:0/3659999230' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:15:19.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:15:19 smithi132 bash[27079]: audit 2020-07-16T14:15:17.722854+0000 mgr.x (mgr.34562) 1762 : audit [DBG] from='client.25918 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:15:19.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:15:19 smithi132 bash[27079]: cluster 2020-07-16T14:15:17.983210+0000 mgr.x (mgr.34562) 1763 : cluster [DBG] pgmap v1099: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:15:19.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:15:19 smithi132 bash[27079]: audit 2020-07-16T14:15:17.991212+0000 mgr.x (mgr.34562) 1764 : audit [DBG] from='client.25924 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:15:19.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:15:19 smithi132 bash[27079]: audit 2020-07-16T14:15:18.290451+0000 mon.c (mon.1) 166 : audit [DBG] from='client.? 172.21.15.132:0/3659999230' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:15:20.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:15:20 smithi188 bash[23329]: cluster 2020-07-16T14:15:19.983793+0000 mgr.x (mgr.34562) 1765 : cluster [DBG] pgmap v1100: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:15:20.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:15:20 smithi132 bash[27079]: cluster 2020-07-16T14:15:19.983793+0000 mgr.x (mgr.34562) 1765 : cluster [DBG] pgmap v1100: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:15:23.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:15:23 smithi188 bash[23329]: cluster 2020-07-16T14:15:21.984215+0000 mgr.x (mgr.34562) 1766 : cluster [DBG] pgmap v1101: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:15:23.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:15:23 smithi132 bash[27079]: cluster 2020-07-16T14:15:21.984215+0000 mgr.x (mgr.34562) 1766 : cluster [DBG] pgmap v1101: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:15:25.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:15:25 smithi188 bash[23329]: cluster 2020-07-16T14:15:23.984608+0000 mgr.x (mgr.34562) 1767 : cluster [DBG] pgmap v1102: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:15:25.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:15:25 smithi132 bash[27079]: cluster 2020-07-16T14:15:23.984608+0000 mgr.x (mgr.34562) 1767 : cluster [DBG] pgmap v1102: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:15:27.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:15:27 smithi188 bash[23329]: cluster 2020-07-16T14:15:25.985107+0000 mgr.x (mgr.34562) 1768 : cluster [DBG] pgmap v1103: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:15:27.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:15:27 smithi132 bash[27079]: cluster 2020-07-16T14:15:25.985107+0000 mgr.x (mgr.34562) 1768 : cluster [DBG] pgmap v1103: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:15:29.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:15:29 smithi188 bash[23329]: cluster 2020-07-16T14:15:27.985628+0000 mgr.x (mgr.34562) 1769 : cluster [DBG] pgmap v1104: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:15:29.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:15:29 smithi132 bash[27079]: cluster 2020-07-16T14:15:27.985628+0000 mgr.x (mgr.34562) 1769 : cluster [DBG] pgmap v1104: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:15:30.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:15:30 smithi188 bash[23329]: audit 2020-07-16T14:15:29.370435+0000 mon.b (mon.2) 494 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:15:30.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:15:30 smithi132 bash[27079]: audit 2020-07-16T14:15:29.370435+0000 mon.b (mon.2) 494 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:15:31.426 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:15:31 smithi188 bash[23329]: cephadm 2020-07-16T14:15:29.371199+0000 mgr.x (mgr.34562) 1770 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:15:31.426 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:15:31 smithi188 bash[23329]: cephadm 2020-07-16T14:15:29.371569+0000 mgr.x (mgr.34562) 1771 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:15:31.427 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:15:31 smithi188 bash[23329]: cluster 2020-07-16T14:15:29.986009+0000 mgr.x (mgr.34562) 1772 : cluster [DBG] pgmap v1105: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:15:31.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:15:31 smithi132 bash[27079]: cephadm 2020-07-16T14:15:29.371199+0000 mgr.x (mgr.34562) 1770 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:15:31.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:15:31 smithi132 bash[27079]: cephadm 2020-07-16T14:15:29.371569+0000 mgr.x (mgr.34562) 1771 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:15:31.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:15:31 smithi132 bash[27079]: cluster 2020-07-16T14:15:29.986009+0000 mgr.x (mgr.34562) 1772 : cluster [DBG] pgmap v1105: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:15:33.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:15:33 smithi188 bash[23329]: cluster 2020-07-16T14:15:31.986584+0000 mgr.x (mgr.34562) 1773 : cluster [DBG] pgmap v1106: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:15:33.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:15:33 smithi132 bash[27079]: cluster 2020-07-16T14:15:31.986584+0000 mgr.x (mgr.34562) 1773 : cluster [DBG] pgmap v1106: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:15:35.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:15:35 smithi188 bash[23329]: cluster 2020-07-16T14:15:33.986923+0000 mgr.x (mgr.34562) 1774 : cluster [DBG] pgmap v1107: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:15:35.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:15:35 smithi132 bash[27079]: cluster 2020-07-16T14:15:33.986923+0000 mgr.x (mgr.34562) 1774 : cluster [DBG] pgmap v1107: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:15:37.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:15:37 smithi188 bash[23329]: cluster 2020-07-16T14:15:35.987398+0000 mgr.x (mgr.34562) 1775 : cluster [DBG] pgmap v1108: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:15:37.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:15:37 smithi132 bash[27079]: cluster 2020-07-16T14:15:35.987398+0000 mgr.x (mgr.34562) 1775 : cluster [DBG] pgmap v1108: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:15:39.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:15:39 smithi188 bash[23329]: cluster 2020-07-16T14:15:37.987926+0000 mgr.x (mgr.34562) 1776 : cluster [DBG] pgmap v1109: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:15:39.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:15:39 smithi132 bash[27079]: cluster 2020-07-16T14:15:37.987926+0000 mgr.x (mgr.34562) 1776 : cluster [DBG] pgmap v1109: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:15:40.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:15:40 smithi132 bash[27079]: cluster 2020-07-16T14:15:39.988359+0000 mgr.x (mgr.34562) 1777 : cluster [DBG] pgmap v1110: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:15:40.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:15:40 smithi188 bash[23329]: cluster 2020-07-16T14:15:39.988359+0000 mgr.x (mgr.34562) 1777 : cluster [DBG] pgmap v1110: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:15:43.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:15:43 smithi188 bash[23329]: cluster 2020-07-16T14:15:41.988885+0000 mgr.x (mgr.34562) 1778 : cluster [DBG] pgmap v1111: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:15:43.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:15:43 smithi132 bash[27079]: cluster 2020-07-16T14:15:41.988885+0000 mgr.x (mgr.34562) 1778 : cluster [DBG] pgmap v1111: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:15:45.172 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:15:45 smithi132 bash[27079]: cluster 2020-07-16T14:15:43.989250+0000 mgr.x (mgr.34562) 1779 : cluster [DBG] pgmap v1112: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:15:45.172 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:15:45 smithi132 bash[27079]: audit 2020-07-16T14:15:44.388203+0000 mon.b (mon.2) 495 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:15:45.173 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:15:45 smithi132 bash[27079]: audit 2020-07-16T14:15:44.389582+0000 mon.b (mon.2) 496 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:15:45.173 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:15:45 smithi132 bash[27079]: audit 2020-07-16T14:15:44.390786+0000 mon.b (mon.2) 497 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:15:45.173 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:15:45 smithi132 bash[27079]: audit 2020-07-16T14:15:44.392273+0000 mon.b (mon.2) 498 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:15:45.173 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:15:45 smithi132 bash[27079]: audit 2020-07-16T14:15:44.393569+0000 mon.b (mon.2) 499 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:15:45.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:15:45 smithi188 bash[23329]: cluster 2020-07-16T14:15:43.989250+0000 mgr.x (mgr.34562) 1779 : cluster [DBG] pgmap v1112: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:15:45.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:15:45 smithi188 bash[23329]: audit 2020-07-16T14:15:44.388203+0000 mon.b (mon.2) 495 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:15:45.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:15:45 smithi188 bash[23329]: audit 2020-07-16T14:15:44.389582+0000 mon.b (mon.2) 496 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:15:45.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:15:45 smithi188 bash[23329]: audit 2020-07-16T14:15:44.390786+0000 mon.b (mon.2) 497 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:15:45.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:15:45 smithi188 bash[23329]: audit 2020-07-16T14:15:44.392273+0000 mon.b (mon.2) 498 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:15:45.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:15:45 smithi188 bash[23329]: audit 2020-07-16T14:15:44.393569+0000 mon.b (mon.2) 499 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:15:46.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:15:46 smithi188 bash[23329]: audit 2020-07-16T14:15:44.388579+0000 mgr.x (mgr.34562) 1780 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:15:46.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:15:46 smithi188 bash[23329]: audit 2020-07-16T14:15:44.389933+0000 mgr.x (mgr.34562) 1781 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:15:46.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:15:46 smithi188 bash[23329]: audit 2020-07-16T14:15:44.391092+0000 mgr.x (mgr.34562) 1782 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:15:46.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:15:46 smithi188 bash[23329]: cephadm 2020-07-16T14:15:44.391840+0000 mgr.x (mgr.34562) 1783 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:15:46.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:15:46 smithi188 bash[23329]: cephadm 2020-07-16T14:15:44.393111+0000 mgr.x (mgr.34562) 1784 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:15:46.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:15:46 smithi188 bash[23329]: cephadm 2020-07-16T14:15:44.394277+0000 mgr.x (mgr.34562) 1785 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:15:46.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:15:46 smithi188 bash[23329]: cephadm 2020-07-16T14:15:44.394392+0000 mgr.x (mgr.34562) 1786 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:15:46.455 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:15:46 smithi132 bash[27079]: audit 2020-07-16T14:15:44.388579+0000 mgr.x (mgr.34562) 1780 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:15:46.455 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:15:46 smithi132 bash[27079]: audit 2020-07-16T14:15:44.389933+0000 mgr.x (mgr.34562) 1781 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:15:46.455 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:15:46 smithi132 bash[27079]: audit 2020-07-16T14:15:44.391092+0000 mgr.x (mgr.34562) 1782 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:15:46.456 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:15:46 smithi132 bash[27079]: cephadm 2020-07-16T14:15:44.391840+0000 mgr.x (mgr.34562) 1783 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:15:46.456 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:15:46 smithi132 bash[27079]: cephadm 2020-07-16T14:15:44.393111+0000 mgr.x (mgr.34562) 1784 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:15:46.456 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:15:46 smithi132 bash[27079]: cephadm 2020-07-16T14:15:44.394277+0000 mgr.x (mgr.34562) 1785 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:15:46.456 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:15:46 smithi132 bash[27079]: cephadm 2020-07-16T14:15:44.394392+0000 mgr.x (mgr.34562) 1786 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:15:47.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:15:47 smithi132 bash[27079]: cluster 2020-07-16T14:15:45.989737+0000 mgr.x (mgr.34562) 1787 : cluster [DBG] pgmap v1113: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:15:47.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:15:47 smithi132 bash[27079]: audit 2020-07-16T14:15:47.002976+0000 mon.b (mon.2) 500 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:15:47.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:15:47 smithi188 bash[23329]: cluster 2020-07-16T14:15:45.989737+0000 mgr.x (mgr.34562) 1787 : cluster [DBG] pgmap v1113: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:15:47.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:15:47 smithi188 bash[23329]: audit 2020-07-16T14:15:47.002976+0000 mon.b (mon.2) 500 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:15:48.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:15:48 smithi188 bash[23329]: cephadm 2020-07-16T14:15:47.003587+0000 mgr.x (mgr.34562) 1788 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:15:48.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:15:48 smithi188 bash[23329]: cephadm 2020-07-16T14:15:47.004027+0000 mgr.x (mgr.34562) 1789 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:15:48.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:15:48 smithi132 bash[27079]: cephadm 2020-07-16T14:15:47.003587+0000 mgr.x (mgr.34562) 1788 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:15:48.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:15:48 smithi132 bash[27079]: cephadm 2020-07-16T14:15:47.004027+0000 mgr.x (mgr.34562) 1789 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:15:48.589 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:15:48.855 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:15:48.855 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (38m) 5m ago 41m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:15:48.855 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (41m) 5m ago 41m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:15:48.855 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (38m) 5m ago 44m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:15:48.856 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (38m) 5m ago 46m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:15:48.856 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 5m ago 46m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:15:48.856 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (44m) 5m ago 44m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:15:48.856 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (44m) 5m ago 44m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:15:48.856 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (41m) 5m ago 41m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:15:48.857 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (41m) 5m ago 41m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:15:48.857 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (44m) 5m ago 44m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:15:48.857 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (43m) 5m ago 43m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:15:48.857 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (43m) 5m ago 43m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:15:48.857 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (43m) 5m ago 43m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:15:48.858 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (42m) 5m ago 43m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:15:48.858 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (42m) 5m ago 42m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:15:48.858 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (42m) 5m ago 42m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:15:48.858 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (42m) 5m ago 42m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:15:48.858 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (41m) 5m ago 41m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:15:49.157 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:15:49.158 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:15:49.158 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:15:49.158 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:15:49.158 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:15:49.158 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:15:49.159 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:15:49.159 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:15:49.159 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:15:49.159 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:15:49.159 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:15:49.160 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:15:49.160 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:15:49.160 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:15:49.160 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:15:49.160 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:15:49.160 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:15:49.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:15:49 smithi188 bash[23329]: cluster 2020-07-16T14:15:47.990169+0000 mgr.x (mgr.34562) 1790 : cluster [DBG] pgmap v1114: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:15:49.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:15:49 smithi132 bash[27079]: cluster 2020-07-16T14:15:47.990169+0000 mgr.x (mgr.34562) 1790 : cluster [DBG] pgmap v1114: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:15:50.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:15:50 smithi188 bash[23329]: audit 2020-07-16T14:15:48.577298+0000 mgr.x (mgr.34562) 1791 : audit [DBG] from='client.25936 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:15:50.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:15:50 smithi188 bash[23329]: audit 2020-07-16T14:15:48.850569+0000 mgr.x (mgr.34562) 1792 : audit [DBG] from='client.25942 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:15:50.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:15:50 smithi188 bash[23329]: audit 2020-07-16T14:15:49.155972+0000 mon.c (mon.1) 167 : audit [DBG] from='client.? 172.21.15.132:0/1702154217' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:15:50.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:15:50 smithi132 bash[27079]: audit 2020-07-16T14:15:48.577298+0000 mgr.x (mgr.34562) 1791 : audit [DBG] from='client.25936 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:15:50.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:15:50 smithi132 bash[27079]: audit 2020-07-16T14:15:48.850569+0000 mgr.x (mgr.34562) 1792 : audit [DBG] from='client.25942 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:15:50.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:15:50 smithi132 bash[27079]: audit 2020-07-16T14:15:49.155972+0000 mon.c (mon.1) 167 : audit [DBG] from='client.? 172.21.15.132:0/1702154217' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:15:51.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:15:51 smithi188 bash[23329]: cluster 2020-07-16T14:15:49.990571+0000 mgr.x (mgr.34562) 1793 : cluster [DBG] pgmap v1115: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:15:51.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:15:51 smithi132 bash[27079]: cluster 2020-07-16T14:15:49.990571+0000 mgr.x (mgr.34562) 1793 : cluster [DBG] pgmap v1115: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:15:53.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:15:53 smithi188 bash[23329]: cluster 2020-07-16T14:15:51.990961+0000 mgr.x (mgr.34562) 1794 : cluster [DBG] pgmap v1116: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:15:53.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:15:53 smithi132 bash[27079]: cluster 2020-07-16T14:15:51.990961+0000 mgr.x (mgr.34562) 1794 : cluster [DBG] pgmap v1116: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:15:55.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:15:55 smithi188 bash[23329]: cluster 2020-07-16T14:15:53.991404+0000 mgr.x (mgr.34562) 1795 : cluster [DBG] pgmap v1117: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:15:55.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:15:55 smithi132 bash[27079]: cluster 2020-07-16T14:15:53.991404+0000 mgr.x (mgr.34562) 1795 : cluster [DBG] pgmap v1117: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:15:57.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:15:57 smithi188 bash[23329]: cluster 2020-07-16T14:15:55.991857+0000 mgr.x (mgr.34562) 1796 : cluster [DBG] pgmap v1118: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:15:57.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:15:57 smithi132 bash[27079]: cluster 2020-07-16T14:15:55.991857+0000 mgr.x (mgr.34562) 1796 : cluster [DBG] pgmap v1118: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:15:59.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:15:59 smithi188 bash[23329]: cluster 2020-07-16T14:15:57.992237+0000 mgr.x (mgr.34562) 1797 : cluster [DBG] pgmap v1119: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:15:59.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:15:59 smithi132 bash[27079]: cluster 2020-07-16T14:15:57.992237+0000 mgr.x (mgr.34562) 1797 : cluster [DBG] pgmap v1119: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:16:00.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:16:00 smithi132 bash[27079]: cluster 2020-07-16T14:15:59.992745+0000 mgr.x (mgr.34562) 1798 : cluster [DBG] pgmap v1120: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:16:00.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:16:00 smithi188 bash[23329]: cluster 2020-07-16T14:15:59.992745+0000 mgr.x (mgr.34562) 1798 : cluster [DBG] pgmap v1120: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:16:02.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:16:02 smithi188 bash[23329]: audit 2020-07-16T14:16:02.019478+0000 mon.b (mon.2) 501 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:16:02.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:16:02 smithi132 bash[27079]: audit 2020-07-16T14:16:02.019478+0000 mon.b (mon.2) 501 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:16:03.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:16:03 smithi188 bash[23329]: cluster 2020-07-16T14:16:01.993350+0000 mgr.x (mgr.34562) 1799 : cluster [DBG] pgmap v1121: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:16:03.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:16:03 smithi188 bash[23329]: cephadm 2020-07-16T14:16:02.020200+0000 mgr.x (mgr.34562) 1800 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:16:03.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:16:03 smithi188 bash[23329]: cephadm 2020-07-16T14:16:02.020412+0000 mgr.x (mgr.34562) 1801 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:16:03.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:16:03 smithi132 bash[27079]: cluster 2020-07-16T14:16:01.993350+0000 mgr.x (mgr.34562) 1799 : cluster [DBG] pgmap v1121: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:16:03.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:16:03 smithi132 bash[27079]: cephadm 2020-07-16T14:16:02.020200+0000 mgr.x (mgr.34562) 1800 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:16:03.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:16:03 smithi132 bash[27079]: cephadm 2020-07-16T14:16:02.020412+0000 mgr.x (mgr.34562) 1801 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:16:05.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:16:05 smithi188 bash[23329]: cluster 2020-07-16T14:16:03.993855+0000 mgr.x (mgr.34562) 1802 : cluster [DBG] pgmap v1122: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:16:05.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:16:05 smithi132 bash[27079]: cluster 2020-07-16T14:16:03.993855+0000 mgr.x (mgr.34562) 1802 : cluster [DBG] pgmap v1122: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:16:07.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:16:07 smithi188 bash[23329]: cluster 2020-07-16T14:16:05.994314+0000 mgr.x (mgr.34562) 1803 : cluster [DBG] pgmap v1123: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:16:07.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:16:07 smithi132 bash[27079]: cluster 2020-07-16T14:16:05.994314+0000 mgr.x (mgr.34562) 1803 : cluster [DBG] pgmap v1123: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:16:09.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:16:09 smithi188 bash[23329]: cluster 2020-07-16T14:16:07.994758+0000 mgr.x (mgr.34562) 1804 : cluster [DBG] pgmap v1124: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:16:09.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:16:09 smithi132 bash[27079]: cluster 2020-07-16T14:16:07.994758+0000 mgr.x (mgr.34562) 1804 : cluster [DBG] pgmap v1124: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:16:10.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:16:10 smithi132 bash[27079]: cluster 2020-07-16T14:16:09.995196+0000 mgr.x (mgr.34562) 1805 : cluster [DBG] pgmap v1125: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:16:10.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:16:10 smithi188 bash[23329]: cluster 2020-07-16T14:16:09.995196+0000 mgr.x (mgr.34562) 1805 : cluster [DBG] pgmap v1125: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:16:13.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:16:13 smithi188 bash[23329]: cluster 2020-07-16T14:16:11.995616+0000 mgr.x (mgr.34562) 1806 : cluster [DBG] pgmap v1126: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:16:13.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:16:13 smithi132 bash[27079]: cluster 2020-07-16T14:16:11.995616+0000 mgr.x (mgr.34562) 1806 : cluster [DBG] pgmap v1126: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:16:15.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:16:15 smithi188 bash[23329]: cluster 2020-07-16T14:16:13.996116+0000 mgr.x (mgr.34562) 1807 : cluster [DBG] pgmap v1127: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:16:15.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:16:15 smithi132 bash[27079]: cluster 2020-07-16T14:16:13.996116+0000 mgr.x (mgr.34562) 1807 : cluster [DBG] pgmap v1127: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:16:17.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:16:17 smithi188 bash[23329]: cluster 2020-07-16T14:16:15.996614+0000 mgr.x (mgr.34562) 1808 : cluster [DBG] pgmap v1128: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:16:17.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:16:17 smithi188 bash[23329]: audit 2020-07-16T14:16:17.036104+0000 mon.b (mon.2) 502 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:16:17.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:16:17 smithi132 bash[27079]: cluster 2020-07-16T14:16:15.996614+0000 mgr.x (mgr.34562) 1808 : cluster [DBG] pgmap v1128: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:16:17.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:16:17 smithi132 bash[27079]: audit 2020-07-16T14:16:17.036104+0000 mon.b (mon.2) 502 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:16:18.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:16:18 smithi188 bash[23329]: cephadm 2020-07-16T14:16:17.036837+0000 mgr.x (mgr.34562) 1809 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:16:18.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:16:18 smithi188 bash[23329]: cephadm 2020-07-16T14:16:17.037347+0000 mgr.x (mgr.34562) 1810 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:16:18.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:16:18 smithi132 bash[27079]: cephadm 2020-07-16T14:16:17.036837+0000 mgr.x (mgr.34562) 1809 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:16:18.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:16:18 smithi132 bash[27079]: cephadm 2020-07-16T14:16:17.037347+0000 mgr.x (mgr.34562) 1810 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:16:19.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:16:19 smithi188 bash[23329]: cluster 2020-07-16T14:16:17.997144+0000 mgr.x (mgr.34562) 1811 : cluster [DBG] pgmap v1129: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:16:19.456 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:16:19.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:16:19 smithi132 bash[27079]: cluster 2020-07-16T14:16:17.997144+0000 mgr.x (mgr.34562) 1811 : cluster [DBG] pgmap v1129: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:16:19.724 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:16:19.724 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (39m) 5m ago 42m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:16:19.724 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (41m) 5m ago 41m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:16:19.725 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (39m) 5m ago 44m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:16:19.725 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (38m) 5m ago 46m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:16:19.725 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 5m ago 46m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:16:19.725 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (45m) 5m ago 45m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:16:19.726 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (45m) 5m ago 45m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:16:19.726 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (42m) 5m ago 42m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:16:19.726 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (42m) 5m ago 42m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:16:19.726 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (44m) 5m ago 44m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:16:19.726 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (44m) 5m ago 44m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:16:19.726 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (44m) 5m ago 44m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:16:19.727 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (43m) 5m ago 43m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:16:19.727 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (43m) 5m ago 43m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:16:19.727 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (43m) 5m ago 43m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:16:19.727 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (42m) 5m ago 43m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:16:19.727 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (42m) 5m ago 42m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:16:19.728 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (41m) 5m ago 42m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:16:20.032 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:16:20.032 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:16:20.032 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:16:20.033 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:16:20.033 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:16:20.033 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:16:20.033 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:16:20.034 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:16:20.034 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:16:20.034 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:16:20.034 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:16:20.034 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:16:20.034 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:16:20.035 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:16:20.035 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:16:20.035 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:16:20.035 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:16:20.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:16:20 smithi132 bash[27079]: audit 2020-07-16T14:16:19.444411+0000 mgr.x (mgr.34562) 1812 : audit [DBG] from='client.25954 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:16:20.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:16:20 smithi132 bash[27079]: audit 2020-07-16T14:16:19.719753+0000 mgr.x (mgr.34562) 1813 : audit [DBG] from='client.25960 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:16:20.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:16:20 smithi132 bash[27079]: cluster 2020-07-16T14:16:19.997493+0000 mgr.x (mgr.34562) 1814 : cluster [DBG] pgmap v1130: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:16:20.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:16:20 smithi132 bash[27079]: audit 2020-07-16T14:16:20.031249+0000 mon.c (mon.1) 168 : audit [DBG] from='client.? 172.21.15.132:0/366504154' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:16:20.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:16:20 smithi188 bash[23329]: audit 2020-07-16T14:16:19.444411+0000 mgr.x (mgr.34562) 1812 : audit [DBG] from='client.25954 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:16:20.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:16:20 smithi188 bash[23329]: audit 2020-07-16T14:16:19.719753+0000 mgr.x (mgr.34562) 1813 : audit [DBG] from='client.25960 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:16:20.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:16:20 smithi188 bash[23329]: cluster 2020-07-16T14:16:19.997493+0000 mgr.x (mgr.34562) 1814 : cluster [DBG] pgmap v1130: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:16:20.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:16:20 smithi188 bash[23329]: audit 2020-07-16T14:16:20.031249+0000 mon.c (mon.1) 168 : audit [DBG] from='client.? 172.21.15.132:0/366504154' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:16:23.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:16:23 smithi188 bash[23329]: cluster 2020-07-16T14:16:21.997836+0000 mgr.x (mgr.34562) 1815 : cluster [DBG] pgmap v1131: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:16:23.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:16:23 smithi132 bash[27079]: cluster 2020-07-16T14:16:21.997836+0000 mgr.x (mgr.34562) 1815 : cluster [DBG] pgmap v1131: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:16:25.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:16:25 smithi188 bash[23329]: cluster 2020-07-16T14:16:23.998371+0000 mgr.x (mgr.34562) 1816 : cluster [DBG] pgmap v1132: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:16:25.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:16:25 smithi132 bash[27079]: cluster 2020-07-16T14:16:23.998371+0000 mgr.x (mgr.34562) 1816 : cluster [DBG] pgmap v1132: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:16:27.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:16:27 smithi188 bash[23329]: cluster 2020-07-16T14:16:25.998857+0000 mgr.x (mgr.34562) 1817 : cluster [DBG] pgmap v1133: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:16:27.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:16:27 smithi132 bash[27079]: cluster 2020-07-16T14:16:25.998857+0000 mgr.x (mgr.34562) 1817 : cluster [DBG] pgmap v1133: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:16:29.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:16:29 smithi188 bash[23329]: cluster 2020-07-16T14:16:27.999346+0000 mgr.x (mgr.34562) 1818 : cluster [DBG] pgmap v1134: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:16:29.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:16:29 smithi132 bash[27079]: cluster 2020-07-16T14:16:27.999346+0000 mgr.x (mgr.34562) 1818 : cluster [DBG] pgmap v1134: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:16:30.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:16:30 smithi132 bash[27079]: cluster 2020-07-16T14:16:29.999852+0000 mgr.x (mgr.34562) 1819 : cluster [DBG] pgmap v1135: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:16:30.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:16:30 smithi188 bash[23329]: cluster 2020-07-16T14:16:29.999852+0000 mgr.x (mgr.34562) 1819 : cluster [DBG] pgmap v1135: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:16:33.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:16:33 smithi188 bash[23329]: cluster 2020-07-16T14:16:32.000359+0000 mgr.x (mgr.34562) 1820 : cluster [DBG] pgmap v1136: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:16:33.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:16:33 smithi188 bash[23329]: audit 2020-07-16T14:16:32.052743+0000 mon.b (mon.2) 503 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:16:33.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:16:33 smithi188 bash[23329]: cephadm 2020-07-16T14:16:32.056235+0000 mgr.x (mgr.34562) 1821 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:16:33.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:16:33 smithi188 bash[23329]: cephadm 2020-07-16T14:16:32.056498+0000 mgr.x (mgr.34562) 1822 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:16:33.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:16:33 smithi132 bash[27079]: cluster 2020-07-16T14:16:32.000359+0000 mgr.x (mgr.34562) 1820 : cluster [DBG] pgmap v1136: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:16:33.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:16:33 smithi132 bash[27079]: audit 2020-07-16T14:16:32.052743+0000 mon.b (mon.2) 503 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:16:33.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:16:33 smithi132 bash[27079]: cephadm 2020-07-16T14:16:32.056235+0000 mgr.x (mgr.34562) 1821 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:16:33.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:16:33 smithi132 bash[27079]: cephadm 2020-07-16T14:16:32.056498+0000 mgr.x (mgr.34562) 1822 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:16:35.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:16:35 smithi188 bash[23329]: cluster 2020-07-16T14:16:34.000705+0000 mgr.x (mgr.34562) 1823 : cluster [DBG] pgmap v1137: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:16:35.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:16:35 smithi132 bash[27079]: cluster 2020-07-16T14:16:34.000705+0000 mgr.x (mgr.34562) 1823 : cluster [DBG] pgmap v1137: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:16:37.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:16:37 smithi188 bash[23329]: cluster 2020-07-16T14:16:36.001155+0000 mgr.x (mgr.34562) 1824 : cluster [DBG] pgmap v1138: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:16:37.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:16:37 smithi132 bash[27079]: cluster 2020-07-16T14:16:36.001155+0000 mgr.x (mgr.34562) 1824 : cluster [DBG] pgmap v1138: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:16:39.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:16:39 smithi188 bash[23329]: cluster 2020-07-16T14:16:38.001600+0000 mgr.x (mgr.34562) 1825 : cluster [DBG] pgmap v1139: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:16:39.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:16:39 smithi132 bash[27079]: cluster 2020-07-16T14:16:38.001600+0000 mgr.x (mgr.34562) 1825 : cluster [DBG] pgmap v1139: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:16:40.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:16:40 smithi132 bash[27079]: cluster 2020-07-16T14:16:40.002111+0000 mgr.x (mgr.34562) 1826 : cluster [DBG] pgmap v1140: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:16:40.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:16:40 smithi188 bash[23329]: cluster 2020-07-16T14:16:40.002111+0000 mgr.x (mgr.34562) 1826 : cluster [DBG] pgmap v1140: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:16:43.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:16:43 smithi188 bash[23329]: cluster 2020-07-16T14:16:42.002550+0000 mgr.x (mgr.34562) 1827 : cluster [DBG] pgmap v1141: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:16:43.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:16:43 smithi132 bash[27079]: cluster 2020-07-16T14:16:42.002550+0000 mgr.x (mgr.34562) 1827 : cluster [DBG] pgmap v1141: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:16:45.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:16:45 smithi188 bash[23329]: cluster 2020-07-16T14:16:44.003063+0000 mgr.x (mgr.34562) 1828 : cluster [DBG] pgmap v1142: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:16:45.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:16:45 smithi132 bash[27079]: cluster 2020-07-16T14:16:44.003063+0000 mgr.x (mgr.34562) 1828 : cluster [DBG] pgmap v1142: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:16:47.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:16:47 smithi188 bash[23329]: cluster 2020-07-16T14:16:46.003503+0000 mgr.x (mgr.34562) 1829 : cluster [DBG] pgmap v1143: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:16:47.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:16:47 smithi132 bash[27079]: cluster 2020-07-16T14:16:46.003503+0000 mgr.x (mgr.34562) 1829 : cluster [DBG] pgmap v1143: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:16:48.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:16:48 smithi132 bash[27079]: audit 2020-07-16T14:16:47.061893+0000 mon.b (mon.2) 504 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:16:48.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:16:48 smithi132 bash[27079]: audit 2020-07-16T14:16:47.062320+0000 mgr.x (mgr.34562) 1830 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:16:48.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:16:48 smithi132 bash[27079]: audit 2020-07-16T14:16:47.063326+0000 mon.b (mon.2) 505 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:16:48.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:16:48 smithi132 bash[27079]: audit 2020-07-16T14:16:47.063649+0000 mgr.x (mgr.34562) 1831 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:16:48.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:16:48 smithi132 bash[27079]: audit 2020-07-16T14:16:47.067114+0000 mon.b (mon.2) 506 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:16:48.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:16:48 smithi132 bash[27079]: audit 2020-07-16T14:16:47.067428+0000 mgr.x (mgr.34562) 1832 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:16:48.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:16:48 smithi132 bash[27079]: cephadm 2020-07-16T14:16:47.068126+0000 mgr.x (mgr.34562) 1833 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:16:48.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:16:48 smithi132 bash[27079]: audit 2020-07-16T14:16:47.068485+0000 mon.b (mon.2) 507 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:16:48.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:16:48 smithi132 bash[27079]: cephadm 2020-07-16T14:16:47.069339+0000 mgr.x (mgr.34562) 1834 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:16:48.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:16:48 smithi132 bash[27079]: audit 2020-07-16T14:16:47.069633+0000 mon.b (mon.2) 508 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:16:48.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:16:48 smithi132 bash[27079]: cephadm 2020-07-16T14:16:47.070333+0000 mgr.x (mgr.34562) 1835 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:16:48.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:16:48 smithi132 bash[27079]: cephadm 2020-07-16T14:16:47.070619+0000 mgr.x (mgr.34562) 1836 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:16:48.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:16:48 smithi188 bash[23329]: audit 2020-07-16T14:16:47.061893+0000 mon.b (mon.2) 504 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:16:48.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:16:48 smithi188 bash[23329]: audit 2020-07-16T14:16:47.062320+0000 mgr.x (mgr.34562) 1830 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:16:48.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:16:48 smithi188 bash[23329]: audit 2020-07-16T14:16:47.063326+0000 mon.b (mon.2) 505 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:16:48.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:16:48 smithi188 bash[23329]: audit 2020-07-16T14:16:47.063649+0000 mgr.x (mgr.34562) 1831 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:16:48.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:16:48 smithi188 bash[23329]: audit 2020-07-16T14:16:47.067114+0000 mon.b (mon.2) 506 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:16:48.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:16:48 smithi188 bash[23329]: audit 2020-07-16T14:16:47.067428+0000 mgr.x (mgr.34562) 1832 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:16:48.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:16:48 smithi188 bash[23329]: cephadm 2020-07-16T14:16:47.068126+0000 mgr.x (mgr.34562) 1833 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:16:48.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:16:48 smithi188 bash[23329]: audit 2020-07-16T14:16:47.068485+0000 mon.b (mon.2) 507 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:16:48.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:16:48 smithi188 bash[23329]: cephadm 2020-07-16T14:16:47.069339+0000 mgr.x (mgr.34562) 1834 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:16:48.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:16:48 smithi188 bash[23329]: audit 2020-07-16T14:16:47.069633+0000 mon.b (mon.2) 508 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:16:48.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:16:48 smithi188 bash[23329]: cephadm 2020-07-16T14:16:47.070333+0000 mgr.x (mgr.34562) 1835 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:16:48.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:16:48 smithi188 bash[23329]: cephadm 2020-07-16T14:16:47.070619+0000 mgr.x (mgr.34562) 1836 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:16:49.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:16:49 smithi132 bash[27079]: cluster 2020-07-16T14:16:48.004049+0000 mgr.x (mgr.34562) 1837 : cluster [DBG] pgmap v1144: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:16:49.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:16:49 smithi188 bash[23329]: cluster 2020-07-16T14:16:48.004049+0000 mgr.x (mgr.34562) 1837 : cluster [DBG] pgmap v1144: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:16:50.322 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:16:50.584 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:16:50.584 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (39m) 6m ago 42m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:16:50.585 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (42m) 6m ago 42m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:16:50.585 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (39m) 6m ago 45m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:16:50.585 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (39m) 6m ago 47m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:16:50.585 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 6m ago 47m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:16:50.585 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (45m) 6m ago 45m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:16:50.586 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (45m) 6m ago 45m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:16:50.586 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (42m) 6m ago 42m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:16:50.586 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (42m) 6m ago 42m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:16:50.586 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (45m) 6m ago 45m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:16:50.587 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (44m) 6m ago 44m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:16:50.587 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (44m) 6m ago 44m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:16:50.587 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (44m) 6m ago 44m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:16:50.587 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (43m) 6m ago 44m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:16:50.587 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (43m) 6m ago 43m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:16:50.588 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (43m) 6m ago 43m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:16:50.588 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (43m) 6m ago 43m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:16:50.588 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (42m) 6m ago 42m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:16:50.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:16:50 smithi132 bash[27079]: audit 2020-07-16T14:16:49.830010+0000 mon.b (mon.2) 509 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:16:50.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:16:50 smithi132 bash[27079]: cephadm 2020-07-16T14:16:49.830669+0000 mgr.x (mgr.34562) 1838 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:16:50.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:16:50 smithi132 bash[27079]: cephadm 2020-07-16T14:16:49.831105+0000 mgr.x (mgr.34562) 1839 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:16:50.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:16:50 smithi132 bash[27079]: cluster 2020-07-16T14:16:50.004594+0000 mgr.x (mgr.34562) 1840 : cluster [DBG] pgmap v1145: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:16:50.884 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:16:50.885 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:16:50.885 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:16:50.885 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:16:50.885 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:16:50.886 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:16:50.886 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:16:50.886 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:16:50.886 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:16:50.887 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:16:50.887 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:16:50.887 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:16:50.887 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:16:50.887 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:16:50.888 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:16:50.888 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:16:50.888 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:16:50.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:16:50 smithi188 bash[23329]: audit 2020-07-16T14:16:49.830010+0000 mon.b (mon.2) 509 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:16:50.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:16:50 smithi188 bash[23329]: cephadm 2020-07-16T14:16:49.830669+0000 mgr.x (mgr.34562) 1838 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:16:50.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:16:50 smithi188 bash[23329]: cephadm 2020-07-16T14:16:49.831105+0000 mgr.x (mgr.34562) 1839 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:16:50.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:16:50 smithi188 bash[23329]: cluster 2020-07-16T14:16:50.004594+0000 mgr.x (mgr.34562) 1840 : cluster [DBG] pgmap v1145: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:16:51.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:16:51 smithi132 bash[27079]: audit 2020-07-16T14:16:50.310552+0000 mgr.x (mgr.34562) 1841 : audit [DBG] from='client.25972 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:16:51.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:16:51 smithi132 bash[27079]: audit 2020-07-16T14:16:50.579785+0000 mgr.x (mgr.34562) 1842 : audit [DBG] from='client.25978 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:16:51.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:16:51 smithi132 bash[27079]: audit 2020-07-16T14:16:50.883770+0000 mon.c (mon.1) 169 : audit [DBG] from='client.? 172.21.15.132:0/2572877448' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:16:51.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:16:51 smithi188 bash[23329]: audit 2020-07-16T14:16:50.310552+0000 mgr.x (mgr.34562) 1841 : audit [DBG] from='client.25972 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:16:51.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:16:51 smithi188 bash[23329]: audit 2020-07-16T14:16:50.579785+0000 mgr.x (mgr.34562) 1842 : audit [DBG] from='client.25978 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:16:51.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:16:51 smithi188 bash[23329]: audit 2020-07-16T14:16:50.883770+0000 mon.c (mon.1) 169 : audit [DBG] from='client.? 172.21.15.132:0/2572877448' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:16:52.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:16:52 smithi132 bash[27079]: cluster 2020-07-16T14:16:52.004963+0000 mgr.x (mgr.34562) 1843 : cluster [DBG] pgmap v1146: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:16:52.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:16:52 smithi188 bash[23329]: cluster 2020-07-16T14:16:52.004963+0000 mgr.x (mgr.34562) 1843 : cluster [DBG] pgmap v1146: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:16:55.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:16:55 smithi188 bash[23329]: cluster 2020-07-16T14:16:54.005376+0000 mgr.x (mgr.34562) 1844 : cluster [DBG] pgmap v1147: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:16:55.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:16:55 smithi132 bash[27079]: cluster 2020-07-16T14:16:54.005376+0000 mgr.x (mgr.34562) 1844 : cluster [DBG] pgmap v1147: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:16:57.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:16:57 smithi188 bash[23329]: cluster 2020-07-16T14:16:56.005742+0000 mgr.x (mgr.34562) 1845 : cluster [DBG] pgmap v1148: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:16:57.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:16:57 smithi132 bash[27079]: cluster 2020-07-16T14:16:56.005742+0000 mgr.x (mgr.34562) 1845 : cluster [DBG] pgmap v1148: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:16:59.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:16:59 smithi188 bash[23329]: cluster 2020-07-16T14:16:58.006149+0000 mgr.x (mgr.34562) 1846 : cluster [DBG] pgmap v1149: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:16:59.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:16:59 smithi132 bash[27079]: cluster 2020-07-16T14:16:58.006149+0000 mgr.x (mgr.34562) 1846 : cluster [DBG] pgmap v1149: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:17:00.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:17:00 smithi132 bash[27079]: cluster 2020-07-16T14:17:00.006674+0000 mgr.x (mgr.34562) 1847 : cluster [DBG] pgmap v1150: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:17:00.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:17:00 smithi188 bash[23329]: cluster 2020-07-16T14:17:00.006674+0000 mgr.x (mgr.34562) 1847 : cluster [DBG] pgmap v1150: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:17:03.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:17:03 smithi188 bash[23329]: cluster 2020-07-16T14:17:02.007059+0000 mgr.x (mgr.34562) 1848 : cluster [DBG] pgmap v1151: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:17:03.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:17:03 smithi132 bash[27079]: cluster 2020-07-16T14:17:02.007059+0000 mgr.x (mgr.34562) 1848 : cluster [DBG] pgmap v1151: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:17:05.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:17:05 smithi188 bash[23329]: cluster 2020-07-16T14:17:04.007496+0000 mgr.x (mgr.34562) 1849 : cluster [DBG] pgmap v1152: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:17:05.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:17:05 smithi188 bash[23329]: audit 2020-07-16T14:17:04.846574+0000 mon.b (mon.2) 510 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:17:05.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:17:05 smithi132 bash[27079]: cluster 2020-07-16T14:17:04.007496+0000 mgr.x (mgr.34562) 1849 : cluster [DBG] pgmap v1152: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:17:05.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:17:05 smithi132 bash[27079]: audit 2020-07-16T14:17:04.846574+0000 mon.b (mon.2) 510 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:17:06.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:17:06 smithi188 bash[23329]: cephadm 2020-07-16T14:17:04.847304+0000 mgr.x (mgr.34562) 1850 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:17:06.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:17:06 smithi188 bash[23329]: cephadm 2020-07-16T14:17:04.847389+0000 mgr.x (mgr.34562) 1851 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:17:06.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:17:06 smithi132 bash[27079]: cephadm 2020-07-16T14:17:04.847304+0000 mgr.x (mgr.34562) 1850 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:17:06.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:17:06 smithi132 bash[27079]: cephadm 2020-07-16T14:17:04.847389+0000 mgr.x (mgr.34562) 1851 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:17:07.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:17:07 smithi188 bash[23329]: cluster 2020-07-16T14:17:06.007835+0000 mgr.x (mgr.34562) 1852 : cluster [DBG] pgmap v1153: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:17:07.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:17:07 smithi132 bash[27079]: cluster 2020-07-16T14:17:06.007835+0000 mgr.x (mgr.34562) 1852 : cluster [DBG] pgmap v1153: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:17:09.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:17:09 smithi188 bash[23329]: cluster 2020-07-16T14:17:08.008249+0000 mgr.x (mgr.34562) 1853 : cluster [DBG] pgmap v1154: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:17:09.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:17:09 smithi132 bash[27079]: cluster 2020-07-16T14:17:08.008249+0000 mgr.x (mgr.34562) 1853 : cluster [DBG] pgmap v1154: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:17:10.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:17:10 smithi132 bash[27079]: cluster 2020-07-16T14:17:10.008659+0000 mgr.x (mgr.34562) 1854 : cluster [DBG] pgmap v1155: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:17:10.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:17:10 smithi188 bash[23329]: cluster 2020-07-16T14:17:10.008659+0000 mgr.x (mgr.34562) 1854 : cluster [DBG] pgmap v1155: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:17:13.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:17:13 smithi188 bash[23329]: cluster 2020-07-16T14:17:12.009218+0000 mgr.x (mgr.34562) 1855 : cluster [DBG] pgmap v1156: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:17:13.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:17:13 smithi132 bash[27079]: cluster 2020-07-16T14:17:12.009218+0000 mgr.x (mgr.34562) 1855 : cluster [DBG] pgmap v1156: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:17:15.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:17:15 smithi188 bash[23329]: cluster 2020-07-16T14:17:14.009611+0000 mgr.x (mgr.34562) 1856 : cluster [DBG] pgmap v1157: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:17:15.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:17:15 smithi132 bash[27079]: cluster 2020-07-16T14:17:14.009611+0000 mgr.x (mgr.34562) 1856 : cluster [DBG] pgmap v1157: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:17:17.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:17:17 smithi188 bash[23329]: cluster 2020-07-16T14:17:16.010104+0000 mgr.x (mgr.34562) 1857 : cluster [DBG] pgmap v1158: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:17:17.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:17:17 smithi132 bash[27079]: cluster 2020-07-16T14:17:16.010104+0000 mgr.x (mgr.34562) 1857 : cluster [DBG] pgmap v1158: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:17:19.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:17:19 smithi188 bash[23329]: cluster 2020-07-16T14:17:18.010554+0000 mgr.x (mgr.34562) 1858 : cluster [DBG] pgmap v1159: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:17:19.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:17:19 smithi132 bash[27079]: cluster 2020-07-16T14:17:18.010554+0000 mgr.x (mgr.34562) 1858 : cluster [DBG] pgmap v1159: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:17:20.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:17:20 smithi132 bash[27079]: audit 2020-07-16T14:17:19.862042+0000 mon.b (mon.2) 511 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:17:20.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:17:20 smithi132 bash[27079]: cephadm 2020-07-16T14:17:19.862865+0000 mgr.x (mgr.34562) 1859 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:17:20.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:17:20 smithi132 bash[27079]: cephadm 2020-07-16T14:17:19.863306+0000 mgr.x (mgr.34562) 1860 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:17:20.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:17:20 smithi132 bash[27079]: cluster 2020-07-16T14:17:20.011050+0000 mgr.x (mgr.34562) 1861 : cluster [DBG] pgmap v1160: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:17:20.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:17:20 smithi188 bash[23329]: audit 2020-07-16T14:17:19.862042+0000 mon.b (mon.2) 511 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:17:20.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:17:20 smithi188 bash[23329]: cephadm 2020-07-16T14:17:19.862865+0000 mgr.x (mgr.34562) 1859 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:17:20.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:17:20 smithi188 bash[23329]: cephadm 2020-07-16T14:17:19.863306+0000 mgr.x (mgr.34562) 1860 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:17:20.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:17:20 smithi188 bash[23329]: cluster 2020-07-16T14:17:20.011050+0000 mgr.x (mgr.34562) 1861 : cluster [DBG] pgmap v1160: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:17:21.185 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:17:21.447 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:17:21.447 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (40m) 6m ago 43m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:17:21.447 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (42m) 6m ago 42m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:17:21.447 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (40m) 6m ago 45m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:17:21.448 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (39m) 6m ago 47m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:17:21.448 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 6m ago 47m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:17:21.448 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (46m) 6m ago 46m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:17:21.448 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (46m) 6m ago 46m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:17:21.448 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (43m) 6m ago 43m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:17:21.449 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (43m) 6m ago 43m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:17:21.449 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (45m) 6m ago 45m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:17:21.449 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (45m) 6m ago 45m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:17:21.449 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (45m) 6m ago 45m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:17:21.449 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (44m) 6m ago 44m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:17:21.450 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (44m) 6m ago 44m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:17:21.450 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (44m) 6m ago 44m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:17:21.450 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (44m) 6m ago 44m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:17:21.450 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (43m) 6m ago 43m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:17:21.450 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (42m) 6m ago 43m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:17:21.744 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:17:21.745 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:17:21.745 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:17:21.745 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:17:21.745 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:17:21.745 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:17:21.746 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:17:21.746 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:17:21.746 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:17:21.746 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:17:21.747 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:17:21.747 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:17:21.747 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:17:21.747 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:17:21.747 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:17:21.748 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:17:21.749 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:17:21.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:17:21 smithi132 bash[27079]: audit 2020-07-16T14:17:21.173346+0000 mgr.x (mgr.34562) 1862 : audit [DBG] from='client.25990 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:17:21.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:17:21 smithi188 bash[23329]: audit 2020-07-16T14:17:21.173346+0000 mgr.x (mgr.34562) 1862 : audit [DBG] from='client.25990 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:17:22.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:17:22 smithi132 bash[27079]: audit 2020-07-16T14:17:21.442104+0000 mgr.x (mgr.34562) 1863 : audit [DBG] from='client.25996 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:17:22.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:17:22 smithi132 bash[27079]: audit 2020-07-16T14:17:21.743462+0000 mon.c (mon.1) 170 : audit [DBG] from='client.? 172.21.15.132:0/2588411248' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:17:22.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:17:22 smithi132 bash[27079]: cluster 2020-07-16T14:17:22.011589+0000 mgr.x (mgr.34562) 1864 : cluster [DBG] pgmap v1161: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:17:22.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:17:22 smithi188 bash[23329]: audit 2020-07-16T14:17:21.442104+0000 mgr.x (mgr.34562) 1863 : audit [DBG] from='client.25996 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:17:22.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:17:22 smithi188 bash[23329]: audit 2020-07-16T14:17:21.743462+0000 mon.c (mon.1) 170 : audit [DBG] from='client.? 172.21.15.132:0/2588411248' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:17:22.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:17:22 smithi188 bash[23329]: cluster 2020-07-16T14:17:22.011589+0000 mgr.x (mgr.34562) 1864 : cluster [DBG] pgmap v1161: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:17:25.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:17:25 smithi188 bash[23329]: cluster 2020-07-16T14:17:24.011968+0000 mgr.x (mgr.34562) 1865 : cluster [DBG] pgmap v1162: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:17:25.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:17:25 smithi132 bash[27079]: cluster 2020-07-16T14:17:24.011968+0000 mgr.x (mgr.34562) 1865 : cluster [DBG] pgmap v1162: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:17:27.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:17:27 smithi188 bash[23329]: cluster 2020-07-16T14:17:26.012512+0000 mgr.x (mgr.34562) 1866 : cluster [DBG] pgmap v1163: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:17:27.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:17:27 smithi132 bash[27079]: cluster 2020-07-16T14:17:26.012512+0000 mgr.x (mgr.34562) 1866 : cluster [DBG] pgmap v1163: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:17:29.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:17:29 smithi188 bash[23329]: cluster 2020-07-16T14:17:28.012978+0000 mgr.x (mgr.34562) 1867 : cluster [DBG] pgmap v1164: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:17:29.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:17:29 smithi132 bash[27079]: cluster 2020-07-16T14:17:28.012978+0000 mgr.x (mgr.34562) 1867 : cluster [DBG] pgmap v1164: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:17:30.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:17:30 smithi132 bash[27079]: cluster 2020-07-16T14:17:30.013376+0000 mgr.x (mgr.34562) 1868 : cluster [DBG] pgmap v1165: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:17:30.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:17:30 smithi188 bash[23329]: cluster 2020-07-16T14:17:30.013376+0000 mgr.x (mgr.34562) 1868 : cluster [DBG] pgmap v1165: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:17:33.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:17:33 smithi188 bash[23329]: cluster 2020-07-16T14:17:32.013807+0000 mgr.x (mgr.34562) 1869 : cluster [DBG] pgmap v1166: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:17:33.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:17:33 smithi132 bash[27079]: cluster 2020-07-16T14:17:32.013807+0000 mgr.x (mgr.34562) 1869 : cluster [DBG] pgmap v1166: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:17:35.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:17:35 smithi188 bash[23329]: cluster 2020-07-16T14:17:34.014160+0000 mgr.x (mgr.34562) 1870 : cluster [DBG] pgmap v1167: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:17:35.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:17:35 smithi188 bash[23329]: audit 2020-07-16T14:17:34.865861+0000 mon.b (mon.2) 512 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:17:35.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:17:35 smithi132 bash[27079]: cluster 2020-07-16T14:17:34.014160+0000 mgr.x (mgr.34562) 1870 : cluster [DBG] pgmap v1167: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:17:35.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:17:35 smithi132 bash[27079]: audit 2020-07-16T14:17:34.865861+0000 mon.b (mon.2) 512 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:17:36.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:17:36 smithi188 bash[23329]: cephadm 2020-07-16T14:17:34.866573+0000 mgr.x (mgr.34562) 1871 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:17:36.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:17:36 smithi188 bash[23329]: cephadm 2020-07-16T14:17:34.867026+0000 mgr.x (mgr.34562) 1872 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:17:36.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:17:36 smithi132 bash[27079]: cephadm 2020-07-16T14:17:34.866573+0000 mgr.x (mgr.34562) 1871 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:17:36.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:17:36 smithi132 bash[27079]: cephadm 2020-07-16T14:17:34.867026+0000 mgr.x (mgr.34562) 1872 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:17:37.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:17:37 smithi188 bash[23329]: cluster 2020-07-16T14:17:36.014571+0000 mgr.x (mgr.34562) 1873 : cluster [DBG] pgmap v1168: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:17:37.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:17:37 smithi132 bash[27079]: cluster 2020-07-16T14:17:36.014571+0000 mgr.x (mgr.34562) 1873 : cluster [DBG] pgmap v1168: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:17:39.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:17:39 smithi188 bash[23329]: cluster 2020-07-16T14:17:38.015132+0000 mgr.x (mgr.34562) 1874 : cluster [DBG] pgmap v1169: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:17:39.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:17:39 smithi132 bash[27079]: cluster 2020-07-16T14:17:38.015132+0000 mgr.x (mgr.34562) 1874 : cluster [DBG] pgmap v1169: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:17:40.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:17:40 smithi132 bash[27079]: cluster 2020-07-16T14:17:40.015598+0000 mgr.x (mgr.34562) 1875 : cluster [DBG] pgmap v1170: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:17:40.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:17:40 smithi188 bash[23329]: cluster 2020-07-16T14:17:40.015598+0000 mgr.x (mgr.34562) 1875 : cluster [DBG] pgmap v1170: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:17:43.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:17:43 smithi188 bash[23329]: cluster 2020-07-16T14:17:42.015998+0000 mgr.x (mgr.34562) 1876 : cluster [DBG] pgmap v1171: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:17:43.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:17:43 smithi132 bash[27079]: cluster 2020-07-16T14:17:42.015998+0000 mgr.x (mgr.34562) 1876 : cluster [DBG] pgmap v1171: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:17:45.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:17:45 smithi188 bash[23329]: cluster 2020-07-16T14:17:44.016524+0000 mgr.x (mgr.34562) 1877 : cluster [DBG] pgmap v1172: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:17:45.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:17:45 smithi132 bash[27079]: cluster 2020-07-16T14:17:44.016524+0000 mgr.x (mgr.34562) 1877 : cluster [DBG] pgmap v1172: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:17:47.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:17:47 smithi188 bash[23329]: cluster 2020-07-16T14:17:46.016988+0000 mgr.x (mgr.34562) 1878 : cluster [DBG] pgmap v1173: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:17:47.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:17:47 smithi132 bash[27079]: cluster 2020-07-16T14:17:46.016988+0000 mgr.x (mgr.34562) 1878 : cluster [DBG] pgmap v1173: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:17:49.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:17:49 smithi188 bash[23329]: cluster 2020-07-16T14:17:48.017491+0000 mgr.x (mgr.34562) 1879 : cluster [DBG] pgmap v1174: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:17:49.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:17:49 smithi132 bash[27079]: cluster 2020-07-16T14:17:48.017491+0000 mgr.x (mgr.34562) 1879 : cluster [DBG] pgmap v1174: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:17:50.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:17:50 smithi132 bash[27079]: audit 2020-07-16T14:17:49.885159+0000 mon.b (mon.2) 513 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:17:50.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:17:50 smithi132 bash[27079]: audit 2020-07-16T14:17:49.885550+0000 mgr.x (mgr.34562) 1880 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:17:50.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:17:50 smithi132 bash[27079]: audit 2020-07-16T14:17:49.886529+0000 mon.b (mon.2) 514 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:17:50.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:17:50 smithi132 bash[27079]: audit 2020-07-16T14:17:49.886902+0000 mgr.x (mgr.34562) 1881 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:17:50.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:17:50 smithi132 bash[27079]: audit 2020-07-16T14:17:49.887832+0000 mon.b (mon.2) 515 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:17:50.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:17:50 smithi132 bash[27079]: audit 2020-07-16T14:17:49.888106+0000 mgr.x (mgr.34562) 1882 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:17:50.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:17:50 smithi132 bash[27079]: cephadm 2020-07-16T14:17:49.888885+0000 mgr.x (mgr.34562) 1883 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:17:50.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:17:50 smithi132 bash[27079]: audit 2020-07-16T14:17:49.889266+0000 mon.b (mon.2) 516 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:17:50.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:17:50 smithi132 bash[27079]: cephadm 2020-07-16T14:17:49.890145+0000 mgr.x (mgr.34562) 1884 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:17:50.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:17:50 smithi132 bash[27079]: audit 2020-07-16T14:17:49.890521+0000 mon.b (mon.2) 517 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:17:50.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:17:50 smithi132 bash[27079]: cephadm 2020-07-16T14:17:49.891264+0000 mgr.x (mgr.34562) 1885 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:17:50.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:17:50 smithi132 bash[27079]: cephadm 2020-07-16T14:17:49.891478+0000 mgr.x (mgr.34562) 1886 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:17:50.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:17:50 smithi132 bash[27079]: cluster 2020-07-16T14:17:50.017915+0000 mgr.x (mgr.34562) 1887 : cluster [DBG] pgmap v1175: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:17:50.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:17:50 smithi188 bash[23329]: audit 2020-07-16T14:17:49.885159+0000 mon.b (mon.2) 513 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:17:50.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:17:50 smithi188 bash[23329]: audit 2020-07-16T14:17:49.885550+0000 mgr.x (mgr.34562) 1880 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:17:50.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:17:50 smithi188 bash[23329]: audit 2020-07-16T14:17:49.886529+0000 mon.b (mon.2) 514 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:17:50.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:17:50 smithi188 bash[23329]: audit 2020-07-16T14:17:49.886902+0000 mgr.x (mgr.34562) 1881 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:17:50.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:17:50 smithi188 bash[23329]: audit 2020-07-16T14:17:49.887832+0000 mon.b (mon.2) 515 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:17:50.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:17:50 smithi188 bash[23329]: audit 2020-07-16T14:17:49.888106+0000 mgr.x (mgr.34562) 1882 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:17:50.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:17:50 smithi188 bash[23329]: cephadm 2020-07-16T14:17:49.888885+0000 mgr.x (mgr.34562) 1883 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:17:50.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:17:50 smithi188 bash[23329]: audit 2020-07-16T14:17:49.889266+0000 mon.b (mon.2) 516 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:17:50.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:17:50 smithi188 bash[23329]: cephadm 2020-07-16T14:17:49.890145+0000 mgr.x (mgr.34562) 1884 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:17:50.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:17:50 smithi188 bash[23329]: audit 2020-07-16T14:17:49.890521+0000 mon.b (mon.2) 517 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:17:50.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:17:50 smithi188 bash[23329]: cephadm 2020-07-16T14:17:49.891264+0000 mgr.x (mgr.34562) 1885 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:17:50.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:17:50 smithi188 bash[23329]: cephadm 2020-07-16T14:17:49.891478+0000 mgr.x (mgr.34562) 1886 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:17:50.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:17:50 smithi188 bash[23329]: cluster 2020-07-16T14:17:50.017915+0000 mgr.x (mgr.34562) 1887 : cluster [DBG] pgmap v1175: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:17:52.071 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:17:52.347 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:17:52.348 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (40m) 7m ago 43m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:17:52.348 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (43m) 7m ago 43m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:17:52.348 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (40m) 7m ago 46m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:17:52.348 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (40m) 7m ago 48m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:17:52.348 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 7m ago 48m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:17:52.349 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (46m) 7m ago 46m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:17:52.349 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (46m) 7m ago 46m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:17:52.349 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (43m) 7m ago 43m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:17:52.349 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (43m) 7m ago 43m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:17:52.349 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (46m) 7m ago 46m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:17:52.350 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (45m) 7m ago 45m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:17:52.350 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (45m) 7m ago 45m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:17:52.350 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (45m) 7m ago 45m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:17:52.350 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (44m) 7m ago 45m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:17:52.350 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (44m) 7m ago 44m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:17:52.351 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (44m) 7m ago 44m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:17:52.351 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (44m) 7m ago 44m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:17:52.351 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (43m) 7m ago 43m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:17:52.654 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:17:52.655 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:17:52.655 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:17:52.655 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:17:52.655 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:17:52.656 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:17:52.656 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:17:52.656 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:17:52.656 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:17:52.656 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:17:52.657 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:17:52.657 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:17:52.657 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:17:52.657 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:17:52.658 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:17:52.658 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:17:52.658 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:17:53.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:17:53 smithi188 bash[23329]: cluster 2020-07-16T14:17:52.018474+0000 mgr.x (mgr.34562) 1888 : cluster [DBG] pgmap v1176: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:17:53.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:17:53 smithi188 bash[23329]: audit 2020-07-16T14:17:52.058732+0000 mgr.x (mgr.34562) 1889 : audit [DBG] from='client.26008 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:17:53.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:17:53 smithi188 bash[23329]: audit 2020-07-16T14:17:52.653828+0000 mon.c (mon.1) 171 : audit [DBG] from='client.? 172.21.15.132:0/2805487615' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:17:53.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:17:53 smithi188 bash[23329]: audit 2020-07-16T14:17:52.691134+0000 mon.b (mon.2) 518 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:17:53.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:17:53 smithi132 bash[27079]: cluster 2020-07-16T14:17:52.018474+0000 mgr.x (mgr.34562) 1888 : cluster [DBG] pgmap v1176: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:17:53.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:17:53 smithi132 bash[27079]: audit 2020-07-16T14:17:52.058732+0000 mgr.x (mgr.34562) 1889 : audit [DBG] from='client.26008 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:17:53.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:17:53 smithi132 bash[27079]: audit 2020-07-16T14:17:52.653828+0000 mon.c (mon.1) 171 : audit [DBG] from='client.? 172.21.15.132:0/2805487615' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:17:53.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:17:53 smithi132 bash[27079]: audit 2020-07-16T14:17:52.691134+0000 mon.b (mon.2) 518 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:17:54.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:17:54 smithi188 bash[23329]: audit 2020-07-16T14:17:52.343208+0000 mgr.x (mgr.34562) 1890 : audit [DBG] from='client.26014 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:17:54.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:17:54 smithi188 bash[23329]: cephadm 2020-07-16T14:17:52.691782+0000 mgr.x (mgr.34562) 1891 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:17:54.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:17:54 smithi188 bash[23329]: cephadm 2020-07-16T14:17:52.692157+0000 mgr.x (mgr.34562) 1892 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:17:54.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:17:54 smithi132 bash[27079]: audit 2020-07-16T14:17:52.343208+0000 mgr.x (mgr.34562) 1890 : audit [DBG] from='client.26014 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:17:54.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:17:54 smithi132 bash[27079]: cephadm 2020-07-16T14:17:52.691782+0000 mgr.x (mgr.34562) 1891 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:17:54.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:17:54 smithi132 bash[27079]: cephadm 2020-07-16T14:17:52.692157+0000 mgr.x (mgr.34562) 1892 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:17:55.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:17:55 smithi188 bash[23329]: cluster 2020-07-16T14:17:54.018859+0000 mgr.x (mgr.34562) 1893 : cluster [DBG] pgmap v1177: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:17:55.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:17:55 smithi132 bash[27079]: cluster 2020-07-16T14:17:54.018859+0000 mgr.x (mgr.34562) 1893 : cluster [DBG] pgmap v1177: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:17:57.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:17:57 smithi188 bash[23329]: cluster 2020-07-16T14:17:56.019227+0000 mgr.x (mgr.34562) 1894 : cluster [DBG] pgmap v1178: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:17:57.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:17:57 smithi132 bash[27079]: cluster 2020-07-16T14:17:56.019227+0000 mgr.x (mgr.34562) 1894 : cluster [DBG] pgmap v1178: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:17:59.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:17:59 smithi188 bash[23329]: cluster 2020-07-16T14:17:58.019614+0000 mgr.x (mgr.34562) 1895 : cluster [DBG] pgmap v1179: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:17:59.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:17:59 smithi132 bash[27079]: cluster 2020-07-16T14:17:58.019614+0000 mgr.x (mgr.34562) 1895 : cluster [DBG] pgmap v1179: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:18:00.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:18:00 smithi132 bash[27079]: cluster 2020-07-16T14:18:00.020143+0000 mgr.x (mgr.34562) 1896 : cluster [DBG] pgmap v1180: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:18:00.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:18:00 smithi188 bash[23329]: cluster 2020-07-16T14:18:00.020143+0000 mgr.x (mgr.34562) 1896 : cluster [DBG] pgmap v1180: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:18:03.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:18:03 smithi188 bash[23329]: cluster 2020-07-16T14:18:02.020744+0000 mgr.x (mgr.34562) 1897 : cluster [DBG] pgmap v1181: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:18:03.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:18:03 smithi132 bash[27079]: cluster 2020-07-16T14:18:02.020744+0000 mgr.x (mgr.34562) 1897 : cluster [DBG] pgmap v1181: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:18:05.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:18:05 smithi188 bash[23329]: cluster 2020-07-16T14:18:04.021169+0000 mgr.x (mgr.34562) 1898 : cluster [DBG] pgmap v1182: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:18:05.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:18:05 smithi132 bash[27079]: cluster 2020-07-16T14:18:04.021169+0000 mgr.x (mgr.34562) 1898 : cluster [DBG] pgmap v1182: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:18:07.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:18:07 smithi188 bash[23329]: cluster 2020-07-16T14:18:06.021506+0000 mgr.x (mgr.34562) 1899 : cluster [DBG] pgmap v1183: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:18:07.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:18:07 smithi132 bash[27079]: cluster 2020-07-16T14:18:06.021506+0000 mgr.x (mgr.34562) 1899 : cluster [DBG] pgmap v1183: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:18:08.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:18:08 smithi188 bash[23329]: audit 2020-07-16T14:18:07.701861+0000 mon.b (mon.2) 519 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:18:08.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:18:08 smithi132 bash[27079]: audit 2020-07-16T14:18:07.701861+0000 mon.b (mon.2) 519 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:18:09.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:18:09 smithi188 bash[23329]: cephadm 2020-07-16T14:18:07.702577+0000 mgr.x (mgr.34562) 1900 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:18:09.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:18:09 smithi188 bash[23329]: cephadm 2020-07-16T14:18:07.703007+0000 mgr.x (mgr.34562) 1901 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:18:09.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:18:09 smithi188 bash[23329]: cluster 2020-07-16T14:18:08.022011+0000 mgr.x (mgr.34562) 1902 : cluster [DBG] pgmap v1184: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:18:09.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:18:09 smithi132 bash[27079]: cephadm 2020-07-16T14:18:07.702577+0000 mgr.x (mgr.34562) 1900 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:18:09.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:18:09 smithi132 bash[27079]: cephadm 2020-07-16T14:18:07.703007+0000 mgr.x (mgr.34562) 1901 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:18:09.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:18:09 smithi132 bash[27079]: cluster 2020-07-16T14:18:08.022011+0000 mgr.x (mgr.34562) 1902 : cluster [DBG] pgmap v1184: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:18:10.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:18:10 smithi132 bash[27079]: cluster 2020-07-16T14:18:10.022543+0000 mgr.x (mgr.34562) 1903 : cluster [DBG] pgmap v1185: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:18:10.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:18:10 smithi188 bash[23329]: cluster 2020-07-16T14:18:10.022543+0000 mgr.x (mgr.34562) 1903 : cluster [DBG] pgmap v1185: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:18:13.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:18:13 smithi188 bash[23329]: cluster 2020-07-16T14:18:12.023078+0000 mgr.x (mgr.34562) 1904 : cluster [DBG] pgmap v1186: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:18:13.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:18:13 smithi132 bash[27079]: cluster 2020-07-16T14:18:12.023078+0000 mgr.x (mgr.34562) 1904 : cluster [DBG] pgmap v1186: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:18:15.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:18:15 smithi188 bash[23329]: cluster 2020-07-16T14:18:14.023562+0000 mgr.x (mgr.34562) 1905 : cluster [DBG] pgmap v1187: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:18:15.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:18:15 smithi132 bash[27079]: cluster 2020-07-16T14:18:14.023562+0000 mgr.x (mgr.34562) 1905 : cluster [DBG] pgmap v1187: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:18:17.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:18:17 smithi188 bash[23329]: cluster 2020-07-16T14:18:16.023918+0000 mgr.x (mgr.34562) 1906 : cluster [DBG] pgmap v1188: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:18:17.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:18:17 smithi132 bash[27079]: cluster 2020-07-16T14:18:16.023918+0000 mgr.x (mgr.34562) 1906 : cluster [DBG] pgmap v1188: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:18:19.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:18:19 smithi188 bash[23329]: cluster 2020-07-16T14:18:18.024333+0000 mgr.x (mgr.34562) 1907 : cluster [DBG] pgmap v1189: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:18:19.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:18:19 smithi132 bash[27079]: cluster 2020-07-16T14:18:18.024333+0000 mgr.x (mgr.34562) 1907 : cluster [DBG] pgmap v1189: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:18:20.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:18:20 smithi132 bash[27079]: cluster 2020-07-16T14:18:20.024817+0000 mgr.x (mgr.34562) 1908 : cluster [DBG] pgmap v1190: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:18:20.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:18:20 smithi188 bash[23329]: cluster 2020-07-16T14:18:20.024817+0000 mgr.x (mgr.34562) 1908 : cluster [DBG] pgmap v1190: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:18:22.952 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:18:23.212 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:18:23.212 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (41m) 7m ago 44m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:18:23.213 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (43m) 7m ago 43m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:18:23.213 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (41m) 7m ago 46m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:18:23.213 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (40m) 7m ago 48m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:18:23.213 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 7m ago 48m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:18:23.214 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (47m) 7m ago 47m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:18:23.214 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (47m) 7m ago 47m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:18:23.214 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (44m) 7m ago 44m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:18:23.215 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (44m) 7m ago 44m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:18:23.215 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (46m) 7m ago 46m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:18:23.215 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (46m) 7m ago 46m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:18:23.216 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (46m) 7m ago 46m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:18:23.216 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (45m) 7m ago 45m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:18:23.216 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (45m) 7m ago 45m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:18:23.217 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (45m) 7m ago 45m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:18:23.217 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (45m) 7m ago 45m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:18:23.217 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (44m) 7m ago 44m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:18:23.218 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (43m) 7m ago 44m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:18:23.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:18:23 smithi188 bash[23329]: cluster 2020-07-16T14:18:22.025216+0000 mgr.x (mgr.34562) 1909 : cluster [DBG] pgmap v1191: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:18:23.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:18:23 smithi188 bash[23329]: audit 2020-07-16T14:18:22.717755+0000 mon.b (mon.2) 520 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:18:23.512 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:18:23.512 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:18:23.513 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:18:23.513 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:18:23.513 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:18:23.513 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:18:23.513 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:18:23.514 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:18:23.514 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:18:23.514 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:18:23.514 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:18:23.514 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:18:23.515 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:18:23.515 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:18:23.515 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:18:23.515 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:18:23.515 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:18:23.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:18:23 smithi132 bash[27079]: cluster 2020-07-16T14:18:22.025216+0000 mgr.x (mgr.34562) 1909 : cluster [DBG] pgmap v1191: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:18:23.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:18:23 smithi132 bash[27079]: audit 2020-07-16T14:18:22.717755+0000 mon.b (mon.2) 520 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:18:24.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:18:24 smithi188 bash[23329]: cephadm 2020-07-16T14:18:22.718581+0000 mgr.x (mgr.34562) 1910 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:18:24.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:18:24 smithi188 bash[23329]: cephadm 2020-07-16T14:18:22.719091+0000 mgr.x (mgr.34562) 1911 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:18:24.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:18:24 smithi188 bash[23329]: audit 2020-07-16T14:18:22.940786+0000 mgr.x (mgr.34562) 1912 : audit [DBG] from='client.26026 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:18:24.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:18:24 smithi188 bash[23329]: audit 2020-07-16T14:18:23.207883+0000 mgr.x (mgr.34562) 1913 : audit [DBG] from='client.26032 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:18:24.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:18:24 smithi188 bash[23329]: audit 2020-07-16T14:18:23.511327+0000 mon.c (mon.1) 172 : audit [DBG] from='client.? 172.21.15.132:0/165914301' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:18:24.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:18:24 smithi132 bash[27079]: cephadm 2020-07-16T14:18:22.718581+0000 mgr.x (mgr.34562) 1910 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:18:24.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:18:24 smithi132 bash[27079]: cephadm 2020-07-16T14:18:22.719091+0000 mgr.x (mgr.34562) 1911 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:18:24.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:18:24 smithi132 bash[27079]: audit 2020-07-16T14:18:22.940786+0000 mgr.x (mgr.34562) 1912 : audit [DBG] from='client.26026 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:18:24.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:18:24 smithi132 bash[27079]: audit 2020-07-16T14:18:23.207883+0000 mgr.x (mgr.34562) 1913 : audit [DBG] from='client.26032 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:18:24.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:18:24 smithi132 bash[27079]: audit 2020-07-16T14:18:23.511327+0000 mon.c (mon.1) 172 : audit [DBG] from='client.? 172.21.15.132:0/165914301' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:18:25.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:18:25 smithi188 bash[23329]: cluster 2020-07-16T14:18:24.025728+0000 mgr.x (mgr.34562) 1914 : cluster [DBG] pgmap v1192: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:18:25.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:18:25 smithi132 bash[27079]: cluster 2020-07-16T14:18:24.025728+0000 mgr.x (mgr.34562) 1914 : cluster [DBG] pgmap v1192: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:18:27.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:18:27 smithi188 bash[23329]: cluster 2020-07-16T14:18:26.026242+0000 mgr.x (mgr.34562) 1915 : cluster [DBG] pgmap v1193: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:18:27.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:18:27 smithi132 bash[27079]: cluster 2020-07-16T14:18:26.026242+0000 mgr.x (mgr.34562) 1915 : cluster [DBG] pgmap v1193: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:18:29.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:18:29 smithi188 bash[23329]: cluster 2020-07-16T14:18:28.026644+0000 mgr.x (mgr.34562) 1916 : cluster [DBG] pgmap v1194: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:18:29.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:18:29 smithi132 bash[27079]: cluster 2020-07-16T14:18:28.026644+0000 mgr.x (mgr.34562) 1916 : cluster [DBG] pgmap v1194: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:18:30.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:18:30 smithi132 bash[27079]: cluster 2020-07-16T14:18:30.027066+0000 mgr.x (mgr.34562) 1917 : cluster [DBG] pgmap v1195: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:18:30.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:18:30 smithi188 bash[23329]: cluster 2020-07-16T14:18:30.027066+0000 mgr.x (mgr.34562) 1917 : cluster [DBG] pgmap v1195: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:18:33.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:18:33 smithi188 bash[23329]: cluster 2020-07-16T14:18:32.027479+0000 mgr.x (mgr.34562) 1918 : cluster [DBG] pgmap v1196: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:18:33.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:18:33 smithi132 bash[27079]: cluster 2020-07-16T14:18:32.027479+0000 mgr.x (mgr.34562) 1918 : cluster [DBG] pgmap v1196: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:18:35.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:18:35 smithi188 bash[23329]: cluster 2020-07-16T14:18:34.027968+0000 mgr.x (mgr.34562) 1919 : cluster [DBG] pgmap v1197: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:18:35.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:18:35 smithi132 bash[27079]: cluster 2020-07-16T14:18:34.027968+0000 mgr.x (mgr.34562) 1919 : cluster [DBG] pgmap v1197: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:18:37.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:18:37 smithi188 bash[23329]: cluster 2020-07-16T14:18:36.028471+0000 mgr.x (mgr.34562) 1920 : cluster [DBG] pgmap v1198: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:18:37.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:18:37 smithi132 bash[27079]: cluster 2020-07-16T14:18:36.028471+0000 mgr.x (mgr.34562) 1920 : cluster [DBG] pgmap v1198: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:18:38.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:18:38 smithi188 bash[23329]: audit 2020-07-16T14:18:37.734652+0000 mon.b (mon.2) 521 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:18:38.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:18:38 smithi132 bash[27079]: audit 2020-07-16T14:18:37.734652+0000 mon.b (mon.2) 521 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:18:39.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:18:39 smithi188 bash[23329]: cephadm 2020-07-16T14:18:37.735448+0000 mgr.x (mgr.34562) 1921 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:18:39.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:18:39 smithi188 bash[23329]: cephadm 2020-07-16T14:18:37.735811+0000 mgr.x (mgr.34562) 1922 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:18:39.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:18:39 smithi188 bash[23329]: cluster 2020-07-16T14:18:38.029053+0000 mgr.x (mgr.34562) 1923 : cluster [DBG] pgmap v1199: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:18:39.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:18:39 smithi132 bash[27079]: cephadm 2020-07-16T14:18:37.735448+0000 mgr.x (mgr.34562) 1921 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:18:39.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:18:39 smithi132 bash[27079]: cephadm 2020-07-16T14:18:37.735811+0000 mgr.x (mgr.34562) 1922 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:18:39.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:18:39 smithi132 bash[27079]: cluster 2020-07-16T14:18:38.029053+0000 mgr.x (mgr.34562) 1923 : cluster [DBG] pgmap v1199: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:18:40.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:18:40 smithi132 bash[27079]: cluster 2020-07-16T14:18:40.029573+0000 mgr.x (mgr.34562) 1924 : cluster [DBG] pgmap v1200: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:18:40.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:18:40 smithi188 bash[23329]: cluster 2020-07-16T14:18:40.029573+0000 mgr.x (mgr.34562) 1924 : cluster [DBG] pgmap v1200: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:18:43.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:18:43 smithi188 bash[23329]: cluster 2020-07-16T14:18:42.029996+0000 mgr.x (mgr.34562) 1925 : cluster [DBG] pgmap v1201: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:18:43.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:18:43 smithi132 bash[27079]: cluster 2020-07-16T14:18:42.029996+0000 mgr.x (mgr.34562) 1925 : cluster [DBG] pgmap v1201: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:18:45.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:18:45 smithi188 bash[23329]: cluster 2020-07-16T14:18:44.030493+0000 mgr.x (mgr.34562) 1926 : cluster [DBG] pgmap v1202: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:18:45.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:18:45 smithi132 bash[27079]: cluster 2020-07-16T14:18:44.030493+0000 mgr.x (mgr.34562) 1926 : cluster [DBG] pgmap v1202: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:18:47.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:18:47 smithi188 bash[23329]: cluster 2020-07-16T14:18:46.030845+0000 mgr.x (mgr.34562) 1927 : cluster [DBG] pgmap v1203: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:18:47.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:18:47 smithi132 bash[27079]: cluster 2020-07-16T14:18:46.030845+0000 mgr.x (mgr.34562) 1927 : cluster [DBG] pgmap v1203: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:18:49.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:18:49 smithi188 bash[23329]: cluster 2020-07-16T14:18:48.031318+0000 mgr.x (mgr.34562) 1928 : cluster [DBG] pgmap v1204: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:18:49.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:18:49 smithi132 bash[27079]: cluster 2020-07-16T14:18:48.031318+0000 mgr.x (mgr.34562) 1928 : cluster [DBG] pgmap v1204: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:18:50.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:18:50 smithi132 bash[27079]: cluster 2020-07-16T14:18:50.031749+0000 mgr.x (mgr.34562) 1929 : cluster [DBG] pgmap v1205: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:18:50.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:18:50 smithi188 bash[23329]: cluster 2020-07-16T14:18:50.031749+0000 mgr.x (mgr.34562) 1929 : cluster [DBG] pgmap v1205: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:18:53.343 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:18:53 smithi132 bash[27079]: cluster 2020-07-16T14:18:52.032385+0000 mgr.x (mgr.34562) 1930 : cluster [DBG] pgmap v1206: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:18:53.343 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:18:53 smithi132 bash[27079]: audit 2020-07-16T14:18:52.743077+0000 mon.b (mon.2) 522 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:18:53.344 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:18:53 smithi132 bash[27079]: audit 2020-07-16T14:18:52.744490+0000 mon.b (mon.2) 523 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:18:53.344 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:18:53 smithi132 bash[27079]: audit 2020-07-16T14:18:52.745751+0000 mon.b (mon.2) 524 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:18:53.344 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:18:53 smithi132 bash[27079]: audit 2020-07-16T14:18:52.747201+0000 mon.b (mon.2) 525 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:18:53.344 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:18:53 smithi132 bash[27079]: audit 2020-07-16T14:18:52.748574+0000 mon.b (mon.2) 526 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:18:53.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:18:53 smithi188 bash[23329]: cluster 2020-07-16T14:18:52.032385+0000 mgr.x (mgr.34562) 1930 : cluster [DBG] pgmap v1206: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:18:53.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:18:53 smithi188 bash[23329]: audit 2020-07-16T14:18:52.743077+0000 mon.b (mon.2) 522 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:18:53.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:18:53 smithi188 bash[23329]: audit 2020-07-16T14:18:52.744490+0000 mon.b (mon.2) 523 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:18:53.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:18:53 smithi188 bash[23329]: audit 2020-07-16T14:18:52.745751+0000 mon.b (mon.2) 524 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:18:53.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:18:53 smithi188 bash[23329]: audit 2020-07-16T14:18:52.747201+0000 mon.b (mon.2) 525 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:18:53.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:18:53 smithi188 bash[23329]: audit 2020-07-16T14:18:52.748574+0000 mon.b (mon.2) 526 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:18:53.839 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:18:54.105 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:18:54.106 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (41m) 8m ago 44m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:18:54.106 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (44m) 8m ago 44m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:18:54.106 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (41m) 8m ago 47m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:18:54.106 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (41m) 8m ago 49m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:18:54.107 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 8m ago 49m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:18:54.107 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (47m) 8m ago 47m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:18:54.107 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (47m) 8m ago 47m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:18:54.107 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (44m) 8m ago 44m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:18:54.107 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (44m) 8m ago 44m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:18:54.108 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (47m) 8m ago 47m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:18:54.108 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (46m) 8m ago 47m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:18:54.108 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (46m) 8m ago 46m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:18:54.108 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (46m) 8m ago 46m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:18:54.108 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (45m) 8m ago 46m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:18:54.109 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (45m) 8m ago 45m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:18:54.109 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (45m) 8m ago 45m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:18:54.109 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (45m) 8m ago 45m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:18:54.109 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (44m) 8m ago 44m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:18:54.413 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:18:54.414 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:18:54.414 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:18:54.415 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:18:54.415 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:18:54.415 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:18:54.416 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:18:54.416 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:18:54.416 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:18:54.417 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:18:54.417 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:18:54.417 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:18:54.418 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:18:54.418 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:18:54.418 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:18:54.418 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:18:54.419 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:18:54.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:18:54 smithi188 bash[23329]: audit 2020-07-16T14:18:52.743485+0000 mgr.x (mgr.34562) 1931 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:18:54.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:18:54 smithi188 bash[23329]: audit 2020-07-16T14:18:52.744823+0000 mgr.x (mgr.34562) 1932 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:18:54.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:18:54 smithi188 bash[23329]: audit 2020-07-16T14:18:52.746044+0000 mgr.x (mgr.34562) 1933 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:18:54.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:18:54 smithi188 bash[23329]: cephadm 2020-07-16T14:18:52.746781+0000 mgr.x (mgr.34562) 1934 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:18:54.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:18:54 smithi188 bash[23329]: cephadm 2020-07-16T14:18:52.748064+0000 mgr.x (mgr.34562) 1935 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:18:54.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:18:54 smithi188 bash[23329]: cephadm 2020-07-16T14:18:52.749325+0000 mgr.x (mgr.34562) 1936 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:18:54.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:18:54 smithi188 bash[23329]: cephadm 2020-07-16T14:18:52.749574+0000 mgr.x (mgr.34562) 1937 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:18:54.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:18:54 smithi132 bash[27079]: audit 2020-07-16T14:18:52.743485+0000 mgr.x (mgr.34562) 1931 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:18:54.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:18:54 smithi132 bash[27079]: audit 2020-07-16T14:18:52.744823+0000 mgr.x (mgr.34562) 1932 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:18:54.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:18:54 smithi132 bash[27079]: audit 2020-07-16T14:18:52.746044+0000 mgr.x (mgr.34562) 1933 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:18:54.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:18:54 smithi132 bash[27079]: cephadm 2020-07-16T14:18:52.746781+0000 mgr.x (mgr.34562) 1934 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:18:54.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:18:54 smithi132 bash[27079]: cephadm 2020-07-16T14:18:52.748064+0000 mgr.x (mgr.34562) 1935 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:18:54.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:18:54 smithi132 bash[27079]: cephadm 2020-07-16T14:18:52.749325+0000 mgr.x (mgr.34562) 1936 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:18:54.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:18:54 smithi132 bash[27079]: cephadm 2020-07-16T14:18:52.749574+0000 mgr.x (mgr.34562) 1937 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:18:55.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:18:55 smithi188 bash[23329]: audit 2020-07-16T14:18:53.826789+0000 mgr.x (mgr.34562) 1938 : audit [DBG] from='client.26044 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:18:55.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:18:55 smithi188 bash[23329]: cluster 2020-07-16T14:18:54.032832+0000 mgr.x (mgr.34562) 1939 : cluster [DBG] pgmap v1207: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:18:55.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:18:55 smithi188 bash[23329]: audit 2020-07-16T14:18:54.101272+0000 mgr.x (mgr.34562) 1940 : audit [DBG] from='client.26050 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:18:55.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:18:55 smithi188 bash[23329]: audit 2020-07-16T14:18:54.412654+0000 mon.c (mon.1) 173 : audit [DBG] from='client.? 172.21.15.132:0/683608904' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:18:55.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:18:55 smithi132 bash[27079]: audit 2020-07-16T14:18:53.826789+0000 mgr.x (mgr.34562) 1938 : audit [DBG] from='client.26044 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:18:55.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:18:55 smithi132 bash[27079]: cluster 2020-07-16T14:18:54.032832+0000 mgr.x (mgr.34562) 1939 : cluster [DBG] pgmap v1207: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:18:55.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:18:55 smithi132 bash[27079]: audit 2020-07-16T14:18:54.101272+0000 mgr.x (mgr.34562) 1940 : audit [DBG] from='client.26050 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:18:55.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:18:55 smithi132 bash[27079]: audit 2020-07-16T14:18:54.412654+0000 mon.c (mon.1) 173 : audit [DBG] from='client.? 172.21.15.132:0/683608904' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:18:56.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:18:56 smithi188 bash[23329]: audit 2020-07-16T14:18:55.686014+0000 mon.b (mon.2) 527 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:18:56.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:18:56 smithi132 bash[27079]: audit 2020-07-16T14:18:55.686014+0000 mon.b (mon.2) 527 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:18:57.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:18:57 smithi188 bash[23329]: cephadm 2020-07-16T14:18:55.686680+0000 mgr.x (mgr.34562) 1941 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:18:57.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:18:57 smithi188 bash[23329]: cephadm 2020-07-16T14:18:55.687011+0000 mgr.x (mgr.34562) 1942 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:18:57.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:18:57 smithi188 bash[23329]: cluster 2020-07-16T14:18:56.033174+0000 mgr.x (mgr.34562) 1943 : cluster [DBG] pgmap v1208: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:18:57.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:18:57 smithi132 bash[27079]: cephadm 2020-07-16T14:18:55.686680+0000 mgr.x (mgr.34562) 1941 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:18:57.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:18:57 smithi132 bash[27079]: cephadm 2020-07-16T14:18:55.687011+0000 mgr.x (mgr.34562) 1942 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:18:57.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:18:57 smithi132 bash[27079]: cluster 2020-07-16T14:18:56.033174+0000 mgr.x (mgr.34562) 1943 : cluster [DBG] pgmap v1208: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:18:59.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:18:59 smithi188 bash[23329]: cluster 2020-07-16T14:18:58.033574+0000 mgr.x (mgr.34562) 1944 : cluster [DBG] pgmap v1209: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:18:59.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:18:59 smithi132 bash[27079]: cluster 2020-07-16T14:18:58.033574+0000 mgr.x (mgr.34562) 1944 : cluster [DBG] pgmap v1209: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:19:00.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:19:00 smithi132 bash[27079]: cluster 2020-07-16T14:19:00.033999+0000 mgr.x (mgr.34562) 1945 : cluster [DBG] pgmap v1210: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:19:00.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:19:00 smithi188 bash[23329]: cluster 2020-07-16T14:19:00.033999+0000 mgr.x (mgr.34562) 1945 : cluster [DBG] pgmap v1210: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:19:03.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:19:03 smithi188 bash[23329]: cluster 2020-07-16T14:19:02.034554+0000 mgr.x (mgr.34562) 1946 : cluster [DBG] pgmap v1211: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:19:03.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:19:03 smithi132 bash[27079]: cluster 2020-07-16T14:19:02.034554+0000 mgr.x (mgr.34562) 1946 : cluster [DBG] pgmap v1211: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:19:05.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:19:05 smithi188 bash[23329]: cluster 2020-07-16T14:19:04.034977+0000 mgr.x (mgr.34562) 1947 : cluster [DBG] pgmap v1212: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:19:05.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:19:05 smithi132 bash[27079]: cluster 2020-07-16T14:19:04.034977+0000 mgr.x (mgr.34562) 1947 : cluster [DBG] pgmap v1212: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:19:07.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:19:07 smithi188 bash[23329]: cluster 2020-07-16T14:19:06.035320+0000 mgr.x (mgr.34562) 1948 : cluster [DBG] pgmap v1213: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:19:07.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:19:07 smithi132 bash[27079]: cluster 2020-07-16T14:19:06.035320+0000 mgr.x (mgr.34562) 1948 : cluster [DBG] pgmap v1213: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:19:09.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:19:09 smithi188 bash[23329]: cluster 2020-07-16T14:19:08.035845+0000 mgr.x (mgr.34562) 1949 : cluster [DBG] pgmap v1214: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:19:09.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:19:09 smithi132 bash[27079]: cluster 2020-07-16T14:19:08.035845+0000 mgr.x (mgr.34562) 1949 : cluster [DBG] pgmap v1214: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:19:10.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:19:10 smithi132 bash[27079]: cluster 2020-07-16T14:19:10.036250+0000 mgr.x (mgr.34562) 1950 : cluster [DBG] pgmap v1215: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:19:10.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:19:10 smithi188 bash[23329]: cluster 2020-07-16T14:19:10.036250+0000 mgr.x (mgr.34562) 1950 : cluster [DBG] pgmap v1215: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:19:11.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:19:11 smithi132 bash[27079]: audit 2020-07-16T14:19:10.702523+0000 mon.b (mon.2) 528 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:19:11.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:19:11 smithi132 bash[27079]: cephadm 2020-07-16T14:19:10.703220+0000 mgr.x (mgr.34562) 1951 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:19:11.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:19:11 smithi132 bash[27079]: cephadm 2020-07-16T14:19:10.703550+0000 mgr.x (mgr.34562) 1952 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:19:11.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:19:11 smithi188 bash[23329]: audit 2020-07-16T14:19:10.702523+0000 mon.b (mon.2) 528 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:19:11.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:19:11 smithi188 bash[23329]: cephadm 2020-07-16T14:19:10.703220+0000 mgr.x (mgr.34562) 1951 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:19:11.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:19:11 smithi188 bash[23329]: cephadm 2020-07-16T14:19:10.703550+0000 mgr.x (mgr.34562) 1952 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:19:12.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:19:12 smithi132 bash[27079]: cluster 2020-07-16T14:19:12.036813+0000 mgr.x (mgr.34562) 1953 : cluster [DBG] pgmap v1216: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:19:12.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:19:12 smithi188 bash[23329]: cluster 2020-07-16T14:19:12.036813+0000 mgr.x (mgr.34562) 1953 : cluster [DBG] pgmap v1216: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:19:15.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:19:15 smithi188 bash[23329]: cluster 2020-07-16T14:19:14.037185+0000 mgr.x (mgr.34562) 1954 : cluster [DBG] pgmap v1217: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:19:15.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:19:15 smithi132 bash[27079]: cluster 2020-07-16T14:19:14.037185+0000 mgr.x (mgr.34562) 1954 : cluster [DBG] pgmap v1217: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:19:17.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:19:17 smithi188 bash[23329]: cluster 2020-07-16T14:19:16.037618+0000 mgr.x (mgr.34562) 1955 : cluster [DBG] pgmap v1218: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:19:17.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:19:17 smithi132 bash[27079]: cluster 2020-07-16T14:19:16.037618+0000 mgr.x (mgr.34562) 1955 : cluster [DBG] pgmap v1218: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:19:19.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:19:19 smithi188 bash[23329]: cluster 2020-07-16T14:19:18.038179+0000 mgr.x (mgr.34562) 1956 : cluster [DBG] pgmap v1219: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:19:19.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:19:19 smithi132 bash[27079]: cluster 2020-07-16T14:19:18.038179+0000 mgr.x (mgr.34562) 1956 : cluster [DBG] pgmap v1219: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:19:20.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:19:20 smithi132 bash[27079]: cluster 2020-07-16T14:19:20.038645+0000 mgr.x (mgr.34562) 1957 : cluster [DBG] pgmap v1220: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:19:20.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:19:20 smithi188 bash[23329]: cluster 2020-07-16T14:19:20.038645+0000 mgr.x (mgr.34562) 1957 : cluster [DBG] pgmap v1220: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:19:23.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:19:23 smithi188 bash[23329]: cluster 2020-07-16T14:19:22.039154+0000 mgr.x (mgr.34562) 1958 : cluster [DBG] pgmap v1221: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:19:23.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:19:23 smithi132 bash[27079]: cluster 2020-07-16T14:19:22.039154+0000 mgr.x (mgr.34562) 1958 : cluster [DBG] pgmap v1221: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:19:24.720 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:19:24.980 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:19:24.980 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (42m) 8m ago 45m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:19:24.980 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (44m) 8m ago 44m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:19:24.980 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (42m) 8m ago 48m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:19:24.981 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (41m) 8m ago 49m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:19:24.981 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 8m ago 49m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:19:24.981 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (48m) 8m ago 48m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:19:24.981 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (48m) 8m ago 48m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:19:24.982 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (45m) 8m ago 45m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:19:24.982 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (45m) 8m ago 45m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:19:24.982 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (47m) 8m ago 47m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:19:24.982 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (47m) 8m ago 47m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:19:24.982 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (47m) 8m ago 47m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:19:24.983 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (46m) 8m ago 46m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:19:24.983 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (46m) 8m ago 46m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:19:24.983 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (46m) 8m ago 46m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:19:24.983 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (46m) 8m ago 46m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:19:24.983 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (45m) 8m ago 45m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:19:24.984 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (44m) 8m ago 45m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:19:25.278 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:19:25.278 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:19:25.279 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:19:25.279 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:19:25.279 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:19:25.279 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:19:25.279 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:19:25.279 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:19:25.280 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:19:25.280 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:19:25.280 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:19:25.280 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:19:25.280 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:19:25.281 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:19:25.281 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:19:25.281 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:19:25.281 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:19:25.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:19:25 smithi188 bash[23329]: cluster 2020-07-16T14:19:24.039562+0000 mgr.x (mgr.34562) 1959 : cluster [DBG] pgmap v1222: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:19:25.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:19:25 smithi132 bash[27079]: cluster 2020-07-16T14:19:24.039562+0000 mgr.x (mgr.34562) 1959 : cluster [DBG] pgmap v1222: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:19:26.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:19:26 smithi188 bash[23329]: audit 2020-07-16T14:19:24.708333+0000 mgr.x (mgr.34562) 1960 : audit [DBG] from='client.26062 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:19:26.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:19:26 smithi188 bash[23329]: audit 2020-07-16T14:19:24.975597+0000 mgr.x (mgr.34562) 1961 : audit [DBG] from='client.26068 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:19:26.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:19:26 smithi188 bash[23329]: audit 2020-07-16T14:19:25.277250+0000 mon.c (mon.1) 174 : audit [DBG] from='client.? 172.21.15.132:0/2910868482' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:19:26.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:19:26 smithi188 bash[23329]: audit 2020-07-16T14:19:25.719043+0000 mon.b (mon.2) 529 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:19:26.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:19:26 smithi132 bash[27079]: audit 2020-07-16T14:19:24.708333+0000 mgr.x (mgr.34562) 1960 : audit [DBG] from='client.26062 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:19:26.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:19:26 smithi132 bash[27079]: audit 2020-07-16T14:19:24.975597+0000 mgr.x (mgr.34562) 1961 : audit [DBG] from='client.26068 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:19:26.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:19:26 smithi132 bash[27079]: audit 2020-07-16T14:19:25.277250+0000 mon.c (mon.1) 174 : audit [DBG] from='client.? 172.21.15.132:0/2910868482' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:19:26.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:19:26 smithi132 bash[27079]: audit 2020-07-16T14:19:25.719043+0000 mon.b (mon.2) 529 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:19:27.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:19:27 smithi188 bash[23329]: cephadm 2020-07-16T14:19:25.719697+0000 mgr.x (mgr.34562) 1962 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:19:27.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:19:27 smithi188 bash[23329]: cephadm 2020-07-16T14:19:25.720008+0000 mgr.x (mgr.34562) 1963 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:19:27.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:19:27 smithi188 bash[23329]: cluster 2020-07-16T14:19:26.039892+0000 mgr.x (mgr.34562) 1964 : cluster [DBG] pgmap v1223: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:19:27.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:19:27 smithi132 bash[27079]: cephadm 2020-07-16T14:19:25.719697+0000 mgr.x (mgr.34562) 1962 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:19:27.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:19:27 smithi132 bash[27079]: cephadm 2020-07-16T14:19:25.720008+0000 mgr.x (mgr.34562) 1963 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:19:27.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:19:27 smithi132 bash[27079]: cluster 2020-07-16T14:19:26.039892+0000 mgr.x (mgr.34562) 1964 : cluster [DBG] pgmap v1223: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:19:29.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:19:29 smithi188 bash[23329]: cluster 2020-07-16T14:19:28.040336+0000 mgr.x (mgr.34562) 1965 : cluster [DBG] pgmap v1224: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:19:29.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:19:29 smithi132 bash[27079]: cluster 2020-07-16T14:19:28.040336+0000 mgr.x (mgr.34562) 1965 : cluster [DBG] pgmap v1224: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:19:30.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:19:30 smithi132 bash[27079]: cluster 2020-07-16T14:19:30.040765+0000 mgr.x (mgr.34562) 1966 : cluster [DBG] pgmap v1225: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:19:30.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:19:30 smithi188 bash[23329]: cluster 2020-07-16T14:19:30.040765+0000 mgr.x (mgr.34562) 1966 : cluster [DBG] pgmap v1225: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:19:33.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:19:33 smithi188 bash[23329]: cluster 2020-07-16T14:19:32.041214+0000 mgr.x (mgr.34562) 1967 : cluster [DBG] pgmap v1226: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:19:33.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:19:33 smithi132 bash[27079]: cluster 2020-07-16T14:19:32.041214+0000 mgr.x (mgr.34562) 1967 : cluster [DBG] pgmap v1226: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:19:35.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:19:35 smithi188 bash[23329]: cluster 2020-07-16T14:19:34.041677+0000 mgr.x (mgr.34562) 1968 : cluster [DBG] pgmap v1227: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:19:35.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:19:35 smithi132 bash[27079]: cluster 2020-07-16T14:19:34.041677+0000 mgr.x (mgr.34562) 1968 : cluster [DBG] pgmap v1227: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:19:37.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:19:37 smithi188 bash[23329]: cluster 2020-07-16T14:19:36.042034+0000 mgr.x (mgr.34562) 1969 : cluster [DBG] pgmap v1228: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:19:37.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:19:37 smithi132 bash[27079]: cluster 2020-07-16T14:19:36.042034+0000 mgr.x (mgr.34562) 1969 : cluster [DBG] pgmap v1228: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:19:39.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:19:39 smithi188 bash[23329]: cluster 2020-07-16T14:19:38.042491+0000 mgr.x (mgr.34562) 1970 : cluster [DBG] pgmap v1229: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:19:39.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:19:39 smithi132 bash[27079]: cluster 2020-07-16T14:19:38.042491+0000 mgr.x (mgr.34562) 1970 : cluster [DBG] pgmap v1229: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:19:40.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:19:40 smithi132 bash[27079]: cluster 2020-07-16T14:19:40.042961+0000 mgr.x (mgr.34562) 1971 : cluster [DBG] pgmap v1230: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:19:40.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:19:40 smithi188 bash[23329]: cluster 2020-07-16T14:19:40.042961+0000 mgr.x (mgr.34562) 1971 : cluster [DBG] pgmap v1230: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:19:41.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:19:41 smithi132 bash[27079]: audit 2020-07-16T14:19:40.735441+0000 mon.b (mon.2) 530 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:19:41.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:19:41 smithi132 bash[27079]: cephadm 2020-07-16T14:19:40.736127+0000 mgr.x (mgr.34562) 1972 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:19:41.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:19:41 smithi132 bash[27079]: cephadm 2020-07-16T14:19:40.736345+0000 mgr.x (mgr.34562) 1973 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:19:41.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:19:41 smithi188 bash[23329]: audit 2020-07-16T14:19:40.735441+0000 mon.b (mon.2) 530 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:19:41.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:19:41 smithi188 bash[23329]: cephadm 2020-07-16T14:19:40.736127+0000 mgr.x (mgr.34562) 1972 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:19:41.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:19:41 smithi188 bash[23329]: cephadm 2020-07-16T14:19:40.736345+0000 mgr.x (mgr.34562) 1973 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:19:42.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:19:42 smithi132 bash[27079]: cluster 2020-07-16T14:19:42.043375+0000 mgr.x (mgr.34562) 1974 : cluster [DBG] pgmap v1231: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:19:42.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:19:42 smithi188 bash[23329]: cluster 2020-07-16T14:19:42.043375+0000 mgr.x (mgr.34562) 1974 : cluster [DBG] pgmap v1231: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:19:45.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:19:45 smithi188 bash[23329]: cluster 2020-07-16T14:19:44.043863+0000 mgr.x (mgr.34562) 1975 : cluster [DBG] pgmap v1232: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:19:45.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:19:45 smithi132 bash[27079]: cluster 2020-07-16T14:19:44.043863+0000 mgr.x (mgr.34562) 1975 : cluster [DBG] pgmap v1232: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:19:47.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:19:47 smithi188 bash[23329]: cluster 2020-07-16T14:19:46.044392+0000 mgr.x (mgr.34562) 1976 : cluster [DBG] pgmap v1233: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:19:47.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:19:47 smithi132 bash[27079]: cluster 2020-07-16T14:19:46.044392+0000 mgr.x (mgr.34562) 1976 : cluster [DBG] pgmap v1233: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:19:49.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:19:49 smithi188 bash[23329]: cluster 2020-07-16T14:19:48.044802+0000 mgr.x (mgr.34562) 1977 : cluster [DBG] pgmap v1234: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:19:49.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:19:49 smithi132 bash[27079]: cluster 2020-07-16T14:19:48.044802+0000 mgr.x (mgr.34562) 1977 : cluster [DBG] pgmap v1234: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:19:50.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:19:50 smithi132 bash[27079]: cluster 2020-07-16T14:19:50.045198+0000 mgr.x (mgr.34562) 1978 : cluster [DBG] pgmap v1235: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:19:50.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:19:50 smithi188 bash[23329]: cluster 2020-07-16T14:19:50.045198+0000 mgr.x (mgr.34562) 1978 : cluster [DBG] pgmap v1235: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:19:53.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:19:53 smithi188 bash[23329]: cluster 2020-07-16T14:19:52.045585+0000 mgr.x (mgr.34562) 1979 : cluster [DBG] pgmap v1236: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:19:53.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:19:53 smithi132 bash[27079]: cluster 2020-07-16T14:19:52.045585+0000 mgr.x (mgr.34562) 1979 : cluster [DBG] pgmap v1236: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:19:55.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:19:55 smithi188 bash[23329]: cluster 2020-07-16T14:19:54.046062+0000 mgr.x (mgr.34562) 1980 : cluster [DBG] pgmap v1237: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:19:55.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:19:55 smithi132 bash[27079]: cluster 2020-07-16T14:19:54.046062+0000 mgr.x (mgr.34562) 1980 : cluster [DBG] pgmap v1237: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:19:55.576 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:19:55.842 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:19:55.842 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (42m) 9m ago 45m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:19:55.842 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (45m) 9m ago 45m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:19:55.843 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (42m) 9m ago 48m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:19:55.843 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (42m) 9m ago 50m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:19:55.843 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 9m ago 50m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:19:55.843 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (48m) 9m ago 48m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:19:55.843 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (48m) 9m ago 48m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:19:55.844 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (45m) 9m ago 45m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:19:55.844 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (45m) 9m ago 45m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:19:55.844 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (48m) 9m ago 48m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:19:55.844 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (48m) 9m ago 48m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:19:55.844 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (47m) 9m ago 47m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:19:55.845 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (47m) 9m ago 47m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:19:55.845 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (46m) 9m ago 47m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:19:55.845 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (46m) 9m ago 46m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:19:55.845 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (46m) 9m ago 46m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:19:55.846 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (46m) 9m ago 46m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:19:55.846 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (45m) 9m ago 45m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:19:56.170 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:19:56.170 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:19:56.170 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:19:56.171 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:19:56.171 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:19:56.171 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:19:56.171 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:19:56.172 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:19:56.172 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:19:56.172 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:19:56.172 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:19:56.172 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:19:56.173 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:19:56.173 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:19:56.173 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:19:56.173 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:19:56.173 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:19:56.358 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:19:56 smithi132 bash[27079]: audit 2020-07-16T14:19:55.754306+0000 mon.b (mon.2) 531 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:19:56.358 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:19:56 smithi132 bash[27079]: audit 2020-07-16T14:19:55.755668+0000 mon.b (mon.2) 532 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:19:56.359 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:19:56 smithi132 bash[27079]: audit 2020-07-16T14:19:55.756865+0000 mon.b (mon.2) 533 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:19:56.359 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:19:56 smithi132 bash[27079]: audit 2020-07-16T14:19:55.758158+0000 mon.b (mon.2) 534 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:19:56.359 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:19:56 smithi132 bash[27079]: audit 2020-07-16T14:19:55.759431+0000 mon.b (mon.2) 535 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:19:56.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:19:56 smithi188 bash[23329]: audit 2020-07-16T14:19:55.754306+0000 mon.b (mon.2) 531 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:19:56.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:19:56 smithi188 bash[23329]: audit 2020-07-16T14:19:55.755668+0000 mon.b (mon.2) 532 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:19:56.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:19:56 smithi188 bash[23329]: audit 2020-07-16T14:19:55.756865+0000 mon.b (mon.2) 533 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:19:56.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:19:56 smithi188 bash[23329]: audit 2020-07-16T14:19:55.758158+0000 mon.b (mon.2) 534 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:19:56.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:19:56 smithi188 bash[23329]: audit 2020-07-16T14:19:55.759431+0000 mon.b (mon.2) 535 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:19:57.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:19:57 smithi188 bash[23329]: audit 2020-07-16T14:19:55.564227+0000 mgr.x (mgr.34562) 1981 : audit [DBG] from='client.26080 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:19:57.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:19:57 smithi188 bash[23329]: audit 2020-07-16T14:19:55.754682+0000 mgr.x (mgr.34562) 1982 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:19:57.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:19:57 smithi188 bash[23329]: audit 2020-07-16T14:19:55.755982+0000 mgr.x (mgr.34562) 1983 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:19:57.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:19:57 smithi188 bash[23329]: audit 2020-07-16T14:19:55.757161+0000 mgr.x (mgr.34562) 1984 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:19:57.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:19:57 smithi188 bash[23329]: cephadm 2020-07-16T14:19:55.757888+0000 mgr.x (mgr.34562) 1985 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:19:57.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:19:57 smithi188 bash[23329]: cephadm 2020-07-16T14:19:55.759075+0000 mgr.x (mgr.34562) 1986 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:19:57.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:19:57 smithi188 bash[23329]: cephadm 2020-07-16T14:19:55.760166+0000 mgr.x (mgr.34562) 1987 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:19:57.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:19:57 smithi188 bash[23329]: cephadm 2020-07-16T14:19:55.760297+0000 mgr.x (mgr.34562) 1988 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:19:57.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:19:57 smithi188 bash[23329]: audit 2020-07-16T14:19:55.837729+0000 mgr.x (mgr.34562) 1989 : audit [DBG] from='client.26086 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:19:57.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:19:57 smithi188 bash[23329]: cluster 2020-07-16T14:19:56.046481+0000 mgr.x (mgr.34562) 1990 : cluster [DBG] pgmap v1238: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:19:57.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:19:57 smithi188 bash[23329]: audit 2020-07-16T14:19:56.169183+0000 mon.c (mon.1) 175 : audit [DBG] from='client.? 172.21.15.132:0/1134726013' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:19:57.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:19:57 smithi132 bash[27079]: audit 2020-07-16T14:19:55.564227+0000 mgr.x (mgr.34562) 1981 : audit [DBG] from='client.26080 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:19:57.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:19:57 smithi132 bash[27079]: audit 2020-07-16T14:19:55.754682+0000 mgr.x (mgr.34562) 1982 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:19:57.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:19:57 smithi132 bash[27079]: audit 2020-07-16T14:19:55.755982+0000 mgr.x (mgr.34562) 1983 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:19:57.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:19:57 smithi132 bash[27079]: audit 2020-07-16T14:19:55.757161+0000 mgr.x (mgr.34562) 1984 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:19:57.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:19:57 smithi132 bash[27079]: cephadm 2020-07-16T14:19:55.757888+0000 mgr.x (mgr.34562) 1985 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:19:57.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:19:57 smithi132 bash[27079]: cephadm 2020-07-16T14:19:55.759075+0000 mgr.x (mgr.34562) 1986 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:19:57.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:19:57 smithi132 bash[27079]: cephadm 2020-07-16T14:19:55.760166+0000 mgr.x (mgr.34562) 1987 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:19:57.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:19:57 smithi132 bash[27079]: cephadm 2020-07-16T14:19:55.760297+0000 mgr.x (mgr.34562) 1988 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:19:57.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:19:57 smithi132 bash[27079]: audit 2020-07-16T14:19:55.837729+0000 mgr.x (mgr.34562) 1989 : audit [DBG] from='client.26086 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:19:57.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:19:57 smithi132 bash[27079]: cluster 2020-07-16T14:19:56.046481+0000 mgr.x (mgr.34562) 1990 : cluster [DBG] pgmap v1238: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:19:57.532 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:19:57 smithi132 bash[27079]: audit 2020-07-16T14:19:56.169183+0000 mon.c (mon.1) 175 : audit [DBG] from='client.? 172.21.15.132:0/1134726013' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:19:59.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:19:59 smithi188 bash[23329]: cluster 2020-07-16T14:19:58.046913+0000 mgr.x (mgr.34562) 1991 : cluster [DBG] pgmap v1239: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:19:59.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:19:59 smithi188 bash[23329]: audit 2020-07-16T14:19:58.562846+0000 mon.b (mon.2) 536 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:19:59.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:19:59 smithi132 bash[27079]: cluster 2020-07-16T14:19:58.046913+0000 mgr.x (mgr.34562) 1991 : cluster [DBG] pgmap v1239: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:19:59.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:19:59 smithi132 bash[27079]: audit 2020-07-16T14:19:58.562846+0000 mon.b (mon.2) 536 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:20:00.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:20:00 smithi188 bash[23329]: cephadm 2020-07-16T14:19:58.563518+0000 mgr.x (mgr.34562) 1992 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:20:00.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:20:00 smithi188 bash[23329]: cephadm 2020-07-16T14:19:58.563670+0000 mgr.x (mgr.34562) 1993 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:20:00.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:20:00 smithi132 bash[27079]: cephadm 2020-07-16T14:19:58.563518+0000 mgr.x (mgr.34562) 1992 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:20:00.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:20:00 smithi132 bash[27079]: cephadm 2020-07-16T14:19:58.563670+0000 mgr.x (mgr.34562) 1993 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:20:01.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:20:01 smithi188 bash[23329]: cluster 2020-07-16T14:20:00.047393+0000 mgr.x (mgr.34562) 1994 : cluster [DBG] pgmap v1240: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:20:01.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:20:01 smithi132 bash[27079]: cluster 2020-07-16T14:20:00.047393+0000 mgr.x (mgr.34562) 1994 : cluster [DBG] pgmap v1240: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:20:03.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:20:03 smithi188 bash[23329]: cluster 2020-07-16T14:20:02.047865+0000 mgr.x (mgr.34562) 1995 : cluster [DBG] pgmap v1241: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:20:03.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:20:03 smithi132 bash[27079]: cluster 2020-07-16T14:20:02.047865+0000 mgr.x (mgr.34562) 1995 : cluster [DBG] pgmap v1241: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:20:05.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:20:05 smithi188 bash[23329]: cluster 2020-07-16T14:20:04.048406+0000 mgr.x (mgr.34562) 1996 : cluster [DBG] pgmap v1242: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:20:05.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:20:05 smithi132 bash[27079]: cluster 2020-07-16T14:20:04.048406+0000 mgr.x (mgr.34562) 1996 : cluster [DBG] pgmap v1242: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:20:07.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:20:07 smithi188 bash[23329]: cluster 2020-07-16T14:20:06.048922+0000 mgr.x (mgr.34562) 1997 : cluster [DBG] pgmap v1243: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:20:07.535 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:20:07 smithi132 bash[27079]: cluster 2020-07-16T14:20:06.048922+0000 mgr.x (mgr.34562) 1997 : cluster [DBG] pgmap v1243: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:20:09.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:20:09 smithi188 bash[23329]: cluster 2020-07-16T14:20:08.049436+0000 mgr.x (mgr.34562) 1998 : cluster [DBG] pgmap v1244: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:20:09.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:20:09 smithi132 bash[27079]: cluster 2020-07-16T14:20:08.049436+0000 mgr.x (mgr.34562) 1998 : cluster [DBG] pgmap v1244: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:20:10.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:20:10 smithi132 bash[27079]: cluster 2020-07-16T14:20:10.049791+0000 mgr.x (mgr.34562) 1999 : cluster [DBG] pgmap v1245: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:20:10.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:20:10 smithi188 bash[23329]: cluster 2020-07-16T14:20:10.049791+0000 mgr.x (mgr.34562) 1999 : cluster [DBG] pgmap v1245: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:20:13.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:20:13 smithi188 bash[23329]: cluster 2020-07-16T14:20:12.050180+0000 mgr.x (mgr.34562) 2000 : cluster [DBG] pgmap v1246: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:20:13.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:20:13 smithi132 bash[27079]: cluster 2020-07-16T14:20:12.050180+0000 mgr.x (mgr.34562) 2000 : cluster [DBG] pgmap v1246: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:20:14.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:20:14 smithi188 bash[23329]: audit 2020-07-16T14:20:13.569823+0000 mon.b (mon.2) 537 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:20:14.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:20:14 smithi132 bash[27079]: audit 2020-07-16T14:20:13.569823+0000 mon.b (mon.2) 537 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:20:15.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:20:15 smithi188 bash[23329]: cephadm 2020-07-16T14:20:13.570748+0000 mgr.x (mgr.34562) 2001 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:20:15.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:20:15 smithi188 bash[23329]: cephadm 2020-07-16T14:20:13.570888+0000 mgr.x (mgr.34562) 2002 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:20:15.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:20:15 smithi188 bash[23329]: cluster 2020-07-16T14:20:14.050614+0000 mgr.x (mgr.34562) 2003 : cluster [DBG] pgmap v1247: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:20:15.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:20:15 smithi132 bash[27079]: cephadm 2020-07-16T14:20:13.570748+0000 mgr.x (mgr.34562) 2001 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:20:15.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:20:15 smithi132 bash[27079]: cephadm 2020-07-16T14:20:13.570888+0000 mgr.x (mgr.34562) 2002 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:20:15.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:20:15 smithi132 bash[27079]: cluster 2020-07-16T14:20:14.050614+0000 mgr.x (mgr.34562) 2003 : cluster [DBG] pgmap v1247: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:20:17.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:20:17 smithi188 bash[23329]: cluster 2020-07-16T14:20:16.050937+0000 mgr.x (mgr.34562) 2004 : cluster [DBG] pgmap v1248: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:20:17.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:20:17 smithi132 bash[27079]: cluster 2020-07-16T14:20:16.050937+0000 mgr.x (mgr.34562) 2004 : cluster [DBG] pgmap v1248: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:20:19.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:20:19 smithi188 bash[23329]: cluster 2020-07-16T14:20:18.051428+0000 mgr.x (mgr.34562) 2005 : cluster [DBG] pgmap v1249: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:20:19.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:20:19 smithi132 bash[27079]: cluster 2020-07-16T14:20:18.051428+0000 mgr.x (mgr.34562) 2005 : cluster [DBG] pgmap v1249: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:20:20.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:20:20 smithi132 bash[27079]: cluster 2020-07-16T14:20:20.051784+0000 mgr.x (mgr.34562) 2006 : cluster [DBG] pgmap v1250: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:20:20.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:20:20 smithi188 bash[23329]: cluster 2020-07-16T14:20:20.051784+0000 mgr.x (mgr.34562) 2006 : cluster [DBG] pgmap v1250: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:20:23.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:20:23 smithi188 bash[23329]: cluster 2020-07-16T14:20:22.052327+0000 mgr.x (mgr.34562) 2007 : cluster [DBG] pgmap v1251: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:20:23.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:20:23 smithi132 bash[27079]: cluster 2020-07-16T14:20:22.052327+0000 mgr.x (mgr.34562) 2007 : cluster [DBG] pgmap v1251: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:20:25.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:20:25 smithi188 bash[23329]: cluster 2020-07-16T14:20:24.052702+0000 mgr.x (mgr.34562) 2008 : cluster [DBG] pgmap v1252: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:20:25.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:20:25 smithi132 bash[27079]: cluster 2020-07-16T14:20:24.052702+0000 mgr.x (mgr.34562) 2008 : cluster [DBG] pgmap v1252: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:20:26.472 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:20:26.739 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:20:26.739 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (43m) 9m ago 46m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:20:26.739 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (45m) 9m ago 45m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:20:26.739 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (43m) 9m ago 49m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:20:26.740 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (42m) 9m ago 50m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:20:26.740 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 9m ago 50m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:20:26.740 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (49m) 9m ago 49m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:20:26.740 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (49m) 9m ago 49m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:20:26.741 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (46m) 9m ago 46m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:20:26.741 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (46m) 9m ago 46m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:20:26.741 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (48m) 9m ago 48m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:20:26.741 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (48m) 9m ago 48m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:20:26.741 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (48m) 9m ago 48m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:20:26.742 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (47m) 9m ago 47m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:20:26.742 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (47m) 9m ago 47m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:20:26.742 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (47m) 9m ago 47m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:20:26.742 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (47m) 9m ago 47m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:20:26.742 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (46m) 9m ago 46m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:20:26.743 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (45m) 9m ago 46m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:20:27.029 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:20:27.030 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:20:27.030 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:20:27.030 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:20:27.030 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:20:27.031 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:20:27.031 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:20:27.031 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:20:27.031 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:20:27.031 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:20:27.032 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:20:27.032 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:20:27.032 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:20:27.032 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:20:27.032 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:20:27.033 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:20:27.033 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:20:27.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:20:27 smithi188 bash[23329]: cluster 2020-07-16T14:20:26.053026+0000 mgr.x (mgr.34562) 2009 : cluster [DBG] pgmap v1253: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:20:27.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:20:27 smithi188 bash[23329]: audit 2020-07-16T14:20:27.028612+0000 mon.c (mon.1) 176 : audit [DBG] from='client.? 172.21.15.132:0/3648012160' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:20:27.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:20:27 smithi132 bash[27079]: cluster 2020-07-16T14:20:26.053026+0000 mgr.x (mgr.34562) 2009 : cluster [DBG] pgmap v1253: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:20:27.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:20:27 smithi132 bash[27079]: audit 2020-07-16T14:20:27.028612+0000 mon.c (mon.1) 176 : audit [DBG] from='client.? 172.21.15.132:0/3648012160' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:20:28.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:20:28 smithi188 bash[23329]: audit 2020-07-16T14:20:26.458665+0000 mgr.x (mgr.34562) 2010 : audit [DBG] from='client.26098 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:20:28.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:20:28 smithi188 bash[23329]: audit 2020-07-16T14:20:26.727685+0000 mgr.x (mgr.34562) 2011 : audit [DBG] from='client.26104 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:20:28.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:20:28 smithi132 bash[27079]: audit 2020-07-16T14:20:26.458665+0000 mgr.x (mgr.34562) 2010 : audit [DBG] from='client.26098 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:20:28.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:20:28 smithi132 bash[27079]: audit 2020-07-16T14:20:26.727685+0000 mgr.x (mgr.34562) 2011 : audit [DBG] from='client.26104 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:20:29.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:20:29 smithi188 bash[23329]: cluster 2020-07-16T14:20:28.053490+0000 mgr.x (mgr.34562) 2012 : cluster [DBG] pgmap v1254: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:20:29.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:20:29 smithi188 bash[23329]: audit 2020-07-16T14:20:28.586686+0000 mon.b (mon.2) 538 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:20:29.535 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:20:29 smithi132 bash[27079]: cluster 2020-07-16T14:20:28.053490+0000 mgr.x (mgr.34562) 2012 : cluster [DBG] pgmap v1254: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:20:29.535 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:20:29 smithi132 bash[27079]: audit 2020-07-16T14:20:28.586686+0000 mon.b (mon.2) 538 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:20:30.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:20:30 smithi188 bash[23329]: cephadm 2020-07-16T14:20:28.587440+0000 mgr.x (mgr.34562) 2013 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:20:30.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:20:30 smithi188 bash[23329]: cephadm 2020-07-16T14:20:28.587729+0000 mgr.x (mgr.34562) 2014 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:20:30.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:20:30 smithi132 bash[27079]: cephadm 2020-07-16T14:20:28.587440+0000 mgr.x (mgr.34562) 2013 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:20:30.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:20:30 smithi132 bash[27079]: cephadm 2020-07-16T14:20:28.587729+0000 mgr.x (mgr.34562) 2014 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:20:31.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:20:31 smithi188 bash[23329]: cluster 2020-07-16T14:20:30.053908+0000 mgr.x (mgr.34562) 2015 : cluster [DBG] pgmap v1255: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:20:31.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:20:31 smithi132 bash[27079]: cluster 2020-07-16T14:20:30.053908+0000 mgr.x (mgr.34562) 2015 : cluster [DBG] pgmap v1255: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:20:33.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:20:33 smithi188 bash[23329]: cluster 2020-07-16T14:20:32.054256+0000 mgr.x (mgr.34562) 2016 : cluster [DBG] pgmap v1256: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:20:33.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:20:33 smithi132 bash[27079]: cluster 2020-07-16T14:20:32.054256+0000 mgr.x (mgr.34562) 2016 : cluster [DBG] pgmap v1256: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:20:35.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:20:35 smithi188 bash[23329]: cluster 2020-07-16T14:20:34.054702+0000 mgr.x (mgr.34562) 2017 : cluster [DBG] pgmap v1257: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:20:35.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:20:35 smithi132 bash[27079]: cluster 2020-07-16T14:20:34.054702+0000 mgr.x (mgr.34562) 2017 : cluster [DBG] pgmap v1257: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:20:37.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:20:37 smithi188 bash[23329]: cluster 2020-07-16T14:20:36.055116+0000 mgr.x (mgr.34562) 2018 : cluster [DBG] pgmap v1258: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:20:37.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:20:37 smithi132 bash[27079]: cluster 2020-07-16T14:20:36.055116+0000 mgr.x (mgr.34562) 2018 : cluster [DBG] pgmap v1258: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:20:39.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:20:39 smithi188 bash[23329]: cluster 2020-07-16T14:20:38.055569+0000 mgr.x (mgr.34562) 2019 : cluster [DBG] pgmap v1259: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:20:39.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:20:39 smithi132 bash[27079]: cluster 2020-07-16T14:20:38.055569+0000 mgr.x (mgr.34562) 2019 : cluster [DBG] pgmap v1259: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:20:40.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:20:40 smithi132 bash[27079]: cluster 2020-07-16T14:20:40.056015+0000 mgr.x (mgr.34562) 2020 : cluster [DBG] pgmap v1260: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:20:40.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:20:40 smithi188 bash[23329]: cluster 2020-07-16T14:20:40.056015+0000 mgr.x (mgr.34562) 2020 : cluster [DBG] pgmap v1260: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:20:43.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:20:43 smithi188 bash[23329]: cluster 2020-07-16T14:20:42.056488+0000 mgr.x (mgr.34562) 2021 : cluster [DBG] pgmap v1261: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:20:43.532 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:20:43 smithi132 bash[27079]: cluster 2020-07-16T14:20:42.056488+0000 mgr.x (mgr.34562) 2021 : cluster [DBG] pgmap v1261: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:20:44.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:20:44 smithi188 bash[23329]: audit 2020-07-16T14:20:43.603280+0000 mon.b (mon.2) 539 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:20:44.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:20:44 smithi132 bash[27079]: audit 2020-07-16T14:20:43.603280+0000 mon.b (mon.2) 539 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:20:45.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:20:45 smithi188 bash[23329]: cephadm 2020-07-16T14:20:43.604006+0000 mgr.x (mgr.34562) 2022 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:20:45.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:20:45 smithi188 bash[23329]: cephadm 2020-07-16T14:20:43.604453+0000 mgr.x (mgr.34562) 2023 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:20:45.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:20:45 smithi188 bash[23329]: cluster 2020-07-16T14:20:44.056886+0000 mgr.x (mgr.34562) 2024 : cluster [DBG] pgmap v1262: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:20:45.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:20:45 smithi132 bash[27079]: cephadm 2020-07-16T14:20:43.604006+0000 mgr.x (mgr.34562) 2022 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:20:45.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:20:45 smithi132 bash[27079]: cephadm 2020-07-16T14:20:43.604453+0000 mgr.x (mgr.34562) 2023 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:20:45.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:20:45 smithi132 bash[27079]: cluster 2020-07-16T14:20:44.056886+0000 mgr.x (mgr.34562) 2024 : cluster [DBG] pgmap v1262: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:20:47.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:20:47 smithi188 bash[23329]: cluster 2020-07-16T14:20:46.057320+0000 mgr.x (mgr.34562) 2025 : cluster [DBG] pgmap v1263: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:20:47.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:20:47 smithi132 bash[27079]: cluster 2020-07-16T14:20:46.057320+0000 mgr.x (mgr.34562) 2025 : cluster [DBG] pgmap v1263: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:20:49.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:20:49 smithi188 bash[23329]: cluster 2020-07-16T14:20:48.057739+0000 mgr.x (mgr.34562) 2026 : cluster [DBG] pgmap v1264: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:20:49.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:20:49 smithi132 bash[27079]: cluster 2020-07-16T14:20:48.057739+0000 mgr.x (mgr.34562) 2026 : cluster [DBG] pgmap v1264: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:20:50.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:20:50 smithi132 bash[27079]: cluster 2020-07-16T14:20:50.058237+0000 mgr.x (mgr.34562) 2027 : cluster [DBG] pgmap v1265: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:20:50.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:20:50 smithi188 bash[23329]: cluster 2020-07-16T14:20:50.058237+0000 mgr.x (mgr.34562) 2027 : cluster [DBG] pgmap v1265: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:20:53.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:20:53 smithi188 bash[23329]: cluster 2020-07-16T14:20:52.058701+0000 mgr.x (mgr.34562) 2028 : cluster [DBG] pgmap v1266: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:20:53.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:20:53 smithi132 bash[27079]: cluster 2020-07-16T14:20:52.058701+0000 mgr.x (mgr.34562) 2028 : cluster [DBG] pgmap v1266: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:20:55.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:20:55 smithi188 bash[23329]: cluster 2020-07-16T14:20:54.059086+0000 mgr.x (mgr.34562) 2029 : cluster [DBG] pgmap v1267: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:20:55.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:20:55 smithi132 bash[27079]: cluster 2020-07-16T14:20:54.059086+0000 mgr.x (mgr.34562) 2029 : cluster [DBG] pgmap v1267: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:20:57.328 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:20:57.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:20:57 smithi188 bash[23329]: cluster 2020-07-16T14:20:56.059497+0000 mgr.x (mgr.34562) 2030 : cluster [DBG] pgmap v1268: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:20:57.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:20:57 smithi132 bash[27079]: cluster 2020-07-16T14:20:56.059497+0000 mgr.x (mgr.34562) 2030 : cluster [DBG] pgmap v1268: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:20:57.590 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:20:57.590 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (43m) 10m ago 46m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:20:57.591 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (46m) 10m ago 46m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:20:57.591 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (44m) 10m ago 49m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:20:57.591 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (43m) 10m ago 51m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:20:57.591 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 10m ago 51m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:20:57.592 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (49m) 10m ago 49m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:20:57.592 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (49m) 10m ago 49m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:20:57.592 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (46m) 10m ago 46m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:20:57.592 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (46m) 10m ago 47m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:20:57.593 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (49m) 10m ago 49m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:20:57.593 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (49m) 10m ago 49m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:20:57.593 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (48m) 10m ago 48m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:20:57.593 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (48m) 10m ago 48m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:20:57.594 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (47m) 10m ago 48m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:20:57.594 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (47m) 10m ago 47m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:20:57.594 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (47m) 10m ago 47m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:20:57.594 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (47m) 10m ago 47m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:20:57.595 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (46m) 10m ago 47m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:20:57.886 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:20:57.886 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:20:57.886 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:20:57.887 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:20:57.887 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:20:57.887 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:20:57.887 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:20:57.887 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:20:57.888 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:20:57.888 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:20:57.888 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:20:57.888 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:20:57.888 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:20:57.889 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:20:57.889 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:20:57.889 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:20:57.889 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:20:58.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:20:58 smithi188 bash[23329]: audit 2020-07-16T14:20:57.884901+0000 mon.c (mon.1) 177 : audit [DBG] from='client.? 172.21.15.132:0/3813960226' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:20:58.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:20:58 smithi132 bash[27079]: audit 2020-07-16T14:20:57.884901+0000 mon.c (mon.1) 177 : audit [DBG] from='client.? 172.21.15.132:0/3813960226' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:20:59.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:20:59 smithi188 bash[23329]: audit 2020-07-16T14:20:57.316371+0000 mgr.x (mgr.34562) 2031 : audit [DBG] from='client.26116 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:20:59.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:20:59 smithi188 bash[23329]: audit 2020-07-16T14:20:57.585697+0000 mgr.x (mgr.34562) 2032 : audit [DBG] from='client.26122 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:20:59.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:20:59 smithi188 bash[23329]: cluster 2020-07-16T14:20:58.059907+0000 mgr.x (mgr.34562) 2033 : cluster [DBG] pgmap v1269: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:20:59.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:20:59 smithi188 bash[23329]: audit 2020-07-16T14:20:58.620546+0000 mon.b (mon.2) 540 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T14:20:59.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:20:59 smithi188 bash[23329]: audit 2020-07-16T14:20:58.620821+0000 mon.b (mon.2) 541 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T14:20:59.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:20:59 smithi132 bash[27079]: audit 2020-07-16T14:20:57.316371+0000 mgr.x (mgr.34562) 2031 : audit [DBG] from='client.26116 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:20:59.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:20:59 smithi132 bash[27079]: audit 2020-07-16T14:20:57.585697+0000 mgr.x (mgr.34562) 2032 : audit [DBG] from='client.26122 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:20:59.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:20:59 smithi132 bash[27079]: cluster 2020-07-16T14:20:58.059907+0000 mgr.x (mgr.34562) 2033 : cluster [DBG] pgmap v1269: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:20:59.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:20:59 smithi132 bash[27079]: audit 2020-07-16T14:20:58.620546+0000 mon.b (mon.2) 540 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T14:20:59.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:20:59 smithi132 bash[27079]: audit 2020-07-16T14:20:58.620821+0000 mon.b (mon.2) 541 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T14:21:00.756 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:21:00 smithi132 bash[27079]: cluster 2020-07-16T14:21:00.060251+0000 mgr.x (mgr.34562) 2034 : cluster [DBG] pgmap v1270: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:21:00.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:21:00 smithi188 bash[23329]: cluster 2020-07-16T14:21:00.060251+0000 mgr.x (mgr.34562) 2034 : cluster [DBG] pgmap v1270: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:21:01.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:21:01 smithi132 bash[27079]: audit 2020-07-16T14:21:00.830398+0000 mon.b (mon.2) 542 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:21:00.828302\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.828388\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.828460\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.828525\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.828830\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.829048\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.829235\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.829391\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.829433\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:21:00.829534\", \"last_device_update\": \"2020-07-16T14:03:05.154706\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:12:36.124268\"}"}]: dispatch 2020-07-16T14:21:01.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:21:01 smithi132 bash[27079]: audit 2020-07-16T14:21:00.831258+0000 mon.c (mon.1) 178 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:21:00.828302\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.828388\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.828460\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.828525\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.828830\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.829048\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.829235\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.829391\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.829433\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:21:00.829534\", \"last_device_update\": \"2020-07-16T14:03:05.154706\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:12:36.124268\"}"}]: dispatch 2020-07-16T14:21:01.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:21:01 smithi132 bash[27079]: audit 2020-07-16T14:21:00.834177+0000 mon.c (mon.1) 179 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:21:00.828302\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.828388\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.828460\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.828525\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.828830\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.829048\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.829235\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.829391\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.829433\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:21:00.829534\", \"last_device_update\": \"2020-07-16T14:03:05.154706\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:12:36.124268\"}"}]': finished 2020-07-16T14:21:01.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:21:01 smithi132 bash[27079]: audit 2020-07-16T14:21:01.117845+0000 mon.b (mon.2) 543 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116357\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116430\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116462\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116639\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116740\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116838\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116936\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116969\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116996\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:21:01.117063\", \"last_device_update\": \"2020-07-16T14:04:10.964865\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:12:36.123740\"}"}]: dispatch 2020-07-16T14:21:01.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:21:01 smithi132 bash[27079]: audit 2020-07-16T14:21:01.118399+0000 mon.c (mon.1) 180 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116357\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116430\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116462\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116639\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116740\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116838\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116936\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116969\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116996\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:21:01.117063\", \"last_device_update\": \"2020-07-16T14:04:10.964865\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:12:36.123740\"}"}]: dispatch 2020-07-16T14:21:01.782 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:21:01 smithi132 bash[27079]: audit 2020-07-16T14:21:01.120664+0000 mon.c (mon.1) 181 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116357\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116430\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116462\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116639\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116740\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116838\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116936\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116969\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116996\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:21:01.117063\", \"last_device_update\": \"2020-07-16T14:04:10.964865\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:12:36.123740\"}"}]': finished 2020-07-16T14:21:01.782 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:21:01 smithi132 bash[27079]: audit 2020-07-16T14:21:01.123873+0000 mon.b (mon.2) 544 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:21:01.782 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:21:01 smithi132 bash[27079]: audit 2020-07-16T14:21:01.124212+0000 mgr.x (mgr.34562) 2035 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:21:01.782 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:21:01 smithi132 bash[27079]: audit 2020-07-16T14:21:01.124918+0000 mon.b (mon.2) 545 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:21:01.783 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:21:01 smithi132 bash[27079]: audit 2020-07-16T14:21:01.125147+0000 mgr.x (mgr.34562) 2036 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:21:01.783 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:21:01 smithi132 bash[27079]: audit 2020-07-16T14:21:01.125713+0000 mon.b (mon.2) 546 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:21:01.783 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:21:01 smithi132 bash[27079]: audit 2020-07-16T14:21:01.125994+0000 mgr.x (mgr.34562) 2037 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:21:01.783 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:21:01 smithi132 bash[27079]: cephadm 2020-07-16T14:21:01.126511+0000 mgr.x (mgr.34562) 2038 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:21:01.783 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:21:01 smithi132 bash[27079]: audit 2020-07-16T14:21:01.126723+0000 mon.b (mon.2) 547 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:21:01.784 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:21:01 smithi132 bash[27079]: cephadm 2020-07-16T14:21:01.127339+0000 mgr.x (mgr.34562) 2039 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:21:01.784 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:21:01 smithi132 bash[27079]: audit 2020-07-16T14:21:01.127570+0000 mon.b (mon.2) 548 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:21:01.784 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:21:01 smithi132 bash[27079]: cephadm 2020-07-16T14:21:01.128059+0000 mgr.x (mgr.34562) 2040 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:21:01.784 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:21:01 smithi132 bash[27079]: cephadm 2020-07-16T14:21:01.128138+0000 mgr.x (mgr.34562) 2041 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:21:01.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:21:01 smithi188 bash[23329]: audit 2020-07-16T14:21:00.830398+0000 mon.b (mon.2) 542 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:21:00.828302\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.828388\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.828460\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.828525\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.828830\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.829048\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.829235\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.829391\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.829433\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:21:00.829534\", \"last_device_update\": \"2020-07-16T14:03:05.154706\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:12:36.124268\"}"}]: dispatch 2020-07-16T14:21:01.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:21:01 smithi188 bash[23329]: audit 2020-07-16T14:21:00.831258+0000 mon.c (mon.1) 178 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:21:00.828302\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.828388\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.828460\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.828525\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.828830\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.829048\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.829235\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.829391\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.829433\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:21:00.829534\", \"last_device_update\": \"2020-07-16T14:03:05.154706\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:12:36.124268\"}"}]: dispatch 2020-07-16T14:21:01.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:21:01 smithi188 bash[23329]: audit 2020-07-16T14:21:00.834177+0000 mon.c (mon.1) 179 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:21:00.828302\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.828388\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.828460\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.828525\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.828830\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.829048\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.829235\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.829391\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.829433\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:21:00.829534\", \"last_device_update\": \"2020-07-16T14:03:05.154706\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:12:36.124268\"}"}]': finished 2020-07-16T14:21:01.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:21:01 smithi188 bash[23329]: audit 2020-07-16T14:21:01.117845+0000 mon.b (mon.2) 543 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116357\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116430\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116462\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116639\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116740\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116838\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116936\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116969\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116996\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:21:01.117063\", \"last_device_update\": \"2020-07-16T14:04:10.964865\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:12:36.123740\"}"}]: dispatch 2020-07-16T14:21:01.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:21:01 smithi188 bash[23329]: audit 2020-07-16T14:21:01.118399+0000 mon.c (mon.1) 180 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116357\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116430\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116462\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116639\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116740\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116838\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116936\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116969\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116996\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:21:01.117063\", \"last_device_update\": \"2020-07-16T14:04:10.964865\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:12:36.123740\"}"}]: dispatch 2020-07-16T14:21:01.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:21:01 smithi188 bash[23329]: audit 2020-07-16T14:21:01.120664+0000 mon.c (mon.1) 181 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116357\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116430\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116462\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116639\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116740\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116838\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116936\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116969\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116996\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:21:01.117063\", \"last_device_update\": \"2020-07-16T14:04:10.964865\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:12:36.123740\"}"}]': finished 2020-07-16T14:21:01.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:21:01 smithi188 bash[23329]: audit 2020-07-16T14:21:01.123873+0000 mon.b (mon.2) 544 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:21:01.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:21:01 smithi188 bash[23329]: audit 2020-07-16T14:21:01.124212+0000 mgr.x (mgr.34562) 2035 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:21:01.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:21:01 smithi188 bash[23329]: audit 2020-07-16T14:21:01.124918+0000 mon.b (mon.2) 545 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:21:01.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:21:01 smithi188 bash[23329]: audit 2020-07-16T14:21:01.125147+0000 mgr.x (mgr.34562) 2036 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:21:01.925 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:21:01 smithi188 bash[23329]: audit 2020-07-16T14:21:01.125713+0000 mon.b (mon.2) 546 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:21:01.925 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:21:01 smithi188 bash[23329]: audit 2020-07-16T14:21:01.125994+0000 mgr.x (mgr.34562) 2037 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:21:01.925 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:21:01 smithi188 bash[23329]: cephadm 2020-07-16T14:21:01.126511+0000 mgr.x (mgr.34562) 2038 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:21:01.925 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:21:01 smithi188 bash[23329]: audit 2020-07-16T14:21:01.126723+0000 mon.b (mon.2) 547 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:21:01.925 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:21:01 smithi188 bash[23329]: cephadm 2020-07-16T14:21:01.127339+0000 mgr.x (mgr.34562) 2039 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:21:01.926 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:21:01 smithi188 bash[23329]: audit 2020-07-16T14:21:01.127570+0000 mon.b (mon.2) 548 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:21:01.926 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:21:01 smithi188 bash[23329]: cephadm 2020-07-16T14:21:01.128059+0000 mgr.x (mgr.34562) 2040 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:21:01.926 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:21:01 smithi188 bash[23329]: cephadm 2020-07-16T14:21:01.128138+0000 mgr.x (mgr.34562) 2041 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:21:02.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:21:02 smithi132 bash[27079]: cluster 2020-07-16T14:21:02.060752+0000 mgr.x (mgr.34562) 2042 : cluster [DBG] pgmap v1271: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:21:02.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:21:02 smithi188 bash[23329]: cluster 2020-07-16T14:21:02.060752+0000 mgr.x (mgr.34562) 2042 : cluster [DBG] pgmap v1271: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:21:04.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:21:03 smithi132 bash[27079]: audit 2020-07-16T14:21:03.893312+0000 mon.b (mon.2) 549 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:21:04.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:21:03 smithi188 bash[23329]: audit 2020-07-16T14:21:03.893312+0000 mon.b (mon.2) 549 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:21:05.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:21:04 smithi132 bash[27079]: cephadm 2020-07-16T14:21:03.893906+0000 mgr.x (mgr.34562) 2043 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:21:05.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:21:04 smithi132 bash[27079]: cephadm 2020-07-16T14:21:03.894309+0000 mgr.x (mgr.34562) 2044 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:21:05.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:21:04 smithi132 bash[27079]: cluster 2020-07-16T14:21:04.061099+0000 mgr.x (mgr.34562) 2045 : cluster [DBG] pgmap v1272: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:21:05.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:21:04 smithi188 bash[23329]: cephadm 2020-07-16T14:21:03.893906+0000 mgr.x (mgr.34562) 2043 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:21:05.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:21:04 smithi188 bash[23329]: cephadm 2020-07-16T14:21:03.894309+0000 mgr.x (mgr.34562) 2044 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:21:05.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:21:04 smithi188 bash[23329]: cluster 2020-07-16T14:21:04.061099+0000 mgr.x (mgr.34562) 2045 : cluster [DBG] pgmap v1272: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:21:07.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:21:07 smithi188 bash[23329]: cluster 2020-07-16T14:21:06.061489+0000 mgr.x (mgr.34562) 2046 : cluster [DBG] pgmap v1273: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:21:07.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:21:07 smithi132 bash[27079]: cluster 2020-07-16T14:21:06.061489+0000 mgr.x (mgr.34562) 2046 : cluster [DBG] pgmap v1273: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:21:09.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:21:09 smithi188 bash[23329]: cluster 2020-07-16T14:21:08.062008+0000 mgr.x (mgr.34562) 2047 : cluster [DBG] pgmap v1274: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:21:09.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:21:09 smithi132 bash[27079]: cluster 2020-07-16T14:21:08.062008+0000 mgr.x (mgr.34562) 2047 : cluster [DBG] pgmap v1274: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:21:10.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:21:10 smithi132 bash[27079]: cluster 2020-07-16T14:21:10.062548+0000 mgr.x (mgr.34562) 2048 : cluster [DBG] pgmap v1275: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:21:10.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:21:10 smithi188 bash[23329]: cluster 2020-07-16T14:21:10.062548+0000 mgr.x (mgr.34562) 2048 : cluster [DBG] pgmap v1275: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:21:13.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:21:13 smithi188 bash[23329]: cluster 2020-07-16T14:21:12.062935+0000 mgr.x (mgr.34562) 2049 : cluster [DBG] pgmap v1276: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:21:13.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:21:13 smithi132 bash[27079]: cluster 2020-07-16T14:21:12.062935+0000 mgr.x (mgr.34562) 2049 : cluster [DBG] pgmap v1276: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:21:15.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:21:15 smithi188 bash[23329]: cluster 2020-07-16T14:21:14.063442+0000 mgr.x (mgr.34562) 2050 : cluster [DBG] pgmap v1277: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:21:15.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:21:15 smithi132 bash[27079]: cluster 2020-07-16T14:21:14.063442+0000 mgr.x (mgr.34562) 2050 : cluster [DBG] pgmap v1277: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:21:17.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:21:17 smithi188 bash[23329]: cluster 2020-07-16T14:21:16.063856+0000 mgr.x (mgr.34562) 2051 : cluster [DBG] pgmap v1278: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:21:17.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:21:17 smithi132 bash[27079]: cluster 2020-07-16T14:21:16.063856+0000 mgr.x (mgr.34562) 2051 : cluster [DBG] pgmap v1278: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:21:19.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:21:19 smithi188 bash[23329]: cluster 2020-07-16T14:21:18.064363+0000 mgr.x (mgr.34562) 2052 : cluster [DBG] pgmap v1279: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:21:19.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:21:19 smithi188 bash[23329]: audit 2020-07-16T14:21:18.909874+0000 mon.b (mon.2) 550 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:21:19.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:21:19 smithi132 bash[27079]: cluster 2020-07-16T14:21:18.064363+0000 mgr.x (mgr.34562) 2052 : cluster [DBG] pgmap v1279: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:21:19.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:21:19 smithi132 bash[27079]: audit 2020-07-16T14:21:18.909874+0000 mon.b (mon.2) 550 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:21:20.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:21:20 smithi188 bash[23329]: cephadm 2020-07-16T14:21:18.910587+0000 mgr.x (mgr.34562) 2053 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:21:20.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:21:20 smithi188 bash[23329]: cephadm 2020-07-16T14:21:18.910662+0000 mgr.x (mgr.34562) 2054 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:21:20.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:21:20 smithi132 bash[27079]: cephadm 2020-07-16T14:21:18.910587+0000 mgr.x (mgr.34562) 2053 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:21:20.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:21:20 smithi132 bash[27079]: cephadm 2020-07-16T14:21:18.910662+0000 mgr.x (mgr.34562) 2054 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:21:21.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:21:21 smithi188 bash[23329]: cluster 2020-07-16T14:21:20.064734+0000 mgr.x (mgr.34562) 2055 : cluster [DBG] pgmap v1280: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:21:21.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:21:21 smithi132 bash[27079]: cluster 2020-07-16T14:21:20.064734+0000 mgr.x (mgr.34562) 2055 : cluster [DBG] pgmap v1280: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:21:23.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:21:23 smithi188 bash[23329]: cluster 2020-07-16T14:21:22.065130+0000 mgr.x (mgr.34562) 2056 : cluster [DBG] pgmap v1281: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:21:23.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:21:23 smithi132 bash[27079]: cluster 2020-07-16T14:21:22.065130+0000 mgr.x (mgr.34562) 2056 : cluster [DBG] pgmap v1281: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:21:25.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:21:25 smithi188 bash[23329]: cluster 2020-07-16T14:21:24.065618+0000 mgr.x (mgr.34562) 2057 : cluster [DBG] pgmap v1282: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:21:25.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:21:25 smithi132 bash[27079]: cluster 2020-07-16T14:21:24.065618+0000 mgr.x (mgr.34562) 2057 : cluster [DBG] pgmap v1282: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:21:27.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:21:27 smithi188 bash[23329]: cluster 2020-07-16T14:21:26.065978+0000 mgr.x (mgr.34562) 2058 : cluster [DBG] pgmap v1283: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:21:27.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:21:27 smithi132 bash[27079]: cluster 2020-07-16T14:21:26.065978+0000 mgr.x (mgr.34562) 2058 : cluster [DBG] pgmap v1283: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:21:28.185 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:21:28.443 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:21:28.443 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (44m) 27s ago 47m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:21:28.443 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (46m) 27s ago 46m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:21:28.444 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (44m) 27s ago 50m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:21:28.444 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (43m) 27s ago 51m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:21:28.444 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 27s ago 51m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:21:28.444 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (50m) 27s ago 50m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:21:28.444 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (50m) 27s ago 50m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:21:28.445 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (47m) 27s ago 47m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:21:28.445 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (47m) 27s ago 47m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:21:28.445 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (49m) 27s ago 49m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:21:28.445 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (49m) 27s ago 49m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:21:28.445 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (49m) 27s ago 49m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:21:28.446 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (48m) 27s ago 49m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:21:28.446 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (48m) 27s ago 48m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:21:28.446 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (48m) 27s ago 48m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:21:28.446 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (48m) 27s ago 48m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:21:28.446 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (47m) 27s ago 47m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:21:28.446 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (46m) 27s ago 47m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:21:28.739 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:21:28.739 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:21:28.739 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:21:28.740 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:21:28.740 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:21:28.740 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:21:28.740 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:21:28.740 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:21:28.741 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:21:28.741 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:21:28.741 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:21:28.741 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:21:28.741 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:21:28.741 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:21:28.742 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:21:28.742 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:21:28.742 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:21:29.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:21:29 smithi188 bash[23329]: cluster 2020-07-16T14:21:28.066382+0000 mgr.x (mgr.34562) 2059 : cluster [DBG] pgmap v1284: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:21:29.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:21:29 smithi188 bash[23329]: audit 2020-07-16T14:21:28.172833+0000 mgr.x (mgr.34562) 2060 : audit [DBG] from='client.26134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:21:29.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:21:29 smithi188 bash[23329]: audit 2020-07-16T14:21:28.738242+0000 mon.c (mon.1) 182 : audit [DBG] from='client.? 172.21.15.132:0/737278397' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:21:29.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:21:29 smithi132 bash[27079]: cluster 2020-07-16T14:21:28.066382+0000 mgr.x (mgr.34562) 2059 : cluster [DBG] pgmap v1284: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:21:29.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:21:29 smithi132 bash[27079]: audit 2020-07-16T14:21:28.172833+0000 mgr.x (mgr.34562) 2060 : audit [DBG] from='client.26134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:21:29.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:21:29 smithi132 bash[27079]: audit 2020-07-16T14:21:28.738242+0000 mon.c (mon.1) 182 : audit [DBG] from='client.? 172.21.15.132:0/737278397' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:21:30.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:21:30 smithi188 bash[23329]: audit 2020-07-16T14:21:28.438769+0000 mgr.x (mgr.34562) 2061 : audit [DBG] from='client.26140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:21:30.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:21:30 smithi132 bash[27079]: audit 2020-07-16T14:21:28.438769+0000 mgr.x (mgr.34562) 2061 : audit [DBG] from='client.26140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:21:31.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:21:31 smithi188 bash[23329]: cluster 2020-07-16T14:21:30.066733+0000 mgr.x (mgr.34562) 2062 : cluster [DBG] pgmap v1285: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:21:31.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:21:31 smithi132 bash[27079]: cluster 2020-07-16T14:21:30.066733+0000 mgr.x (mgr.34562) 2062 : cluster [DBG] pgmap v1285: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:21:33.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:21:33 smithi188 bash[23329]: cluster 2020-07-16T14:21:32.067235+0000 mgr.x (mgr.34562) 2063 : cluster [DBG] pgmap v1286: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:21:33.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:21:33 smithi132 bash[27079]: cluster 2020-07-16T14:21:32.067235+0000 mgr.x (mgr.34562) 2063 : cluster [DBG] pgmap v1286: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:21:34.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:21:34 smithi188 bash[23329]: audit 2020-07-16T14:21:33.926172+0000 mon.b (mon.2) 551 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:21:34.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:21:34 smithi132 bash[27079]: audit 2020-07-16T14:21:33.926172+0000 mon.b (mon.2) 551 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:21:35.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:21:35 smithi188 bash[23329]: cephadm 2020-07-16T14:21:33.926896+0000 mgr.x (mgr.34562) 2064 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:21:35.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:21:35 smithi188 bash[23329]: cephadm 2020-07-16T14:21:33.927302+0000 mgr.x (mgr.34562) 2065 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:21:35.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:21:35 smithi188 bash[23329]: cluster 2020-07-16T14:21:34.067716+0000 mgr.x (mgr.34562) 2066 : cluster [DBG] pgmap v1287: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:21:35.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:21:35 smithi132 bash[27079]: cephadm 2020-07-16T14:21:33.926896+0000 mgr.x (mgr.34562) 2064 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:21:35.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:21:35 smithi132 bash[27079]: cephadm 2020-07-16T14:21:33.927302+0000 mgr.x (mgr.34562) 2065 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:21:35.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:21:35 smithi132 bash[27079]: cluster 2020-07-16T14:21:34.067716+0000 mgr.x (mgr.34562) 2066 : cluster [DBG] pgmap v1287: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:21:37.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:21:37 smithi188 bash[23329]: cluster 2020-07-16T14:21:36.068095+0000 mgr.x (mgr.34562) 2067 : cluster [DBG] pgmap v1288: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:21:37.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:21:37 smithi132 bash[27079]: cluster 2020-07-16T14:21:36.068095+0000 mgr.x (mgr.34562) 2067 : cluster [DBG] pgmap v1288: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:21:39.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:21:39 smithi132 bash[27079]: cluster 2020-07-16T14:21:38.068605+0000 mgr.x (mgr.34562) 2068 : cluster [DBG] pgmap v1289: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:21:39.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:21:39 smithi188 bash[23329]: cluster 2020-07-16T14:21:38.068605+0000 mgr.x (mgr.34562) 2068 : cluster [DBG] pgmap v1289: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:21:40.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:21:40 smithi132 bash[27079]: cluster 2020-07-16T14:21:40.068902+0000 mgr.x (mgr.34562) 2069 : cluster [DBG] pgmap v1290: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:21:40.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:21:40 smithi188 bash[23329]: cluster 2020-07-16T14:21:40.068902+0000 mgr.x (mgr.34562) 2069 : cluster [DBG] pgmap v1290: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:21:43.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:21:43 smithi188 bash[23329]: cluster 2020-07-16T14:21:42.069437+0000 mgr.x (mgr.34562) 2070 : cluster [DBG] pgmap v1291: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:21:43.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:21:43 smithi132 bash[27079]: cluster 2020-07-16T14:21:42.069437+0000 mgr.x (mgr.34562) 2070 : cluster [DBG] pgmap v1291: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:21:45.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:21:45 smithi188 bash[23329]: cluster 2020-07-16T14:21:44.069961+0000 mgr.x (mgr.34562) 2071 : cluster [DBG] pgmap v1292: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:21:45.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:21:45 smithi132 bash[27079]: cluster 2020-07-16T14:21:44.069961+0000 mgr.x (mgr.34562) 2071 : cluster [DBG] pgmap v1292: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:21:47.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:21:47 smithi188 bash[23329]: cluster 2020-07-16T14:21:46.070397+0000 mgr.x (mgr.34562) 2072 : cluster [DBG] pgmap v1293: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:21:47.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:21:47 smithi132 bash[27079]: cluster 2020-07-16T14:21:46.070397+0000 mgr.x (mgr.34562) 2072 : cluster [DBG] pgmap v1293: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:21:49.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:21:49 smithi188 bash[23329]: cluster 2020-07-16T14:21:48.070861+0000 mgr.x (mgr.34562) 2073 : cluster [DBG] pgmap v1294: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:21:49.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:21:49 smithi188 bash[23329]: audit 2020-07-16T14:21:48.942967+0000 mon.b (mon.2) 552 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:21:49.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:21:49 smithi132 bash[27079]: cluster 2020-07-16T14:21:48.070861+0000 mgr.x (mgr.34562) 2073 : cluster [DBG] pgmap v1294: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:21:49.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:21:49 smithi132 bash[27079]: audit 2020-07-16T14:21:48.942967+0000 mon.b (mon.2) 552 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:21:50.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:21:50 smithi188 bash[23329]: cephadm 2020-07-16T14:21:48.943722+0000 mgr.x (mgr.34562) 2074 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:21:50.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:21:50 smithi188 bash[23329]: cephadm 2020-07-16T14:21:48.943926+0000 mgr.x (mgr.34562) 2075 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:21:50.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:21:50 smithi132 bash[27079]: cephadm 2020-07-16T14:21:48.943722+0000 mgr.x (mgr.34562) 2074 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:21:50.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:21:50 smithi132 bash[27079]: cephadm 2020-07-16T14:21:48.943926+0000 mgr.x (mgr.34562) 2075 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:21:51.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:21:51 smithi188 bash[23329]: cluster 2020-07-16T14:21:50.071332+0000 mgr.x (mgr.34562) 2076 : cluster [DBG] pgmap v1295: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:21:51.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:21:51 smithi132 bash[27079]: cluster 2020-07-16T14:21:50.071332+0000 mgr.x (mgr.34562) 2076 : cluster [DBG] pgmap v1295: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:21:53.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:21:53 smithi188 bash[23329]: cluster 2020-07-16T14:21:52.071794+0000 mgr.x (mgr.34562) 2077 : cluster [DBG] pgmap v1296: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:21:53.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:21:53 smithi132 bash[27079]: cluster 2020-07-16T14:21:52.071794+0000 mgr.x (mgr.34562) 2077 : cluster [DBG] pgmap v1296: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:21:55.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:21:55 smithi188 bash[23329]: cluster 2020-07-16T14:21:54.072252+0000 mgr.x (mgr.34562) 2078 : cluster [DBG] pgmap v1297: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:21:55.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:21:55 smithi132 bash[27079]: cluster 2020-07-16T14:21:54.072252+0000 mgr.x (mgr.34562) 2078 : cluster [DBG] pgmap v1297: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:21:57.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:21:57 smithi188 bash[23329]: cluster 2020-07-16T14:21:56.072623+0000 mgr.x (mgr.34562) 2079 : cluster [DBG] pgmap v1298: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:21:57.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:21:57 smithi132 bash[27079]: cluster 2020-07-16T14:21:56.072623+0000 mgr.x (mgr.34562) 2079 : cluster [DBG] pgmap v1298: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:21:59.035 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:21:59.300 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:21:59.301 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (44m) 58s ago 47m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:21:59.301 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (47m) 58s ago 47m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:21:59.301 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (45m) 58s ago 50m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:21:59.301 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (44m) 58s ago 52m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:21:59.302 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 58s ago 52m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:21:59.302 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (50m) 58s ago 50m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:21:59.302 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (51m) 58s ago 51m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:21:59.302 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (47m) 58s ago 48m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:21:59.302 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (47m) 58s ago 48m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:21:59.302 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (50m) 58s ago 50m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:21:59.303 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (50m) 58s ago 50m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:21:59.303 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (49m) 58s ago 49m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:21:59.303 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (49m) 58s ago 49m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:21:59.303 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (48m) 58s ago 49m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:21:59.303 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (48m) 58s ago 48m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:21:59.304 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (48m) 58s ago 48m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:21:59.304 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (48m) 58s ago 48m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:21:59.304 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (47m) 58s ago 48m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:21:59.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:21:59 smithi188 bash[23329]: cluster 2020-07-16T14:21:58.073052+0000 mgr.x (mgr.34562) 2080 : cluster [DBG] pgmap v1299: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:21:59.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:21:59 smithi132 bash[27079]: cluster 2020-07-16T14:21:58.073052+0000 mgr.x (mgr.34562) 2080 : cluster [DBG] pgmap v1299: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:21:59.601 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:21:59.601 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:21:59.602 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:21:59.602 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:21:59.602 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:21:59.602 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:21:59.602 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:21:59.603 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:21:59.603 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:21:59.603 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:21:59.603 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:21:59.603 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:21:59.604 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:21:59.604 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:21:59.604 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:21:59.604 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:21:59.604 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:22:00.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:22:00 smithi188 bash[23329]: audit 2020-07-16T14:21:59.023858+0000 mgr.x (mgr.34562) 2081 : audit [DBG] from='client.26152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:22:00.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:22:00 smithi188 bash[23329]: audit 2020-07-16T14:21:59.293865+0000 mgr.x (mgr.34562) 2082 : audit [DBG] from='client.26158 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:22:00.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:22:00 smithi188 bash[23329]: audit 2020-07-16T14:21:59.600438+0000 mon.c (mon.1) 183 : audit [DBG] from='client.? 172.21.15.132:0/4070510517' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:22:00.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:22:00 smithi132 bash[27079]: audit 2020-07-16T14:21:59.023858+0000 mgr.x (mgr.34562) 2081 : audit [DBG] from='client.26152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:22:00.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:22:00 smithi132 bash[27079]: audit 2020-07-16T14:21:59.293865+0000 mgr.x (mgr.34562) 2082 : audit [DBG] from='client.26158 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:22:00.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:22:00 smithi132 bash[27079]: audit 2020-07-16T14:21:59.600438+0000 mon.c (mon.1) 183 : audit [DBG] from='client.? 172.21.15.132:0/4070510517' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:22:01.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:22:01 smithi188 bash[23329]: cluster 2020-07-16T14:22:00.073571+0000 mgr.x (mgr.34562) 2083 : cluster [DBG] pgmap v1300: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:22:01.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:22:01 smithi132 bash[27079]: cluster 2020-07-16T14:22:00.073571+0000 mgr.x (mgr.34562) 2083 : cluster [DBG] pgmap v1300: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:22:03.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:22:03 smithi188 bash[23329]: cluster 2020-07-16T14:22:02.074147+0000 mgr.x (mgr.34562) 2084 : cluster [DBG] pgmap v1301: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:22:03.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:22:03 smithi132 bash[27079]: cluster 2020-07-16T14:22:02.074147+0000 mgr.x (mgr.34562) 2084 : cluster [DBG] pgmap v1301: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:22:04.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:22:04 smithi188 bash[23329]: audit 2020-07-16T14:22:03.951256+0000 mon.b (mon.2) 553 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:22:04.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:22:04 smithi188 bash[23329]: audit 2020-07-16T14:22:03.952776+0000 mon.b (mon.2) 554 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:22:04.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:22:04 smithi188 bash[23329]: audit 2020-07-16T14:22:03.953954+0000 mon.b (mon.2) 555 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:22:04.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:22:04 smithi188 bash[23329]: audit 2020-07-16T14:22:03.955235+0000 mon.b (mon.2) 556 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:22:04.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:22:04 smithi188 bash[23329]: audit 2020-07-16T14:22:03.956452+0000 mon.b (mon.2) 557 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:22:04.462 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:22:04 smithi132 bash[27079]: audit 2020-07-16T14:22:03.951256+0000 mon.b (mon.2) 553 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:22:04.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:22:04 smithi132 bash[27079]: audit 2020-07-16T14:22:03.952776+0000 mon.b (mon.2) 554 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:22:04.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:22:04 smithi132 bash[27079]: audit 2020-07-16T14:22:03.953954+0000 mon.b (mon.2) 555 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:22:04.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:22:04 smithi132 bash[27079]: audit 2020-07-16T14:22:03.955235+0000 mon.b (mon.2) 556 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:22:04.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:22:04 smithi132 bash[27079]: audit 2020-07-16T14:22:03.956452+0000 mon.b (mon.2) 557 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:22:05.428 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:22:05 smithi132 bash[27079]: audit 2020-07-16T14:22:03.951677+0000 mgr.x (mgr.34562) 2085 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:22:05.429 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:22:05 smithi132 bash[27079]: audit 2020-07-16T14:22:03.953125+0000 mgr.x (mgr.34562) 2086 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:22:05.429 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:22:05 smithi132 bash[27079]: audit 2020-07-16T14:22:03.954207+0000 mgr.x (mgr.34562) 2087 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:22:05.429 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:22:05 smithi132 bash[27079]: cephadm 2020-07-16T14:22:03.954884+0000 mgr.x (mgr.34562) 2088 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:22:05.430 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:22:05 smithi132 bash[27079]: cephadm 2020-07-16T14:22:03.956035+0000 mgr.x (mgr.34562) 2089 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:22:05.430 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:22:05 smithi132 bash[27079]: cephadm 2020-07-16T14:22:03.957164+0000 mgr.x (mgr.34562) 2090 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:22:05.430 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:22:05 smithi132 bash[27079]: cephadm 2020-07-16T14:22:03.957272+0000 mgr.x (mgr.34562) 2091 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:22:05.430 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:22:05 smithi132 bash[27079]: cluster 2020-07-16T14:22:04.074667+0000 mgr.x (mgr.34562) 2092 : cluster [DBG] pgmap v1302: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:22:05.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:22:05 smithi188 bash[23329]: audit 2020-07-16T14:22:03.951677+0000 mgr.x (mgr.34562) 2085 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:22:05.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:22:05 smithi188 bash[23329]: audit 2020-07-16T14:22:03.953125+0000 mgr.x (mgr.34562) 2086 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:22:05.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:22:05 smithi188 bash[23329]: audit 2020-07-16T14:22:03.954207+0000 mgr.x (mgr.34562) 2087 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:22:05.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:22:05 smithi188 bash[23329]: cephadm 2020-07-16T14:22:03.954884+0000 mgr.x (mgr.34562) 2088 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:22:05.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:22:05 smithi188 bash[23329]: cephadm 2020-07-16T14:22:03.956035+0000 mgr.x (mgr.34562) 2089 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:22:05.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:22:05 smithi188 bash[23329]: cephadm 2020-07-16T14:22:03.957164+0000 mgr.x (mgr.34562) 2090 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:22:05.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:22:05 smithi188 bash[23329]: cephadm 2020-07-16T14:22:03.957272+0000 mgr.x (mgr.34562) 2091 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:22:05.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:22:05 smithi188 bash[23329]: cluster 2020-07-16T14:22:04.074667+0000 mgr.x (mgr.34562) 2092 : cluster [DBG] pgmap v1302: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:22:07.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:22:07 smithi132 bash[27079]: cluster 2020-07-16T14:22:06.075155+0000 mgr.x (mgr.34562) 2093 : cluster [DBG] pgmap v1303: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:22:07.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:22:07 smithi132 bash[27079]: audit 2020-07-16T14:22:06.762803+0000 mon.b (mon.2) 558 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:22:07.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:22:07 smithi188 bash[23329]: cluster 2020-07-16T14:22:06.075155+0000 mgr.x (mgr.34562) 2093 : cluster [DBG] pgmap v1303: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:22:07.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:22:07 smithi188 bash[23329]: audit 2020-07-16T14:22:06.762803+0000 mon.b (mon.2) 558 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:22:08.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:22:08 smithi132 bash[27079]: cephadm 2020-07-16T14:22:06.763457+0000 mgr.x (mgr.34562) 2094 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:22:08.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:22:08 smithi132 bash[27079]: cephadm 2020-07-16T14:22:06.763861+0000 mgr.x (mgr.34562) 2095 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:22:08.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:22:08 smithi188 bash[23329]: cephadm 2020-07-16T14:22:06.763457+0000 mgr.x (mgr.34562) 2094 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:22:08.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:22:08 smithi188 bash[23329]: cephadm 2020-07-16T14:22:06.763861+0000 mgr.x (mgr.34562) 2095 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:22:09.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:22:09 smithi132 bash[27079]: cluster 2020-07-16T14:22:08.075600+0000 mgr.x (mgr.34562) 2096 : cluster [DBG] pgmap v1304: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:22:09.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:22:09 smithi188 bash[23329]: cluster 2020-07-16T14:22:08.075600+0000 mgr.x (mgr.34562) 2096 : cluster [DBG] pgmap v1304: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:22:10.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:22:10 smithi132 bash[27079]: cluster 2020-07-16T14:22:10.075998+0000 mgr.x (mgr.34562) 2097 : cluster [DBG] pgmap v1305: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:22:10.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:22:10 smithi188 bash[23329]: cluster 2020-07-16T14:22:10.075998+0000 mgr.x (mgr.34562) 2097 : cluster [DBG] pgmap v1305: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:22:13.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:22:13 smithi188 bash[23329]: cluster 2020-07-16T14:22:12.076376+0000 mgr.x (mgr.34562) 2098 : cluster [DBG] pgmap v1306: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:22:13.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:22:13 smithi132 bash[27079]: cluster 2020-07-16T14:22:12.076376+0000 mgr.x (mgr.34562) 2098 : cluster [DBG] pgmap v1306: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:22:15.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:22:15 smithi188 bash[23329]: cluster 2020-07-16T14:22:14.076751+0000 mgr.x (mgr.34562) 2099 : cluster [DBG] pgmap v1307: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:22:15.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:22:15 smithi132 bash[27079]: cluster 2020-07-16T14:22:14.076751+0000 mgr.x (mgr.34562) 2099 : cluster [DBG] pgmap v1307: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:22:17.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:22:17 smithi188 bash[23329]: cluster 2020-07-16T14:22:16.077222+0000 mgr.x (mgr.34562) 2100 : cluster [DBG] pgmap v1308: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:22:17.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:22:17 smithi132 bash[27079]: cluster 2020-07-16T14:22:16.077222+0000 mgr.x (mgr.34562) 2100 : cluster [DBG] pgmap v1308: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:22:19.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:22:19 smithi188 bash[23329]: cluster 2020-07-16T14:22:18.077699+0000 mgr.x (mgr.34562) 2101 : cluster [DBG] pgmap v1309: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:22:19.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:22:19 smithi132 bash[27079]: cluster 2020-07-16T14:22:18.077699+0000 mgr.x (mgr.34562) 2101 : cluster [DBG] pgmap v1309: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:22:20.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:22:20 smithi132 bash[27079]: cluster 2020-07-16T14:22:20.078198+0000 mgr.x (mgr.34562) 2102 : cluster [DBG] pgmap v1310: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:22:20.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:22:20 smithi188 bash[23329]: cluster 2020-07-16T14:22:20.078198+0000 mgr.x (mgr.34562) 2102 : cluster [DBG] pgmap v1310: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:22:22.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:22:21 smithi188 bash[23329]: audit 2020-07-16T14:22:21.769735+0000 mon.b (mon.2) 559 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:22:22.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:22:21 smithi132 bash[27079]: audit 2020-07-16T14:22:21.769735+0000 mon.b (mon.2) 559 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:22:23.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:22:22 smithi188 bash[23329]: cephadm 2020-07-16T14:22:21.770500+0000 mgr.x (mgr.34562) 2103 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:22:23.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:22:22 smithi188 bash[23329]: cephadm 2020-07-16T14:22:21.770647+0000 mgr.x (mgr.34562) 2104 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:22:23.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:22:22 smithi188 bash[23329]: cluster 2020-07-16T14:22:22.078740+0000 mgr.x (mgr.34562) 2105 : cluster [DBG] pgmap v1311: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:22:23.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:22:22 smithi132 bash[27079]: cephadm 2020-07-16T14:22:21.770500+0000 mgr.x (mgr.34562) 2103 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:22:23.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:22:22 smithi132 bash[27079]: cephadm 2020-07-16T14:22:21.770647+0000 mgr.x (mgr.34562) 2104 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:22:23.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:22:22 smithi132 bash[27079]: cluster 2020-07-16T14:22:22.078740+0000 mgr.x (mgr.34562) 2105 : cluster [DBG] pgmap v1311: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:22:25.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:22:25 smithi188 bash[23329]: cluster 2020-07-16T14:22:24.079105+0000 mgr.x (mgr.34562) 2106 : cluster [DBG] pgmap v1312: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:22:25.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:22:25 smithi132 bash[27079]: cluster 2020-07-16T14:22:24.079105+0000 mgr.x (mgr.34562) 2106 : cluster [DBG] pgmap v1312: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:22:27.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:22:27 smithi188 bash[23329]: cluster 2020-07-16T14:22:26.079502+0000 mgr.x (mgr.34562) 2107 : cluster [DBG] pgmap v1313: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:22:27.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:22:27 smithi132 bash[27079]: cluster 2020-07-16T14:22:26.079502+0000 mgr.x (mgr.34562) 2107 : cluster [DBG] pgmap v1313: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:22:29.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:22:29 smithi188 bash[23329]: cluster 2020-07-16T14:22:28.080051+0000 mgr.x (mgr.34562) 2108 : cluster [DBG] pgmap v1314: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:22:29.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:22:29 smithi132 bash[27079]: cluster 2020-07-16T14:22:28.080051+0000 mgr.x (mgr.34562) 2108 : cluster [DBG] pgmap v1314: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:22:29.903 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:22:30.165 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:22:30.165 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (45m) 89s ago 48m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:22:30.165 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (47m) 89s ago 47m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:22:30.165 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (45m) 89s ago 51m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:22:30.166 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (44m) 89s ago 52m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:22:30.166 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 89s ago 52m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:22:30.166 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (51m) 89s ago 51m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:22:30.166 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (51m) 89s ago 51m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:22:30.167 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (48m) 89s ago 48m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:22:30.167 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (48m) 89s ago 48m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:22:30.167 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (50m) 89s ago 50m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:22:30.167 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (50m) 89s ago 50m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:22:30.167 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (50m) 89s ago 50m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:22:30.168 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (50m) 89s ago 50m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:22:30.168 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (49m) 89s ago 49m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:22:30.168 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (49m) 89s ago 49m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:22:30.168 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (49m) 89s ago 49m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:22:30.168 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (48m) 89s ago 48m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:22:30.168 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (47m) 89s ago 48m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:22:30.461 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:22:30.461 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:22:30.461 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:22:30.462 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:22:30.462 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:22:30.462 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:22:30.462 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:22:30.462 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:22:30.463 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:22:30.463 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:22:30.463 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:22:30.463 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:22:30.463 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:22:30.464 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:22:30.464 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:22:30.464 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:22:30.464 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:22:30.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:22:30 smithi132 bash[27079]: audit 2020-07-16T14:22:29.890610+0000 mgr.x (mgr.34562) 2109 : audit [DBG] from='client.26170 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:22:30.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:22:30 smithi132 bash[27079]: cluster 2020-07-16T14:22:30.080428+0000 mgr.x (mgr.34562) 2110 : cluster [DBG] pgmap v1315: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:22:30.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:22:30 smithi132 bash[27079]: audit 2020-07-16T14:22:30.160407+0000 mgr.x (mgr.34562) 2111 : audit [DBG] from='client.26176 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:22:30.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:22:30 smithi132 bash[27079]: audit 2020-07-16T14:22:30.460014+0000 mon.c (mon.1) 184 : audit [DBG] from='client.? 172.21.15.132:0/3195862332' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:22:30.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:22:30 smithi188 bash[23329]: audit 2020-07-16T14:22:29.890610+0000 mgr.x (mgr.34562) 2109 : audit [DBG] from='client.26170 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:22:30.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:22:30 smithi188 bash[23329]: cluster 2020-07-16T14:22:30.080428+0000 mgr.x (mgr.34562) 2110 : cluster [DBG] pgmap v1315: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:22:30.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:22:30 smithi188 bash[23329]: audit 2020-07-16T14:22:30.160407+0000 mgr.x (mgr.34562) 2111 : audit [DBG] from='client.26176 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:22:30.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:22:30 smithi188 bash[23329]: audit 2020-07-16T14:22:30.460014+0000 mon.c (mon.1) 184 : audit [DBG] from='client.? 172.21.15.132:0/3195862332' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:22:33.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:22:33 smithi188 bash[23329]: cluster 2020-07-16T14:22:32.080888+0000 mgr.x (mgr.34562) 2112 : cluster [DBG] pgmap v1316: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:22:33.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:22:33 smithi132 bash[27079]: cluster 2020-07-16T14:22:32.080888+0000 mgr.x (mgr.34562) 2112 : cluster [DBG] pgmap v1316: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:22:35.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:22:35 smithi188 bash[23329]: cluster 2020-07-16T14:22:34.081395+0000 mgr.x (mgr.34562) 2113 : cluster [DBG] pgmap v1317: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:22:35.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:22:35 smithi132 bash[27079]: cluster 2020-07-16T14:22:34.081395+0000 mgr.x (mgr.34562) 2113 : cluster [DBG] pgmap v1317: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:22:37.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:22:37 smithi188 bash[23329]: cluster 2020-07-16T14:22:36.081860+0000 mgr.x (mgr.34562) 2114 : cluster [DBG] pgmap v1318: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:22:37.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:22:37 smithi188 bash[23329]: audit 2020-07-16T14:22:36.786382+0000 mon.b (mon.2) 560 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:22:37.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:22:37 smithi132 bash[27079]: cluster 2020-07-16T14:22:36.081860+0000 mgr.x (mgr.34562) 2114 : cluster [DBG] pgmap v1318: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:22:37.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:22:37 smithi132 bash[27079]: audit 2020-07-16T14:22:36.786382+0000 mon.b (mon.2) 560 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:22:38.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:22:38 smithi188 bash[23329]: cephadm 2020-07-16T14:22:36.787122+0000 mgr.x (mgr.34562) 2115 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:22:38.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:22:38 smithi188 bash[23329]: cephadm 2020-07-16T14:22:36.787532+0000 mgr.x (mgr.34562) 2116 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:22:38.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:22:38 smithi132 bash[27079]: cephadm 2020-07-16T14:22:36.787122+0000 mgr.x (mgr.34562) 2115 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:22:38.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:22:38 smithi132 bash[27079]: cephadm 2020-07-16T14:22:36.787532+0000 mgr.x (mgr.34562) 2116 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:22:39.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:22:39 smithi188 bash[23329]: cluster 2020-07-16T14:22:38.082269+0000 mgr.x (mgr.34562) 2117 : cluster [DBG] pgmap v1319: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:22:39.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:22:39 smithi132 bash[27079]: cluster 2020-07-16T14:22:38.082269+0000 mgr.x (mgr.34562) 2117 : cluster [DBG] pgmap v1319: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:22:40.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:22:40 smithi132 bash[27079]: cluster 2020-07-16T14:22:40.082625+0000 mgr.x (mgr.34562) 2118 : cluster [DBG] pgmap v1320: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:22:40.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:22:40 smithi188 bash[23329]: cluster 2020-07-16T14:22:40.082625+0000 mgr.x (mgr.34562) 2118 : cluster [DBG] pgmap v1320: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:22:43.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:22:43 smithi188 bash[23329]: cluster 2020-07-16T14:22:42.083185+0000 mgr.x (mgr.34562) 2119 : cluster [DBG] pgmap v1321: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:22:43.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:22:43 smithi132 bash[27079]: cluster 2020-07-16T14:22:42.083185+0000 mgr.x (mgr.34562) 2119 : cluster [DBG] pgmap v1321: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:22:45.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:22:45 smithi188 bash[23329]: cluster 2020-07-16T14:22:44.083641+0000 mgr.x (mgr.34562) 2120 : cluster [DBG] pgmap v1322: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:22:45.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:22:45 smithi132 bash[27079]: cluster 2020-07-16T14:22:44.083641+0000 mgr.x (mgr.34562) 2120 : cluster [DBG] pgmap v1322: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:22:47.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:22:47 smithi188 bash[23329]: cluster 2020-07-16T14:22:46.084124+0000 mgr.x (mgr.34562) 2121 : cluster [DBG] pgmap v1323: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:22:47.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:22:47 smithi132 bash[27079]: cluster 2020-07-16T14:22:46.084124+0000 mgr.x (mgr.34562) 2121 : cluster [DBG] pgmap v1323: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:22:49.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:22:49 smithi188 bash[23329]: cluster 2020-07-16T14:22:48.084617+0000 mgr.x (mgr.34562) 2122 : cluster [DBG] pgmap v1324: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:22:49.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:22:49 smithi132 bash[27079]: cluster 2020-07-16T14:22:48.084617+0000 mgr.x (mgr.34562) 2122 : cluster [DBG] pgmap v1324: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:22:50.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:22:50 smithi132 bash[27079]: cluster 2020-07-16T14:22:50.085001+0000 mgr.x (mgr.34562) 2123 : cluster [DBG] pgmap v1325: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:22:50.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:22:50 smithi188 bash[23329]: cluster 2020-07-16T14:22:50.085001+0000 mgr.x (mgr.34562) 2123 : cluster [DBG] pgmap v1325: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:22:52.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:22:51 smithi188 bash[23329]: audit 2020-07-16T14:22:51.803025+0000 mon.b (mon.2) 561 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:22:52.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:22:51 smithi132 bash[27079]: audit 2020-07-16T14:22:51.803025+0000 mon.b (mon.2) 561 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:22:53.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:22:52 smithi188 bash[23329]: cephadm 2020-07-16T14:22:51.803774+0000 mgr.x (mgr.34562) 2124 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:22:53.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:22:52 smithi188 bash[23329]: cephadm 2020-07-16T14:22:51.804186+0000 mgr.x (mgr.34562) 2125 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:22:53.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:22:52 smithi188 bash[23329]: cluster 2020-07-16T14:22:52.085551+0000 mgr.x (mgr.34562) 2126 : cluster [DBG] pgmap v1326: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:22:53.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:22:52 smithi132 bash[27079]: cephadm 2020-07-16T14:22:51.803774+0000 mgr.x (mgr.34562) 2124 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:22:53.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:22:52 smithi132 bash[27079]: cephadm 2020-07-16T14:22:51.804186+0000 mgr.x (mgr.34562) 2125 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:22:53.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:22:52 smithi132 bash[27079]: cluster 2020-07-16T14:22:52.085551+0000 mgr.x (mgr.34562) 2126 : cluster [DBG] pgmap v1326: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:22:55.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:22:55 smithi188 bash[23329]: cluster 2020-07-16T14:22:54.086013+0000 mgr.x (mgr.34562) 2127 : cluster [DBG] pgmap v1327: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:22:55.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:22:55 smithi132 bash[27079]: cluster 2020-07-16T14:22:54.086013+0000 mgr.x (mgr.34562) 2127 : cluster [DBG] pgmap v1327: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:22:57.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:22:57 smithi188 bash[23329]: cluster 2020-07-16T14:22:56.086452+0000 mgr.x (mgr.34562) 2128 : cluster [DBG] pgmap v1328: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:22:57.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:22:57 smithi132 bash[27079]: cluster 2020-07-16T14:22:56.086452+0000 mgr.x (mgr.34562) 2128 : cluster [DBG] pgmap v1328: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:22:59.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:22:59 smithi188 bash[23329]: cluster 2020-07-16T14:22:58.087020+0000 mgr.x (mgr.34562) 2129 : cluster [DBG] pgmap v1329: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:22:59.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:22:59 smithi132 bash[27079]: cluster 2020-07-16T14:22:58.087020+0000 mgr.x (mgr.34562) 2129 : cluster [DBG] pgmap v1329: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:23:00.758 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:23:00.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:00 smithi132 bash[27079]: cluster 2020-07-16T14:23:00.087609+0000 mgr.x (mgr.34562) 2130 : cluster [DBG] pgmap v1330: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:23:00.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:00 smithi188 bash[23329]: cluster 2020-07-16T14:23:00.087609+0000 mgr.x (mgr.34562) 2130 : cluster [DBG] pgmap v1330: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:23:01.022 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:23:01.023 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (45m) 2m ago 48m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:23:01.023 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (48m) 119s ago 48m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:23:01.023 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (46m) 119s ago 51m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:23:01.023 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (45m) 2m ago 53m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:23:01.024 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 2m ago 53m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:23:01.024 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (51m) 119s ago 51m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:23:01.024 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (52m) 2m ago 52m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:23:01.024 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (48m) 2m ago 49m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:23:01.024 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (48m) 119s ago 49m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:23:01.025 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (51m) 2m ago 51m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:23:01.025 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (51m) 2m ago 51m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:23:01.025 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (50m) 2m ago 50m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:23:01.025 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (50m) 2m ago 50m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:23:01.025 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (49m) 119s ago 50m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:23:01.026 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (49m) 119s ago 49m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:23:01.026 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (49m) 119s ago 49m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:23:01.026 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (49m) 119s ago 49m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:23:01.026 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (48m) 119s ago 49m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:23:01.316 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:23:01.317 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:23:01.317 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:23:01.317 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:23:01.317 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:23:01.317 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:23:01.318 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:23:01.318 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:23:01.318 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:23:01.318 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:23:01.318 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:23:01.319 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:23:01.319 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:23:01.319 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:23:01.319 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:23:01.320 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:23:01.320 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:23:01.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:01 smithi132 bash[27079]: audit 2020-07-16T14:23:00.747120+0000 mgr.x (mgr.34562) 2131 : audit [DBG] from='client.26188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:23:01.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:01 smithi132 bash[27079]: audit 2020-07-16T14:23:01.018196+0000 mgr.x (mgr.34562) 2132 : audit [DBG] from='client.26194 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:23:01.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:01 smithi132 bash[27079]: audit 2020-07-16T14:23:01.315457+0000 mon.c (mon.1) 185 : audit [DBG] from='client.? 172.21.15.132:0/1494112570' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:23:01.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:01 smithi188 bash[23329]: audit 2020-07-16T14:23:00.747120+0000 mgr.x (mgr.34562) 2131 : audit [DBG] from='client.26188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:23:01.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:01 smithi188 bash[23329]: audit 2020-07-16T14:23:01.018196+0000 mgr.x (mgr.34562) 2132 : audit [DBG] from='client.26194 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:23:01.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:01 smithi188 bash[23329]: audit 2020-07-16T14:23:01.315457+0000 mon.c (mon.1) 185 : audit [DBG] from='client.? 172.21.15.132:0/1494112570' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:23:02.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:02 smithi132 bash[27079]: cluster 2020-07-16T14:23:02.088164+0000 mgr.x (mgr.34562) 2133 : cluster [DBG] pgmap v1331: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:23:02.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:02 smithi188 bash[23329]: cluster 2020-07-16T14:23:02.088164+0000 mgr.x (mgr.34562) 2133 : cluster [DBG] pgmap v1331: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:23:05.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:05 smithi188 bash[23329]: cluster 2020-07-16T14:23:04.088631+0000 mgr.x (mgr.34562) 2134 : cluster [DBG] pgmap v1332: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:23:05.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:05 smithi132 bash[27079]: cluster 2020-07-16T14:23:04.088631+0000 mgr.x (mgr.34562) 2134 : cluster [DBG] pgmap v1332: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:23:07.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:07 smithi188 bash[23329]: cluster 2020-07-16T14:23:06.088986+0000 mgr.x (mgr.34562) 2135 : cluster [DBG] pgmap v1333: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:23:07.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:07 smithi188 bash[23329]: audit 2020-07-16T14:23:07.041531+0000 mon.b (mon.2) 562 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:21:00.828302\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.828388\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.828460\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.828525\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.828830\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.829048\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.829235\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.829391\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.829433\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:21:00.829534\", \"last_device_update\": \"2020-07-16T14:03:05.154706\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:23:07.040663\"}"}]: dispatch 2020-07-16T14:23:07.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:07 smithi188 bash[23329]: audit 2020-07-16T14:23:07.042199+0000 mon.c (mon.1) 186 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:21:00.828302\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.828388\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.828460\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.828525\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.828830\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.829048\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.829235\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.829391\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.829433\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:21:00.829534\", \"last_device_update\": \"2020-07-16T14:03:05.154706\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:23:07.040663\"}"}]: dispatch 2020-07-16T14:23:07.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:07 smithi188 bash[23329]: audit 2020-07-16T14:23:07.044809+0000 mon.c (mon.1) 187 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:21:00.828302\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.828388\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.828460\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.828525\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.828830\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.829048\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.829235\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.829391\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.829433\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:21:00.829534\", \"last_device_update\": \"2020-07-16T14:03:05.154706\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:23:07.040663\"}"}]': finished 2020-07-16T14:23:07.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:07 smithi188 bash[23329]: audit 2020-07-16T14:23:07.045406+0000 mon.b (mon.2) 563 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116357\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116430\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116462\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116639\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116740\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116838\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116936\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116969\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116996\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:21:01.117063\", \"last_device_update\": \"2020-07-16T14:04:10.964865\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:23:07.043105\"}"}]: dispatch 2020-07-16T14:23:07.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:07 smithi188 bash[23329]: audit 2020-07-16T14:23:07.045835+0000 mon.c (mon.1) 188 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116357\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116430\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116462\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116639\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116740\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116838\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116936\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116969\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116996\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:21:01.117063\", \"last_device_update\": \"2020-07-16T14:04:10.964865\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:23:07.043105\"}"}]: dispatch 2020-07-16T14:23:07.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:07 smithi188 bash[23329]: audit 2020-07-16T14:23:07.050052+0000 mon.c (mon.1) 189 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116357\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116430\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116462\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116639\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116740\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116838\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116936\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116969\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116996\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:21:01.117063\", \"last_device_update\": \"2020-07-16T14:04:10.964865\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:23:07.043105\"}"}]': finished 2020-07-16T14:23:07.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:07 smithi188 bash[23329]: audit 2020-07-16T14:23:07.052436+0000 mon.b (mon.2) 564 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:23:07.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:07 smithi188 bash[23329]: audit 2020-07-16T14:23:07.053396+0000 mon.b (mon.2) 565 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:23:07.425 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:07 smithi188 bash[23329]: audit 2020-07-16T14:23:07.054235+0000 mon.b (mon.2) 566 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:23:07.425 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:07 smithi188 bash[23329]: audit 2020-07-16T14:23:07.055147+0000 mon.b (mon.2) 567 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:23:07.425 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:07 smithi188 bash[23329]: audit 2020-07-16T14:23:07.056119+0000 mon.b (mon.2) 568 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:23:07.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:07 smithi132 bash[27079]: cluster 2020-07-16T14:23:06.088986+0000 mgr.x (mgr.34562) 2135 : cluster [DBG] pgmap v1333: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:23:07.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:07 smithi132 bash[27079]: audit 2020-07-16T14:23:07.041531+0000 mon.b (mon.2) 562 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:21:00.828302\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.828388\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.828460\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.828525\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.828830\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.829048\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.829235\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.829391\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.829433\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:21:00.829534\", \"last_device_update\": \"2020-07-16T14:03:05.154706\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:23:07.040663\"}"}]: dispatch 2020-07-16T14:23:07.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:07 smithi132 bash[27079]: audit 2020-07-16T14:23:07.042199+0000 mon.c (mon.1) 186 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:21:00.828302\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.828388\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.828460\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.828525\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.828830\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.829048\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.829235\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.829391\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.829433\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:21:00.829534\", \"last_device_update\": \"2020-07-16T14:03:05.154706\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:23:07.040663\"}"}]: dispatch 2020-07-16T14:23:07.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:07 smithi132 bash[27079]: audit 2020-07-16T14:23:07.044809+0000 mon.c (mon.1) 187 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:21:00.828302\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.828388\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.828460\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.828525\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.828830\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.829048\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.829235\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.829391\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:00.829433\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:21:00.829534\", \"last_device_update\": \"2020-07-16T14:03:05.154706\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:23:07.040663\"}"}]': finished 2020-07-16T14:23:07.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:07 smithi132 bash[27079]: audit 2020-07-16T14:23:07.045406+0000 mon.b (mon.2) 563 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116357\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116430\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116462\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116639\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116740\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116838\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116936\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116969\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116996\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:21:01.117063\", \"last_device_update\": \"2020-07-16T14:04:10.964865\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:23:07.043105\"}"}]: dispatch 2020-07-16T14:23:07.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:07 smithi132 bash[27079]: audit 2020-07-16T14:23:07.045835+0000 mon.c (mon.1) 188 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116357\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116430\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116462\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116639\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116740\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116838\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116936\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116969\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116996\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:21:01.117063\", \"last_device_update\": \"2020-07-16T14:04:10.964865\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:23:07.043105\"}"}]: dispatch 2020-07-16T14:23:07.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:07 smithi132 bash[27079]: audit 2020-07-16T14:23:07.050052+0000 mon.c (mon.1) 189 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116357\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116430\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116462\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116639\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116740\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116838\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116936\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116969\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:21:01.116996\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:21:01.117063\", \"last_device_update\": \"2020-07-16T14:04:10.964865\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:23:07.043105\"}"}]': finished 2020-07-16T14:23:07.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:07 smithi132 bash[27079]: audit 2020-07-16T14:23:07.052436+0000 mon.b (mon.2) 564 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:23:07.532 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:07 smithi132 bash[27079]: audit 2020-07-16T14:23:07.053396+0000 mon.b (mon.2) 565 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:23:07.532 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:07 smithi132 bash[27079]: audit 2020-07-16T14:23:07.054235+0000 mon.b (mon.2) 566 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:23:07.532 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:07 smithi132 bash[27079]: audit 2020-07-16T14:23:07.055147+0000 mon.b (mon.2) 567 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:23:07.532 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:07 smithi132 bash[27079]: audit 2020-07-16T14:23:07.056119+0000 mon.b (mon.2) 568 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:23:08.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:08 smithi188 bash[23329]: audit 2020-07-16T14:23:07.052702+0000 mgr.x (mgr.34562) 2136 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:23:08.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:08 smithi188 bash[23329]: audit 2020-07-16T14:23:07.053634+0000 mgr.x (mgr.34562) 2137 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:23:08.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:08 smithi188 bash[23329]: audit 2020-07-16T14:23:07.054452+0000 mgr.x (mgr.34562) 2138 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:23:08.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:08 smithi188 bash[23329]: cephadm 2020-07-16T14:23:07.054950+0000 mgr.x (mgr.34562) 2139 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:23:08.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:08 smithi188 bash[23329]: cephadm 2020-07-16T14:23:07.055751+0000 mgr.x (mgr.34562) 2140 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:23:08.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:08 smithi188 bash[23329]: cephadm 2020-07-16T14:23:07.056614+0000 mgr.x (mgr.34562) 2141 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:23:08.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:08 smithi188 bash[23329]: cephadm 2020-07-16T14:23:07.056661+0000 mgr.x (mgr.34562) 2142 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:23:08.481 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:08 smithi132 bash[27079]: audit 2020-07-16T14:23:07.052702+0000 mgr.x (mgr.34562) 2136 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:23:08.482 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:08 smithi132 bash[27079]: audit 2020-07-16T14:23:07.053634+0000 mgr.x (mgr.34562) 2137 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:23:08.482 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:08 smithi132 bash[27079]: audit 2020-07-16T14:23:07.054452+0000 mgr.x (mgr.34562) 2138 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:23:08.482 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:08 smithi132 bash[27079]: cephadm 2020-07-16T14:23:07.054950+0000 mgr.x (mgr.34562) 2139 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:23:08.482 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:08 smithi132 bash[27079]: cephadm 2020-07-16T14:23:07.055751+0000 mgr.x (mgr.34562) 2140 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:23:08.483 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:08 smithi132 bash[27079]: cephadm 2020-07-16T14:23:07.056614+0000 mgr.x (mgr.34562) 2141 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:23:08.483 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:08 smithi132 bash[27079]: cephadm 2020-07-16T14:23:07.056661+0000 mgr.x (mgr.34562) 2142 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:23:09.277 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:09 smithi132 bash[27079]: cluster 2020-07-16T14:23:08.089372+0000 mgr.x (mgr.34562) 2143 : cluster [DBG] pgmap v1334: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:23:09.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:09 smithi188 bash[23329]: cluster 2020-07-16T14:23:08.089372+0000 mgr.x (mgr.34562) 2143 : cluster [DBG] pgmap v1334: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:23:10.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:10 smithi132 bash[27079]: audit 2020-07-16T14:23:09.773826+0000 mon.b (mon.2) 569 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:23:10.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:10 smithi132 bash[27079]: cephadm 2020-07-16T14:23:09.774443+0000 mgr.x (mgr.34562) 2144 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:23:10.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:10 smithi132 bash[27079]: cephadm 2020-07-16T14:23:09.774887+0000 mgr.x (mgr.34562) 2145 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:23:10.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:10 smithi132 bash[27079]: cluster 2020-07-16T14:23:10.089700+0000 mgr.x (mgr.34562) 2146 : cluster [DBG] pgmap v1335: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:23:10.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:10 smithi188 bash[23329]: audit 2020-07-16T14:23:09.773826+0000 mon.b (mon.2) 569 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:23:10.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:10 smithi188 bash[23329]: cephadm 2020-07-16T14:23:09.774443+0000 mgr.x (mgr.34562) 2144 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:23:10.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:10 smithi188 bash[23329]: cephadm 2020-07-16T14:23:09.774887+0000 mgr.x (mgr.34562) 2145 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:23:10.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:10 smithi188 bash[23329]: cluster 2020-07-16T14:23:10.089700+0000 mgr.x (mgr.34562) 2146 : cluster [DBG] pgmap v1335: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:23:13.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:13 smithi188 bash[23329]: cluster 2020-07-16T14:23:12.090151+0000 mgr.x (mgr.34562) 2147 : cluster [DBG] pgmap v1336: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:23:13.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:13 smithi132 bash[27079]: cluster 2020-07-16T14:23:12.090151+0000 mgr.x (mgr.34562) 2147 : cluster [DBG] pgmap v1336: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:23:15.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:15 smithi188 bash[23329]: cluster 2020-07-16T14:23:14.090634+0000 mgr.x (mgr.34562) 2148 : cluster [DBG] pgmap v1337: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:23:15.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:15 smithi132 bash[27079]: cluster 2020-07-16T14:23:14.090634+0000 mgr.x (mgr.34562) 2148 : cluster [DBG] pgmap v1337: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:23:17.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:17 smithi188 bash[23329]: cluster 2020-07-16T14:23:16.091017+0000 mgr.x (mgr.34562) 2149 : cluster [DBG] pgmap v1338: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:23:17.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:17 smithi132 bash[27079]: cluster 2020-07-16T14:23:16.091017+0000 mgr.x (mgr.34562) 2149 : cluster [DBG] pgmap v1338: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:23:19.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:19 smithi188 bash[23329]: cluster 2020-07-16T14:23:18.091454+0000 mgr.x (mgr.34562) 2150 : cluster [DBG] pgmap v1339: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:23:19.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:19 smithi132 bash[27079]: cluster 2020-07-16T14:23:18.091454+0000 mgr.x (mgr.34562) 2150 : cluster [DBG] pgmap v1339: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:23:20.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:20 smithi132 bash[27079]: cluster 2020-07-16T14:23:20.091847+0000 mgr.x (mgr.34562) 2151 : cluster [DBG] pgmap v1340: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:23:20.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:20 smithi188 bash[23329]: cluster 2020-07-16T14:23:20.091847+0000 mgr.x (mgr.34562) 2151 : cluster [DBG] pgmap v1340: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:23:23.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:23 smithi188 bash[23329]: cluster 2020-07-16T14:23:22.092267+0000 mgr.x (mgr.34562) 2152 : cluster [DBG] pgmap v1341: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:23:23.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:23 smithi132 bash[27079]: cluster 2020-07-16T14:23:22.092267+0000 mgr.x (mgr.34562) 2152 : cluster [DBG] pgmap v1341: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:23:25.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:25 smithi188 bash[23329]: cluster 2020-07-16T14:23:24.092785+0000 mgr.x (mgr.34562) 2153 : cluster [DBG] pgmap v1342: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:23:25.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:25 smithi188 bash[23329]: audit 2020-07-16T14:23:24.790357+0000 mon.b (mon.2) 570 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:23:25.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:25 smithi132 bash[27079]: cluster 2020-07-16T14:23:24.092785+0000 mgr.x (mgr.34562) 2153 : cluster [DBG] pgmap v1342: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:23:25.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:25 smithi132 bash[27079]: audit 2020-07-16T14:23:24.790357+0000 mon.b (mon.2) 570 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:23:26.426 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:26 smithi188 bash[23329]: cephadm 2020-07-16T14:23:24.791095+0000 mgr.x (mgr.34562) 2154 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:23:26.427 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:26 smithi188 bash[23329]: cephadm 2020-07-16T14:23:24.791194+0000 mgr.x (mgr.34562) 2155 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:23:26.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:26 smithi132 bash[27079]: cephadm 2020-07-16T14:23:24.791095+0000 mgr.x (mgr.34562) 2154 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:23:26.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:26 smithi132 bash[27079]: cephadm 2020-07-16T14:23:24.791194+0000 mgr.x (mgr.34562) 2155 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:23:27.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:27 smithi188 bash[23329]: cluster 2020-07-16T14:23:26.093344+0000 mgr.x (mgr.34562) 2156 : cluster [DBG] pgmap v1343: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:23:27.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:27 smithi132 bash[27079]: cluster 2020-07-16T14:23:26.093344+0000 mgr.x (mgr.34562) 2156 : cluster [DBG] pgmap v1343: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:23:29.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:29 smithi188 bash[23329]: cluster 2020-07-16T14:23:28.093906+0000 mgr.x (mgr.34562) 2157 : cluster [DBG] pgmap v1344: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:23:29.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:29 smithi132 bash[27079]: cluster 2020-07-16T14:23:28.093906+0000 mgr.x (mgr.34562) 2157 : cluster [DBG] pgmap v1344: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:23:30.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:30 smithi132 bash[27079]: cluster 2020-07-16T14:23:30.094407+0000 mgr.x (mgr.34562) 2158 : cluster [DBG] pgmap v1345: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:23:30.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:30 smithi188 bash[23329]: cluster 2020-07-16T14:23:30.094407+0000 mgr.x (mgr.34562) 2158 : cluster [DBG] pgmap v1345: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:23:31.614 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:23:31.875 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:23:31.876 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (46m) 2m ago 49m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:23:31.876 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (49m) 2m ago 49m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:23:31.876 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (46m) 2m ago 52m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:23:31.876 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (46m) 2m ago 53m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:23:31.877 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 2m ago 53m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:23:31.877 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (52m) 2m ago 52m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:23:31.877 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (52m) 2m ago 52m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:23:31.877 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (49m) 2m ago 49m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:23:31.877 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (49m) 2m ago 49m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:23:31.878 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (51m) 2m ago 51m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:23:31.878 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (51m) 2m ago 51m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:23:31.878 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (51m) 2m ago 51m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:23:31.878 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (51m) 2m ago 51m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:23:31.879 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (50m) 2m ago 50m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:23:31.879 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (50m) 2m ago 50m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:23:31.879 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (50m) 2m ago 50m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:23:31.879 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (49m) 2m ago 49m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:23:31.880 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (48m) 2m ago 49m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:23:32.174 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:23:32.174 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:23:32.175 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:23:32.175 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:23:32.175 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:23:32.175 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:23:32.176 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:23:32.176 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:23:32.176 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:23:32.176 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:23:32.176 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:23:32.177 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:23:32.177 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:23:32.177 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:23:32.177 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:23:32.177 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:23:32.178 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:23:33.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:33 smithi188 bash[23329]: audit 2020-07-16T14:23:31.601724+0000 mgr.x (mgr.34562) 2159 : audit [DBG] from='client.26206 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:23:33.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:33 smithi188 bash[23329]: audit 2020-07-16T14:23:31.870445+0000 mgr.x (mgr.34562) 2160 : audit [DBG] from='client.26212 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:23:33.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:33 smithi188 bash[23329]: cluster 2020-07-16T14:23:32.094870+0000 mgr.x (mgr.34562) 2161 : cluster [DBG] pgmap v1346: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:23:33.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:33 smithi188 bash[23329]: audit 2020-07-16T14:23:32.173037+0000 mon.c (mon.1) 190 : audit [DBG] from='client.? 172.21.15.132:0/1292777016' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:23:33.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:33 smithi132 bash[27079]: audit 2020-07-16T14:23:31.601724+0000 mgr.x (mgr.34562) 2159 : audit [DBG] from='client.26206 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:23:33.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:33 smithi132 bash[27079]: audit 2020-07-16T14:23:31.870445+0000 mgr.x (mgr.34562) 2160 : audit [DBG] from='client.26212 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:23:33.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:33 smithi132 bash[27079]: cluster 2020-07-16T14:23:32.094870+0000 mgr.x (mgr.34562) 2161 : cluster [DBG] pgmap v1346: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:23:33.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:33 smithi132 bash[27079]: audit 2020-07-16T14:23:32.173037+0000 mon.c (mon.1) 190 : audit [DBG] from='client.? 172.21.15.132:0/1292777016' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:23:35.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:35 smithi188 bash[23329]: cluster 2020-07-16T14:23:34.095212+0000 mgr.x (mgr.34562) 2162 : cluster [DBG] pgmap v1347: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:23:35.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:35 smithi132 bash[27079]: cluster 2020-07-16T14:23:34.095212+0000 mgr.x (mgr.34562) 2162 : cluster [DBG] pgmap v1347: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:23:37.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:37 smithi188 bash[23329]: cluster 2020-07-16T14:23:36.095526+0000 mgr.x (mgr.34562) 2163 : cluster [DBG] pgmap v1348: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:23:37.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:37 smithi132 bash[27079]: cluster 2020-07-16T14:23:36.095526+0000 mgr.x (mgr.34562) 2163 : cluster [DBG] pgmap v1348: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:23:39.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:39 smithi188 bash[23329]: cluster 2020-07-16T14:23:38.095955+0000 mgr.x (mgr.34562) 2164 : cluster [DBG] pgmap v1349: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:23:39.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:39 smithi132 bash[27079]: cluster 2020-07-16T14:23:38.095955+0000 mgr.x (mgr.34562) 2164 : cluster [DBG] pgmap v1349: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:23:40.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:40 smithi132 bash[27079]: audit 2020-07-16T14:23:39.807018+0000 mon.b (mon.2) 571 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:23:40.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:40 smithi132 bash[27079]: cephadm 2020-07-16T14:23:39.807754+0000 mgr.x (mgr.34562) 2165 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:23:40.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:40 smithi132 bash[27079]: cephadm 2020-07-16T14:23:39.808180+0000 mgr.x (mgr.34562) 2166 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:23:40.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:40 smithi132 bash[27079]: cluster 2020-07-16T14:23:40.096318+0000 mgr.x (mgr.34562) 2167 : cluster [DBG] pgmap v1350: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:23:40.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:40 smithi188 bash[23329]: audit 2020-07-16T14:23:39.807018+0000 mon.b (mon.2) 571 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:23:40.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:40 smithi188 bash[23329]: cephadm 2020-07-16T14:23:39.807754+0000 mgr.x (mgr.34562) 2165 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:23:40.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:40 smithi188 bash[23329]: cephadm 2020-07-16T14:23:39.808180+0000 mgr.x (mgr.34562) 2166 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:23:40.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:40 smithi188 bash[23329]: cluster 2020-07-16T14:23:40.096318+0000 mgr.x (mgr.34562) 2167 : cluster [DBG] pgmap v1350: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:23:43.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:43 smithi188 bash[23329]: cluster 2020-07-16T14:23:42.096821+0000 mgr.x (mgr.34562) 2168 : cluster [DBG] pgmap v1351: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:23:43.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:43 smithi132 bash[27079]: cluster 2020-07-16T14:23:42.096821+0000 mgr.x (mgr.34562) 2168 : cluster [DBG] pgmap v1351: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:23:45.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:45 smithi188 bash[23329]: cluster 2020-07-16T14:23:44.097192+0000 mgr.x (mgr.34562) 2169 : cluster [DBG] pgmap v1352: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:23:45.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:45 smithi132 bash[27079]: cluster 2020-07-16T14:23:44.097192+0000 mgr.x (mgr.34562) 2169 : cluster [DBG] pgmap v1352: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:23:47.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:47 smithi188 bash[23329]: cluster 2020-07-16T14:23:46.097578+0000 mgr.x (mgr.34562) 2170 : cluster [DBG] pgmap v1353: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:23:47.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:47 smithi132 bash[27079]: cluster 2020-07-16T14:23:46.097578+0000 mgr.x (mgr.34562) 2170 : cluster [DBG] pgmap v1353: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:23:49.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:49 smithi188 bash[23329]: cluster 2020-07-16T14:23:48.097993+0000 mgr.x (mgr.34562) 2171 : cluster [DBG] pgmap v1354: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:23:49.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:49 smithi132 bash[27079]: cluster 2020-07-16T14:23:48.097993+0000 mgr.x (mgr.34562) 2171 : cluster [DBG] pgmap v1354: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:23:50.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:50 smithi132 bash[27079]: cluster 2020-07-16T14:23:50.098492+0000 mgr.x (mgr.34562) 2172 : cluster [DBG] pgmap v1355: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:23:50.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:50 smithi188 bash[23329]: cluster 2020-07-16T14:23:50.098492+0000 mgr.x (mgr.34562) 2172 : cluster [DBG] pgmap v1355: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:23:53.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:53 smithi188 bash[23329]: cluster 2020-07-16T14:23:52.098874+0000 mgr.x (mgr.34562) 2173 : cluster [DBG] pgmap v1356: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:23:53.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:53 smithi132 bash[27079]: cluster 2020-07-16T14:23:52.098874+0000 mgr.x (mgr.34562) 2173 : cluster [DBG] pgmap v1356: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:23:55.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:55 smithi188 bash[23329]: cluster 2020-07-16T14:23:54.099263+0000 mgr.x (mgr.34562) 2174 : cluster [DBG] pgmap v1357: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:23:55.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:55 smithi188 bash[23329]: audit 2020-07-16T14:23:54.820989+0000 mon.b (mon.2) 572 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:23:55.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:55 smithi132 bash[27079]: cluster 2020-07-16T14:23:54.099263+0000 mgr.x (mgr.34562) 2174 : cluster [DBG] pgmap v1357: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:23:55.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:55 smithi132 bash[27079]: audit 2020-07-16T14:23:54.820989+0000 mon.b (mon.2) 572 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:23:56.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:56 smithi188 bash[23329]: cephadm 2020-07-16T14:23:54.822171+0000 mgr.x (mgr.34562) 2175 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:23:56.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:56 smithi188 bash[23329]: cephadm 2020-07-16T14:23:54.822509+0000 mgr.x (mgr.34562) 2176 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:23:56.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:56 smithi132 bash[27079]: cephadm 2020-07-16T14:23:54.822171+0000 mgr.x (mgr.34562) 2175 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:23:56.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:56 smithi132 bash[27079]: cephadm 2020-07-16T14:23:54.822509+0000 mgr.x (mgr.34562) 2176 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:23:57.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:57 smithi188 bash[23329]: cluster 2020-07-16T14:23:56.099782+0000 mgr.x (mgr.34562) 2177 : cluster [DBG] pgmap v1358: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:23:57.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:57 smithi132 bash[27079]: cluster 2020-07-16T14:23:56.099782+0000 mgr.x (mgr.34562) 2177 : cluster [DBG] pgmap v1358: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:23:59.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:23:59 smithi132 bash[27079]: cluster 2020-07-16T14:23:58.100158+0000 mgr.x (mgr.34562) 2178 : cluster [DBG] pgmap v1359: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:23:59.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:23:59 smithi188 bash[23329]: cluster 2020-07-16T14:23:58.100158+0000 mgr.x (mgr.34562) 2178 : cluster [DBG] pgmap v1359: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:24:00.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:24:00 smithi132 bash[27079]: cluster 2020-07-16T14:24:00.100659+0000 mgr.x (mgr.34562) 2179 : cluster [DBG] pgmap v1360: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:24:00.928 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:24:00 smithi188 bash[23329]: cluster 2020-07-16T14:24:00.100659+0000 mgr.x (mgr.34562) 2179 : cluster [DBG] pgmap v1360: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:24:02.472 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:24:02.736 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:24:02.736 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (46m) 3m ago 49m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:24:02.736 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (49m) 3m ago 49m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:24:02.737 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (47m) 3m ago 52m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:24:02.737 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (46m) 3m ago 54m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:24:02.737 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 3m ago 54m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:24:02.737 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (52m) 3m ago 52m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:24:02.738 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (53m) 3m ago 53m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:24:02.738 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (50m) 3m ago 50m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:24:02.738 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (50m) 3m ago 50m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:24:02.738 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (52m) 3m ago 52m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:24:02.739 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (52m) 3m ago 52m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:24:02.747 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (51m) 3m ago 51m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:24:02.747 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (51m) 3m ago 51m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:24:02.747 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (51m) 3m ago 51m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:24:02.748 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (50m) 3m ago 51m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:24:02.748 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (50m) 3m ago 50m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:24:02.748 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (50m) 3m ago 50m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:24:02.748 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (49m) 3m ago 50m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:24:03.029 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:24:03.029 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:24:03.029 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:24:03.030 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:24:03.030 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:24:03.030 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:24:03.030 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:24:03.031 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:24:03.031 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:24:03.031 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:24:03.031 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:24:03.032 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:24:03.032 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:24:03.032 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:24:03.032 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:24:03.033 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:24:03.033 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:24:03.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:24:03 smithi188 bash[23329]: cluster 2020-07-16T14:24:02.101066+0000 mgr.x (mgr.34562) 2180 : cluster [DBG] pgmap v1361: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:24:03.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:24:03 smithi188 bash[23329]: audit 2020-07-16T14:24:03.027889+0000 mon.c (mon.1) 191 : audit [DBG] from='client.? 172.21.15.132:0/2728545228' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:24:03.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:24:03 smithi132 bash[27079]: cluster 2020-07-16T14:24:02.101066+0000 mgr.x (mgr.34562) 2180 : cluster [DBG] pgmap v1361: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:24:03.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:24:03 smithi132 bash[27079]: audit 2020-07-16T14:24:03.027889+0000 mon.c (mon.1) 191 : audit [DBG] from='client.? 172.21.15.132:0/2728545228' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:24:04.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:24:04 smithi188 bash[23329]: audit 2020-07-16T14:24:02.460240+0000 mgr.x (mgr.34562) 2181 : audit [DBG] from='client.26224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:24:04.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:24:04 smithi188 bash[23329]: audit 2020-07-16T14:24:02.729050+0000 mgr.x (mgr.34562) 2182 : audit [DBG] from='client.26230 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:24:04.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:24:04 smithi132 bash[27079]: audit 2020-07-16T14:24:02.460240+0000 mgr.x (mgr.34562) 2181 : audit [DBG] from='client.26224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:24:04.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:24:04 smithi132 bash[27079]: audit 2020-07-16T14:24:02.729050+0000 mgr.x (mgr.34562) 2182 : audit [DBG] from='client.26230 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:24:05.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:24:05 smithi188 bash[23329]: cluster 2020-07-16T14:24:04.101453+0000 mgr.x (mgr.34562) 2183 : cluster [DBG] pgmap v1362: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:24:05.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:24:05 smithi132 bash[27079]: cluster 2020-07-16T14:24:04.101453+0000 mgr.x (mgr.34562) 2183 : cluster [DBG] pgmap v1362: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:24:07.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:24:07 smithi188 bash[23329]: cluster 2020-07-16T14:24:06.101795+0000 mgr.x (mgr.34562) 2184 : cluster [DBG] pgmap v1363: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:24:07.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:24:07 smithi132 bash[27079]: cluster 2020-07-16T14:24:06.101795+0000 mgr.x (mgr.34562) 2184 : cluster [DBG] pgmap v1363: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:24:09.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:24:09 smithi132 bash[27079]: cluster 2020-07-16T14:24:08.102280+0000 mgr.x (mgr.34562) 2185 : cluster [DBG] pgmap v1364: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:24:09.548 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:24:09 smithi188 bash[23329]: cluster 2020-07-16T14:24:08.102280+0000 mgr.x (mgr.34562) 2185 : cluster [DBG] pgmap v1364: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:24:10.643 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:24:10 smithi132 bash[27079]: audit 2020-07-16T14:24:09.840657+0000 mon.b (mon.2) 573 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:24:10.643 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:24:10 smithi132 bash[27079]: audit 2020-07-16T14:24:09.841044+0000 mgr.x (mgr.34562) 2186 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:24:10.644 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:24:10 smithi132 bash[27079]: audit 2020-07-16T14:24:09.842086+0000 mon.b (mon.2) 574 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:24:10.644 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:24:10 smithi132 bash[27079]: audit 2020-07-16T14:24:09.842407+0000 mgr.x (mgr.34562) 2187 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:24:10.644 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:24:10 smithi132 bash[27079]: audit 2020-07-16T14:24:09.843337+0000 mon.b (mon.2) 575 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:24:10.644 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:24:10 smithi132 bash[27079]: audit 2020-07-16T14:24:09.843626+0000 mgr.x (mgr.34562) 2188 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:24:10.644 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:24:10 smithi132 bash[27079]: cephadm 2020-07-16T14:24:09.844411+0000 mgr.x (mgr.34562) 2189 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:24:10.645 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:24:10 smithi132 bash[27079]: audit 2020-07-16T14:24:09.844743+0000 mon.b (mon.2) 576 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:24:10.645 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:24:10 smithi132 bash[27079]: cephadm 2020-07-16T14:24:09.845686+0000 mgr.x (mgr.34562) 2190 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:24:10.645 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:24:10 smithi132 bash[27079]: audit 2020-07-16T14:24:09.846034+0000 mon.b (mon.2) 577 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:24:10.645 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:24:10 smithi132 bash[27079]: cephadm 2020-07-16T14:24:09.846787+0000 mgr.x (mgr.34562) 2191 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:24:10.645 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:24:10 smithi132 bash[27079]: cephadm 2020-07-16T14:24:09.846913+0000 mgr.x (mgr.34562) 2192 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:24:10.646 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:24:10 smithi132 bash[27079]: cluster 2020-07-16T14:24:10.102671+0000 mgr.x (mgr.34562) 2193 : cluster [DBG] pgmap v1365: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:24:10.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:24:10 smithi188 bash[23329]: audit 2020-07-16T14:24:09.840657+0000 mon.b (mon.2) 573 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:24:10.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:24:10 smithi188 bash[23329]: audit 2020-07-16T14:24:09.841044+0000 mgr.x (mgr.34562) 2186 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:24:10.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:24:10 smithi188 bash[23329]: audit 2020-07-16T14:24:09.842086+0000 mon.b (mon.2) 574 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:24:10.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:24:10 smithi188 bash[23329]: audit 2020-07-16T14:24:09.842407+0000 mgr.x (mgr.34562) 2187 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:24:10.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:24:10 smithi188 bash[23329]: audit 2020-07-16T14:24:09.843337+0000 mon.b (mon.2) 575 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:24:10.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:24:10 smithi188 bash[23329]: audit 2020-07-16T14:24:09.843626+0000 mgr.x (mgr.34562) 2188 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:24:10.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:24:10 smithi188 bash[23329]: cephadm 2020-07-16T14:24:09.844411+0000 mgr.x (mgr.34562) 2189 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:24:10.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:24:10 smithi188 bash[23329]: audit 2020-07-16T14:24:09.844743+0000 mon.b (mon.2) 576 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:24:10.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:24:10 smithi188 bash[23329]: cephadm 2020-07-16T14:24:09.845686+0000 mgr.x (mgr.34562) 2190 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:24:10.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:24:10 smithi188 bash[23329]: audit 2020-07-16T14:24:09.846034+0000 mon.b (mon.2) 577 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:24:10.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:24:10 smithi188 bash[23329]: cephadm 2020-07-16T14:24:09.846787+0000 mgr.x (mgr.34562) 2191 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:24:10.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:24:10 smithi188 bash[23329]: cephadm 2020-07-16T14:24:09.846913+0000 mgr.x (mgr.34562) 2192 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:24:10.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:24:10 smithi188 bash[23329]: cluster 2020-07-16T14:24:10.102671+0000 mgr.x (mgr.34562) 2193 : cluster [DBG] pgmap v1365: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:24:13.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:24:13 smithi188 bash[23329]: cluster 2020-07-16T14:24:12.103029+0000 mgr.x (mgr.34562) 2194 : cluster [DBG] pgmap v1366: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:24:13.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:24:13 smithi188 bash[23329]: audit 2020-07-16T14:24:12.568140+0000 mon.b (mon.2) 578 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:24:13.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:24:13 smithi132 bash[27079]: cluster 2020-07-16T14:24:12.103029+0000 mgr.x (mgr.34562) 2194 : cluster [DBG] pgmap v1366: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:24:13.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:24:13 smithi132 bash[27079]: audit 2020-07-16T14:24:12.568140+0000 mon.b (mon.2) 578 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:24:14.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:24:14 smithi188 bash[23329]: cephadm 2020-07-16T14:24:12.568796+0000 mgr.x (mgr.34562) 2195 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:24:14.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:24:14 smithi188 bash[23329]: cephadm 2020-07-16T14:24:12.568886+0000 mgr.x (mgr.34562) 2196 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:24:14.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:24:14 smithi132 bash[27079]: cephadm 2020-07-16T14:24:12.568796+0000 mgr.x (mgr.34562) 2195 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:24:14.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:24:14 smithi132 bash[27079]: cephadm 2020-07-16T14:24:12.568886+0000 mgr.x (mgr.34562) 2196 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:24:15.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:24:15 smithi188 bash[23329]: cluster 2020-07-16T14:24:14.103428+0000 mgr.x (mgr.34562) 2197 : cluster [DBG] pgmap v1367: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:24:15.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:24:15 smithi132 bash[27079]: cluster 2020-07-16T14:24:14.103428+0000 mgr.x (mgr.34562) 2197 : cluster [DBG] pgmap v1367: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:24:17.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:24:17 smithi132 bash[27079]: cluster 2020-07-16T14:24:16.103975+0000 mgr.x (mgr.34562) 2198 : cluster [DBG] pgmap v1368: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:24:17.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:24:17 smithi188 bash[23329]: cluster 2020-07-16T14:24:16.103975+0000 mgr.x (mgr.34562) 2198 : cluster [DBG] pgmap v1368: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:24:19.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:24:19 smithi132 bash[27079]: cluster 2020-07-16T14:24:18.104400+0000 mgr.x (mgr.34562) 2199 : cluster [DBG] pgmap v1369: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:24:19.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:24:19 smithi188 bash[23329]: cluster 2020-07-16T14:24:18.104400+0000 mgr.x (mgr.34562) 2199 : cluster [DBG] pgmap v1369: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:24:20.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:24:20 smithi188 bash[23329]: cluster 2020-07-16T14:24:20.104785+0000 mgr.x (mgr.34562) 2200 : cluster [DBG] pgmap v1370: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:24:21.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:24:20 smithi132 bash[27079]: cluster 2020-07-16T14:24:20.104785+0000 mgr.x (mgr.34562) 2200 : cluster [DBG] pgmap v1370: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:24:23.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:24:23 smithi188 bash[23329]: cluster 2020-07-16T14:24:22.105151+0000 mgr.x (mgr.34562) 2201 : cluster [DBG] pgmap v1371: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:24:23.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:24:23 smithi132 bash[27079]: cluster 2020-07-16T14:24:22.105151+0000 mgr.x (mgr.34562) 2201 : cluster [DBG] pgmap v1371: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:24:25.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:24:25 smithi188 bash[23329]: cluster 2020-07-16T14:24:24.105582+0000 mgr.x (mgr.34562) 2202 : cluster [DBG] pgmap v1372: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:24:25.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:24:25 smithi132 bash[27079]: cluster 2020-07-16T14:24:24.105582+0000 mgr.x (mgr.34562) 2202 : cluster [DBG] pgmap v1372: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:24:27.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:24:27 smithi188 bash[23329]: cluster 2020-07-16T14:24:26.106094+0000 mgr.x (mgr.34562) 2203 : cluster [DBG] pgmap v1373: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:24:27.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:24:27 smithi132 bash[27079]: cluster 2020-07-16T14:24:26.106094+0000 mgr.x (mgr.34562) 2203 : cluster [DBG] pgmap v1373: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:24:28.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:24:28 smithi132 bash[27079]: audit 2020-07-16T14:24:27.584625+0000 mon.b (mon.2) 579 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:24:28.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:24:28 smithi188 bash[23329]: audit 2020-07-16T14:24:27.584625+0000 mon.b (mon.2) 579 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:24:29.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:24:29 smithi132 bash[27079]: cephadm 2020-07-16T14:24:27.585373+0000 mgr.x (mgr.34562) 2204 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:24:29.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:24:29 smithi132 bash[27079]: cephadm 2020-07-16T14:24:27.585734+0000 mgr.x (mgr.34562) 2205 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:24:29.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:24:29 smithi132 bash[27079]: cluster 2020-07-16T14:24:28.106496+0000 mgr.x (mgr.34562) 2206 : cluster [DBG] pgmap v1374: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:24:29.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:24:29 smithi188 bash[23329]: cephadm 2020-07-16T14:24:27.585373+0000 mgr.x (mgr.34562) 2204 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:24:29.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:24:29 smithi188 bash[23329]: cephadm 2020-07-16T14:24:27.585734+0000 mgr.x (mgr.34562) 2205 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:24:29.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:24:29 smithi188 bash[23329]: cluster 2020-07-16T14:24:28.106496+0000 mgr.x (mgr.34562) 2206 : cluster [DBG] pgmap v1374: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:24:30.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:24:30 smithi188 bash[23329]: cluster 2020-07-16T14:24:30.106836+0000 mgr.x (mgr.34562) 2207 : cluster [DBG] pgmap v1375: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:24:31.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:24:30 smithi132 bash[27079]: cluster 2020-07-16T14:24:30.106836+0000 mgr.x (mgr.34562) 2207 : cluster [DBG] pgmap v1375: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:24:33.328 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:24:33.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:24:33 smithi188 bash[23329]: cluster 2020-07-16T14:24:32.107376+0000 mgr.x (mgr.34562) 2208 : cluster [DBG] pgmap v1376: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:24:33.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:24:33 smithi132 bash[27079]: cluster 2020-07-16T14:24:32.107376+0000 mgr.x (mgr.34562) 2208 : cluster [DBG] pgmap v1376: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:24:33.592 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:24:33.592 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (47m) 3m ago 50m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:24:33.592 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (50m) 3m ago 50m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:24:33.593 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (47m) 3m ago 53m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:24:33.593 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (47m) 3m ago 54m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:24:33.593 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 3m ago 54m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:24:33.593 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (53m) 3m ago 53m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:24:33.593 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (53m) 3m ago 53m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:24:33.594 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (50m) 3m ago 50m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:24:33.594 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (50m) 3m ago 50m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:24:33.594 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (52m) 3m ago 52m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:24:33.594 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (52m) 3m ago 52m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:24:33.594 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (52m) 3m ago 52m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:24:33.595 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (52m) 3m ago 52m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:24:33.595 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (51m) 3m ago 51m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:24:33.595 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (51m) 3m ago 51m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:24:33.595 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (51m) 3m ago 51m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:24:33.595 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (50m) 3m ago 50m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:24:33.596 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (49m) 3m ago 50m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:24:33.887 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:24:33.887 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:24:33.887 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:24:33.888 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:24:33.888 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:24:33.888 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:24:33.888 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:24:33.888 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:24:33.889 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:24:33.889 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:24:33.889 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:24:33.889 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:24:33.889 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:24:33.890 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:24:33.890 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:24:33.890 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:24:33.890 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:24:34.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:24:34 smithi188 bash[23329]: audit 2020-07-16T14:24:33.316754+0000 mgr.x (mgr.34562) 2209 : audit [DBG] from='client.26242 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:24:34.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:24:34 smithi188 bash[23329]: audit 2020-07-16T14:24:33.886136+0000 mon.c (mon.1) 192 : audit [DBG] from='client.? 172.21.15.132:0/718713648' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:24:34.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:24:34 smithi132 bash[27079]: audit 2020-07-16T14:24:33.316754+0000 mgr.x (mgr.34562) 2209 : audit [DBG] from='client.26242 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:24:34.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:24:34 smithi132 bash[27079]: audit 2020-07-16T14:24:33.886136+0000 mon.c (mon.1) 192 : audit [DBG] from='client.? 172.21.15.132:0/718713648' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:24:35.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:24:35 smithi132 bash[27079]: audit 2020-07-16T14:24:33.587663+0000 mgr.x (mgr.34562) 2210 : audit [DBG] from='client.26248 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:24:35.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:24:35 smithi132 bash[27079]: cluster 2020-07-16T14:24:34.107754+0000 mgr.x (mgr.34562) 2211 : cluster [DBG] pgmap v1377: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:24:35.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:24:35 smithi188 bash[23329]: audit 2020-07-16T14:24:33.587663+0000 mgr.x (mgr.34562) 2210 : audit [DBG] from='client.26248 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:24:35.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:24:35 smithi188 bash[23329]: cluster 2020-07-16T14:24:34.107754+0000 mgr.x (mgr.34562) 2211 : cluster [DBG] pgmap v1377: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:24:37.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:24:37 smithi132 bash[27079]: cluster 2020-07-16T14:24:36.108054+0000 mgr.x (mgr.34562) 2212 : cluster [DBG] pgmap v1378: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:24:37.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:24:37 smithi188 bash[23329]: cluster 2020-07-16T14:24:36.108054+0000 mgr.x (mgr.34562) 2212 : cluster [DBG] pgmap v1378: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:24:39.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:24:39 smithi132 bash[27079]: cluster 2020-07-16T14:24:38.108499+0000 mgr.x (mgr.34562) 2213 : cluster [DBG] pgmap v1379: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:24:39.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:24:39 smithi188 bash[23329]: cluster 2020-07-16T14:24:38.108499+0000 mgr.x (mgr.34562) 2213 : cluster [DBG] pgmap v1379: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:24:40.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:24:40 smithi188 bash[23329]: cluster 2020-07-16T14:24:40.108981+0000 mgr.x (mgr.34562) 2214 : cluster [DBG] pgmap v1380: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:24:41.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:24:40 smithi132 bash[27079]: cluster 2020-07-16T14:24:40.108981+0000 mgr.x (mgr.34562) 2214 : cluster [DBG] pgmap v1380: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:24:43.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:24:43 smithi188 bash[23329]: cluster 2020-07-16T14:24:42.109532+0000 mgr.x (mgr.34562) 2215 : cluster [DBG] pgmap v1381: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:24:43.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:24:43 smithi188 bash[23329]: audit 2020-07-16T14:24:42.601303+0000 mon.b (mon.2) 580 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:24:43.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:24:43 smithi132 bash[27079]: cluster 2020-07-16T14:24:42.109532+0000 mgr.x (mgr.34562) 2215 : cluster [DBG] pgmap v1381: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:24:43.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:24:43 smithi132 bash[27079]: audit 2020-07-16T14:24:42.601303+0000 mon.b (mon.2) 580 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:24:44.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:24:44 smithi188 bash[23329]: cephadm 2020-07-16T14:24:42.602038+0000 mgr.x (mgr.34562) 2216 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:24:44.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:24:44 smithi188 bash[23329]: cephadm 2020-07-16T14:24:42.602180+0000 mgr.x (mgr.34562) 2217 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:24:44.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:24:44 smithi132 bash[27079]: cephadm 2020-07-16T14:24:42.602038+0000 mgr.x (mgr.34562) 2216 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:24:44.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:24:44 smithi132 bash[27079]: cephadm 2020-07-16T14:24:42.602180+0000 mgr.x (mgr.34562) 2217 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:24:45.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:24:45 smithi132 bash[27079]: cluster 2020-07-16T14:24:44.109934+0000 mgr.x (mgr.34562) 2218 : cluster [DBG] pgmap v1382: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:24:45.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:24:45 smithi188 bash[23329]: cluster 2020-07-16T14:24:44.109934+0000 mgr.x (mgr.34562) 2218 : cluster [DBG] pgmap v1382: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:24:47.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:24:47 smithi132 bash[27079]: cluster 2020-07-16T14:24:46.110394+0000 mgr.x (mgr.34562) 2219 : cluster [DBG] pgmap v1383: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:24:47.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:24:47 smithi188 bash[23329]: cluster 2020-07-16T14:24:46.110394+0000 mgr.x (mgr.34562) 2219 : cluster [DBG] pgmap v1383: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:24:49.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:24:49 smithi132 bash[27079]: cluster 2020-07-16T14:24:48.110820+0000 mgr.x (mgr.34562) 2220 : cluster [DBG] pgmap v1384: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:24:49.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:24:49 smithi188 bash[23329]: cluster 2020-07-16T14:24:48.110820+0000 mgr.x (mgr.34562) 2220 : cluster [DBG] pgmap v1384: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:24:50.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:24:50 smithi188 bash[23329]: cluster 2020-07-16T14:24:50.111184+0000 mgr.x (mgr.34562) 2221 : cluster [DBG] pgmap v1385: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:24:51.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:24:50 smithi132 bash[27079]: cluster 2020-07-16T14:24:50.111184+0000 mgr.x (mgr.34562) 2221 : cluster [DBG] pgmap v1385: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:24:53.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:24:53 smithi188 bash[23329]: cluster 2020-07-16T14:24:52.111557+0000 mgr.x (mgr.34562) 2222 : cluster [DBG] pgmap v1386: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:24:53.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:24:53 smithi132 bash[27079]: cluster 2020-07-16T14:24:52.111557+0000 mgr.x (mgr.34562) 2222 : cluster [DBG] pgmap v1386: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:24:55.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:24:55 smithi132 bash[27079]: cluster 2020-07-16T14:24:54.112108+0000 mgr.x (mgr.34562) 2223 : cluster [DBG] pgmap v1387: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:24:55.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:24:55 smithi188 bash[23329]: cluster 2020-07-16T14:24:54.112108+0000 mgr.x (mgr.34562) 2223 : cluster [DBG] pgmap v1387: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:24:57.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:24:57 smithi132 bash[27079]: cluster 2020-07-16T14:24:56.112614+0000 mgr.x (mgr.34562) 2224 : cluster [DBG] pgmap v1388: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:24:57.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:24:57 smithi188 bash[23329]: cluster 2020-07-16T14:24:56.112614+0000 mgr.x (mgr.34562) 2224 : cluster [DBG] pgmap v1388: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:24:58.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:24:58 smithi132 bash[27079]: audit 2020-07-16T14:24:57.617926+0000 mon.b (mon.2) 581 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:24:58.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:24:58 smithi188 bash[23329]: audit 2020-07-16T14:24:57.617926+0000 mon.b (mon.2) 581 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:24:59.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:24:59 smithi132 bash[27079]: cephadm 2020-07-16T14:24:57.618646+0000 mgr.x (mgr.34562) 2225 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:24:59.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:24:59 smithi132 bash[27079]: cephadm 2020-07-16T14:24:57.618902+0000 mgr.x (mgr.34562) 2226 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:24:59.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:24:59 smithi132 bash[27079]: cluster 2020-07-16T14:24:58.112999+0000 mgr.x (mgr.34562) 2227 : cluster [DBG] pgmap v1389: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:24:59.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:24:59 smithi188 bash[23329]: cephadm 2020-07-16T14:24:57.618646+0000 mgr.x (mgr.34562) 2225 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:24:59.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:24:59 smithi188 bash[23329]: cephadm 2020-07-16T14:24:57.618902+0000 mgr.x (mgr.34562) 2226 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:24:59.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:24:59 smithi188 bash[23329]: cluster 2020-07-16T14:24:58.112999+0000 mgr.x (mgr.34562) 2227 : cluster [DBG] pgmap v1389: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:25:00.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:25:00 smithi188 bash[23329]: cluster 2020-07-16T14:25:00.113451+0000 mgr.x (mgr.34562) 2228 : cluster [DBG] pgmap v1390: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:25:01.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:25:00 smithi132 bash[27079]: cluster 2020-07-16T14:25:00.113451+0000 mgr.x (mgr.34562) 2228 : cluster [DBG] pgmap v1390: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:25:03.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:25:03 smithi132 bash[27079]: cluster 2020-07-16T14:25:02.113890+0000 mgr.x (mgr.34562) 2229 : cluster [DBG] pgmap v1391: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:25:03.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:25:03 smithi188 bash[23329]: cluster 2020-07-16T14:25:02.113890+0000 mgr.x (mgr.34562) 2229 : cluster [DBG] pgmap v1391: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:25:04.186 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:25:04.444 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:25:04.445 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (47m) 4m ago 50m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:25:04.445 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (50m) 4m ago 50m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:25:04.445 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (48m) 4m ago 53m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:25:04.446 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (47m) 4m ago 55m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:25:04.446 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 4m ago 55m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:25:04.446 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (53m) 4m ago 53m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:25:04.447 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (54m) 4m ago 54m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:25:04.447 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (51m) 4m ago 51m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:25:04.447 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (51m) 4m ago 51m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:25:04.447 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (53m) 4m ago 53m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:25:04.448 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (53m) 4m ago 53m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:25:04.448 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (52m) 4m ago 52m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:25:04.448 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (52m) 4m ago 52m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:25:04.449 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (52m) 4m ago 52m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:25:04.449 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (52m) 4m ago 52m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:25:04.449 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (51m) 4m ago 51m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:25:04.450 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (51m) 4m ago 51m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:25:04.450 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (50m) 4m ago 51m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:25:04.754 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:25:04.755 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:25:04.755 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:25:04.756 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:25:04.756 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:25:04.756 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:25:04.757 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:25:04.757 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:25:04.757 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:25:04.758 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:25:04.758 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:25:04.758 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:25:04.759 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:25:04.759 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:25:04.759 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:25:04.759 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:25:04.760 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:25:05.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:25:05 smithi132 bash[27079]: cluster 2020-07-16T14:25:04.114405+0000 mgr.x (mgr.34562) 2230 : cluster [DBG] pgmap v1392: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:25:05.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:25:05 smithi132 bash[27079]: audit 2020-07-16T14:25:04.173806+0000 mgr.x (mgr.34562) 2231 : audit [DBG] from='client.26260 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:25:05.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:25:05 smithi132 bash[27079]: audit 2020-07-16T14:25:04.753667+0000 mon.c (mon.1) 193 : audit [DBG] from='client.? 172.21.15.132:0/4266943274' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:25:05.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:25:05 smithi188 bash[23329]: cluster 2020-07-16T14:25:04.114405+0000 mgr.x (mgr.34562) 2230 : cluster [DBG] pgmap v1392: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:25:05.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:25:05 smithi188 bash[23329]: audit 2020-07-16T14:25:04.173806+0000 mgr.x (mgr.34562) 2231 : audit [DBG] from='client.26260 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:25:05.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:25:05 smithi188 bash[23329]: audit 2020-07-16T14:25:04.753667+0000 mon.c (mon.1) 193 : audit [DBG] from='client.? 172.21.15.132:0/4266943274' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:25:06.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:25:06 smithi132 bash[27079]: audit 2020-07-16T14:25:04.439854+0000 mgr.x (mgr.34562) 2232 : audit [DBG] from='client.26266 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:25:06.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:25:06 smithi188 bash[23329]: audit 2020-07-16T14:25:04.439854+0000 mgr.x (mgr.34562) 2232 : audit [DBG] from='client.26266 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:25:07.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:25:07 smithi132 bash[27079]: cluster 2020-07-16T14:25:06.114750+0000 mgr.x (mgr.34562) 2233 : cluster [DBG] pgmap v1393: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:25:07.796 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:25:07 smithi188 bash[23329]: cluster 2020-07-16T14:25:06.114750+0000 mgr.x (mgr.34562) 2233 : cluster [DBG] pgmap v1393: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:25:09.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:25:09 smithi132 bash[27079]: cluster 2020-07-16T14:25:08.115138+0000 mgr.x (mgr.34562) 2234 : cluster [DBG] pgmap v1394: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:25:09.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:25:09 smithi188 bash[23329]: cluster 2020-07-16T14:25:08.115138+0000 mgr.x (mgr.34562) 2234 : cluster [DBG] pgmap v1394: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:25:10.927 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:25:10 smithi188 bash[23329]: cluster 2020-07-16T14:25:10.115643+0000 mgr.x (mgr.34562) 2235 : cluster [DBG] pgmap v1395: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:25:11.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:25:10 smithi132 bash[27079]: cluster 2020-07-16T14:25:10.115643+0000 mgr.x (mgr.34562) 2235 : cluster [DBG] pgmap v1395: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:25:13.400 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:25:13 smithi132 bash[27079]: cluster 2020-07-16T14:25:12.116012+0000 mgr.x (mgr.34562) 2236 : cluster [DBG] pgmap v1396: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:25:13.400 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:25:13 smithi132 bash[27079]: audit 2020-07-16T14:25:12.622628+0000 mon.b (mon.2) 582 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:25:13.401 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:25:13 smithi132 bash[27079]: audit 2020-07-16T14:25:12.624006+0000 mon.b (mon.2) 583 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:25:13.401 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:25:13 smithi132 bash[27079]: audit 2020-07-16T14:25:12.625184+0000 mon.b (mon.2) 584 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:25:13.401 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:25:13 smithi132 bash[27079]: audit 2020-07-16T14:25:12.626675+0000 mon.b (mon.2) 585 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:25:13.401 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:25:13 smithi132 bash[27079]: audit 2020-07-16T14:25:12.627896+0000 mon.b (mon.2) 586 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:25:13.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:25:13 smithi188 bash[23329]: cluster 2020-07-16T14:25:12.116012+0000 mgr.x (mgr.34562) 2236 : cluster [DBG] pgmap v1396: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:25:13.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:25:13 smithi188 bash[23329]: audit 2020-07-16T14:25:12.622628+0000 mon.b (mon.2) 582 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:25:13.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:25:13 smithi188 bash[23329]: audit 2020-07-16T14:25:12.624006+0000 mon.b (mon.2) 583 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:25:13.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:25:13 smithi188 bash[23329]: audit 2020-07-16T14:25:12.625184+0000 mon.b (mon.2) 584 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:25:13.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:25:13 smithi188 bash[23329]: audit 2020-07-16T14:25:12.626675+0000 mon.b (mon.2) 585 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:25:13.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:25:13 smithi188 bash[23329]: audit 2020-07-16T14:25:12.627896+0000 mon.b (mon.2) 586 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:25:14.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:25:14 smithi132 bash[27079]: audit 2020-07-16T14:25:12.622978+0000 mgr.x (mgr.34562) 2237 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:25:14.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:25:14 smithi132 bash[27079]: audit 2020-07-16T14:25:12.624315+0000 mgr.x (mgr.34562) 2238 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:25:14.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:25:14 smithi132 bash[27079]: audit 2020-07-16T14:25:12.625458+0000 mgr.x (mgr.34562) 2239 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:25:14.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:25:14 smithi132 bash[27079]: cephadm 2020-07-16T14:25:12.626214+0000 mgr.x (mgr.34562) 2240 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:25:14.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:25:14 smithi132 bash[27079]: cephadm 2020-07-16T14:25:12.627599+0000 mgr.x (mgr.34562) 2241 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:25:14.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:25:14 smithi132 bash[27079]: cephadm 2020-07-16T14:25:12.628613+0000 mgr.x (mgr.34562) 2242 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:25:14.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:25:14 smithi132 bash[27079]: cephadm 2020-07-16T14:25:12.628809+0000 mgr.x (mgr.34562) 2243 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:25:14.676 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:25:14 smithi188 bash[23329]: audit 2020-07-16T14:25:12.622978+0000 mgr.x (mgr.34562) 2237 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:25:14.676 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:25:14 smithi188 bash[23329]: audit 2020-07-16T14:25:12.624315+0000 mgr.x (mgr.34562) 2238 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:25:14.677 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:25:14 smithi188 bash[23329]: audit 2020-07-16T14:25:12.625458+0000 mgr.x (mgr.34562) 2239 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:25:14.677 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:25:14 smithi188 bash[23329]: cephadm 2020-07-16T14:25:12.626214+0000 mgr.x (mgr.34562) 2240 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:25:14.677 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:25:14 smithi188 bash[23329]: cephadm 2020-07-16T14:25:12.627599+0000 mgr.x (mgr.34562) 2241 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:25:14.677 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:25:14 smithi188 bash[23329]: cephadm 2020-07-16T14:25:12.628613+0000 mgr.x (mgr.34562) 2242 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:25:14.678 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:25:14 smithi188 bash[23329]: cephadm 2020-07-16T14:25:12.628809+0000 mgr.x (mgr.34562) 2243 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:25:15.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:25:15 smithi132 bash[27079]: cluster 2020-07-16T14:25:14.116524+0000 mgr.x (mgr.34562) 2244 : cluster [DBG] pgmap v1397: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:25:15.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:25:15 smithi188 bash[23329]: cluster 2020-07-16T14:25:14.116524+0000 mgr.x (mgr.34562) 2244 : cluster [DBG] pgmap v1397: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:25:16.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:25:16 smithi132 bash[27079]: audit 2020-07-16T14:25:15.269910+0000 mon.b (mon.2) 587 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:25:16.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:25:16 smithi132 bash[27079]: cephadm 2020-07-16T14:25:15.270561+0000 mgr.x (mgr.34562) 2245 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:25:16.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:25:16 smithi132 bash[27079]: cephadm 2020-07-16T14:25:15.270782+0000 mgr.x (mgr.34562) 2246 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:25:16.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:25:16 smithi188 bash[23329]: audit 2020-07-16T14:25:15.269910+0000 mon.b (mon.2) 587 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:25:16.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:25:16 smithi188 bash[23329]: cephadm 2020-07-16T14:25:15.270561+0000 mgr.x (mgr.34562) 2245 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:25:16.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:25:16 smithi188 bash[23329]: cephadm 2020-07-16T14:25:15.270782+0000 mgr.x (mgr.34562) 2246 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:25:17.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:25:17 smithi132 bash[27079]: cluster 2020-07-16T14:25:16.117001+0000 mgr.x (mgr.34562) 2247 : cluster [DBG] pgmap v1398: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:25:17.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:25:17 smithi188 bash[23329]: cluster 2020-07-16T14:25:16.117001+0000 mgr.x (mgr.34562) 2247 : cluster [DBG] pgmap v1398: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:25:19.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:25:19 smithi132 bash[27079]: cluster 2020-07-16T14:25:18.117494+0000 mgr.x (mgr.34562) 2248 : cluster [DBG] pgmap v1399: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:25:19.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:25:19 smithi188 bash[23329]: cluster 2020-07-16T14:25:18.117494+0000 mgr.x (mgr.34562) 2248 : cluster [DBG] pgmap v1399: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:25:20.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:25:20 smithi188 bash[23329]: cluster 2020-07-16T14:25:20.117909+0000 mgr.x (mgr.34562) 2249 : cluster [DBG] pgmap v1400: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:25:21.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:25:20 smithi132 bash[27079]: cluster 2020-07-16T14:25:20.117909+0000 mgr.x (mgr.34562) 2249 : cluster [DBG] pgmap v1400: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:25:23.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:25:23 smithi132 bash[27079]: cluster 2020-07-16T14:25:22.118488+0000 mgr.x (mgr.34562) 2250 : cluster [DBG] pgmap v1401: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:25:23.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:25:23 smithi188 bash[23329]: cluster 2020-07-16T14:25:22.118488+0000 mgr.x (mgr.34562) 2250 : cluster [DBG] pgmap v1401: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:25:25.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:25:25 smithi132 bash[27079]: cluster 2020-07-16T14:25:24.118893+0000 mgr.x (mgr.34562) 2251 : cluster [DBG] pgmap v1402: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:25:25.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:25:25 smithi188 bash[23329]: cluster 2020-07-16T14:25:24.118893+0000 mgr.x (mgr.34562) 2251 : cluster [DBG] pgmap v1402: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:25:27.534 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:25:27 smithi132 bash[27079]: cluster 2020-07-16T14:25:26.119417+0000 mgr.x (mgr.34562) 2252 : cluster [DBG] pgmap v1403: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:25:27.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:25:27 smithi188 bash[23329]: cluster 2020-07-16T14:25:26.119417+0000 mgr.x (mgr.34562) 2252 : cluster [DBG] pgmap v1403: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:25:29.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:25:29 smithi132 bash[27079]: cluster 2020-07-16T14:25:28.119969+0000 mgr.x (mgr.34562) 2253 : cluster [DBG] pgmap v1404: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:25:29.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:25:29 smithi188 bash[23329]: cluster 2020-07-16T14:25:28.119969+0000 mgr.x (mgr.34562) 2253 : cluster [DBG] pgmap v1404: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:25:30.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:25:30 smithi188 bash[23329]: cluster 2020-07-16T14:25:30.120474+0000 mgr.x (mgr.34562) 2254 : cluster [DBG] pgmap v1405: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:25:30.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:25:30 smithi188 bash[23329]: audit 2020-07-16T14:25:30.286343+0000 mon.b (mon.2) 588 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:25:30.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:25:30 smithi188 bash[23329]: cephadm 2020-07-16T14:25:30.287091+0000 mgr.x (mgr.34562) 2255 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:25:30.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:25:30 smithi188 bash[23329]: cephadm 2020-07-16T14:25:30.287524+0000 mgr.x (mgr.34562) 2256 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:25:31.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:25:30 smithi132 bash[27079]: cluster 2020-07-16T14:25:30.120474+0000 mgr.x (mgr.34562) 2254 : cluster [DBG] pgmap v1405: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:25:31.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:25:30 smithi132 bash[27079]: audit 2020-07-16T14:25:30.286343+0000 mon.b (mon.2) 588 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:25:31.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:25:30 smithi132 bash[27079]: cephadm 2020-07-16T14:25:30.287091+0000 mgr.x (mgr.34562) 2255 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:25:31.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:25:30 smithi132 bash[27079]: cephadm 2020-07-16T14:25:30.287524+0000 mgr.x (mgr.34562) 2256 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:25:33.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:25:33 smithi132 bash[27079]: cluster 2020-07-16T14:25:32.120832+0000 mgr.x (mgr.34562) 2257 : cluster [DBG] pgmap v1406: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:25:33.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:25:33 smithi188 bash[23329]: cluster 2020-07-16T14:25:32.120832+0000 mgr.x (mgr.34562) 2257 : cluster [DBG] pgmap v1406: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:25:35.063 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:25:35.325 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:25:35.325 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (48m) 4m ago 51m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:25:35.325 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (51m) 4m ago 51m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:25:35.325 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (48m) 4m ago 54m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:25:35.326 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (48m) 4m ago 55m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:25:35.326 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 4m ago 56m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:25:35.326 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (54m) 4m ago 54m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:25:35.326 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (54m) 4m ago 54m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:25:35.326 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (51m) 4m ago 51m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:25:35.327 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (51m) 4m ago 51m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:25:35.327 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (53m) 4m ago 53m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:25:35.327 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (53m) 4m ago 53m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:25:35.327 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (53m) 4m ago 53m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:25:35.327 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (53m) 4m ago 53m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:25:35.328 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (52m) 4m ago 52m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:25:35.328 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (52m) 4m ago 52m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:25:35.328 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (52m) 4m ago 52m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:25:35.328 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (51m) 4m ago 51m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:25:35.328 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (50m) 4m ago 51m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:25:35.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:25:35 smithi132 bash[27079]: cluster 2020-07-16T14:25:34.121191+0000 mgr.x (mgr.34562) 2258 : cluster [DBG] pgmap v1407: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:25:35.622 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:25:35.622 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:25:35.623 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:25:35.623 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:25:35.623 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:25:35.623 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:25:35.623 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:25:35.624 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:25:35.624 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:25:35.624 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:25:35.624 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:25:35.624 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:25:35.625 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:25:35.625 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:25:35.625 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:25:35.625 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:25:35.625 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:25:35.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:25:35 smithi188 bash[23329]: cluster 2020-07-16T14:25:34.121191+0000 mgr.x (mgr.34562) 2258 : cluster [DBG] pgmap v1407: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:25:36.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:25:36 smithi132 bash[27079]: audit 2020-07-16T14:25:35.051332+0000 mgr.x (mgr.34562) 2259 : audit [DBG] from='client.26278 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:25:36.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:25:36 smithi132 bash[27079]: audit 2020-07-16T14:25:35.320160+0000 mgr.x (mgr.34562) 2260 : audit [DBG] from='client.26284 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:25:36.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:25:36 smithi132 bash[27079]: audit 2020-07-16T14:25:35.621395+0000 mon.c (mon.1) 194 : audit [DBG] from='client.? 172.21.15.132:0/3323997942' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:25:36.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:25:36 smithi188 bash[23329]: audit 2020-07-16T14:25:35.051332+0000 mgr.x (mgr.34562) 2259 : audit [DBG] from='client.26278 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:25:36.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:25:36 smithi188 bash[23329]: audit 2020-07-16T14:25:35.320160+0000 mgr.x (mgr.34562) 2260 : audit [DBG] from='client.26284 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:25:36.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:25:36 smithi188 bash[23329]: audit 2020-07-16T14:25:35.621395+0000 mon.c (mon.1) 194 : audit [DBG] from='client.? 172.21.15.132:0/3323997942' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:25:37.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:25:37 smithi132 bash[27079]: cluster 2020-07-16T14:25:36.121677+0000 mgr.x (mgr.34562) 2261 : cluster [DBG] pgmap v1408: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:25:37.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:25:37 smithi188 bash[23329]: cluster 2020-07-16T14:25:36.121677+0000 mgr.x (mgr.34562) 2261 : cluster [DBG] pgmap v1408: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:25:39.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:25:39 smithi132 bash[27079]: cluster 2020-07-16T14:25:38.122164+0000 mgr.x (mgr.34562) 2262 : cluster [DBG] pgmap v1409: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:25:39.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:25:39 smithi188 bash[23329]: cluster 2020-07-16T14:25:38.122164+0000 mgr.x (mgr.34562) 2262 : cluster [DBG] pgmap v1409: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:25:40.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:25:40 smithi188 bash[23329]: cluster 2020-07-16T14:25:40.122657+0000 mgr.x (mgr.34562) 2263 : cluster [DBG] pgmap v1410: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:25:41.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:25:40 smithi132 bash[27079]: cluster 2020-07-16T14:25:40.122657+0000 mgr.x (mgr.34562) 2263 : cluster [DBG] pgmap v1410: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:25:43.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:25:43 smithi132 bash[27079]: cluster 2020-07-16T14:25:42.123052+0000 mgr.x (mgr.34562) 2264 : cluster [DBG] pgmap v1411: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:25:43.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:25:43 smithi188 bash[23329]: cluster 2020-07-16T14:25:42.123052+0000 mgr.x (mgr.34562) 2264 : cluster [DBG] pgmap v1411: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:25:45.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:25:45 smithi132 bash[27079]: cluster 2020-07-16T14:25:44.123544+0000 mgr.x (mgr.34562) 2265 : cluster [DBG] pgmap v1412: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:25:45.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:25:45 smithi188 bash[23329]: cluster 2020-07-16T14:25:44.123544+0000 mgr.x (mgr.34562) 2265 : cluster [DBG] pgmap v1412: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:25:46.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:25:46 smithi132 bash[27079]: audit 2020-07-16T14:25:45.289828+0000 mon.b (mon.2) 589 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:25:46.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:25:46 smithi132 bash[27079]: cephadm 2020-07-16T14:25:45.290417+0000 mgr.x (mgr.34562) 2266 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:25:46.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:25:46 smithi132 bash[27079]: cephadm 2020-07-16T14:25:45.290614+0000 mgr.x (mgr.34562) 2267 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:25:46.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:25:46 smithi188 bash[23329]: audit 2020-07-16T14:25:45.289828+0000 mon.b (mon.2) 589 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:25:46.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:25:46 smithi188 bash[23329]: cephadm 2020-07-16T14:25:45.290417+0000 mgr.x (mgr.34562) 2266 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:25:46.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:25:46 smithi188 bash[23329]: cephadm 2020-07-16T14:25:45.290614+0000 mgr.x (mgr.34562) 2267 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:25:47.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:25:47 smithi132 bash[27079]: cluster 2020-07-16T14:25:46.124000+0000 mgr.x (mgr.34562) 2268 : cluster [DBG] pgmap v1413: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:25:47.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:25:47 smithi188 bash[23329]: cluster 2020-07-16T14:25:46.124000+0000 mgr.x (mgr.34562) 2268 : cluster [DBG] pgmap v1413: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:25:49.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:25:49 smithi132 bash[27079]: cluster 2020-07-16T14:25:48.124524+0000 mgr.x (mgr.34562) 2269 : cluster [DBG] pgmap v1414: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:25:49.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:25:49 smithi188 bash[23329]: cluster 2020-07-16T14:25:48.124524+0000 mgr.x (mgr.34562) 2269 : cluster [DBG] pgmap v1414: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:25:50.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:25:50 smithi188 bash[23329]: cluster 2020-07-16T14:25:50.124894+0000 mgr.x (mgr.34562) 2270 : cluster [DBG] pgmap v1415: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:25:51.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:25:50 smithi132 bash[27079]: cluster 2020-07-16T14:25:50.124894+0000 mgr.x (mgr.34562) 2270 : cluster [DBG] pgmap v1415: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:25:53.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:25:53 smithi132 bash[27079]: cluster 2020-07-16T14:25:52.125456+0000 mgr.x (mgr.34562) 2271 : cluster [DBG] pgmap v1416: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:25:53.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:25:53 smithi188 bash[23329]: cluster 2020-07-16T14:25:52.125456+0000 mgr.x (mgr.34562) 2271 : cluster [DBG] pgmap v1416: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:25:55.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:25:55 smithi132 bash[27079]: cluster 2020-07-16T14:25:54.125890+0000 mgr.x (mgr.34562) 2272 : cluster [DBG] pgmap v1417: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:25:55.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:25:55 smithi188 bash[23329]: cluster 2020-07-16T14:25:54.125890+0000 mgr.x (mgr.34562) 2272 : cluster [DBG] pgmap v1417: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:25:57.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:25:57 smithi132 bash[27079]: cluster 2020-07-16T14:25:56.126329+0000 mgr.x (mgr.34562) 2273 : cluster [DBG] pgmap v1418: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:25:57.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:25:57 smithi188 bash[23329]: cluster 2020-07-16T14:25:56.126329+0000 mgr.x (mgr.34562) 2273 : cluster [DBG] pgmap v1418: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:25:59.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:25:59 smithi132 bash[27079]: cluster 2020-07-16T14:25:58.126716+0000 mgr.x (mgr.34562) 2274 : cluster [DBG] pgmap v1419: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:25:59.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:25:59 smithi188 bash[23329]: cluster 2020-07-16T14:25:58.126716+0000 mgr.x (mgr.34562) 2274 : cluster [DBG] pgmap v1419: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:26:00.925 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:26:00 smithi188 bash[23329]: cluster 2020-07-16T14:26:00.127143+0000 mgr.x (mgr.34562) 2275 : cluster [DBG] pgmap v1420: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:26:00.926 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:26:00 smithi188 bash[23329]: audit 2020-07-16T14:26:00.306182+0000 mon.b (mon.2) 590 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:26:00.926 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:26:00 smithi188 bash[23329]: cephadm 2020-07-16T14:26:00.306926+0000 mgr.x (mgr.34562) 2276 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:26:00.926 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:26:00 smithi188 bash[23329]: cephadm 2020-07-16T14:26:00.307145+0000 mgr.x (mgr.34562) 2277 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:26:01.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:26:00 smithi132 bash[27079]: cluster 2020-07-16T14:26:00.127143+0000 mgr.x (mgr.34562) 2275 : cluster [DBG] pgmap v1420: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:26:01.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:26:00 smithi132 bash[27079]: audit 2020-07-16T14:26:00.306182+0000 mon.b (mon.2) 590 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:26:01.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:26:00 smithi132 bash[27079]: cephadm 2020-07-16T14:26:00.306926+0000 mgr.x (mgr.34562) 2276 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:26:01.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:26:00 smithi132 bash[27079]: cephadm 2020-07-16T14:26:00.307145+0000 mgr.x (mgr.34562) 2277 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:26:03.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:26:03 smithi132 bash[27079]: cluster 2020-07-16T14:26:02.127568+0000 mgr.x (mgr.34562) 2278 : cluster [DBG] pgmap v1421: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:26:03.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:26:03 smithi188 bash[23329]: cluster 2020-07-16T14:26:02.127568+0000 mgr.x (mgr.34562) 2278 : cluster [DBG] pgmap v1421: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:26:05.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:26:05 smithi132 bash[27079]: cluster 2020-07-16T14:26:04.127891+0000 mgr.x (mgr.34562) 2279 : cluster [DBG] pgmap v1422: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:26:05.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:26:05 smithi188 bash[23329]: cluster 2020-07-16T14:26:04.127891+0000 mgr.x (mgr.34562) 2279 : cluster [DBG] pgmap v1422: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:26:05.920 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:26:06.180 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:26:06.181 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (48m) 5m ago 51m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:26:06.181 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (51m) 5m ago 51m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:26:06.181 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (49m) 5m ago 54m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:26:06.181 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (48m) 5m ago 56m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:26:06.182 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 5m ago 56m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:26:06.182 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (54m) 5m ago 54m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:26:06.182 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (55m) 5m ago 55m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:26:06.182 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (52m) 5m ago 52m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:26:06.182 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (52m) 5m ago 52m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:26:06.183 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (54m) 5m ago 54m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:26:06.183 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (54m) 5m ago 54m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:26:06.183 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (53m) 5m ago 53m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:26:06.183 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (53m) 5m ago 53m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:26:06.183 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (53m) 5m ago 53m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:26:06.184 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (53m) 5m ago 53m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:26:06.184 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (52m) 5m ago 52m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:26:06.184 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (52m) 5m ago 52m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:26:06.184 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (51m) 5m ago 52m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:26:06.478 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:26:06.479 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:26:06.479 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:26:06.480 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:26:06.480 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:26:06.480 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:26:06.480 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:26:06.480 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:26:06.481 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:26:06.481 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:26:06.481 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:26:06.486 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:26:06.486 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:26:06.487 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:26:06.487 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:26:06.487 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:26:06.487 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:26:07.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:26:07 smithi132 bash[27079]: audit 2020-07-16T14:26:05.908560+0000 mgr.x (mgr.34562) 2280 : audit [DBG] from='client.26296 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:26:07.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:26:07 smithi132 bash[27079]: cluster 2020-07-16T14:26:06.128299+0000 mgr.x (mgr.34562) 2281 : cluster [DBG] pgmap v1423: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:26:07.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:26:07 smithi132 bash[27079]: audit 2020-07-16T14:26:06.176280+0000 mgr.x (mgr.34562) 2282 : audit [DBG] from='client.26302 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:26:07.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:26:07 smithi132 bash[27079]: audit 2020-07-16T14:26:06.477397+0000 mon.c (mon.1) 195 : audit [DBG] from='client.? 172.21.15.132:0/1985599950' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:26:07.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:26:07 smithi188 bash[23329]: audit 2020-07-16T14:26:05.908560+0000 mgr.x (mgr.34562) 2280 : audit [DBG] from='client.26296 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:26:07.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:26:07 smithi188 bash[23329]: cluster 2020-07-16T14:26:06.128299+0000 mgr.x (mgr.34562) 2281 : cluster [DBG] pgmap v1423: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:26:07.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:26:07 smithi188 bash[23329]: audit 2020-07-16T14:26:06.176280+0000 mgr.x (mgr.34562) 2282 : audit [DBG] from='client.26302 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:26:07.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:26:07 smithi188 bash[23329]: audit 2020-07-16T14:26:06.477397+0000 mon.c (mon.1) 195 : audit [DBG] from='client.? 172.21.15.132:0/1985599950' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:26:09.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:26:09 smithi132 bash[27079]: cluster 2020-07-16T14:26:08.128819+0000 mgr.x (mgr.34562) 2283 : cluster [DBG] pgmap v1424: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:26:09.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:26:09 smithi188 bash[23329]: cluster 2020-07-16T14:26:08.128819+0000 mgr.x (mgr.34562) 2283 : cluster [DBG] pgmap v1424: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:26:10.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:26:10 smithi188 bash[23329]: cluster 2020-07-16T14:26:10.129180+0000 mgr.x (mgr.34562) 2284 : cluster [DBG] pgmap v1425: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:26:11.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:26:10 smithi132 bash[27079]: cluster 2020-07-16T14:26:10.129180+0000 mgr.x (mgr.34562) 2284 : cluster [DBG] pgmap v1425: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:26:13.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:26:13 smithi132 bash[27079]: cluster 2020-07-16T14:26:12.129676+0000 mgr.x (mgr.34562) 2285 : cluster [DBG] pgmap v1426: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:26:13.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:26:13 smithi188 bash[23329]: cluster 2020-07-16T14:26:12.129676+0000 mgr.x (mgr.34562) 2285 : cluster [DBG] pgmap v1426: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:26:15.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:26:15 smithi132 bash[27079]: cluster 2020-07-16T14:26:14.130033+0000 mgr.x (mgr.34562) 2286 : cluster [DBG] pgmap v1427: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:26:15.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:26:15 smithi188 bash[23329]: cluster 2020-07-16T14:26:14.130033+0000 mgr.x (mgr.34562) 2286 : cluster [DBG] pgmap v1427: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:26:16.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:26:16 smithi132 bash[27079]: audit 2020-07-16T14:26:15.322449+0000 mon.b (mon.2) 591 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:26:16.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:26:16 smithi132 bash[27079]: audit 2020-07-16T14:26:15.322850+0000 mgr.x (mgr.34562) 2287 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:26:16.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:26:16 smithi132 bash[27079]: audit 2020-07-16T14:26:15.323841+0000 mon.b (mon.2) 592 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:26:16.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:26:16 smithi132 bash[27079]: audit 2020-07-16T14:26:15.324175+0000 mgr.x (mgr.34562) 2288 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:26:16.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:26:16 smithi132 bash[27079]: audit 2020-07-16T14:26:15.325022+0000 mon.b (mon.2) 593 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:26:16.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:26:16 smithi132 bash[27079]: audit 2020-07-16T14:26:15.325306+0000 mgr.x (mgr.34562) 2289 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:26:16.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:26:16 smithi132 bash[27079]: cephadm 2020-07-16T14:26:15.326047+0000 mgr.x (mgr.34562) 2290 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:26:16.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:26:16 smithi132 bash[27079]: audit 2020-07-16T14:26:15.326325+0000 mon.b (mon.2) 594 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:26:16.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:26:16 smithi132 bash[27079]: cephadm 2020-07-16T14:26:15.327210+0000 mgr.x (mgr.34562) 2291 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:26:16.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:26:16 smithi132 bash[27079]: audit 2020-07-16T14:26:15.327554+0000 mon.b (mon.2) 595 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:26:16.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:26:16 smithi132 bash[27079]: cephadm 2020-07-16T14:26:15.328269+0000 mgr.x (mgr.34562) 2292 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:26:16.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:26:16 smithi132 bash[27079]: cephadm 2020-07-16T14:26:15.328476+0000 mgr.x (mgr.34562) 2293 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:26:16.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:26:16 smithi188 bash[23329]: audit 2020-07-16T14:26:15.322449+0000 mon.b (mon.2) 591 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:26:16.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:26:16 smithi188 bash[23329]: audit 2020-07-16T14:26:15.322850+0000 mgr.x (mgr.34562) 2287 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:26:16.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:26:16 smithi188 bash[23329]: audit 2020-07-16T14:26:15.323841+0000 mon.b (mon.2) 592 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:26:16.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:26:16 smithi188 bash[23329]: audit 2020-07-16T14:26:15.324175+0000 mgr.x (mgr.34562) 2288 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:26:16.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:26:16 smithi188 bash[23329]: audit 2020-07-16T14:26:15.325022+0000 mon.b (mon.2) 593 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:26:16.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:26:16 smithi188 bash[23329]: audit 2020-07-16T14:26:15.325306+0000 mgr.x (mgr.34562) 2289 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:26:16.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:26:16 smithi188 bash[23329]: cephadm 2020-07-16T14:26:15.326047+0000 mgr.x (mgr.34562) 2290 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:26:16.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:26:16 smithi188 bash[23329]: audit 2020-07-16T14:26:15.326325+0000 mon.b (mon.2) 594 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:26:16.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:26:16 smithi188 bash[23329]: cephadm 2020-07-16T14:26:15.327210+0000 mgr.x (mgr.34562) 2291 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:26:16.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:26:16 smithi188 bash[23329]: audit 2020-07-16T14:26:15.327554+0000 mon.b (mon.2) 595 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:26:16.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:26:16 smithi188 bash[23329]: cephadm 2020-07-16T14:26:15.328269+0000 mgr.x (mgr.34562) 2292 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:26:16.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:26:16 smithi188 bash[23329]: cephadm 2020-07-16T14:26:15.328476+0000 mgr.x (mgr.34562) 2293 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:26:17.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:26:17 smithi132 bash[27079]: cluster 2020-07-16T14:26:16.130520+0000 mgr.x (mgr.34562) 2294 : cluster [DBG] pgmap v1428: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:26:17.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:26:17 smithi188 bash[23329]: cluster 2020-07-16T14:26:16.130520+0000 mgr.x (mgr.34562) 2294 : cluster [DBG] pgmap v1428: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:26:19.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:26:19 smithi132 bash[27079]: cluster 2020-07-16T14:26:18.130964+0000 mgr.x (mgr.34562) 2295 : cluster [DBG] pgmap v1429: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:26:19.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:26:19 smithi132 bash[27079]: audit 2020-07-16T14:26:18.246810+0000 mon.b (mon.2) 596 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:26:19.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:26:19 smithi132 bash[27079]: cephadm 2020-07-16T14:26:18.247433+0000 mgr.x (mgr.34562) 2296 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:26:19.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:26:19 smithi132 bash[27079]: cephadm 2020-07-16T14:26:18.247886+0000 mgr.x (mgr.34562) 2297 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:26:19.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:26:19 smithi188 bash[23329]: cluster 2020-07-16T14:26:18.130964+0000 mgr.x (mgr.34562) 2295 : cluster [DBG] pgmap v1429: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:26:19.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:26:19 smithi188 bash[23329]: audit 2020-07-16T14:26:18.246810+0000 mon.b (mon.2) 596 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:26:19.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:26:19 smithi188 bash[23329]: cephadm 2020-07-16T14:26:18.247433+0000 mgr.x (mgr.34562) 2296 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:26:19.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:26:19 smithi188 bash[23329]: cephadm 2020-07-16T14:26:18.247886+0000 mgr.x (mgr.34562) 2297 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:26:20.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:26:20 smithi188 bash[23329]: cluster 2020-07-16T14:26:20.131447+0000 mgr.x (mgr.34562) 2298 : cluster [DBG] pgmap v1430: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:26:21.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:26:20 smithi132 bash[27079]: cluster 2020-07-16T14:26:20.131447+0000 mgr.x (mgr.34562) 2298 : cluster [DBG] pgmap v1430: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:26:23.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:26:23 smithi132 bash[27079]: cluster 2020-07-16T14:26:22.131852+0000 mgr.x (mgr.34562) 2299 : cluster [DBG] pgmap v1431: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:26:23.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:26:23 smithi188 bash[23329]: cluster 2020-07-16T14:26:22.131852+0000 mgr.x (mgr.34562) 2299 : cluster [DBG] pgmap v1431: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:26:25.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:26:25 smithi132 bash[27079]: cluster 2020-07-16T14:26:24.132245+0000 mgr.x (mgr.34562) 2300 : cluster [DBG] pgmap v1432: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:26:25.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:26:25 smithi188 bash[23329]: cluster 2020-07-16T14:26:24.132245+0000 mgr.x (mgr.34562) 2300 : cluster [DBG] pgmap v1432: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:26:27.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:26:27 smithi132 bash[27079]: cluster 2020-07-16T14:26:26.132671+0000 mgr.x (mgr.34562) 2301 : cluster [DBG] pgmap v1433: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:26:27.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:26:27 smithi188 bash[23329]: cluster 2020-07-16T14:26:26.132671+0000 mgr.x (mgr.34562) 2301 : cluster [DBG] pgmap v1433: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:26:29.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:26:29 smithi132 bash[27079]: cluster 2020-07-16T14:26:28.133073+0000 mgr.x (mgr.34562) 2302 : cluster [DBG] pgmap v1434: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:26:29.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:26:29 smithi188 bash[23329]: cluster 2020-07-16T14:26:28.133073+0000 mgr.x (mgr.34562) 2302 : cluster [DBG] pgmap v1434: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:26:30.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:26:30 smithi188 bash[23329]: cluster 2020-07-16T14:26:30.133617+0000 mgr.x (mgr.34562) 2303 : cluster [DBG] pgmap v1435: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:26:31.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:26:30 smithi132 bash[27079]: cluster 2020-07-16T14:26:30.133617+0000 mgr.x (mgr.34562) 2303 : cluster [DBG] pgmap v1435: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:26:33.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:26:33 smithi132 bash[27079]: cluster 2020-07-16T14:26:32.134081+0000 mgr.x (mgr.34562) 2304 : cluster [DBG] pgmap v1436: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:26:33.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:26:33 smithi188 bash[23329]: cluster 2020-07-16T14:26:32.134081+0000 mgr.x (mgr.34562) 2304 : cluster [DBG] pgmap v1436: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:26:34.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:26:34 smithi132 bash[27079]: audit 2020-07-16T14:26:33.263397+0000 mon.b (mon.2) 597 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:26:34.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:26:34 smithi132 bash[27079]: cephadm 2020-07-16T14:26:33.264102+0000 mgr.x (mgr.34562) 2305 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:26:34.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:26:34 smithi132 bash[27079]: cephadm 2020-07-16T14:26:33.264263+0000 mgr.x (mgr.34562) 2306 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:26:34.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:26:34 smithi188 bash[23329]: audit 2020-07-16T14:26:33.263397+0000 mon.b (mon.2) 597 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:26:34.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:26:34 smithi188 bash[23329]: cephadm 2020-07-16T14:26:33.264102+0000 mgr.x (mgr.34562) 2305 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:26:34.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:26:34 smithi188 bash[23329]: cephadm 2020-07-16T14:26:33.264263+0000 mgr.x (mgr.34562) 2306 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:26:35.542 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:26:35 smithi132 bash[27079]: cluster 2020-07-16T14:26:34.134451+0000 mgr.x (mgr.34562) 2307 : cluster [DBG] pgmap v1437: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:26:35.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:26:35 smithi188 bash[23329]: cluster 2020-07-16T14:26:34.134451+0000 mgr.x (mgr.34562) 2307 : cluster [DBG] pgmap v1437: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:26:36.777 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:26:37.040 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:26:37.040 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (49m) 5m ago 52m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:26:37.040 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (52m) 5m ago 52m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:26:37.040 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (49m) 5m ago 55m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:26:37.041 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (49m) 5m ago 56m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:26:37.041 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 5m ago 57m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:26:37.041 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (55m) 5m ago 55m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:26:37.041 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (55m) 5m ago 55m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:26:37.041 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (52m) 5m ago 52m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:26:37.042 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (52m) 5m ago 52m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:26:37.042 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (54m) 5m ago 54m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:26:37.042 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (54m) 5m ago 54m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:26:37.042 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (54m) 5m ago 54m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:26:37.042 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (54m) 5m ago 54m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:26:37.043 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (53m) 5m ago 53m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:26:37.043 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (53m) 5m ago 53m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:26:37.043 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (53m) 5m ago 53m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:26:37.043 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (52m) 5m ago 53m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:26:37.043 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (51m) 5m ago 52m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:26:37.340 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:26:37.340 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:26:37.340 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:26:37.340 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:26:37.341 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:26:37.341 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:26:37.341 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:26:37.341 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:26:37.341 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:26:37.341 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:26:37.342 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:26:37.342 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:26:37.342 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:26:37.342 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:26:37.342 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:26:37.343 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:26:37.343 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:26:37.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:26:37 smithi132 bash[27079]: cluster 2020-07-16T14:26:36.134868+0000 mgr.x (mgr.34562) 2308 : cluster [DBG] pgmap v1438: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:26:37.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:26:37 smithi188 bash[23329]: cluster 2020-07-16T14:26:36.134868+0000 mgr.x (mgr.34562) 2308 : cluster [DBG] pgmap v1438: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:26:38.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:26:38 smithi132 bash[27079]: audit 2020-07-16T14:26:36.765322+0000 mgr.x (mgr.34562) 2309 : audit [DBG] from='client.26314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:26:38.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:26:38 smithi132 bash[27079]: audit 2020-07-16T14:26:37.035168+0000 mgr.x (mgr.34562) 2310 : audit [DBG] from='client.26320 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:26:38.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:26:38 smithi132 bash[27079]: audit 2020-07-16T14:26:37.338992+0000 mon.c (mon.1) 196 : audit [DBG] from='client.? 172.21.15.132:0/1980877508' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:26:38.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:26:38 smithi188 bash[23329]: audit 2020-07-16T14:26:36.765322+0000 mgr.x (mgr.34562) 2309 : audit [DBG] from='client.26314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:26:38.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:26:38 smithi188 bash[23329]: audit 2020-07-16T14:26:37.035168+0000 mgr.x (mgr.34562) 2310 : audit [DBG] from='client.26320 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:26:38.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:26:38 smithi188 bash[23329]: audit 2020-07-16T14:26:37.338992+0000 mon.c (mon.1) 196 : audit [DBG] from='client.? 172.21.15.132:0/1980877508' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:26:39.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:26:39 smithi132 bash[27079]: cluster 2020-07-16T14:26:38.135344+0000 mgr.x (mgr.34562) 2311 : cluster [DBG] pgmap v1439: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:26:39.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:26:39 smithi188 bash[23329]: cluster 2020-07-16T14:26:38.135344+0000 mgr.x (mgr.34562) 2311 : cluster [DBG] pgmap v1439: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:26:40.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:26:40 smithi188 bash[23329]: cluster 2020-07-16T14:26:40.135741+0000 mgr.x (mgr.34562) 2312 : cluster [DBG] pgmap v1440: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:26:41.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:26:40 smithi132 bash[27079]: cluster 2020-07-16T14:26:40.135741+0000 mgr.x (mgr.34562) 2312 : cluster [DBG] pgmap v1440: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:26:43.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:26:43 smithi132 bash[27079]: cluster 2020-07-16T14:26:42.136260+0000 mgr.x (mgr.34562) 2313 : cluster [DBG] pgmap v1441: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:26:43.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:26:43 smithi188 bash[23329]: cluster 2020-07-16T14:26:42.136260+0000 mgr.x (mgr.34562) 2313 : cluster [DBG] pgmap v1441: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:26:45.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:26:45 smithi132 bash[27079]: cluster 2020-07-16T14:26:44.136717+0000 mgr.x (mgr.34562) 2314 : cluster [DBG] pgmap v1442: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:26:45.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:26:45 smithi188 bash[23329]: cluster 2020-07-16T14:26:44.136717+0000 mgr.x (mgr.34562) 2314 : cluster [DBG] pgmap v1442: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:26:47.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:26:47 smithi132 bash[27079]: cluster 2020-07-16T14:26:46.137193+0000 mgr.x (mgr.34562) 2315 : cluster [DBG] pgmap v1443: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:26:47.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:26:47 smithi188 bash[23329]: cluster 2020-07-16T14:26:46.137193+0000 mgr.x (mgr.34562) 2315 : cluster [DBG] pgmap v1443: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:26:49.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:26:49 smithi132 bash[27079]: cluster 2020-07-16T14:26:48.137633+0000 mgr.x (mgr.34562) 2316 : cluster [DBG] pgmap v1444: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:26:49.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:26:49 smithi132 bash[27079]: audit 2020-07-16T14:26:48.280122+0000 mon.b (mon.2) 598 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:26:49.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:26:49 smithi132 bash[27079]: cephadm 2020-07-16T14:26:48.280834+0000 mgr.x (mgr.34562) 2317 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:26:49.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:26:49 smithi132 bash[27079]: cephadm 2020-07-16T14:26:48.281253+0000 mgr.x (mgr.34562) 2318 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:26:49.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:26:49 smithi188 bash[23329]: cluster 2020-07-16T14:26:48.137633+0000 mgr.x (mgr.34562) 2316 : cluster [DBG] pgmap v1444: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:26:49.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:26:49 smithi188 bash[23329]: audit 2020-07-16T14:26:48.280122+0000 mon.b (mon.2) 598 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:26:49.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:26:49 smithi188 bash[23329]: cephadm 2020-07-16T14:26:48.280834+0000 mgr.x (mgr.34562) 2317 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:26:49.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:26:49 smithi188 bash[23329]: cephadm 2020-07-16T14:26:48.281253+0000 mgr.x (mgr.34562) 2318 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:26:50.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:26:50 smithi188 bash[23329]: cluster 2020-07-16T14:26:50.138137+0000 mgr.x (mgr.34562) 2319 : cluster [DBG] pgmap v1445: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:26:51.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:26:50 smithi132 bash[27079]: cluster 2020-07-16T14:26:50.138137+0000 mgr.x (mgr.34562) 2319 : cluster [DBG] pgmap v1445: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:26:53.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:26:53 smithi132 bash[27079]: cluster 2020-07-16T14:26:52.138579+0000 mgr.x (mgr.34562) 2320 : cluster [DBG] pgmap v1446: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:26:53.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:26:53 smithi188 bash[23329]: cluster 2020-07-16T14:26:52.138579+0000 mgr.x (mgr.34562) 2320 : cluster [DBG] pgmap v1446: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:26:55.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:26:55 smithi132 bash[27079]: cluster 2020-07-16T14:26:54.139035+0000 mgr.x (mgr.34562) 2321 : cluster [DBG] pgmap v1447: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:26:55.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:26:55 smithi188 bash[23329]: cluster 2020-07-16T14:26:54.139035+0000 mgr.x (mgr.34562) 2321 : cluster [DBG] pgmap v1447: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:26:57.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:26:57 smithi132 bash[27079]: cluster 2020-07-16T14:26:56.139499+0000 mgr.x (mgr.34562) 2322 : cluster [DBG] pgmap v1448: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:26:57.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:26:57 smithi188 bash[23329]: cluster 2020-07-16T14:26:56.139499+0000 mgr.x (mgr.34562) 2322 : cluster [DBG] pgmap v1448: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:26:59.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:26:59 smithi132 bash[27079]: cluster 2020-07-16T14:26:58.139966+0000 mgr.x (mgr.34562) 2323 : cluster [DBG] pgmap v1449: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:26:59.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:26:59 smithi188 bash[23329]: cluster 2020-07-16T14:26:58.139966+0000 mgr.x (mgr.34562) 2323 : cluster [DBG] pgmap v1449: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:27:00.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:27:00 smithi188 bash[23329]: cluster 2020-07-16T14:27:00.140346+0000 mgr.x (mgr.34562) 2324 : cluster [DBG] pgmap v1450: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:27:01.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:27:00 smithi132 bash[27079]: cluster 2020-07-16T14:27:00.140346+0000 mgr.x (mgr.34562) 2324 : cluster [DBG] pgmap v1450: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:27:03.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:27:03 smithi132 bash[27079]: cluster 2020-07-16T14:27:02.140722+0000 mgr.x (mgr.34562) 2325 : cluster [DBG] pgmap v1451: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:27:03.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:27:03 smithi188 bash[23329]: cluster 2020-07-16T14:27:02.140722+0000 mgr.x (mgr.34562) 2325 : cluster [DBG] pgmap v1451: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:27:04.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:27:04 smithi132 bash[27079]: audit 2020-07-16T14:27:03.282703+0000 mon.b (mon.2) 599 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:27:04.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:27:04 smithi132 bash[27079]: cephadm 2020-07-16T14:27:03.283425+0000 mgr.x (mgr.34562) 2326 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:27:04.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:27:04 smithi132 bash[27079]: cephadm 2020-07-16T14:27:03.283847+0000 mgr.x (mgr.34562) 2327 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:27:04.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:27:04 smithi188 bash[23329]: audit 2020-07-16T14:27:03.282703+0000 mon.b (mon.2) 599 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:27:04.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:27:04 smithi188 bash[23329]: cephadm 2020-07-16T14:27:03.283425+0000 mgr.x (mgr.34562) 2326 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:27:04.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:27:04 smithi188 bash[23329]: cephadm 2020-07-16T14:27:03.283847+0000 mgr.x (mgr.34562) 2327 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:27:05.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:27:05 smithi132 bash[27079]: cluster 2020-07-16T14:27:04.141204+0000 mgr.x (mgr.34562) 2328 : cluster [DBG] pgmap v1452: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:27:05.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:27:05 smithi188 bash[23329]: cluster 2020-07-16T14:27:04.141204+0000 mgr.x (mgr.34562) 2328 : cluster [DBG] pgmap v1452: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:27:07.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:27:07 smithi132 bash[27079]: cluster 2020-07-16T14:27:06.141631+0000 mgr.x (mgr.34562) 2329 : cluster [DBG] pgmap v1453: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:27:07.640 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:27:07.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:27:07 smithi188 bash[23329]: cluster 2020-07-16T14:27:06.141631+0000 mgr.x (mgr.34562) 2329 : cluster [DBG] pgmap v1453: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:27:07.899 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:27:07.899 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (49m) 6m ago 52m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:27:07.899 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (52m) 6m ago 52m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:27:07.900 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (50m) 6m ago 55m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:27:07.900 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (49m) 6m ago 57m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:27:07.900 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 6m ago 57m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:27:07.900 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (55m) 6m ago 55m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:27:07.900 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (56m) 6m ago 56m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:27:07.901 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (53m) 6m ago 53m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:27:07.901 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (53m) 6m ago 53m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:27:07.901 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (55m) 6m ago 55m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:27:07.901 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (55m) 6m ago 55m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:27:07.901 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (54m) 6m ago 54m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:27:07.902 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (54m) 6m ago 54m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:27:07.902 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (54m) 6m ago 54m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:27:07.902 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (54m) 6m ago 54m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:27:07.902 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (53m) 6m ago 53m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:27:07.902 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (53m) 6m ago 53m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:27:07.903 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (52m) 6m ago 53m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:27:08.196 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:27:08.196 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:27:08.196 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:27:08.197 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:27:08.197 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:27:08.197 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:27:08.197 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:27:08.197 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:27:08.198 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:27:08.198 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:27:08.198 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:27:08.198 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:27:08.199 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:27:08.199 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:27:08.199 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:27:08.199 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:27:08.199 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:27:08.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:27:08 smithi132 bash[27079]: audit 2020-07-16T14:27:08.195049+0000 mon.c (mon.1) 197 : audit [DBG] from='client.? 172.21.15.132:0/2687962252' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:27:08.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:27:08 smithi188 bash[23329]: audit 2020-07-16T14:27:08.195049+0000 mon.c (mon.1) 197 : audit [DBG] from='client.? 172.21.15.132:0/2687962252' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:27:09.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:27:09 smithi132 bash[27079]: audit 2020-07-16T14:27:07.628738+0000 mgr.x (mgr.34562) 2330 : audit [DBG] from='client.26332 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:27:09.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:27:09 smithi132 bash[27079]: audit 2020-07-16T14:27:07.894751+0000 mgr.x (mgr.34562) 2331 : audit [DBG] from='client.26338 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:27:09.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:27:09 smithi132 bash[27079]: cluster 2020-07-16T14:27:08.142026+0000 mgr.x (mgr.34562) 2332 : cluster [DBG] pgmap v1454: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:27:09.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:27:09 smithi188 bash[23329]: audit 2020-07-16T14:27:07.628738+0000 mgr.x (mgr.34562) 2330 : audit [DBG] from='client.26332 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:27:09.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:27:09 smithi188 bash[23329]: audit 2020-07-16T14:27:07.894751+0000 mgr.x (mgr.34562) 2331 : audit [DBG] from='client.26338 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:27:09.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:27:09 smithi188 bash[23329]: cluster 2020-07-16T14:27:08.142026+0000 mgr.x (mgr.34562) 2332 : cluster [DBG] pgmap v1454: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:27:10.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:27:10 smithi188 bash[23329]: cluster 2020-07-16T14:27:10.142536+0000 mgr.x (mgr.34562) 2333 : cluster [DBG] pgmap v1455: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:27:11.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:27:10 smithi132 bash[27079]: cluster 2020-07-16T14:27:10.142536+0000 mgr.x (mgr.34562) 2333 : cluster [DBG] pgmap v1455: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:27:13.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:27:13 smithi132 bash[27079]: cluster 2020-07-16T14:27:12.143075+0000 mgr.x (mgr.34562) 2334 : cluster [DBG] pgmap v1456: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:27:13.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:27:13 smithi188 bash[23329]: cluster 2020-07-16T14:27:12.143075+0000 mgr.x (mgr.34562) 2334 : cluster [DBG] pgmap v1456: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:27:15.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:27:15 smithi132 bash[27079]: cluster 2020-07-16T14:27:14.143533+0000 mgr.x (mgr.34562) 2335 : cluster [DBG] pgmap v1457: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:27:15.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:27:15 smithi188 bash[23329]: cluster 2020-07-16T14:27:14.143533+0000 mgr.x (mgr.34562) 2335 : cluster [DBG] pgmap v1457: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:27:17.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:27:17 smithi132 bash[27079]: cluster 2020-07-16T14:27:16.143963+0000 mgr.x (mgr.34562) 2336 : cluster [DBG] pgmap v1458: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:27:17.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:27:17 smithi188 bash[23329]: cluster 2020-07-16T14:27:16.143963+0000 mgr.x (mgr.34562) 2336 : cluster [DBG] pgmap v1458: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:27:19.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:27:19 smithi132 bash[27079]: cluster 2020-07-16T14:27:18.144373+0000 mgr.x (mgr.34562) 2337 : cluster [DBG] pgmap v1459: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:27:19.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:27:19 smithi132 bash[27079]: audit 2020-07-16T14:27:18.299605+0000 mon.b (mon.2) 600 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:27:19.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:27:19 smithi132 bash[27079]: audit 2020-07-16T14:27:18.300081+0000 mgr.x (mgr.34562) 2338 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:27:19.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:27:19 smithi132 bash[27079]: audit 2020-07-16T14:27:18.301122+0000 mon.b (mon.2) 601 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:27:19.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:27:19 smithi132 bash[27079]: audit 2020-07-16T14:27:18.301426+0000 mgr.x (mgr.34562) 2339 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:27:19.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:27:19 smithi132 bash[27079]: audit 2020-07-16T14:27:18.302219+0000 mon.b (mon.2) 602 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:27:19.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:27:19 smithi132 bash[27079]: audit 2020-07-16T14:27:18.302549+0000 mgr.x (mgr.34562) 2340 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:27:19.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:27:19 smithi132 bash[27079]: cephadm 2020-07-16T14:27:18.303243+0000 mgr.x (mgr.34562) 2341 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:27:19.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:27:19 smithi132 bash[27079]: audit 2020-07-16T14:27:18.303527+0000 mon.b (mon.2) 603 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:27:19.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:27:19 smithi132 bash[27079]: cephadm 2020-07-16T14:27:18.304312+0000 mgr.x (mgr.34562) 2342 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:27:19.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:27:19 smithi132 bash[27079]: audit 2020-07-16T14:27:18.304635+0000 mon.b (mon.2) 604 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:27:19.532 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:27:19 smithi132 bash[27079]: cephadm 2020-07-16T14:27:18.305364+0000 mgr.x (mgr.34562) 2343 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:27:19.532 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:27:19 smithi132 bash[27079]: cephadm 2020-07-16T14:27:18.305535+0000 mgr.x (mgr.34562) 2344 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:27:19.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:27:19 smithi188 bash[23329]: cluster 2020-07-16T14:27:18.144373+0000 mgr.x (mgr.34562) 2337 : cluster [DBG] pgmap v1459: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:27:19.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:27:19 smithi188 bash[23329]: audit 2020-07-16T14:27:18.299605+0000 mon.b (mon.2) 600 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:27:19.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:27:19 smithi188 bash[23329]: audit 2020-07-16T14:27:18.300081+0000 mgr.x (mgr.34562) 2338 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:27:19.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:27:19 smithi188 bash[23329]: audit 2020-07-16T14:27:18.301122+0000 mon.b (mon.2) 601 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:27:19.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:27:19 smithi188 bash[23329]: audit 2020-07-16T14:27:18.301426+0000 mgr.x (mgr.34562) 2339 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:27:19.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:27:19 smithi188 bash[23329]: audit 2020-07-16T14:27:18.302219+0000 mon.b (mon.2) 602 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:27:19.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:27:19 smithi188 bash[23329]: audit 2020-07-16T14:27:18.302549+0000 mgr.x (mgr.34562) 2340 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:27:19.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:27:19 smithi188 bash[23329]: cephadm 2020-07-16T14:27:18.303243+0000 mgr.x (mgr.34562) 2341 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:27:19.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:27:19 smithi188 bash[23329]: audit 2020-07-16T14:27:18.303527+0000 mon.b (mon.2) 603 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:27:19.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:27:19 smithi188 bash[23329]: cephadm 2020-07-16T14:27:18.304312+0000 mgr.x (mgr.34562) 2342 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:27:19.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:27:19 smithi188 bash[23329]: audit 2020-07-16T14:27:18.304635+0000 mon.b (mon.2) 604 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:27:19.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:27:19 smithi188 bash[23329]: cephadm 2020-07-16T14:27:18.305364+0000 mgr.x (mgr.34562) 2343 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:27:19.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:27:19 smithi188 bash[23329]: cephadm 2020-07-16T14:27:18.305535+0000 mgr.x (mgr.34562) 2344 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:27:20.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:27:20 smithi188 bash[23329]: cluster 2020-07-16T14:27:20.144870+0000 mgr.x (mgr.34562) 2345 : cluster [DBG] pgmap v1460: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:27:21.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:27:20 smithi132 bash[27079]: cluster 2020-07-16T14:27:20.144870+0000 mgr.x (mgr.34562) 2345 : cluster [DBG] pgmap v1460: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:27:21.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:27:21 smithi188 bash[23329]: audit 2020-07-16T14:27:21.081872+0000 mon.b (mon.2) 605 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:27:21.925 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:27:21 smithi188 bash[23329]: cephadm 2020-07-16T14:27:21.082487+0000 mgr.x (mgr.34562) 2346 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:27:21.925 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:27:21 smithi188 bash[23329]: cephadm 2020-07-16T14:27:21.082566+0000 mgr.x (mgr.34562) 2347 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:27:22.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:27:21 smithi132 bash[27079]: audit 2020-07-16T14:27:21.081872+0000 mon.b (mon.2) 605 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:27:22.135 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:27:21 smithi132 bash[27079]: cephadm 2020-07-16T14:27:21.082487+0000 mgr.x (mgr.34562) 2346 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:27:22.135 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:27:21 smithi132 bash[27079]: cephadm 2020-07-16T14:27:21.082566+0000 mgr.x (mgr.34562) 2347 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:27:22.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:27:22 smithi188 bash[23329]: cluster 2020-07-16T14:27:22.145339+0000 mgr.x (mgr.34562) 2348 : cluster [DBG] pgmap v1461: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:27:23.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:27:22 smithi132 bash[27079]: cluster 2020-07-16T14:27:22.145339+0000 mgr.x (mgr.34562) 2348 : cluster [DBG] pgmap v1461: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:27:25.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:27:25 smithi132 bash[27079]: cluster 2020-07-16T14:27:24.145706+0000 mgr.x (mgr.34562) 2349 : cluster [DBG] pgmap v1462: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:27:25.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:27:25 smithi188 bash[23329]: cluster 2020-07-16T14:27:24.145706+0000 mgr.x (mgr.34562) 2349 : cluster [DBG] pgmap v1462: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:27:27.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:27:27 smithi132 bash[27079]: cluster 2020-07-16T14:27:26.146180+0000 mgr.x (mgr.34562) 2350 : cluster [DBG] pgmap v1463: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:27:27.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:27:27 smithi188 bash[23329]: cluster 2020-07-16T14:27:26.146180+0000 mgr.x (mgr.34562) 2350 : cluster [DBG] pgmap v1463: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:27:29.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:27:29 smithi132 bash[27079]: cluster 2020-07-16T14:27:28.146741+0000 mgr.x (mgr.34562) 2351 : cluster [DBG] pgmap v1464: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:27:29.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:27:29 smithi188 bash[23329]: cluster 2020-07-16T14:27:28.146741+0000 mgr.x (mgr.34562) 2351 : cluster [DBG] pgmap v1464: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:27:30.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:27:30 smithi188 bash[23329]: cluster 2020-07-16T14:27:30.147171+0000 mgr.x (mgr.34562) 2352 : cluster [DBG] pgmap v1465: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:27:31.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:27:30 smithi132 bash[27079]: cluster 2020-07-16T14:27:30.147171+0000 mgr.x (mgr.34562) 2352 : cluster [DBG] pgmap v1465: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:27:33.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:27:33 smithi132 bash[27079]: cluster 2020-07-16T14:27:32.147617+0000 mgr.x (mgr.34562) 2353 : cluster [DBG] pgmap v1466: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:27:33.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:27:33 smithi188 bash[23329]: cluster 2020-07-16T14:27:32.147617+0000 mgr.x (mgr.34562) 2353 : cluster [DBG] pgmap v1466: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:27:35.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:27:35 smithi132 bash[27079]: cluster 2020-07-16T14:27:34.147989+0000 mgr.x (mgr.34562) 2354 : cluster [DBG] pgmap v1467: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:27:35.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:27:35 smithi188 bash[23329]: cluster 2020-07-16T14:27:34.147989+0000 mgr.x (mgr.34562) 2354 : cluster [DBG] pgmap v1467: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:27:36.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:27:36 smithi132 bash[27079]: audit 2020-07-16T14:27:36.098016+0000 mon.b (mon.2) 606 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:27:36.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:27:36 smithi188 bash[23329]: audit 2020-07-16T14:27:36.098016+0000 mon.b (mon.2) 606 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:27:37.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:27:37 smithi132 bash[27079]: cephadm 2020-07-16T14:27:36.098704+0000 mgr.x (mgr.34562) 2355 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:27:37.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:27:37 smithi132 bash[27079]: cephadm 2020-07-16T14:27:36.098969+0000 mgr.x (mgr.34562) 2356 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:27:37.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:27:37 smithi132 bash[27079]: cluster 2020-07-16T14:27:36.148395+0000 mgr.x (mgr.34562) 2357 : cluster [DBG] pgmap v1468: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:27:37.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:27:37 smithi188 bash[23329]: cephadm 2020-07-16T14:27:36.098704+0000 mgr.x (mgr.34562) 2355 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:27:37.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:27:37 smithi188 bash[23329]: cephadm 2020-07-16T14:27:36.098969+0000 mgr.x (mgr.34562) 2356 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:27:37.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:27:37 smithi188 bash[23329]: cluster 2020-07-16T14:27:36.148395+0000 mgr.x (mgr.34562) 2357 : cluster [DBG] pgmap v1468: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:27:38.493 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:27:38.755 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:27:38.756 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (50m) 6m ago 53m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:27:38.756 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (53m) 6m ago 53m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:27:38.756 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (50m) 6m ago 56m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:27:38.757 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (50m) 6m ago 57m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:27:38.757 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 6m ago 58m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:27:38.757 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (56m) 6m ago 56m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:27:38.758 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (56m) 6m ago 56m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:27:38.758 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (53m) 6m ago 53m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:27:38.758 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (53m) 6m ago 53m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:27:38.759 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (55m) 6m ago 56m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:27:38.759 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (55m) 6m ago 55m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:27:38.759 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (55m) 6m ago 55m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:27:38.760 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (55m) 6m ago 55m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:27:38.760 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (54m) 6m ago 54m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:27:38.760 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (54m) 6m ago 54m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:27:38.761 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (54m) 6m ago 54m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:27:38.761 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (54m) 6m ago 54m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:27:38.761 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (52m) 6m ago 53m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:27:39.054 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:27:39.054 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:27:39.054 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:27:39.055 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:27:39.055 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:27:39.056 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:27:39.056 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:27:39.056 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:27:39.057 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:27:39.057 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:27:39.058 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:27:39.058 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:27:39.060 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:27:39.060 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:27:39.060 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:27:39.061 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:27:39.061 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:27:39.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:27:39 smithi132 bash[27079]: cluster 2020-07-16T14:27:38.148874+0000 mgr.x (mgr.34562) 2358 : cluster [DBG] pgmap v1469: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:27:39.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:27:39 smithi132 bash[27079]: audit 2020-07-16T14:27:39.053037+0000 mon.c (mon.1) 198 : audit [DBG] from='client.? 172.21.15.132:0/846477743' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:27:39.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:27:39 smithi188 bash[23329]: cluster 2020-07-16T14:27:38.148874+0000 mgr.x (mgr.34562) 2358 : cluster [DBG] pgmap v1469: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:27:39.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:27:39 smithi188 bash[23329]: audit 2020-07-16T14:27:39.053037+0000 mon.c (mon.1) 198 : audit [DBG] from='client.? 172.21.15.132:0/846477743' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:27:40.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:27:40 smithi132 bash[27079]: audit 2020-07-16T14:27:38.481603+0000 mgr.x (mgr.34562) 2359 : audit [DBG] from='client.26350 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:27:40.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:27:40 smithi132 bash[27079]: audit 2020-07-16T14:27:38.751276+0000 mgr.x (mgr.34562) 2360 : audit [DBG] from='client.26356 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:27:40.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:27:40 smithi188 bash[23329]: audit 2020-07-16T14:27:38.481603+0000 mgr.x (mgr.34562) 2359 : audit [DBG] from='client.26350 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:27:40.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:27:40 smithi188 bash[23329]: audit 2020-07-16T14:27:38.751276+0000 mgr.x (mgr.34562) 2360 : audit [DBG] from='client.26356 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:27:41.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:27:41 smithi132 bash[27079]: cluster 2020-07-16T14:27:40.149388+0000 mgr.x (mgr.34562) 2361 : cluster [DBG] pgmap v1470: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:27:41.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:27:41 smithi188 bash[23329]: cluster 2020-07-16T14:27:40.149388+0000 mgr.x (mgr.34562) 2361 : cluster [DBG] pgmap v1470: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:27:43.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:27:43 smithi132 bash[27079]: cluster 2020-07-16T14:27:42.149856+0000 mgr.x (mgr.34562) 2362 : cluster [DBG] pgmap v1471: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:27:43.679 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:27:43 smithi188 bash[23329]: cluster 2020-07-16T14:27:42.149856+0000 mgr.x (mgr.34562) 2362 : cluster [DBG] pgmap v1471: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:27:45.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:27:45 smithi132 bash[27079]: cluster 2020-07-16T14:27:44.150267+0000 mgr.x (mgr.34562) 2363 : cluster [DBG] pgmap v1472: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:27:45.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:27:45 smithi188 bash[23329]: cluster 2020-07-16T14:27:44.150267+0000 mgr.x (mgr.34562) 2363 : cluster [DBG] pgmap v1472: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:27:47.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:27:47 smithi132 bash[27079]: cluster 2020-07-16T14:27:46.150730+0000 mgr.x (mgr.34562) 2364 : cluster [DBG] pgmap v1473: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:27:47.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:27:47 smithi188 bash[23329]: cluster 2020-07-16T14:27:46.150730+0000 mgr.x (mgr.34562) 2364 : cluster [DBG] pgmap v1473: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:27:49.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:27:49 smithi132 bash[27079]: cluster 2020-07-16T14:27:48.151219+0000 mgr.x (mgr.34562) 2365 : cluster [DBG] pgmap v1474: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:27:49.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:27:49 smithi188 bash[23329]: cluster 2020-07-16T14:27:48.151219+0000 mgr.x (mgr.34562) 2365 : cluster [DBG] pgmap v1474: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:27:50.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:27:50 smithi188 bash[23329]: cluster 2020-07-16T14:27:50.151621+0000 mgr.x (mgr.34562) 2366 : cluster [DBG] pgmap v1475: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:27:51.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:27:50 smithi132 bash[27079]: cluster 2020-07-16T14:27:50.151621+0000 mgr.x (mgr.34562) 2366 : cluster [DBG] pgmap v1475: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:27:51.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:27:51 smithi188 bash[23329]: audit 2020-07-16T14:27:51.114655+0000 mon.b (mon.2) 607 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:27:51.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:27:51 smithi188 bash[23329]: cephadm 2020-07-16T14:27:51.115412+0000 mgr.x (mgr.34562) 2367 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:27:51.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:27:51 smithi188 bash[23329]: cephadm 2020-07-16T14:27:51.115485+0000 mgr.x (mgr.34562) 2368 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:27:52.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:27:51 smithi132 bash[27079]: audit 2020-07-16T14:27:51.114655+0000 mon.b (mon.2) 607 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:27:52.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:27:51 smithi132 bash[27079]: cephadm 2020-07-16T14:27:51.115412+0000 mgr.x (mgr.34562) 2367 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:27:52.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:27:51 smithi132 bash[27079]: cephadm 2020-07-16T14:27:51.115485+0000 mgr.x (mgr.34562) 2368 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:27:52.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:27:52 smithi188 bash[23329]: cluster 2020-07-16T14:27:52.151988+0000 mgr.x (mgr.34562) 2369 : cluster [DBG] pgmap v1476: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:27:53.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:27:52 smithi132 bash[27079]: cluster 2020-07-16T14:27:52.151988+0000 mgr.x (mgr.34562) 2369 : cluster [DBG] pgmap v1476: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:27:55.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:27:55 smithi132 bash[27079]: cluster 2020-07-16T14:27:54.152342+0000 mgr.x (mgr.34562) 2370 : cluster [DBG] pgmap v1477: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:27:55.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:27:55 smithi188 bash[23329]: cluster 2020-07-16T14:27:54.152342+0000 mgr.x (mgr.34562) 2370 : cluster [DBG] pgmap v1477: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:27:57.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:27:57 smithi132 bash[27079]: cluster 2020-07-16T14:27:56.152639+0000 mgr.x (mgr.34562) 2371 : cluster [DBG] pgmap v1478: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:27:57.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:27:57 smithi188 bash[23329]: cluster 2020-07-16T14:27:56.152639+0000 mgr.x (mgr.34562) 2371 : cluster [DBG] pgmap v1478: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:27:59.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:27:59 smithi132 bash[27079]: cluster 2020-07-16T14:27:58.153056+0000 mgr.x (mgr.34562) 2372 : cluster [DBG] pgmap v1479: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:27:59.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:27:59 smithi188 bash[23329]: cluster 2020-07-16T14:27:58.153056+0000 mgr.x (mgr.34562) 2372 : cluster [DBG] pgmap v1479: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:28:00.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:28:00 smithi188 bash[23329]: cluster 2020-07-16T14:28:00.153442+0000 mgr.x (mgr.34562) 2373 : cluster [DBG] pgmap v1480: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:28:01.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:28:00 smithi132 bash[27079]: cluster 2020-07-16T14:28:00.153442+0000 mgr.x (mgr.34562) 2373 : cluster [DBG] pgmap v1480: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:28:03.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:28:03 smithi132 bash[27079]: cluster 2020-07-16T14:28:02.153942+0000 mgr.x (mgr.34562) 2374 : cluster [DBG] pgmap v1481: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:28:03.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:28:03 smithi188 bash[23329]: cluster 2020-07-16T14:28:02.153942+0000 mgr.x (mgr.34562) 2374 : cluster [DBG] pgmap v1481: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:28:05.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:28:05 smithi132 bash[27079]: cluster 2020-07-16T14:28:04.154493+0000 mgr.x (mgr.34562) 2375 : cluster [DBG] pgmap v1482: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:28:05.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:28:05 smithi188 bash[23329]: cluster 2020-07-16T14:28:04.154493+0000 mgr.x (mgr.34562) 2375 : cluster [DBG] pgmap v1482: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:28:06.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:28:06 smithi132 bash[27079]: audit 2020-07-16T14:28:06.130241+0000 mon.b (mon.2) 608 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:28:06.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:28:06 smithi188 bash[23329]: audit 2020-07-16T14:28:06.130241+0000 mon.b (mon.2) 608 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:28:07.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:28:07 smithi132 bash[27079]: cephadm 2020-07-16T14:28:06.130898+0000 mgr.x (mgr.34562) 2376 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:28:07.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:28:07 smithi132 bash[27079]: cephadm 2020-07-16T14:28:06.131165+0000 mgr.x (mgr.34562) 2377 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:28:07.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:28:07 smithi132 bash[27079]: cluster 2020-07-16T14:28:06.154939+0000 mgr.x (mgr.34562) 2378 : cluster [DBG] pgmap v1483: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:28:07.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:28:07 smithi188 bash[23329]: cephadm 2020-07-16T14:28:06.130898+0000 mgr.x (mgr.34562) 2376 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:28:07.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:28:07 smithi188 bash[23329]: cephadm 2020-07-16T14:28:06.131165+0000 mgr.x (mgr.34562) 2377 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:28:07.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:28:07 smithi188 bash[23329]: cluster 2020-07-16T14:28:06.154939+0000 mgr.x (mgr.34562) 2378 : cluster [DBG] pgmap v1483: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:28:09.354 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:28:09.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:28:09 smithi132 bash[27079]: cluster 2020-07-16T14:28:08.155495+0000 mgr.x (mgr.34562) 2379 : cluster [DBG] pgmap v1484: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:28:09.619 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:28:09.619 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (50m) 7m ago 53m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:28:09.620 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (53m) 7m ago 53m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:28:09.620 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (51m) 7m ago 56m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:28:09.620 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (50m) 7m ago 58m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:28:09.620 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 7m ago 58m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:28:09.621 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (56m) 7m ago 56m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:28:09.621 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (57m) 7m ago 57m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:28:09.621 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (54m) 7m ago 54m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:28:09.621 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (54m) 7m ago 54m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:28:09.621 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (56m) 7m ago 56m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:28:09.622 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (56m) 7m ago 56m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:28:09.622 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (55m) 7m ago 55m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:28:09.622 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (55m) 7m ago 55m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:28:09.622 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (55m) 7m ago 55m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:28:09.623 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (55m) 7m ago 55m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:28:09.623 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (54m) 7m ago 54m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:28:09.623 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (54m) 7m ago 54m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:28:09.623 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (53m) 7m ago 54m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:28:09.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:28:09 smithi188 bash[23329]: cluster 2020-07-16T14:28:08.155495+0000 mgr.x (mgr.34562) 2379 : cluster [DBG] pgmap v1484: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:28:09.933 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:28:09.934 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:28:09.934 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:28:09.934 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:28:09.934 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:28:09.934 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:28:09.935 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:28:09.935 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:28:09.935 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:28:09.935 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:28:09.935 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:28:09.936 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:28:09.936 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:28:09.936 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:28:09.936 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:28:09.936 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:28:09.937 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:28:10.533 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:28:10 smithi132 bash[27079]: audit 2020-07-16T14:28:09.343071+0000 mgr.x (mgr.34562) 2380 : audit [DBG] from='client.26368 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:28:10.534 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:28:10 smithi132 bash[27079]: audit 2020-07-16T14:28:09.932498+0000 mon.c (mon.1) 199 : audit [DBG] from='client.? 172.21.15.132:0/4082783612' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:28:10.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:28:10 smithi188 bash[23329]: audit 2020-07-16T14:28:09.343071+0000 mgr.x (mgr.34562) 2380 : audit [DBG] from='client.26368 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:28:10.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:28:10 smithi188 bash[23329]: audit 2020-07-16T14:28:09.932498+0000 mon.c (mon.1) 199 : audit [DBG] from='client.? 172.21.15.132:0/4082783612' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:28:11.536 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:28:11 smithi132 bash[27079]: audit 2020-07-16T14:28:09.614877+0000 mgr.x (mgr.34562) 2381 : audit [DBG] from='client.26374 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:28:11.537 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:28:11 smithi132 bash[27079]: cluster 2020-07-16T14:28:10.156017+0000 mgr.x (mgr.34562) 2382 : cluster [DBG] pgmap v1485: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:28:11.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:28:11 smithi188 bash[23329]: audit 2020-07-16T14:28:09.614877+0000 mgr.x (mgr.34562) 2381 : audit [DBG] from='client.26374 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:28:11.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:28:11 smithi188 bash[23329]: cluster 2020-07-16T14:28:10.156017+0000 mgr.x (mgr.34562) 2382 : cluster [DBG] pgmap v1485: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:28:13.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:28:13 smithi132 bash[27079]: cluster 2020-07-16T14:28:12.156611+0000 mgr.x (mgr.34562) 2383 : cluster [DBG] pgmap v1486: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:28:13.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:28:13 smithi188 bash[23329]: cluster 2020-07-16T14:28:12.156611+0000 mgr.x (mgr.34562) 2383 : cluster [DBG] pgmap v1486: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:28:15.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:28:15 smithi132 bash[27079]: cluster 2020-07-16T14:28:14.157102+0000 mgr.x (mgr.34562) 2384 : cluster [DBG] pgmap v1487: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:28:15.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:28:15 smithi188 bash[23329]: cluster 2020-07-16T14:28:14.157102+0000 mgr.x (mgr.34562) 2384 : cluster [DBG] pgmap v1487: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:28:17.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:28:17 smithi132 bash[27079]: cluster 2020-07-16T14:28:16.157540+0000 mgr.x (mgr.34562) 2385 : cluster [DBG] pgmap v1488: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:28:17.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:28:17 smithi188 bash[23329]: cluster 2020-07-16T14:28:16.157540+0000 mgr.x (mgr.34562) 2385 : cluster [DBG] pgmap v1488: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:28:19.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:28:19 smithi132 bash[27079]: cluster 2020-07-16T14:28:18.157917+0000 mgr.x (mgr.34562) 2386 : cluster [DBG] pgmap v1489: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:28:19.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:28:19 smithi188 bash[23329]: cluster 2020-07-16T14:28:18.157917+0000 mgr.x (mgr.34562) 2386 : cluster [DBG] pgmap v1489: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:28:20.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:28:20 smithi188 bash[23329]: cluster 2020-07-16T14:28:20.158321+0000 mgr.x (mgr.34562) 2387 : cluster [DBG] pgmap v1490: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:28:21.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:28:20 smithi132 bash[27079]: cluster 2020-07-16T14:28:20.158321+0000 mgr.x (mgr.34562) 2387 : cluster [DBG] pgmap v1490: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:28:21.903 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:28:21 smithi132 bash[27079]: audit 2020-07-16T14:28:21.149238+0000 mon.b (mon.2) 609 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:28:21.904 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:28:21 smithi132 bash[27079]: audit 2020-07-16T14:28:21.149643+0000 mgr.x (mgr.34562) 2388 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:28:21.904 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:28:21 smithi132 bash[27079]: audit 2020-07-16T14:28:21.150639+0000 mon.b (mon.2) 610 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:28:21.904 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:28:21 smithi132 bash[27079]: audit 2020-07-16T14:28:21.150962+0000 mgr.x (mgr.34562) 2389 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:28:21.904 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:28:21 smithi132 bash[27079]: audit 2020-07-16T14:28:21.151869+0000 mon.b (mon.2) 611 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:28:21.905 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:28:21 smithi132 bash[27079]: audit 2020-07-16T14:28:21.152163+0000 mgr.x (mgr.34562) 2390 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:28:21.905 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:28:21 smithi132 bash[27079]: cephadm 2020-07-16T14:28:21.152893+0000 mgr.x (mgr.34562) 2391 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:28:21.905 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:28:21 smithi132 bash[27079]: audit 2020-07-16T14:28:21.153225+0000 mon.b (mon.2) 612 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:28:21.905 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:28:21 smithi132 bash[27079]: cephadm 2020-07-16T14:28:21.154110+0000 mgr.x (mgr.34562) 2392 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:28:21.905 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:28:21 smithi132 bash[27079]: audit 2020-07-16T14:28:21.154404+0000 mon.b (mon.2) 613 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:28:21.906 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:28:21 smithi132 bash[27079]: cephadm 2020-07-16T14:28:21.155084+0000 mgr.x (mgr.34562) 2393 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:28:21.906 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:28:21 smithi132 bash[27079]: cephadm 2020-07-16T14:28:21.155281+0000 mgr.x (mgr.34562) 2394 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:28:21.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:28:21 smithi188 bash[23329]: audit 2020-07-16T14:28:21.149238+0000 mon.b (mon.2) 609 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:28:21.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:28:21 smithi188 bash[23329]: audit 2020-07-16T14:28:21.149643+0000 mgr.x (mgr.34562) 2388 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:28:21.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:28:21 smithi188 bash[23329]: audit 2020-07-16T14:28:21.150639+0000 mon.b (mon.2) 610 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:28:21.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:28:21 smithi188 bash[23329]: audit 2020-07-16T14:28:21.150962+0000 mgr.x (mgr.34562) 2389 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:28:21.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:28:21 smithi188 bash[23329]: audit 2020-07-16T14:28:21.151869+0000 mon.b (mon.2) 611 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:28:21.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:28:21 smithi188 bash[23329]: audit 2020-07-16T14:28:21.152163+0000 mgr.x (mgr.34562) 2390 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:28:21.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:28:21 smithi188 bash[23329]: cephadm 2020-07-16T14:28:21.152893+0000 mgr.x (mgr.34562) 2391 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:28:21.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:28:21 smithi188 bash[23329]: audit 2020-07-16T14:28:21.153225+0000 mon.b (mon.2) 612 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:28:21.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:28:21 smithi188 bash[23329]: cephadm 2020-07-16T14:28:21.154110+0000 mgr.x (mgr.34562) 2392 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:28:21.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:28:21 smithi188 bash[23329]: audit 2020-07-16T14:28:21.154404+0000 mon.b (mon.2) 613 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:28:21.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:28:21 smithi188 bash[23329]: cephadm 2020-07-16T14:28:21.155084+0000 mgr.x (mgr.34562) 2393 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:28:21.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:28:21 smithi188 bash[23329]: cephadm 2020-07-16T14:28:21.155281+0000 mgr.x (mgr.34562) 2394 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:28:22.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:28:22 smithi188 bash[23329]: cluster 2020-07-16T14:28:22.158809+0000 mgr.x (mgr.34562) 2395 : cluster [DBG] pgmap v1491: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:28:23.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:28:22 smithi132 bash[27079]: cluster 2020-07-16T14:28:22.158809+0000 mgr.x (mgr.34562) 2395 : cluster [DBG] pgmap v1491: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:28:24.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:28:24 smithi132 bash[27079]: audit 2020-07-16T14:28:23.960205+0000 mon.b (mon.2) 614 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:28:24.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:28:24 smithi188 bash[23329]: audit 2020-07-16T14:28:23.960205+0000 mon.b (mon.2) 614 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:28:25.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:28:25 smithi132 bash[27079]: cephadm 2020-07-16T14:28:23.960892+0000 mgr.x (mgr.34562) 2396 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:28:25.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:28:25 smithi132 bash[27079]: cephadm 2020-07-16T14:28:23.961278+0000 mgr.x (mgr.34562) 2397 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:28:25.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:28:25 smithi132 bash[27079]: cluster 2020-07-16T14:28:24.159395+0000 mgr.x (mgr.34562) 2398 : cluster [DBG] pgmap v1492: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:28:25.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:28:25 smithi188 bash[23329]: cephadm 2020-07-16T14:28:23.960892+0000 mgr.x (mgr.34562) 2396 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:28:25.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:28:25 smithi188 bash[23329]: cephadm 2020-07-16T14:28:23.961278+0000 mgr.x (mgr.34562) 2397 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:28:25.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:28:25 smithi188 bash[23329]: cluster 2020-07-16T14:28:24.159395+0000 mgr.x (mgr.34562) 2398 : cluster [DBG] pgmap v1492: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:28:27.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:28:27 smithi132 bash[27079]: cluster 2020-07-16T14:28:26.159773+0000 mgr.x (mgr.34562) 2399 : cluster [DBG] pgmap v1493: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:28:27.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:28:27 smithi188 bash[23329]: cluster 2020-07-16T14:28:26.159773+0000 mgr.x (mgr.34562) 2399 : cluster [DBG] pgmap v1493: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:28:29.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:28:29 smithi132 bash[27079]: cluster 2020-07-16T14:28:28.160185+0000 mgr.x (mgr.34562) 2400 : cluster [DBG] pgmap v1494: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:28:29.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:28:29 smithi188 bash[23329]: cluster 2020-07-16T14:28:28.160185+0000 mgr.x (mgr.34562) 2400 : cluster [DBG] pgmap v1494: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:28:30.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:28:30 smithi188 bash[23329]: cluster 2020-07-16T14:28:30.160635+0000 mgr.x (mgr.34562) 2401 : cluster [DBG] pgmap v1495: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:28:31.033 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:28:30 smithi132 bash[27079]: cluster 2020-07-16T14:28:30.160635+0000 mgr.x (mgr.34562) 2401 : cluster [DBG] pgmap v1495: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:28:33.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:28:33 smithi132 bash[27079]: cluster 2020-07-16T14:28:32.161010+0000 mgr.x (mgr.34562) 2402 : cluster [DBG] pgmap v1496: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:28:33.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:28:33 smithi188 bash[23329]: cluster 2020-07-16T14:28:32.161010+0000 mgr.x (mgr.34562) 2402 : cluster [DBG] pgmap v1496: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:28:35.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:28:35 smithi132 bash[27079]: cluster 2020-07-16T14:28:34.161442+0000 mgr.x (mgr.34562) 2403 : cluster [DBG] pgmap v1497: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:28:35.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:28:35 smithi188 bash[23329]: cluster 2020-07-16T14:28:34.161442+0000 mgr.x (mgr.34562) 2403 : cluster [DBG] pgmap v1497: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:28:37.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:28:37 smithi132 bash[27079]: cluster 2020-07-16T14:28:36.161763+0000 mgr.x (mgr.34562) 2404 : cluster [DBG] pgmap v1498: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:28:37.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:28:37 smithi188 bash[23329]: cluster 2020-07-16T14:28:36.161763+0000 mgr.x (mgr.34562) 2404 : cluster [DBG] pgmap v1498: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:28:39.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:28:39 smithi132 bash[27079]: cluster 2020-07-16T14:28:38.162215+0000 mgr.x (mgr.34562) 2405 : cluster [DBG] pgmap v1499: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:28:39.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:28:39 smithi132 bash[27079]: audit 2020-07-16T14:28:38.977003+0000 mon.b (mon.2) 615 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:28:39.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:28:39 smithi188 bash[23329]: cluster 2020-07-16T14:28:38.162215+0000 mgr.x (mgr.34562) 2405 : cluster [DBG] pgmap v1499: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:28:39.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:28:39 smithi188 bash[23329]: audit 2020-07-16T14:28:38.977003+0000 mon.b (mon.2) 615 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:28:40.234 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:28:40.495 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:28:40.496 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (51m) 7m ago 54m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:28:40.496 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (54m) 7m ago 54m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:28:40.496 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (51m) 7m ago 57m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:28:40.496 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (51m) 7m ago 58m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:28:40.497 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 7m ago 59m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:28:40.497 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (57m) 7m ago 57m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:28:40.497 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (57m) 7m ago 57m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:28:40.497 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (54m) 7m ago 54m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:28:40.497 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (54m) 7m ago 54m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:28:40.498 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (57m) 7m ago 57m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:28:40.498 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (56m) 7m ago 56m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:28:40.498 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (56m) 7m ago 56m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:28:40.498 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (56m) 7m ago 56m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:28:40.499 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (55m) 7m ago 55m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:28:40.499 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (55m) 7m ago 55m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:28:40.499 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (55m) 7m ago 55m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:28:40.499 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (55m) 7m ago 55m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:28:40.499 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (53m) 7m ago 54m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:28:40.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:28:40 smithi132 bash[27079]: cephadm 2020-07-16T14:28:38.977813+0000 mgr.x (mgr.34562) 2406 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:28:40.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:28:40 smithi132 bash[27079]: cephadm 2020-07-16T14:28:38.978236+0000 mgr.x (mgr.34562) 2407 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:28:40.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:28:40 smithi188 bash[23329]: cephadm 2020-07-16T14:28:38.977813+0000 mgr.x (mgr.34562) 2406 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:28:40.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:28:40 smithi188 bash[23329]: cephadm 2020-07-16T14:28:38.978236+0000 mgr.x (mgr.34562) 2407 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:28:40.795 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:28:40.795 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:28:40.795 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:28:40.796 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:28:40.796 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:28:40.796 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:28:40.796 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:28:40.796 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:28:40.797 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:28:40.797 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:28:40.797 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:28:40.797 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:28:40.797 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:28:40.798 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:28:40.798 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:28:40.798 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:28:40.798 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:28:41.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:28:41 smithi132 bash[27079]: cluster 2020-07-16T14:28:40.162483+0000 mgr.x (mgr.34562) 2408 : cluster [DBG] pgmap v1500: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:28:41.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:28:41 smithi132 bash[27079]: audit 2020-07-16T14:28:40.221706+0000 mgr.x (mgr.34562) 2409 : audit [DBG] from='client.26386 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:28:41.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:28:41 smithi132 bash[27079]: audit 2020-07-16T14:28:40.793370+0000 mon.c (mon.1) 200 : audit [DBG] from='client.? 172.21.15.132:0/1467315648' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:28:41.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:28:41 smithi188 bash[23329]: cluster 2020-07-16T14:28:40.162483+0000 mgr.x (mgr.34562) 2408 : cluster [DBG] pgmap v1500: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:28:41.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:28:41 smithi188 bash[23329]: audit 2020-07-16T14:28:40.221706+0000 mgr.x (mgr.34562) 2409 : audit [DBG] from='client.26386 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:28:41.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:28:41 smithi188 bash[23329]: audit 2020-07-16T14:28:40.793370+0000 mon.c (mon.1) 200 : audit [DBG] from='client.? 172.21.15.132:0/1467315648' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:28:42.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:28:42 smithi132 bash[27079]: audit 2020-07-16T14:28:40.490189+0000 mgr.x (mgr.34562) 2410 : audit [DBG] from='client.26392 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:28:42.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:28:42 smithi188 bash[23329]: audit 2020-07-16T14:28:40.490189+0000 mgr.x (mgr.34562) 2410 : audit [DBG] from='client.26392 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:28:43.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:28:43 smithi132 bash[27079]: cluster 2020-07-16T14:28:42.162962+0000 mgr.x (mgr.34562) 2411 : cluster [DBG] pgmap v1501: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:28:43.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:28:43 smithi188 bash[23329]: cluster 2020-07-16T14:28:42.162962+0000 mgr.x (mgr.34562) 2411 : cluster [DBG] pgmap v1501: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:28:45.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:28:45 smithi132 bash[27079]: cluster 2020-07-16T14:28:44.163334+0000 mgr.x (mgr.34562) 2412 : cluster [DBG] pgmap v1502: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:28:45.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:28:45 smithi188 bash[23329]: cluster 2020-07-16T14:28:44.163334+0000 mgr.x (mgr.34562) 2412 : cluster [DBG] pgmap v1502: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:28:47.534 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:28:47 smithi132 bash[27079]: cluster 2020-07-16T14:28:46.163801+0000 mgr.x (mgr.34562) 2413 : cluster [DBG] pgmap v1503: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:28:47.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:28:47 smithi188 bash[23329]: cluster 2020-07-16T14:28:46.163801+0000 mgr.x (mgr.34562) 2413 : cluster [DBG] pgmap v1503: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:28:49.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:28:49 smithi132 bash[27079]: cluster 2020-07-16T14:28:48.164331+0000 mgr.x (mgr.34562) 2414 : cluster [DBG] pgmap v1504: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:28:49.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:28:49 smithi188 bash[23329]: cluster 2020-07-16T14:28:48.164331+0000 mgr.x (mgr.34562) 2414 : cluster [DBG] pgmap v1504: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:28:50.926 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:28:50 smithi188 bash[23329]: cluster 2020-07-16T14:28:50.164692+0000 mgr.x (mgr.34562) 2415 : cluster [DBG] pgmap v1505: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:28:51.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:28:50 smithi132 bash[27079]: cluster 2020-07-16T14:28:50.164692+0000 mgr.x (mgr.34562) 2415 : cluster [DBG] pgmap v1505: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:28:53.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:28:53 smithi132 bash[27079]: cluster 2020-07-16T14:28:52.165054+0000 mgr.x (mgr.34562) 2416 : cluster [DBG] pgmap v1506: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:28:53.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:28:53 smithi188 bash[23329]: cluster 2020-07-16T14:28:52.165054+0000 mgr.x (mgr.34562) 2416 : cluster [DBG] pgmap v1506: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:28:54.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:28:54 smithi132 bash[27079]: audit 2020-07-16T14:28:53.993826+0000 mon.b (mon.2) 616 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:28:54.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:28:54 smithi188 bash[23329]: audit 2020-07-16T14:28:53.993826+0000 mon.b (mon.2) 616 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:28:55.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:28:55 smithi132 bash[27079]: cephadm 2020-07-16T14:28:53.994592+0000 mgr.x (mgr.34562) 2417 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:28:55.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:28:55 smithi132 bash[27079]: cephadm 2020-07-16T14:28:53.995042+0000 mgr.x (mgr.34562) 2418 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:28:55.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:28:55 smithi132 bash[27079]: cluster 2020-07-16T14:28:54.165538+0000 mgr.x (mgr.34562) 2419 : cluster [DBG] pgmap v1507: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:28:55.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:28:55 smithi188 bash[23329]: cephadm 2020-07-16T14:28:53.994592+0000 mgr.x (mgr.34562) 2417 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:28:55.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:28:55 smithi188 bash[23329]: cephadm 2020-07-16T14:28:53.995042+0000 mgr.x (mgr.34562) 2418 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:28:55.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:28:55 smithi188 bash[23329]: cluster 2020-07-16T14:28:54.165538+0000 mgr.x (mgr.34562) 2419 : cluster [DBG] pgmap v1507: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:28:57.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:28:57 smithi132 bash[27079]: cluster 2020-07-16T14:28:56.165889+0000 mgr.x (mgr.34562) 2420 : cluster [DBG] pgmap v1508: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:28:57.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:28:57 smithi188 bash[23329]: cluster 2020-07-16T14:28:56.165889+0000 mgr.x (mgr.34562) 2420 : cluster [DBG] pgmap v1508: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:28:59.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:28:59 smithi132 bash[27079]: cluster 2020-07-16T14:28:58.166280+0000 mgr.x (mgr.34562) 2421 : cluster [DBG] pgmap v1509: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:28:59.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:28:59 smithi188 bash[23329]: cluster 2020-07-16T14:28:58.166280+0000 mgr.x (mgr.34562) 2421 : cluster [DBG] pgmap v1509: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:29:00.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:29:00 smithi188 bash[23329]: cluster 2020-07-16T14:29:00.166765+0000 mgr.x (mgr.34562) 2422 : cluster [DBG] pgmap v1510: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:29:01.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:29:00 smithi132 bash[27079]: cluster 2020-07-16T14:29:00.166765+0000 mgr.x (mgr.34562) 2422 : cluster [DBG] pgmap v1510: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:29:03.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:29:03 smithi132 bash[27079]: cluster 2020-07-16T14:29:02.167236+0000 mgr.x (mgr.34562) 2423 : cluster [DBG] pgmap v1511: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:29:03.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:29:03 smithi188 bash[23329]: cluster 2020-07-16T14:29:02.167236+0000 mgr.x (mgr.34562) 2423 : cluster [DBG] pgmap v1511: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:29:05.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:29:05 smithi132 bash[27079]: cluster 2020-07-16T14:29:04.167731+0000 mgr.x (mgr.34562) 2424 : cluster [DBG] pgmap v1512: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:29:05.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:29:05 smithi188 bash[23329]: cluster 2020-07-16T14:29:04.167731+0000 mgr.x (mgr.34562) 2424 : cluster [DBG] pgmap v1512: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:29:07.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:29:07 smithi132 bash[27079]: cluster 2020-07-16T14:29:06.168223+0000 mgr.x (mgr.34562) 2425 : cluster [DBG] pgmap v1513: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:29:07.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:29:07 smithi188 bash[23329]: cluster 2020-07-16T14:29:06.168223+0000 mgr.x (mgr.34562) 2425 : cluster [DBG] pgmap v1513: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:29:09.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:29:09 smithi132 bash[27079]: cluster 2020-07-16T14:29:08.168774+0000 mgr.x (mgr.34562) 2426 : cluster [DBG] pgmap v1514: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:29:09.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:29:09 smithi132 bash[27079]: audit 2020-07-16T14:29:09.009879+0000 mon.b (mon.2) 617 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:29:09.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:29:09 smithi188 bash[23329]: cluster 2020-07-16T14:29:08.168774+0000 mgr.x (mgr.34562) 2426 : cluster [DBG] pgmap v1514: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:29:09.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:29:09 smithi188 bash[23329]: audit 2020-07-16T14:29:09.009879+0000 mon.b (mon.2) 617 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:29:10.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:29:10 smithi132 bash[27079]: cephadm 2020-07-16T14:29:09.010611+0000 mgr.x (mgr.34562) 2427 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:29:10.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:29:10 smithi132 bash[27079]: cephadm 2020-07-16T14:29:09.010768+0000 mgr.x (mgr.34562) 2428 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:29:10.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:29:10 smithi188 bash[23329]: cephadm 2020-07-16T14:29:09.010611+0000 mgr.x (mgr.34562) 2427 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:29:10.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:29:10 smithi188 bash[23329]: cephadm 2020-07-16T14:29:09.010768+0000 mgr.x (mgr.34562) 2428 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:29:11.095 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:29:11.357 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:29:11.358 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (51m) 8m ago 54m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:29:11.358 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (54m) 8m ago 54m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:29:11.358 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (52m) 8m ago 57m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:29:11.358 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (51m) 8m ago 59m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:29:11.359 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 8m ago 59m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:29:11.359 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (58m) 8m ago 58m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:29:11.359 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (58m) 8m ago 58m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:29:11.359 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (55m) 8m ago 55m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:29:11.359 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (55m) 8m ago 55m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:29:11.360 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (57m) 8m ago 57m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:29:11.360 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (57m) 8m ago 57m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:29:11.360 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (56m) 8m ago 57m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:29:11.360 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (56m) 8m ago 56m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:29:11.360 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (56m) 8m ago 56m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:29:11.361 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (56m) 8m ago 56m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:29:11.361 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (55m) 8m ago 55m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:29:11.361 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (55m) 8m ago 55m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:29:11.361 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (54m) 8m ago 55m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:29:11.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:29:11 smithi132 bash[27079]: cluster 2020-07-16T14:29:10.169354+0000 mgr.x (mgr.34562) 2429 : cluster [DBG] pgmap v1515: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:29:11.656 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:29:11.657 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:29:11.657 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:29:11.657 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:29:11.658 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:29:11.658 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:29:11.658 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:29:11.658 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:29:11.658 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:29:11.659 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:29:11.659 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:29:11.659 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:29:11.659 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:29:11.659 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:29:11.660 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:29:11.660 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:29:11.660 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:29:11.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:29:11 smithi188 bash[23329]: cluster 2020-07-16T14:29:10.169354+0000 mgr.x (mgr.34562) 2429 : cluster [DBG] pgmap v1515: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:29:12.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:29:12 smithi132 bash[27079]: audit 2020-07-16T14:29:11.082569+0000 mgr.x (mgr.34562) 2430 : audit [DBG] from='client.26404 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:29:12.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:29:12 smithi132 bash[27079]: audit 2020-07-16T14:29:11.352712+0000 mgr.x (mgr.34562) 2431 : audit [DBG] from='client.26410 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:29:12.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:29:12 smithi132 bash[27079]: audit 2020-07-16T14:29:11.655415+0000 mon.c (mon.1) 201 : audit [DBG] from='client.? 172.21.15.132:0/2773544900' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:29:12.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:29:12 smithi188 bash[23329]: audit 2020-07-16T14:29:11.082569+0000 mgr.x (mgr.34562) 2430 : audit [DBG] from='client.26404 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:29:12.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:29:12 smithi188 bash[23329]: audit 2020-07-16T14:29:11.352712+0000 mgr.x (mgr.34562) 2431 : audit [DBG] from='client.26410 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:29:12.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:29:12 smithi188 bash[23329]: audit 2020-07-16T14:29:11.655415+0000 mon.c (mon.1) 201 : audit [DBG] from='client.? 172.21.15.132:0/2773544900' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:29:13.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:29:13 smithi132 bash[27079]: cluster 2020-07-16T14:29:12.169772+0000 mgr.x (mgr.34562) 2432 : cluster [DBG] pgmap v1516: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:29:13.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:29:13 smithi188 bash[23329]: cluster 2020-07-16T14:29:12.169772+0000 mgr.x (mgr.34562) 2432 : cluster [DBG] pgmap v1516: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:29:15.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:29:15 smithi132 bash[27079]: cluster 2020-07-16T14:29:14.170268+0000 mgr.x (mgr.34562) 2433 : cluster [DBG] pgmap v1517: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:29:15.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:29:15 smithi188 bash[23329]: cluster 2020-07-16T14:29:14.170268+0000 mgr.x (mgr.34562) 2433 : cluster [DBG] pgmap v1517: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:29:17.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:29:17 smithi132 bash[27079]: cluster 2020-07-16T14:29:16.170712+0000 mgr.x (mgr.34562) 2434 : cluster [DBG] pgmap v1518: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:29:17.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:29:17 smithi188 bash[23329]: cluster 2020-07-16T14:29:16.170712+0000 mgr.x (mgr.34562) 2434 : cluster [DBG] pgmap v1518: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:29:19.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:29:19 smithi132 bash[27079]: cluster 2020-07-16T14:29:18.171265+0000 mgr.x (mgr.34562) 2435 : cluster [DBG] pgmap v1519: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:29:19.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:29:19 smithi188 bash[23329]: cluster 2020-07-16T14:29:18.171265+0000 mgr.x (mgr.34562) 2435 : cluster [DBG] pgmap v1519: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:29:20.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:29:20 smithi188 bash[23329]: cluster 2020-07-16T14:29:20.171804+0000 mgr.x (mgr.34562) 2436 : cluster [DBG] pgmap v1520: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:29:21.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:29:20 smithi132 bash[27079]: cluster 2020-07-16T14:29:20.171804+0000 mgr.x (mgr.34562) 2436 : cluster [DBG] pgmap v1520: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:29:23.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:29:23 smithi132 bash[27079]: cluster 2020-07-16T14:29:22.172250+0000 mgr.x (mgr.34562) 2437 : cluster [DBG] pgmap v1521: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:29:23.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:29:23 smithi188 bash[23329]: cluster 2020-07-16T14:29:22.172250+0000 mgr.x (mgr.34562) 2437 : cluster [DBG] pgmap v1521: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:29:24.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:29:24 smithi132 bash[27079]: audit 2020-07-16T14:29:24.029197+0000 mon.b (mon.2) 618 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:29:24.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:29:24 smithi132 bash[27079]: audit 2020-07-16T14:29:24.030607+0000 mon.b (mon.2) 619 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:29:24.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:29:24 smithi132 bash[27079]: audit 2020-07-16T14:29:24.031744+0000 mon.b (mon.2) 620 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:29:24.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:29:24 smithi132 bash[27079]: audit 2020-07-16T14:29:24.033045+0000 mon.b (mon.2) 621 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:29:24.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:29:24 smithi132 bash[27079]: audit 2020-07-16T14:29:24.034280+0000 mon.b (mon.2) 622 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:29:24.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:29:24 smithi188 bash[23329]: audit 2020-07-16T14:29:24.029197+0000 mon.b (mon.2) 618 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:29:24.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:29:24 smithi188 bash[23329]: audit 2020-07-16T14:29:24.030607+0000 mon.b (mon.2) 619 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:29:24.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:29:24 smithi188 bash[23329]: audit 2020-07-16T14:29:24.031744+0000 mon.b (mon.2) 620 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:29:24.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:29:24 smithi188 bash[23329]: audit 2020-07-16T14:29:24.033045+0000 mon.b (mon.2) 621 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:29:24.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:29:24 smithi188 bash[23329]: audit 2020-07-16T14:29:24.034280+0000 mon.b (mon.2) 622 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:29:25.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:29:25 smithi132 bash[27079]: audit 2020-07-16T14:29:24.029603+0000 mgr.x (mgr.34562) 2438 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:29:25.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:29:25 smithi132 bash[27079]: audit 2020-07-16T14:29:24.030936+0000 mgr.x (mgr.34562) 2439 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:29:25.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:29:25 smithi132 bash[27079]: audit 2020-07-16T14:29:24.032039+0000 mgr.x (mgr.34562) 2440 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:29:25.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:29:25 smithi132 bash[27079]: cephadm 2020-07-16T14:29:24.032767+0000 mgr.x (mgr.34562) 2441 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:29:25.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:29:25 smithi132 bash[27079]: cephadm 2020-07-16T14:29:24.033922+0000 mgr.x (mgr.34562) 2442 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:29:25.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:29:25 smithi132 bash[27079]: cephadm 2020-07-16T14:29:24.035024+0000 mgr.x (mgr.34562) 2443 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:29:25.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:29:25 smithi132 bash[27079]: cephadm 2020-07-16T14:29:24.035134+0000 mgr.x (mgr.34562) 2444 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:29:25.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:29:25 smithi132 bash[27079]: cluster 2020-07-16T14:29:24.172686+0000 mgr.x (mgr.34562) 2445 : cluster [DBG] pgmap v1522: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:29:25.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:29:25 smithi188 bash[23329]: audit 2020-07-16T14:29:24.029603+0000 mgr.x (mgr.34562) 2438 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:29:25.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:29:25 smithi188 bash[23329]: audit 2020-07-16T14:29:24.030936+0000 mgr.x (mgr.34562) 2439 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:29:25.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:29:25 smithi188 bash[23329]: audit 2020-07-16T14:29:24.032039+0000 mgr.x (mgr.34562) 2440 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:29:25.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:29:25 smithi188 bash[23329]: cephadm 2020-07-16T14:29:24.032767+0000 mgr.x (mgr.34562) 2441 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:29:25.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:29:25 smithi188 bash[23329]: cephadm 2020-07-16T14:29:24.033922+0000 mgr.x (mgr.34562) 2442 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:29:25.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:29:25 smithi188 bash[23329]: cephadm 2020-07-16T14:29:24.035024+0000 mgr.x (mgr.34562) 2443 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:29:25.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:29:25 smithi188 bash[23329]: cephadm 2020-07-16T14:29:24.035134+0000 mgr.x (mgr.34562) 2444 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:29:25.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:29:25 smithi188 bash[23329]: cluster 2020-07-16T14:29:24.172686+0000 mgr.x (mgr.34562) 2445 : cluster [DBG] pgmap v1522: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:29:27.533 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:29:27 smithi132 bash[27079]: cluster 2020-07-16T14:29:26.173092+0000 mgr.x (mgr.34562) 2446 : cluster [DBG] pgmap v1523: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:29:27.533 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:29:27 smithi132 bash[27079]: audit 2020-07-16T14:29:26.780213+0000 mon.b (mon.2) 623 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:29:27.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:29:27 smithi188 bash[23329]: cluster 2020-07-16T14:29:26.173092+0000 mgr.x (mgr.34562) 2446 : cluster [DBG] pgmap v1523: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:29:27.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:29:27 smithi188 bash[23329]: audit 2020-07-16T14:29:26.780213+0000 mon.b (mon.2) 623 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:29:28.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:29:28 smithi132 bash[27079]: cephadm 2020-07-16T14:29:26.780855+0000 mgr.x (mgr.34562) 2447 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:29:28.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:29:28 smithi132 bash[27079]: cephadm 2020-07-16T14:29:26.781242+0000 mgr.x (mgr.34562) 2448 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:29:28.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:29:28 smithi188 bash[23329]: cephadm 2020-07-16T14:29:26.780855+0000 mgr.x (mgr.34562) 2447 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:29:28.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:29:28 smithi188 bash[23329]: cephadm 2020-07-16T14:29:26.781242+0000 mgr.x (mgr.34562) 2448 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:29:29.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:29:29 smithi132 bash[27079]: cluster 2020-07-16T14:29:28.173642+0000 mgr.x (mgr.34562) 2449 : cluster [DBG] pgmap v1524: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:29:29.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:29:29 smithi188 bash[23329]: cluster 2020-07-16T14:29:28.173642+0000 mgr.x (mgr.34562) 2449 : cluster [DBG] pgmap v1524: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:29:30.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:29:30 smithi188 bash[23329]: cluster 2020-07-16T14:29:30.174163+0000 mgr.x (mgr.34562) 2450 : cluster [DBG] pgmap v1525: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:29:31.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:29:30 smithi132 bash[27079]: cluster 2020-07-16T14:29:30.174163+0000 mgr.x (mgr.34562) 2450 : cluster [DBG] pgmap v1525: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:29:33.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:29:33 smithi132 bash[27079]: cluster 2020-07-16T14:29:32.174695+0000 mgr.x (mgr.34562) 2451 : cluster [DBG] pgmap v1526: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:29:33.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:29:33 smithi188 bash[23329]: cluster 2020-07-16T14:29:32.174695+0000 mgr.x (mgr.34562) 2451 : cluster [DBG] pgmap v1526: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:29:35.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:29:35 smithi132 bash[27079]: cluster 2020-07-16T14:29:34.175194+0000 mgr.x (mgr.34562) 2452 : cluster [DBG] pgmap v1527: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:29:35.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:29:35 smithi188 bash[23329]: cluster 2020-07-16T14:29:34.175194+0000 mgr.x (mgr.34562) 2452 : cluster [DBG] pgmap v1527: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:29:37.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:29:37 smithi132 bash[27079]: cluster 2020-07-16T14:29:36.175688+0000 mgr.x (mgr.34562) 2453 : cluster [DBG] pgmap v1528: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:29:37.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:29:37 smithi188 bash[23329]: cluster 2020-07-16T14:29:36.175688+0000 mgr.x (mgr.34562) 2453 : cluster [DBG] pgmap v1528: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:29:39.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:29:39 smithi132 bash[27079]: cluster 2020-07-16T14:29:38.176144+0000 mgr.x (mgr.34562) 2454 : cluster [DBG] pgmap v1529: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:29:39.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:29:39 smithi188 bash[23329]: cluster 2020-07-16T14:29:38.176144+0000 mgr.x (mgr.34562) 2454 : cluster [DBG] pgmap v1529: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:29:40.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:29:40 smithi188 bash[23329]: cluster 2020-07-16T14:29:40.176581+0000 mgr.x (mgr.34562) 2455 : cluster [DBG] pgmap v1530: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:29:41.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:29:40 smithi132 bash[27079]: cluster 2020-07-16T14:29:40.176581+0000 mgr.x (mgr.34562) 2455 : cluster [DBG] pgmap v1530: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:29:41.955 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:29:42.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:29:41 smithi188 bash[23329]: audit 2020-07-16T14:29:41.793926+0000 mon.b (mon.2) 624 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:29:42.216 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:29:42.217 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (52m) 8m ago 55m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:29:42.217 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (55m) 8m ago 55m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:29:42.217 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (52m) 8m ago 58m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:29:42.218 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (52m) 8m ago 60m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:29:42.218 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 8m ago 60m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:29:42.218 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (58m) 8m ago 58m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:29:42.218 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (58m) 8m ago 58m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:29:42.218 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (55m) 8m ago 55m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:29:42.219 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (55m) 8m ago 55m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:29:42.219 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (58m) 8m ago 58m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:29:42.219 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (57m) 8m ago 57m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:29:42.219 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (57m) 8m ago 57m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:29:42.219 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (57m) 8m ago 57m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:29:42.220 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (56m) 8m ago 56m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:29:42.220 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (56m) 8m ago 56m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:29:42.220 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (56m) 8m ago 56m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:29:42.220 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (56m) 8m ago 56m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:29:42.220 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (54m) 8m ago 55m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:29:42.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:29:41 smithi132 bash[27079]: audit 2020-07-16T14:29:41.793926+0000 mon.b (mon.2) 624 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:29:42.522 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:29:42.522 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:29:42.523 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:29:42.523 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:29:42.523 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:29:42.523 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:29:42.523 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:29:42.524 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:29:42.524 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:29:42.524 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:29:42.524 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:29:42.524 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:29:42.525 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:29:42.525 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:29:42.525 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:29:42.525 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:29:42.528 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:29:43.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:29:42 smithi188 bash[23329]: cephadm 2020-07-16T14:29:41.794671+0000 mgr.x (mgr.34562) 2456 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:29:43.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:29:42 smithi188 bash[23329]: cephadm 2020-07-16T14:29:41.794843+0000 mgr.x (mgr.34562) 2457 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:29:43.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:29:42 smithi188 bash[23329]: audit 2020-07-16T14:29:41.943887+0000 mgr.x (mgr.34562) 2458 : audit [DBG] from='client.26422 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:29:43.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:29:42 smithi188 bash[23329]: cluster 2020-07-16T14:29:42.177040+0000 mgr.x (mgr.34562) 2459 : cluster [DBG] pgmap v1531: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:29:43.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:29:42 smithi188 bash[23329]: audit 2020-07-16T14:29:42.212319+0000 mgr.x (mgr.34562) 2460 : audit [DBG] from='client.26428 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:29:43.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:29:42 smithi188 bash[23329]: audit 2020-07-16T14:29:42.514942+0000 mon.c (mon.1) 202 : audit [DBG] from='client.? 172.21.15.132:0/1546025367' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:29:43.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:29:42 smithi132 bash[27079]: cephadm 2020-07-16T14:29:41.794671+0000 mgr.x (mgr.34562) 2456 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:29:43.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:29:42 smithi132 bash[27079]: cephadm 2020-07-16T14:29:41.794843+0000 mgr.x (mgr.34562) 2457 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:29:43.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:29:42 smithi132 bash[27079]: audit 2020-07-16T14:29:41.943887+0000 mgr.x (mgr.34562) 2458 : audit [DBG] from='client.26422 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:29:43.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:29:42 smithi132 bash[27079]: cluster 2020-07-16T14:29:42.177040+0000 mgr.x (mgr.34562) 2459 : cluster [DBG] pgmap v1531: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:29:43.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:29:42 smithi132 bash[27079]: audit 2020-07-16T14:29:42.212319+0000 mgr.x (mgr.34562) 2460 : audit [DBG] from='client.26428 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:29:43.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:29:42 smithi132 bash[27079]: audit 2020-07-16T14:29:42.514942+0000 mon.c (mon.1) 202 : audit [DBG] from='client.? 172.21.15.132:0/1546025367' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:29:45.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:29:45 smithi132 bash[27079]: cluster 2020-07-16T14:29:44.177447+0000 mgr.x (mgr.34562) 2461 : cluster [DBG] pgmap v1532: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:29:45.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:29:45 smithi188 bash[23329]: cluster 2020-07-16T14:29:44.177447+0000 mgr.x (mgr.34562) 2461 : cluster [DBG] pgmap v1532: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:29:47.532 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:29:47 smithi132 bash[27079]: cluster 2020-07-16T14:29:46.177904+0000 mgr.x (mgr.34562) 2462 : cluster [DBG] pgmap v1533: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:29:47.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:29:47 smithi188 bash[23329]: cluster 2020-07-16T14:29:46.177904+0000 mgr.x (mgr.34562) 2462 : cluster [DBG] pgmap v1533: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:29:49.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:29:49 smithi132 bash[27079]: cluster 2020-07-16T14:29:48.178485+0000 mgr.x (mgr.34562) 2463 : cluster [DBG] pgmap v1534: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:29:49.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:29:49 smithi188 bash[23329]: cluster 2020-07-16T14:29:48.178485+0000 mgr.x (mgr.34562) 2463 : cluster [DBG] pgmap v1534: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:29:50.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:29:50 smithi188 bash[23329]: cluster 2020-07-16T14:29:50.178838+0000 mgr.x (mgr.34562) 2464 : cluster [DBG] pgmap v1535: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:29:51.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:29:50 smithi132 bash[27079]: cluster 2020-07-16T14:29:50.178838+0000 mgr.x (mgr.34562) 2464 : cluster [DBG] pgmap v1535: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:29:53.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:29:53 smithi132 bash[27079]: cluster 2020-07-16T14:29:52.179302+0000 mgr.x (mgr.34562) 2465 : cluster [DBG] pgmap v1536: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:29:53.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:29:53 smithi188 bash[23329]: cluster 2020-07-16T14:29:52.179302+0000 mgr.x (mgr.34562) 2465 : cluster [DBG] pgmap v1536: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:29:55.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:29:55 smithi132 bash[27079]: cluster 2020-07-16T14:29:54.179815+0000 mgr.x (mgr.34562) 2466 : cluster [DBG] pgmap v1537: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:29:55.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:29:55 smithi188 bash[23329]: cluster 2020-07-16T14:29:54.179815+0000 mgr.x (mgr.34562) 2466 : cluster [DBG] pgmap v1537: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:29:57.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:29:57 smithi132 bash[27079]: cluster 2020-07-16T14:29:56.180251+0000 mgr.x (mgr.34562) 2467 : cluster [DBG] pgmap v1538: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:29:57.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:29:57 smithi132 bash[27079]: audit 2020-07-16T14:29:56.801399+0000 mon.b (mon.2) 625 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:29:57.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:29:57 smithi188 bash[23329]: cluster 2020-07-16T14:29:56.180251+0000 mgr.x (mgr.34562) 2467 : cluster [DBG] pgmap v1538: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:29:57.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:29:57 smithi188 bash[23329]: audit 2020-07-16T14:29:56.801399+0000 mon.b (mon.2) 625 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:29:58.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:29:58 smithi132 bash[27079]: cephadm 2020-07-16T14:29:56.802109+0000 mgr.x (mgr.34562) 2468 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:29:58.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:29:58 smithi132 bash[27079]: cephadm 2020-07-16T14:29:56.802599+0000 mgr.x (mgr.34562) 2469 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:29:58.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:29:58 smithi188 bash[23329]: cephadm 2020-07-16T14:29:56.802109+0000 mgr.x (mgr.34562) 2468 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:29:58.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:29:58 smithi188 bash[23329]: cephadm 2020-07-16T14:29:56.802599+0000 mgr.x (mgr.34562) 2469 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:29:59.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:29:59 smithi132 bash[27079]: cluster 2020-07-16T14:29:58.180752+0000 mgr.x (mgr.34562) 2470 : cluster [DBG] pgmap v1539: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:29:59.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:29:59 smithi188 bash[23329]: cluster 2020-07-16T14:29:58.180752+0000 mgr.x (mgr.34562) 2470 : cluster [DBG] pgmap v1539: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:30:00.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:30:00 smithi188 bash[23329]: cluster 2020-07-16T14:30:00.181173+0000 mgr.x (mgr.34562) 2471 : cluster [DBG] pgmap v1540: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:30:01.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:30:00 smithi132 bash[27079]: cluster 2020-07-16T14:30:00.181173+0000 mgr.x (mgr.34562) 2471 : cluster [DBG] pgmap v1540: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:30:03.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:30:03 smithi132 bash[27079]: cluster 2020-07-16T14:30:02.181553+0000 mgr.x (mgr.34562) 2472 : cluster [DBG] pgmap v1541: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:30:03.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:30:03 smithi188 bash[23329]: cluster 2020-07-16T14:30:02.181553+0000 mgr.x (mgr.34562) 2472 : cluster [DBG] pgmap v1541: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:30:05.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:30:05 smithi132 bash[27079]: cluster 2020-07-16T14:30:04.181913+0000 mgr.x (mgr.34562) 2473 : cluster [DBG] pgmap v1542: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:30:05.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:30:05 smithi188 bash[23329]: cluster 2020-07-16T14:30:04.181913+0000 mgr.x (mgr.34562) 2473 : cluster [DBG] pgmap v1542: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:30:07.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:30:07 smithi132 bash[27079]: cluster 2020-07-16T14:30:06.182256+0000 mgr.x (mgr.34562) 2474 : cluster [DBG] pgmap v1543: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:30:07.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:30:07 smithi188 bash[23329]: cluster 2020-07-16T14:30:06.182256+0000 mgr.x (mgr.34562) 2474 : cluster [DBG] pgmap v1543: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:30:09.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:30:09 smithi132 bash[27079]: cluster 2020-07-16T14:30:08.182698+0000 mgr.x (mgr.34562) 2475 : cluster [DBG] pgmap v1544: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:30:09.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:30:09 smithi188 bash[23329]: cluster 2020-07-16T14:30:08.182698+0000 mgr.x (mgr.34562) 2475 : cluster [DBG] pgmap v1544: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:30:10.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:30:10 smithi188 bash[23329]: cluster 2020-07-16T14:30:10.183164+0000 mgr.x (mgr.34562) 2476 : cluster [DBG] pgmap v1545: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:30:11.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:30:10 smithi132 bash[27079]: cluster 2020-07-16T14:30:10.183164+0000 mgr.x (mgr.34562) 2476 : cluster [DBG] pgmap v1545: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:30:12.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:30:11 smithi188 bash[23329]: audit 2020-07-16T14:30:11.818047+0000 mon.b (mon.2) 626 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:30:12.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:30:11 smithi132 bash[27079]: audit 2020-07-16T14:30:11.818047+0000 mon.b (mon.2) 626 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:30:12.815 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:30:13.075 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:30:13.075 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (52m) 9m ago 56m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:30:13.075 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (55m) 9m ago 55m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:30:13.076 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (53m) 9m ago 58m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:30:13.076 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (52m) 9m ago 60m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:30:13.076 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 9m ago 60m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:30:13.076 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (59m) 9m ago 59m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:30:13.076 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (59m) 9m ago 59m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:30:13.077 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (56m) 9m ago 56m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:30:13.077 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (56m) 9m ago 56m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:30:13.077 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (58m) 9m ago 58m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:30:13.077 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (58m) 9m ago 58m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:30:13.077 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (58m) 9m ago 58m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:30:13.078 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (57m) 9m ago 57m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:30:13.078 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (57m) 9m ago 57m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:30:13.078 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (57m) 9m ago 57m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:30:13.078 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (56m) 9m ago 56m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:30:13.078 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (56m) 9m ago 56m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:30:13.079 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (55m) 9m ago 56m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:30:13.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:30:12 smithi188 bash[23329]: cephadm 2020-07-16T14:30:11.818762+0000 mgr.x (mgr.34562) 2477 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:30:13.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:30:12 smithi188 bash[23329]: cephadm 2020-07-16T14:30:11.819001+0000 mgr.x (mgr.34562) 2478 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:30:13.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:30:12 smithi188 bash[23329]: cluster 2020-07-16T14:30:12.183689+0000 mgr.x (mgr.34562) 2479 : cluster [DBG] pgmap v1546: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:30:13.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:30:12 smithi132 bash[27079]: cephadm 2020-07-16T14:30:11.818762+0000 mgr.x (mgr.34562) 2477 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:30:13.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:30:12 smithi132 bash[27079]: cephadm 2020-07-16T14:30:11.819001+0000 mgr.x (mgr.34562) 2478 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:30:13.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:30:12 smithi132 bash[27079]: cluster 2020-07-16T14:30:12.183689+0000 mgr.x (mgr.34562) 2479 : cluster [DBG] pgmap v1546: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:30:13.371 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:30:13.371 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:30:13.371 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:30:13.371 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:30:13.372 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:30:13.372 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:30:13.372 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:30:13.372 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:30:13.372 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:30:13.373 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:30:13.373 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:30:13.373 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:30:13.373 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:30:13.373 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:30:13.374 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:30:13.374 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:30:13.374 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:30:14.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:30:13 smithi188 bash[23329]: audit 2020-07-16T14:30:12.803180+0000 mgr.x (mgr.34562) 2480 : audit [DBG] from='client.26440 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:30:14.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:30:13 smithi188 bash[23329]: audit 2020-07-16T14:30:13.070212+0000 mgr.x (mgr.34562) 2481 : audit [DBG] from='client.26446 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:30:14.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:30:13 smithi188 bash[23329]: audit 2020-07-16T14:30:13.370062+0000 mon.c (mon.1) 203 : audit [DBG] from='client.? 172.21.15.132:0/75937632' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:30:14.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:30:13 smithi132 bash[27079]: audit 2020-07-16T14:30:12.803180+0000 mgr.x (mgr.34562) 2480 : audit [DBG] from='client.26440 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:30:14.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:30:13 smithi132 bash[27079]: audit 2020-07-16T14:30:13.070212+0000 mgr.x (mgr.34562) 2481 : audit [DBG] from='client.26446 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:30:14.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:30:13 smithi132 bash[27079]: audit 2020-07-16T14:30:13.370062+0000 mon.c (mon.1) 203 : audit [DBG] from='client.? 172.21.15.132:0/75937632' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:30:15.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:30:14 smithi188 bash[23329]: cluster 2020-07-16T14:30:14.184219+0000 mgr.x (mgr.34562) 2482 : cluster [DBG] pgmap v1547: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:30:15.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:30:14 smithi132 bash[27079]: cluster 2020-07-16T14:30:14.184219+0000 mgr.x (mgr.34562) 2482 : cluster [DBG] pgmap v1547: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:30:17.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:30:17 smithi132 bash[27079]: cluster 2020-07-16T14:30:16.184689+0000 mgr.x (mgr.34562) 2483 : cluster [DBG] pgmap v1548: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:30:17.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:30:17 smithi188 bash[23329]: cluster 2020-07-16T14:30:16.184689+0000 mgr.x (mgr.34562) 2483 : cluster [DBG] pgmap v1548: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:30:19.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:30:19 smithi132 bash[27079]: cluster 2020-07-16T14:30:18.185174+0000 mgr.x (mgr.34562) 2484 : cluster [DBG] pgmap v1549: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:30:19.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:30:19 smithi188 bash[23329]: cluster 2020-07-16T14:30:18.185174+0000 mgr.x (mgr.34562) 2484 : cluster [DBG] pgmap v1549: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:30:20.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:30:20 smithi188 bash[23329]: cluster 2020-07-16T14:30:20.185577+0000 mgr.x (mgr.34562) 2485 : cluster [DBG] pgmap v1550: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:30:21.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:30:20 smithi132 bash[27079]: cluster 2020-07-16T14:30:20.185577+0000 mgr.x (mgr.34562) 2485 : cluster [DBG] pgmap v1550: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:30:23.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:30:23 smithi132 bash[27079]: cluster 2020-07-16T14:30:22.185991+0000 mgr.x (mgr.34562) 2486 : cluster [DBG] pgmap v1551: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:30:23.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:30:23 smithi188 bash[23329]: cluster 2020-07-16T14:30:22.185991+0000 mgr.x (mgr.34562) 2486 : cluster [DBG] pgmap v1551: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:30:25.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:30:25 smithi132 bash[27079]: cluster 2020-07-16T14:30:24.186445+0000 mgr.x (mgr.34562) 2487 : cluster [DBG] pgmap v1552: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:30:25.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:30:25 smithi188 bash[23329]: cluster 2020-07-16T14:30:24.186445+0000 mgr.x (mgr.34562) 2487 : cluster [DBG] pgmap v1552: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:30:27.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:30:27 smithi132 bash[27079]: cluster 2020-07-16T14:30:26.186851+0000 mgr.x (mgr.34562) 2488 : cluster [DBG] pgmap v1553: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:30:27.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:30:27 smithi132 bash[27079]: audit 2020-07-16T14:30:26.828336+0000 mon.b (mon.2) 627 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:30:27.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:30:27 smithi132 bash[27079]: audit 2020-07-16T14:30:26.829657+0000 mon.b (mon.2) 628 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:30:27.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:30:27 smithi132 bash[27079]: audit 2020-07-16T14:30:26.830851+0000 mon.b (mon.2) 629 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:30:27.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:30:27 smithi132 bash[27079]: audit 2020-07-16T14:30:26.832159+0000 mon.b (mon.2) 630 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:30:27.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:30:27 smithi132 bash[27079]: audit 2020-07-16T14:30:26.833313+0000 mon.b (mon.2) 631 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:30:27.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:30:27 smithi188 bash[23329]: cluster 2020-07-16T14:30:26.186851+0000 mgr.x (mgr.34562) 2488 : cluster [DBG] pgmap v1553: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:30:27.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:30:27 smithi188 bash[23329]: audit 2020-07-16T14:30:26.828336+0000 mon.b (mon.2) 627 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:30:27.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:30:27 smithi188 bash[23329]: audit 2020-07-16T14:30:26.829657+0000 mon.b (mon.2) 628 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:30:27.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:30:27 smithi188 bash[23329]: audit 2020-07-16T14:30:26.830851+0000 mon.b (mon.2) 629 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:30:27.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:30:27 smithi188 bash[23329]: audit 2020-07-16T14:30:26.832159+0000 mon.b (mon.2) 630 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:30:27.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:30:27 smithi188 bash[23329]: audit 2020-07-16T14:30:26.833313+0000 mon.b (mon.2) 631 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:30:28.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:30:28 smithi132 bash[27079]: audit 2020-07-16T14:30:26.828704+0000 mgr.x (mgr.34562) 2489 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:30:28.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:30:28 smithi132 bash[27079]: audit 2020-07-16T14:30:26.829933+0000 mgr.x (mgr.34562) 2490 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:30:28.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:30:28 smithi132 bash[27079]: audit 2020-07-16T14:30:26.831137+0000 mgr.x (mgr.34562) 2491 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:30:28.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:30:28 smithi132 bash[27079]: cephadm 2020-07-16T14:30:26.831876+0000 mgr.x (mgr.34562) 2492 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:30:28.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:30:28 smithi132 bash[27079]: cephadm 2020-07-16T14:30:26.833013+0000 mgr.x (mgr.34562) 2493 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:30:28.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:30:28 smithi132 bash[27079]: cephadm 2020-07-16T14:30:26.834066+0000 mgr.x (mgr.34562) 2494 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:30:28.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:30:28 smithi132 bash[27079]: cephadm 2020-07-16T14:30:26.834180+0000 mgr.x (mgr.34562) 2495 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:30:28.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:30:28 smithi188 bash[23329]: audit 2020-07-16T14:30:26.828704+0000 mgr.x (mgr.34562) 2489 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:30:28.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:30:28 smithi188 bash[23329]: audit 2020-07-16T14:30:26.829933+0000 mgr.x (mgr.34562) 2490 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:30:28.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:30:28 smithi188 bash[23329]: audit 2020-07-16T14:30:26.831137+0000 mgr.x (mgr.34562) 2491 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:30:28.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:30:28 smithi188 bash[23329]: cephadm 2020-07-16T14:30:26.831876+0000 mgr.x (mgr.34562) 2492 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:30:28.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:30:28 smithi188 bash[23329]: cephadm 2020-07-16T14:30:26.833013+0000 mgr.x (mgr.34562) 2493 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:30:28.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:30:28 smithi188 bash[23329]: cephadm 2020-07-16T14:30:26.834066+0000 mgr.x (mgr.34562) 2494 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:30:28.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:30:28 smithi188 bash[23329]: cephadm 2020-07-16T14:30:26.834180+0000 mgr.x (mgr.34562) 2495 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:30:29.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:30:29 smithi132 bash[27079]: cluster 2020-07-16T14:30:28.187252+0000 mgr.x (mgr.34562) 2496 : cluster [DBG] pgmap v1554: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:30:29.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:30:29 smithi188 bash[23329]: cluster 2020-07-16T14:30:28.187252+0000 mgr.x (mgr.34562) 2496 : cluster [DBG] pgmap v1554: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:30:30.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:30:30 smithi188 bash[23329]: audit 2020-07-16T14:30:29.699170+0000 mon.b (mon.2) 632 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:30:30.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:30:30 smithi188 bash[23329]: cephadm 2020-07-16T14:30:29.699852+0000 mgr.x (mgr.34562) 2497 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:30:30.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:30:30 smithi188 bash[23329]: cephadm 2020-07-16T14:30:29.700246+0000 mgr.x (mgr.34562) 2498 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:30:30.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:30:30 smithi188 bash[23329]: cluster 2020-07-16T14:30:30.187611+0000 mgr.x (mgr.34562) 2499 : cluster [DBG] pgmap v1555: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:30:31.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:30:30 smithi132 bash[27079]: audit 2020-07-16T14:30:29.699170+0000 mon.b (mon.2) 632 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:30:31.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:30:30 smithi132 bash[27079]: cephadm 2020-07-16T14:30:29.699852+0000 mgr.x (mgr.34562) 2497 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:30:31.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:30:30 smithi132 bash[27079]: cephadm 2020-07-16T14:30:29.700246+0000 mgr.x (mgr.34562) 2498 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:30:31.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:30:30 smithi132 bash[27079]: cluster 2020-07-16T14:30:30.187611+0000 mgr.x (mgr.34562) 2499 : cluster [DBG] pgmap v1555: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:30:33.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:30:33 smithi132 bash[27079]: cluster 2020-07-16T14:30:32.188030+0000 mgr.x (mgr.34562) 2500 : cluster [DBG] pgmap v1556: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:30:33.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:30:33 smithi188 bash[23329]: cluster 2020-07-16T14:30:32.188030+0000 mgr.x (mgr.34562) 2500 : cluster [DBG] pgmap v1556: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:30:35.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:30:35 smithi132 bash[27079]: cluster 2020-07-16T14:30:34.188429+0000 mgr.x (mgr.34562) 2501 : cluster [DBG] pgmap v1557: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:30:35.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:30:35 smithi188 bash[23329]: cluster 2020-07-16T14:30:34.188429+0000 mgr.x (mgr.34562) 2501 : cluster [DBG] pgmap v1557: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:30:37.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:30:37 smithi132 bash[27079]: cluster 2020-07-16T14:30:36.188787+0000 mgr.x (mgr.34562) 2502 : cluster [DBG] pgmap v1558: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:30:37.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:30:37 smithi188 bash[23329]: cluster 2020-07-16T14:30:36.188787+0000 mgr.x (mgr.34562) 2502 : cluster [DBG] pgmap v1558: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:30:39.544 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:30:39 smithi132 bash[27079]: cluster 2020-07-16T14:30:38.189274+0000 mgr.x (mgr.34562) 2503 : cluster [DBG] pgmap v1559: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:30:39.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:30:39 smithi188 bash[23329]: cluster 2020-07-16T14:30:38.189274+0000 mgr.x (mgr.34562) 2503 : cluster [DBG] pgmap v1559: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:30:40.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:30:40 smithi188 bash[23329]: cluster 2020-07-16T14:30:40.189816+0000 mgr.x (mgr.34562) 2504 : cluster [DBG] pgmap v1560: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:30:41.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:30:40 smithi132 bash[27079]: cluster 2020-07-16T14:30:40.189816+0000 mgr.x (mgr.34562) 2504 : cluster [DBG] pgmap v1560: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:30:43.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:30:43 smithi132 bash[27079]: cluster 2020-07-16T14:30:42.190325+0000 mgr.x (mgr.34562) 2505 : cluster [DBG] pgmap v1561: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:30:43.666 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:30:43.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:30:43 smithi188 bash[23329]: cluster 2020-07-16T14:30:42.190325+0000 mgr.x (mgr.34562) 2505 : cluster [DBG] pgmap v1561: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:30:43.927 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:30:43.927 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (53m) 9m ago 56m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:30:43.928 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (56m) 9m ago 56m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:30:43.928 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (53m) 9m ago 59m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:30:43.928 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (53m) 9m ago 61m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:30:43.928 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 9m ago 61m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:30:43.928 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (59m) 9m ago 59m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:30:43.929 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (59m) 9m ago 59m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:30:43.929 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (56m) 9m ago 56m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:30:43.929 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (56m) 9m ago 56m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:30:43.929 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (59m) 9m ago 59m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:30:43.930 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (58m) 9m ago 58m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:30:43.930 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (58m) 9m ago 58m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:30:43.930 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (58m) 9m ago 58m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:30:43.930 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (57m) 9m ago 58m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:30:43.930 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (57m) 9m ago 57m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:30:43.931 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (57m) 9m ago 57m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:30:43.931 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (57m) 9m ago 57m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:30:43.931 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (55m) 9m ago 56m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:30:44.222 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:30:44.223 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:30:44.223 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:30:44.223 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:30:44.223 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:30:44.223 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:30:44.224 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:30:44.224 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:30:44.224 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:30:44.224 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:30:44.224 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:30:44.225 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:30:44.225 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:30:44.225 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:30:44.225 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:30:44.225 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:30:44.226 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:30:44.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:30:44 smithi132 bash[27079]: audit 2020-07-16T14:30:44.221482+0000 mon.c (mon.1) 204 : audit [DBG] from='client.? 172.21.15.132:0/988627764' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:30:44.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:30:44 smithi188 bash[23329]: audit 2020-07-16T14:30:44.221482+0000 mon.c (mon.1) 204 : audit [DBG] from='client.? 172.21.15.132:0/988627764' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:30:45.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:30:45 smithi132 bash[27079]: audit 2020-07-16T14:30:43.654304+0000 mgr.x (mgr.34562) 2506 : audit [DBG] from='client.26458 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:30:45.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:30:45 smithi132 bash[27079]: audit 2020-07-16T14:30:43.922761+0000 mgr.x (mgr.34562) 2507 : audit [DBG] from='client.26464 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:30:45.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:30:45 smithi132 bash[27079]: cluster 2020-07-16T14:30:44.190782+0000 mgr.x (mgr.34562) 2508 : cluster [DBG] pgmap v1562: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:30:45.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:30:45 smithi132 bash[27079]: audit 2020-07-16T14:30:44.713826+0000 mon.b (mon.2) 633 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:30:45.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:30:45 smithi188 bash[23329]: audit 2020-07-16T14:30:43.654304+0000 mgr.x (mgr.34562) 2506 : audit [DBG] from='client.26458 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:30:45.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:30:45 smithi188 bash[23329]: audit 2020-07-16T14:30:43.922761+0000 mgr.x (mgr.34562) 2507 : audit [DBG] from='client.26464 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:30:45.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:30:45 smithi188 bash[23329]: cluster 2020-07-16T14:30:44.190782+0000 mgr.x (mgr.34562) 2508 : cluster [DBG] pgmap v1562: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:30:45.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:30:45 smithi188 bash[23329]: audit 2020-07-16T14:30:44.713826+0000 mon.b (mon.2) 633 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:30:46.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:30:46 smithi132 bash[27079]: cephadm 2020-07-16T14:30:44.714515+0000 mgr.x (mgr.34562) 2509 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:30:46.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:30:46 smithi132 bash[27079]: cephadm 2020-07-16T14:30:44.714602+0000 mgr.x (mgr.34562) 2510 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:30:46.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:30:46 smithi188 bash[23329]: cephadm 2020-07-16T14:30:44.714515+0000 mgr.x (mgr.34562) 2509 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:30:46.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:30:46 smithi188 bash[23329]: cephadm 2020-07-16T14:30:44.714602+0000 mgr.x (mgr.34562) 2510 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:30:47.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:30:47 smithi132 bash[27079]: cluster 2020-07-16T14:30:46.191253+0000 mgr.x (mgr.34562) 2511 : cluster [DBG] pgmap v1563: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:30:47.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:30:47 smithi188 bash[23329]: cluster 2020-07-16T14:30:46.191253+0000 mgr.x (mgr.34562) 2511 : cluster [DBG] pgmap v1563: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:30:49.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:30:49 smithi132 bash[27079]: cluster 2020-07-16T14:30:48.191778+0000 mgr.x (mgr.34562) 2512 : cluster [DBG] pgmap v1564: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:30:49.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:30:49 smithi188 bash[23329]: cluster 2020-07-16T14:30:48.191778+0000 mgr.x (mgr.34562) 2512 : cluster [DBG] pgmap v1564: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:30:50.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:30:50 smithi188 bash[23329]: cluster 2020-07-16T14:30:50.192146+0000 mgr.x (mgr.34562) 2513 : cluster [DBG] pgmap v1565: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:30:51.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:30:50 smithi132 bash[27079]: cluster 2020-07-16T14:30:50.192146+0000 mgr.x (mgr.34562) 2513 : cluster [DBG] pgmap v1565: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:30:53.536 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:30:53 smithi132 bash[27079]: cluster 2020-07-16T14:30:52.192604+0000 mgr.x (mgr.34562) 2514 : cluster [DBG] pgmap v1566: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:30:53.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:30:53 smithi188 bash[23329]: cluster 2020-07-16T14:30:52.192604+0000 mgr.x (mgr.34562) 2514 : cluster [DBG] pgmap v1566: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:30:55.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:30:55 smithi132 bash[27079]: cluster 2020-07-16T14:30:54.193117+0000 mgr.x (mgr.34562) 2515 : cluster [DBG] pgmap v1567: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:30:55.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:30:55 smithi188 bash[23329]: cluster 2020-07-16T14:30:54.193117+0000 mgr.x (mgr.34562) 2515 : cluster [DBG] pgmap v1567: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:30:57.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:30:57 smithi132 bash[27079]: cluster 2020-07-16T14:30:56.193607+0000 mgr.x (mgr.34562) 2516 : cluster [DBG] pgmap v1568: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:30:57.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:30:57 smithi188 bash[23329]: cluster 2020-07-16T14:30:56.193607+0000 mgr.x (mgr.34562) 2516 : cluster [DBG] pgmap v1568: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:30:59.533 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:30:59 smithi132 bash[27079]: cluster 2020-07-16T14:30:58.194012+0000 mgr.x (mgr.34562) 2517 : cluster [DBG] pgmap v1569: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:30:59.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:30:59 smithi188 bash[23329]: cluster 2020-07-16T14:30:58.194012+0000 mgr.x (mgr.34562) 2517 : cluster [DBG] pgmap v1569: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:31:00.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:00 smithi188 bash[23329]: audit 2020-07-16T14:30:59.723538+0000 mon.b (mon.2) 634 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:31:00.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:00 smithi188 bash[23329]: cephadm 2020-07-16T14:30:59.724243+0000 mgr.x (mgr.34562) 2518 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:31:00.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:00 smithi188 bash[23329]: cephadm 2020-07-16T14:30:59.724516+0000 mgr.x (mgr.34562) 2519 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:31:00.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:00 smithi188 bash[23329]: cluster 2020-07-16T14:31:00.194410+0000 mgr.x (mgr.34562) 2520 : cluster [DBG] pgmap v1570: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:31:01.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:00 smithi132 bash[27079]: audit 2020-07-16T14:30:59.723538+0000 mon.b (mon.2) 634 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:31:01.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:00 smithi132 bash[27079]: cephadm 2020-07-16T14:30:59.724243+0000 mgr.x (mgr.34562) 2518 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:31:01.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:00 smithi132 bash[27079]: cephadm 2020-07-16T14:30:59.724516+0000 mgr.x (mgr.34562) 2519 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:31:01.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:00 smithi132 bash[27079]: cluster 2020-07-16T14:31:00.194410+0000 mgr.x (mgr.34562) 2520 : cluster [DBG] pgmap v1570: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:31:03.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:03 smithi132 bash[27079]: cluster 2020-07-16T14:31:02.194880+0000 mgr.x (mgr.34562) 2521 : cluster [DBG] pgmap v1571: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:31:03.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:03 smithi188 bash[23329]: cluster 2020-07-16T14:31:02.194880+0000 mgr.x (mgr.34562) 2521 : cluster [DBG] pgmap v1571: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:31:05.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:05 smithi132 bash[27079]: cluster 2020-07-16T14:31:04.195459+0000 mgr.x (mgr.34562) 2522 : cluster [DBG] pgmap v1572: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:31:05.675 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:05 smithi188 bash[23329]: cluster 2020-07-16T14:31:04.195459+0000 mgr.x (mgr.34562) 2522 : cluster [DBG] pgmap v1572: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:31:07.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:07 smithi132 bash[27079]: cluster 2020-07-16T14:31:06.195968+0000 mgr.x (mgr.34562) 2523 : cluster [DBG] pgmap v1573: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:31:07.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:07 smithi188 bash[23329]: cluster 2020-07-16T14:31:06.195968+0000 mgr.x (mgr.34562) 2523 : cluster [DBG] pgmap v1573: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:31:09.542 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:09 smithi132 bash[27079]: cluster 2020-07-16T14:31:08.196547+0000 mgr.x (mgr.34562) 2524 : cluster [DBG] pgmap v1574: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:31:09.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:09 smithi188 bash[23329]: cluster 2020-07-16T14:31:08.196547+0000 mgr.x (mgr.34562) 2524 : cluster [DBG] pgmap v1574: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:31:10.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:10 smithi188 bash[23329]: cluster 2020-07-16T14:31:10.196966+0000 mgr.x (mgr.34562) 2525 : cluster [DBG] pgmap v1575: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:31:11.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:10 smithi132 bash[27079]: cluster 2020-07-16T14:31:10.196966+0000 mgr.x (mgr.34562) 2525 : cluster [DBG] pgmap v1575: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:31:13.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:13 smithi132 bash[27079]: cluster 2020-07-16T14:31:12.197451+0000 mgr.x (mgr.34562) 2526 : cluster [DBG] pgmap v1576: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:31:13.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:13 smithi188 bash[23329]: cluster 2020-07-16T14:31:12.197451+0000 mgr.x (mgr.34562) 2526 : cluster [DBG] pgmap v1576: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:31:14.519 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:31:14.788 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:31:14.788 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (54m) 10m ago 57m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:31:14.789 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (56m) 10m ago 56m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:31:14.789 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (54m) 10m ago 59m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:31:14.789 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (53m) 10m ago 61m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:31:14.789 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 10m ago 61m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:31:14.790 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (60m) 10m ago 60m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:31:14.790 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (60m) 10m ago 60m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:31:14.790 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (57m) 10m ago 57m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:31:14.790 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (57m) 10m ago 57m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:31:14.790 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (59m) 10m ago 59m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:31:14.791 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (59m) 10m ago 59m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:31:14.791 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (59m) 10m ago 59m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:31:14.791 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (58m) 10m ago 58m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:31:14.791 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (58m) 10m ago 58m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:31:14.792 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (58m) 10m ago 58m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:31:14.792 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (57m) 10m ago 57m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:31:14.792 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (57m) 10m ago 57m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:31:14.792 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (56m) 10m ago 57m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:31:15.085 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:31:15.086 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:31:15.086 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:31:15.086 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:31:15.086 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:31:15.087 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:31:15.087 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:31:15.087 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:31:15.087 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:31:15.087 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:31:15.089 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:31:15.089 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:31:15.089 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:31:15.089 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:31:15.090 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:31:15.090 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:31:15.090 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:31:15.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:15 smithi132 bash[27079]: cluster 2020-07-16T14:31:14.197807+0000 mgr.x (mgr.34562) 2527 : cluster [DBG] pgmap v1577: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:31:15.596 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:15 smithi132 bash[27079]: audit 2020-07-16T14:31:14.740185+0000 mon.b (mon.2) 635 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:31:15.596 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:15 smithi132 bash[27079]: audit 2020-07-16T14:31:15.084630+0000 mon.c (mon.1) 205 : audit [DBG] from='client.? 172.21.15.132:0/138028213' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:31:15.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:15 smithi188 bash[23329]: cluster 2020-07-16T14:31:14.197807+0000 mgr.x (mgr.34562) 2527 : cluster [DBG] pgmap v1577: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:31:15.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:15 smithi188 bash[23329]: audit 2020-07-16T14:31:14.740185+0000 mon.b (mon.2) 635 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:31:15.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:15 smithi188 bash[23329]: audit 2020-07-16T14:31:15.084630+0000 mon.c (mon.1) 205 : audit [DBG] from='client.? 172.21.15.132:0/138028213' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:31:16.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:16 smithi132 bash[27079]: audit 2020-07-16T14:31:14.507389+0000 mgr.x (mgr.34562) 2528 : audit [DBG] from='client.26476 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:31:16.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:16 smithi132 bash[27079]: cephadm 2020-07-16T14:31:14.740881+0000 mgr.x (mgr.34562) 2529 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:31:16.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:16 smithi132 bash[27079]: cephadm 2020-07-16T14:31:14.740964+0000 mgr.x (mgr.34562) 2530 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:31:16.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:16 smithi132 bash[27079]: audit 2020-07-16T14:31:14.783913+0000 mgr.x (mgr.34562) 2531 : audit [DBG] from='client.26482 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:31:16.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:16 smithi188 bash[23329]: audit 2020-07-16T14:31:14.507389+0000 mgr.x (mgr.34562) 2528 : audit [DBG] from='client.26476 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:31:16.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:16 smithi188 bash[23329]: cephadm 2020-07-16T14:31:14.740881+0000 mgr.x (mgr.34562) 2529 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:31:16.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:16 smithi188 bash[23329]: cephadm 2020-07-16T14:31:14.740964+0000 mgr.x (mgr.34562) 2530 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:31:16.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:16 smithi188 bash[23329]: audit 2020-07-16T14:31:14.783913+0000 mgr.x (mgr.34562) 2531 : audit [DBG] from='client.26482 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:31:17.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:17 smithi132 bash[27079]: cluster 2020-07-16T14:31:16.198364+0000 mgr.x (mgr.34562) 2532 : cluster [DBG] pgmap v1578: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:31:17.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:17 smithi188 bash[23329]: cluster 2020-07-16T14:31:16.198364+0000 mgr.x (mgr.34562) 2532 : cluster [DBG] pgmap v1578: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:31:19.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:19 smithi132 bash[27079]: cluster 2020-07-16T14:31:18.198832+0000 mgr.x (mgr.34562) 2533 : cluster [DBG] pgmap v1579: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:31:19.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:19 smithi188 bash[23329]: cluster 2020-07-16T14:31:18.198832+0000 mgr.x (mgr.34562) 2533 : cluster [DBG] pgmap v1579: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:31:20.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:20 smithi188 bash[23329]: cluster 2020-07-16T14:31:20.199310+0000 mgr.x (mgr.34562) 2534 : cluster [DBG] pgmap v1580: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:31:21.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:20 smithi132 bash[27079]: cluster 2020-07-16T14:31:20.199310+0000 mgr.x (mgr.34562) 2534 : cluster [DBG] pgmap v1580: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:31:23.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:23 smithi132 bash[27079]: cluster 2020-07-16T14:31:22.199692+0000 mgr.x (mgr.34562) 2535 : cluster [DBG] pgmap v1581: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:31:23.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:23 smithi188 bash[23329]: cluster 2020-07-16T14:31:22.199692+0000 mgr.x (mgr.34562) 2535 : cluster [DBG] pgmap v1581: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:31:25.534 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:25 smithi132 bash[27079]: cluster 2020-07-16T14:31:24.200198+0000 mgr.x (mgr.34562) 2536 : cluster [DBG] pgmap v1582: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:31:25.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:25 smithi188 bash[23329]: cluster 2020-07-16T14:31:24.200198+0000 mgr.x (mgr.34562) 2536 : cluster [DBG] pgmap v1582: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:31:27.538 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:27 smithi132 bash[27079]: cluster 2020-07-16T14:31:26.200738+0000 mgr.x (mgr.34562) 2537 : cluster [DBG] pgmap v1583: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:31:27.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:27 smithi188 bash[23329]: cluster 2020-07-16T14:31:26.200738+0000 mgr.x (mgr.34562) 2537 : cluster [DBG] pgmap v1583: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:31:29.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:29 smithi132 bash[27079]: cluster 2020-07-16T14:31:28.201262+0000 mgr.x (mgr.34562) 2538 : cluster [DBG] pgmap v1584: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:31:29.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:29 smithi188 bash[23329]: cluster 2020-07-16T14:31:28.201262+0000 mgr.x (mgr.34562) 2538 : cluster [DBG] pgmap v1584: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:31:30.691 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:30 smithi132 bash[27079]: audit 2020-07-16T14:31:29.757436+0000 mon.b (mon.2) 636 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T14:31:30.691 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:30 smithi132 bash[27079]: audit 2020-07-16T14:31:29.757683+0000 mon.b (mon.2) 637 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T14:31:30.691 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:30 smithi132 bash[27079]: cluster 2020-07-16T14:31:30.201624+0000 mgr.x (mgr.34562) 2539 : cluster [DBG] pgmap v1585: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:31:30.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:30 smithi188 bash[23329]: audit 2020-07-16T14:31:29.757436+0000 mon.b (mon.2) 636 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T14:31:30.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:30 smithi188 bash[23329]: audit 2020-07-16T14:31:29.757683+0000 mon.b (mon.2) 637 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T14:31:30.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:30 smithi188 bash[23329]: cluster 2020-07-16T14:31:30.201624+0000 mgr.x (mgr.34562) 2539 : cluster [DBG] pgmap v1585: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:31:32.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:32 smithi132 bash[27079]: audit 2020-07-16T14:31:32.163697+0000 mon.b (mon.2) 638 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:31:32.162208\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162267\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162328\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162359\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162518\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162638\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162735\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162831\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162864\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:31:32.162932\", \"last_device_update\": \"2020-07-16T14:03:05.154706\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:23:07.040663\"}"}]: dispatch 2020-07-16T14:31:32.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:32 smithi132 bash[27079]: audit 2020-07-16T14:31:32.164498+0000 mon.c (mon.1) 206 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:31:32.162208\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162267\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162328\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162359\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162518\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162638\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162735\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162831\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162864\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:31:32.162932\", \"last_device_update\": \"2020-07-16T14:03:05.154706\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:23:07.040663\"}"}]: dispatch 2020-07-16T14:31:32.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:32 smithi132 bash[27079]: audit 2020-07-16T14:31:32.167140+0000 mon.c (mon.1) 207 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:31:32.162208\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162267\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162328\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162359\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162518\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162638\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162735\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162831\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162864\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:31:32.162932\", \"last_device_update\": \"2020-07-16T14:03:05.154706\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:23:07.040663\"}"}]': finished 2020-07-16T14:31:32.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:32 smithi188 bash[23329]: audit 2020-07-16T14:31:32.163697+0000 mon.b (mon.2) 638 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:31:32.162208\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162267\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162328\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162359\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162518\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162638\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162735\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162831\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162864\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:31:32.162932\", \"last_device_update\": \"2020-07-16T14:03:05.154706\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:23:07.040663\"}"}]: dispatch 2020-07-16T14:31:32.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:32 smithi188 bash[23329]: audit 2020-07-16T14:31:32.164498+0000 mon.c (mon.1) 206 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:31:32.162208\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162267\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162328\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162359\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162518\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162638\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162735\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162831\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162864\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:31:32.162932\", \"last_device_update\": \"2020-07-16T14:03:05.154706\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:23:07.040663\"}"}]: dispatch 2020-07-16T14:31:32.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:32 smithi188 bash[23329]: audit 2020-07-16T14:31:32.167140+0000 mon.c (mon.1) 207 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:31:32.162208\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162267\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162328\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162359\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162518\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162638\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162735\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162831\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162864\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:31:32.162932\", \"last_device_update\": \"2020-07-16T14:03:05.154706\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:23:07.040663\"}"}]': finished 2020-07-16T14:31:33.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:33 smithi132 bash[27079]: cluster 2020-07-16T14:31:32.202080+0000 mgr.x (mgr.34562) 2540 : cluster [DBG] pgmap v1586: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:31:33.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:33 smithi132 bash[27079]: audit 2020-07-16T14:31:32.263398+0000 mon.b (mon.2) 639 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.261903\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.261975\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262006\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262168\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262268\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262400\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262501\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262535\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262564\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:31:32.262647\", \"last_device_update\": \"2020-07-16T14:04:10.964865\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:23:07.043105\"}"}]: dispatch 2020-07-16T14:31:33.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:33 smithi132 bash[27079]: audit 2020-07-16T14:31:32.264052+0000 mon.c (mon.1) 208 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.261903\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.261975\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262006\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262168\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262268\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262400\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262501\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262535\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262564\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:31:32.262647\", \"last_device_update\": \"2020-07-16T14:04:10.964865\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:23:07.043105\"}"}]: dispatch 2020-07-16T14:31:33.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:33 smithi132 bash[27079]: audit 2020-07-16T14:31:32.266033+0000 mon.c (mon.1) 209 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.261903\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.261975\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262006\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262168\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262268\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262400\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262501\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262535\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262564\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:31:32.262647\", \"last_device_update\": \"2020-07-16T14:04:10.964865\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:23:07.043105\"}"}]': finished 2020-07-16T14:31:33.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:33 smithi132 bash[27079]: audit 2020-07-16T14:31:32.268848+0000 mon.b (mon.2) 640 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:31:33.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:33 smithi132 bash[27079]: audit 2020-07-16T14:31:32.269130+0000 mgr.x (mgr.34562) 2541 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:31:33.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:33 smithi132 bash[27079]: audit 2020-07-16T14:31:32.269807+0000 mon.b (mon.2) 641 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:31:33.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:33 smithi132 bash[27079]: audit 2020-07-16T14:31:32.270037+0000 mgr.x (mgr.34562) 2542 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:31:33.532 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:33 smithi132 bash[27079]: audit 2020-07-16T14:31:32.270601+0000 mon.b (mon.2) 642 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:31:33.532 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:33 smithi132 bash[27079]: audit 2020-07-16T14:31:32.270815+0000 mgr.x (mgr.34562) 2543 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:31:33.532 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:33 smithi132 bash[27079]: cephadm 2020-07-16T14:31:32.271324+0000 mgr.x (mgr.34562) 2544 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:31:33.532 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:33 smithi132 bash[27079]: audit 2020-07-16T14:31:32.271494+0000 mon.b (mon.2) 643 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:31:33.532 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:33 smithi132 bash[27079]: cephadm 2020-07-16T14:31:32.272122+0000 mgr.x (mgr.34562) 2545 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:31:33.533 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:33 smithi132 bash[27079]: audit 2020-07-16T14:31:32.272332+0000 mon.b (mon.2) 644 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:31:33.533 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:33 smithi132 bash[27079]: cephadm 2020-07-16T14:31:32.272831+0000 mgr.x (mgr.34562) 2546 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:31:33.533 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:33 smithi132 bash[27079]: cephadm 2020-07-16T14:31:32.272970+0000 mgr.x (mgr.34562) 2547 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:31:33.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:33 smithi188 bash[23329]: cluster 2020-07-16T14:31:32.202080+0000 mgr.x (mgr.34562) 2540 : cluster [DBG] pgmap v1586: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:31:33.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:33 smithi188 bash[23329]: audit 2020-07-16T14:31:32.263398+0000 mon.b (mon.2) 639 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.261903\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.261975\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262006\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262168\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262268\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262400\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262501\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262535\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262564\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:31:32.262647\", \"last_device_update\": \"2020-07-16T14:04:10.964865\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:23:07.043105\"}"}]: dispatch 2020-07-16T14:31:33.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:33 smithi188 bash[23329]: audit 2020-07-16T14:31:32.264052+0000 mon.c (mon.1) 208 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.261903\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.261975\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262006\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262168\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262268\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262400\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262501\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262535\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262564\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:31:32.262647\", \"last_device_update\": \"2020-07-16T14:04:10.964865\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:23:07.043105\"}"}]: dispatch 2020-07-16T14:31:33.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:33 smithi188 bash[23329]: audit 2020-07-16T14:31:32.266033+0000 mon.c (mon.1) 209 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.261903\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.261975\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262006\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262168\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262268\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262400\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262501\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262535\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262564\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:31:32.262647\", \"last_device_update\": \"2020-07-16T14:04:10.964865\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:23:07.043105\"}"}]': finished 2020-07-16T14:31:33.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:33 smithi188 bash[23329]: audit 2020-07-16T14:31:32.268848+0000 mon.b (mon.2) 640 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:31:33.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:33 smithi188 bash[23329]: audit 2020-07-16T14:31:32.269130+0000 mgr.x (mgr.34562) 2541 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:31:33.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:33 smithi188 bash[23329]: audit 2020-07-16T14:31:32.269807+0000 mon.b (mon.2) 641 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:31:33.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:33 smithi188 bash[23329]: audit 2020-07-16T14:31:32.270037+0000 mgr.x (mgr.34562) 2542 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:31:33.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:33 smithi188 bash[23329]: audit 2020-07-16T14:31:32.270601+0000 mon.b (mon.2) 642 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:31:33.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:33 smithi188 bash[23329]: audit 2020-07-16T14:31:32.270815+0000 mgr.x (mgr.34562) 2543 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:31:33.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:33 smithi188 bash[23329]: cephadm 2020-07-16T14:31:32.271324+0000 mgr.x (mgr.34562) 2544 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:31:33.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:33 smithi188 bash[23329]: audit 2020-07-16T14:31:32.271494+0000 mon.b (mon.2) 643 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:31:33.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:33 smithi188 bash[23329]: cephadm 2020-07-16T14:31:32.272122+0000 mgr.x (mgr.34562) 2545 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:31:33.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:33 smithi188 bash[23329]: audit 2020-07-16T14:31:32.272332+0000 mon.b (mon.2) 644 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:31:33.675 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:33 smithi188 bash[23329]: cephadm 2020-07-16T14:31:32.272831+0000 mgr.x (mgr.34562) 2546 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:31:33.675 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:33 smithi188 bash[23329]: cephadm 2020-07-16T14:31:32.272970+0000 mgr.x (mgr.34562) 2547 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:31:35.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:35 smithi132 bash[27079]: cluster 2020-07-16T14:31:34.202482+0000 mgr.x (mgr.34562) 2548 : cluster [DBG] pgmap v1587: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:31:35.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:35 smithi132 bash[27079]: audit 2020-07-16T14:31:34.938822+0000 mon.b (mon.2) 645 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:31:35.678 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:35 smithi188 bash[23329]: cluster 2020-07-16T14:31:34.202482+0000 mgr.x (mgr.34562) 2548 : cluster [DBG] pgmap v1587: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:31:35.678 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:35 smithi188 bash[23329]: audit 2020-07-16T14:31:34.938822+0000 mon.b (mon.2) 645 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:31:36.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:36 smithi132 bash[27079]: cephadm 2020-07-16T14:31:34.939488+0000 mgr.x (mgr.34562) 2549 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:31:36.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:36 smithi132 bash[27079]: cephadm 2020-07-16T14:31:34.939593+0000 mgr.x (mgr.34562) 2550 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:31:36.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:36 smithi188 bash[23329]: cephadm 2020-07-16T14:31:34.939488+0000 mgr.x (mgr.34562) 2549 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:31:36.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:36 smithi188 bash[23329]: cephadm 2020-07-16T14:31:34.939593+0000 mgr.x (mgr.34562) 2550 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:31:37.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:37 smithi132 bash[27079]: cluster 2020-07-16T14:31:36.202824+0000 mgr.x (mgr.34562) 2551 : cluster [DBG] pgmap v1588: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:31:37.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:37 smithi188 bash[23329]: cluster 2020-07-16T14:31:36.202824+0000 mgr.x (mgr.34562) 2551 : cluster [DBG] pgmap v1588: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:31:39.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:39 smithi132 bash[27079]: cluster 2020-07-16T14:31:38.203211+0000 mgr.x (mgr.34562) 2552 : cluster [DBG] pgmap v1589: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:31:39.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:39 smithi188 bash[23329]: cluster 2020-07-16T14:31:38.203211+0000 mgr.x (mgr.34562) 2552 : cluster [DBG] pgmap v1589: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:31:40.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:40 smithi188 bash[23329]: cluster 2020-07-16T14:31:40.203668+0000 mgr.x (mgr.34562) 2553 : cluster [DBG] pgmap v1590: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:31:41.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:40 smithi132 bash[27079]: cluster 2020-07-16T14:31:40.203668+0000 mgr.x (mgr.34562) 2553 : cluster [DBG] pgmap v1590: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:31:43.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:43 smithi132 bash[27079]: cluster 2020-07-16T14:31:42.204202+0000 mgr.x (mgr.34562) 2554 : cluster [DBG] pgmap v1591: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:31:43.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:43 smithi188 bash[23329]: cluster 2020-07-16T14:31:42.204202+0000 mgr.x (mgr.34562) 2554 : cluster [DBG] pgmap v1591: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:31:45.387 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:31:45.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:45 smithi132 bash[27079]: cluster 2020-07-16T14:31:44.204639+0000 mgr.x (mgr.34562) 2555 : cluster [DBG] pgmap v1592: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:31:45.652 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:31:45.652 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (54m) 13s ago 57m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:31:45.653 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (57m) 13s ago 57m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:31:45.653 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (54m) 13s ago 60m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:31:45.653 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (54m) 13s ago 62m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:31:45.653 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 13s ago 62m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:31:45.653 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (60m) 13s ago 60m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:31:45.654 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (60m) 13s ago 60m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:31:45.654 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (57m) 13s ago 57m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:31:45.658 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (57m) 13s ago 57m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:31:45.658 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (60m) 13s ago 60m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:31:45.658 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (59m) 13s ago 59m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:31:45.658 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (59m) 13s ago 59m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:31:45.659 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (59m) 13s ago 59m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:31:45.659 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (58m) 13s ago 59m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:31:45.659 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (58m) 13s ago 58m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:31:45.659 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (58m) 13s ago 58m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:31:45.659 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (58m) 13s ago 58m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:31:45.659 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (56m) 13s ago 57m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:31:45.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:45 smithi188 bash[23329]: cluster 2020-07-16T14:31:44.204639+0000 mgr.x (mgr.34562) 2555 : cluster [DBG] pgmap v1592: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:31:45.952 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:31:45.952 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:31:45.953 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:31:45.953 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:31:45.953 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:31:45.953 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:31:45.954 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:31:45.954 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:31:45.954 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:31:45.954 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:31:45.954 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:31:45.955 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:31:45.955 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:31:45.955 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:31:45.955 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:31:45.955 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:31:45.956 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:31:46.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:46 smithi132 bash[27079]: audit 2020-07-16T14:31:45.374445+0000 mgr.x (mgr.34562) 2556 : audit [DBG] from='client.26494 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:31:46.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:46 smithi132 bash[27079]: audit 2020-07-16T14:31:45.951460+0000 mon.c (mon.1) 210 : audit [DBG] from='client.? 172.21.15.132:0/2754439285' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:31:46.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:46 smithi188 bash[23329]: audit 2020-07-16T14:31:45.374445+0000 mgr.x (mgr.34562) 2556 : audit [DBG] from='client.26494 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:31:46.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:46 smithi188 bash[23329]: audit 2020-07-16T14:31:45.951460+0000 mon.c (mon.1) 210 : audit [DBG] from='client.? 172.21.15.132:0/2754439285' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:31:47.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:47 smithi132 bash[27079]: audit 2020-07-16T14:31:45.647574+0000 mgr.x (mgr.34562) 2557 : audit [DBG] from='client.26500 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:31:47.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:47 smithi132 bash[27079]: cluster 2020-07-16T14:31:46.205044+0000 mgr.x (mgr.34562) 2558 : cluster [DBG] pgmap v1593: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:31:47.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:47 smithi188 bash[23329]: audit 2020-07-16T14:31:45.647574+0000 mgr.x (mgr.34562) 2557 : audit [DBG] from='client.26500 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:31:47.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:47 smithi188 bash[23329]: cluster 2020-07-16T14:31:46.205044+0000 mgr.x (mgr.34562) 2558 : cluster [DBG] pgmap v1593: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:31:49.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:49 smithi132 bash[27079]: cluster 2020-07-16T14:31:48.205505+0000 mgr.x (mgr.34562) 2559 : cluster [DBG] pgmap v1594: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:31:49.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:49 smithi188 bash[23329]: cluster 2020-07-16T14:31:48.205505+0000 mgr.x (mgr.34562) 2559 : cluster [DBG] pgmap v1594: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:31:50.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:50 smithi188 bash[23329]: audit 2020-07-16T14:31:49.948828+0000 mon.b (mon.2) 646 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:31:50.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:50 smithi188 bash[23329]: cephadm 2020-07-16T14:31:49.949508+0000 mgr.x (mgr.34562) 2560 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:31:50.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:50 smithi188 bash[23329]: cephadm 2020-07-16T14:31:49.949590+0000 mgr.x (mgr.34562) 2561 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:31:50.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:50 smithi188 bash[23329]: cluster 2020-07-16T14:31:50.205962+0000 mgr.x (mgr.34562) 2562 : cluster [DBG] pgmap v1595: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:31:51.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:50 smithi132 bash[27079]: audit 2020-07-16T14:31:49.948828+0000 mon.b (mon.2) 646 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:31:51.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:50 smithi132 bash[27079]: cephadm 2020-07-16T14:31:49.949508+0000 mgr.x (mgr.34562) 2560 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:31:51.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:50 smithi132 bash[27079]: cephadm 2020-07-16T14:31:49.949590+0000 mgr.x (mgr.34562) 2561 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:31:51.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:50 smithi132 bash[27079]: cluster 2020-07-16T14:31:50.205962+0000 mgr.x (mgr.34562) 2562 : cluster [DBG] pgmap v1595: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:31:53.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:53 smithi132 bash[27079]: cluster 2020-07-16T14:31:52.206326+0000 mgr.x (mgr.34562) 2563 : cluster [DBG] pgmap v1596: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:31:53.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:53 smithi188 bash[23329]: cluster 2020-07-16T14:31:52.206326+0000 mgr.x (mgr.34562) 2563 : cluster [DBG] pgmap v1596: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:31:55.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:55 smithi132 bash[27079]: cluster 2020-07-16T14:31:54.206797+0000 mgr.x (mgr.34562) 2564 : cluster [DBG] pgmap v1597: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:31:55.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:55 smithi188 bash[23329]: cluster 2020-07-16T14:31:54.206797+0000 mgr.x (mgr.34562) 2564 : cluster [DBG] pgmap v1597: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:31:57.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:57 smithi132 bash[27079]: cluster 2020-07-16T14:31:56.207306+0000 mgr.x (mgr.34562) 2565 : cluster [DBG] pgmap v1598: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:31:57.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:57 smithi188 bash[23329]: cluster 2020-07-16T14:31:56.207306+0000 mgr.x (mgr.34562) 2565 : cluster [DBG] pgmap v1598: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:31:59.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:31:59 smithi132 bash[27079]: cluster 2020-07-16T14:31:58.207779+0000 mgr.x (mgr.34562) 2566 : cluster [DBG] pgmap v1599: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:31:59.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:31:59 smithi188 bash[23329]: cluster 2020-07-16T14:31:58.207779+0000 mgr.x (mgr.34562) 2566 : cluster [DBG] pgmap v1599: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:32:00.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:32:00 smithi188 bash[23329]: cluster 2020-07-16T14:32:00.208164+0000 mgr.x (mgr.34562) 2567 : cluster [DBG] pgmap v1600: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:32:01.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:32:00 smithi132 bash[27079]: cluster 2020-07-16T14:32:00.208164+0000 mgr.x (mgr.34562) 2567 : cluster [DBG] pgmap v1600: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:32:03.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:32:03 smithi132 bash[27079]: cluster 2020-07-16T14:32:02.208578+0000 mgr.x (mgr.34562) 2568 : cluster [DBG] pgmap v1601: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:32:03.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:32:03 smithi188 bash[23329]: cluster 2020-07-16T14:32:02.208578+0000 mgr.x (mgr.34562) 2568 : cluster [DBG] pgmap v1601: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:32:05.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:32:05 smithi132 bash[27079]: cluster 2020-07-16T14:32:04.208962+0000 mgr.x (mgr.34562) 2569 : cluster [DBG] pgmap v1602: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:32:05.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:32:05 smithi132 bash[27079]: audit 2020-07-16T14:32:04.951501+0000 mon.b (mon.2) 647 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:32:05.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:32:05 smithi188 bash[23329]: cluster 2020-07-16T14:32:04.208962+0000 mgr.x (mgr.34562) 2569 : cluster [DBG] pgmap v1602: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:32:05.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:32:05 smithi188 bash[23329]: audit 2020-07-16T14:32:04.951501+0000 mon.b (mon.2) 647 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:32:06.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:32:06 smithi132 bash[27079]: cephadm 2020-07-16T14:32:04.952233+0000 mgr.x (mgr.34562) 2570 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:32:06.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:32:06 smithi132 bash[27079]: cephadm 2020-07-16T14:32:04.952666+0000 mgr.x (mgr.34562) 2571 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:32:06.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:32:06 smithi188 bash[23329]: cephadm 2020-07-16T14:32:04.952233+0000 mgr.x (mgr.34562) 2570 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:32:06.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:32:06 smithi188 bash[23329]: cephadm 2020-07-16T14:32:04.952666+0000 mgr.x (mgr.34562) 2571 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:32:07.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:32:07 smithi132 bash[27079]: cluster 2020-07-16T14:32:06.209462+0000 mgr.x (mgr.34562) 2572 : cluster [DBG] pgmap v1603: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:32:07.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:32:07 smithi188 bash[23329]: cluster 2020-07-16T14:32:06.209462+0000 mgr.x (mgr.34562) 2572 : cluster [DBG] pgmap v1603: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:32:09.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:32:09 smithi188 bash[23329]: cluster 2020-07-16T14:32:08.209922+0000 mgr.x (mgr.34562) 2573 : cluster [DBG] pgmap v1604: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:32:09.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:32:09 smithi132 bash[27079]: cluster 2020-07-16T14:32:08.209922+0000 mgr.x (mgr.34562) 2573 : cluster [DBG] pgmap v1604: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:32:10.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:32:10 smithi188 bash[23329]: cluster 2020-07-16T14:32:10.210364+0000 mgr.x (mgr.34562) 2574 : cluster [DBG] pgmap v1605: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:32:11.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:32:10 smithi132 bash[27079]: cluster 2020-07-16T14:32:10.210364+0000 mgr.x (mgr.34562) 2574 : cluster [DBG] pgmap v1605: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:32:13.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:32:13 smithi132 bash[27079]: cluster 2020-07-16T14:32:12.210937+0000 mgr.x (mgr.34562) 2575 : cluster [DBG] pgmap v1606: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:32:13.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:32:13 smithi188 bash[23329]: cluster 2020-07-16T14:32:12.210937+0000 mgr.x (mgr.34562) 2575 : cluster [DBG] pgmap v1606: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:32:15.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:32:15 smithi132 bash[27079]: cluster 2020-07-16T14:32:14.211474+0000 mgr.x (mgr.34562) 2576 : cluster [DBG] pgmap v1607: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:32:15.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:32:15 smithi188 bash[23329]: cluster 2020-07-16T14:32:14.211474+0000 mgr.x (mgr.34562) 2576 : cluster [DBG] pgmap v1607: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:32:16.251 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:32:16.512 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:32:16.642 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (55m) 44s ago 58m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:32:16.642 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (57m) 44s ago 57m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:32:16.643 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (55m) 44s ago 60m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:32:16.643 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (54m) 44s ago 62m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:32:16.643 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 44s ago 62m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:32:16.643 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (61m) 44s ago 61m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:32:16.644 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (61m) 44s ago 61m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:32:16.644 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (58m) 44s ago 58m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:32:16.644 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (58m) 44s ago 58m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:32:16.644 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (60m) 44s ago 60m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:32:16.644 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (60m) 44s ago 60m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:32:16.645 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (60m) 44s ago 60m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:32:16.645 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (59m) 44s ago 59m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:32:16.645 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (59m) 44s ago 59m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:32:16.645 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (59m) 44s ago 59m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:32:16.645 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (58m) 44s ago 58m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:32:16.646 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (58m) 44s ago 58m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:32:16.646 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (57m) 44s ago 58m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:32:16.810 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:32:16.810 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:32:16.811 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:32:16.811 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:32:16.811 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:32:16.811 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:32:16.812 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:32:16.812 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:32:16.812 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:32:16.812 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:32:16.812 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:32:16.812 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:32:16.813 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:32:16.813 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:32:16.813 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:32:16.813 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:32:16.813 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:32:17.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:32:17 smithi132 bash[27079]: cluster 2020-07-16T14:32:16.211942+0000 mgr.x (mgr.34562) 2577 : cluster [DBG] pgmap v1608: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:32:17.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:32:17 smithi132 bash[27079]: audit 2020-07-16T14:32:16.238747+0000 mgr.x (mgr.34562) 2578 : audit [DBG] from='client.26512 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:32:17.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:32:17 smithi132 bash[27079]: audit 2020-07-16T14:32:16.809144+0000 mon.c (mon.1) 211 : audit [DBG] from='client.? 172.21.15.132:0/4197946208' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:32:17.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:32:17 smithi188 bash[23329]: cluster 2020-07-16T14:32:16.211942+0000 mgr.x (mgr.34562) 2577 : cluster [DBG] pgmap v1608: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:32:17.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:32:17 smithi188 bash[23329]: audit 2020-07-16T14:32:16.238747+0000 mgr.x (mgr.34562) 2578 : audit [DBG] from='client.26512 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:32:17.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:32:17 smithi188 bash[23329]: audit 2020-07-16T14:32:16.809144+0000 mon.c (mon.1) 211 : audit [DBG] from='client.? 172.21.15.132:0/4197946208' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:32:18.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:32:18 smithi132 bash[27079]: audit 2020-07-16T14:32:16.506974+0000 mgr.x (mgr.34562) 2579 : audit [DBG] from='client.26518 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:32:18.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:32:18 smithi188 bash[23329]: audit 2020-07-16T14:32:16.506974+0000 mgr.x (mgr.34562) 2579 : audit [DBG] from='client.26518 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:32:19.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:32:19 smithi188 bash[23329]: cluster 2020-07-16T14:32:18.212530+0000 mgr.x (mgr.34562) 2580 : cluster [DBG] pgmap v1609: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:32:19.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:32:19 smithi132 bash[27079]: cluster 2020-07-16T14:32:18.212530+0000 mgr.x (mgr.34562) 2580 : cluster [DBG] pgmap v1609: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:32:20.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:32:20 smithi188 bash[23329]: audit 2020-07-16T14:32:19.956536+0000 mon.b (mon.2) 648 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:32:20.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:32:20 smithi188 bash[23329]: cephadm 2020-07-16T14:32:19.957253+0000 mgr.x (mgr.34562) 2581 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:32:20.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:32:20 smithi188 bash[23329]: cephadm 2020-07-16T14:32:19.957423+0000 mgr.x (mgr.34562) 2582 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:32:20.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:32:20 smithi188 bash[23329]: cluster 2020-07-16T14:32:20.212953+0000 mgr.x (mgr.34562) 2583 : cluster [DBG] pgmap v1610: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:32:21.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:32:20 smithi132 bash[27079]: audit 2020-07-16T14:32:19.956536+0000 mon.b (mon.2) 648 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:32:21.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:32:20 smithi132 bash[27079]: cephadm 2020-07-16T14:32:19.957253+0000 mgr.x (mgr.34562) 2581 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:32:21.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:32:20 smithi132 bash[27079]: cephadm 2020-07-16T14:32:19.957423+0000 mgr.x (mgr.34562) 2582 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:32:21.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:32:20 smithi132 bash[27079]: cluster 2020-07-16T14:32:20.212953+0000 mgr.x (mgr.34562) 2583 : cluster [DBG] pgmap v1610: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:32:23.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:32:23 smithi132 bash[27079]: cluster 2020-07-16T14:32:22.213456+0000 mgr.x (mgr.34562) 2584 : cluster [DBG] pgmap v1611: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:32:23.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:32:23 smithi188 bash[23329]: cluster 2020-07-16T14:32:22.213456+0000 mgr.x (mgr.34562) 2584 : cluster [DBG] pgmap v1611: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:32:25.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:32:25 smithi132 bash[27079]: cluster 2020-07-16T14:32:24.213833+0000 mgr.x (mgr.34562) 2585 : cluster [DBG] pgmap v1612: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:32:25.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:32:25 smithi188 bash[23329]: cluster 2020-07-16T14:32:24.213833+0000 mgr.x (mgr.34562) 2585 : cluster [DBG] pgmap v1612: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:32:27.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:32:27 smithi132 bash[27079]: cluster 2020-07-16T14:32:26.214339+0000 mgr.x (mgr.34562) 2586 : cluster [DBG] pgmap v1613: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:32:27.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:32:27 smithi188 bash[23329]: cluster 2020-07-16T14:32:26.214339+0000 mgr.x (mgr.34562) 2586 : cluster [DBG] pgmap v1613: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:32:29.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:32:29 smithi188 bash[23329]: cluster 2020-07-16T14:32:28.214848+0000 mgr.x (mgr.34562) 2587 : cluster [DBG] pgmap v1614: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:32:29.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:32:29 smithi132 bash[27079]: cluster 2020-07-16T14:32:28.214848+0000 mgr.x (mgr.34562) 2587 : cluster [DBG] pgmap v1614: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:32:30.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:32:30 smithi188 bash[23329]: cluster 2020-07-16T14:32:30.215234+0000 mgr.x (mgr.34562) 2588 : cluster [DBG] pgmap v1615: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:32:31.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:32:30 smithi132 bash[27079]: cluster 2020-07-16T14:32:30.215234+0000 mgr.x (mgr.34562) 2588 : cluster [DBG] pgmap v1615: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:32:33.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:32:33 smithi132 bash[27079]: cluster 2020-07-16T14:32:32.215632+0000 mgr.x (mgr.34562) 2589 : cluster [DBG] pgmap v1616: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:32:33.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:32:33 smithi188 bash[23329]: cluster 2020-07-16T14:32:32.215632+0000 mgr.x (mgr.34562) 2589 : cluster [DBG] pgmap v1616: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:32:35.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:32:35 smithi132 bash[27079]: cluster 2020-07-16T14:32:34.215995+0000 mgr.x (mgr.34562) 2590 : cluster [DBG] pgmap v1617: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:32:35.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:32:35 smithi132 bash[27079]: audit 2020-07-16T14:32:34.976226+0000 mon.b (mon.2) 649 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:32:35.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:32:35 smithi132 bash[27079]: audit 2020-07-16T14:32:34.977634+0000 mon.b (mon.2) 650 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:32:35.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:32:35 smithi132 bash[27079]: audit 2020-07-16T14:32:34.978795+0000 mon.b (mon.2) 651 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:32:35.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:32:35 smithi132 bash[27079]: audit 2020-07-16T14:32:34.980132+0000 mon.b (mon.2) 652 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:32:35.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:32:35 smithi132 bash[27079]: audit 2020-07-16T14:32:34.981327+0000 mon.b (mon.2) 653 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:32:35.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:32:35 smithi188 bash[23329]: cluster 2020-07-16T14:32:34.215995+0000 mgr.x (mgr.34562) 2590 : cluster [DBG] pgmap v1617: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:32:35.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:32:35 smithi188 bash[23329]: audit 2020-07-16T14:32:34.976226+0000 mon.b (mon.2) 649 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:32:35.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:32:35 smithi188 bash[23329]: audit 2020-07-16T14:32:34.977634+0000 mon.b (mon.2) 650 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:32:35.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:32:35 smithi188 bash[23329]: audit 2020-07-16T14:32:34.978795+0000 mon.b (mon.2) 651 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:32:35.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:32:35 smithi188 bash[23329]: audit 2020-07-16T14:32:34.980132+0000 mon.b (mon.2) 652 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:32:35.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:32:35 smithi188 bash[23329]: audit 2020-07-16T14:32:34.981327+0000 mon.b (mon.2) 653 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:32:36.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:32:36 smithi188 bash[23329]: audit 2020-07-16T14:32:34.976624+0000 mgr.x (mgr.34562) 2591 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:32:36.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:32:36 smithi188 bash[23329]: audit 2020-07-16T14:32:34.977942+0000 mgr.x (mgr.34562) 2592 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:32:36.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:32:36 smithi188 bash[23329]: audit 2020-07-16T14:32:34.979061+0000 mgr.x (mgr.34562) 2593 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:32:36.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:32:36 smithi188 bash[23329]: cephadm 2020-07-16T14:32:34.979788+0000 mgr.x (mgr.34562) 2594 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:32:36.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:32:36 smithi188 bash[23329]: cephadm 2020-07-16T14:32:34.981022+0000 mgr.x (mgr.34562) 2595 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:32:36.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:32:36 smithi188 bash[23329]: cephadm 2020-07-16T14:32:34.982074+0000 mgr.x (mgr.34562) 2596 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:32:36.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:32:36 smithi188 bash[23329]: cephadm 2020-07-16T14:32:34.982389+0000 mgr.x (mgr.34562) 2597 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:32:36.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:32:36 smithi132 bash[27079]: audit 2020-07-16T14:32:34.976624+0000 mgr.x (mgr.34562) 2591 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:32:36.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:32:36 smithi132 bash[27079]: audit 2020-07-16T14:32:34.977942+0000 mgr.x (mgr.34562) 2592 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:32:36.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:32:36 smithi132 bash[27079]: audit 2020-07-16T14:32:34.979061+0000 mgr.x (mgr.34562) 2593 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:32:36.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:32:36 smithi132 bash[27079]: cephadm 2020-07-16T14:32:34.979788+0000 mgr.x (mgr.34562) 2594 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:32:36.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:32:36 smithi132 bash[27079]: cephadm 2020-07-16T14:32:34.981022+0000 mgr.x (mgr.34562) 2595 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:32:36.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:32:36 smithi132 bash[27079]: cephadm 2020-07-16T14:32:34.982074+0000 mgr.x (mgr.34562) 2596 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:32:36.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:32:36 smithi132 bash[27079]: cephadm 2020-07-16T14:32:34.982389+0000 mgr.x (mgr.34562) 2597 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:32:37.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:32:37 smithi188 bash[23329]: cluster 2020-07-16T14:32:36.216428+0000 mgr.x (mgr.34562) 2598 : cluster [DBG] pgmap v1618: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:32:37.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:32:37 smithi132 bash[27079]: cluster 2020-07-16T14:32:36.216428+0000 mgr.x (mgr.34562) 2598 : cluster [DBG] pgmap v1618: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:32:38.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:32:38 smithi188 bash[23329]: audit 2020-07-16T14:32:37.799692+0000 mon.b (mon.2) 654 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:32:38.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:32:38 smithi132 bash[27079]: audit 2020-07-16T14:32:37.799692+0000 mon.b (mon.2) 654 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:32:39.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:32:39 smithi188 bash[23329]: cephadm 2020-07-16T14:32:37.800272+0000 mgr.x (mgr.34562) 2599 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:32:39.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:32:39 smithi188 bash[23329]: cephadm 2020-07-16T14:32:37.800734+0000 mgr.x (mgr.34562) 2600 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:32:39.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:32:39 smithi188 bash[23329]: cluster 2020-07-16T14:32:38.216882+0000 mgr.x (mgr.34562) 2601 : cluster [DBG] pgmap v1619: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:32:39.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:32:39 smithi132 bash[27079]: cephadm 2020-07-16T14:32:37.800272+0000 mgr.x (mgr.34562) 2599 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:32:39.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:32:39 smithi132 bash[27079]: cephadm 2020-07-16T14:32:37.800734+0000 mgr.x (mgr.34562) 2600 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:32:39.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:32:39 smithi132 bash[27079]: cluster 2020-07-16T14:32:38.216882+0000 mgr.x (mgr.34562) 2601 : cluster [DBG] pgmap v1619: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:32:40.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:32:40 smithi188 bash[23329]: cluster 2020-07-16T14:32:40.217425+0000 mgr.x (mgr.34562) 2602 : cluster [DBG] pgmap v1620: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:32:41.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:32:40 smithi132 bash[27079]: cluster 2020-07-16T14:32:40.217425+0000 mgr.x (mgr.34562) 2602 : cluster [DBG] pgmap v1620: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:32:43.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:32:43 smithi132 bash[27079]: cluster 2020-07-16T14:32:42.217892+0000 mgr.x (mgr.34562) 2603 : cluster [DBG] pgmap v1621: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:32:43.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:32:43 smithi188 bash[23329]: cluster 2020-07-16T14:32:42.217892+0000 mgr.x (mgr.34562) 2603 : cluster [DBG] pgmap v1621: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:32:45.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:32:45 smithi132 bash[27079]: cluster 2020-07-16T14:32:44.218259+0000 mgr.x (mgr.34562) 2604 : cluster [DBG] pgmap v1622: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:32:45.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:32:45 smithi188 bash[23329]: cluster 2020-07-16T14:32:44.218259+0000 mgr.x (mgr.34562) 2604 : cluster [DBG] pgmap v1622: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:32:47.110 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:32:47.374 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:32:47.374 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (55m) 75s ago 58m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:32:47.374 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (58m) 75s ago 58m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:32:47.375 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (55m) 75s ago 61m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:32:47.375 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (55m) 75s ago 63m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:32:47.375 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 75s ago 63m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:32:47.375 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (61m) 75s ago 61m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:32:47.375 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (61m) 75s ago 61m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:32:47.376 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (58m) 75s ago 58m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:32:47.376 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (58m) 75s ago 58m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:32:47.376 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (61m) 75s ago 61m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:32:47.376 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (60m) 75s ago 60m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:32:47.376 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (60m) 75s ago 60m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:32:47.377 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (60m) 75s ago 60m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:32:47.377 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (59m) 75s ago 60m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:32:47.377 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (59m) 75s ago 59m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:32:47.377 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (59m) 75s ago 59m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:32:47.377 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (59m) 75s ago 59m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:32:47.378 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (58m) 75s ago 58m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:32:47.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:32:47 smithi188 bash[23329]: cluster 2020-07-16T14:32:46.218610+0000 mgr.x (mgr.34562) 2605 : cluster [DBG] pgmap v1623: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:32:47.674 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:32:47.675 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:32:47.675 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:32:47.675 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:32:47.675 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:32:47.675 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:32:47.676 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:32:47.676 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:32:47.676 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:32:47.676 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:32:47.676 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:32:47.677 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:32:47.677 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:32:47.677 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:32:47.677 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:32:47.677 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:32:47.677 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:32:47.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:32:47 smithi132 bash[27079]: cluster 2020-07-16T14:32:46.218610+0000 mgr.x (mgr.34562) 2605 : cluster [DBG] pgmap v1623: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:32:48.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:32:48 smithi188 bash[23329]: audit 2020-07-16T14:32:47.098638+0000 mgr.x (mgr.34562) 2606 : audit [DBG] from='client.26530 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:32:48.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:32:48 smithi188 bash[23329]: audit 2020-07-16T14:32:47.369249+0000 mgr.x (mgr.34562) 2607 : audit [DBG] from='client.26536 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:32:48.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:32:48 smithi188 bash[23329]: audit 2020-07-16T14:32:47.673749+0000 mon.c (mon.1) 212 : audit [DBG] from='client.? 172.21.15.132:0/1721961726' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:32:48.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:32:48 smithi132 bash[27079]: audit 2020-07-16T14:32:47.098638+0000 mgr.x (mgr.34562) 2606 : audit [DBG] from='client.26530 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:32:48.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:32:48 smithi132 bash[27079]: audit 2020-07-16T14:32:47.369249+0000 mgr.x (mgr.34562) 2607 : audit [DBG] from='client.26536 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:32:48.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:32:48 smithi132 bash[27079]: audit 2020-07-16T14:32:47.673749+0000 mon.c (mon.1) 212 : audit [DBG] from='client.? 172.21.15.132:0/1721961726' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:32:49.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:32:49 smithi188 bash[23329]: cluster 2020-07-16T14:32:48.219152+0000 mgr.x (mgr.34562) 2608 : cluster [DBG] pgmap v1624: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:32:49.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:32:49 smithi132 bash[27079]: cluster 2020-07-16T14:32:48.219152+0000 mgr.x (mgr.34562) 2608 : cluster [DBG] pgmap v1624: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:32:50.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:32:50 smithi188 bash[23329]: cluster 2020-07-16T14:32:50.219661+0000 mgr.x (mgr.34562) 2609 : cluster [DBG] pgmap v1625: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:32:51.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:32:50 smithi132 bash[27079]: cluster 2020-07-16T14:32:50.219661+0000 mgr.x (mgr.34562) 2609 : cluster [DBG] pgmap v1625: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:32:53.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:32:53 smithi132 bash[27079]: cluster 2020-07-16T14:32:52.220078+0000 mgr.x (mgr.34562) 2610 : cluster [DBG] pgmap v1626: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:32:53.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:32:53 smithi132 bash[27079]: audit 2020-07-16T14:32:52.816308+0000 mon.b (mon.2) 655 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:32:53.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:32:53 smithi188 bash[23329]: cluster 2020-07-16T14:32:52.220078+0000 mgr.x (mgr.34562) 2610 : cluster [DBG] pgmap v1626: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:32:53.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:32:53 smithi188 bash[23329]: audit 2020-07-16T14:32:52.816308+0000 mon.b (mon.2) 655 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:32:54.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:32:54 smithi188 bash[23329]: cephadm 2020-07-16T14:32:52.817011+0000 mgr.x (mgr.34562) 2611 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:32:54.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:32:54 smithi188 bash[23329]: cephadm 2020-07-16T14:32:52.817139+0000 mgr.x (mgr.34562) 2612 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:32:54.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:32:54 smithi132 bash[27079]: cephadm 2020-07-16T14:32:52.817011+0000 mgr.x (mgr.34562) 2611 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:32:54.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:32:54 smithi132 bash[27079]: cephadm 2020-07-16T14:32:52.817139+0000 mgr.x (mgr.34562) 2612 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:32:55.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:32:55 smithi188 bash[23329]: cluster 2020-07-16T14:32:54.220588+0000 mgr.x (mgr.34562) 2613 : cluster [DBG] pgmap v1627: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:32:55.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:32:55 smithi132 bash[27079]: cluster 2020-07-16T14:32:54.220588+0000 mgr.x (mgr.34562) 2613 : cluster [DBG] pgmap v1627: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:32:57.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:32:57 smithi188 bash[23329]: cluster 2020-07-16T14:32:56.221006+0000 mgr.x (mgr.34562) 2614 : cluster [DBG] pgmap v1628: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:32:57.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:32:57 smithi132 bash[27079]: cluster 2020-07-16T14:32:56.221006+0000 mgr.x (mgr.34562) 2614 : cluster [DBG] pgmap v1628: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:32:59.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:32:59 smithi188 bash[23329]: cluster 2020-07-16T14:32:58.221459+0000 mgr.x (mgr.34562) 2615 : cluster [DBG] pgmap v1629: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:32:59.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:32:59 smithi132 bash[27079]: cluster 2020-07-16T14:32:58.221459+0000 mgr.x (mgr.34562) 2615 : cluster [DBG] pgmap v1629: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:33:00.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:00 smithi188 bash[23329]: cluster 2020-07-16T14:33:00.221920+0000 mgr.x (mgr.34562) 2616 : cluster [DBG] pgmap v1630: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:33:01.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:00 smithi132 bash[27079]: cluster 2020-07-16T14:33:00.221920+0000 mgr.x (mgr.34562) 2616 : cluster [DBG] pgmap v1630: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:33:03.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:03 smithi132 bash[27079]: cluster 2020-07-16T14:33:02.222417+0000 mgr.x (mgr.34562) 2617 : cluster [DBG] pgmap v1631: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:33:03.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:03 smithi188 bash[23329]: cluster 2020-07-16T14:33:02.222417+0000 mgr.x (mgr.34562) 2617 : cluster [DBG] pgmap v1631: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:33:05.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:05 smithi188 bash[23329]: cluster 2020-07-16T14:33:04.222736+0000 mgr.x (mgr.34562) 2618 : cluster [DBG] pgmap v1632: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:33:05.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:05 smithi132 bash[27079]: cluster 2020-07-16T14:33:04.222736+0000 mgr.x (mgr.34562) 2618 : cluster [DBG] pgmap v1632: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:33:07.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:07 smithi188 bash[23329]: cluster 2020-07-16T14:33:06.223228+0000 mgr.x (mgr.34562) 2619 : cluster [DBG] pgmap v1633: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:33:07.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:07 smithi132 bash[27079]: cluster 2020-07-16T14:33:06.223228+0000 mgr.x (mgr.34562) 2619 : cluster [DBG] pgmap v1633: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:33:08.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:08 smithi188 bash[23329]: audit 2020-07-16T14:33:07.832928+0000 mon.b (mon.2) 656 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:33:08.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:08 smithi132 bash[27079]: audit 2020-07-16T14:33:07.832928+0000 mon.b (mon.2) 656 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:33:09.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:09 smithi188 bash[23329]: cephadm 2020-07-16T14:33:07.833678+0000 mgr.x (mgr.34562) 2620 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:33:09.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:09 smithi188 bash[23329]: cephadm 2020-07-16T14:33:07.833908+0000 mgr.x (mgr.34562) 2621 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:33:09.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:09 smithi188 bash[23329]: cluster 2020-07-16T14:33:08.223732+0000 mgr.x (mgr.34562) 2622 : cluster [DBG] pgmap v1634: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:33:09.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:09 smithi132 bash[27079]: cephadm 2020-07-16T14:33:07.833678+0000 mgr.x (mgr.34562) 2620 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:33:09.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:09 smithi132 bash[27079]: cephadm 2020-07-16T14:33:07.833908+0000 mgr.x (mgr.34562) 2621 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:33:09.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:09 smithi132 bash[27079]: cluster 2020-07-16T14:33:08.223732+0000 mgr.x (mgr.34562) 2622 : cluster [DBG] pgmap v1634: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:33:10.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:10 smithi188 bash[23329]: cluster 2020-07-16T14:33:10.224153+0000 mgr.x (mgr.34562) 2623 : cluster [DBG] pgmap v1635: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:33:11.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:10 smithi132 bash[27079]: cluster 2020-07-16T14:33:10.224153+0000 mgr.x (mgr.34562) 2623 : cluster [DBG] pgmap v1635: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:33:13.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:13 smithi188 bash[23329]: cluster 2020-07-16T14:33:12.224576+0000 mgr.x (mgr.34562) 2624 : cluster [DBG] pgmap v1636: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:33:13.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:13 smithi132 bash[27079]: cluster 2020-07-16T14:33:12.224576+0000 mgr.x (mgr.34562) 2624 : cluster [DBG] pgmap v1636: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:33:15.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:15 smithi188 bash[23329]: cluster 2020-07-16T14:33:14.225035+0000 mgr.x (mgr.34562) 2625 : cluster [DBG] pgmap v1637: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:33:15.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:15 smithi132 bash[27079]: cluster 2020-07-16T14:33:14.225035+0000 mgr.x (mgr.34562) 2625 : cluster [DBG] pgmap v1637: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:33:17.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:17 smithi188 bash[23329]: cluster 2020-07-16T14:33:16.225487+0000 mgr.x (mgr.34562) 2626 : cluster [DBG] pgmap v1638: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:33:17.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:17 smithi132 bash[27079]: cluster 2020-07-16T14:33:16.225487+0000 mgr.x (mgr.34562) 2626 : cluster [DBG] pgmap v1638: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:33:17.974 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:33:18.237 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:33:18.237 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (56m) 106s ago 59m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:33:18.238 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (58m) 105s ago 58m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:33:18.238 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (56m) 105s ago 61m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:33:18.238 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (55m) 106s ago 63m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:33:18.238 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 106s ago 63m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:33:18.238 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (62m) 105s ago 62m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:33:18.239 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (62m) 106s ago 62m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:33:18.239 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (59m) 106s ago 59m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:33:18.239 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (59m) 105s ago 59m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:33:18.239 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (61m) 106s ago 61m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:33:18.239 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (61m) 106s ago 61m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:33:18.240 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (61m) 106s ago 61m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:33:18.240 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (60m) 106s ago 60m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:33:18.240 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (60m) 105s ago 60m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:33:18.240 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (60m) 105s ago 60m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:33:18.240 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (59m) 105s ago 59m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:33:18.241 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (59m) 105s ago 59m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:33:18.241 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (58m) 105s ago 59m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:33:18.534 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:33:18.535 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:33:18.535 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:33:18.535 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:33:18.535 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:33:18.536 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:33:18.536 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:33:18.536 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:33:18.537 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:33:18.537 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:33:18.537 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:33:18.538 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:33:18.538 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:33:18.538 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:33:18.538 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:33:18.539 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:33:18.539 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:33:19.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:19 smithi188 bash[23329]: audit 2020-07-16T14:33:17.963003+0000 mgr.x (mgr.34562) 2627 : audit [DBG] from='client.26548 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:33:19.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:19 smithi188 bash[23329]: cluster 2020-07-16T14:33:18.225907+0000 mgr.x (mgr.34562) 2628 : cluster [DBG] pgmap v1639: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:33:19.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:19 smithi188 bash[23329]: audit 2020-07-16T14:33:18.232787+0000 mgr.x (mgr.34562) 2629 : audit [DBG] from='client.26554 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:33:19.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:19 smithi188 bash[23329]: audit 2020-07-16T14:33:18.533367+0000 mon.c (mon.1) 213 : audit [DBG] from='client.? 172.21.15.132:0/3884837576' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:33:19.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:19 smithi132 bash[27079]: audit 2020-07-16T14:33:17.963003+0000 mgr.x (mgr.34562) 2627 : audit [DBG] from='client.26548 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:33:19.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:19 smithi132 bash[27079]: cluster 2020-07-16T14:33:18.225907+0000 mgr.x (mgr.34562) 2628 : cluster [DBG] pgmap v1639: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:33:19.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:19 smithi132 bash[27079]: audit 2020-07-16T14:33:18.232787+0000 mgr.x (mgr.34562) 2629 : audit [DBG] from='client.26554 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:33:19.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:19 smithi132 bash[27079]: audit 2020-07-16T14:33:18.533367+0000 mon.c (mon.1) 213 : audit [DBG] from='client.? 172.21.15.132:0/3884837576' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:33:20.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:20 smithi188 bash[23329]: cluster 2020-07-16T14:33:20.226262+0000 mgr.x (mgr.34562) 2630 : cluster [DBG] pgmap v1640: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:33:21.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:20 smithi132 bash[27079]: cluster 2020-07-16T14:33:20.226262+0000 mgr.x (mgr.34562) 2630 : cluster [DBG] pgmap v1640: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:33:23.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:23 smithi188 bash[23329]: cluster 2020-07-16T14:33:22.226785+0000 mgr.x (mgr.34562) 2631 : cluster [DBG] pgmap v1641: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:33:23.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:23 smithi188 bash[23329]: audit 2020-07-16T14:33:22.849481+0000 mon.b (mon.2) 657 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:33:23.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:23 smithi132 bash[27079]: cluster 2020-07-16T14:33:22.226785+0000 mgr.x (mgr.34562) 2631 : cluster [DBG] pgmap v1641: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:33:23.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:23 smithi132 bash[27079]: audit 2020-07-16T14:33:22.849481+0000 mon.b (mon.2) 657 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:33:24.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:24 smithi188 bash[23329]: cephadm 2020-07-16T14:33:22.850200+0000 mgr.x (mgr.34562) 2632 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:33:24.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:24 smithi188 bash[23329]: cephadm 2020-07-16T14:33:22.850659+0000 mgr.x (mgr.34562) 2633 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:33:24.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:24 smithi132 bash[27079]: cephadm 2020-07-16T14:33:22.850200+0000 mgr.x (mgr.34562) 2632 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:33:24.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:24 smithi132 bash[27079]: cephadm 2020-07-16T14:33:22.850659+0000 mgr.x (mgr.34562) 2633 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:33:25.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:25 smithi188 bash[23329]: cluster 2020-07-16T14:33:24.227307+0000 mgr.x (mgr.34562) 2634 : cluster [DBG] pgmap v1642: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:33:25.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:25 smithi132 bash[27079]: cluster 2020-07-16T14:33:24.227307+0000 mgr.x (mgr.34562) 2634 : cluster [DBG] pgmap v1642: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:33:27.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:27 smithi188 bash[23329]: cluster 2020-07-16T14:33:26.227756+0000 mgr.x (mgr.34562) 2635 : cluster [DBG] pgmap v1643: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:33:27.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:27 smithi132 bash[27079]: cluster 2020-07-16T14:33:26.227756+0000 mgr.x (mgr.34562) 2635 : cluster [DBG] pgmap v1643: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:33:29.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:29 smithi188 bash[23329]: cluster 2020-07-16T14:33:28.228313+0000 mgr.x (mgr.34562) 2636 : cluster [DBG] pgmap v1644: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:33:29.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:29 smithi132 bash[27079]: cluster 2020-07-16T14:33:28.228313+0000 mgr.x (mgr.34562) 2636 : cluster [DBG] pgmap v1644: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:33:30.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:30 smithi188 bash[23329]: cluster 2020-07-16T14:33:30.228663+0000 mgr.x (mgr.34562) 2637 : cluster [DBG] pgmap v1645: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:33:31.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:30 smithi132 bash[27079]: cluster 2020-07-16T14:33:30.228663+0000 mgr.x (mgr.34562) 2637 : cluster [DBG] pgmap v1645: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:33:33.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:33 smithi188 bash[23329]: cluster 2020-07-16T14:33:32.229102+0000 mgr.x (mgr.34562) 2638 : cluster [DBG] pgmap v1646: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:33:33.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:33 smithi132 bash[27079]: cluster 2020-07-16T14:33:32.229102+0000 mgr.x (mgr.34562) 2638 : cluster [DBG] pgmap v1646: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:33:35.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:35 smithi188 bash[23329]: cluster 2020-07-16T14:33:34.229588+0000 mgr.x (mgr.34562) 2639 : cluster [DBG] pgmap v1647: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:33:35.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:35 smithi132 bash[27079]: cluster 2020-07-16T14:33:34.229588+0000 mgr.x (mgr.34562) 2639 : cluster [DBG] pgmap v1647: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:33:37.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:37 smithi188 bash[23329]: cluster 2020-07-16T14:33:36.230069+0000 mgr.x (mgr.34562) 2640 : cluster [DBG] pgmap v1648: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:33:37.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:37 smithi132 bash[27079]: cluster 2020-07-16T14:33:36.230069+0000 mgr.x (mgr.34562) 2640 : cluster [DBG] pgmap v1648: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:33:38.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:38 smithi132 bash[27079]: audit 2020-07-16T14:33:38.094624+0000 mon.b (mon.2) 658 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:31:32.162208\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162267\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162328\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162359\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162518\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162638\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162735\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162831\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162864\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:31:32.162932\", \"last_device_update\": \"2020-07-16T14:03:05.154706\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:33:38.093826\"}"}]: dispatch 2020-07-16T14:33:38.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:38 smithi132 bash[27079]: audit 2020-07-16T14:33:38.094966+0000 mon.b (mon.2) 659 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.261903\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.261975\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262006\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262168\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262268\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262400\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262501\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262535\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262564\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:31:32.262647\", \"last_device_update\": \"2020-07-16T14:04:10.964865\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:33:38.094344\"}"}]: dispatch 2020-07-16T14:33:38.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:38 smithi132 bash[27079]: audit 2020-07-16T14:33:38.095223+0000 mon.c (mon.1) 214 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:31:32.162208\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162267\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162328\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162359\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162518\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162638\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162735\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162831\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162864\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:31:32.162932\", \"last_device_update\": \"2020-07-16T14:03:05.154706\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:33:38.093826\"}"}]: dispatch 2020-07-16T14:33:38.568 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:38 smithi132 bash[27079]: audit 2020-07-16T14:33:38.095843+0000 mon.c (mon.1) 215 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.261903\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.261975\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262006\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262168\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262268\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262400\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262501\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262535\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262564\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:31:32.262647\", \"last_device_update\": \"2020-07-16T14:04:10.964865\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:33:38.094344\"}"}]: dispatch 2020-07-16T14:33:38.569 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:38 smithi132 bash[27079]: audit 2020-07-16T14:33:38.097975+0000 mon.c (mon.1) 216 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:31:32.162208\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162267\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162328\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162359\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162518\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162638\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162735\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162831\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162864\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:31:32.162932\", \"last_device_update\": \"2020-07-16T14:03:05.154706\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:33:38.093826\"}"}]': finished 2020-07-16T14:33:38.569 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:38 smithi132 bash[27079]: audit 2020-07-16T14:33:38.098760+0000 mon.b (mon.2) 660 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T14:33:38.569 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:38 smithi132 bash[27079]: audit 2020-07-16T14:33:38.099938+0000 mon.c (mon.1) 217 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.261903\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.261975\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262006\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262168\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262268\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262400\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262501\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262535\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262564\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:31:32.262647\", \"last_device_update\": \"2020-07-16T14:04:10.964865\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:33:38.094344\"}"}]': finished 2020-07-16T14:33:38.572 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:38 smithi188 bash[23329]: audit 2020-07-16T14:33:38.094624+0000 mon.b (mon.2) 658 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:31:32.162208\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162267\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162328\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162359\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162518\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162638\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162735\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162831\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162864\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:31:32.162932\", \"last_device_update\": \"2020-07-16T14:03:05.154706\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:33:38.093826\"}"}]: dispatch 2020-07-16T14:33:38.573 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:38 smithi188 bash[23329]: audit 2020-07-16T14:33:38.094966+0000 mon.b (mon.2) 659 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.261903\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.261975\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262006\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262168\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262268\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262400\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262501\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262535\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262564\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:31:32.262647\", \"last_device_update\": \"2020-07-16T14:04:10.964865\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:33:38.094344\"}"}]: dispatch 2020-07-16T14:33:38.573 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:38 smithi188 bash[23329]: audit 2020-07-16T14:33:38.095223+0000 mon.c (mon.1) 214 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:31:32.162208\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162267\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162328\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162359\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162518\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162638\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162735\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162831\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162864\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:31:32.162932\", \"last_device_update\": \"2020-07-16T14:03:05.154706\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:33:38.093826\"}"}]: dispatch 2020-07-16T14:33:38.573 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:38 smithi188 bash[23329]: audit 2020-07-16T14:33:38.095843+0000 mon.c (mon.1) 215 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.261903\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.261975\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262006\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262168\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262268\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262400\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262501\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262535\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262564\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:31:32.262647\", \"last_device_update\": \"2020-07-16T14:04:10.964865\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:33:38.094344\"}"}]: dispatch 2020-07-16T14:33:38.574 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:38 smithi188 bash[23329]: audit 2020-07-16T14:33:38.097975+0000 mon.c (mon.1) 216 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:31:32.162208\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162267\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162328\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162359\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162518\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162638\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162735\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162831\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162864\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:31:32.162932\", \"last_device_update\": \"2020-07-16T14:03:05.154706\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:33:38.093826\"}"}]': finished 2020-07-16T14:33:38.574 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:38 smithi188 bash[23329]: audit 2020-07-16T14:33:38.098760+0000 mon.b (mon.2) 660 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T14:33:38.574 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:38 smithi188 bash[23329]: audit 2020-07-16T14:33:38.099938+0000 mon.c (mon.1) 217 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.261903\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.261975\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262006\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262168\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262268\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262400\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262501\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262535\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262564\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:31:32.262647\", \"last_device_update\": \"2020-07-16T14:04:10.964865\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:33:38.094344\"}"}]': finished 2020-07-16T14:33:39.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:39 smithi188 bash[23329]: cluster 2020-07-16T14:33:38.230526+0000 mgr.x (mgr.34562) 2641 : cluster [DBG] pgmap v1649: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:33:39.754 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:39 smithi132 bash[27079]: cluster 2020-07-16T14:33:38.230526+0000 mgr.x (mgr.34562) 2641 : cluster [DBG] pgmap v1649: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:33:40.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:40 smithi188 bash[23329]: cluster 2020-07-16T14:33:40.231011+0000 mgr.x (mgr.34562) 2642 : cluster [DBG] pgmap v1650: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:33:41.015 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:40 smithi132 bash[27079]: cluster 2020-07-16T14:33:40.231011+0000 mgr.x (mgr.34562) 2642 : cluster [DBG] pgmap v1650: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:33:41.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:41 smithi188 bash[23329]: audit 2020-07-16T14:33:41.029019+0000 mon.b (mon.2) 661 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T14:33:41.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:41 smithi188 bash[23329]: audit 2020-07-16T14:33:41.234673+0000 mon.b (mon.2) 662 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:31:32.162208\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162267\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162328\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162359\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162518\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162638\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162735\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162831\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162864\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:31:32.162932\", \"last_device_update\": \"2020-07-16T14:33:41.233618\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:33:38.093826\"}"}]: dispatch 2020-07-16T14:33:41.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:41 smithi188 bash[23329]: audit 2020-07-16T14:33:41.235284+0000 mon.c (mon.1) 218 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:31:32.162208\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162267\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162328\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162359\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162518\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162638\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162735\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162831\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162864\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:31:32.162932\", \"last_device_update\": \"2020-07-16T14:33:41.233618\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:33:38.093826\"}"}]: dispatch 2020-07-16T14:33:41.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:41 smithi188 bash[23329]: audit 2020-07-16T14:33:41.238073+0000 mon.c (mon.1) 219 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:31:32.162208\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162267\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162328\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162359\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162518\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162638\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162735\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162831\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162864\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:31:32.162932\", \"last_device_update\": \"2020-07-16T14:33:41.233618\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:33:38.093826\"}"}]': finished 2020-07-16T14:33:41.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:41 smithi188 bash[23329]: audit 2020-07-16T14:33:41.242039+0000 mon.b (mon.2) 663 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:33:41.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:41 smithi188 bash[23329]: audit 2020-07-16T14:33:41.242421+0000 mgr.x (mgr.34562) 2643 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:33:41.925 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:41 smithi188 bash[23329]: audit 2020-07-16T14:33:41.243447+0000 mon.b (mon.2) 664 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:33:41.925 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:41 smithi188 bash[23329]: audit 2020-07-16T14:33:41.243732+0000 mgr.x (mgr.34562) 2644 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:33:41.925 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:41 smithi188 bash[23329]: audit 2020-07-16T14:33:41.244605+0000 mon.b (mon.2) 665 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:33:41.926 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:41 smithi188 bash[23329]: audit 2020-07-16T14:33:41.244896+0000 mgr.x (mgr.34562) 2645 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:33:41.927 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:41 smithi188 bash[23329]: cephadm 2020-07-16T14:33:41.245580+0000 mgr.x (mgr.34562) 2646 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:33:41.927 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:41 smithi188 bash[23329]: audit 2020-07-16T14:33:41.245946+0000 mon.b (mon.2) 666 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:33:41.927 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:41 smithi188 bash[23329]: cephadm 2020-07-16T14:33:41.246767+0000 mgr.x (mgr.34562) 2647 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:33:41.927 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:41 smithi188 bash[23329]: audit 2020-07-16T14:33:41.247098+0000 mon.b (mon.2) 667 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:33:41.928 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:41 smithi188 bash[23329]: cephadm 2020-07-16T14:33:41.247801+0000 mgr.x (mgr.34562) 2648 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:33:41.928 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:41 smithi188 bash[23329]: cephadm 2020-07-16T14:33:41.247970+0000 mgr.x (mgr.34562) 2649 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:33:42.012 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:41 smithi132 bash[27079]: audit 2020-07-16T14:33:41.029019+0000 mon.b (mon.2) 661 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T14:33:42.012 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:41 smithi132 bash[27079]: audit 2020-07-16T14:33:41.234673+0000 mon.b (mon.2) 662 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:31:32.162208\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162267\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162328\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162359\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162518\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162638\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162735\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162831\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162864\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:31:32.162932\", \"last_device_update\": \"2020-07-16T14:33:41.233618\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:33:38.093826\"}"}]: dispatch 2020-07-16T14:33:42.013 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:41 smithi132 bash[27079]: audit 2020-07-16T14:33:41.235284+0000 mon.c (mon.1) 218 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:31:32.162208\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162267\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162328\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162359\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162518\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162638\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162735\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162831\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162864\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:31:32.162932\", \"last_device_update\": \"2020-07-16T14:33:41.233618\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:33:38.093826\"}"}]: dispatch 2020-07-16T14:33:42.013 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:41 smithi132 bash[27079]: audit 2020-07-16T14:33:41.238073+0000 mon.c (mon.1) 219 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:31:32.162208\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162267\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162328\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162359\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162518\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162638\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162735\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162831\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.162864\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:31:32.162932\", \"last_device_update\": \"2020-07-16T14:33:41.233618\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:33:38.093826\"}"}]': finished 2020-07-16T14:33:42.013 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:41 smithi132 bash[27079]: audit 2020-07-16T14:33:41.242039+0000 mon.b (mon.2) 663 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:33:42.014 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:41 smithi132 bash[27079]: audit 2020-07-16T14:33:41.242421+0000 mgr.x (mgr.34562) 2643 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:33:42.014 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:41 smithi132 bash[27079]: audit 2020-07-16T14:33:41.243447+0000 mon.b (mon.2) 664 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:33:42.014 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:41 smithi132 bash[27079]: audit 2020-07-16T14:33:41.243732+0000 mgr.x (mgr.34562) 2644 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:33:42.014 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:41 smithi132 bash[27079]: audit 2020-07-16T14:33:41.244605+0000 mon.b (mon.2) 665 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:33:42.014 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:41 smithi132 bash[27079]: audit 2020-07-16T14:33:41.244896+0000 mgr.x (mgr.34562) 2645 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:33:42.015 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:41 smithi132 bash[27079]: cephadm 2020-07-16T14:33:41.245580+0000 mgr.x (mgr.34562) 2646 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:33:42.015 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:41 smithi132 bash[27079]: audit 2020-07-16T14:33:41.245946+0000 mon.b (mon.2) 666 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:33:42.015 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:41 smithi132 bash[27079]: cephadm 2020-07-16T14:33:41.246767+0000 mgr.x (mgr.34562) 2647 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:33:42.016 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:41 smithi132 bash[27079]: audit 2020-07-16T14:33:41.247098+0000 mon.b (mon.2) 667 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:33:42.016 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:41 smithi132 bash[27079]: cephadm 2020-07-16T14:33:41.247801+0000 mgr.x (mgr.34562) 2648 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:33:42.016 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:41 smithi132 bash[27079]: cephadm 2020-07-16T14:33:41.247970+0000 mgr.x (mgr.34562) 2649 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:33:42.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:42 smithi132 bash[27079]: cluster 2020-07-16T14:33:42.231627+0000 mgr.x (mgr.34562) 2650 : cluster [DBG] pgmap v1651: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:33:43.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:42 smithi188 bash[23329]: cluster 2020-07-16T14:33:42.231627+0000 mgr.x (mgr.34562) 2650 : cluster [DBG] pgmap v1651: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:33:44.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:43 smithi188 bash[23329]: audit 2020-07-16T14:33:43.853090+0000 mon.b (mon.2) 668 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:33:44.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:43 smithi132 bash[27079]: audit 2020-07-16T14:33:43.853090+0000 mon.b (mon.2) 668 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:33:45.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:44 smithi188 bash[23329]: cephadm 2020-07-16T14:33:43.853722+0000 mgr.x (mgr.34562) 2651 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:33:45.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:44 smithi188 bash[23329]: cephadm 2020-07-16T14:33:43.853948+0000 mgr.x (mgr.34562) 2652 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:33:45.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:44 smithi188 bash[23329]: cluster 2020-07-16T14:33:44.232010+0000 mgr.x (mgr.34562) 2653 : cluster [DBG] pgmap v1652: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:33:45.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:44 smithi132 bash[27079]: cephadm 2020-07-16T14:33:43.853722+0000 mgr.x (mgr.34562) 2651 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:33:45.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:44 smithi132 bash[27079]: cephadm 2020-07-16T14:33:43.853948+0000 mgr.x (mgr.34562) 2652 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:33:45.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:44 smithi132 bash[27079]: cluster 2020-07-16T14:33:44.232010+0000 mgr.x (mgr.34562) 2653 : cluster [DBG] pgmap v1652: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:33:47.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:47 smithi188 bash[23329]: cluster 2020-07-16T14:33:46.232509+0000 mgr.x (mgr.34562) 2654 : cluster [DBG] pgmap v1653: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:33:47.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:47 smithi132 bash[27079]: cluster 2020-07-16T14:33:46.232509+0000 mgr.x (mgr.34562) 2654 : cluster [DBG] pgmap v1653: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:33:48.833 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:33:49.095 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:33:49.096 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (56m) 2m ago 59m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:33:49.096 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (59m) 2m ago 59m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:33:49.096 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (56m) 2m ago 62m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:33:49.096 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (56m) 2m ago 64m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:33:49.097 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 2m ago 64m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:33:49.097 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (62m) 2m ago 62m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:33:49.097 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (62m) 2m ago 62m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:33:49.097 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (59m) 2m ago 59m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:33:49.097 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (59m) 2m ago 59m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:33:49.098 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (62m) 2m ago 62m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:33:49.098 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (61m) 2m ago 61m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:33:49.098 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (61m) 2m ago 61m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:33:49.098 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (61m) 2m ago 61m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:33:49.099 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (60m) 2m ago 61m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:33:49.099 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (60m) 2m ago 60m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:33:49.099 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (60m) 2m ago 60m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:33:49.099 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (60m) 2m ago 60m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:33:49.100 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (59m) 2m ago 59m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:33:49.392 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:33:49.393 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:33:49.393 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:33:49.393 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:33:49.394 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:33:49.394 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:33:49.394 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:33:49.394 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:33:49.394 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:33:49.394 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:33:49.395 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:33:49.395 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:33:49.395 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:33:49.395 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:33:49.395 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:33:49.396 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:33:49.396 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:33:49.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:49 smithi188 bash[23329]: cluster 2020-07-16T14:33:48.232923+0000 mgr.x (mgr.34562) 2655 : cluster [DBG] pgmap v1654: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:33:49.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:49 smithi132 bash[27079]: cluster 2020-07-16T14:33:48.232923+0000 mgr.x (mgr.34562) 2655 : cluster [DBG] pgmap v1654: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:33:50.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:50 smithi188 bash[23329]: audit 2020-07-16T14:33:48.821021+0000 mgr.x (mgr.34562) 2656 : audit [DBG] from='client.26566 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:33:50.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:50 smithi188 bash[23329]: audit 2020-07-16T14:33:49.090782+0000 mgr.x (mgr.34562) 2657 : audit [DBG] from='client.26572 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:33:50.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:50 smithi188 bash[23329]: audit 2020-07-16T14:33:49.391993+0000 mon.c (mon.1) 220 : audit [DBG] from='client.? 172.21.15.132:0/2793522859' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:33:50.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:50 smithi132 bash[27079]: audit 2020-07-16T14:33:48.821021+0000 mgr.x (mgr.34562) 2656 : audit [DBG] from='client.26566 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:33:50.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:50 smithi132 bash[27079]: audit 2020-07-16T14:33:49.090782+0000 mgr.x (mgr.34562) 2657 : audit [DBG] from='client.26572 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:33:50.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:50 smithi132 bash[27079]: audit 2020-07-16T14:33:49.391993+0000 mon.c (mon.1) 220 : audit [DBG] from='client.? 172.21.15.132:0/2793522859' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:33:51.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:51 smithi188 bash[23329]: cluster 2020-07-16T14:33:50.233440+0000 mgr.x (mgr.34562) 2658 : cluster [DBG] pgmap v1655: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:33:51.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:51 smithi132 bash[27079]: cluster 2020-07-16T14:33:50.233440+0000 mgr.x (mgr.34562) 2658 : cluster [DBG] pgmap v1655: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:33:53.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:53 smithi188 bash[23329]: cluster 2020-07-16T14:33:52.233779+0000 mgr.x (mgr.34562) 2659 : cluster [DBG] pgmap v1656: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:33:53.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:53 smithi132 bash[27079]: cluster 2020-07-16T14:33:52.233779+0000 mgr.x (mgr.34562) 2659 : cluster [DBG] pgmap v1656: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:33:55.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:55 smithi188 bash[23329]: cluster 2020-07-16T14:33:54.234255+0000 mgr.x (mgr.34562) 2660 : cluster [DBG] pgmap v1657: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:33:55.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:55 smithi132 bash[27079]: cluster 2020-07-16T14:33:54.234255+0000 mgr.x (mgr.34562) 2660 : cluster [DBG] pgmap v1657: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:33:57.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:57 smithi188 bash[23329]: cluster 2020-07-16T14:33:56.234719+0000 mgr.x (mgr.34562) 2661 : cluster [DBG] pgmap v1658: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:33:57.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:57 smithi132 bash[27079]: cluster 2020-07-16T14:33:56.234719+0000 mgr.x (mgr.34562) 2661 : cluster [DBG] pgmap v1658: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:33:59.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:59 smithi188 bash[23329]: cluster 2020-07-16T14:33:58.235076+0000 mgr.x (mgr.34562) 2662 : cluster [DBG] pgmap v1659: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:33:59.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:33:59 smithi188 bash[23329]: audit 2020-07-16T14:33:58.865781+0000 mon.b (mon.2) 669 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:33:59.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:59 smithi132 bash[27079]: cluster 2020-07-16T14:33:58.235076+0000 mgr.x (mgr.34562) 2662 : cluster [DBG] pgmap v1659: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:33:59.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:33:59 smithi132 bash[27079]: audit 2020-07-16T14:33:58.865781+0000 mon.b (mon.2) 669 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:34:00.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:00 smithi188 bash[23329]: cephadm 2020-07-16T14:33:58.866468+0000 mgr.x (mgr.34562) 2663 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:34:00.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:00 smithi188 bash[23329]: cephadm 2020-07-16T14:33:58.866718+0000 mgr.x (mgr.34562) 2664 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:34:00.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:00 smithi132 bash[27079]: cephadm 2020-07-16T14:33:58.866468+0000 mgr.x (mgr.34562) 2663 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:34:00.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:00 smithi132 bash[27079]: cephadm 2020-07-16T14:33:58.866718+0000 mgr.x (mgr.34562) 2664 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:34:01.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:01 smithi188 bash[23329]: cluster 2020-07-16T14:34:00.235437+0000 mgr.x (mgr.34562) 2665 : cluster [DBG] pgmap v1660: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:34:01.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:01 smithi132 bash[27079]: cluster 2020-07-16T14:34:00.235437+0000 mgr.x (mgr.34562) 2665 : cluster [DBG] pgmap v1660: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:34:03.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:03 smithi188 bash[23329]: cluster 2020-07-16T14:34:02.235821+0000 mgr.x (mgr.34562) 2666 : cluster [DBG] pgmap v1661: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:34:03.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:03 smithi132 bash[27079]: cluster 2020-07-16T14:34:02.235821+0000 mgr.x (mgr.34562) 2666 : cluster [DBG] pgmap v1661: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:34:05.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:05 smithi188 bash[23329]: cluster 2020-07-16T14:34:04.236258+0000 mgr.x (mgr.34562) 2667 : cluster [DBG] pgmap v1662: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:34:05.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:05 smithi132 bash[27079]: cluster 2020-07-16T14:34:04.236258+0000 mgr.x (mgr.34562) 2667 : cluster [DBG] pgmap v1662: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:34:07.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:07 smithi188 bash[23329]: cluster 2020-07-16T14:34:06.236697+0000 mgr.x (mgr.34562) 2668 : cluster [DBG] pgmap v1663: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:34:07.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:07 smithi132 bash[27079]: cluster 2020-07-16T14:34:06.236697+0000 mgr.x (mgr.34562) 2668 : cluster [DBG] pgmap v1663: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:34:09.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:09 smithi188 bash[23329]: cluster 2020-07-16T14:34:08.237182+0000 mgr.x (mgr.34562) 2669 : cluster [DBG] pgmap v1664: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:34:09.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:09 smithi132 bash[27079]: cluster 2020-07-16T14:34:08.237182+0000 mgr.x (mgr.34562) 2669 : cluster [DBG] pgmap v1664: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:34:10.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:10 smithi188 bash[23329]: cluster 2020-07-16T14:34:10.237666+0000 mgr.x (mgr.34562) 2670 : cluster [DBG] pgmap v1665: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:34:11.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:10 smithi132 bash[27079]: cluster 2020-07-16T14:34:10.237666+0000 mgr.x (mgr.34562) 2670 : cluster [DBG] pgmap v1665: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:34:13.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:13 smithi188 bash[23329]: cluster 2020-07-16T14:34:12.238191+0000 mgr.x (mgr.34562) 2671 : cluster [DBG] pgmap v1666: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:34:13.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:13 smithi132 bash[27079]: cluster 2020-07-16T14:34:12.238191+0000 mgr.x (mgr.34562) 2671 : cluster [DBG] pgmap v1666: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:34:14.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:14 smithi188 bash[23329]: audit 2020-07-16T14:34:13.882482+0000 mon.b (mon.2) 670 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:34:14.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:14 smithi132 bash[27079]: audit 2020-07-16T14:34:13.882482+0000 mon.b (mon.2) 670 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:34:15.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:15 smithi188 bash[23329]: cephadm 2020-07-16T14:34:13.883220+0000 mgr.x (mgr.34562) 2672 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:34:15.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:15 smithi188 bash[23329]: cephadm 2020-07-16T14:34:13.883306+0000 mgr.x (mgr.34562) 2673 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:34:15.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:15 smithi188 bash[23329]: cluster 2020-07-16T14:34:14.238525+0000 mgr.x (mgr.34562) 2674 : cluster [DBG] pgmap v1667: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:34:15.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:15 smithi132 bash[27079]: cephadm 2020-07-16T14:34:13.883220+0000 mgr.x (mgr.34562) 2672 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:34:15.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:15 smithi132 bash[27079]: cephadm 2020-07-16T14:34:13.883306+0000 mgr.x (mgr.34562) 2673 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:34:15.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:15 smithi132 bash[27079]: cluster 2020-07-16T14:34:14.238525+0000 mgr.x (mgr.34562) 2674 : cluster [DBG] pgmap v1667: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:34:17.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:17 smithi188 bash[23329]: cluster 2020-07-16T14:34:16.238844+0000 mgr.x (mgr.34562) 2675 : cluster [DBG] pgmap v1668: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:34:17.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:17 smithi132 bash[27079]: cluster 2020-07-16T14:34:16.238844+0000 mgr.x (mgr.34562) 2675 : cluster [DBG] pgmap v1668: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:34:19.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:19 smithi188 bash[23329]: cluster 2020-07-16T14:34:18.239329+0000 mgr.x (mgr.34562) 2676 : cluster [DBG] pgmap v1669: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:34:19.701 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:34:19.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:19 smithi132 bash[27079]: cluster 2020-07-16T14:34:18.239329+0000 mgr.x (mgr.34562) 2676 : cluster [DBG] pgmap v1669: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:34:19.965 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:34:19.965 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (57m) 2m ago 60m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:34:19.966 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (59m) 2m ago 59m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:34:19.966 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (57m) 2m ago 62m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:34:19.966 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (56m) 2m ago 64m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:34:19.966 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 2m ago 64m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:34:19.966 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (63m) 2m ago 63m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:34:19.967 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (63m) 2m ago 63m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:34:19.967 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (60m) 2m ago 60m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:34:19.967 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (60m) 2m ago 60m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:34:19.967 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (62m) 2m ago 62m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:34:19.967 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (62m) 2m ago 62m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:34:19.968 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (62m) 2m ago 62m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:34:19.968 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (61m) 2m ago 61m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:34:19.968 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (61m) 2m ago 61m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:34:19.968 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (61m) 2m ago 61m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:34:19.968 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (60m) 2m ago 61m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:34:19.969 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (60m) 2m ago 60m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:34:19.969 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (59m) 2m ago 60m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:34:20.263 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:34:20.264 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:34:20.264 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:34:20.264 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:34:20.264 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:34:20.264 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:34:20.265 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:34:20.265 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:34:20.265 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:34:20.265 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:34:20.265 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:34:20.266 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:34:20.266 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:34:20.266 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:34:20.266 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:34:20.266 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:34:20.267 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:34:21.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:20 smithi132 bash[27079]: audit 2020-07-16T14:34:19.685483+0000 mgr.x (mgr.34562) 2677 : audit [DBG] from='client.26584 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:34:21.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:20 smithi132 bash[27079]: audit 2020-07-16T14:34:19.960741+0000 mgr.x (mgr.34562) 2678 : audit [DBG] from='client.26590 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:34:21.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:20 smithi132 bash[27079]: cluster 2020-07-16T14:34:20.239768+0000 mgr.x (mgr.34562) 2679 : cluster [DBG] pgmap v1670: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:34:21.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:20 smithi132 bash[27079]: audit 2020-07-16T14:34:20.262594+0000 mon.c (mon.1) 221 : audit [DBG] from='client.? 172.21.15.132:0/3489316942' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:34:21.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:20 smithi188 bash[23329]: audit 2020-07-16T14:34:19.685483+0000 mgr.x (mgr.34562) 2677 : audit [DBG] from='client.26584 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:34:21.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:20 smithi188 bash[23329]: audit 2020-07-16T14:34:19.960741+0000 mgr.x (mgr.34562) 2678 : audit [DBG] from='client.26590 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:34:21.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:20 smithi188 bash[23329]: cluster 2020-07-16T14:34:20.239768+0000 mgr.x (mgr.34562) 2679 : cluster [DBG] pgmap v1670: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:34:21.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:20 smithi188 bash[23329]: audit 2020-07-16T14:34:20.262594+0000 mon.c (mon.1) 221 : audit [DBG] from='client.? 172.21.15.132:0/3489316942' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:34:23.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:23 smithi188 bash[23329]: cluster 2020-07-16T14:34:22.240233+0000 mgr.x (mgr.34562) 2680 : cluster [DBG] pgmap v1671: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:34:23.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:23 smithi132 bash[27079]: cluster 2020-07-16T14:34:22.240233+0000 mgr.x (mgr.34562) 2680 : cluster [DBG] pgmap v1671: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:34:25.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:25 smithi188 bash[23329]: cluster 2020-07-16T14:34:24.240813+0000 mgr.x (mgr.34562) 2681 : cluster [DBG] pgmap v1672: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:34:25.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:25 smithi132 bash[27079]: cluster 2020-07-16T14:34:24.240813+0000 mgr.x (mgr.34562) 2681 : cluster [DBG] pgmap v1672: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:34:27.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:27 smithi188 bash[23329]: cluster 2020-07-16T14:34:26.241196+0000 mgr.x (mgr.34562) 2682 : cluster [DBG] pgmap v1673: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:34:27.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:27 smithi132 bash[27079]: cluster 2020-07-16T14:34:26.241196+0000 mgr.x (mgr.34562) 2682 : cluster [DBG] pgmap v1673: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:34:29.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:29 smithi188 bash[23329]: cluster 2020-07-16T14:34:28.241572+0000 mgr.x (mgr.34562) 2683 : cluster [DBG] pgmap v1674: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:34:29.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:29 smithi188 bash[23329]: audit 2020-07-16T14:34:28.899044+0000 mon.b (mon.2) 671 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:34:29.783 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:29 smithi132 bash[27079]: cluster 2020-07-16T14:34:28.241572+0000 mgr.x (mgr.34562) 2683 : cluster [DBG] pgmap v1674: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:34:29.783 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:29 smithi132 bash[27079]: audit 2020-07-16T14:34:28.899044+0000 mon.b (mon.2) 671 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:34:30.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:30 smithi188 bash[23329]: cephadm 2020-07-16T14:34:28.899750+0000 mgr.x (mgr.34562) 2684 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:34:30.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:30 smithi188 bash[23329]: cephadm 2020-07-16T14:34:28.899952+0000 mgr.x (mgr.34562) 2685 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:34:30.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:30 smithi132 bash[27079]: cephadm 2020-07-16T14:34:28.899750+0000 mgr.x (mgr.34562) 2684 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:34:30.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:30 smithi132 bash[27079]: cephadm 2020-07-16T14:34:28.899952+0000 mgr.x (mgr.34562) 2685 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:34:31.678 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:31 smithi188 bash[23329]: cluster 2020-07-16T14:34:30.241971+0000 mgr.x (mgr.34562) 2686 : cluster [DBG] pgmap v1675: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:34:31.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:31 smithi132 bash[27079]: cluster 2020-07-16T14:34:30.241971+0000 mgr.x (mgr.34562) 2686 : cluster [DBG] pgmap v1675: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:34:33.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:33 smithi188 bash[23329]: cluster 2020-07-16T14:34:32.242372+0000 mgr.x (mgr.34562) 2687 : cluster [DBG] pgmap v1676: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:34:33.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:33 smithi132 bash[27079]: cluster 2020-07-16T14:34:32.242372+0000 mgr.x (mgr.34562) 2687 : cluster [DBG] pgmap v1676: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:34:35.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:35 smithi188 bash[23329]: cluster 2020-07-16T14:34:34.242826+0000 mgr.x (mgr.34562) 2688 : cluster [DBG] pgmap v1677: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:34:35.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:35 smithi132 bash[27079]: cluster 2020-07-16T14:34:34.242826+0000 mgr.x (mgr.34562) 2688 : cluster [DBG] pgmap v1677: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:34:37.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:37 smithi188 bash[23329]: cluster 2020-07-16T14:34:36.243238+0000 mgr.x (mgr.34562) 2689 : cluster [DBG] pgmap v1678: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:34:37.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:37 smithi132 bash[27079]: cluster 2020-07-16T14:34:36.243238+0000 mgr.x (mgr.34562) 2689 : cluster [DBG] pgmap v1678: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:34:39.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:39 smithi188 bash[23329]: cluster 2020-07-16T14:34:38.243692+0000 mgr.x (mgr.34562) 2690 : cluster [DBG] pgmap v1679: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:34:39.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:39 smithi132 bash[27079]: cluster 2020-07-16T14:34:38.243692+0000 mgr.x (mgr.34562) 2690 : cluster [DBG] pgmap v1679: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:34:41.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:40 smithi132 bash[27079]: cluster 2020-07-16T14:34:40.244056+0000 mgr.x (mgr.34562) 2691 : cluster [DBG] pgmap v1680: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:34:41.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:40 smithi188 bash[23329]: cluster 2020-07-16T14:34:40.244056+0000 mgr.x (mgr.34562) 2691 : cluster [DBG] pgmap v1680: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:34:43.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:43 smithi188 bash[23329]: cluster 2020-07-16T14:34:42.244573+0000 mgr.x (mgr.34562) 2692 : cluster [DBG] pgmap v1681: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:34:43.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:43 smithi132 bash[27079]: cluster 2020-07-16T14:34:42.244573+0000 mgr.x (mgr.34562) 2692 : cluster [DBG] pgmap v1681: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:34:44.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:44 smithi188 bash[23329]: audit 2020-07-16T14:34:43.914511+0000 mon.b (mon.2) 672 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T14:34:44.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:44 smithi132 bash[27079]: audit 2020-07-16T14:34:43.914511+0000 mon.b (mon.2) 672 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T14:34:45.398 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:45 smithi188 bash[23329]: cluster 2020-07-16T14:34:44.245047+0000 mgr.x (mgr.34562) 2693 : cluster [DBG] pgmap v1682: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:34:45.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:45 smithi132 bash[27079]: cluster 2020-07-16T14:34:44.245047+0000 mgr.x (mgr.34562) 2693 : cluster [DBG] pgmap v1682: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:34:47.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:47 smithi132 bash[27079]: cluster 2020-07-16T14:34:46.245492+0000 mgr.x (mgr.34562) 2694 : cluster [DBG] pgmap v1683: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:34:47.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:47 smithi132 bash[27079]: audit 2020-07-16T14:34:46.506549+0000 mon.b (mon.2) 673 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T14:34:47.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:47 smithi132 bash[27079]: audit 2020-07-16T14:34:46.716956+0000 mon.b (mon.2) 674 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.261903\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.261975\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262006\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262168\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262268\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262400\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262501\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262535\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262564\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:31:32.262647\", \"last_device_update\": \"2020-07-16T14:34:46.715995\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:33:38.094344\"}"}]: dispatch 2020-07-16T14:34:47.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:47 smithi132 bash[27079]: audit 2020-07-16T14:34:46.717863+0000 mon.c (mon.1) 222 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.261903\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.261975\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262006\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262168\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262268\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262400\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262501\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262535\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262564\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:31:32.262647\", \"last_device_update\": \"2020-07-16T14:34:46.715995\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:33:38.094344\"}"}]: dispatch 2020-07-16T14:34:47.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:47 smithi132 bash[27079]: audit 2020-07-16T14:34:46.720881+0000 mon.c (mon.1) 223 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.261903\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.261975\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262006\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262168\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262268\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262400\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262501\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262535\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262564\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:31:32.262647\", \"last_device_update\": \"2020-07-16T14:34:46.715995\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:33:38.094344\"}"}]': finished 2020-07-16T14:34:47.532 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:47 smithi132 bash[27079]: audit 2020-07-16T14:34:46.723496+0000 mon.b (mon.2) 675 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:34:47.532 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:47 smithi132 bash[27079]: audit 2020-07-16T14:34:46.724468+0000 mon.b (mon.2) 676 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:34:47.532 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:47 smithi132 bash[27079]: audit 2020-07-16T14:34:46.725276+0000 mon.b (mon.2) 677 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:34:47.532 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:47 smithi132 bash[27079]: audit 2020-07-16T14:34:46.726250+0000 mon.b (mon.2) 678 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:34:47.532 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:47 smithi132 bash[27079]: audit 2020-07-16T14:34:46.727118+0000 mon.b (mon.2) 679 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:34:47.576 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:47 smithi188 bash[23329]: cluster 2020-07-16T14:34:46.245492+0000 mgr.x (mgr.34562) 2694 : cluster [DBG] pgmap v1683: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:34:47.576 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:47 smithi188 bash[23329]: audit 2020-07-16T14:34:46.506549+0000 mon.b (mon.2) 673 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T14:34:47.576 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:47 smithi188 bash[23329]: audit 2020-07-16T14:34:46.716956+0000 mon.b (mon.2) 674 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.261903\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.261975\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262006\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262168\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262268\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262400\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262501\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262535\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262564\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:31:32.262647\", \"last_device_update\": \"2020-07-16T14:34:46.715995\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:33:38.094344\"}"}]: dispatch 2020-07-16T14:34:47.577 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:47 smithi188 bash[23329]: audit 2020-07-16T14:34:46.717863+0000 mon.c (mon.1) 222 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.261903\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.261975\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262006\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262168\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262268\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262400\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262501\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262535\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262564\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:31:32.262647\", \"last_device_update\": \"2020-07-16T14:34:46.715995\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:33:38.094344\"}"}]: dispatch 2020-07-16T14:34:47.577 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:47 smithi188 bash[23329]: audit 2020-07-16T14:34:46.720881+0000 mon.c (mon.1) 223 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.261903\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.261975\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262006\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262168\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262268\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262400\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262501\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262535\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:31:32.262564\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:31:32.262647\", \"last_device_update\": \"2020-07-16T14:34:46.715995\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:33:38.094344\"}"}]': finished 2020-07-16T14:34:47.577 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:47 smithi188 bash[23329]: audit 2020-07-16T14:34:46.723496+0000 mon.b (mon.2) 675 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:34:47.577 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:47 smithi188 bash[23329]: audit 2020-07-16T14:34:46.724468+0000 mon.b (mon.2) 676 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:34:47.578 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:47 smithi188 bash[23329]: audit 2020-07-16T14:34:46.725276+0000 mon.b (mon.2) 677 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:34:47.578 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:47 smithi188 bash[23329]: audit 2020-07-16T14:34:46.726250+0000 mon.b (mon.2) 678 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:34:47.578 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:47 smithi188 bash[23329]: audit 2020-07-16T14:34:46.727118+0000 mon.b (mon.2) 679 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:34:48.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:48 smithi132 bash[27079]: audit 2020-07-16T14:34:46.723774+0000 mgr.x (mgr.34562) 2695 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:34:48.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:48 smithi132 bash[27079]: audit 2020-07-16T14:34:46.724708+0000 mgr.x (mgr.34562) 2696 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:34:48.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:48 smithi132 bash[27079]: audit 2020-07-16T14:34:46.725514+0000 mgr.x (mgr.34562) 2697 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:34:48.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:48 smithi132 bash[27079]: cephadm 2020-07-16T14:34:46.726000+0000 mgr.x (mgr.34562) 2698 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:34:48.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:48 smithi132 bash[27079]: cephadm 2020-07-16T14:34:46.726895+0000 mgr.x (mgr.34562) 2699 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:34:48.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:48 smithi132 bash[27079]: cephadm 2020-07-16T14:34:46.727615+0000 mgr.x (mgr.34562) 2700 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:34:48.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:48 smithi132 bash[27079]: cephadm 2020-07-16T14:34:46.727744+0000 mgr.x (mgr.34562) 2701 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:34:48.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:48 smithi188 bash[23329]: audit 2020-07-16T14:34:46.723774+0000 mgr.x (mgr.34562) 2695 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:34:48.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:48 smithi188 bash[23329]: audit 2020-07-16T14:34:46.724708+0000 mgr.x (mgr.34562) 2696 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:34:48.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:48 smithi188 bash[23329]: audit 2020-07-16T14:34:46.725514+0000 mgr.x (mgr.34562) 2697 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:34:48.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:48 smithi188 bash[23329]: cephadm 2020-07-16T14:34:46.726000+0000 mgr.x (mgr.34562) 2698 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:34:48.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:48 smithi188 bash[23329]: cephadm 2020-07-16T14:34:46.726895+0000 mgr.x (mgr.34562) 2699 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:34:48.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:48 smithi188 bash[23329]: cephadm 2020-07-16T14:34:46.727615+0000 mgr.x (mgr.34562) 2700 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:34:48.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:48 smithi188 bash[23329]: cephadm 2020-07-16T14:34:46.727744+0000 mgr.x (mgr.34562) 2701 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:34:49.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:49 smithi188 bash[23329]: cluster 2020-07-16T14:34:48.245974+0000 mgr.x (mgr.34562) 2702 : cluster [DBG] pgmap v1684: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:34:49.783 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:49 smithi132 bash[27079]: cluster 2020-07-16T14:34:48.245974+0000 mgr.x (mgr.34562) 2702 : cluster [DBG] pgmap v1684: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:34:50.561 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:34:50.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:50 smithi188 bash[23329]: audit 2020-07-16T14:34:49.447344+0000 mon.b (mon.2) 680 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:34:50.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:50 smithi132 bash[27079]: audit 2020-07-16T14:34:49.447344+0000 mon.b (mon.2) 680 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:34:50.822 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:34:50.822 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (57m) 3m ago 60m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:34:50.822 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (60m) 3m ago 60m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:34:50.822 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (57m) 3m ago 63m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:34:50.823 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (57m) 3m ago 65m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:34:50.823 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 3m ago 65m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:34:50.823 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (63m) 3m ago 63m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:34:50.823 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (63m) 3m ago 63m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:34:50.823 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (60m) 3m ago 60m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:34:50.824 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (60m) 3m ago 60m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:34:50.824 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (63m) 3m ago 63m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:34:50.824 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (62m) 3m ago 62m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:34:50.824 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (62m) 3m ago 62m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:34:50.824 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (62m) 3m ago 62m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:34:50.825 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (61m) 3m ago 62m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:34:50.825 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (61m) 3m ago 61m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:34:50.825 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (61m) 3m ago 61m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:34:50.825 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (61m) 3m ago 61m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:34:50.825 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (60m) 3m ago 60m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:34:51.121 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:34:51.122 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:34:51.122 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:34:51.122 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:34:51.122 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:34:51.122 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:34:51.123 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:34:51.123 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:34:51.123 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:34:51.123 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:34:51.123 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:34:51.124 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:34:51.124 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:34:51.124 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:34:51.124 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:34:51.124 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:34:51.125 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:34:51.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:51 smithi188 bash[23329]: cephadm 2020-07-16T14:34:49.447979+0000 mgr.x (mgr.34562) 2703 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:34:51.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:51 smithi188 bash[23329]: cephadm 2020-07-16T14:34:49.448420+0000 mgr.x (mgr.34562) 2704 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:34:51.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:51 smithi188 bash[23329]: cluster 2020-07-16T14:34:50.246472+0000 mgr.x (mgr.34562) 2705 : cluster [DBG] pgmap v1685: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:34:51.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:51 smithi188 bash[23329]: audit 2020-07-16T14:34:51.120627+0000 mon.c (mon.1) 224 : audit [DBG] from='client.? 172.21.15.132:0/20186407' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:34:51.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:51 smithi132 bash[27079]: cephadm 2020-07-16T14:34:49.447979+0000 mgr.x (mgr.34562) 2703 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:34:51.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:51 smithi132 bash[27079]: cephadm 2020-07-16T14:34:49.448420+0000 mgr.x (mgr.34562) 2704 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:34:51.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:51 smithi132 bash[27079]: cluster 2020-07-16T14:34:50.246472+0000 mgr.x (mgr.34562) 2705 : cluster [DBG] pgmap v1685: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:34:51.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:51 smithi132 bash[27079]: audit 2020-07-16T14:34:51.120627+0000 mon.c (mon.1) 224 : audit [DBG] from='client.? 172.21.15.132:0/20186407' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:34:52.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:52 smithi188 bash[23329]: audit 2020-07-16T14:34:50.549828+0000 mgr.x (mgr.34562) 2706 : audit [DBG] from='client.26602 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:34:52.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:52 smithi188 bash[23329]: audit 2020-07-16T14:34:50.816408+0000 mgr.x (mgr.34562) 2707 : audit [DBG] from='client.26608 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:34:52.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:52 smithi132 bash[27079]: audit 2020-07-16T14:34:50.549828+0000 mgr.x (mgr.34562) 2706 : audit [DBG] from='client.26602 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:34:52.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:52 smithi132 bash[27079]: audit 2020-07-16T14:34:50.816408+0000 mgr.x (mgr.34562) 2707 : audit [DBG] from='client.26608 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:34:53.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:53 smithi188 bash[23329]: cluster 2020-07-16T14:34:52.246801+0000 mgr.x (mgr.34562) 2708 : cluster [DBG] pgmap v1686: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:34:53.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:53 smithi132 bash[27079]: cluster 2020-07-16T14:34:52.246801+0000 mgr.x (mgr.34562) 2708 : cluster [DBG] pgmap v1686: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:34:55.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:55 smithi188 bash[23329]: cluster 2020-07-16T14:34:54.247209+0000 mgr.x (mgr.34562) 2709 : cluster [DBG] pgmap v1687: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:34:55.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:55 smithi132 bash[27079]: cluster 2020-07-16T14:34:54.247209+0000 mgr.x (mgr.34562) 2709 : cluster [DBG] pgmap v1687: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:34:57.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:57 smithi188 bash[23329]: cluster 2020-07-16T14:34:56.247694+0000 mgr.x (mgr.34562) 2710 : cluster [DBG] pgmap v1688: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:34:57.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:57 smithi132 bash[27079]: cluster 2020-07-16T14:34:56.247694+0000 mgr.x (mgr.34562) 2710 : cluster [DBG] pgmap v1688: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:34:59.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:34:59 smithi188 bash[23329]: cluster 2020-07-16T14:34:58.248220+0000 mgr.x (mgr.34562) 2711 : cluster [DBG] pgmap v1689: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:34:59.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:34:59 smithi132 bash[27079]: cluster 2020-07-16T14:34:58.248220+0000 mgr.x (mgr.34562) 2711 : cluster [DBG] pgmap v1689: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:35:01.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:35:00 smithi132 bash[27079]: cluster 2020-07-16T14:35:00.248668+0000 mgr.x (mgr.34562) 2712 : cluster [DBG] pgmap v1690: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:35:01.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:35:00 smithi188 bash[23329]: cluster 2020-07-16T14:35:00.248668+0000 mgr.x (mgr.34562) 2712 : cluster [DBG] pgmap v1690: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:35:03.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:35:03 smithi188 bash[23329]: cluster 2020-07-16T14:35:02.249035+0000 mgr.x (mgr.34562) 2713 : cluster [DBG] pgmap v1691: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:35:03.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:35:03 smithi132 bash[27079]: cluster 2020-07-16T14:35:02.249035+0000 mgr.x (mgr.34562) 2713 : cluster [DBG] pgmap v1691: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:35:05.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:35:05 smithi188 bash[23329]: cluster 2020-07-16T14:35:04.249456+0000 mgr.x (mgr.34562) 2714 : cluster [DBG] pgmap v1692: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:35:05.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:35:05 smithi188 bash[23329]: audit 2020-07-16T14:35:04.463991+0000 mon.b (mon.2) 681 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:35:05.783 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:35:05 smithi132 bash[27079]: cluster 2020-07-16T14:35:04.249456+0000 mgr.x (mgr.34562) 2714 : cluster [DBG] pgmap v1692: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:35:05.783 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:35:05 smithi132 bash[27079]: audit 2020-07-16T14:35:04.463991+0000 mon.b (mon.2) 681 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:35:06.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:35:06 smithi188 bash[23329]: cephadm 2020-07-16T14:35:04.464666+0000 mgr.x (mgr.34562) 2715 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:35:06.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:35:06 smithi188 bash[23329]: cephadm 2020-07-16T14:35:04.464825+0000 mgr.x (mgr.34562) 2716 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:35:06.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:35:06 smithi132 bash[27079]: cephadm 2020-07-16T14:35:04.464666+0000 mgr.x (mgr.34562) 2715 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:35:06.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:35:06 smithi132 bash[27079]: cephadm 2020-07-16T14:35:04.464825+0000 mgr.x (mgr.34562) 2716 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:35:07.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:35:07 smithi188 bash[23329]: cluster 2020-07-16T14:35:06.249836+0000 mgr.x (mgr.34562) 2717 : cluster [DBG] pgmap v1693: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:35:07.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:35:07 smithi132 bash[27079]: cluster 2020-07-16T14:35:06.249836+0000 mgr.x (mgr.34562) 2717 : cluster [DBG] pgmap v1693: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:35:09.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:35:09 smithi188 bash[23329]: cluster 2020-07-16T14:35:08.250187+0000 mgr.x (mgr.34562) 2718 : cluster [DBG] pgmap v1694: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:35:09.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:35:09 smithi132 bash[27079]: cluster 2020-07-16T14:35:08.250187+0000 mgr.x (mgr.34562) 2718 : cluster [DBG] pgmap v1694: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:35:11.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:35:10 smithi132 bash[27079]: cluster 2020-07-16T14:35:10.250586+0000 mgr.x (mgr.34562) 2719 : cluster [DBG] pgmap v1695: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:35:11.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:35:10 smithi188 bash[23329]: cluster 2020-07-16T14:35:10.250586+0000 mgr.x (mgr.34562) 2719 : cluster [DBG] pgmap v1695: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:35:13.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:35:13 smithi188 bash[23329]: cluster 2020-07-16T14:35:12.251067+0000 mgr.x (mgr.34562) 2720 : cluster [DBG] pgmap v1696: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:35:13.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:35:13 smithi132 bash[27079]: cluster 2020-07-16T14:35:12.251067+0000 mgr.x (mgr.34562) 2720 : cluster [DBG] pgmap v1696: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:35:15.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:35:15 smithi188 bash[23329]: cluster 2020-07-16T14:35:14.251456+0000 mgr.x (mgr.34562) 2721 : cluster [DBG] pgmap v1697: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:35:15.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:35:15 smithi132 bash[27079]: cluster 2020-07-16T14:35:14.251456+0000 mgr.x (mgr.34562) 2721 : cluster [DBG] pgmap v1697: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:35:17.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:35:17 smithi132 bash[27079]: cluster 2020-07-16T14:35:16.251869+0000 mgr.x (mgr.34562) 2722 : cluster [DBG] pgmap v1698: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:35:17.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:35:17 smithi188 bash[23329]: cluster 2020-07-16T14:35:16.251869+0000 mgr.x (mgr.34562) 2722 : cluster [DBG] pgmap v1698: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:35:19.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:35:19 smithi188 bash[23329]: cluster 2020-07-16T14:35:18.252319+0000 mgr.x (mgr.34562) 2723 : cluster [DBG] pgmap v1699: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:35:19.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:35:19 smithi132 bash[27079]: cluster 2020-07-16T14:35:18.252319+0000 mgr.x (mgr.34562) 2723 : cluster [DBG] pgmap v1699: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:35:20.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:35:20 smithi188 bash[23329]: audit 2020-07-16T14:35:19.479766+0000 mon.b (mon.2) 682 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:35:20.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:35:20 smithi132 bash[27079]: audit 2020-07-16T14:35:19.479766+0000 mon.b (mon.2) 682 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:35:21.419 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:35:21.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:35:21 smithi188 bash[23329]: cephadm 2020-07-16T14:35:19.480470+0000 mgr.x (mgr.34562) 2724 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:35:21.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:35:21 smithi188 bash[23329]: cephadm 2020-07-16T14:35:19.480953+0000 mgr.x (mgr.34562) 2725 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:35:21.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:35:21 smithi188 bash[23329]: cluster 2020-07-16T14:35:20.252649+0000 mgr.x (mgr.34562) 2726 : cluster [DBG] pgmap v1700: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:35:21.681 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:35:21.682 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (58m) 3m ago 61m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:35:21.682 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (60m) 3m ago 60m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:35:21.683 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (58m) 3m ago 63m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:35:21.683 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (57m) 3m ago 65m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:35:21.683 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 3m ago 65m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:35:21.684 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (64m) 3m ago 64m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:35:21.684 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (64m) 3m ago 64m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:35:21.684 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (61m) 3m ago 61m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:35:21.685 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (61m) 3m ago 61m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:35:21.685 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (63m) 3m ago 63m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:35:21.685 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (63m) 3m ago 63m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:35:21.686 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (63m) 3m ago 63m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:35:21.686 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (62m) 3m ago 62m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:35:21.686 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (62m) 3m ago 62m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:35:21.687 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (62m) 3m ago 62m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:35:21.687 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (62m) 3m ago 62m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:35:21.687 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (61m) 3m ago 61m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:35:21.688 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (60m) 3m ago 61m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:35:21.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:35:21 smithi132 bash[27079]: cephadm 2020-07-16T14:35:19.480470+0000 mgr.x (mgr.34562) 2724 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:35:21.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:35:21 smithi132 bash[27079]: cephadm 2020-07-16T14:35:19.480953+0000 mgr.x (mgr.34562) 2725 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:35:21.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:35:21 smithi132 bash[27079]: cluster 2020-07-16T14:35:20.252649+0000 mgr.x (mgr.34562) 2726 : cluster [DBG] pgmap v1700: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:35:21.978 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:35:21.979 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:35:21.979 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:35:21.979 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:35:21.980 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:35:21.980 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:35:21.980 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:35:21.980 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:35:21.981 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:35:21.981 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:35:21.981 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:35:21.982 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:35:21.982 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:35:21.982 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:35:21.982 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:35:21.982 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:35:21.983 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:35:22.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:35:22 smithi188 bash[23329]: audit 2020-07-16T14:35:21.406834+0000 mgr.x (mgr.34562) 2727 : audit [DBG] from='client.26620 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:35:22.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:35:22 smithi188 bash[23329]: audit 2020-07-16T14:35:21.977855+0000 mon.c (mon.1) 225 : audit [DBG] from='client.? 172.21.15.132:0/2690848498' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:35:22.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:35:22 smithi132 bash[27079]: audit 2020-07-16T14:35:21.406834+0000 mgr.x (mgr.34562) 2727 : audit [DBG] from='client.26620 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:35:22.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:35:22 smithi132 bash[27079]: audit 2020-07-16T14:35:21.977855+0000 mon.c (mon.1) 225 : audit [DBG] from='client.? 172.21.15.132:0/2690848498' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:35:23.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:35:23 smithi188 bash[23329]: audit 2020-07-16T14:35:21.673957+0000 mgr.x (mgr.34562) 2728 : audit [DBG] from='client.26626 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:35:23.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:35:23 smithi188 bash[23329]: cluster 2020-07-16T14:35:22.253166+0000 mgr.x (mgr.34562) 2729 : cluster [DBG] pgmap v1701: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:35:23.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:35:23 smithi132 bash[27079]: audit 2020-07-16T14:35:21.673957+0000 mgr.x (mgr.34562) 2728 : audit [DBG] from='client.26626 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:35:23.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:35:23 smithi132 bash[27079]: cluster 2020-07-16T14:35:22.253166+0000 mgr.x (mgr.34562) 2729 : cluster [DBG] pgmap v1701: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:35:25.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:35:25 smithi188 bash[23329]: cluster 2020-07-16T14:35:24.253604+0000 mgr.x (mgr.34562) 2730 : cluster [DBG] pgmap v1702: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:35:25.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:35:25 smithi132 bash[27079]: cluster 2020-07-16T14:35:24.253604+0000 mgr.x (mgr.34562) 2730 : cluster [DBG] pgmap v1702: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:35:27.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:35:27 smithi188 bash[23329]: cluster 2020-07-16T14:35:26.254048+0000 mgr.x (mgr.34562) 2731 : cluster [DBG] pgmap v1703: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:35:27.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:35:27 smithi132 bash[27079]: cluster 2020-07-16T14:35:26.254048+0000 mgr.x (mgr.34562) 2731 : cluster [DBG] pgmap v1703: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:35:29.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:35:29 smithi188 bash[23329]: cluster 2020-07-16T14:35:28.254586+0000 mgr.x (mgr.34562) 2732 : cluster [DBG] pgmap v1704: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:35:29.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:35:29 smithi132 bash[27079]: cluster 2020-07-16T14:35:28.254586+0000 mgr.x (mgr.34562) 2732 : cluster [DBG] pgmap v1704: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:35:31.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:35:30 smithi132 bash[27079]: cluster 2020-07-16T14:35:30.255038+0000 mgr.x (mgr.34562) 2733 : cluster [DBG] pgmap v1705: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:35:31.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:35:30 smithi188 bash[23329]: cluster 2020-07-16T14:35:30.255038+0000 mgr.x (mgr.34562) 2733 : cluster [DBG] pgmap v1705: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:35:33.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:35:33 smithi188 bash[23329]: cluster 2020-07-16T14:35:32.255502+0000 mgr.x (mgr.34562) 2734 : cluster [DBG] pgmap v1706: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:35:33.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:35:33 smithi132 bash[27079]: cluster 2020-07-16T14:35:32.255502+0000 mgr.x (mgr.34562) 2734 : cluster [DBG] pgmap v1706: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:35:35.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:35:35 smithi188 bash[23329]: cluster 2020-07-16T14:35:34.255952+0000 mgr.x (mgr.34562) 2735 : cluster [DBG] pgmap v1707: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:35:35.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:35:35 smithi188 bash[23329]: audit 2020-07-16T14:35:34.487740+0000 mon.b (mon.2) 683 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:35:35.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:35:35 smithi132 bash[27079]: cluster 2020-07-16T14:35:34.255952+0000 mgr.x (mgr.34562) 2735 : cluster [DBG] pgmap v1707: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:35:35.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:35:35 smithi132 bash[27079]: audit 2020-07-16T14:35:34.487740+0000 mon.b (mon.2) 683 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:35:36.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:35:36 smithi188 bash[23329]: cephadm 2020-07-16T14:35:34.488415+0000 mgr.x (mgr.34562) 2736 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:35:36.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:35:36 smithi188 bash[23329]: cephadm 2020-07-16T14:35:34.488832+0000 mgr.x (mgr.34562) 2737 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:35:36.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:35:36 smithi132 bash[27079]: cephadm 2020-07-16T14:35:34.488415+0000 mgr.x (mgr.34562) 2736 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:35:36.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:35:36 smithi132 bash[27079]: cephadm 2020-07-16T14:35:34.488832+0000 mgr.x (mgr.34562) 2737 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:35:37.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:35:37 smithi188 bash[23329]: cluster 2020-07-16T14:35:36.256466+0000 mgr.x (mgr.34562) 2738 : cluster [DBG] pgmap v1708: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:35:37.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:35:37 smithi132 bash[27079]: cluster 2020-07-16T14:35:36.256466+0000 mgr.x (mgr.34562) 2738 : cluster [DBG] pgmap v1708: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:35:39.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:35:39 smithi188 bash[23329]: cluster 2020-07-16T14:35:38.257016+0000 mgr.x (mgr.34562) 2739 : cluster [DBG] pgmap v1709: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:35:39.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:35:39 smithi132 bash[27079]: cluster 2020-07-16T14:35:38.257016+0000 mgr.x (mgr.34562) 2739 : cluster [DBG] pgmap v1709: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:35:41.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:35:40 smithi132 bash[27079]: cluster 2020-07-16T14:35:40.257401+0000 mgr.x (mgr.34562) 2740 : cluster [DBG] pgmap v1710: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:35:41.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:35:40 smithi188 bash[23329]: cluster 2020-07-16T14:35:40.257401+0000 mgr.x (mgr.34562) 2740 : cluster [DBG] pgmap v1710: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:35:43.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:35:43 smithi188 bash[23329]: cluster 2020-07-16T14:35:42.257802+0000 mgr.x (mgr.34562) 2741 : cluster [DBG] pgmap v1711: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:35:43.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:35:43 smithi132 bash[27079]: cluster 2020-07-16T14:35:42.257802+0000 mgr.x (mgr.34562) 2741 : cluster [DBG] pgmap v1711: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:35:45.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:35:45 smithi188 bash[23329]: cluster 2020-07-16T14:35:44.258275+0000 mgr.x (mgr.34562) 2742 : cluster [DBG] pgmap v1712: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:35:45.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:35:45 smithi132 bash[27079]: cluster 2020-07-16T14:35:44.258275+0000 mgr.x (mgr.34562) 2742 : cluster [DBG] pgmap v1712: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:35:47.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:35:47 smithi188 bash[23329]: cluster 2020-07-16T14:35:46.258637+0000 mgr.x (mgr.34562) 2743 : cluster [DBG] pgmap v1713: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:35:47.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:35:47 smithi132 bash[27079]: cluster 2020-07-16T14:35:46.258637+0000 mgr.x (mgr.34562) 2743 : cluster [DBG] pgmap v1713: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:35:49.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:35:49 smithi188 bash[23329]: cluster 2020-07-16T14:35:48.259148+0000 mgr.x (mgr.34562) 2744 : cluster [DBG] pgmap v1714: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:35:49.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:35:49 smithi132 bash[27079]: cluster 2020-07-16T14:35:48.259148+0000 mgr.x (mgr.34562) 2744 : cluster [DBG] pgmap v1714: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:35:50.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:35:50 smithi188 bash[23329]: audit 2020-07-16T14:35:49.500303+0000 mon.b (mon.2) 684 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:35:50.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:35:50 smithi188 bash[23329]: audit 2020-07-16T14:35:49.501742+0000 mon.b (mon.2) 685 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:35:50.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:35:50 smithi188 bash[23329]: audit 2020-07-16T14:35:49.502973+0000 mon.b (mon.2) 686 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:35:50.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:35:50 smithi188 bash[23329]: audit 2020-07-16T14:35:49.504482+0000 mon.b (mon.2) 687 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:35:50.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:35:50 smithi188 bash[23329]: audit 2020-07-16T14:35:49.505673+0000 mon.b (mon.2) 688 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:35:50.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:35:50 smithi132 bash[27079]: audit 2020-07-16T14:35:49.500303+0000 mon.b (mon.2) 684 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:35:50.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:35:50 smithi132 bash[27079]: audit 2020-07-16T14:35:49.501742+0000 mon.b (mon.2) 685 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:35:50.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:35:50 smithi132 bash[27079]: audit 2020-07-16T14:35:49.502973+0000 mon.b (mon.2) 686 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:35:50.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:35:50 smithi132 bash[27079]: audit 2020-07-16T14:35:49.504482+0000 mon.b (mon.2) 687 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:35:50.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:35:50 smithi132 bash[27079]: audit 2020-07-16T14:35:49.505673+0000 mon.b (mon.2) 688 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:35:51.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:35:51 smithi188 bash[23329]: audit 2020-07-16T14:35:49.500671+0000 mgr.x (mgr.34562) 2745 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:35:51.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:35:51 smithi188 bash[23329]: audit 2020-07-16T14:35:49.502053+0000 mgr.x (mgr.34562) 2746 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:35:51.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:35:51 smithi188 bash[23329]: audit 2020-07-16T14:35:49.503271+0000 mgr.x (mgr.34562) 2747 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:35:51.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:35:51 smithi188 bash[23329]: cephadm 2020-07-16T14:35:49.504075+0000 mgr.x (mgr.34562) 2748 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:35:51.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:35:51 smithi188 bash[23329]: cephadm 2020-07-16T14:35:49.505271+0000 mgr.x (mgr.34562) 2749 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:35:51.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:35:51 smithi188 bash[23329]: cephadm 2020-07-16T14:35:49.506357+0000 mgr.x (mgr.34562) 2750 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:35:51.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:35:51 smithi188 bash[23329]: cephadm 2020-07-16T14:35:49.506423+0000 mgr.x (mgr.34562) 2751 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:35:51.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:35:51 smithi188 bash[23329]: cluster 2020-07-16T14:35:50.259632+0000 mgr.x (mgr.34562) 2752 : cluster [DBG] pgmap v1715: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:35:51.766 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:35:51 smithi132 bash[27079]: audit 2020-07-16T14:35:49.500671+0000 mgr.x (mgr.34562) 2745 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:35:51.766 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:35:51 smithi132 bash[27079]: audit 2020-07-16T14:35:49.502053+0000 mgr.x (mgr.34562) 2746 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:35:51.767 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:35:51 smithi132 bash[27079]: audit 2020-07-16T14:35:49.503271+0000 mgr.x (mgr.34562) 2747 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:35:51.767 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:35:51 smithi132 bash[27079]: cephadm 2020-07-16T14:35:49.504075+0000 mgr.x (mgr.34562) 2748 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:35:51.767 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:35:51 smithi132 bash[27079]: cephadm 2020-07-16T14:35:49.505271+0000 mgr.x (mgr.34562) 2749 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:35:51.767 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:35:51 smithi132 bash[27079]: cephadm 2020-07-16T14:35:49.506357+0000 mgr.x (mgr.34562) 2750 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:35:51.767 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:35:51 smithi132 bash[27079]: cephadm 2020-07-16T14:35:49.506423+0000 mgr.x (mgr.34562) 2751 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:35:51.768 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:35:51 smithi132 bash[27079]: cluster 2020-07-16T14:35:50.259632+0000 mgr.x (mgr.34562) 2752 : cluster [DBG] pgmap v1715: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:35:52.285 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:35:52.541 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:35:52.541 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (58m) 4m ago 61m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:35:52.541 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (61m) 4m ago 61m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:35:52.542 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (58m) 4m ago 64m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:35:52.542 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (58m) 4m ago 66m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:35:52.542 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 4m ago 66m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:35:52.542 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (64m) 4m ago 64m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:35:52.542 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (64m) 4m ago 64m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:35:52.543 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (61m) 4m ago 61m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:35:52.543 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (61m) 4m ago 61m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:35:52.543 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (64m) 4m ago 64m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:35:52.543 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (63m) 4m ago 63m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:35:52.543 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (63m) 4m ago 63m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:35:52.544 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (63m) 4m ago 63m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:35:52.544 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (62m) 4m ago 63m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:35:52.544 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (62m) 4m ago 62m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:35:52.544 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (62m) 4m ago 62m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:35:52.544 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (62m) 4m ago 62m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:35:52.545 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (61m) 4m ago 61m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:35:52.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:35:52 smithi188 bash[23329]: audit 2020-07-16T14:35:52.301772+0000 mon.b (mon.2) 689 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:35:52.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:35:52 smithi132 bash[27079]: audit 2020-07-16T14:35:52.301772+0000 mon.b (mon.2) 689 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:35:52.839 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:35:52.840 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:35:52.840 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:35:52.840 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:35:52.841 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:35:52.841 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:35:52.841 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:35:52.841 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:35:52.841 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:35:52.842 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:35:52.842 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:35:52.842 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:35:52.842 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:35:52.842 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:35:52.843 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:35:52.843 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:35:52.843 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:35:53.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:35:53 smithi188 bash[23329]: cluster 2020-07-16T14:35:52.259961+0000 mgr.x (mgr.34562) 2753 : cluster [DBG] pgmap v1716: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:35:53.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:35:53 smithi188 bash[23329]: audit 2020-07-16T14:35:52.266804+0000 mgr.x (mgr.34562) 2754 : audit [DBG] from='client.26638 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:35:53.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:35:53 smithi188 bash[23329]: cephadm 2020-07-16T14:35:52.302387+0000 mgr.x (mgr.34562) 2755 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:35:53.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:35:53 smithi188 bash[23329]: cephadm 2020-07-16T14:35:52.302621+0000 mgr.x (mgr.34562) 2756 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:35:53.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:35:53 smithi188 bash[23329]: audit 2020-07-16T14:35:52.838908+0000 mon.c (mon.1) 226 : audit [DBG] from='client.? 172.21.15.132:0/3400758603' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:35:53.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:35:53 smithi132 bash[27079]: cluster 2020-07-16T14:35:52.259961+0000 mgr.x (mgr.34562) 2753 : cluster [DBG] pgmap v1716: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:35:53.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:35:53 smithi132 bash[27079]: audit 2020-07-16T14:35:52.266804+0000 mgr.x (mgr.34562) 2754 : audit [DBG] from='client.26638 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:35:53.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:35:53 smithi132 bash[27079]: cephadm 2020-07-16T14:35:52.302387+0000 mgr.x (mgr.34562) 2755 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:35:53.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:35:53 smithi132 bash[27079]: cephadm 2020-07-16T14:35:52.302621+0000 mgr.x (mgr.34562) 2756 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:35:53.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:35:53 smithi132 bash[27079]: audit 2020-07-16T14:35:52.838908+0000 mon.c (mon.1) 226 : audit [DBG] from='client.? 172.21.15.132:0/3400758603' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:35:54.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:35:54 smithi188 bash[23329]: audit 2020-07-16T14:35:52.536304+0000 mgr.x (mgr.34562) 2757 : audit [DBG] from='client.26644 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:35:54.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:35:54 smithi132 bash[27079]: audit 2020-07-16T14:35:52.536304+0000 mgr.x (mgr.34562) 2757 : audit [DBG] from='client.26644 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:35:55.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:35:55 smithi188 bash[23329]: cluster 2020-07-16T14:35:54.260454+0000 mgr.x (mgr.34562) 2758 : cluster [DBG] pgmap v1717: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:35:55.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:35:55 smithi132 bash[27079]: cluster 2020-07-16T14:35:54.260454+0000 mgr.x (mgr.34562) 2758 : cluster [DBG] pgmap v1717: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:35:57.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:35:57 smithi188 bash[23329]: cluster 2020-07-16T14:35:56.260870+0000 mgr.x (mgr.34562) 2759 : cluster [DBG] pgmap v1718: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:35:57.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:35:57 smithi132 bash[27079]: cluster 2020-07-16T14:35:56.260870+0000 mgr.x (mgr.34562) 2759 : cluster [DBG] pgmap v1718: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:35:59.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:35:59 smithi188 bash[23329]: cluster 2020-07-16T14:35:58.261265+0000 mgr.x (mgr.34562) 2760 : cluster [DBG] pgmap v1719: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:35:59.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:35:59 smithi132 bash[27079]: cluster 2020-07-16T14:35:58.261265+0000 mgr.x (mgr.34562) 2760 : cluster [DBG] pgmap v1719: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:36:01.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:36:00 smithi132 bash[27079]: cluster 2020-07-16T14:36:00.261666+0000 mgr.x (mgr.34562) 2761 : cluster [DBG] pgmap v1720: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:36:01.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:36:00 smithi188 bash[23329]: cluster 2020-07-16T14:36:00.261666+0000 mgr.x (mgr.34562) 2761 : cluster [DBG] pgmap v1720: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:36:03.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:36:03 smithi188 bash[23329]: cluster 2020-07-16T14:36:02.262134+0000 mgr.x (mgr.34562) 2762 : cluster [DBG] pgmap v1721: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:36:03.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:36:03 smithi132 bash[27079]: cluster 2020-07-16T14:36:02.262134+0000 mgr.x (mgr.34562) 2762 : cluster [DBG] pgmap v1721: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:36:05.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:36:05 smithi188 bash[23329]: cluster 2020-07-16T14:36:04.262580+0000 mgr.x (mgr.34562) 2763 : cluster [DBG] pgmap v1722: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:36:05.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:36:05 smithi132 bash[27079]: cluster 2020-07-16T14:36:04.262580+0000 mgr.x (mgr.34562) 2763 : cluster [DBG] pgmap v1722: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:36:07.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:36:07 smithi188 bash[23329]: cluster 2020-07-16T14:36:06.263075+0000 mgr.x (mgr.34562) 2764 : cluster [DBG] pgmap v1723: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:36:07.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:36:07 smithi188 bash[23329]: audit 2020-07-16T14:36:07.310130+0000 mon.b (mon.2) 690 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:36:07.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:36:07 smithi132 bash[27079]: cluster 2020-07-16T14:36:06.263075+0000 mgr.x (mgr.34562) 2764 : cluster [DBG] pgmap v1723: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:36:07.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:36:07 smithi132 bash[27079]: audit 2020-07-16T14:36:07.310130+0000 mon.b (mon.2) 690 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:36:08.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:36:08 smithi188 bash[23329]: cephadm 2020-07-16T14:36:07.310884+0000 mgr.x (mgr.34562) 2765 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:36:08.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:36:08 smithi188 bash[23329]: cephadm 2020-07-16T14:36:07.311338+0000 mgr.x (mgr.34562) 2766 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:36:08.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:36:08 smithi132 bash[27079]: cephadm 2020-07-16T14:36:07.310884+0000 mgr.x (mgr.34562) 2765 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:36:08.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:36:08 smithi132 bash[27079]: cephadm 2020-07-16T14:36:07.311338+0000 mgr.x (mgr.34562) 2766 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:36:09.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:36:09 smithi188 bash[23329]: cluster 2020-07-16T14:36:08.263496+0000 mgr.x (mgr.34562) 2767 : cluster [DBG] pgmap v1724: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:36:09.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:36:09 smithi132 bash[27079]: cluster 2020-07-16T14:36:08.263496+0000 mgr.x (mgr.34562) 2767 : cluster [DBG] pgmap v1724: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:36:11.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:36:10 smithi132 bash[27079]: cluster 2020-07-16T14:36:10.263830+0000 mgr.x (mgr.34562) 2768 : cluster [DBG] pgmap v1725: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:36:11.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:36:10 smithi188 bash[23329]: cluster 2020-07-16T14:36:10.263830+0000 mgr.x (mgr.34562) 2768 : cluster [DBG] pgmap v1725: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:36:13.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:36:13 smithi188 bash[23329]: cluster 2020-07-16T14:36:12.264237+0000 mgr.x (mgr.34562) 2769 : cluster [DBG] pgmap v1726: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:36:13.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:36:13 smithi132 bash[27079]: cluster 2020-07-16T14:36:12.264237+0000 mgr.x (mgr.34562) 2769 : cluster [DBG] pgmap v1726: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:36:15.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:36:15 smithi188 bash[23329]: cluster 2020-07-16T14:36:14.264631+0000 mgr.x (mgr.34562) 2770 : cluster [DBG] pgmap v1727: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:36:15.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:36:15 smithi132 bash[27079]: cluster 2020-07-16T14:36:14.264631+0000 mgr.x (mgr.34562) 2770 : cluster [DBG] pgmap v1727: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:36:17.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:36:17 smithi188 bash[23329]: cluster 2020-07-16T14:36:16.265123+0000 mgr.x (mgr.34562) 2771 : cluster [DBG] pgmap v1728: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:36:17.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:36:17 smithi132 bash[27079]: cluster 2020-07-16T14:36:16.265123+0000 mgr.x (mgr.34562) 2771 : cluster [DBG] pgmap v1728: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:36:19.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:36:19 smithi188 bash[23329]: cluster 2020-07-16T14:36:18.265583+0000 mgr.x (mgr.34562) 2772 : cluster [DBG] pgmap v1729: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:36:19.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:36:19 smithi132 bash[27079]: cluster 2020-07-16T14:36:18.265583+0000 mgr.x (mgr.34562) 2772 : cluster [DBG] pgmap v1729: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:36:21.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:36:20 smithi132 bash[27079]: cluster 2020-07-16T14:36:20.266006+0000 mgr.x (mgr.34562) 2773 : cluster [DBG] pgmap v1730: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:36:21.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:36:20 smithi188 bash[23329]: cluster 2020-07-16T14:36:20.266006+0000 mgr.x (mgr.34562) 2773 : cluster [DBG] pgmap v1730: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:36:23.135 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:36:23.396 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:36:23.396 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (59m) 4m ago 62m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:36:23.397 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (61m) 4m ago 61m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:36:23.397 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (59m) 4m ago 64m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:36:23.397 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (58m) 4m ago 66m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:36:23.397 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 4m ago 66m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:36:23.397 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (65m) 4m ago 65m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:36:23.398 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (65m) 4m ago 65m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:36:23.398 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (62m) 4m ago 62m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:36:23.398 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (62m) 4m ago 62m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:36:23.398 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (64m) 4m ago 64m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:36:23.398 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (64m) 4m ago 64m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:36:23.399 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (64m) 4m ago 64m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:36:23.399 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (63m) 4m ago 63m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:36:23.399 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (63m) 4m ago 63m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:36:23.399 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (63m) 4m ago 63m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:36:23.399 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (63m) 4m ago 63m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:36:23.400 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (62m) 4m ago 62m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:36:23.400 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (61m) 4m ago 62m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:36:23.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:36:23 smithi188 bash[23329]: cluster 2020-07-16T14:36:22.266580+0000 mgr.x (mgr.34562) 2774 : cluster [DBG] pgmap v1731: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:36:23.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:36:23 smithi188 bash[23329]: audit 2020-07-16T14:36:22.326688+0000 mon.b (mon.2) 691 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:36:23.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:36:23 smithi188 bash[23329]: cephadm 2020-07-16T14:36:22.327406+0000 mgr.x (mgr.34562) 2775 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:36:23.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:36:23 smithi188 bash[23329]: cephadm 2020-07-16T14:36:22.327793+0000 mgr.x (mgr.34562) 2776 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:36:23.693 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:36:23.694 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:36:23.694 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:36:23.694 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:36:23.694 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:36:23.695 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:36:23.695 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:36:23.695 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:36:23.695 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:36:23.695 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:36:23.696 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:36:23.696 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:36:23.696 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:36:23.696 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:36:23.696 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:36:23.696 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:36:23.697 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:36:23.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:36:23 smithi132 bash[27079]: cluster 2020-07-16T14:36:22.266580+0000 mgr.x (mgr.34562) 2774 : cluster [DBG] pgmap v1731: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:36:23.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:36:23 smithi132 bash[27079]: audit 2020-07-16T14:36:22.326688+0000 mon.b (mon.2) 691 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:36:23.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:36:23 smithi132 bash[27079]: cephadm 2020-07-16T14:36:22.327406+0000 mgr.x (mgr.34562) 2775 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:36:23.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:36:23 smithi132 bash[27079]: cephadm 2020-07-16T14:36:22.327793+0000 mgr.x (mgr.34562) 2776 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:36:24.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:36:24 smithi188 bash[23329]: audit 2020-07-16T14:36:23.123377+0000 mgr.x (mgr.34562) 2777 : audit [DBG] from='client.26656 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:36:24.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:36:24 smithi188 bash[23329]: audit 2020-07-16T14:36:23.391973+0000 mgr.x (mgr.34562) 2778 : audit [DBG] from='client.26662 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:36:24.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:36:24 smithi188 bash[23329]: audit 2020-07-16T14:36:23.692714+0000 mon.c (mon.1) 227 : audit [DBG] from='client.? 172.21.15.132:0/4248350536' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:36:24.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:36:24 smithi132 bash[27079]: audit 2020-07-16T14:36:23.123377+0000 mgr.x (mgr.34562) 2777 : audit [DBG] from='client.26656 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:36:24.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:36:24 smithi132 bash[27079]: audit 2020-07-16T14:36:23.391973+0000 mgr.x (mgr.34562) 2778 : audit [DBG] from='client.26662 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:36:24.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:36:24 smithi132 bash[27079]: audit 2020-07-16T14:36:23.692714+0000 mon.c (mon.1) 227 : audit [DBG] from='client.? 172.21.15.132:0/4248350536' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:36:25.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:36:25 smithi188 bash[23329]: cluster 2020-07-16T14:36:24.266930+0000 mgr.x (mgr.34562) 2779 : cluster [DBG] pgmap v1732: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:36:25.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:36:25 smithi132 bash[27079]: cluster 2020-07-16T14:36:24.266930+0000 mgr.x (mgr.34562) 2779 : cluster [DBG] pgmap v1732: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:36:27.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:36:27 smithi188 bash[23329]: cluster 2020-07-16T14:36:26.267359+0000 mgr.x (mgr.34562) 2780 : cluster [DBG] pgmap v1733: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:36:27.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:36:27 smithi132 bash[27079]: cluster 2020-07-16T14:36:26.267359+0000 mgr.x (mgr.34562) 2780 : cluster [DBG] pgmap v1733: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:36:29.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:36:29 smithi188 bash[23329]: cluster 2020-07-16T14:36:28.267904+0000 mgr.x (mgr.34562) 2781 : cluster [DBG] pgmap v1734: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:36:29.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:36:29 smithi132 bash[27079]: cluster 2020-07-16T14:36:28.267904+0000 mgr.x (mgr.34562) 2781 : cluster [DBG] pgmap v1734: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:36:31.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:36:30 smithi132 bash[27079]: cluster 2020-07-16T14:36:30.268442+0000 mgr.x (mgr.34562) 2782 : cluster [DBG] pgmap v1735: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:36:31.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:36:30 smithi188 bash[23329]: cluster 2020-07-16T14:36:30.268442+0000 mgr.x (mgr.34562) 2782 : cluster [DBG] pgmap v1735: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:36:33.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:36:33 smithi188 bash[23329]: cluster 2020-07-16T14:36:32.268872+0000 mgr.x (mgr.34562) 2783 : cluster [DBG] pgmap v1736: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:36:33.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:36:33 smithi132 bash[27079]: cluster 2020-07-16T14:36:32.268872+0000 mgr.x (mgr.34562) 2783 : cluster [DBG] pgmap v1736: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:36:35.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:36:35 smithi188 bash[23329]: cluster 2020-07-16T14:36:34.269320+0000 mgr.x (mgr.34562) 2784 : cluster [DBG] pgmap v1737: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:36:35.789 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:36:35 smithi132 bash[27079]: cluster 2020-07-16T14:36:34.269320+0000 mgr.x (mgr.34562) 2784 : cluster [DBG] pgmap v1737: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:36:37.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:36:37 smithi188 bash[23329]: cluster 2020-07-16T14:36:36.269798+0000 mgr.x (mgr.34562) 2785 : cluster [DBG] pgmap v1738: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:36:37.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:36:37 smithi132 bash[27079]: cluster 2020-07-16T14:36:36.269798+0000 mgr.x (mgr.34562) 2785 : cluster [DBG] pgmap v1738: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:36:38.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:36:38 smithi188 bash[23329]: audit 2020-07-16T14:36:37.343215+0000 mon.b (mon.2) 692 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:36:38.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:36:38 smithi188 bash[23329]: cephadm 2020-07-16T14:36:37.343891+0000 mgr.x (mgr.34562) 2786 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:36:38.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:36:38 smithi188 bash[23329]: cephadm 2020-07-16T14:36:37.344331+0000 mgr.x (mgr.34562) 2787 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:36:38.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:36:38 smithi132 bash[27079]: audit 2020-07-16T14:36:37.343215+0000 mon.b (mon.2) 692 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:36:38.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:36:38 smithi132 bash[27079]: cephadm 2020-07-16T14:36:37.343891+0000 mgr.x (mgr.34562) 2786 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:36:38.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:36:38 smithi132 bash[27079]: cephadm 2020-07-16T14:36:37.344331+0000 mgr.x (mgr.34562) 2787 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:36:39.676 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:36:39 smithi188 bash[23329]: cluster 2020-07-16T14:36:38.270170+0000 mgr.x (mgr.34562) 2788 : cluster [DBG] pgmap v1739: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:36:39.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:36:39 smithi132 bash[27079]: cluster 2020-07-16T14:36:38.270170+0000 mgr.x (mgr.34562) 2788 : cluster [DBG] pgmap v1739: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:36:41.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:36:40 smithi132 bash[27079]: cluster 2020-07-16T14:36:40.270624+0000 mgr.x (mgr.34562) 2789 : cluster [DBG] pgmap v1740: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:36:41.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:36:40 smithi188 bash[23329]: cluster 2020-07-16T14:36:40.270624+0000 mgr.x (mgr.34562) 2789 : cluster [DBG] pgmap v1740: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:36:43.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:36:43 smithi188 bash[23329]: cluster 2020-07-16T14:36:42.271058+0000 mgr.x (mgr.34562) 2790 : cluster [DBG] pgmap v1741: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:36:43.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:36:43 smithi132 bash[27079]: cluster 2020-07-16T14:36:42.271058+0000 mgr.x (mgr.34562) 2790 : cluster [DBG] pgmap v1741: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:36:45.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:36:45 smithi188 bash[23329]: cluster 2020-07-16T14:36:44.271506+0000 mgr.x (mgr.34562) 2791 : cluster [DBG] pgmap v1742: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:36:45.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:36:45 smithi132 bash[27079]: cluster 2020-07-16T14:36:44.271506+0000 mgr.x (mgr.34562) 2791 : cluster [DBG] pgmap v1742: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:36:47.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:36:47 smithi188 bash[23329]: cluster 2020-07-16T14:36:46.271939+0000 mgr.x (mgr.34562) 2792 : cluster [DBG] pgmap v1743: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:36:47.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:36:47 smithi132 bash[27079]: cluster 2020-07-16T14:36:46.271939+0000 mgr.x (mgr.34562) 2792 : cluster [DBG] pgmap v1743: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:36:49.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:36:49 smithi188 bash[23329]: cluster 2020-07-16T14:36:48.272336+0000 mgr.x (mgr.34562) 2793 : cluster [DBG] pgmap v1744: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:36:49.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:36:49 smithi132 bash[27079]: cluster 2020-07-16T14:36:48.272336+0000 mgr.x (mgr.34562) 2793 : cluster [DBG] pgmap v1744: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:36:51.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:36:50 smithi132 bash[27079]: cluster 2020-07-16T14:36:50.272829+0000 mgr.x (mgr.34562) 2794 : cluster [DBG] pgmap v1745: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:36:51.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:36:50 smithi188 bash[23329]: cluster 2020-07-16T14:36:50.272829+0000 mgr.x (mgr.34562) 2794 : cluster [DBG] pgmap v1745: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:36:53.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:36:53 smithi132 bash[27079]: cluster 2020-07-16T14:36:52.273344+0000 mgr.x (mgr.34562) 2795 : cluster [DBG] pgmap v1746: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:36:53.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:36:53 smithi132 bash[27079]: audit 2020-07-16T14:36:52.356358+0000 mon.b (mon.2) 693 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:36:53.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:36:53 smithi132 bash[27079]: audit 2020-07-16T14:36:52.356703+0000 mgr.x (mgr.34562) 2796 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:36:53.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:36:53 smithi132 bash[27079]: audit 2020-07-16T14:36:52.357703+0000 mon.b (mon.2) 694 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:36:53.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:36:53 smithi132 bash[27079]: audit 2020-07-16T14:36:52.358027+0000 mgr.x (mgr.34562) 2797 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:36:53.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:36:53 smithi132 bash[27079]: audit 2020-07-16T14:36:52.358931+0000 mon.b (mon.2) 695 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:36:53.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:36:53 smithi132 bash[27079]: audit 2020-07-16T14:36:52.359210+0000 mgr.x (mgr.34562) 2798 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:36:53.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:36:53 smithi132 bash[27079]: cephadm 2020-07-16T14:36:52.359993+0000 mgr.x (mgr.34562) 2799 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:36:53.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:36:53 smithi132 bash[27079]: audit 2020-07-16T14:36:52.360271+0000 mon.b (mon.2) 696 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:36:53.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:36:53 smithi132 bash[27079]: cephadm 2020-07-16T14:36:52.361126+0000 mgr.x (mgr.34562) 2800 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:36:53.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:36:53 smithi132 bash[27079]: audit 2020-07-16T14:36:52.361435+0000 mon.b (mon.2) 697 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:36:53.532 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:36:53 smithi132 bash[27079]: cephadm 2020-07-16T14:36:52.362128+0000 mgr.x (mgr.34562) 2801 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:36:53.532 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:36:53 smithi132 bash[27079]: cephadm 2020-07-16T14:36:52.362200+0000 mgr.x (mgr.34562) 2802 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:36:53.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:36:53 smithi188 bash[23329]: cluster 2020-07-16T14:36:52.273344+0000 mgr.x (mgr.34562) 2795 : cluster [DBG] pgmap v1746: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:36:53.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:36:53 smithi188 bash[23329]: audit 2020-07-16T14:36:52.356358+0000 mon.b (mon.2) 693 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:36:53.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:36:53 smithi188 bash[23329]: audit 2020-07-16T14:36:52.356703+0000 mgr.x (mgr.34562) 2796 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:36:53.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:36:53 smithi188 bash[23329]: audit 2020-07-16T14:36:52.357703+0000 mon.b (mon.2) 694 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:36:53.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:36:53 smithi188 bash[23329]: audit 2020-07-16T14:36:52.358027+0000 mgr.x (mgr.34562) 2797 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:36:53.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:36:53 smithi188 bash[23329]: audit 2020-07-16T14:36:52.358931+0000 mon.b (mon.2) 695 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:36:53.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:36:53 smithi188 bash[23329]: audit 2020-07-16T14:36:52.359210+0000 mgr.x (mgr.34562) 2798 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:36:53.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:36:53 smithi188 bash[23329]: cephadm 2020-07-16T14:36:52.359993+0000 mgr.x (mgr.34562) 2799 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:36:53.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:36:53 smithi188 bash[23329]: audit 2020-07-16T14:36:52.360271+0000 mon.b (mon.2) 696 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:36:53.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:36:53 smithi188 bash[23329]: cephadm 2020-07-16T14:36:52.361126+0000 mgr.x (mgr.34562) 2800 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:36:53.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:36:53 smithi188 bash[23329]: audit 2020-07-16T14:36:52.361435+0000 mon.b (mon.2) 697 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:36:53.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:36:53 smithi188 bash[23329]: cephadm 2020-07-16T14:36:52.362128+0000 mgr.x (mgr.34562) 2801 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:36:53.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:36:53 smithi188 bash[23329]: cephadm 2020-07-16T14:36:52.362200+0000 mgr.x (mgr.34562) 2802 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:36:54.003 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:36:54.282 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:36:54.283 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (59m) 5m ago 62m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:36:54.283 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (62m) 5m ago 62m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:36:54.283 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (59m) 5m ago 65m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:36:54.284 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (59m) 5m ago 67m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:36:54.284 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 5m ago 67m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:36:54.284 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (65m) 5m ago 65m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:36:54.284 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (65m) 5m ago 65m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:36:54.284 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (62m) 5m ago 62m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:36:54.285 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (62m) 5m ago 62m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:36:54.285 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (65m) 5m ago 65m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:36:54.285 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (64m) 5m ago 65m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:36:54.285 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (64m) 5m ago 64m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:36:54.285 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (64m) 5m ago 64m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:36:54.286 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (63m) 5m ago 64m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:36:54.286 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (63m) 5m ago 63m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:36:54.286 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (63m) 5m ago 63m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:36:54.286 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (63m) 5m ago 63m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:36:54.286 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (62m) 5m ago 62m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:36:54.612 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:36:54.613 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:36:54.613 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:36:54.613 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:36:54.613 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:36:54.614 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:36:54.614 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:36:54.614 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:36:54.615 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:36:54.615 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:36:54.615 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:36:54.615 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:36:54.616 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:36:54.616 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:36:54.616 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:36:54.616 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:36:54.617 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:36:55.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:36:55 smithi132 bash[27079]: audit 2020-07-16T14:36:53.991413+0000 mgr.x (mgr.34562) 2803 : audit [DBG] from='client.26674 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:36:55.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:36:55 smithi132 bash[27079]: cluster 2020-07-16T14:36:54.273802+0000 mgr.x (mgr.34562) 2804 : cluster [DBG] pgmap v1747: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:36:55.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:36:55 smithi132 bash[27079]: audit 2020-07-16T14:36:54.278412+0000 mgr.x (mgr.34562) 2805 : audit [DBG] from='client.26680 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:36:55.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:36:55 smithi132 bash[27079]: audit 2020-07-16T14:36:54.611325+0000 mon.c (mon.1) 228 : audit [DBG] from='client.? 172.21.15.132:0/3663653899' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:36:55.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:36:55 smithi132 bash[27079]: audit 2020-07-16T14:36:55.189082+0000 mon.b (mon.2) 698 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:36:55.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:36:55 smithi188 bash[23329]: audit 2020-07-16T14:36:53.991413+0000 mgr.x (mgr.34562) 2803 : audit [DBG] from='client.26674 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:36:55.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:36:55 smithi188 bash[23329]: cluster 2020-07-16T14:36:54.273802+0000 mgr.x (mgr.34562) 2804 : cluster [DBG] pgmap v1747: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:36:55.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:36:55 smithi188 bash[23329]: audit 2020-07-16T14:36:54.278412+0000 mgr.x (mgr.34562) 2805 : audit [DBG] from='client.26680 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:36:55.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:36:55 smithi188 bash[23329]: audit 2020-07-16T14:36:54.611325+0000 mon.c (mon.1) 228 : audit [DBG] from='client.? 172.21.15.132:0/3663653899' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:36:55.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:36:55 smithi188 bash[23329]: audit 2020-07-16T14:36:55.189082+0000 mon.b (mon.2) 698 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:36:56.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:36:56 smithi188 bash[23329]: cephadm 2020-07-16T14:36:55.189756+0000 mgr.x (mgr.34562) 2806 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:36:56.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:36:56 smithi188 bash[23329]: cephadm 2020-07-16T14:36:55.190122+0000 mgr.x (mgr.34562) 2807 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:36:56.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:36:56 smithi132 bash[27079]: cephadm 2020-07-16T14:36:55.189756+0000 mgr.x (mgr.34562) 2806 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:36:56.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:36:56 smithi132 bash[27079]: cephadm 2020-07-16T14:36:55.190122+0000 mgr.x (mgr.34562) 2807 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:36:57.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:36:57 smithi188 bash[23329]: cluster 2020-07-16T14:36:56.274326+0000 mgr.x (mgr.34562) 2808 : cluster [DBG] pgmap v1748: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:36:57.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:36:57 smithi132 bash[27079]: cluster 2020-07-16T14:36:56.274326+0000 mgr.x (mgr.34562) 2808 : cluster [DBG] pgmap v1748: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:36:59.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:36:59 smithi188 bash[23329]: cluster 2020-07-16T14:36:58.274695+0000 mgr.x (mgr.34562) 2809 : cluster [DBG] pgmap v1749: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:36:59.782 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:36:59 smithi132 bash[27079]: cluster 2020-07-16T14:36:58.274695+0000 mgr.x (mgr.34562) 2809 : cluster [DBG] pgmap v1749: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:37:01.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:37:00 smithi132 bash[27079]: cluster 2020-07-16T14:37:00.275114+0000 mgr.x (mgr.34562) 2810 : cluster [DBG] pgmap v1750: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:37:01.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:37:00 smithi188 bash[23329]: cluster 2020-07-16T14:37:00.275114+0000 mgr.x (mgr.34562) 2810 : cluster [DBG] pgmap v1750: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:37:03.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:37:03 smithi188 bash[23329]: cluster 2020-07-16T14:37:02.275530+0000 mgr.x (mgr.34562) 2811 : cluster [DBG] pgmap v1751: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:37:03.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:37:03 smithi132 bash[27079]: cluster 2020-07-16T14:37:02.275530+0000 mgr.x (mgr.34562) 2811 : cluster [DBG] pgmap v1751: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:37:05.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:37:05 smithi188 bash[23329]: cluster 2020-07-16T14:37:04.275937+0000 mgr.x (mgr.34562) 2812 : cluster [DBG] pgmap v1752: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:37:05.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:37:05 smithi132 bash[27079]: cluster 2020-07-16T14:37:04.275937+0000 mgr.x (mgr.34562) 2812 : cluster [DBG] pgmap v1752: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:37:07.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:37:07 smithi188 bash[23329]: cluster 2020-07-16T14:37:06.276442+0000 mgr.x (mgr.34562) 2813 : cluster [DBG] pgmap v1753: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:37:07.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:37:07 smithi132 bash[27079]: cluster 2020-07-16T14:37:06.276442+0000 mgr.x (mgr.34562) 2813 : cluster [DBG] pgmap v1753: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:37:09.678 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:37:09 smithi188 bash[23329]: cluster 2020-07-16T14:37:08.276967+0000 mgr.x (mgr.34562) 2814 : cluster [DBG] pgmap v1754: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:37:09.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:37:09 smithi132 bash[27079]: cluster 2020-07-16T14:37:08.276967+0000 mgr.x (mgr.34562) 2814 : cluster [DBG] pgmap v1754: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:37:11.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:37:10 smithi132 bash[27079]: audit 2020-07-16T14:37:10.205616+0000 mon.b (mon.2) 699 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:37:11.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:37:10 smithi132 bash[27079]: cephadm 2020-07-16T14:37:10.206375+0000 mgr.x (mgr.34562) 2815 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:37:11.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:37:10 smithi132 bash[27079]: cephadm 2020-07-16T14:37:10.206600+0000 mgr.x (mgr.34562) 2816 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:37:11.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:37:10 smithi132 bash[27079]: cluster 2020-07-16T14:37:10.277448+0000 mgr.x (mgr.34562) 2817 : cluster [DBG] pgmap v1755: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:37:11.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:37:10 smithi188 bash[23329]: audit 2020-07-16T14:37:10.205616+0000 mon.b (mon.2) 699 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:37:11.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:37:10 smithi188 bash[23329]: cephadm 2020-07-16T14:37:10.206375+0000 mgr.x (mgr.34562) 2815 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:37:11.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:37:10 smithi188 bash[23329]: cephadm 2020-07-16T14:37:10.206600+0000 mgr.x (mgr.34562) 2816 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:37:11.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:37:10 smithi188 bash[23329]: cluster 2020-07-16T14:37:10.277448+0000 mgr.x (mgr.34562) 2817 : cluster [DBG] pgmap v1755: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:37:13.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:37:13 smithi188 bash[23329]: cluster 2020-07-16T14:37:12.277854+0000 mgr.x (mgr.34562) 2818 : cluster [DBG] pgmap v1756: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:37:13.782 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:37:13 smithi132 bash[27079]: cluster 2020-07-16T14:37:12.277854+0000 mgr.x (mgr.34562) 2818 : cluster [DBG] pgmap v1756: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:37:15.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:37:15 smithi188 bash[23329]: cluster 2020-07-16T14:37:14.278348+0000 mgr.x (mgr.34562) 2819 : cluster [DBG] pgmap v1757: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:37:15.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:37:15 smithi132 bash[27079]: cluster 2020-07-16T14:37:14.278348+0000 mgr.x (mgr.34562) 2819 : cluster [DBG] pgmap v1757: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:37:17.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:37:17 smithi188 bash[23329]: cluster 2020-07-16T14:37:16.278738+0000 mgr.x (mgr.34562) 2820 : cluster [DBG] pgmap v1758: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:37:17.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:37:17 smithi132 bash[27079]: cluster 2020-07-16T14:37:16.278738+0000 mgr.x (mgr.34562) 2820 : cluster [DBG] pgmap v1758: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:37:19.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:37:19 smithi188 bash[23329]: cluster 2020-07-16T14:37:18.279165+0000 mgr.x (mgr.34562) 2821 : cluster [DBG] pgmap v1759: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:37:19.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:37:19 smithi132 bash[27079]: cluster 2020-07-16T14:37:18.279165+0000 mgr.x (mgr.34562) 2821 : cluster [DBG] pgmap v1759: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:37:21.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:37:20 smithi132 bash[27079]: cluster 2020-07-16T14:37:20.279592+0000 mgr.x (mgr.34562) 2822 : cluster [DBG] pgmap v1760: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:37:21.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:37:20 smithi188 bash[23329]: cluster 2020-07-16T14:37:20.279592+0000 mgr.x (mgr.34562) 2822 : cluster [DBG] pgmap v1760: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:37:23.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:37:23 smithi188 bash[23329]: cluster 2020-07-16T14:37:22.279944+0000 mgr.x (mgr.34562) 2823 : cluster [DBG] pgmap v1761: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:37:23.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:37:23 smithi132 bash[27079]: cluster 2020-07-16T14:37:22.279944+0000 mgr.x (mgr.34562) 2823 : cluster [DBG] pgmap v1761: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:37:24.925 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:37:25.186 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:37:25.186 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (60m) 5m ago 63m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:37:25.186 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (62m) 5m ago 62m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:37:25.186 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (60m) 5m ago 66m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:37:25.187 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (59m) 5m ago 67m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:37:25.187 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 5m ago 67m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:37:25.187 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (66m) 5m ago 66m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:37:25.187 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (66m) 5m ago 66m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:37:25.187 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (63m) 5m ago 63m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:37:25.188 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (63m) 5m ago 63m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:37:25.188 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (65m) 5m ago 65m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:37:25.188 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (65m) 5m ago 65m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:37:25.188 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (65m) 5m ago 65m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:37:25.188 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (64m) 5m ago 64m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:37:25.189 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (64m) 5m ago 64m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:37:25.189 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (64m) 5m ago 64m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:37:25.189 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (64m) 5m ago 64m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:37:25.189 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (63m) 5m ago 63m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:37:25.189 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (62m) 5m ago 63m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:37:25.483 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:37:25.483 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:37:25.484 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:37:25.484 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:37:25.484 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:37:25.484 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:37:25.485 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:37:25.485 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:37:25.485 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:37:25.485 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:37:25.485 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:37:25.486 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:37:25.486 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:37:25.486 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:37:25.486 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:37:25.486 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:37:25.487 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:37:25.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:37:25 smithi188 bash[23329]: cluster 2020-07-16T14:37:24.280332+0000 mgr.x (mgr.34562) 2824 : cluster [DBG] pgmap v1762: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:37:25.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:37:25 smithi188 bash[23329]: audit 2020-07-16T14:37:25.209744+0000 mon.b (mon.2) 700 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:37:25.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:37:25 smithi132 bash[27079]: cluster 2020-07-16T14:37:24.280332+0000 mgr.x (mgr.34562) 2824 : cluster [DBG] pgmap v1762: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:37:25.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:37:25 smithi132 bash[27079]: audit 2020-07-16T14:37:25.209744+0000 mon.b (mon.2) 700 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:37:26.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:37:26 smithi188 bash[23329]: audit 2020-07-16T14:37:24.913165+0000 mgr.x (mgr.34562) 2825 : audit [DBG] from='client.26692 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:37:26.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:37:26 smithi188 bash[23329]: audit 2020-07-16T14:37:25.180161+0000 mgr.x (mgr.34562) 2826 : audit [DBG] from='client.26698 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:37:26.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:37:26 smithi188 bash[23329]: cephadm 2020-07-16T14:37:25.210424+0000 mgr.x (mgr.34562) 2827 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:37:26.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:37:26 smithi188 bash[23329]: cephadm 2020-07-16T14:37:25.210862+0000 mgr.x (mgr.34562) 2828 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:37:26.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:37:26 smithi188 bash[23329]: audit 2020-07-16T14:37:25.482391+0000 mon.c (mon.1) 229 : audit [DBG] from='client.? 172.21.15.132:0/3095141986' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:37:26.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:37:26 smithi132 bash[27079]: audit 2020-07-16T14:37:24.913165+0000 mgr.x (mgr.34562) 2825 : audit [DBG] from='client.26692 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:37:26.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:37:26 smithi132 bash[27079]: audit 2020-07-16T14:37:25.180161+0000 mgr.x (mgr.34562) 2826 : audit [DBG] from='client.26698 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:37:26.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:37:26 smithi132 bash[27079]: cephadm 2020-07-16T14:37:25.210424+0000 mgr.x (mgr.34562) 2827 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:37:26.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:37:26 smithi132 bash[27079]: cephadm 2020-07-16T14:37:25.210862+0000 mgr.x (mgr.34562) 2828 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:37:26.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:37:26 smithi132 bash[27079]: audit 2020-07-16T14:37:25.482391+0000 mon.c (mon.1) 229 : audit [DBG] from='client.? 172.21.15.132:0/3095141986' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:37:27.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:37:27 smithi188 bash[23329]: cluster 2020-07-16T14:37:26.280739+0000 mgr.x (mgr.34562) 2829 : cluster [DBG] pgmap v1763: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:37:27.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:37:27 smithi132 bash[27079]: cluster 2020-07-16T14:37:26.280739+0000 mgr.x (mgr.34562) 2829 : cluster [DBG] pgmap v1763: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:37:29.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:37:29 smithi188 bash[23329]: cluster 2020-07-16T14:37:28.281151+0000 mgr.x (mgr.34562) 2830 : cluster [DBG] pgmap v1764: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:37:29.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:37:29 smithi132 bash[27079]: cluster 2020-07-16T14:37:28.281151+0000 mgr.x (mgr.34562) 2830 : cluster [DBG] pgmap v1764: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:37:31.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:37:30 smithi132 bash[27079]: cluster 2020-07-16T14:37:30.281578+0000 mgr.x (mgr.34562) 2831 : cluster [DBG] pgmap v1765: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:37:31.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:37:30 smithi188 bash[23329]: cluster 2020-07-16T14:37:30.281578+0000 mgr.x (mgr.34562) 2831 : cluster [DBG] pgmap v1765: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:37:33.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:37:33 smithi188 bash[23329]: cluster 2020-07-16T14:37:32.281964+0000 mgr.x (mgr.34562) 2832 : cluster [DBG] pgmap v1766: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:37:33.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:37:33 smithi132 bash[27079]: cluster 2020-07-16T14:37:32.281964+0000 mgr.x (mgr.34562) 2832 : cluster [DBG] pgmap v1766: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:37:35.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:37:35 smithi188 bash[23329]: cluster 2020-07-16T14:37:34.282478+0000 mgr.x (mgr.34562) 2833 : cluster [DBG] pgmap v1767: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:37:35.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:37:35 smithi132 bash[27079]: cluster 2020-07-16T14:37:34.282478+0000 mgr.x (mgr.34562) 2833 : cluster [DBG] pgmap v1767: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:37:37.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:37:37 smithi188 bash[23329]: cluster 2020-07-16T14:37:36.282943+0000 mgr.x (mgr.34562) 2834 : cluster [DBG] pgmap v1768: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:37:37.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:37:37 smithi132 bash[27079]: cluster 2020-07-16T14:37:36.282943+0000 mgr.x (mgr.34562) 2834 : cluster [DBG] pgmap v1768: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:37:39.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:37:39 smithi188 bash[23329]: cluster 2020-07-16T14:37:38.283468+0000 mgr.x (mgr.34562) 2835 : cluster [DBG] pgmap v1769: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:37:39.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:37:39 smithi132 bash[27079]: cluster 2020-07-16T14:37:38.283468+0000 mgr.x (mgr.34562) 2835 : cluster [DBG] pgmap v1769: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:37:41.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:37:40 smithi132 bash[27079]: audit 2020-07-16T14:37:40.226517+0000 mon.b (mon.2) 701 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:37:41.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:37:40 smithi132 bash[27079]: cephadm 2020-07-16T14:37:40.227261+0000 mgr.x (mgr.34562) 2836 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:37:41.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:37:40 smithi132 bash[27079]: cephadm 2020-07-16T14:37:40.227620+0000 mgr.x (mgr.34562) 2837 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:37:41.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:37:40 smithi132 bash[27079]: cluster 2020-07-16T14:37:40.283824+0000 mgr.x (mgr.34562) 2838 : cluster [DBG] pgmap v1770: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:37:41.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:37:40 smithi188 bash[23329]: audit 2020-07-16T14:37:40.226517+0000 mon.b (mon.2) 701 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:37:41.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:37:40 smithi188 bash[23329]: cephadm 2020-07-16T14:37:40.227261+0000 mgr.x (mgr.34562) 2836 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:37:41.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:37:40 smithi188 bash[23329]: cephadm 2020-07-16T14:37:40.227620+0000 mgr.x (mgr.34562) 2837 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:37:41.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:37:40 smithi188 bash[23329]: cluster 2020-07-16T14:37:40.283824+0000 mgr.x (mgr.34562) 2838 : cluster [DBG] pgmap v1770: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:37:43.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:37:43 smithi188 bash[23329]: cluster 2020-07-16T14:37:42.284273+0000 mgr.x (mgr.34562) 2839 : cluster [DBG] pgmap v1771: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:37:43.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:37:43 smithi132 bash[27079]: cluster 2020-07-16T14:37:42.284273+0000 mgr.x (mgr.34562) 2839 : cluster [DBG] pgmap v1771: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:37:45.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:37:45 smithi188 bash[23329]: cluster 2020-07-16T14:37:44.284750+0000 mgr.x (mgr.34562) 2840 : cluster [DBG] pgmap v1772: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:37:45.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:37:45 smithi132 bash[27079]: cluster 2020-07-16T14:37:44.284750+0000 mgr.x (mgr.34562) 2840 : cluster [DBG] pgmap v1772: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:37:47.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:37:47 smithi188 bash[23329]: cluster 2020-07-16T14:37:46.285060+0000 mgr.x (mgr.34562) 2841 : cluster [DBG] pgmap v1773: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:37:47.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:37:47 smithi132 bash[27079]: cluster 2020-07-16T14:37:46.285060+0000 mgr.x (mgr.34562) 2841 : cluster [DBG] pgmap v1773: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:37:49.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:37:49 smithi188 bash[23329]: cluster 2020-07-16T14:37:48.285667+0000 mgr.x (mgr.34562) 2842 : cluster [DBG] pgmap v1774: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:37:49.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:37:49 smithi132 bash[27079]: cluster 2020-07-16T14:37:48.285667+0000 mgr.x (mgr.34562) 2842 : cluster [DBG] pgmap v1774: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:37:51.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:37:50 smithi132 bash[27079]: cluster 2020-07-16T14:37:50.286048+0000 mgr.x (mgr.34562) 2843 : cluster [DBG] pgmap v1775: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:37:51.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:37:50 smithi188 bash[23329]: cluster 2020-07-16T14:37:50.286048+0000 mgr.x (mgr.34562) 2843 : cluster [DBG] pgmap v1775: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:37:53.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:37:53 smithi188 bash[23329]: cluster 2020-07-16T14:37:52.286607+0000 mgr.x (mgr.34562) 2844 : cluster [DBG] pgmap v1776: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:37:53.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:37:53 smithi132 bash[27079]: cluster 2020-07-16T14:37:52.286607+0000 mgr.x (mgr.34562) 2844 : cluster [DBG] pgmap v1776: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:37:55.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:37:55 smithi188 bash[23329]: cluster 2020-07-16T14:37:54.286991+0000 mgr.x (mgr.34562) 2845 : cluster [DBG] pgmap v1777: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:37:55.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:37:55 smithi188 bash[23329]: audit 2020-07-16T14:37:55.244337+0000 mon.b (mon.2) 702 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:37:55.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:37:55 smithi188 bash[23329]: audit 2020-07-16T14:37:55.245650+0000 mon.b (mon.2) 703 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:37:55.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:37:55 smithi188 bash[23329]: audit 2020-07-16T14:37:55.246882+0000 mon.b (mon.2) 704 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:37:55.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:37:55 smithi188 bash[23329]: audit 2020-07-16T14:37:55.248336+0000 mon.b (mon.2) 705 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:37:55.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:37:55 smithi188 bash[23329]: audit 2020-07-16T14:37:55.249557+0000 mon.b (mon.2) 706 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:37:55.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:37:55 smithi132 bash[27079]: cluster 2020-07-16T14:37:54.286991+0000 mgr.x (mgr.34562) 2845 : cluster [DBG] pgmap v1777: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:37:55.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:37:55 smithi132 bash[27079]: audit 2020-07-16T14:37:55.244337+0000 mon.b (mon.2) 702 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:37:55.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:37:55 smithi132 bash[27079]: audit 2020-07-16T14:37:55.245650+0000 mon.b (mon.2) 703 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:37:55.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:37:55 smithi132 bash[27079]: audit 2020-07-16T14:37:55.246882+0000 mon.b (mon.2) 704 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:37:55.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:37:55 smithi132 bash[27079]: audit 2020-07-16T14:37:55.248336+0000 mon.b (mon.2) 705 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:37:55.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:37:55 smithi132 bash[27079]: audit 2020-07-16T14:37:55.249557+0000 mon.b (mon.2) 706 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:37:55.780 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:37:56.087 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:37:56.088 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (60m) 6m ago 63m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:37:56.088 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (63m) 6m ago 63m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:37:56.088 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (61m) 6m ago 66m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:37:56.089 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (60m) 6m ago 68m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:37:56.089 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 6m ago 68m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:37:56.089 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (66m) 6m ago 66m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:37:56.089 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (66m) 6m ago 66m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:37:56.089 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (63m) 6m ago 63m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:37:56.090 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (63m) 6m ago 63m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:37:56.090 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (66m) 6m ago 66m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:37:56.090 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (66m) 6m ago 66m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:37:56.090 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (65m) 6m ago 65m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:37:56.090 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (65m) 6m ago 65m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:37:56.091 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (64m) 6m ago 65m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:37:56.091 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (64m) 6m ago 64m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:37:56.091 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (64m) 6m ago 64m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:37:56.091 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (64m) 6m ago 64m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:37:56.091 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (63m) 6m ago 63m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:37:56.411 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:37:56.412 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:37:56.412 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:37:56.412 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:37:56.412 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:37:56.412 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:37:56.413 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:37:56.413 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:37:56.413 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:37:56.414 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:37:56.414 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:37:56.414 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:37:56.414 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:37:56.414 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:37:56.414 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:37:56.415 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:37:56.415 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:37:56.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:37:56 smithi132 bash[27079]: audit 2020-07-16T14:37:55.244708+0000 mgr.x (mgr.34562) 2846 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:37:56.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:37:56 smithi132 bash[27079]: audit 2020-07-16T14:37:55.245961+0000 mgr.x (mgr.34562) 2847 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:37:56.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:37:56 smithi132 bash[27079]: audit 2020-07-16T14:37:55.247168+0000 mgr.x (mgr.34562) 2848 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:37:56.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:37:56 smithi132 bash[27079]: cephadm 2020-07-16T14:37:55.247897+0000 mgr.x (mgr.34562) 2849 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:37:56.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:37:56 smithi132 bash[27079]: cephadm 2020-07-16T14:37:55.249163+0000 mgr.x (mgr.34562) 2850 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:37:56.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:37:56 smithi132 bash[27079]: cephadm 2020-07-16T14:37:55.250271+0000 mgr.x (mgr.34562) 2851 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:37:56.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:37:56 smithi132 bash[27079]: cephadm 2020-07-16T14:37:55.250480+0000 mgr.x (mgr.34562) 2852 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:37:56.676 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:37:56 smithi188 bash[23329]: audit 2020-07-16T14:37:55.244708+0000 mgr.x (mgr.34562) 2846 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:37:56.676 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:37:56 smithi188 bash[23329]: audit 2020-07-16T14:37:55.245961+0000 mgr.x (mgr.34562) 2847 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:37:56.678 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:37:56 smithi188 bash[23329]: audit 2020-07-16T14:37:55.247168+0000 mgr.x (mgr.34562) 2848 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:37:56.679 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:37:56 smithi188 bash[23329]: cephadm 2020-07-16T14:37:55.247897+0000 mgr.x (mgr.34562) 2849 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:37:56.679 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:37:56 smithi188 bash[23329]: cephadm 2020-07-16T14:37:55.249163+0000 mgr.x (mgr.34562) 2850 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:37:56.679 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:37:56 smithi188 bash[23329]: cephadm 2020-07-16T14:37:55.250271+0000 mgr.x (mgr.34562) 2851 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:37:56.679 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:37:56 smithi188 bash[23329]: cephadm 2020-07-16T14:37:55.250480+0000 mgr.x (mgr.34562) 2852 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:37:57.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:37:57 smithi132 bash[27079]: audit 2020-07-16T14:37:55.767617+0000 mgr.x (mgr.34562) 2853 : audit [DBG] from='client.26710 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:37:57.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:37:57 smithi132 bash[27079]: audit 2020-07-16T14:37:56.082399+0000 mgr.x (mgr.34562) 2854 : audit [DBG] from='client.35834 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:37:57.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:37:57 smithi132 bash[27079]: cluster 2020-07-16T14:37:56.287329+0000 mgr.x (mgr.34562) 2855 : cluster [DBG] pgmap v1778: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:37:57.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:37:57 smithi132 bash[27079]: audit 2020-07-16T14:37:56.410247+0000 mon.c (mon.1) 230 : audit [DBG] from='client.? 172.21.15.132:0/2763346388' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:37:57.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:37:57 smithi188 bash[23329]: audit 2020-07-16T14:37:55.767617+0000 mgr.x (mgr.34562) 2853 : audit [DBG] from='client.26710 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:37:57.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:37:57 smithi188 bash[23329]: audit 2020-07-16T14:37:56.082399+0000 mgr.x (mgr.34562) 2854 : audit [DBG] from='client.35834 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:37:57.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:37:57 smithi188 bash[23329]: cluster 2020-07-16T14:37:56.287329+0000 mgr.x (mgr.34562) 2855 : cluster [DBG] pgmap v1778: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:37:57.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:37:57 smithi188 bash[23329]: audit 2020-07-16T14:37:56.410247+0000 mon.c (mon.1) 230 : audit [DBG] from='client.? 172.21.15.132:0/2763346388' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:37:58.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:37:58 smithi188 bash[23329]: audit 2020-07-16T14:37:58.083817+0000 mon.b (mon.2) 707 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:37:58.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:37:58 smithi132 bash[27079]: audit 2020-07-16T14:37:58.083817+0000 mon.b (mon.2) 707 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:37:59.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:37:59 smithi188 bash[23329]: cephadm 2020-07-16T14:37:58.084464+0000 mgr.x (mgr.34562) 2856 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:37:59.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:37:59 smithi188 bash[23329]: cephadm 2020-07-16T14:37:58.084880+0000 mgr.x (mgr.34562) 2857 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:37:59.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:37:59 smithi188 bash[23329]: cluster 2020-07-16T14:37:58.287760+0000 mgr.x (mgr.34562) 2858 : cluster [DBG] pgmap v1779: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:37:59.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:37:59 smithi132 bash[27079]: cephadm 2020-07-16T14:37:58.084464+0000 mgr.x (mgr.34562) 2856 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:37:59.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:37:59 smithi132 bash[27079]: cephadm 2020-07-16T14:37:58.084880+0000 mgr.x (mgr.34562) 2857 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:37:59.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:37:59 smithi132 bash[27079]: cluster 2020-07-16T14:37:58.287760+0000 mgr.x (mgr.34562) 2858 : cluster [DBG] pgmap v1779: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:38:01.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:38:00 smithi132 bash[27079]: cluster 2020-07-16T14:38:00.288257+0000 mgr.x (mgr.34562) 2859 : cluster [DBG] pgmap v1780: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:38:01.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:38:00 smithi188 bash[23329]: cluster 2020-07-16T14:38:00.288257+0000 mgr.x (mgr.34562) 2859 : cluster [DBG] pgmap v1780: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:38:03.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:38:03 smithi188 bash[23329]: cluster 2020-07-16T14:38:02.288670+0000 mgr.x (mgr.34562) 2860 : cluster [DBG] pgmap v1781: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:38:03.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:38:03 smithi132 bash[27079]: cluster 2020-07-16T14:38:02.288670+0000 mgr.x (mgr.34562) 2860 : cluster [DBG] pgmap v1781: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:38:05.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:38:05 smithi188 bash[23329]: cluster 2020-07-16T14:38:04.289038+0000 mgr.x (mgr.34562) 2861 : cluster [DBG] pgmap v1782: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:38:05.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:38:05 smithi132 bash[27079]: cluster 2020-07-16T14:38:04.289038+0000 mgr.x (mgr.34562) 2861 : cluster [DBG] pgmap v1782: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:38:07.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:38:07 smithi188 bash[23329]: cluster 2020-07-16T14:38:06.289428+0000 mgr.x (mgr.34562) 2862 : cluster [DBG] pgmap v1783: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:38:07.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:38:07 smithi132 bash[27079]: cluster 2020-07-16T14:38:06.289428+0000 mgr.x (mgr.34562) 2862 : cluster [DBG] pgmap v1783: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:38:09.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:38:09 smithi188 bash[23329]: cluster 2020-07-16T14:38:08.289945+0000 mgr.x (mgr.34562) 2863 : cluster [DBG] pgmap v1784: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:38:09.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:38:09 smithi132 bash[27079]: cluster 2020-07-16T14:38:08.289945+0000 mgr.x (mgr.34562) 2863 : cluster [DBG] pgmap v1784: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:38:11.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:38:10 smithi132 bash[27079]: cluster 2020-07-16T14:38:10.290379+0000 mgr.x (mgr.34562) 2864 : cluster [DBG] pgmap v1785: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:38:11.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:38:10 smithi188 bash[23329]: cluster 2020-07-16T14:38:10.290379+0000 mgr.x (mgr.34562) 2864 : cluster [DBG] pgmap v1785: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:38:13.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:38:13 smithi188 bash[23329]: cluster 2020-07-16T14:38:12.290744+0000 mgr.x (mgr.34562) 2865 : cluster [DBG] pgmap v1786: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:38:13.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:38:13 smithi188 bash[23329]: audit 2020-07-16T14:38:13.100432+0000 mon.b (mon.2) 708 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:38:13.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:38:13 smithi132 bash[27079]: cluster 2020-07-16T14:38:12.290744+0000 mgr.x (mgr.34562) 2865 : cluster [DBG] pgmap v1786: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:38:13.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:38:13 smithi132 bash[27079]: audit 2020-07-16T14:38:13.100432+0000 mon.b (mon.2) 708 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:38:14.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:38:14 smithi188 bash[23329]: cephadm 2020-07-16T14:38:13.101139+0000 mgr.x (mgr.34562) 2866 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:38:14.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:38:14 smithi188 bash[23329]: cephadm 2020-07-16T14:38:13.101217+0000 mgr.x (mgr.34562) 2867 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:38:14.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:38:14 smithi132 bash[27079]: cephadm 2020-07-16T14:38:13.101139+0000 mgr.x (mgr.34562) 2866 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:38:14.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:38:14 smithi132 bash[27079]: cephadm 2020-07-16T14:38:13.101217+0000 mgr.x (mgr.34562) 2867 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:38:15.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:38:15 smithi188 bash[23329]: cluster 2020-07-16T14:38:14.291256+0000 mgr.x (mgr.34562) 2868 : cluster [DBG] pgmap v1787: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:38:15.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:38:15 smithi132 bash[27079]: cluster 2020-07-16T14:38:14.291256+0000 mgr.x (mgr.34562) 2868 : cluster [DBG] pgmap v1787: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:38:17.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:38:17 smithi188 bash[23329]: cluster 2020-07-16T14:38:16.291730+0000 mgr.x (mgr.34562) 2869 : cluster [DBG] pgmap v1788: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:38:17.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:38:17 smithi132 bash[27079]: cluster 2020-07-16T14:38:16.291730+0000 mgr.x (mgr.34562) 2869 : cluster [DBG] pgmap v1788: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:38:19.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:38:19 smithi188 bash[23329]: cluster 2020-07-16T14:38:18.292147+0000 mgr.x (mgr.34562) 2870 : cluster [DBG] pgmap v1789: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:38:19.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:38:19 smithi132 bash[27079]: cluster 2020-07-16T14:38:18.292147+0000 mgr.x (mgr.34562) 2870 : cluster [DBG] pgmap v1789: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:38:21.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:38:20 smithi132 bash[27079]: cluster 2020-07-16T14:38:20.292641+0000 mgr.x (mgr.34562) 2871 : cluster [DBG] pgmap v1790: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:38:21.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:38:20 smithi188 bash[23329]: cluster 2020-07-16T14:38:20.292641+0000 mgr.x (mgr.34562) 2871 : cluster [DBG] pgmap v1790: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:38:23.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:38:23 smithi188 bash[23329]: cluster 2020-07-16T14:38:22.293038+0000 mgr.x (mgr.34562) 2872 : cluster [DBG] pgmap v1791: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:38:23.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:38:23 smithi132 bash[27079]: cluster 2020-07-16T14:38:22.293038+0000 mgr.x (mgr.34562) 2872 : cluster [DBG] pgmap v1791: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:38:25.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:38:25 smithi188 bash[23329]: cluster 2020-07-16T14:38:24.293557+0000 mgr.x (mgr.34562) 2873 : cluster [DBG] pgmap v1792: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:38:25.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:38:25 smithi132 bash[27079]: cluster 2020-07-16T14:38:24.293557+0000 mgr.x (mgr.34562) 2873 : cluster [DBG] pgmap v1792: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:38:26.710 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:38:26.970 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:38:26.971 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (61m) 6m ago 64m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:38:26.971 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (63m) 6m ago 63m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:38:26.971 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (61m) 6m ago 67m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:38:26.971 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (60m) 6m ago 68m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:38:26.972 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 6m ago 68m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:38:26.972 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (67m) 6m ago 67m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:38:26.972 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (67m) 6m ago 67m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:38:26.972 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (64m) 6m ago 64m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:38:26.972 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (64m) 6m ago 64m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:38:26.973 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (66m) 6m ago 66m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:38:26.973 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (66m) 6m ago 66m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:38:26.973 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (66m) 6m ago 66m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:38:26.973 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (65m) 6m ago 65m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:38:26.973 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (65m) 6m ago 65m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:38:26.974 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (65m) 6m ago 65m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:38:26.974 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (65m) 6m ago 65m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:38:26.974 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (64m) 6m ago 64m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:38:26.974 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (63m) 6m ago 64m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:38:27.265 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:38:27.265 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:38:27.266 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:38:27.266 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:38:27.266 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:38:27.266 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:38:27.267 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:38:27.267 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:38:27.267 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:38:27.267 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:38:27.267 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:38:27.267 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:38:27.268 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:38:27.268 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:38:27.268 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:38:27.268 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:38:27.268 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:38:27.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:38:27 smithi188 bash[23329]: cluster 2020-07-16T14:38:26.293956+0000 mgr.x (mgr.34562) 2874 : cluster [DBG] pgmap v1793: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:38:27.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:38:27 smithi188 bash[23329]: audit 2020-07-16T14:38:27.264498+0000 mon.c (mon.1) 231 : audit [DBG] from='client.? 172.21.15.132:0/1026952762' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:38:27.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:38:27 smithi132 bash[27079]: cluster 2020-07-16T14:38:26.293956+0000 mgr.x (mgr.34562) 2874 : cluster [DBG] pgmap v1793: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:38:27.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:38:27 smithi132 bash[27079]: audit 2020-07-16T14:38:27.264498+0000 mon.c (mon.1) 231 : audit [DBG] from='client.? 172.21.15.132:0/1026952762' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:38:28.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:38:28 smithi188 bash[23329]: audit 2020-07-16T14:38:26.699216+0000 mgr.x (mgr.34562) 2875 : audit [DBG] from='client.26728 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:38:28.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:38:28 smithi188 bash[23329]: audit 2020-07-16T14:38:26.966411+0000 mgr.x (mgr.34562) 2876 : audit [DBG] from='client.26734 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:38:28.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:38:28 smithi188 bash[23329]: audit 2020-07-16T14:38:28.117070+0000 mon.b (mon.2) 709 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:38:28.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:38:28 smithi132 bash[27079]: audit 2020-07-16T14:38:26.699216+0000 mgr.x (mgr.34562) 2875 : audit [DBG] from='client.26728 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:38:28.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:38:28 smithi132 bash[27079]: audit 2020-07-16T14:38:26.966411+0000 mgr.x (mgr.34562) 2876 : audit [DBG] from='client.26734 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:38:28.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:38:28 smithi132 bash[27079]: audit 2020-07-16T14:38:28.117070+0000 mon.b (mon.2) 709 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:38:29.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:38:29 smithi188 bash[23329]: cephadm 2020-07-16T14:38:28.117853+0000 mgr.x (mgr.34562) 2877 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:38:29.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:38:29 smithi188 bash[23329]: cephadm 2020-07-16T14:38:28.118255+0000 mgr.x (mgr.34562) 2878 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:38:29.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:38:29 smithi188 bash[23329]: cluster 2020-07-16T14:38:28.294356+0000 mgr.x (mgr.34562) 2879 : cluster [DBG] pgmap v1794: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:38:29.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:38:29 smithi132 bash[27079]: cephadm 2020-07-16T14:38:28.117853+0000 mgr.x (mgr.34562) 2877 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:38:29.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:38:29 smithi132 bash[27079]: cephadm 2020-07-16T14:38:28.118255+0000 mgr.x (mgr.34562) 2878 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:38:29.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:38:29 smithi132 bash[27079]: cluster 2020-07-16T14:38:28.294356+0000 mgr.x (mgr.34562) 2879 : cluster [DBG] pgmap v1794: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:38:31.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:38:30 smithi132 bash[27079]: cluster 2020-07-16T14:38:30.294860+0000 mgr.x (mgr.34562) 2880 : cluster [DBG] pgmap v1795: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:38:31.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:38:30 smithi188 bash[23329]: cluster 2020-07-16T14:38:30.294860+0000 mgr.x (mgr.34562) 2880 : cluster [DBG] pgmap v1795: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:38:33.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:38:33 smithi188 bash[23329]: cluster 2020-07-16T14:38:32.295414+0000 mgr.x (mgr.34562) 2881 : cluster [DBG] pgmap v1796: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:38:33.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:38:33 smithi132 bash[27079]: cluster 2020-07-16T14:38:32.295414+0000 mgr.x (mgr.34562) 2881 : cluster [DBG] pgmap v1796: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:38:35.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:38:35 smithi188 bash[23329]: cluster 2020-07-16T14:38:34.295915+0000 mgr.x (mgr.34562) 2882 : cluster [DBG] pgmap v1797: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:38:35.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:38:35 smithi132 bash[27079]: cluster 2020-07-16T14:38:34.295915+0000 mgr.x (mgr.34562) 2882 : cluster [DBG] pgmap v1797: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:38:37.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:38:37 smithi188 bash[23329]: cluster 2020-07-16T14:38:36.296393+0000 mgr.x (mgr.34562) 2883 : cluster [DBG] pgmap v1798: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:38:37.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:38:37 smithi132 bash[27079]: cluster 2020-07-16T14:38:36.296393+0000 mgr.x (mgr.34562) 2883 : cluster [DBG] pgmap v1798: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:38:39.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:38:39 smithi188 bash[23329]: cluster 2020-07-16T14:38:38.296851+0000 mgr.x (mgr.34562) 2884 : cluster [DBG] pgmap v1799: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:38:39.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:38:39 smithi132 bash[27079]: cluster 2020-07-16T14:38:38.296851+0000 mgr.x (mgr.34562) 2884 : cluster [DBG] pgmap v1799: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:38:41.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:38:40 smithi132 bash[27079]: cluster 2020-07-16T14:38:40.297368+0000 mgr.x (mgr.34562) 2885 : cluster [DBG] pgmap v1800: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:38:41.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:38:40 smithi188 bash[23329]: cluster 2020-07-16T14:38:40.297368+0000 mgr.x (mgr.34562) 2885 : cluster [DBG] pgmap v1800: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:38:43.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:38:43 smithi188 bash[23329]: cluster 2020-07-16T14:38:42.297791+0000 mgr.x (mgr.34562) 2886 : cluster [DBG] pgmap v1801: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:38:43.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:38:43 smithi188 bash[23329]: audit 2020-07-16T14:38:43.129533+0000 mon.b (mon.2) 710 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:38:43.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:38:43 smithi132 bash[27079]: cluster 2020-07-16T14:38:42.297791+0000 mgr.x (mgr.34562) 2886 : cluster [DBG] pgmap v1801: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:38:43.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:38:43 smithi132 bash[27079]: audit 2020-07-16T14:38:43.129533+0000 mon.b (mon.2) 710 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:38:44.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:38:44 smithi188 bash[23329]: cephadm 2020-07-16T14:38:43.130203+0000 mgr.x (mgr.34562) 2887 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:38:44.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:38:44 smithi188 bash[23329]: cephadm 2020-07-16T14:38:43.130643+0000 mgr.x (mgr.34562) 2888 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:38:44.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:38:44 smithi132 bash[27079]: cephadm 2020-07-16T14:38:43.130203+0000 mgr.x (mgr.34562) 2887 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:38:44.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:38:44 smithi132 bash[27079]: cephadm 2020-07-16T14:38:43.130643+0000 mgr.x (mgr.34562) 2888 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:38:45.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:38:45 smithi188 bash[23329]: cluster 2020-07-16T14:38:44.298210+0000 mgr.x (mgr.34562) 2889 : cluster [DBG] pgmap v1802: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:38:45.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:38:45 smithi132 bash[27079]: cluster 2020-07-16T14:38:44.298210+0000 mgr.x (mgr.34562) 2889 : cluster [DBG] pgmap v1802: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:38:47.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:38:47 smithi188 bash[23329]: cluster 2020-07-16T14:38:46.298550+0000 mgr.x (mgr.34562) 2890 : cluster [DBG] pgmap v1803: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:38:47.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:38:47 smithi132 bash[27079]: cluster 2020-07-16T14:38:46.298550+0000 mgr.x (mgr.34562) 2890 : cluster [DBG] pgmap v1803: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:38:49.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:38:49 smithi188 bash[23329]: cluster 2020-07-16T14:38:48.299036+0000 mgr.x (mgr.34562) 2891 : cluster [DBG] pgmap v1804: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:38:49.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:38:49 smithi132 bash[27079]: cluster 2020-07-16T14:38:48.299036+0000 mgr.x (mgr.34562) 2891 : cluster [DBG] pgmap v1804: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:38:51.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:38:50 smithi132 bash[27079]: cluster 2020-07-16T14:38:50.299556+0000 mgr.x (mgr.34562) 2892 : cluster [DBG] pgmap v1805: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:38:51.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:38:50 smithi188 bash[23329]: cluster 2020-07-16T14:38:50.299556+0000 mgr.x (mgr.34562) 2892 : cluster [DBG] pgmap v1805: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:38:53.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:38:53 smithi188 bash[23329]: cluster 2020-07-16T14:38:52.300076+0000 mgr.x (mgr.34562) 2893 : cluster [DBG] pgmap v1806: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:38:53.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:38:53 smithi132 bash[27079]: cluster 2020-07-16T14:38:52.300076+0000 mgr.x (mgr.34562) 2893 : cluster [DBG] pgmap v1806: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:38:55.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:38:55 smithi188 bash[23329]: cluster 2020-07-16T14:38:54.300617+0000 mgr.x (mgr.34562) 2894 : cluster [DBG] pgmap v1807: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:38:55.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:38:55 smithi132 bash[27079]: cluster 2020-07-16T14:38:54.300617+0000 mgr.x (mgr.34562) 2894 : cluster [DBG] pgmap v1807: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:38:57.566 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:38:57.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:38:57 smithi188 bash[23329]: cluster 2020-07-16T14:38:56.300992+0000 mgr.x (mgr.34562) 2895 : cluster [DBG] pgmap v1808: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:38:57.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:38:57 smithi132 bash[27079]: cluster 2020-07-16T14:38:56.300992+0000 mgr.x (mgr.34562) 2895 : cluster [DBG] pgmap v1808: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:38:57.827 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:38:57.827 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (61m) 7m ago 64m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:38:57.828 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (64m) 7m ago 64m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:38:57.828 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (62m) 7m ago 67m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:38:57.828 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (61m) 7m ago 69m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:38:57.828 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 7m ago 69m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:38:57.828 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (67m) 7m ago 67m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:38:57.829 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (67m) 7m ago 67m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:38:57.829 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (64m) 7m ago 64m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:38:57.829 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (64m) 7m ago 65m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:38:57.829 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (67m) 7m ago 67m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:38:57.829 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (67m) 7m ago 67m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:38:57.830 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (66m) 7m ago 66m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:38:57.830 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (66m) 7m ago 66m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:38:57.830 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (65m) 7m ago 66m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:38:57.830 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (65m) 7m ago 65m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:38:57.830 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (65m) 7m ago 65m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:38:57.831 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (65m) 7m ago 65m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:38:57.831 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (64m) 7m ago 65m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:38:58.122 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:38:58.122 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:38:58.123 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:38:58.123 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:38:58.123 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:38:58.123 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:38:58.124 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:38:58.124 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:38:58.124 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:38:58.124 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:38:58.124 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:38:58.124 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:38:58.125 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:38:58.125 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:38:58.125 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:38:58.125 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:38:58.125 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:38:58.645 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:38:58 smithi132 bash[27079]: audit 2020-07-16T14:38:58.121497+0000 mon.c (mon.1) 232 : audit [DBG] from='client.? 172.21.15.132:0/923489303' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:38:58.645 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:38:58 smithi132 bash[27079]: audit 2020-07-16T14:38:58.148443+0000 mon.b (mon.2) 711 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:38:58.645 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:38:58 smithi132 bash[27079]: audit 2020-07-16T14:38:58.149784+0000 mon.b (mon.2) 712 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:38:58.646 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:38:58 smithi132 bash[27079]: audit 2020-07-16T14:38:58.150989+0000 mon.b (mon.2) 713 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:38:58.646 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:38:58 smithi132 bash[27079]: audit 2020-07-16T14:38:58.152412+0000 mon.b (mon.2) 714 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:38:58.646 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:38:58 smithi132 bash[27079]: audit 2020-07-16T14:38:58.153722+0000 mon.b (mon.2) 715 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:38:58.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:38:58 smithi188 bash[23329]: audit 2020-07-16T14:38:58.121497+0000 mon.c (mon.1) 232 : audit [DBG] from='client.? 172.21.15.132:0/923489303' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:38:58.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:38:58 smithi188 bash[23329]: audit 2020-07-16T14:38:58.148443+0000 mon.b (mon.2) 711 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:38:58.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:38:58 smithi188 bash[23329]: audit 2020-07-16T14:38:58.149784+0000 mon.b (mon.2) 712 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:38:58.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:38:58 smithi188 bash[23329]: audit 2020-07-16T14:38:58.150989+0000 mon.b (mon.2) 713 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:38:58.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:38:58 smithi188 bash[23329]: audit 2020-07-16T14:38:58.152412+0000 mon.b (mon.2) 714 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:38:58.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:38:58 smithi188 bash[23329]: audit 2020-07-16T14:38:58.153722+0000 mon.b (mon.2) 715 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:38:59.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:38:59 smithi188 bash[23329]: audit 2020-07-16T14:38:57.554352+0000 mgr.x (mgr.34562) 2896 : audit [DBG] from='client.26746 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:38:59.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:38:59 smithi188 bash[23329]: audit 2020-07-16T14:38:57.822628+0000 mgr.x (mgr.34562) 2897 : audit [DBG] from='client.26752 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:38:59.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:38:59 smithi188 bash[23329]: audit 2020-07-16T14:38:58.148757+0000 mgr.x (mgr.34562) 2898 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:38:59.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:38:59 smithi188 bash[23329]: audit 2020-07-16T14:38:58.150087+0000 mgr.x (mgr.34562) 2899 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:38:59.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:38:59 smithi188 bash[23329]: audit 2020-07-16T14:38:58.151263+0000 mgr.x (mgr.34562) 2900 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:38:59.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:38:59 smithi188 bash[23329]: cephadm 2020-07-16T14:38:58.151985+0000 mgr.x (mgr.34562) 2901 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:38:59.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:38:59 smithi188 bash[23329]: cephadm 2020-07-16T14:38:58.153251+0000 mgr.x (mgr.34562) 2902 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:38:59.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:38:59 smithi188 bash[23329]: cephadm 2020-07-16T14:38:58.154501+0000 mgr.x (mgr.34562) 2903 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:38:59.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:38:59 smithi188 bash[23329]: cephadm 2020-07-16T14:38:58.154813+0000 mgr.x (mgr.34562) 2904 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:38:59.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:38:59 smithi188 bash[23329]: cluster 2020-07-16T14:38:58.301538+0000 mgr.x (mgr.34562) 2905 : cluster [DBG] pgmap v1809: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:38:59.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:38:59 smithi132 bash[27079]: audit 2020-07-16T14:38:57.554352+0000 mgr.x (mgr.34562) 2896 : audit [DBG] from='client.26746 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:38:59.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:38:59 smithi132 bash[27079]: audit 2020-07-16T14:38:57.822628+0000 mgr.x (mgr.34562) 2897 : audit [DBG] from='client.26752 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:38:59.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:38:59 smithi132 bash[27079]: audit 2020-07-16T14:38:58.148757+0000 mgr.x (mgr.34562) 2898 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:38:59.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:38:59 smithi132 bash[27079]: audit 2020-07-16T14:38:58.150087+0000 mgr.x (mgr.34562) 2899 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:38:59.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:38:59 smithi132 bash[27079]: audit 2020-07-16T14:38:58.151263+0000 mgr.x (mgr.34562) 2900 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:38:59.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:38:59 smithi132 bash[27079]: cephadm 2020-07-16T14:38:58.151985+0000 mgr.x (mgr.34562) 2901 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:38:59.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:38:59 smithi132 bash[27079]: cephadm 2020-07-16T14:38:58.153251+0000 mgr.x (mgr.34562) 2902 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:38:59.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:38:59 smithi132 bash[27079]: cephadm 2020-07-16T14:38:58.154501+0000 mgr.x (mgr.34562) 2903 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:38:59.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:38:59 smithi132 bash[27079]: cephadm 2020-07-16T14:38:58.154813+0000 mgr.x (mgr.34562) 2904 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:38:59.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:38:59 smithi132 bash[27079]: cluster 2020-07-16T14:38:58.301538+0000 mgr.x (mgr.34562) 2905 : cluster [DBG] pgmap v1809: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:39:01.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:39:00 smithi132 bash[27079]: cluster 2020-07-16T14:39:00.301992+0000 mgr.x (mgr.34562) 2906 : cluster [DBG] pgmap v1810: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:39:01.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:39:00 smithi188 bash[23329]: cluster 2020-07-16T14:39:00.301992+0000 mgr.x (mgr.34562) 2906 : cluster [DBG] pgmap v1810: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:39:02.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:39:01 smithi132 bash[27079]: audit 2020-07-16T14:39:00.978443+0000 mon.b (mon.2) 716 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:39:02.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:39:01 smithi132 bash[27079]: cephadm 2020-07-16T14:39:00.979067+0000 mgr.x (mgr.34562) 2907 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:39:02.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:39:01 smithi132 bash[27079]: cephadm 2020-07-16T14:39:00.979266+0000 mgr.x (mgr.34562) 2908 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:39:02.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:39:01 smithi188 bash[23329]: audit 2020-07-16T14:39:00.978443+0000 mon.b (mon.2) 716 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:39:02.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:39:01 smithi188 bash[23329]: cephadm 2020-07-16T14:39:00.979067+0000 mgr.x (mgr.34562) 2907 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:39:02.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:39:01 smithi188 bash[23329]: cephadm 2020-07-16T14:39:00.979266+0000 mgr.x (mgr.34562) 2908 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:39:03.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:39:02 smithi132 bash[27079]: cluster 2020-07-16T14:39:02.302421+0000 mgr.x (mgr.34562) 2909 : cluster [DBG] pgmap v1811: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:39:03.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:39:02 smithi188 bash[23329]: cluster 2020-07-16T14:39:02.302421+0000 mgr.x (mgr.34562) 2909 : cluster [DBG] pgmap v1811: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:39:05.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:39:05 smithi188 bash[23329]: cluster 2020-07-16T14:39:04.302749+0000 mgr.x (mgr.34562) 2910 : cluster [DBG] pgmap v1812: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:39:05.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:39:05 smithi132 bash[27079]: cluster 2020-07-16T14:39:04.302749+0000 mgr.x (mgr.34562) 2910 : cluster [DBG] pgmap v1812: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:39:07.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:39:07 smithi188 bash[23329]: cluster 2020-07-16T14:39:06.303179+0000 mgr.x (mgr.34562) 2911 : cluster [DBG] pgmap v1813: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:39:07.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:39:07 smithi132 bash[27079]: cluster 2020-07-16T14:39:06.303179+0000 mgr.x (mgr.34562) 2911 : cluster [DBG] pgmap v1813: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:39:09.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:39:09 smithi188 bash[23329]: cluster 2020-07-16T14:39:08.303541+0000 mgr.x (mgr.34562) 2912 : cluster [DBG] pgmap v1814: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:39:09.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:39:09 smithi132 bash[27079]: cluster 2020-07-16T14:39:08.303541+0000 mgr.x (mgr.34562) 2912 : cluster [DBG] pgmap v1814: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:39:11.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:39:10 smithi132 bash[27079]: cluster 2020-07-16T14:39:10.303991+0000 mgr.x (mgr.34562) 2913 : cluster [DBG] pgmap v1815: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:39:11.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:39:10 smithi188 bash[23329]: cluster 2020-07-16T14:39:10.303991+0000 mgr.x (mgr.34562) 2913 : cluster [DBG] pgmap v1815: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:39:13.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:39:13 smithi188 bash[23329]: cluster 2020-07-16T14:39:12.304526+0000 mgr.x (mgr.34562) 2914 : cluster [DBG] pgmap v1816: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:39:13.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:39:13 smithi132 bash[27079]: cluster 2020-07-16T14:39:12.304526+0000 mgr.x (mgr.34562) 2914 : cluster [DBG] pgmap v1816: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:39:15.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:39:15 smithi188 bash[23329]: cluster 2020-07-16T14:39:14.305009+0000 mgr.x (mgr.34562) 2915 : cluster [DBG] pgmap v1817: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:39:15.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:39:15 smithi132 bash[27079]: cluster 2020-07-16T14:39:14.305009+0000 mgr.x (mgr.34562) 2915 : cluster [DBG] pgmap v1817: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:39:16.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:39:16 smithi188 bash[23329]: audit 2020-07-16T14:39:15.994748+0000 mon.b (mon.2) 717 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:39:16.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:39:16 smithi132 bash[27079]: audit 2020-07-16T14:39:15.994748+0000 mon.b (mon.2) 717 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:39:17.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:39:17 smithi188 bash[23329]: cephadm 2020-07-16T14:39:15.995432+0000 mgr.x (mgr.34562) 2916 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:39:17.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:39:17 smithi188 bash[23329]: cephadm 2020-07-16T14:39:15.995634+0000 mgr.x (mgr.34562) 2917 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:39:17.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:39:17 smithi188 bash[23329]: cluster 2020-07-16T14:39:16.305518+0000 mgr.x (mgr.34562) 2918 : cluster [DBG] pgmap v1818: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:39:17.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:39:17 smithi132 bash[27079]: cephadm 2020-07-16T14:39:15.995432+0000 mgr.x (mgr.34562) 2916 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:39:17.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:39:17 smithi132 bash[27079]: cephadm 2020-07-16T14:39:15.995634+0000 mgr.x (mgr.34562) 2917 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:39:17.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:39:17 smithi132 bash[27079]: cluster 2020-07-16T14:39:16.305518+0000 mgr.x (mgr.34562) 2918 : cluster [DBG] pgmap v1818: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:39:19.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:39:19 smithi188 bash[23329]: cluster 2020-07-16T14:39:18.305948+0000 mgr.x (mgr.34562) 2919 : cluster [DBG] pgmap v1819: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:39:19.786 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:39:19 smithi132 bash[27079]: cluster 2020-07-16T14:39:18.305948+0000 mgr.x (mgr.34562) 2919 : cluster [DBG] pgmap v1819: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:39:21.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:39:20 smithi132 bash[27079]: cluster 2020-07-16T14:39:20.306343+0000 mgr.x (mgr.34562) 2920 : cluster [DBG] pgmap v1820: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:39:21.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:39:20 smithi188 bash[23329]: cluster 2020-07-16T14:39:20.306343+0000 mgr.x (mgr.34562) 2920 : cluster [DBG] pgmap v1820: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:39:23.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:39:23 smithi188 bash[23329]: cluster 2020-07-16T14:39:22.306841+0000 mgr.x (mgr.34562) 2921 : cluster [DBG] pgmap v1821: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:39:23.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:39:23 smithi132 bash[27079]: cluster 2020-07-16T14:39:22.306841+0000 mgr.x (mgr.34562) 2921 : cluster [DBG] pgmap v1821: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:39:25.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:39:25 smithi188 bash[23329]: cluster 2020-07-16T14:39:24.307302+0000 mgr.x (mgr.34562) 2922 : cluster [DBG] pgmap v1822: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:39:25.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:39:25 smithi132 bash[27079]: cluster 2020-07-16T14:39:24.307302+0000 mgr.x (mgr.34562) 2922 : cluster [DBG] pgmap v1822: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:39:27.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:39:27 smithi188 bash[23329]: cluster 2020-07-16T14:39:26.307695+0000 mgr.x (mgr.34562) 2923 : cluster [DBG] pgmap v1823: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:39:27.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:39:27 smithi132 bash[27079]: cluster 2020-07-16T14:39:26.307695+0000 mgr.x (mgr.34562) 2923 : cluster [DBG] pgmap v1823: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:39:28.421 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:39:28.681 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:39:28.681 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (62m) 7m ago 65m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:39:28.681 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (64m) 7m ago 64m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:39:28.681 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (62m) 7m ago 68m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:39:28.682 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (61m) 7m ago 69m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:39:28.682 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 7m ago 69m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:39:28.682 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (68m) 7m ago 68m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:39:28.682 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (68m) 7m ago 68m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:39:28.683 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (65m) 7m ago 65m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:39:28.683 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (65m) 7m ago 65m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:39:28.683 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (67m) 7m ago 67m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:39:28.683 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (67m) 7m ago 67m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:39:28.683 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (67m) 7m ago 67m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:39:28.684 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (66m) 7m ago 67m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:39:28.684 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (66m) 7m ago 66m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:39:28.684 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (66m) 7m ago 66m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:39:28.684 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (66m) 7m ago 66m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:39:28.684 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (65m) 7m ago 65m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:39:28.684 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (64m) 7m ago 65m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:39:28.978 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:39:28.978 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:39:28.979 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:39:28.979 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:39:28.979 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:39:28.979 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:39:28.979 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:39:28.980 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:39:28.980 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:39:28.980 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:39:28.980 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:39:28.980 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:39:28.981 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:39:28.981 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:39:28.981 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:39:28.981 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:39:28.981 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:39:29.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:39:29 smithi188 bash[23329]: cluster 2020-07-16T14:39:28.308182+0000 mgr.x (mgr.34562) 2924 : cluster [DBG] pgmap v1824: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:39:29.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:39:29 smithi188 bash[23329]: audit 2020-07-16T14:39:28.409649+0000 mgr.x (mgr.34562) 2925 : audit [DBG] from='client.26764 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:39:29.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:39:29 smithi188 bash[23329]: audit 2020-07-16T14:39:28.975523+0000 mon.c (mon.1) 233 : audit [DBG] from='client.? 172.21.15.132:0/1017795660' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:39:29.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:39:29 smithi132 bash[27079]: cluster 2020-07-16T14:39:28.308182+0000 mgr.x (mgr.34562) 2924 : cluster [DBG] pgmap v1824: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:39:29.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:39:29 smithi132 bash[27079]: audit 2020-07-16T14:39:28.409649+0000 mgr.x (mgr.34562) 2925 : audit [DBG] from='client.26764 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:39:29.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:39:29 smithi132 bash[27079]: audit 2020-07-16T14:39:28.975523+0000 mon.c (mon.1) 233 : audit [DBG] from='client.? 172.21.15.132:0/1017795660' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:39:30.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:39:30 smithi188 bash[23329]: audit 2020-07-16T14:39:28.676758+0000 mgr.x (mgr.34562) 2926 : audit [DBG] from='client.26770 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:39:30.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:39:30 smithi132 bash[27079]: audit 2020-07-16T14:39:28.676758+0000 mgr.x (mgr.34562) 2926 : audit [DBG] from='client.26770 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:39:31.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:39:31 smithi188 bash[23329]: cluster 2020-07-16T14:39:30.308584+0000 mgr.x (mgr.34562) 2927 : cluster [DBG] pgmap v1825: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:39:31.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:39:31 smithi188 bash[23329]: audit 2020-07-16T14:39:31.003897+0000 mon.b (mon.2) 718 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:39:31.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:39:31 smithi132 bash[27079]: cluster 2020-07-16T14:39:30.308584+0000 mgr.x (mgr.34562) 2927 : cluster [DBG] pgmap v1825: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:39:31.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:39:31 smithi132 bash[27079]: audit 2020-07-16T14:39:31.003897+0000 mon.b (mon.2) 718 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:39:32.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:39:32 smithi188 bash[23329]: cephadm 2020-07-16T14:39:31.004543+0000 mgr.x (mgr.34562) 2928 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:39:32.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:39:32 smithi188 bash[23329]: cephadm 2020-07-16T14:39:31.004739+0000 mgr.x (mgr.34562) 2929 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:39:32.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:39:32 smithi132 bash[27079]: cephadm 2020-07-16T14:39:31.004543+0000 mgr.x (mgr.34562) 2928 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:39:32.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:39:32 smithi132 bash[27079]: cephadm 2020-07-16T14:39:31.004739+0000 mgr.x (mgr.34562) 2929 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:39:33.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:39:33 smithi188 bash[23329]: cluster 2020-07-16T14:39:32.309112+0000 mgr.x (mgr.34562) 2930 : cluster [DBG] pgmap v1826: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:39:33.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:39:33 smithi132 bash[27079]: cluster 2020-07-16T14:39:32.309112+0000 mgr.x (mgr.34562) 2930 : cluster [DBG] pgmap v1826: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:39:35.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:39:35 smithi188 bash[23329]: cluster 2020-07-16T14:39:34.309511+0000 mgr.x (mgr.34562) 2931 : cluster [DBG] pgmap v1827: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:39:35.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:39:35 smithi132 bash[27079]: cluster 2020-07-16T14:39:34.309511+0000 mgr.x (mgr.34562) 2931 : cluster [DBG] pgmap v1827: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:39:37.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:39:37 smithi188 bash[23329]: cluster 2020-07-16T14:39:36.309914+0000 mgr.x (mgr.34562) 2932 : cluster [DBG] pgmap v1828: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:39:37.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:39:37 smithi132 bash[27079]: cluster 2020-07-16T14:39:36.309914+0000 mgr.x (mgr.34562) 2932 : cluster [DBG] pgmap v1828: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:39:39.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:39:39 smithi188 bash[23329]: cluster 2020-07-16T14:39:38.310492+0000 mgr.x (mgr.34562) 2933 : cluster [DBG] pgmap v1829: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:39:39.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:39:39 smithi132 bash[27079]: cluster 2020-07-16T14:39:38.310492+0000 mgr.x (mgr.34562) 2933 : cluster [DBG] pgmap v1829: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:39:41.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:39:40 smithi132 bash[27079]: cluster 2020-07-16T14:39:40.310908+0000 mgr.x (mgr.34562) 2934 : cluster [DBG] pgmap v1830: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:39:41.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:39:40 smithi188 bash[23329]: cluster 2020-07-16T14:39:40.310908+0000 mgr.x (mgr.34562) 2934 : cluster [DBG] pgmap v1830: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:39:43.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:39:43 smithi188 bash[23329]: cluster 2020-07-16T14:39:42.311427+0000 mgr.x (mgr.34562) 2935 : cluster [DBG] pgmap v1831: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:39:43.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:39:43 smithi132 bash[27079]: cluster 2020-07-16T14:39:42.311427+0000 mgr.x (mgr.34562) 2935 : cluster [DBG] pgmap v1831: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:39:45.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:39:45 smithi188 bash[23329]: cluster 2020-07-16T14:39:44.311762+0000 mgr.x (mgr.34562) 2936 : cluster [DBG] pgmap v1832: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:39:45.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:39:45 smithi132 bash[27079]: cluster 2020-07-16T14:39:44.311762+0000 mgr.x (mgr.34562) 2936 : cluster [DBG] pgmap v1832: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:39:46.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:39:46 smithi188 bash[23329]: audit 2020-07-16T14:39:46.020228+0000 mon.b (mon.2) 719 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:39:46.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:39:46 smithi132 bash[27079]: audit 2020-07-16T14:39:46.020228+0000 mon.b (mon.2) 719 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:39:47.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:39:47 smithi188 bash[23329]: cephadm 2020-07-16T14:39:46.020919+0000 mgr.x (mgr.34562) 2937 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:39:47.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:39:47 smithi188 bash[23329]: cephadm 2020-07-16T14:39:46.021266+0000 mgr.x (mgr.34562) 2938 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:39:47.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:39:47 smithi188 bash[23329]: cluster 2020-07-16T14:39:46.312086+0000 mgr.x (mgr.34562) 2939 : cluster [DBG] pgmap v1833: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:39:47.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:39:47 smithi132 bash[27079]: cephadm 2020-07-16T14:39:46.020919+0000 mgr.x (mgr.34562) 2937 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:39:47.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:39:47 smithi132 bash[27079]: cephadm 2020-07-16T14:39:46.021266+0000 mgr.x (mgr.34562) 2938 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:39:47.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:39:47 smithi132 bash[27079]: cluster 2020-07-16T14:39:46.312086+0000 mgr.x (mgr.34562) 2939 : cluster [DBG] pgmap v1833: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:39:49.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:39:49 smithi188 bash[23329]: cluster 2020-07-16T14:39:48.312480+0000 mgr.x (mgr.34562) 2940 : cluster [DBG] pgmap v1834: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:39:49.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:39:49 smithi132 bash[27079]: cluster 2020-07-16T14:39:48.312480+0000 mgr.x (mgr.34562) 2940 : cluster [DBG] pgmap v1834: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:39:51.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:39:50 smithi132 bash[27079]: cluster 2020-07-16T14:39:50.312969+0000 mgr.x (mgr.34562) 2941 : cluster [DBG] pgmap v1835: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:39:51.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:39:50 smithi188 bash[23329]: cluster 2020-07-16T14:39:50.312969+0000 mgr.x (mgr.34562) 2941 : cluster [DBG] pgmap v1835: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:39:53.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:39:53 smithi188 bash[23329]: cluster 2020-07-16T14:39:52.313390+0000 mgr.x (mgr.34562) 2942 : cluster [DBG] pgmap v1836: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:39:53.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:39:53 smithi132 bash[27079]: cluster 2020-07-16T14:39:52.313390+0000 mgr.x (mgr.34562) 2942 : cluster [DBG] pgmap v1836: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:39:55.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:39:55 smithi188 bash[23329]: cluster 2020-07-16T14:39:54.313869+0000 mgr.x (mgr.34562) 2943 : cluster [DBG] pgmap v1837: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:39:55.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:39:55 smithi132 bash[27079]: cluster 2020-07-16T14:39:54.313869+0000 mgr.x (mgr.34562) 2943 : cluster [DBG] pgmap v1837: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:39:57.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:39:57 smithi188 bash[23329]: cluster 2020-07-16T14:39:56.314371+0000 mgr.x (mgr.34562) 2944 : cluster [DBG] pgmap v1838: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:39:57.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:39:57 smithi132 bash[27079]: cluster 2020-07-16T14:39:56.314371+0000 mgr.x (mgr.34562) 2944 : cluster [DBG] pgmap v1838: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:39:59.271 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:39:59.534 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:39:59.534 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (62m) 8m ago 65m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:39:59.535 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (65m) 8m ago 65m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:39:59.535 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (63m) 8m ago 68m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:39:59.535 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (62m) 8m ago 70m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:39:59.535 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 8m ago 70m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:39:59.536 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (68m) 8m ago 68m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:39:59.536 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (69m) 8m ago 69m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:39:59.536 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (65m) 8m ago 66m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:39:59.536 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (65m) 8m ago 66m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:39:59.537 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (68m) 8m ago 68m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:39:59.537 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (68m) 8m ago 68m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:39:59.537 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (67m) 8m ago 67m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:39:59.538 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (67m) 8m ago 67m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:39:59.538 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (66m) 8m ago 67m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:39:59.538 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (66m) 8m ago 66m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:39:59.539 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (66m) 8m ago 66m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:39:59.539 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (66m) 8m ago 66m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:39:59.539 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (65m) 8m ago 66m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:39:59.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:39:59 smithi188 bash[23329]: cluster 2020-07-16T14:39:58.314850+0000 mgr.x (mgr.34562) 2945 : cluster [DBG] pgmap v1839: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:39:59.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:39:59 smithi132 bash[27079]: cluster 2020-07-16T14:39:58.314850+0000 mgr.x (mgr.34562) 2945 : cluster [DBG] pgmap v1839: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:39:59.852 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:39:59.852 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:39:59.853 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:39:59.853 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:39:59.853 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:39:59.854 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:39:59.854 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:39:59.854 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:39:59.855 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:39:59.855 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:39:59.855 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:39:59.856 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:39:59.856 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:39:59.856 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:39:59.856 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:39:59.857 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:39:59.857 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:40:00.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:40:00 smithi188 bash[23329]: audit 2020-07-16T14:39:59.259615+0000 mgr.x (mgr.34562) 2946 : audit [DBG] from='client.26782 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:40:00.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:40:00 smithi188 bash[23329]: audit 2020-07-16T14:39:59.851003+0000 mon.c (mon.1) 234 : audit [DBG] from='client.? 172.21.15.132:0/1245100811' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:40:00.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:40:00 smithi132 bash[27079]: audit 2020-07-16T14:39:59.259615+0000 mgr.x (mgr.34562) 2946 : audit [DBG] from='client.26782 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:40:00.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:40:00 smithi132 bash[27079]: audit 2020-07-16T14:39:59.851003+0000 mon.c (mon.1) 234 : audit [DBG] from='client.? 172.21.15.132:0/1245100811' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:40:01.642 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:40:01 smithi132 bash[27079]: audit 2020-07-16T14:39:59.529428+0000 mgr.x (mgr.34562) 2947 : audit [DBG] from='client.26788 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:40:01.643 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:40:01 smithi132 bash[27079]: cluster 2020-07-16T14:40:00.315235+0000 mgr.x (mgr.34562) 2948 : cluster [DBG] pgmap v1840: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:40:01.643 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:40:01 smithi132 bash[27079]: audit 2020-07-16T14:40:01.039354+0000 mon.b (mon.2) 720 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:40:01.643 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:40:01 smithi132 bash[27079]: audit 2020-07-16T14:40:01.040765+0000 mon.b (mon.2) 721 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:40:01.643 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:40:01 smithi132 bash[27079]: audit 2020-07-16T14:40:01.041939+0000 mon.b (mon.2) 722 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:40:01.644 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:40:01 smithi132 bash[27079]: audit 2020-07-16T14:40:01.043260+0000 mon.b (mon.2) 723 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:40:01.644 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:40:01 smithi132 bash[27079]: audit 2020-07-16T14:40:01.044455+0000 mon.b (mon.2) 724 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:40:01.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:40:01 smithi188 bash[23329]: audit 2020-07-16T14:39:59.529428+0000 mgr.x (mgr.34562) 2947 : audit [DBG] from='client.26788 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:40:01.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:40:01 smithi188 bash[23329]: cluster 2020-07-16T14:40:00.315235+0000 mgr.x (mgr.34562) 2948 : cluster [DBG] pgmap v1840: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:40:01.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:40:01 smithi188 bash[23329]: audit 2020-07-16T14:40:01.039354+0000 mon.b (mon.2) 720 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:40:01.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:40:01 smithi188 bash[23329]: audit 2020-07-16T14:40:01.040765+0000 mon.b (mon.2) 721 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:40:01.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:40:01 smithi188 bash[23329]: audit 2020-07-16T14:40:01.041939+0000 mon.b (mon.2) 722 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:40:01.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:40:01 smithi188 bash[23329]: audit 2020-07-16T14:40:01.043260+0000 mon.b (mon.2) 723 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:40:01.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:40:01 smithi188 bash[23329]: audit 2020-07-16T14:40:01.044455+0000 mon.b (mon.2) 724 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:40:02.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:40:02 smithi188 bash[23329]: audit 2020-07-16T14:40:01.039756+0000 mgr.x (mgr.34562) 2949 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:40:02.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:40:02 smithi188 bash[23329]: audit 2020-07-16T14:40:01.041076+0000 mgr.x (mgr.34562) 2950 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:40:02.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:40:02 smithi188 bash[23329]: audit 2020-07-16T14:40:01.042226+0000 mgr.x (mgr.34562) 2951 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:40:02.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:40:02 smithi188 bash[23329]: cephadm 2020-07-16T14:40:01.042942+0000 mgr.x (mgr.34562) 2952 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:40:02.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:40:02 smithi188 bash[23329]: cephadm 2020-07-16T14:40:01.044103+0000 mgr.x (mgr.34562) 2953 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:40:02.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:40:02 smithi188 bash[23329]: cephadm 2020-07-16T14:40:01.045154+0000 mgr.x (mgr.34562) 2954 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:40:02.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:40:02 smithi188 bash[23329]: cephadm 2020-07-16T14:40:01.045528+0000 mgr.x (mgr.34562) 2955 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:40:02.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:40:02 smithi132 bash[27079]: audit 2020-07-16T14:40:01.039756+0000 mgr.x (mgr.34562) 2949 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:40:02.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:40:02 smithi132 bash[27079]: audit 2020-07-16T14:40:01.041076+0000 mgr.x (mgr.34562) 2950 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:40:02.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:40:02 smithi132 bash[27079]: audit 2020-07-16T14:40:01.042226+0000 mgr.x (mgr.34562) 2951 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:40:02.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:40:02 smithi132 bash[27079]: cephadm 2020-07-16T14:40:01.042942+0000 mgr.x (mgr.34562) 2952 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:40:02.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:40:02 smithi132 bash[27079]: cephadm 2020-07-16T14:40:01.044103+0000 mgr.x (mgr.34562) 2953 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:40:02.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:40:02 smithi132 bash[27079]: cephadm 2020-07-16T14:40:01.045154+0000 mgr.x (mgr.34562) 2954 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:40:02.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:40:02 smithi132 bash[27079]: cephadm 2020-07-16T14:40:01.045528+0000 mgr.x (mgr.34562) 2955 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:40:03.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:40:03 smithi188 bash[23329]: cluster 2020-07-16T14:40:02.315666+0000 mgr.x (mgr.34562) 2956 : cluster [DBG] pgmap v1841: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:40:03.782 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:40:03 smithi132 bash[27079]: cluster 2020-07-16T14:40:02.315666+0000 mgr.x (mgr.34562) 2956 : cluster [DBG] pgmap v1841: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:40:04.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:40:04 smithi188 bash[23329]: audit 2020-07-16T14:40:04.004753+0000 mon.b (mon.2) 725 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:40:04.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:40:04 smithi132 bash[27079]: audit 2020-07-16T14:40:04.004753+0000 mon.b (mon.2) 725 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:40:05.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:40:05 smithi188 bash[23329]: cephadm 2020-07-16T14:40:04.005374+0000 mgr.x (mgr.34562) 2957 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:40:05.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:40:05 smithi188 bash[23329]: cephadm 2020-07-16T14:40:04.005796+0000 mgr.x (mgr.34562) 2958 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:40:05.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:40:05 smithi188 bash[23329]: cluster 2020-07-16T14:40:04.316095+0000 mgr.x (mgr.34562) 2959 : cluster [DBG] pgmap v1842: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:40:05.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:40:05 smithi132 bash[27079]: cephadm 2020-07-16T14:40:04.005374+0000 mgr.x (mgr.34562) 2957 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:40:05.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:40:05 smithi132 bash[27079]: cephadm 2020-07-16T14:40:04.005796+0000 mgr.x (mgr.34562) 2958 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:40:05.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:40:05 smithi132 bash[27079]: cluster 2020-07-16T14:40:04.316095+0000 mgr.x (mgr.34562) 2959 : cluster [DBG] pgmap v1842: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:40:07.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:40:07 smithi188 bash[23329]: cluster 2020-07-16T14:40:06.316598+0000 mgr.x (mgr.34562) 2960 : cluster [DBG] pgmap v1843: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:40:07.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:40:07 smithi132 bash[27079]: cluster 2020-07-16T14:40:06.316598+0000 mgr.x (mgr.34562) 2960 : cluster [DBG] pgmap v1843: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:40:09.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:40:09 smithi188 bash[23329]: cluster 2020-07-16T14:40:08.317164+0000 mgr.x (mgr.34562) 2961 : cluster [DBG] pgmap v1844: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:40:09.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:40:09 smithi132 bash[27079]: cluster 2020-07-16T14:40:08.317164+0000 mgr.x (mgr.34562) 2961 : cluster [DBG] pgmap v1844: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:40:11.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:40:10 smithi132 bash[27079]: cluster 2020-07-16T14:40:10.317559+0000 mgr.x (mgr.34562) 2962 : cluster [DBG] pgmap v1845: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:40:11.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:40:10 smithi188 bash[23329]: cluster 2020-07-16T14:40:10.317559+0000 mgr.x (mgr.34562) 2962 : cluster [DBG] pgmap v1845: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:40:13.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:40:13 smithi188 bash[23329]: cluster 2020-07-16T14:40:12.317948+0000 mgr.x (mgr.34562) 2963 : cluster [DBG] pgmap v1846: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:40:13.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:40:13 smithi132 bash[27079]: cluster 2020-07-16T14:40:12.317948+0000 mgr.x (mgr.34562) 2963 : cluster [DBG] pgmap v1846: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:40:15.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:40:15 smithi188 bash[23329]: cluster 2020-07-16T14:40:14.318317+0000 mgr.x (mgr.34562) 2964 : cluster [DBG] pgmap v1847: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:40:15.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:40:15 smithi132 bash[27079]: cluster 2020-07-16T14:40:14.318317+0000 mgr.x (mgr.34562) 2964 : cluster [DBG] pgmap v1847: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:40:17.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:40:17 smithi188 bash[23329]: cluster 2020-07-16T14:40:16.318691+0000 mgr.x (mgr.34562) 2965 : cluster [DBG] pgmap v1848: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:40:17.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:40:17 smithi132 bash[27079]: cluster 2020-07-16T14:40:16.318691+0000 mgr.x (mgr.34562) 2965 : cluster [DBG] pgmap v1848: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:40:19.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:40:19 smithi188 bash[23329]: cluster 2020-07-16T14:40:18.319166+0000 mgr.x (mgr.34562) 2966 : cluster [DBG] pgmap v1849: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:40:19.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:40:19 smithi188 bash[23329]: audit 2020-07-16T14:40:19.021519+0000 mon.b (mon.2) 726 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:40:19.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:40:19 smithi132 bash[27079]: cluster 2020-07-16T14:40:18.319166+0000 mgr.x (mgr.34562) 2966 : cluster [DBG] pgmap v1849: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:40:19.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:40:19 smithi132 bash[27079]: audit 2020-07-16T14:40:19.021519+0000 mon.b (mon.2) 726 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:40:20.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:40:20 smithi188 bash[23329]: cephadm 2020-07-16T14:40:19.022372+0000 mgr.x (mgr.34562) 2967 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:40:20.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:40:20 smithi188 bash[23329]: cephadm 2020-07-16T14:40:19.022451+0000 mgr.x (mgr.34562) 2968 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:40:20.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:40:20 smithi132 bash[27079]: cephadm 2020-07-16T14:40:19.022372+0000 mgr.x (mgr.34562) 2967 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:40:20.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:40:20 smithi132 bash[27079]: cephadm 2020-07-16T14:40:19.022451+0000 mgr.x (mgr.34562) 2968 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:40:21.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:40:21 smithi188 bash[23329]: cluster 2020-07-16T14:40:20.319558+0000 mgr.x (mgr.34562) 2969 : cluster [DBG] pgmap v1850: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:40:21.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:40:21 smithi132 bash[27079]: cluster 2020-07-16T14:40:20.319558+0000 mgr.x (mgr.34562) 2969 : cluster [DBG] pgmap v1850: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:40:23.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:40:23 smithi188 bash[23329]: cluster 2020-07-16T14:40:22.320093+0000 mgr.x (mgr.34562) 2970 : cluster [DBG] pgmap v1851: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:40:23.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:40:23 smithi132 bash[27079]: cluster 2020-07-16T14:40:22.320093+0000 mgr.x (mgr.34562) 2970 : cluster [DBG] pgmap v1851: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:40:25.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:40:25 smithi188 bash[23329]: cluster 2020-07-16T14:40:24.320628+0000 mgr.x (mgr.34562) 2971 : cluster [DBG] pgmap v1852: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:40:25.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:40:25 smithi132 bash[27079]: cluster 2020-07-16T14:40:24.320628+0000 mgr.x (mgr.34562) 2971 : cluster [DBG] pgmap v1852: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:40:27.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:40:27 smithi188 bash[23329]: cluster 2020-07-16T14:40:26.321071+0000 mgr.x (mgr.34562) 2972 : cluster [DBG] pgmap v1853: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:40:27.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:40:27 smithi132 bash[27079]: cluster 2020-07-16T14:40:26.321071+0000 mgr.x (mgr.34562) 2972 : cluster [DBG] pgmap v1853: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:40:29.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:40:29 smithi188 bash[23329]: cluster 2020-07-16T14:40:28.321611+0000 mgr.x (mgr.34562) 2973 : cluster [DBG] pgmap v1854: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:40:29.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:40:29 smithi132 bash[27079]: cluster 2020-07-16T14:40:28.321611+0000 mgr.x (mgr.34562) 2973 : cluster [DBG] pgmap v1854: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:40:30.151 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:40:30.411 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:40:30.411 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (63m) 8m ago 66m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:40:30.412 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (65m) 8m ago 65m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:40:30.412 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (63m) 8m ago 69m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:40:30.412 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (63m) 8m ago 70m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:40:30.412 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 8m ago 70m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:40:30.413 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (69m) 8m ago 69m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:40:30.413 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (69m) 8m ago 69m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:40:30.413 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (66m) 8m ago 66m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:40:30.413 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (66m) 8m ago 66m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:40:30.413 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (68m) 8m ago 68m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:40:30.414 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (68m) 8m ago 68m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:40:30.414 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (68m) 8m ago 68m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:40:30.414 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (68m) 8m ago 68m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:40:30.414 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (67m) 8m ago 67m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:40:30.414 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (67m) 8m ago 67m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:40:30.414 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (67m) 8m ago 67m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:40:30.415 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (66m) 8m ago 66m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:40:30.415 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (65m) 8m ago 66m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:40:30.709 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:40:30.709 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:40:30.709 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:40:30.709 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:40:30.710 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:40:30.710 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:40:30.710 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:40:30.710 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:40:30.710 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:40:30.711 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:40:30.711 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:40:30.711 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:40:30.711 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:40:30.711 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:40:30.712 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:40:30.712 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:40:30.712 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:40:31.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:40:30 smithi132 bash[27079]: audit 2020-07-16T14:40:30.139674+0000 mgr.x (mgr.34562) 2974 : audit [DBG] from='client.26800 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:40:31.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:40:30 smithi132 bash[27079]: cluster 2020-07-16T14:40:30.321960+0000 mgr.x (mgr.34562) 2975 : cluster [DBG] pgmap v1855: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:40:31.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:40:30 smithi132 bash[27079]: audit 2020-07-16T14:40:30.407178+0000 mgr.x (mgr.34562) 2976 : audit [DBG] from='client.26806 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:40:31.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:40:30 smithi132 bash[27079]: audit 2020-07-16T14:40:30.707919+0000 mon.c (mon.1) 235 : audit [DBG] from='client.? 172.21.15.132:0/19419974' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:40:31.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:40:30 smithi188 bash[23329]: audit 2020-07-16T14:40:30.139674+0000 mgr.x (mgr.34562) 2974 : audit [DBG] from='client.26800 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:40:31.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:40:30 smithi188 bash[23329]: cluster 2020-07-16T14:40:30.321960+0000 mgr.x (mgr.34562) 2975 : cluster [DBG] pgmap v1855: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:40:31.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:40:30 smithi188 bash[23329]: audit 2020-07-16T14:40:30.407178+0000 mgr.x (mgr.34562) 2976 : audit [DBG] from='client.26806 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:40:31.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:40:30 smithi188 bash[23329]: audit 2020-07-16T14:40:30.707919+0000 mon.c (mon.1) 235 : audit [DBG] from='client.? 172.21.15.132:0/19419974' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:40:33.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:40:33 smithi188 bash[23329]: cluster 2020-07-16T14:40:32.322463+0000 mgr.x (mgr.34562) 2977 : cluster [DBG] pgmap v1856: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:40:33.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:40:33 smithi132 bash[27079]: cluster 2020-07-16T14:40:32.322463+0000 mgr.x (mgr.34562) 2977 : cluster [DBG] pgmap v1856: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:40:34.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:40:34 smithi188 bash[23329]: audit 2020-07-16T14:40:34.038381+0000 mon.b (mon.2) 727 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:40:34.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:40:34 smithi132 bash[27079]: audit 2020-07-16T14:40:34.038381+0000 mon.b (mon.2) 727 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:40:35.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:40:35 smithi188 bash[23329]: cephadm 2020-07-16T14:40:34.039132+0000 mgr.x (mgr.34562) 2978 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:40:35.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:40:35 smithi188 bash[23329]: cephadm 2020-07-16T14:40:34.039269+0000 mgr.x (mgr.34562) 2979 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:40:35.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:40:35 smithi188 bash[23329]: cluster 2020-07-16T14:40:34.322926+0000 mgr.x (mgr.34562) 2980 : cluster [DBG] pgmap v1857: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:40:35.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:40:35 smithi132 bash[27079]: cephadm 2020-07-16T14:40:34.039132+0000 mgr.x (mgr.34562) 2978 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:40:35.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:40:35 smithi132 bash[27079]: cephadm 2020-07-16T14:40:34.039269+0000 mgr.x (mgr.34562) 2979 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:40:35.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:40:35 smithi132 bash[27079]: cluster 2020-07-16T14:40:34.322926+0000 mgr.x (mgr.34562) 2980 : cluster [DBG] pgmap v1857: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:40:37.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:40:37 smithi188 bash[23329]: cluster 2020-07-16T14:40:36.323392+0000 mgr.x (mgr.34562) 2981 : cluster [DBG] pgmap v1858: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:40:37.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:40:37 smithi132 bash[27079]: cluster 2020-07-16T14:40:36.323392+0000 mgr.x (mgr.34562) 2981 : cluster [DBG] pgmap v1858: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:40:39.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:40:39 smithi188 bash[23329]: cluster 2020-07-16T14:40:38.323927+0000 mgr.x (mgr.34562) 2982 : cluster [DBG] pgmap v1859: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:40:39.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:40:39 smithi132 bash[27079]: cluster 2020-07-16T14:40:38.323927+0000 mgr.x (mgr.34562) 2982 : cluster [DBG] pgmap v1859: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:40:41.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:40:40 smithi132 bash[27079]: cluster 2020-07-16T14:40:40.324492+0000 mgr.x (mgr.34562) 2983 : cluster [DBG] pgmap v1860: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:40:41.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:40:40 smithi188 bash[23329]: cluster 2020-07-16T14:40:40.324492+0000 mgr.x (mgr.34562) 2983 : cluster [DBG] pgmap v1860: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:40:43.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:40:43 smithi188 bash[23329]: cluster 2020-07-16T14:40:42.324988+0000 mgr.x (mgr.34562) 2984 : cluster [DBG] pgmap v1861: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:40:43.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:40:43 smithi132 bash[27079]: cluster 2020-07-16T14:40:42.324988+0000 mgr.x (mgr.34562) 2984 : cluster [DBG] pgmap v1861: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:40:45.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:40:45 smithi188 bash[23329]: cluster 2020-07-16T14:40:44.325344+0000 mgr.x (mgr.34562) 2985 : cluster [DBG] pgmap v1862: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:40:45.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:40:45 smithi132 bash[27079]: cluster 2020-07-16T14:40:44.325344+0000 mgr.x (mgr.34562) 2985 : cluster [DBG] pgmap v1862: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:40:47.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:40:47 smithi188 bash[23329]: cluster 2020-07-16T14:40:46.325807+0000 mgr.x (mgr.34562) 2986 : cluster [DBG] pgmap v1863: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:40:47.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:40:47 smithi132 bash[27079]: cluster 2020-07-16T14:40:46.325807+0000 mgr.x (mgr.34562) 2986 : cluster [DBG] pgmap v1863: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:40:49.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:40:49 smithi188 bash[23329]: cluster 2020-07-16T14:40:48.326211+0000 mgr.x (mgr.34562) 2987 : cluster [DBG] pgmap v1864: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:40:49.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:40:49 smithi188 bash[23329]: audit 2020-07-16T14:40:49.050325+0000 mon.b (mon.2) 728 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:40:49.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:40:49 smithi132 bash[27079]: cluster 2020-07-16T14:40:48.326211+0000 mgr.x (mgr.34562) 2987 : cluster [DBG] pgmap v1864: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:40:49.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:40:49 smithi132 bash[27079]: audit 2020-07-16T14:40:49.050325+0000 mon.b (mon.2) 728 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:40:50.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:40:50 smithi188 bash[23329]: cephadm 2020-07-16T14:40:49.051022+0000 mgr.x (mgr.34562) 2988 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:40:50.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:40:50 smithi188 bash[23329]: cephadm 2020-07-16T14:40:49.051253+0000 mgr.x (mgr.34562) 2989 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:40:50.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:40:50 smithi132 bash[27079]: cephadm 2020-07-16T14:40:49.051022+0000 mgr.x (mgr.34562) 2988 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:40:50.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:40:50 smithi132 bash[27079]: cephadm 2020-07-16T14:40:49.051253+0000 mgr.x (mgr.34562) 2989 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:40:51.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:40:51 smithi188 bash[23329]: cluster 2020-07-16T14:40:50.326688+0000 mgr.x (mgr.34562) 2990 : cluster [DBG] pgmap v1865: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:40:51.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:40:51 smithi132 bash[27079]: cluster 2020-07-16T14:40:50.326688+0000 mgr.x (mgr.34562) 2990 : cluster [DBG] pgmap v1865: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:40:53.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:40:53 smithi188 bash[23329]: cluster 2020-07-16T14:40:52.327221+0000 mgr.x (mgr.34562) 2991 : cluster [DBG] pgmap v1866: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:40:53.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:40:53 smithi132 bash[27079]: cluster 2020-07-16T14:40:52.327221+0000 mgr.x (mgr.34562) 2991 : cluster [DBG] pgmap v1866: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:40:55.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:40:55 smithi188 bash[23329]: cluster 2020-07-16T14:40:54.327610+0000 mgr.x (mgr.34562) 2992 : cluster [DBG] pgmap v1867: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:40:55.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:40:55 smithi132 bash[27079]: cluster 2020-07-16T14:40:54.327610+0000 mgr.x (mgr.34562) 2992 : cluster [DBG] pgmap v1867: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:40:57.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:40:57 smithi188 bash[23329]: cluster 2020-07-16T14:40:56.328039+0000 mgr.x (mgr.34562) 2993 : cluster [DBG] pgmap v1868: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:40:57.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:40:57 smithi132 bash[27079]: cluster 2020-07-16T14:40:56.328039+0000 mgr.x (mgr.34562) 2993 : cluster [DBG] pgmap v1868: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:40:59.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:40:59 smithi188 bash[23329]: cluster 2020-07-16T14:40:58.328504+0000 mgr.x (mgr.34562) 2994 : cluster [DBG] pgmap v1869: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:40:59.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:40:59 smithi132 bash[27079]: cluster 2020-07-16T14:40:58.328504+0000 mgr.x (mgr.34562) 2994 : cluster [DBG] pgmap v1869: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:41:01.009 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:41:01.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:41:00 smithi132 bash[27079]: cluster 2020-07-16T14:41:00.329000+0000 mgr.x (mgr.34562) 2995 : cluster [DBG] pgmap v1870: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:41:01.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:41:00 smithi188 bash[23329]: cluster 2020-07-16T14:41:00.329000+0000 mgr.x (mgr.34562) 2995 : cluster [DBG] pgmap v1870: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:41:01.272 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:41:01.272 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (63m) 9m ago 66m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:41:01.272 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (66m) 9m ago 66m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:41:01.273 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (64m) 9m ago 69m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:41:01.273 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (63m) 9m ago 71m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:41:01.273 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 9m ago 71m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:41:01.273 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (69m) 9m ago 69m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:41:01.273 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (70m) 9m ago 70m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:41:01.274 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (66m) 9m ago 67m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:41:01.274 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (66m) 9m ago 67m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:41:01.274 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (69m) 9m ago 69m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:41:01.274 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (69m) 9m ago 69m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:41:01.274 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (68m) 9m ago 68m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:41:01.275 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (68m) 9m ago 68m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:41:01.275 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (67m) 9m ago 68m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:41:01.275 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (67m) 9m ago 67m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:41:01.275 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (67m) 9m ago 67m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:41:01.275 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (67m) 9m ago 67m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:41:01.278 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (66m) 9m ago 67m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:41:01.570 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:41:01.571 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:41:01.571 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:41:01.571 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:41:01.572 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:41:01.572 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:41:01.572 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:41:01.572 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:41:01.572 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:41:01.573 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:41:01.573 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:41:01.573 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:41:01.573 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:41:01.573 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:41:01.574 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:41:01.574 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:41:01.574 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:41:02.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:41:01 smithi132 bash[27079]: audit 2020-07-16T14:41:00.998024+0000 mgr.x (mgr.34562) 2996 : audit [DBG] from='client.26818 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:41:02.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:41:01 smithi132 bash[27079]: audit 2020-07-16T14:41:01.267448+0000 mgr.x (mgr.34562) 2997 : audit [DBG] from='client.26824 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:41:02.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:41:01 smithi132 bash[27079]: audit 2020-07-16T14:41:01.569182+0000 mon.c (mon.1) 236 : audit [DBG] from='client.? 172.21.15.132:0/580578381' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:41:02.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:41:01 smithi188 bash[23329]: audit 2020-07-16T14:41:00.998024+0000 mgr.x (mgr.34562) 2996 : audit [DBG] from='client.26818 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:41:02.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:41:01 smithi188 bash[23329]: audit 2020-07-16T14:41:01.267448+0000 mgr.x (mgr.34562) 2997 : audit [DBG] from='client.26824 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:41:02.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:41:01 smithi188 bash[23329]: audit 2020-07-16T14:41:01.569182+0000 mon.c (mon.1) 236 : audit [DBG] from='client.? 172.21.15.132:0/580578381' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:41:03.038 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:41:02 smithi132 bash[27079]: cluster 2020-07-16T14:41:02.329459+0000 mgr.x (mgr.34562) 2998 : cluster [DBG] pgmap v1871: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:41:03.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:41:02 smithi188 bash[23329]: cluster 2020-07-16T14:41:02.329459+0000 mgr.x (mgr.34562) 2998 : cluster [DBG] pgmap v1871: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:41:04.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:41:04 smithi188 bash[23329]: audit 2020-07-16T14:41:04.069441+0000 mon.b (mon.2) 729 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:41:04.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:41:04 smithi188 bash[23329]: audit 2020-07-16T14:41:04.070806+0000 mon.b (mon.2) 730 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:41:04.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:41:04 smithi188 bash[23329]: audit 2020-07-16T14:41:04.072000+0000 mon.b (mon.2) 731 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:41:04.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:41:04 smithi188 bash[23329]: audit 2020-07-16T14:41:04.073486+0000 mon.b (mon.2) 732 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:41:04.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:41:04 smithi188 bash[23329]: audit 2020-07-16T14:41:04.074864+0000 mon.b (mon.2) 733 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:41:04.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:41:04 smithi132 bash[27079]: audit 2020-07-16T14:41:04.069441+0000 mon.b (mon.2) 729 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:41:04.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:41:04 smithi132 bash[27079]: audit 2020-07-16T14:41:04.070806+0000 mon.b (mon.2) 730 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:41:04.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:41:04 smithi132 bash[27079]: audit 2020-07-16T14:41:04.072000+0000 mon.b (mon.2) 731 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:41:04.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:41:04 smithi132 bash[27079]: audit 2020-07-16T14:41:04.073486+0000 mon.b (mon.2) 732 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:41:04.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:41:04 smithi132 bash[27079]: audit 2020-07-16T14:41:04.074864+0000 mon.b (mon.2) 733 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:41:05.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:41:05 smithi132 bash[27079]: audit 2020-07-16T14:41:04.069804+0000 mgr.x (mgr.34562) 2999 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:41:05.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:41:05 smithi132 bash[27079]: audit 2020-07-16T14:41:04.071117+0000 mgr.x (mgr.34562) 3000 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:41:05.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:41:05 smithi132 bash[27079]: audit 2020-07-16T14:41:04.072268+0000 mgr.x (mgr.34562) 3001 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:41:05.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:41:05 smithi132 bash[27079]: cephadm 2020-07-16T14:41:04.073004+0000 mgr.x (mgr.34562) 3002 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:41:05.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:41:05 smithi132 bash[27079]: cephadm 2020-07-16T14:41:04.074327+0000 mgr.x (mgr.34562) 3003 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:41:05.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:41:05 smithi132 bash[27079]: cephadm 2020-07-16T14:41:04.075649+0000 mgr.x (mgr.34562) 3004 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:41:05.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:41:05 smithi132 bash[27079]: cephadm 2020-07-16T14:41:04.075971+0000 mgr.x (mgr.34562) 3005 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:41:05.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:41:05 smithi132 bash[27079]: cluster 2020-07-16T14:41:04.329846+0000 mgr.x (mgr.34562) 3006 : cluster [DBG] pgmap v1872: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:41:05.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:41:05 smithi188 bash[23329]: audit 2020-07-16T14:41:04.069804+0000 mgr.x (mgr.34562) 2999 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:41:05.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:41:05 smithi188 bash[23329]: audit 2020-07-16T14:41:04.071117+0000 mgr.x (mgr.34562) 3000 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:41:05.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:41:05 smithi188 bash[23329]: audit 2020-07-16T14:41:04.072268+0000 mgr.x (mgr.34562) 3001 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:41:05.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:41:05 smithi188 bash[23329]: cephadm 2020-07-16T14:41:04.073004+0000 mgr.x (mgr.34562) 3002 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:41:05.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:41:05 smithi188 bash[23329]: cephadm 2020-07-16T14:41:04.074327+0000 mgr.x (mgr.34562) 3003 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:41:05.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:41:05 smithi188 bash[23329]: cephadm 2020-07-16T14:41:04.075649+0000 mgr.x (mgr.34562) 3004 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:41:05.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:41:05 smithi188 bash[23329]: cephadm 2020-07-16T14:41:04.075971+0000 mgr.x (mgr.34562) 3005 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:41:05.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:41:05 smithi188 bash[23329]: cluster 2020-07-16T14:41:04.329846+0000 mgr.x (mgr.34562) 3006 : cluster [DBG] pgmap v1872: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:41:07.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:41:07 smithi188 bash[23329]: cluster 2020-07-16T14:41:06.330275+0000 mgr.x (mgr.34562) 3007 : cluster [DBG] pgmap v1873: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:41:07.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:41:07 smithi188 bash[23329]: audit 2020-07-16T14:41:07.106508+0000 mon.b (mon.2) 734 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:41:07.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:41:07 smithi132 bash[27079]: cluster 2020-07-16T14:41:06.330275+0000 mgr.x (mgr.34562) 3007 : cluster [DBG] pgmap v1873: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:41:07.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:41:07 smithi132 bash[27079]: audit 2020-07-16T14:41:07.106508+0000 mon.b (mon.2) 734 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:41:08.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:41:08 smithi188 bash[23329]: cephadm 2020-07-16T14:41:07.107187+0000 mgr.x (mgr.34562) 3008 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:41:08.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:41:08 smithi188 bash[23329]: cephadm 2020-07-16T14:41:07.107609+0000 mgr.x (mgr.34562) 3009 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:41:08.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:41:08 smithi132 bash[27079]: cephadm 2020-07-16T14:41:07.107187+0000 mgr.x (mgr.34562) 3008 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:41:08.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:41:08 smithi132 bash[27079]: cephadm 2020-07-16T14:41:07.107609+0000 mgr.x (mgr.34562) 3009 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:41:09.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:41:09 smithi188 bash[23329]: cluster 2020-07-16T14:41:08.330668+0000 mgr.x (mgr.34562) 3010 : cluster [DBG] pgmap v1874: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:41:09.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:41:09 smithi132 bash[27079]: cluster 2020-07-16T14:41:08.330668+0000 mgr.x (mgr.34562) 3010 : cluster [DBG] pgmap v1874: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:41:11.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:41:10 smithi132 bash[27079]: cluster 2020-07-16T14:41:10.331174+0000 mgr.x (mgr.34562) 3011 : cluster [DBG] pgmap v1875: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:41:11.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:41:10 smithi188 bash[23329]: cluster 2020-07-16T14:41:10.331174+0000 mgr.x (mgr.34562) 3011 : cluster [DBG] pgmap v1875: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:41:13.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:41:13 smithi188 bash[23329]: cluster 2020-07-16T14:41:12.331684+0000 mgr.x (mgr.34562) 3012 : cluster [DBG] pgmap v1876: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:41:13.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:41:13 smithi132 bash[27079]: cluster 2020-07-16T14:41:12.331684+0000 mgr.x (mgr.34562) 3012 : cluster [DBG] pgmap v1876: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:41:15.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:41:15 smithi188 bash[23329]: cluster 2020-07-16T14:41:14.332068+0000 mgr.x (mgr.34562) 3013 : cluster [DBG] pgmap v1877: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:41:15.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:41:15 smithi132 bash[27079]: cluster 2020-07-16T14:41:14.332068+0000 mgr.x (mgr.34562) 3013 : cluster [DBG] pgmap v1877: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:41:17.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:41:17 smithi188 bash[23329]: cluster 2020-07-16T14:41:16.332453+0000 mgr.x (mgr.34562) 3014 : cluster [DBG] pgmap v1878: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:41:17.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:41:17 smithi132 bash[27079]: cluster 2020-07-16T14:41:16.332453+0000 mgr.x (mgr.34562) 3014 : cluster [DBG] pgmap v1878: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:41:19.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:41:19 smithi188 bash[23329]: cluster 2020-07-16T14:41:18.333046+0000 mgr.x (mgr.34562) 3015 : cluster [DBG] pgmap v1879: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:41:19.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:41:19 smithi132 bash[27079]: cluster 2020-07-16T14:41:18.333046+0000 mgr.x (mgr.34562) 3015 : cluster [DBG] pgmap v1879: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:41:21.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:41:20 smithi132 bash[27079]: cluster 2020-07-16T14:41:20.333467+0000 mgr.x (mgr.34562) 3016 : cluster [DBG] pgmap v1880: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:41:21.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:41:20 smithi188 bash[23329]: cluster 2020-07-16T14:41:20.333467+0000 mgr.x (mgr.34562) 3016 : cluster [DBG] pgmap v1880: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:41:22.533 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:41:22 smithi132 bash[27079]: audit 2020-07-16T14:41:22.123121+0000 mon.b (mon.2) 735 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:41:22.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:41:22 smithi188 bash[23329]: audit 2020-07-16T14:41:22.123121+0000 mon.b (mon.2) 735 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:41:23.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:41:23 smithi132 bash[27079]: cephadm 2020-07-16T14:41:22.123846+0000 mgr.x (mgr.34562) 3017 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:41:23.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:41:23 smithi132 bash[27079]: cephadm 2020-07-16T14:41:22.124207+0000 mgr.x (mgr.34562) 3018 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:41:23.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:41:23 smithi132 bash[27079]: cluster 2020-07-16T14:41:22.334072+0000 mgr.x (mgr.34562) 3019 : cluster [DBG] pgmap v1881: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:41:23.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:41:23 smithi188 bash[23329]: cephadm 2020-07-16T14:41:22.123846+0000 mgr.x (mgr.34562) 3017 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:41:23.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:41:23 smithi188 bash[23329]: cephadm 2020-07-16T14:41:22.124207+0000 mgr.x (mgr.34562) 3018 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:41:23.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:41:23 smithi188 bash[23329]: cluster 2020-07-16T14:41:22.334072+0000 mgr.x (mgr.34562) 3019 : cluster [DBG] pgmap v1881: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:41:25.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:41:25 smithi188 bash[23329]: cluster 2020-07-16T14:41:24.334471+0000 mgr.x (mgr.34562) 3020 : cluster [DBG] pgmap v1882: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:41:25.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:41:25 smithi132 bash[27079]: cluster 2020-07-16T14:41:24.334471+0000 mgr.x (mgr.34562) 3020 : cluster [DBG] pgmap v1882: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:41:27.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:41:27 smithi188 bash[23329]: cluster 2020-07-16T14:41:26.334840+0000 mgr.x (mgr.34562) 3021 : cluster [DBG] pgmap v1883: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:41:28.197 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:41:27 smithi132 bash[27079]: cluster 2020-07-16T14:41:26.334840+0000 mgr.x (mgr.34562) 3021 : cluster [DBG] pgmap v1883: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:41:29.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:41:29 smithi188 bash[23329]: cluster 2020-07-16T14:41:28.335234+0000 mgr.x (mgr.34562) 3022 : cluster [DBG] pgmap v1884: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:41:29.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:41:29 smithi132 bash[27079]: cluster 2020-07-16T14:41:28.335234+0000 mgr.x (mgr.34562) 3022 : cluster [DBG] pgmap v1884: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:41:31.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:41:30 smithi132 bash[27079]: cluster 2020-07-16T14:41:30.335812+0000 mgr.x (mgr.34562) 3023 : cluster [DBG] pgmap v1885: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:41:31.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:41:30 smithi188 bash[23329]: cluster 2020-07-16T14:41:30.335812+0000 mgr.x (mgr.34562) 3023 : cluster [DBG] pgmap v1885: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:41:31.872 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:41:32.131 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:41:32.131 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (64m) 9m ago 67m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:41:32.131 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (67m) 9m ago 67m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:41:32.132 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (64m) 9m ago 70m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:41:32.132 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (64m) 9m ago 71m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:41:32.132 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 9m ago 71m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:41:32.132 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (70m) 9m ago 70m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:41:32.132 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (70m) 9m ago 70m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:41:32.133 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (67m) 9m ago 67m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:41:32.133 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (67m) 9m ago 67m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:41:32.133 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (69m) 9m ago 69m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:41:32.133 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (69m) 9m ago 69m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:41:32.134 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (69m) 9m ago 69m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:41:32.134 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (69m) 9m ago 69m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:41:32.134 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (68m) 9m ago 68m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:41:32.134 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (68m) 9m ago 68m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:41:32.134 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (68m) 9m ago 68m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:41:32.135 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (67m) 9m ago 67m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:41:32.135 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (66m) 9m ago 67m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:41:32.429 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:41:32.430 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:41:32.430 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:41:32.430 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:41:32.430 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:41:32.431 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:41:32.431 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:41:32.431 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:41:32.431 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:41:32.431 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:41:32.432 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:41:32.432 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:41:32.432 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:41:32.432 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:41:32.432 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:41:32.433 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:41:32.433 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:41:33.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:41:33 smithi188 bash[23329]: audit 2020-07-16T14:41:31.859590+0000 mgr.x (mgr.34562) 3024 : audit [DBG] from='client.26836 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:41:33.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:41:33 smithi188 bash[23329]: audit 2020-07-16T14:41:32.127008+0000 mgr.x (mgr.34562) 3025 : audit [DBG] from='client.26842 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:41:33.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:41:33 smithi188 bash[23329]: cluster 2020-07-16T14:41:32.336377+0000 mgr.x (mgr.34562) 3026 : cluster [DBG] pgmap v1886: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:41:33.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:41:33 smithi188 bash[23329]: audit 2020-07-16T14:41:32.428713+0000 mon.c (mon.1) 237 : audit [DBG] from='client.? 172.21.15.132:0/3650045211' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:41:33.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:41:33 smithi132 bash[27079]: audit 2020-07-16T14:41:31.859590+0000 mgr.x (mgr.34562) 3024 : audit [DBG] from='client.26836 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:41:33.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:41:33 smithi132 bash[27079]: audit 2020-07-16T14:41:32.127008+0000 mgr.x (mgr.34562) 3025 : audit [DBG] from='client.26842 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:41:33.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:41:33 smithi132 bash[27079]: cluster 2020-07-16T14:41:32.336377+0000 mgr.x (mgr.34562) 3026 : cluster [DBG] pgmap v1886: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:41:33.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:41:33 smithi132 bash[27079]: audit 2020-07-16T14:41:32.428713+0000 mon.c (mon.1) 237 : audit [DBG] from='client.? 172.21.15.132:0/3650045211' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:41:35.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:41:35 smithi188 bash[23329]: cluster 2020-07-16T14:41:34.336714+0000 mgr.x (mgr.34562) 3027 : cluster [DBG] pgmap v1887: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:41:35.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:41:35 smithi132 bash[27079]: cluster 2020-07-16T14:41:34.336714+0000 mgr.x (mgr.34562) 3027 : cluster [DBG] pgmap v1887: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:41:37.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:41:37 smithi188 bash[23329]: cluster 2020-07-16T14:41:36.337118+0000 mgr.x (mgr.34562) 3028 : cluster [DBG] pgmap v1888: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:41:37.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:41:37 smithi188 bash[23329]: audit 2020-07-16T14:41:37.139758+0000 mon.b (mon.2) 736 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:41:37.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:41:37 smithi132 bash[27079]: cluster 2020-07-16T14:41:36.337118+0000 mgr.x (mgr.34562) 3028 : cluster [DBG] pgmap v1888: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:41:37.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:41:37 smithi132 bash[27079]: audit 2020-07-16T14:41:37.139758+0000 mon.b (mon.2) 736 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:41:38.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:41:38 smithi188 bash[23329]: cephadm 2020-07-16T14:41:37.140478+0000 mgr.x (mgr.34562) 3029 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:41:38.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:41:38 smithi188 bash[23329]: cephadm 2020-07-16T14:41:37.140878+0000 mgr.x (mgr.34562) 3030 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:41:38.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:41:38 smithi132 bash[27079]: cephadm 2020-07-16T14:41:37.140478+0000 mgr.x (mgr.34562) 3029 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:41:38.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:41:38 smithi132 bash[27079]: cephadm 2020-07-16T14:41:37.140878+0000 mgr.x (mgr.34562) 3030 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:41:39.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:41:39 smithi188 bash[23329]: cluster 2020-07-16T14:41:38.337659+0000 mgr.x (mgr.34562) 3031 : cluster [DBG] pgmap v1889: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:41:39.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:41:39 smithi132 bash[27079]: cluster 2020-07-16T14:41:38.337659+0000 mgr.x (mgr.34562) 3031 : cluster [DBG] pgmap v1889: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:41:41.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:41:40 smithi132 bash[27079]: cluster 2020-07-16T14:41:40.338151+0000 mgr.x (mgr.34562) 3032 : cluster [DBG] pgmap v1890: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:41:41.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:41:40 smithi188 bash[23329]: cluster 2020-07-16T14:41:40.338151+0000 mgr.x (mgr.34562) 3032 : cluster [DBG] pgmap v1890: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:41:43.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:41:43 smithi188 bash[23329]: cluster 2020-07-16T14:41:42.338724+0000 mgr.x (mgr.34562) 3033 : cluster [DBG] pgmap v1891: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:41:43.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:41:43 smithi132 bash[27079]: cluster 2020-07-16T14:41:42.338724+0000 mgr.x (mgr.34562) 3033 : cluster [DBG] pgmap v1891: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:41:45.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:41:45 smithi188 bash[23329]: cluster 2020-07-16T14:41:44.339102+0000 mgr.x (mgr.34562) 3034 : cluster [DBG] pgmap v1892: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:41:45.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:41:45 smithi132 bash[27079]: cluster 2020-07-16T14:41:44.339102+0000 mgr.x (mgr.34562) 3034 : cluster [DBG] pgmap v1892: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:41:47.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:41:47 smithi188 bash[23329]: cluster 2020-07-16T14:41:46.339484+0000 mgr.x (mgr.34562) 3035 : cluster [DBG] pgmap v1893: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:41:47.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:41:47 smithi132 bash[27079]: cluster 2020-07-16T14:41:46.339484+0000 mgr.x (mgr.34562) 3035 : cluster [DBG] pgmap v1893: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:41:49.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:41:49 smithi188 bash[23329]: cluster 2020-07-16T14:41:48.339860+0000 mgr.x (mgr.34562) 3036 : cluster [DBG] pgmap v1894: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:41:49.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:41:49 smithi132 bash[27079]: cluster 2020-07-16T14:41:48.339860+0000 mgr.x (mgr.34562) 3036 : cluster [DBG] pgmap v1894: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:41:51.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:41:50 smithi188 bash[23329]: cluster 2020-07-16T14:41:50.340337+0000 mgr.x (mgr.34562) 3037 : cluster [DBG] pgmap v1895: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:41:51.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:41:50 smithi132 bash[27079]: cluster 2020-07-16T14:41:50.340337+0000 mgr.x (mgr.34562) 3037 : cluster [DBG] pgmap v1895: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:41:52.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:41:52 smithi132 bash[27079]: audit 2020-07-16T14:41:52.154738+0000 mon.b (mon.2) 737 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:41:52.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:41:52 smithi188 bash[23329]: audit 2020-07-16T14:41:52.154738+0000 mon.b (mon.2) 737 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:41:53.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:41:53 smithi132 bash[27079]: cephadm 2020-07-16T14:41:52.155479+0000 mgr.x (mgr.34562) 3038 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:41:53.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:41:53 smithi132 bash[27079]: cephadm 2020-07-16T14:41:52.155899+0000 mgr.x (mgr.34562) 3039 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:41:53.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:41:53 smithi132 bash[27079]: cluster 2020-07-16T14:41:52.340878+0000 mgr.x (mgr.34562) 3040 : cluster [DBG] pgmap v1896: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:41:53.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:41:53 smithi188 bash[23329]: cephadm 2020-07-16T14:41:52.155479+0000 mgr.x (mgr.34562) 3038 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:41:53.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:41:53 smithi188 bash[23329]: cephadm 2020-07-16T14:41:52.155899+0000 mgr.x (mgr.34562) 3039 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:41:53.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:41:53 smithi188 bash[23329]: cluster 2020-07-16T14:41:52.340878+0000 mgr.x (mgr.34562) 3040 : cluster [DBG] pgmap v1896: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:41:55.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:41:55 smithi188 bash[23329]: cluster 2020-07-16T14:41:54.341426+0000 mgr.x (mgr.34562) 3041 : cluster [DBG] pgmap v1897: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:41:55.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:41:55 smithi132 bash[27079]: cluster 2020-07-16T14:41:54.341426+0000 mgr.x (mgr.34562) 3041 : cluster [DBG] pgmap v1897: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:41:57.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:41:57 smithi188 bash[23329]: cluster 2020-07-16T14:41:56.341789+0000 mgr.x (mgr.34562) 3042 : cluster [DBG] pgmap v1898: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:41:57.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:41:57 smithi132 bash[27079]: cluster 2020-07-16T14:41:56.341789+0000 mgr.x (mgr.34562) 3042 : cluster [DBG] pgmap v1898: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:41:59.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:41:59 smithi188 bash[23329]: cluster 2020-07-16T14:41:58.342207+0000 mgr.x (mgr.34562) 3043 : cluster [DBG] pgmap v1899: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:41:59.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:41:59 smithi132 bash[27079]: cluster 2020-07-16T14:41:58.342207+0000 mgr.x (mgr.34562) 3043 : cluster [DBG] pgmap v1899: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:42:01.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:00 smithi188 bash[23329]: cluster 2020-07-16T14:42:00.342551+0000 mgr.x (mgr.34562) 3044 : cluster [DBG] pgmap v1900: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:42:01.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:00 smithi132 bash[27079]: cluster 2020-07-16T14:42:00.342551+0000 mgr.x (mgr.34562) 3044 : cluster [DBG] pgmap v1900: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:42:02.731 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:42:02.990 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:42:02.990 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (64m) 10m ago 67m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:42:02.990 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (67m) 10m ago 67m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:42:02.991 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (65m) 10m ago 70m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:42:02.991 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (64m) 10m ago 72m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:42:02.991 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 10m ago 72m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:42:02.991 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (70m) 10m ago 70m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:42:02.992 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (71m) 10m ago 71m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:42:02.992 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (68m) 10m ago 68m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:42:02.992 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (68m) 10m ago 68m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:42:02.993 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (70m) 10m ago 70m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:42:02.993 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (70m) 10m ago 70m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:42:02.993 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (69m) 10m ago 69m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:42:02.993 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (69m) 10m ago 69m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:42:02.994 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (69m) 10m ago 69m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:42:02.994 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (68m) 10m ago 69m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:42:02.994 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (68m) 10m ago 68m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:42:02.994 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (68m) 10m ago 68m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:42:02.994 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (67m) 10m ago 68m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:42:03.285 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:42:03.286 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:42:03.286 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:42:03.286 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:42:03.286 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:42:03.286 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:42:03.287 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:42:03.287 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:42:03.287 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:42:03.287 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:42:03.287 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:42:03.288 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:42:03.288 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:42:03.288 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:42:03.288 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:42:03.288 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:42:03.289 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:42:03.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:03 smithi188 bash[23329]: cluster 2020-07-16T14:42:02.342936+0000 mgr.x (mgr.34562) 3045 : cluster [DBG] pgmap v1901: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:42:03.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:03 smithi188 bash[23329]: audit 2020-07-16T14:42:03.284547+0000 mon.c (mon.1) 238 : audit [DBG] from='client.? 172.21.15.132:0/3707695004' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:42:03.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:03 smithi132 bash[27079]: cluster 2020-07-16T14:42:02.342936+0000 mgr.x (mgr.34562) 3045 : cluster [DBG] pgmap v1901: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:42:03.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:03 smithi132 bash[27079]: audit 2020-07-16T14:42:03.284547+0000 mon.c (mon.1) 238 : audit [DBG] from='client.? 172.21.15.132:0/3707695004' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:42:04.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:04 smithi188 bash[23329]: audit 2020-07-16T14:42:02.716077+0000 mgr.x (mgr.34562) 3046 : audit [DBG] from='client.26854 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:42:04.736 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:04 smithi188 bash[23329]: audit 2020-07-16T14:42:02.985567+0000 mgr.x (mgr.34562) 3047 : audit [DBG] from='client.26860 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:42:04.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:04 smithi132 bash[27079]: audit 2020-07-16T14:42:02.716077+0000 mgr.x (mgr.34562) 3046 : audit [DBG] from='client.26854 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:42:04.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:04 smithi132 bash[27079]: audit 2020-07-16T14:42:02.985567+0000 mgr.x (mgr.34562) 3047 : audit [DBG] from='client.26860 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:42:05.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:05 smithi188 bash[23329]: cluster 2020-07-16T14:42:04.343425+0000 mgr.x (mgr.34562) 3048 : cluster [DBG] pgmap v1902: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:42:05.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:05 smithi132 bash[27079]: cluster 2020-07-16T14:42:04.343425+0000 mgr.x (mgr.34562) 3048 : cluster [DBG] pgmap v1902: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:42:07.669 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:07 smithi188 bash[23329]: cluster 2020-07-16T14:42:06.343841+0000 mgr.x (mgr.34562) 3049 : cluster [DBG] pgmap v1903: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:42:07.669 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:07 smithi188 bash[23329]: audit 2020-07-16T14:42:07.162533+0000 mon.b (mon.2) 738 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T14:42:07.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:07 smithi188 bash[23329]: audit 2020-07-16T14:42:07.162802+0000 mon.b (mon.2) 739 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T14:42:07.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:07 smithi132 bash[27079]: cluster 2020-07-16T14:42:06.343841+0000 mgr.x (mgr.34562) 3049 : cluster [DBG] pgmap v1903: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:42:07.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:07 smithi132 bash[27079]: audit 2020-07-16T14:42:07.162533+0000 mon.b (mon.2) 738 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T14:42:07.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:07 smithi132 bash[27079]: audit 2020-07-16T14:42:07.162802+0000 mon.b (mon.2) 739 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T14:42:09.651 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:09 smithi188 bash[23329]: cluster 2020-07-16T14:42:08.344209+0000 mgr.x (mgr.34562) 3050 : cluster [DBG] pgmap v1904: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:42:09.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:09 smithi132 bash[27079]: cluster 2020-07-16T14:42:08.344209+0000 mgr.x (mgr.34562) 3050 : cluster [DBG] pgmap v1904: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:42:10.500 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:10 smithi132 bash[27079]: audit 2020-07-16T14:42:09.647579+0000 mon.b (mon.2) 740 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:42:09.646084\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646142\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646176\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646203\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646400\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646511\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646629\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646728\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646761\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:42:09.646830\", \"last_device_update\": \"2020-07-16T14:33:41.233618\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:33:38.093826\"}"}]: dispatch 2020-07-16T14:42:10.500 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:10 smithi132 bash[27079]: audit 2020-07-16T14:42:09.648264+0000 mon.c (mon.1) 239 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:42:09.646084\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646142\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646176\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646203\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646400\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646511\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646629\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646728\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646761\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:42:09.646830\", \"last_device_update\": \"2020-07-16T14:33:41.233618\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:33:38.093826\"}"}]: dispatch 2020-07-16T14:42:10.501 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:10 smithi132 bash[27079]: audit 2020-07-16T14:42:09.650971+0000 mon.c (mon.1) 240 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:42:09.646084\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646142\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646176\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646203\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646400\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646511\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646629\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646728\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646761\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:42:09.646830\", \"last_device_update\": \"2020-07-16T14:33:41.233618\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:33:38.093826\"}"}]': finished 2020-07-16T14:42:10.501 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:10 smithi132 bash[27079]: audit 2020-07-16T14:42:09.732449+0000 mon.b (mon.2) 741 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.730914\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.730986\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731017\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731176\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731278\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731409\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731512\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731546\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731591\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:42:09.731658\", \"last_device_update\": \"2020-07-16T14:34:46.715995\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:33:38.094344\"}"}]: dispatch 2020-07-16T14:42:10.502 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:10 smithi132 bash[27079]: audit 2020-07-16T14:42:09.733027+0000 mon.c (mon.1) 241 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.730914\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.730986\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731017\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731176\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731278\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731409\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731512\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731546\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731591\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:42:09.731658\", \"last_device_update\": \"2020-07-16T14:34:46.715995\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:33:38.094344\"}"}]: dispatch 2020-07-16T14:42:10.502 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:10 smithi132 bash[27079]: audit 2020-07-16T14:42:09.735919+0000 mon.c (mon.1) 242 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.730914\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.730986\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731017\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731176\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731278\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731409\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731512\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731546\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731591\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:42:09.731658\", \"last_device_update\": \"2020-07-16T14:34:46.715995\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:33:38.094344\"}"}]': finished 2020-07-16T14:42:10.502 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:10 smithi132 bash[27079]: audit 2020-07-16T14:42:09.738223+0000 mon.b (mon.2) 742 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:42:10.502 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:10 smithi132 bash[27079]: audit 2020-07-16T14:42:09.739192+0000 mon.b (mon.2) 743 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:42:10.503 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:10 smithi132 bash[27079]: audit 2020-07-16T14:42:09.740023+0000 mon.b (mon.2) 744 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:42:10.503 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:10 smithi132 bash[27079]: audit 2020-07-16T14:42:09.740990+0000 mon.b (mon.2) 745 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:42:10.503 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:10 smithi132 bash[27079]: audit 2020-07-16T14:42:09.741873+0000 mon.b (mon.2) 746 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:42:10.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:10 smithi188 bash[23329]: audit 2020-07-16T14:42:09.647579+0000 mon.b (mon.2) 740 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:42:09.646084\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646142\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646176\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646203\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646400\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646511\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646629\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646728\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646761\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:42:09.646830\", \"last_device_update\": \"2020-07-16T14:33:41.233618\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:33:38.093826\"}"}]: dispatch 2020-07-16T14:42:10.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:10 smithi188 bash[23329]: audit 2020-07-16T14:42:09.648264+0000 mon.c (mon.1) 239 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:42:09.646084\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646142\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646176\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646203\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646400\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646511\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646629\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646728\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646761\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:42:09.646830\", \"last_device_update\": \"2020-07-16T14:33:41.233618\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:33:38.093826\"}"}]: dispatch 2020-07-16T14:42:10.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:10 smithi188 bash[23329]: audit 2020-07-16T14:42:09.650971+0000 mon.c (mon.1) 240 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:42:09.646084\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646142\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646176\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646203\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646400\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646511\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646629\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646728\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646761\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:42:09.646830\", \"last_device_update\": \"2020-07-16T14:33:41.233618\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:33:38.093826\"}"}]': finished 2020-07-16T14:42:10.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:10 smithi188 bash[23329]: audit 2020-07-16T14:42:09.732449+0000 mon.b (mon.2) 741 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.730914\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.730986\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731017\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731176\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731278\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731409\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731512\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731546\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731591\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:42:09.731658\", \"last_device_update\": \"2020-07-16T14:34:46.715995\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:33:38.094344\"}"}]: dispatch 2020-07-16T14:42:10.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:10 smithi188 bash[23329]: audit 2020-07-16T14:42:09.733027+0000 mon.c (mon.1) 241 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.730914\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.730986\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731017\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731176\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731278\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731409\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731512\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731546\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731591\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:42:09.731658\", \"last_device_update\": \"2020-07-16T14:34:46.715995\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:33:38.094344\"}"}]: dispatch 2020-07-16T14:42:10.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:10 smithi188 bash[23329]: audit 2020-07-16T14:42:09.735919+0000 mon.c (mon.1) 242 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.730914\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.730986\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731017\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731176\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731278\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731409\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731512\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731546\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731591\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:42:09.731658\", \"last_device_update\": \"2020-07-16T14:34:46.715995\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:33:38.094344\"}"}]': finished 2020-07-16T14:42:10.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:10 smithi188 bash[23329]: audit 2020-07-16T14:42:09.738223+0000 mon.b (mon.2) 742 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:42:10.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:10 smithi188 bash[23329]: audit 2020-07-16T14:42:09.739192+0000 mon.b (mon.2) 743 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:42:10.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:10 smithi188 bash[23329]: audit 2020-07-16T14:42:09.740023+0000 mon.b (mon.2) 744 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:42:10.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:10 smithi188 bash[23329]: audit 2020-07-16T14:42:09.740990+0000 mon.b (mon.2) 745 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:42:10.675 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:10 smithi188 bash[23329]: audit 2020-07-16T14:42:09.741873+0000 mon.b (mon.2) 746 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:42:11.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:11 smithi188 bash[23329]: audit 2020-07-16T14:42:09.738511+0000 mgr.x (mgr.34562) 3051 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:42:11.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:11 smithi188 bash[23329]: audit 2020-07-16T14:42:09.739477+0000 mgr.x (mgr.34562) 3052 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:42:11.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:11 smithi188 bash[23329]: audit 2020-07-16T14:42:09.740242+0000 mgr.x (mgr.34562) 3053 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:42:11.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:11 smithi188 bash[23329]: cephadm 2020-07-16T14:42:09.740714+0000 mgr.x (mgr.34562) 3054 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:42:11.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:11 smithi188 bash[23329]: cephadm 2020-07-16T14:42:09.741552+0000 mgr.x (mgr.34562) 3055 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:42:11.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:11 smithi188 bash[23329]: cephadm 2020-07-16T14:42:09.742363+0000 mgr.x (mgr.34562) 3056 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:42:11.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:11 smithi188 bash[23329]: cephadm 2020-07-16T14:42:09.742445+0000 mgr.x (mgr.34562) 3057 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:42:11.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:11 smithi188 bash[23329]: cluster 2020-07-16T14:42:10.344530+0000 mgr.x (mgr.34562) 3058 : cluster [DBG] pgmap v1905: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:42:11.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:11 smithi132 bash[27079]: audit 2020-07-16T14:42:09.738511+0000 mgr.x (mgr.34562) 3051 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:42:11.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:11 smithi132 bash[27079]: audit 2020-07-16T14:42:09.739477+0000 mgr.x (mgr.34562) 3052 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:42:11.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:11 smithi132 bash[27079]: audit 2020-07-16T14:42:09.740242+0000 mgr.x (mgr.34562) 3053 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:42:11.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:11 smithi132 bash[27079]: cephadm 2020-07-16T14:42:09.740714+0000 mgr.x (mgr.34562) 3054 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:42:11.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:11 smithi132 bash[27079]: cephadm 2020-07-16T14:42:09.741552+0000 mgr.x (mgr.34562) 3055 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:42:11.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:11 smithi132 bash[27079]: cephadm 2020-07-16T14:42:09.742363+0000 mgr.x (mgr.34562) 3056 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:42:11.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:11 smithi132 bash[27079]: cephadm 2020-07-16T14:42:09.742445+0000 mgr.x (mgr.34562) 3057 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:42:11.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:11 smithi132 bash[27079]: cluster 2020-07-16T14:42:10.344530+0000 mgr.x (mgr.34562) 3058 : cluster [DBG] pgmap v1905: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:42:13.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:13 smithi188 bash[23329]: cluster 2020-07-16T14:42:12.345018+0000 mgr.x (mgr.34562) 3059 : cluster [DBG] pgmap v1906: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:42:13.675 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:13 smithi188 bash[23329]: audit 2020-07-16T14:42:12.428490+0000 mon.b (mon.2) 747 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:42:13.675 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:13 smithi188 bash[23329]: cephadm 2020-07-16T14:42:12.429111+0000 mgr.x (mgr.34562) 3060 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:42:13.675 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:13 smithi188 bash[23329]: cephadm 2020-07-16T14:42:12.429554+0000 mgr.x (mgr.34562) 3061 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:42:13.782 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:13 smithi132 bash[27079]: cluster 2020-07-16T14:42:12.345018+0000 mgr.x (mgr.34562) 3059 : cluster [DBG] pgmap v1906: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:42:13.783 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:13 smithi132 bash[27079]: audit 2020-07-16T14:42:12.428490+0000 mon.b (mon.2) 747 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:42:13.783 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:13 smithi132 bash[27079]: cephadm 2020-07-16T14:42:12.429111+0000 mgr.x (mgr.34562) 3060 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:42:13.783 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:13 smithi132 bash[27079]: cephadm 2020-07-16T14:42:12.429554+0000 mgr.x (mgr.34562) 3061 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:42:15.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:15 smithi188 bash[23329]: cluster 2020-07-16T14:42:14.345544+0000 mgr.x (mgr.34562) 3062 : cluster [DBG] pgmap v1907: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:42:15.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:15 smithi132 bash[27079]: cluster 2020-07-16T14:42:14.345544+0000 mgr.x (mgr.34562) 3062 : cluster [DBG] pgmap v1907: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:42:17.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:17 smithi132 bash[27079]: cluster 2020-07-16T14:42:16.345943+0000 mgr.x (mgr.34562) 3063 : cluster [DBG] pgmap v1908: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:42:17.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:17 smithi188 bash[23329]: cluster 2020-07-16T14:42:16.345943+0000 mgr.x (mgr.34562) 3063 : cluster [DBG] pgmap v1908: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:42:19.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:19 smithi132 bash[27079]: cluster 2020-07-16T14:42:18.346560+0000 mgr.x (mgr.34562) 3064 : cluster [DBG] pgmap v1909: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:42:19.927 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:19 smithi188 bash[23329]: cluster 2020-07-16T14:42:18.346560+0000 mgr.x (mgr.34562) 3064 : cluster [DBG] pgmap v1909: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:42:21.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:20 smithi188 bash[23329]: cluster 2020-07-16T14:42:20.347054+0000 mgr.x (mgr.34562) 3065 : cluster [DBG] pgmap v1910: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:42:21.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:20 smithi132 bash[27079]: cluster 2020-07-16T14:42:20.347054+0000 mgr.x (mgr.34562) 3065 : cluster [DBG] pgmap v1910: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:42:23.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:23 smithi188 bash[23329]: cluster 2020-07-16T14:42:22.347516+0000 mgr.x (mgr.34562) 3066 : cluster [DBG] pgmap v1911: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:42:23.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:23 smithi132 bash[27079]: cluster 2020-07-16T14:42:22.347516+0000 mgr.x (mgr.34562) 3066 : cluster [DBG] pgmap v1911: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:42:25.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:25 smithi188 bash[23329]: cluster 2020-07-16T14:42:24.347888+0000 mgr.x (mgr.34562) 3067 : cluster [DBG] pgmap v1912: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:42:25.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:25 smithi132 bash[27079]: cluster 2020-07-16T14:42:24.347888+0000 mgr.x (mgr.34562) 3067 : cluster [DBG] pgmap v1912: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:42:27.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:27 smithi188 bash[23329]: cluster 2020-07-16T14:42:26.348186+0000 mgr.x (mgr.34562) 3068 : cluster [DBG] pgmap v1913: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:42:27.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:27 smithi132 bash[27079]: cluster 2020-07-16T14:42:26.348186+0000 mgr.x (mgr.34562) 3068 : cluster [DBG] pgmap v1913: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:42:28.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:28 smithi188 bash[23329]: audit 2020-07-16T14:42:27.444994+0000 mon.b (mon.2) 748 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:42:28.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:28 smithi188 bash[23329]: cephadm 2020-07-16T14:42:27.445676+0000 mgr.x (mgr.34562) 3069 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:42:28.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:28 smithi188 bash[23329]: cephadm 2020-07-16T14:42:27.446157+0000 mgr.x (mgr.34562) 3070 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:42:28.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:28 smithi132 bash[27079]: audit 2020-07-16T14:42:27.444994+0000 mon.b (mon.2) 748 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:42:28.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:28 smithi132 bash[27079]: cephadm 2020-07-16T14:42:27.445676+0000 mgr.x (mgr.34562) 3069 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:42:28.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:28 smithi132 bash[27079]: cephadm 2020-07-16T14:42:27.446157+0000 mgr.x (mgr.34562) 3070 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:42:29.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:29 smithi188 bash[23329]: cluster 2020-07-16T14:42:28.348549+0000 mgr.x (mgr.34562) 3071 : cluster [DBG] pgmap v1914: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:42:29.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:29 smithi132 bash[27079]: cluster 2020-07-16T14:42:28.348549+0000 mgr.x (mgr.34562) 3071 : cluster [DBG] pgmap v1914: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:42:31.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:30 smithi188 bash[23329]: cluster 2020-07-16T14:42:30.349039+0000 mgr.x (mgr.34562) 3072 : cluster [DBG] pgmap v1915: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:42:31.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:30 smithi132 bash[27079]: cluster 2020-07-16T14:42:30.349039+0000 mgr.x (mgr.34562) 3072 : cluster [DBG] pgmap v1915: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:42:33.586 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:42:33.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:33 smithi188 bash[23329]: cluster 2020-07-16T14:42:32.349457+0000 mgr.x (mgr.34562) 3073 : cluster [DBG] pgmap v1916: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:42:33.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:33 smithi132 bash[27079]: cluster 2020-07-16T14:42:32.349457+0000 mgr.x (mgr.34562) 3073 : cluster [DBG] pgmap v1916: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:42:33.845 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:42:33.845 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (65m) 24s ago 68m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:42:33.845 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (68m) 24s ago 68m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:42:33.846 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (65m) 24s ago 71m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:42:33.846 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (65m) 24s ago 72m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:42:33.846 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 24s ago 72m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:42:33.846 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (71m) 24s ago 71m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:42:33.846 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (71m) 24s ago 71m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:42:33.847 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (68m) 24s ago 68m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:42:33.847 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (68m) 24s ago 68m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:42:33.847 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (70m) 24s ago 70m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:42:33.847 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (70m) 24s ago 70m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:42:33.847 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (70m) 24s ago 70m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:42:33.848 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (70m) 24s ago 70m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:42:33.848 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (69m) 24s ago 69m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:42:33.848 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (69m) 24s ago 69m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:42:33.848 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (69m) 24s ago 69m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:42:33.848 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (68m) 24s ago 68m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:42:33.849 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (67m) 24s ago 68m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:42:34.141 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:42:34.141 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:42:34.141 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:42:34.141 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:42:34.142 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:42:34.142 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:42:34.142 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:42:34.142 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:42:34.142 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:42:34.143 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:42:34.143 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:42:34.143 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:42:34.143 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:42:34.143 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:42:34.144 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:42:34.144 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:42:34.144 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:42:34.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:34 smithi188 bash[23329]: audit 2020-07-16T14:42:34.139886+0000 mon.c (mon.1) 243 : audit [DBG] from='client.? 172.21.15.132:0/3626175833' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:42:34.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:34 smithi132 bash[27079]: audit 2020-07-16T14:42:34.139886+0000 mon.c (mon.1) 243 : audit [DBG] from='client.? 172.21.15.132:0/3626175833' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:42:35.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:35 smithi188 bash[23329]: audit 2020-07-16T14:42:33.574641+0000 mgr.x (mgr.34562) 3074 : audit [DBG] from='client.26872 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:42:35.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:35 smithi188 bash[23329]: audit 2020-07-16T14:42:33.840927+0000 mgr.x (mgr.34562) 3075 : audit [DBG] from='client.26878 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:42:35.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:35 smithi188 bash[23329]: cluster 2020-07-16T14:42:34.349847+0000 mgr.x (mgr.34562) 3076 : cluster [DBG] pgmap v1917: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:42:35.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:35 smithi132 bash[27079]: audit 2020-07-16T14:42:33.574641+0000 mgr.x (mgr.34562) 3074 : audit [DBG] from='client.26872 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:42:35.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:35 smithi132 bash[27079]: audit 2020-07-16T14:42:33.840927+0000 mgr.x (mgr.34562) 3075 : audit [DBG] from='client.26878 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:42:35.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:35 smithi132 bash[27079]: cluster 2020-07-16T14:42:34.349847+0000 mgr.x (mgr.34562) 3076 : cluster [DBG] pgmap v1917: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:42:37.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:37 smithi188 bash[23329]: cluster 2020-07-16T14:42:36.350171+0000 mgr.x (mgr.34562) 3077 : cluster [DBG] pgmap v1918: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:42:37.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:37 smithi132 bash[27079]: cluster 2020-07-16T14:42:36.350171+0000 mgr.x (mgr.34562) 3077 : cluster [DBG] pgmap v1918: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:42:39.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:39 smithi188 bash[23329]: cluster 2020-07-16T14:42:38.350544+0000 mgr.x (mgr.34562) 3078 : cluster [DBG] pgmap v1919: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:42:39.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:39 smithi132 bash[27079]: cluster 2020-07-16T14:42:38.350544+0000 mgr.x (mgr.34562) 3078 : cluster [DBG] pgmap v1919: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:42:41.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:40 smithi188 bash[23329]: cluster 2020-07-16T14:42:40.351000+0000 mgr.x (mgr.34562) 3079 : cluster [DBG] pgmap v1920: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:42:41.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:40 smithi132 bash[27079]: cluster 2020-07-16T14:42:40.351000+0000 mgr.x (mgr.34562) 3079 : cluster [DBG] pgmap v1920: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:42:43.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:43 smithi188 bash[23329]: cluster 2020-07-16T14:42:42.351426+0000 mgr.x (mgr.34562) 3080 : cluster [DBG] pgmap v1921: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:42:43.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:43 smithi188 bash[23329]: audit 2020-07-16T14:42:42.461659+0000 mon.b (mon.2) 749 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:42:43.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:43 smithi188 bash[23329]: cephadm 2020-07-16T14:42:42.462406+0000 mgr.x (mgr.34562) 3081 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:42:43.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:43 smithi188 bash[23329]: cephadm 2020-07-16T14:42:42.462492+0000 mgr.x (mgr.34562) 3082 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:42:43.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:43 smithi132 bash[27079]: cluster 2020-07-16T14:42:42.351426+0000 mgr.x (mgr.34562) 3080 : cluster [DBG] pgmap v1921: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:42:43.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:43 smithi132 bash[27079]: audit 2020-07-16T14:42:42.461659+0000 mon.b (mon.2) 749 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:42:43.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:43 smithi132 bash[27079]: cephadm 2020-07-16T14:42:42.462406+0000 mgr.x (mgr.34562) 3081 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:42:43.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:43 smithi132 bash[27079]: cephadm 2020-07-16T14:42:42.462492+0000 mgr.x (mgr.34562) 3082 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:42:45.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:45 smithi188 bash[23329]: cluster 2020-07-16T14:42:44.351741+0000 mgr.x (mgr.34562) 3083 : cluster [DBG] pgmap v1922: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:42:45.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:45 smithi132 bash[27079]: cluster 2020-07-16T14:42:44.351741+0000 mgr.x (mgr.34562) 3083 : cluster [DBG] pgmap v1922: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:42:47.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:47 smithi188 bash[23329]: cluster 2020-07-16T14:42:46.352063+0000 mgr.x (mgr.34562) 3084 : cluster [DBG] pgmap v1923: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:42:47.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:47 smithi132 bash[27079]: cluster 2020-07-16T14:42:46.352063+0000 mgr.x (mgr.34562) 3084 : cluster [DBG] pgmap v1923: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:42:49.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:49 smithi188 bash[23329]: cluster 2020-07-16T14:42:48.352549+0000 mgr.x (mgr.34562) 3085 : cluster [DBG] pgmap v1924: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:42:49.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:49 smithi132 bash[27079]: cluster 2020-07-16T14:42:48.352549+0000 mgr.x (mgr.34562) 3085 : cluster [DBG] pgmap v1924: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:42:51.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:50 smithi188 bash[23329]: cluster 2020-07-16T14:42:50.353030+0000 mgr.x (mgr.34562) 3086 : cluster [DBG] pgmap v1925: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:42:51.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:50 smithi132 bash[27079]: cluster 2020-07-16T14:42:50.353030+0000 mgr.x (mgr.34562) 3086 : cluster [DBG] pgmap v1925: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:42:53.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:53 smithi188 bash[23329]: cluster 2020-07-16T14:42:52.353587+0000 mgr.x (mgr.34562) 3087 : cluster [DBG] pgmap v1926: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:42:53.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:53 smithi132 bash[27079]: cluster 2020-07-16T14:42:52.353587+0000 mgr.x (mgr.34562) 3087 : cluster [DBG] pgmap v1926: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:42:55.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:55 smithi188 bash[23329]: cluster 2020-07-16T14:42:54.353911+0000 mgr.x (mgr.34562) 3088 : cluster [DBG] pgmap v1927: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:42:55.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:55 smithi132 bash[27079]: cluster 2020-07-16T14:42:54.353911+0000 mgr.x (mgr.34562) 3088 : cluster [DBG] pgmap v1927: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:42:57.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:57 smithi188 bash[23329]: cluster 2020-07-16T14:42:56.354266+0000 mgr.x (mgr.34562) 3089 : cluster [DBG] pgmap v1928: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:42:57.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:57 smithi132 bash[27079]: cluster 2020-07-16T14:42:56.354266+0000 mgr.x (mgr.34562) 3089 : cluster [DBG] pgmap v1928: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:42:58.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:58 smithi132 bash[27079]: audit 2020-07-16T14:42:57.472892+0000 mon.b (mon.2) 750 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:42:58.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:58 smithi132 bash[27079]: cephadm 2020-07-16T14:42:57.473584+0000 mgr.x (mgr.34562) 3090 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:42:58.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:58 smithi132 bash[27079]: cephadm 2020-07-16T14:42:57.474006+0000 mgr.x (mgr.34562) 3091 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:42:58.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:58 smithi188 bash[23329]: audit 2020-07-16T14:42:57.472892+0000 mon.b (mon.2) 750 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:42:58.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:58 smithi188 bash[23329]: cephadm 2020-07-16T14:42:57.473584+0000 mgr.x (mgr.34562) 3090 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:42:58.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:58 smithi188 bash[23329]: cephadm 2020-07-16T14:42:57.474006+0000 mgr.x (mgr.34562) 3091 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:42:59.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:42:59 smithi132 bash[27079]: cluster 2020-07-16T14:42:58.354700+0000 mgr.x (mgr.34562) 3092 : cluster [DBG] pgmap v1929: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:42:59.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:42:59 smithi188 bash[23329]: cluster 2020-07-16T14:42:58.354700+0000 mgr.x (mgr.34562) 3092 : cluster [DBG] pgmap v1929: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:43:01.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:43:00 smithi188 bash[23329]: cluster 2020-07-16T14:43:00.355069+0000 mgr.x (mgr.34562) 3093 : cluster [DBG] pgmap v1930: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:43:01.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:43:00 smithi132 bash[27079]: cluster 2020-07-16T14:43:00.355069+0000 mgr.x (mgr.34562) 3093 : cluster [DBG] pgmap v1930: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:43:03.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:43:03 smithi188 bash[23329]: cluster 2020-07-16T14:43:02.355470+0000 mgr.x (mgr.34562) 3094 : cluster [DBG] pgmap v1931: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:43:03.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:43:03 smithi132 bash[27079]: cluster 2020-07-16T14:43:02.355470+0000 mgr.x (mgr.34562) 3094 : cluster [DBG] pgmap v1931: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:43:04.442 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:43:04.707 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:43:04.708 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (65m) 55s ago 68m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:43:04.708 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (68m) 54s ago 68m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:43:04.708 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (66m) 54s ago 71m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:43:04.708 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (65m) 55s ago 73m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:43:04.709 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 55s ago 73m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:43:04.709 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (71m) 54s ago 71m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:43:04.709 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (72m) 55s ago 72m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:43:04.709 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (69m) 55s ago 69m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:43:04.709 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (69m) 54s ago 69m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:43:04.710 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (71m) 55s ago 71m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:43:04.710 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (71m) 55s ago 71m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:43:04.710 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (70m) 55s ago 70m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:43:04.710 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (70m) 55s ago 70m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:43:04.710 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (70m) 54s ago 70m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:43:04.711 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (70m) 54s ago 70m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:43:04.711 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (69m) 54s ago 69m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:43:04.711 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (69m) 54s ago 69m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:43:04.712 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (68m) 54s ago 69m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:43:05.016 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:43:05.017 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:43:05.017 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:43:05.017 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:43:05.017 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:43:05.017 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:43:05.018 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:43:05.018 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:43:05.018 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:43:05.018 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:43:05.018 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:43:05.019 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:43:05.019 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:43:05.019 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:43:05.019 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:43:05.019 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:43:05.020 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:43:05.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:43:05 smithi188 bash[23329]: cluster 2020-07-16T14:43:04.355928+0000 mgr.x (mgr.34562) 3095 : cluster [DBG] pgmap v1932: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:43:05.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:43:05 smithi188 bash[23329]: audit 2020-07-16T14:43:04.429975+0000 mgr.x (mgr.34562) 3096 : audit [DBG] from='client.26890 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:43:05.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:43:05 smithi188 bash[23329]: audit 2020-07-16T14:43:05.015542+0000 mon.c (mon.1) 244 : audit [DBG] from='client.? 172.21.15.132:0/1020499157' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:43:05.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:43:05 smithi132 bash[27079]: cluster 2020-07-16T14:43:04.355928+0000 mgr.x (mgr.34562) 3095 : cluster [DBG] pgmap v1932: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:43:05.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:43:05 smithi132 bash[27079]: audit 2020-07-16T14:43:04.429975+0000 mgr.x (mgr.34562) 3096 : audit [DBG] from='client.26890 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:43:05.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:43:05 smithi132 bash[27079]: audit 2020-07-16T14:43:05.015542+0000 mon.c (mon.1) 244 : audit [DBG] from='client.? 172.21.15.132:0/1020499157' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:43:06.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:43:06 smithi188 bash[23329]: audit 2020-07-16T14:43:04.703450+0000 mgr.x (mgr.34562) 3097 : audit [DBG] from='client.26896 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:43:06.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:43:06 smithi132 bash[27079]: audit 2020-07-16T14:43:04.703450+0000 mgr.x (mgr.34562) 3097 : audit [DBG] from='client.26896 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:43:07.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:43:07 smithi132 bash[27079]: cluster 2020-07-16T14:43:06.356437+0000 mgr.x (mgr.34562) 3098 : cluster [DBG] pgmap v1933: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:43:07.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:43:07 smithi188 bash[23329]: cluster 2020-07-16T14:43:06.356437+0000 mgr.x (mgr.34562) 3098 : cluster [DBG] pgmap v1933: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:43:09.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:43:09 smithi132 bash[27079]: cluster 2020-07-16T14:43:08.356884+0000 mgr.x (mgr.34562) 3099 : cluster [DBG] pgmap v1934: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:43:09.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:43:09 smithi188 bash[23329]: cluster 2020-07-16T14:43:08.356884+0000 mgr.x (mgr.34562) 3099 : cluster [DBG] pgmap v1934: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:43:11.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:43:10 smithi188 bash[23329]: cluster 2020-07-16T14:43:10.357392+0000 mgr.x (mgr.34562) 3100 : cluster [DBG] pgmap v1935: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:43:11.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:43:10 smithi132 bash[27079]: cluster 2020-07-16T14:43:10.357392+0000 mgr.x (mgr.34562) 3100 : cluster [DBG] pgmap v1935: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:43:13.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:43:13 smithi132 bash[27079]: cluster 2020-07-16T14:43:12.357705+0000 mgr.x (mgr.34562) 3101 : cluster [DBG] pgmap v1936: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:43:13.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:43:13 smithi132 bash[27079]: audit 2020-07-16T14:43:12.483103+0000 mon.b (mon.2) 751 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:43:13.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:43:13 smithi132 bash[27079]: audit 2020-07-16T14:43:12.483487+0000 mgr.x (mgr.34562) 3102 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:43:13.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:43:13 smithi132 bash[27079]: audit 2020-07-16T14:43:12.484468+0000 mon.b (mon.2) 752 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:43:13.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:43:13 smithi132 bash[27079]: audit 2020-07-16T14:43:12.484792+0000 mgr.x (mgr.34562) 3103 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:43:13.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:43:13 smithi132 bash[27079]: audit 2020-07-16T14:43:12.485614+0000 mon.b (mon.2) 753 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:43:13.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:43:13 smithi132 bash[27079]: audit 2020-07-16T14:43:12.485896+0000 mgr.x (mgr.34562) 3104 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:43:13.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:43:13 smithi132 bash[27079]: cephadm 2020-07-16T14:43:12.486591+0000 mgr.x (mgr.34562) 3105 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:43:13.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:43:13 smithi132 bash[27079]: audit 2020-07-16T14:43:12.487005+0000 mon.b (mon.2) 754 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:43:13.532 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:43:13 smithi132 bash[27079]: cephadm 2020-07-16T14:43:12.487864+0000 mgr.x (mgr.34562) 3106 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:43:13.532 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:43:13 smithi132 bash[27079]: audit 2020-07-16T14:43:12.488296+0000 mon.b (mon.2) 755 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:43:13.532 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:43:13 smithi132 bash[27079]: cephadm 2020-07-16T14:43:12.489013+0000 mgr.x (mgr.34562) 3107 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:43:13.532 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:43:13 smithi132 bash[27079]: cephadm 2020-07-16T14:43:12.489089+0000 mgr.x (mgr.34562) 3108 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:43:13.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:43:13 smithi188 bash[23329]: cluster 2020-07-16T14:43:12.357705+0000 mgr.x (mgr.34562) 3101 : cluster [DBG] pgmap v1936: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:43:13.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:43:13 smithi188 bash[23329]: audit 2020-07-16T14:43:12.483103+0000 mon.b (mon.2) 751 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:43:13.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:43:13 smithi188 bash[23329]: audit 2020-07-16T14:43:12.483487+0000 mgr.x (mgr.34562) 3102 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:43:13.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:43:13 smithi188 bash[23329]: audit 2020-07-16T14:43:12.484468+0000 mon.b (mon.2) 752 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:43:13.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:43:13 smithi188 bash[23329]: audit 2020-07-16T14:43:12.484792+0000 mgr.x (mgr.34562) 3103 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:43:13.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:43:13 smithi188 bash[23329]: audit 2020-07-16T14:43:12.485614+0000 mon.b (mon.2) 753 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:43:13.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:43:13 smithi188 bash[23329]: audit 2020-07-16T14:43:12.485896+0000 mgr.x (mgr.34562) 3104 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:43:13.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:43:13 smithi188 bash[23329]: cephadm 2020-07-16T14:43:12.486591+0000 mgr.x (mgr.34562) 3105 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:43:13.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:43:13 smithi188 bash[23329]: audit 2020-07-16T14:43:12.487005+0000 mon.b (mon.2) 754 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:43:13.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:43:13 smithi188 bash[23329]: cephadm 2020-07-16T14:43:12.487864+0000 mgr.x (mgr.34562) 3106 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:43:13.675 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:43:13 smithi188 bash[23329]: audit 2020-07-16T14:43:12.488296+0000 mon.b (mon.2) 755 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:43:13.675 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:43:13 smithi188 bash[23329]: cephadm 2020-07-16T14:43:12.489013+0000 mgr.x (mgr.34562) 3107 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:43:13.675 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:43:13 smithi188 bash[23329]: cephadm 2020-07-16T14:43:12.489089+0000 mgr.x (mgr.34562) 3108 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:43:15.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:43:15 smithi132 bash[27079]: cluster 2020-07-16T14:43:14.358189+0000 mgr.x (mgr.34562) 3109 : cluster [DBG] pgmap v1937: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:43:15.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:43:15 smithi132 bash[27079]: audit 2020-07-16T14:43:15.231267+0000 mon.b (mon.2) 756 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:43:15.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:43:15 smithi188 bash[23329]: cluster 2020-07-16T14:43:14.358189+0000 mgr.x (mgr.34562) 3109 : cluster [DBG] pgmap v1937: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:43:15.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:43:15 smithi188 bash[23329]: audit 2020-07-16T14:43:15.231267+0000 mon.b (mon.2) 756 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:43:16.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:43:16 smithi132 bash[27079]: cephadm 2020-07-16T14:43:15.231950+0000 mgr.x (mgr.34562) 3110 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:43:16.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:43:16 smithi132 bash[27079]: cephadm 2020-07-16T14:43:15.232361+0000 mgr.x (mgr.34562) 3111 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:43:16.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:43:16 smithi188 bash[23329]: cephadm 2020-07-16T14:43:15.231950+0000 mgr.x (mgr.34562) 3110 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:43:16.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:43:16 smithi188 bash[23329]: cephadm 2020-07-16T14:43:15.232361+0000 mgr.x (mgr.34562) 3111 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:43:17.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:43:17 smithi132 bash[27079]: cluster 2020-07-16T14:43:16.358554+0000 mgr.x (mgr.34562) 3112 : cluster [DBG] pgmap v1938: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:43:17.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:43:17 smithi188 bash[23329]: cluster 2020-07-16T14:43:16.358554+0000 mgr.x (mgr.34562) 3112 : cluster [DBG] pgmap v1938: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:43:19.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:43:19 smithi132 bash[27079]: cluster 2020-07-16T14:43:18.358953+0000 mgr.x (mgr.34562) 3113 : cluster [DBG] pgmap v1939: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:43:19.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:43:19 smithi188 bash[23329]: cluster 2020-07-16T14:43:18.358953+0000 mgr.x (mgr.34562) 3113 : cluster [DBG] pgmap v1939: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:43:21.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:43:20 smithi188 bash[23329]: cluster 2020-07-16T14:43:20.359343+0000 mgr.x (mgr.34562) 3114 : cluster [DBG] pgmap v1940: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:43:21.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:43:20 smithi132 bash[27079]: cluster 2020-07-16T14:43:20.359343+0000 mgr.x (mgr.34562) 3114 : cluster [DBG] pgmap v1940: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:43:23.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:43:23 smithi188 bash[23329]: cluster 2020-07-16T14:43:22.359806+0000 mgr.x (mgr.34562) 3115 : cluster [DBG] pgmap v1941: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:43:23.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:43:23 smithi132 bash[27079]: cluster 2020-07-16T14:43:22.359806+0000 mgr.x (mgr.34562) 3115 : cluster [DBG] pgmap v1941: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:43:25.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:43:25 smithi188 bash[23329]: cluster 2020-07-16T14:43:24.360333+0000 mgr.x (mgr.34562) 3116 : cluster [DBG] pgmap v1942: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:43:25.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:43:25 smithi132 bash[27079]: cluster 2020-07-16T14:43:24.360333+0000 mgr.x (mgr.34562) 3116 : cluster [DBG] pgmap v1942: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:43:27.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:43:27 smithi132 bash[27079]: cluster 2020-07-16T14:43:26.360710+0000 mgr.x (mgr.34562) 3117 : cluster [DBG] pgmap v1943: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:43:27.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:43:27 smithi188 bash[23329]: cluster 2020-07-16T14:43:26.360710+0000 mgr.x (mgr.34562) 3117 : cluster [DBG] pgmap v1943: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:43:29.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:43:29 smithi132 bash[27079]: cluster 2020-07-16T14:43:28.361113+0000 mgr.x (mgr.34562) 3118 : cluster [DBG] pgmap v1944: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:43:29.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:43:29 smithi188 bash[23329]: cluster 2020-07-16T14:43:28.361113+0000 mgr.x (mgr.34562) 3118 : cluster [DBG] pgmap v1944: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:43:31.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:43:30 smithi188 bash[23329]: audit 2020-07-16T14:43:30.247812+0000 mon.b (mon.2) 757 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:43:31.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:43:30 smithi188 bash[23329]: cephadm 2020-07-16T14:43:30.248560+0000 mgr.x (mgr.34562) 3119 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:43:31.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:43:30 smithi188 bash[23329]: cephadm 2020-07-16T14:43:30.248801+0000 mgr.x (mgr.34562) 3120 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:43:31.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:43:30 smithi188 bash[23329]: cluster 2020-07-16T14:43:30.361647+0000 mgr.x (mgr.34562) 3121 : cluster [DBG] pgmap v1945: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:43:31.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:43:30 smithi132 bash[27079]: audit 2020-07-16T14:43:30.247812+0000 mon.b (mon.2) 757 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:43:31.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:43:30 smithi132 bash[27079]: cephadm 2020-07-16T14:43:30.248560+0000 mgr.x (mgr.34562) 3119 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:43:31.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:43:30 smithi132 bash[27079]: cephadm 2020-07-16T14:43:30.248801+0000 mgr.x (mgr.34562) 3120 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:43:31.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:43:30 smithi132 bash[27079]: cluster 2020-07-16T14:43:30.361647+0000 mgr.x (mgr.34562) 3121 : cluster [DBG] pgmap v1945: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:43:33.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:43:33 smithi188 bash[23329]: cluster 2020-07-16T14:43:32.362126+0000 mgr.x (mgr.34562) 3122 : cluster [DBG] pgmap v1946: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:43:33.785 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:43:33 smithi132 bash[27079]: cluster 2020-07-16T14:43:32.362126+0000 mgr.x (mgr.34562) 3122 : cluster [DBG] pgmap v1946: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:43:35.316 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:43:35.579 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:43:35.579 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (66m) 85s ago 69m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:43:35.580 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (69m) 85s ago 69m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:43:35.580 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (66m) 85s ago 72m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:43:35.580 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (66m) 85s ago 73m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:43:35.580 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 85s ago 74m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:43:35.580 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (72m) 85s ago 72m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:43:35.581 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (72m) 85s ago 72m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:43:35.581 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (69m) 85s ago 69m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:43:35.581 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (69m) 85s ago 69m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:43:35.581 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (71m) 85s ago 71m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:43:35.581 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (71m) 85s ago 71m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:43:35.582 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (71m) 85s ago 71m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:43:35.582 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (71m) 85s ago 71m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:43:35.582 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (70m) 85s ago 70m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:43:35.582 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (70m) 85s ago 70m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:43:35.582 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (70m) 85s ago 70m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:43:35.583 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (69m) 85s ago 69m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:43:35.583 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (68m) 85s ago 69m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:43:35.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:43:35 smithi132 bash[27079]: cluster 2020-07-16T14:43:34.362626+0000 mgr.x (mgr.34562) 3123 : cluster [DBG] pgmap v1947: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:43:35.878 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:43:35.879 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:43:35.879 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:43:35.879 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:43:35.879 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:43:35.879 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:43:35.880 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:43:35.880 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:43:35.880 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:43:35.881 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:43:35.881 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:43:35.881 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:43:35.882 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:43:35.883 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:43:35.883 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:43:35.883 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:43:35.884 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:43:35.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:43:35 smithi188 bash[23329]: cluster 2020-07-16T14:43:34.362626+0000 mgr.x (mgr.34562) 3123 : cluster [DBG] pgmap v1947: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:43:36.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:43:36 smithi132 bash[27079]: audit 2020-07-16T14:43:35.303964+0000 mgr.x (mgr.34562) 3124 : audit [DBG] from='client.26908 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:43:36.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:43:36 smithi132 bash[27079]: audit 2020-07-16T14:43:35.877426+0000 mon.c (mon.1) 245 : audit [DBG] from='client.? 172.21.15.132:0/1819661661' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:43:36.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:43:36 smithi188 bash[23329]: audit 2020-07-16T14:43:35.303964+0000 mgr.x (mgr.34562) 3124 : audit [DBG] from='client.26908 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:43:36.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:43:36 smithi188 bash[23329]: audit 2020-07-16T14:43:35.877426+0000 mon.c (mon.1) 245 : audit [DBG] from='client.? 172.21.15.132:0/1819661661' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:43:37.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:43:37 smithi132 bash[27079]: audit 2020-07-16T14:43:35.574874+0000 mgr.x (mgr.34562) 3125 : audit [DBG] from='client.26914 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:43:37.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:43:37 smithi132 bash[27079]: cluster 2020-07-16T14:43:36.362985+0000 mgr.x (mgr.34562) 3126 : cluster [DBG] pgmap v1948: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:43:37.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:43:37 smithi188 bash[23329]: audit 2020-07-16T14:43:35.574874+0000 mgr.x (mgr.34562) 3125 : audit [DBG] from='client.26914 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:43:37.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:43:37 smithi188 bash[23329]: cluster 2020-07-16T14:43:36.362985+0000 mgr.x (mgr.34562) 3126 : cluster [DBG] pgmap v1948: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:43:39.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:43:39 smithi132 bash[27079]: cluster 2020-07-16T14:43:38.363379+0000 mgr.x (mgr.34562) 3127 : cluster [DBG] pgmap v1949: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:43:39.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:43:39 smithi188 bash[23329]: cluster 2020-07-16T14:43:38.363379+0000 mgr.x (mgr.34562) 3127 : cluster [DBG] pgmap v1949: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:43:41.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:43:40 smithi188 bash[23329]: cluster 2020-07-16T14:43:40.363770+0000 mgr.x (mgr.34562) 3128 : cluster [DBG] pgmap v1950: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:43:41.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:43:40 smithi132 bash[27079]: cluster 2020-07-16T14:43:40.363770+0000 mgr.x (mgr.34562) 3128 : cluster [DBG] pgmap v1950: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:43:43.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:43:43 smithi132 bash[27079]: cluster 2020-07-16T14:43:42.364207+0000 mgr.x (mgr.34562) 3129 : cluster [DBG] pgmap v1951: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:43:43.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:43:43 smithi188 bash[23329]: cluster 2020-07-16T14:43:42.364207+0000 mgr.x (mgr.34562) 3129 : cluster [DBG] pgmap v1951: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:43:45.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:43:45 smithi132 bash[27079]: cluster 2020-07-16T14:43:44.364671+0000 mgr.x (mgr.34562) 3130 : cluster [DBG] pgmap v1952: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:43:45.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:43:45 smithi132 bash[27079]: audit 2020-07-16T14:43:45.264560+0000 mon.b (mon.2) 758 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:43:45.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:43:45 smithi188 bash[23329]: cluster 2020-07-16T14:43:44.364671+0000 mgr.x (mgr.34562) 3130 : cluster [DBG] pgmap v1952: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:43:45.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:43:45 smithi188 bash[23329]: audit 2020-07-16T14:43:45.264560+0000 mon.b (mon.2) 758 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:43:46.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:43:46 smithi132 bash[27079]: cephadm 2020-07-16T14:43:45.265255+0000 mgr.x (mgr.34562) 3131 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:43:46.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:43:46 smithi132 bash[27079]: cephadm 2020-07-16T14:43:45.265364+0000 mgr.x (mgr.34562) 3132 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:43:46.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:43:46 smithi188 bash[23329]: cephadm 2020-07-16T14:43:45.265255+0000 mgr.x (mgr.34562) 3131 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:43:46.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:43:46 smithi188 bash[23329]: cephadm 2020-07-16T14:43:45.265364+0000 mgr.x (mgr.34562) 3132 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:43:47.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:43:47 smithi132 bash[27079]: cluster 2020-07-16T14:43:46.365096+0000 mgr.x (mgr.34562) 3133 : cluster [DBG] pgmap v1953: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:43:47.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:43:47 smithi188 bash[23329]: cluster 2020-07-16T14:43:46.365096+0000 mgr.x (mgr.34562) 3133 : cluster [DBG] pgmap v1953: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:43:49.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:43:49 smithi132 bash[27079]: cluster 2020-07-16T14:43:48.365565+0000 mgr.x (mgr.34562) 3134 : cluster [DBG] pgmap v1954: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:43:49.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:43:49 smithi188 bash[23329]: cluster 2020-07-16T14:43:48.365565+0000 mgr.x (mgr.34562) 3134 : cluster [DBG] pgmap v1954: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:43:51.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:43:50 smithi188 bash[23329]: cluster 2020-07-16T14:43:50.366000+0000 mgr.x (mgr.34562) 3135 : cluster [DBG] pgmap v1955: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:43:51.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:43:50 smithi132 bash[27079]: cluster 2020-07-16T14:43:50.366000+0000 mgr.x (mgr.34562) 3135 : cluster [DBG] pgmap v1955: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:43:53.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:43:53 smithi132 bash[27079]: cluster 2020-07-16T14:43:52.366380+0000 mgr.x (mgr.34562) 3136 : cluster [DBG] pgmap v1956: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:43:53.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:43:53 smithi188 bash[23329]: cluster 2020-07-16T14:43:52.366380+0000 mgr.x (mgr.34562) 3136 : cluster [DBG] pgmap v1956: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:43:55.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:43:55 smithi132 bash[27079]: cluster 2020-07-16T14:43:54.366716+0000 mgr.x (mgr.34562) 3137 : cluster [DBG] pgmap v1957: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:43:55.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:43:55 smithi188 bash[23329]: cluster 2020-07-16T14:43:54.366716+0000 mgr.x (mgr.34562) 3137 : cluster [DBG] pgmap v1957: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:43:57.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:43:57 smithi132 bash[27079]: cluster 2020-07-16T14:43:56.367088+0000 mgr.x (mgr.34562) 3138 : cluster [DBG] pgmap v1958: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:43:57.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:43:57 smithi188 bash[23329]: cluster 2020-07-16T14:43:56.367088+0000 mgr.x (mgr.34562) 3138 : cluster [DBG] pgmap v1958: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:43:59.788 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:43:59 smithi132 bash[27079]: cluster 2020-07-16T14:43:58.367518+0000 mgr.x (mgr.34562) 3139 : cluster [DBG] pgmap v1959: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:43:59.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:43:59 smithi188 bash[23329]: cluster 2020-07-16T14:43:58.367518+0000 mgr.x (mgr.34562) 3139 : cluster [DBG] pgmap v1959: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:44:01.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:00 smithi188 bash[23329]: audit 2020-07-16T14:44:00.273833+0000 mon.b (mon.2) 759 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:44:01.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:00 smithi188 bash[23329]: cephadm 2020-07-16T14:44:00.274551+0000 mgr.x (mgr.34562) 3140 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:44:01.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:00 smithi188 bash[23329]: cephadm 2020-07-16T14:44:00.275054+0000 mgr.x (mgr.34562) 3141 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:44:01.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:00 smithi188 bash[23329]: cluster 2020-07-16T14:44:00.368013+0000 mgr.x (mgr.34562) 3142 : cluster [DBG] pgmap v1960: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:44:01.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:00 smithi132 bash[27079]: audit 2020-07-16T14:44:00.273833+0000 mon.b (mon.2) 759 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:44:01.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:00 smithi132 bash[27079]: cephadm 2020-07-16T14:44:00.274551+0000 mgr.x (mgr.34562) 3140 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:44:01.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:00 smithi132 bash[27079]: cephadm 2020-07-16T14:44:00.275054+0000 mgr.x (mgr.34562) 3141 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:44:01.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:00 smithi132 bash[27079]: cluster 2020-07-16T14:44:00.368013+0000 mgr.x (mgr.34562) 3142 : cluster [DBG] pgmap v1960: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:44:03.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:03 smithi132 bash[27079]: cluster 2020-07-16T14:44:02.368668+0000 mgr.x (mgr.34562) 3143 : cluster [DBG] pgmap v1961: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:44:03.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:03 smithi188 bash[23329]: cluster 2020-07-16T14:44:02.368668+0000 mgr.x (mgr.34562) 3143 : cluster [DBG] pgmap v1961: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:44:05.790 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:05 smithi132 bash[27079]: cluster 2020-07-16T14:44:04.369187+0000 mgr.x (mgr.34562) 3144 : cluster [DBG] pgmap v1962: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:44:05.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:05 smithi188 bash[23329]: cluster 2020-07-16T14:44:04.369187+0000 mgr.x (mgr.34562) 3144 : cluster [DBG] pgmap v1962: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:44:06.173 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:44:06.433 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:44:06.433 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (66m) 116s ago 69m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:44:06.433 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (69m) 116s ago 69m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:44:06.434 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (67m) 116s ago 72m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:44:06.434 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (66m) 116s ago 74m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:44:06.434 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 116s ago 74m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:44:06.434 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (72m) 116s ago 72m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:44:06.435 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (73m) 116s ago 73m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:44:06.435 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (70m) 116s ago 70m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:44:06.435 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (70m) 116s ago 70m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:44:06.435 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (72m) 116s ago 72m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:44:06.435 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (72m) 116s ago 72m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:44:06.436 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (71m) 116s ago 71m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:44:06.436 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (71m) 116s ago 71m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:44:06.436 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (71m) 116s ago 71m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:44:06.436 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (71m) 116s ago 71m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:44:06.436 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (70m) 116s ago 70m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:44:06.437 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (70m) 116s ago 70m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:44:06.437 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (69m) 116s ago 70m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:44:06.735 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:44:06.736 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:44:06.736 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:44:06.736 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:44:06.737 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:44:06.737 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:44:06.737 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:44:06.737 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:44:06.737 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:44:06.738 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:44:06.738 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:44:06.738 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:44:06.738 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:44:06.738 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:44:06.739 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:44:06.739 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:44:06.739 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:44:07.785 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:07 smithi132 bash[27079]: audit 2020-07-16T14:44:06.161130+0000 mgr.x (mgr.34562) 3145 : audit [DBG] from='client.26926 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:44:07.786 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:07 smithi132 bash[27079]: cluster 2020-07-16T14:44:06.369502+0000 mgr.x (mgr.34562) 3146 : cluster [DBG] pgmap v1963: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:44:07.786 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:07 smithi132 bash[27079]: audit 2020-07-16T14:44:06.428440+0000 mgr.x (mgr.34562) 3147 : audit [DBG] from='client.26932 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:44:07.786 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:07 smithi132 bash[27079]: audit 2020-07-16T14:44:06.734541+0000 mon.c (mon.1) 246 : audit [DBG] from='client.? 172.21.15.132:0/3477636906' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:44:07.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:07 smithi188 bash[23329]: audit 2020-07-16T14:44:06.161130+0000 mgr.x (mgr.34562) 3145 : audit [DBG] from='client.26926 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:44:07.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:07 smithi188 bash[23329]: cluster 2020-07-16T14:44:06.369502+0000 mgr.x (mgr.34562) 3146 : cluster [DBG] pgmap v1963: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:44:07.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:07 smithi188 bash[23329]: audit 2020-07-16T14:44:06.428440+0000 mgr.x (mgr.34562) 3147 : audit [DBG] from='client.26932 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:44:07.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:07 smithi188 bash[23329]: audit 2020-07-16T14:44:06.734541+0000 mon.c (mon.1) 246 : audit [DBG] from='client.? 172.21.15.132:0/3477636906' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:44:09.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:09 smithi132 bash[27079]: cluster 2020-07-16T14:44:08.369925+0000 mgr.x (mgr.34562) 3148 : cluster [DBG] pgmap v1964: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:44:09.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:09 smithi188 bash[23329]: cluster 2020-07-16T14:44:08.369925+0000 mgr.x (mgr.34562) 3148 : cluster [DBG] pgmap v1964: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:44:11.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:10 smithi188 bash[23329]: cluster 2020-07-16T14:44:10.370317+0000 mgr.x (mgr.34562) 3149 : cluster [DBG] pgmap v1965: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:44:11.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:10 smithi132 bash[27079]: cluster 2020-07-16T14:44:10.370317+0000 mgr.x (mgr.34562) 3149 : cluster [DBG] pgmap v1965: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:44:13.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:13 smithi132 bash[27079]: cluster 2020-07-16T14:44:12.370857+0000 mgr.x (mgr.34562) 3150 : cluster [DBG] pgmap v1966: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:44:13.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:13 smithi188 bash[23329]: cluster 2020-07-16T14:44:12.370857+0000 mgr.x (mgr.34562) 3150 : cluster [DBG] pgmap v1966: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:44:15.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:15 smithi132 bash[27079]: cluster 2020-07-16T14:44:14.371225+0000 mgr.x (mgr.34562) 3151 : cluster [DBG] pgmap v1967: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:44:15.947 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:15 smithi188 bash[23329]: cluster 2020-07-16T14:44:14.371225+0000 mgr.x (mgr.34562) 3151 : cluster [DBG] pgmap v1967: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:44:16.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:16 smithi132 bash[27079]: audit 2020-07-16T14:44:15.518899+0000 mon.b (mon.2) 760 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:42:09.646084\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646142\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646176\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646203\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646400\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646511\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646629\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646728\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646761\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:42:09.646830\", \"last_device_update\": \"2020-07-16T14:33:41.233618\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:44:15.518016\"}"}]: dispatch 2020-07-16T14:44:16.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:16 smithi132 bash[27079]: audit 2020-07-16T14:44:15.519474+0000 mon.c (mon.1) 247 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:42:09.646084\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646142\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646176\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646203\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646400\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646511\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646629\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646728\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646761\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:42:09.646830\", \"last_device_update\": \"2020-07-16T14:33:41.233618\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:44:15.518016\"}"}]: dispatch 2020-07-16T14:44:16.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:16 smithi132 bash[27079]: audit 2020-07-16T14:44:15.522492+0000 mon.c (mon.1) 248 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:42:09.646084\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646142\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646176\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646203\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646400\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646511\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646629\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646728\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646761\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:42:09.646830\", \"last_device_update\": \"2020-07-16T14:33:41.233618\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:44:15.518016\"}"}]': finished 2020-07-16T14:44:16.782 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:16 smithi132 bash[27079]: audit 2020-07-16T14:44:15.523074+0000 mon.b (mon.2) 761 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.730914\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.730986\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731017\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731176\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731278\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731409\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731512\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731546\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731591\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:42:09.731658\", \"last_device_update\": \"2020-07-16T14:34:46.715995\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:44:15.520478\"}"}]: dispatch 2020-07-16T14:44:16.782 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:16 smithi132 bash[27079]: audit 2020-07-16T14:44:15.523280+0000 mon.c (mon.1) 249 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.730914\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.730986\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731017\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731176\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731278\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731409\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731512\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731546\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731591\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:42:09.731658\", \"last_device_update\": \"2020-07-16T14:34:46.715995\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:44:15.520478\"}"}]: dispatch 2020-07-16T14:44:16.783 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:16 smithi132 bash[27079]: audit 2020-07-16T14:44:15.525716+0000 mon.c (mon.1) 250 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.730914\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.730986\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731017\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731176\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731278\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731409\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731512\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731546\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731591\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:42:09.731658\", \"last_device_update\": \"2020-07-16T14:34:46.715995\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:44:15.520478\"}"}]': finished 2020-07-16T14:44:16.783 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:16 smithi132 bash[27079]: audit 2020-07-16T14:44:15.528263+0000 mon.b (mon.2) 762 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:44:16.783 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:16 smithi132 bash[27079]: audit 2020-07-16T14:44:15.528542+0000 mgr.x (mgr.34562) 3152 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:44:16.784 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:16 smithi132 bash[27079]: audit 2020-07-16T14:44:15.529218+0000 mon.b (mon.2) 763 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:44:16.784 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:16 smithi132 bash[27079]: audit 2020-07-16T14:44:15.529471+0000 mgr.x (mgr.34562) 3153 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:44:16.784 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:16 smithi132 bash[27079]: audit 2020-07-16T14:44:15.530037+0000 mon.b (mon.2) 764 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:44:16.784 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:16 smithi132 bash[27079]: audit 2020-07-16T14:44:15.530300+0000 mgr.x (mgr.34562) 3154 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:44:16.784 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:16 smithi132 bash[27079]: cephadm 2020-07-16T14:44:15.530810+0000 mgr.x (mgr.34562) 3155 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:44:16.785 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:16 smithi132 bash[27079]: audit 2020-07-16T14:44:15.531100+0000 mon.b (mon.2) 765 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:44:16.785 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:16 smithi132 bash[27079]: cephadm 2020-07-16T14:44:15.531708+0000 mgr.x (mgr.34562) 3156 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:44:16.785 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:16 smithi132 bash[27079]: audit 2020-07-16T14:44:15.531977+0000 mon.b (mon.2) 766 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:44:16.785 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:16 smithi132 bash[27079]: cephadm 2020-07-16T14:44:15.532480+0000 mgr.x (mgr.34562) 3157 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:44:16.786 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:16 smithi132 bash[27079]: cephadm 2020-07-16T14:44:15.532680+0000 mgr.x (mgr.34562) 3158 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:44:16.823 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:16 smithi188 bash[23329]: audit 2020-07-16T14:44:15.518899+0000 mon.b (mon.2) 760 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:42:09.646084\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646142\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646176\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646203\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646400\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646511\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646629\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646728\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646761\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:42:09.646830\", \"last_device_update\": \"2020-07-16T14:33:41.233618\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:44:15.518016\"}"}]: dispatch 2020-07-16T14:44:16.823 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:16 smithi188 bash[23329]: audit 2020-07-16T14:44:15.519474+0000 mon.c (mon.1) 247 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:42:09.646084\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646142\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646176\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646203\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646400\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646511\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646629\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646728\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646761\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:42:09.646830\", \"last_device_update\": \"2020-07-16T14:33:41.233618\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:44:15.518016\"}"}]: dispatch 2020-07-16T14:44:16.824 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:16 smithi188 bash[23329]: audit 2020-07-16T14:44:15.522492+0000 mon.c (mon.1) 248 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:42:09.646084\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646142\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646176\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646203\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646400\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646511\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646629\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646728\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.646761\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:42:09.646830\", \"last_device_update\": \"2020-07-16T14:33:41.233618\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:44:15.518016\"}"}]': finished 2020-07-16T14:44:16.824 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:16 smithi188 bash[23329]: audit 2020-07-16T14:44:15.523074+0000 mon.b (mon.2) 761 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.730914\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.730986\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731017\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731176\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731278\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731409\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731512\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731546\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731591\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:42:09.731658\", \"last_device_update\": \"2020-07-16T14:34:46.715995\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:44:15.520478\"}"}]: dispatch 2020-07-16T14:44:16.824 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:16 smithi188 bash[23329]: audit 2020-07-16T14:44:15.523280+0000 mon.c (mon.1) 249 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.730914\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.730986\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731017\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731176\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731278\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731409\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731512\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731546\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731591\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:42:09.731658\", \"last_device_update\": \"2020-07-16T14:34:46.715995\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:44:15.520478\"}"}]: dispatch 2020-07-16T14:44:16.825 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:16 smithi188 bash[23329]: audit 2020-07-16T14:44:15.525716+0000 mon.c (mon.1) 250 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.730914\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.730986\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731017\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731176\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731278\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731409\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731512\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731546\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:42:09.731591\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:42:09.731658\", \"last_device_update\": \"2020-07-16T14:34:46.715995\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:44:15.520478\"}"}]': finished 2020-07-16T14:44:16.825 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:16 smithi188 bash[23329]: audit 2020-07-16T14:44:15.528263+0000 mon.b (mon.2) 762 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:44:16.825 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:16 smithi188 bash[23329]: audit 2020-07-16T14:44:15.528542+0000 mgr.x (mgr.34562) 3152 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:44:16.826 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:16 smithi188 bash[23329]: audit 2020-07-16T14:44:15.529218+0000 mon.b (mon.2) 763 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:44:16.826 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:16 smithi188 bash[23329]: audit 2020-07-16T14:44:15.529471+0000 mgr.x (mgr.34562) 3153 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:44:16.826 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:16 smithi188 bash[23329]: audit 2020-07-16T14:44:15.530037+0000 mon.b (mon.2) 764 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:44:16.826 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:16 smithi188 bash[23329]: audit 2020-07-16T14:44:15.530300+0000 mgr.x (mgr.34562) 3154 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:44:16.826 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:16 smithi188 bash[23329]: cephadm 2020-07-16T14:44:15.530810+0000 mgr.x (mgr.34562) 3155 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:44:16.827 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:16 smithi188 bash[23329]: audit 2020-07-16T14:44:15.531100+0000 mon.b (mon.2) 765 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:44:16.827 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:16 smithi188 bash[23329]: cephadm 2020-07-16T14:44:15.531708+0000 mgr.x (mgr.34562) 3156 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:44:16.827 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:16 smithi188 bash[23329]: audit 2020-07-16T14:44:15.531977+0000 mon.b (mon.2) 766 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:44:16.827 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:16 smithi188 bash[23329]: cephadm 2020-07-16T14:44:15.532480+0000 mgr.x (mgr.34562) 3157 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:44:16.828 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:16 smithi188 bash[23329]: cephadm 2020-07-16T14:44:15.532680+0000 mgr.x (mgr.34562) 3158 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:44:17.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:17 smithi132 bash[27079]: cluster 2020-07-16T14:44:16.371628+0000 mgr.x (mgr.34562) 3159 : cluster [DBG] pgmap v1968: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:44:17.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:17 smithi188 bash[23329]: cluster 2020-07-16T14:44:16.371628+0000 mgr.x (mgr.34562) 3159 : cluster [DBG] pgmap v1968: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:44:18.785 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:18 smithi132 bash[27079]: audit 2020-07-16T14:44:18.384061+0000 mon.b (mon.2) 767 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:44:18.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:18 smithi188 bash[23329]: audit 2020-07-16T14:44:18.384061+0000 mon.b (mon.2) 767 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:44:19.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:19 smithi188 bash[23329]: cluster 2020-07-16T14:44:18.372006+0000 mgr.x (mgr.34562) 3160 : cluster [DBG] pgmap v1969: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:44:19.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:19 smithi188 bash[23329]: cephadm 2020-07-16T14:44:18.384702+0000 mgr.x (mgr.34562) 3161 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:44:19.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:19 smithi188 bash[23329]: cephadm 2020-07-16T14:44:18.385154+0000 mgr.x (mgr.34562) 3162 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:44:20.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:19 smithi132 bash[27079]: cluster 2020-07-16T14:44:18.372006+0000 mgr.x (mgr.34562) 3160 : cluster [DBG] pgmap v1969: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:44:20.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:19 smithi132 bash[27079]: cephadm 2020-07-16T14:44:18.384702+0000 mgr.x (mgr.34562) 3161 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:44:20.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:19 smithi132 bash[27079]: cephadm 2020-07-16T14:44:18.385154+0000 mgr.x (mgr.34562) 3162 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:44:21.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:20 smithi188 bash[23329]: cluster 2020-07-16T14:44:20.372558+0000 mgr.x (mgr.34562) 3163 : cluster [DBG] pgmap v1970: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:44:21.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:20 smithi132 bash[27079]: cluster 2020-07-16T14:44:20.372558+0000 mgr.x (mgr.34562) 3163 : cluster [DBG] pgmap v1970: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:44:23.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:23 smithi132 bash[27079]: cluster 2020-07-16T14:44:22.373076+0000 mgr.x (mgr.34562) 3164 : cluster [DBG] pgmap v1971: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:44:23.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:23 smithi188 bash[23329]: cluster 2020-07-16T14:44:22.373076+0000 mgr.x (mgr.34562) 3164 : cluster [DBG] pgmap v1971: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:44:25.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:25 smithi132 bash[27079]: cluster 2020-07-16T14:44:24.373582+0000 mgr.x (mgr.34562) 3165 : cluster [DBG] pgmap v1972: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:44:25.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:25 smithi188 bash[23329]: cluster 2020-07-16T14:44:24.373582+0000 mgr.x (mgr.34562) 3165 : cluster [DBG] pgmap v1972: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:44:27.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:27 smithi132 bash[27079]: cluster 2020-07-16T14:44:26.373947+0000 mgr.x (mgr.34562) 3166 : cluster [DBG] pgmap v1973: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:44:27.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:27 smithi188 bash[23329]: cluster 2020-07-16T14:44:26.373947+0000 mgr.x (mgr.34562) 3166 : cluster [DBG] pgmap v1973: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:44:29.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:29 smithi132 bash[27079]: cluster 2020-07-16T14:44:28.374356+0000 mgr.x (mgr.34562) 3167 : cluster [DBG] pgmap v1974: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:44:29.926 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:29 smithi188 bash[23329]: cluster 2020-07-16T14:44:28.374356+0000 mgr.x (mgr.34562) 3167 : cluster [DBG] pgmap v1974: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:44:31.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:30 smithi188 bash[23329]: cluster 2020-07-16T14:44:30.374819+0000 mgr.x (mgr.34562) 3168 : cluster [DBG] pgmap v1975: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:44:31.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:30 smithi132 bash[27079]: cluster 2020-07-16T14:44:30.374819+0000 mgr.x (mgr.34562) 3168 : cluster [DBG] pgmap v1975: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:44:33.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:33 smithi132 bash[27079]: cluster 2020-07-16T14:44:32.375327+0000 mgr.x (mgr.34562) 3169 : cluster [DBG] pgmap v1976: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:44:33.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:33 smithi132 bash[27079]: audit 2020-07-16T14:44:33.400789+0000 mon.b (mon.2) 768 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:44:33.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:33 smithi188 bash[23329]: cluster 2020-07-16T14:44:32.375327+0000 mgr.x (mgr.34562) 3169 : cluster [DBG] pgmap v1976: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:44:33.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:33 smithi188 bash[23329]: audit 2020-07-16T14:44:33.400789+0000 mon.b (mon.2) 768 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:44:34.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:34 smithi132 bash[27079]: cephadm 2020-07-16T14:44:33.401492+0000 mgr.x (mgr.34562) 3170 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:44:34.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:34 smithi132 bash[27079]: cephadm 2020-07-16T14:44:33.401665+0000 mgr.x (mgr.34562) 3171 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:44:34.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:34 smithi188 bash[23329]: cephadm 2020-07-16T14:44:33.401492+0000 mgr.x (mgr.34562) 3170 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:44:34.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:34 smithi188 bash[23329]: cephadm 2020-07-16T14:44:33.401665+0000 mgr.x (mgr.34562) 3171 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:44:35.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:35 smithi132 bash[27079]: cluster 2020-07-16T14:44:34.375647+0000 mgr.x (mgr.34562) 3172 : cluster [DBG] pgmap v1977: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:44:35.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:35 smithi188 bash[23329]: cluster 2020-07-16T14:44:34.375647+0000 mgr.x (mgr.34562) 3172 : cluster [DBG] pgmap v1977: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:44:37.033 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:44:37.296 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:44:37.296 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (67m) 2m ago 70m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:44:37.296 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (70m) 2m ago 70m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:44:37.297 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (67m) 2m ago 73m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:44:37.297 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (67m) 2m ago 74m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:44:37.297 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 2m ago 75m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:44:37.297 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (73m) 2m ago 73m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:44:37.298 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (73m) 2m ago 73m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:44:37.298 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (70m) 2m ago 70m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:44:37.298 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (70m) 2m ago 70m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:44:37.298 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (72m) 2m ago 72m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:44:37.298 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (72m) 2m ago 72m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:44:37.299 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (72m) 2m ago 72m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:44:37.299 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (72m) 2m ago 72m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:44:37.299 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (71m) 2m ago 71m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:44:37.299 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (71m) 2m ago 71m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:44:37.299 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (71m) 2m ago 71m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:44:37.300 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (70m) 2m ago 71m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:44:37.301 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (69m) 2m ago 70m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:44:37.594 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:44:37.595 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:44:37.595 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:44:37.595 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:44:37.595 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:44:37.595 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:44:37.596 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:44:37.596 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:44:37.596 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:44:37.596 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:44:37.596 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:44:37.596 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:44:37.597 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:44:37.597 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:44:37.597 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:44:37.597 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:44:37.597 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:44:37.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:37 smithi132 bash[27079]: cluster 2020-07-16T14:44:36.376004+0000 mgr.x (mgr.34562) 3173 : cluster [DBG] pgmap v1978: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:44:37.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:37 smithi188 bash[23329]: cluster 2020-07-16T14:44:36.376004+0000 mgr.x (mgr.34562) 3173 : cluster [DBG] pgmap v1978: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:44:38.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:38 smithi132 bash[27079]: audit 2020-07-16T14:44:37.021959+0000 mgr.x (mgr.34562) 3174 : audit [DBG] from='client.26944 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:44:38.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:38 smithi132 bash[27079]: audit 2020-07-16T14:44:37.291018+0000 mgr.x (mgr.34562) 3175 : audit [DBG] from='client.26950 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:44:38.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:38 smithi132 bash[27079]: audit 2020-07-16T14:44:37.592950+0000 mon.c (mon.1) 251 : audit [DBG] from='client.? 172.21.15.132:0/997276619' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:44:38.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:38 smithi188 bash[23329]: audit 2020-07-16T14:44:37.021959+0000 mgr.x (mgr.34562) 3174 : audit [DBG] from='client.26944 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:44:38.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:38 smithi188 bash[23329]: audit 2020-07-16T14:44:37.291018+0000 mgr.x (mgr.34562) 3175 : audit [DBG] from='client.26950 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:44:38.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:38 smithi188 bash[23329]: audit 2020-07-16T14:44:37.592950+0000 mon.c (mon.1) 251 : audit [DBG] from='client.? 172.21.15.132:0/997276619' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:44:39.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:39 smithi132 bash[27079]: cluster 2020-07-16T14:44:38.376412+0000 mgr.x (mgr.34562) 3176 : cluster [DBG] pgmap v1979: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:44:39.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:39 smithi188 bash[23329]: cluster 2020-07-16T14:44:38.376412+0000 mgr.x (mgr.34562) 3176 : cluster [DBG] pgmap v1979: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:44:41.178 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:40 smithi188 bash[23329]: cluster 2020-07-16T14:44:40.376812+0000 mgr.x (mgr.34562) 3177 : cluster [DBG] pgmap v1980: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:44:41.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:40 smithi132 bash[27079]: cluster 2020-07-16T14:44:40.376812+0000 mgr.x (mgr.34562) 3177 : cluster [DBG] pgmap v1980: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:44:43.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:43 smithi132 bash[27079]: cluster 2020-07-16T14:44:42.377235+0000 mgr.x (mgr.34562) 3178 : cluster [DBG] pgmap v1981: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:44:43.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:43 smithi188 bash[23329]: cluster 2020-07-16T14:44:42.377235+0000 mgr.x (mgr.34562) 3178 : cluster [DBG] pgmap v1981: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:44:45.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:45 smithi132 bash[27079]: cluster 2020-07-16T14:44:44.377686+0000 mgr.x (mgr.34562) 3179 : cluster [DBG] pgmap v1982: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:44:45.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:45 smithi188 bash[23329]: cluster 2020-07-16T14:44:44.377686+0000 mgr.x (mgr.34562) 3179 : cluster [DBG] pgmap v1982: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:44:47.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:47 smithi132 bash[27079]: cluster 2020-07-16T14:44:46.378151+0000 mgr.x (mgr.34562) 3180 : cluster [DBG] pgmap v1983: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:44:47.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:47 smithi188 bash[23329]: cluster 2020-07-16T14:44:46.378151+0000 mgr.x (mgr.34562) 3180 : cluster [DBG] pgmap v1983: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:44:48.787 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:48 smithi132 bash[27079]: audit 2020-07-16T14:44:48.406047+0000 mon.b (mon.2) 769 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:44:48.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:48 smithi188 bash[23329]: audit 2020-07-16T14:44:48.406047+0000 mon.b (mon.2) 769 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:44:49.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:49 smithi132 bash[27079]: cluster 2020-07-16T14:44:48.378743+0000 mgr.x (mgr.34562) 3181 : cluster [DBG] pgmap v1984: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:44:49.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:49 smithi132 bash[27079]: cephadm 2020-07-16T14:44:48.406806+0000 mgr.x (mgr.34562) 3182 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:44:49.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:49 smithi132 bash[27079]: cephadm 2020-07-16T14:44:48.407220+0000 mgr.x (mgr.34562) 3183 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:44:49.930 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:49 smithi188 bash[23329]: cluster 2020-07-16T14:44:48.378743+0000 mgr.x (mgr.34562) 3181 : cluster [DBG] pgmap v1984: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:44:49.931 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:49 smithi188 bash[23329]: cephadm 2020-07-16T14:44:48.406806+0000 mgr.x (mgr.34562) 3182 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:44:49.931 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:49 smithi188 bash[23329]: cephadm 2020-07-16T14:44:48.407220+0000 mgr.x (mgr.34562) 3183 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:44:51.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:50 smithi188 bash[23329]: cluster 2020-07-16T14:44:50.379151+0000 mgr.x (mgr.34562) 3184 : cluster [DBG] pgmap v1985: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:44:51.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:50 smithi132 bash[27079]: cluster 2020-07-16T14:44:50.379151+0000 mgr.x (mgr.34562) 3184 : cluster [DBG] pgmap v1985: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:44:53.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:53 smithi132 bash[27079]: cluster 2020-07-16T14:44:52.379645+0000 mgr.x (mgr.34562) 3185 : cluster [DBG] pgmap v1986: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:44:53.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:53 smithi188 bash[23329]: cluster 2020-07-16T14:44:52.379645+0000 mgr.x (mgr.34562) 3185 : cluster [DBG] pgmap v1986: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:44:55.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:55 smithi132 bash[27079]: cluster 2020-07-16T14:44:54.380008+0000 mgr.x (mgr.34562) 3186 : cluster [DBG] pgmap v1987: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:44:55.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:55 smithi188 bash[23329]: cluster 2020-07-16T14:44:54.380008+0000 mgr.x (mgr.34562) 3186 : cluster [DBG] pgmap v1987: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:44:57.783 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:57 smithi132 bash[27079]: cluster 2020-07-16T14:44:56.380456+0000 mgr.x (mgr.34562) 3187 : cluster [DBG] pgmap v1988: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:44:57.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:57 smithi188 bash[23329]: cluster 2020-07-16T14:44:56.380456+0000 mgr.x (mgr.34562) 3187 : cluster [DBG] pgmap v1988: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:44:59.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:44:59 smithi132 bash[27079]: cluster 2020-07-16T14:44:58.380944+0000 mgr.x (mgr.34562) 3188 : cluster [DBG] pgmap v1989: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:44:59.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:44:59 smithi188 bash[23329]: cluster 2020-07-16T14:44:58.380944+0000 mgr.x (mgr.34562) 3188 : cluster [DBG] pgmap v1989: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:45:01.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:45:00 smithi188 bash[23329]: cluster 2020-07-16T14:45:00.381335+0000 mgr.x (mgr.34562) 3189 : cluster [DBG] pgmap v1990: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:45:01.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:45:00 smithi132 bash[27079]: cluster 2020-07-16T14:45:00.381335+0000 mgr.x (mgr.34562) 3189 : cluster [DBG] pgmap v1990: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:45:03.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:45:03 smithi132 bash[27079]: cluster 2020-07-16T14:45:02.381797+0000 mgr.x (mgr.34562) 3190 : cluster [DBG] pgmap v1991: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:45:03.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:45:03 smithi132 bash[27079]: audit 2020-07-16T14:45:03.422653+0000 mon.b (mon.2) 770 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:45:03.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:45:03 smithi188 bash[23329]: cluster 2020-07-16T14:45:02.381797+0000 mgr.x (mgr.34562) 3190 : cluster [DBG] pgmap v1991: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:45:03.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:45:03 smithi188 bash[23329]: audit 2020-07-16T14:45:03.422653+0000 mon.b (mon.2) 770 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:45:04.787 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:45:04 smithi132 bash[27079]: cephadm 2020-07-16T14:45:03.423350+0000 mgr.x (mgr.34562) 3191 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:45:04.788 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:45:04 smithi132 bash[27079]: cephadm 2020-07-16T14:45:03.423736+0000 mgr.x (mgr.34562) 3192 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:45:04.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:45:04 smithi188 bash[23329]: cephadm 2020-07-16T14:45:03.423350+0000 mgr.x (mgr.34562) 3191 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:45:04.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:45:04 smithi188 bash[23329]: cephadm 2020-07-16T14:45:03.423736+0000 mgr.x (mgr.34562) 3192 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:45:05.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:45:05 smithi132 bash[27079]: cluster 2020-07-16T14:45:04.382127+0000 mgr.x (mgr.34562) 3193 : cluster [DBG] pgmap v1992: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:45:05.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:45:05 smithi188 bash[23329]: cluster 2020-07-16T14:45:04.382127+0000 mgr.x (mgr.34562) 3193 : cluster [DBG] pgmap v1992: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:45:07.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:45:07 smithi132 bash[27079]: cluster 2020-07-16T14:45:06.382631+0000 mgr.x (mgr.34562) 3194 : cluster [DBG] pgmap v1993: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:45:07.893 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:45:07.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:45:07 smithi188 bash[23329]: cluster 2020-07-16T14:45:06.382631+0000 mgr.x (mgr.34562) 3194 : cluster [DBG] pgmap v1993: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:45:08.157 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:45:08.158 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (67m) 2m ago 70m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:45:08.158 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (70m) 2m ago 70m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:45:08.158 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (68m) 2m ago 73m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:45:08.158 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (67m) 2m ago 75m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:45:08.159 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 2m ago 75m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:45:08.159 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (73m) 2m ago 73m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:45:08.159 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (74m) 2m ago 74m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:45:08.159 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (71m) 2m ago 71m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:45:08.159 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (71m) 2m ago 71m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:45:08.160 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (73m) 2m ago 73m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:45:08.160 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (73m) 2m ago 73m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:45:08.160 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (72m) 2m ago 72m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:45:08.160 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (72m) 2m ago 72m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:45:08.161 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (72m) 2m ago 72m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:45:08.161 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (72m) 2m ago 72m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:45:08.161 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (71m) 2m ago 71m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:45:08.161 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (71m) 2m ago 71m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:45:08.161 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (70m) 2m ago 71m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:45:08.455 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:45:08.455 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:45:08.456 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:45:08.456 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:45:08.456 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:45:08.456 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:45:08.456 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:45:08.457 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:45:08.457 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:45:08.457 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:45:08.457 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:45:08.457 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:45:08.458 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:45:08.458 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:45:08.458 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:45:08.458 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:45:08.458 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:45:09.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:45:09 smithi132 bash[27079]: audit 2020-07-16T14:45:07.880695+0000 mgr.x (mgr.34562) 3195 : audit [DBG] from='client.26962 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:45:09.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:45:09 smithi132 bash[27079]: audit 2020-07-16T14:45:08.152989+0000 mgr.x (mgr.34562) 3196 : audit [DBG] from='client.26968 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:45:09.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:45:09 smithi132 bash[27079]: cluster 2020-07-16T14:45:08.383203+0000 mgr.x (mgr.34562) 3197 : cluster [DBG] pgmap v1994: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:45:09.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:45:09 smithi132 bash[27079]: audit 2020-07-16T14:45:08.454148+0000 mon.c (mon.1) 252 : audit [DBG] from='client.? 172.21.15.132:0/3596699488' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:45:09.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:45:09 smithi188 bash[23329]: audit 2020-07-16T14:45:07.880695+0000 mgr.x (mgr.34562) 3195 : audit [DBG] from='client.26962 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:45:09.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:45:09 smithi188 bash[23329]: audit 2020-07-16T14:45:08.152989+0000 mgr.x (mgr.34562) 3196 : audit [DBG] from='client.26968 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:45:09.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:45:09 smithi188 bash[23329]: cluster 2020-07-16T14:45:08.383203+0000 mgr.x (mgr.34562) 3197 : cluster [DBG] pgmap v1994: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:45:09.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:45:09 smithi188 bash[23329]: audit 2020-07-16T14:45:08.454148+0000 mon.c (mon.1) 252 : audit [DBG] from='client.? 172.21.15.132:0/3596699488' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:45:11.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:45:10 smithi188 bash[23329]: cluster 2020-07-16T14:45:10.383570+0000 mgr.x (mgr.34562) 3198 : cluster [DBG] pgmap v1995: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:45:11.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:45:10 smithi132 bash[27079]: cluster 2020-07-16T14:45:10.383570+0000 mgr.x (mgr.34562) 3198 : cluster [DBG] pgmap v1995: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:45:13.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:45:13 smithi132 bash[27079]: cluster 2020-07-16T14:45:12.384012+0000 mgr.x (mgr.34562) 3199 : cluster [DBG] pgmap v1996: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:45:13.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:45:13 smithi188 bash[23329]: cluster 2020-07-16T14:45:12.384012+0000 mgr.x (mgr.34562) 3199 : cluster [DBG] pgmap v1996: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:45:15.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:45:15 smithi132 bash[27079]: cluster 2020-07-16T14:45:14.384521+0000 mgr.x (mgr.34562) 3200 : cluster [DBG] pgmap v1997: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:45:15.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:45:15 smithi188 bash[23329]: cluster 2020-07-16T14:45:14.384521+0000 mgr.x (mgr.34562) 3200 : cluster [DBG] pgmap v1997: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:45:17.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:45:17 smithi132 bash[27079]: cluster 2020-07-16T14:45:16.384948+0000 mgr.x (mgr.34562) 3201 : cluster [DBG] pgmap v1998: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:45:17.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:45:17 smithi188 bash[23329]: cluster 2020-07-16T14:45:16.384948+0000 mgr.x (mgr.34562) 3201 : cluster [DBG] pgmap v1998: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:45:18.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:45:18 smithi132 bash[27079]: audit 2020-07-16T14:45:18.431700+0000 mon.b (mon.2) 771 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:45:18.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:45:18 smithi132 bash[27079]: audit 2020-07-16T14:45:18.433114+0000 mon.b (mon.2) 772 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:45:18.782 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:45:18 smithi132 bash[27079]: audit 2020-07-16T14:45:18.434241+0000 mon.b (mon.2) 773 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:45:18.782 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:45:18 smithi132 bash[27079]: audit 2020-07-16T14:45:18.435671+0000 mon.b (mon.2) 774 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:45:18.782 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:45:18 smithi132 bash[27079]: audit 2020-07-16T14:45:18.436903+0000 mon.b (mon.2) 775 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:45:18.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:45:18 smithi188 bash[23329]: audit 2020-07-16T14:45:18.431700+0000 mon.b (mon.2) 771 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:45:18.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:45:18 smithi188 bash[23329]: audit 2020-07-16T14:45:18.433114+0000 mon.b (mon.2) 772 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:45:18.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:45:18 smithi188 bash[23329]: audit 2020-07-16T14:45:18.434241+0000 mon.b (mon.2) 773 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:45:18.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:45:18 smithi188 bash[23329]: audit 2020-07-16T14:45:18.435671+0000 mon.b (mon.2) 774 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:45:18.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:45:18 smithi188 bash[23329]: audit 2020-07-16T14:45:18.436903+0000 mon.b (mon.2) 775 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:45:19.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:45:19 smithi132 bash[27079]: cluster 2020-07-16T14:45:18.385458+0000 mgr.x (mgr.34562) 3202 : cluster [DBG] pgmap v1999: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:45:19.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:45:19 smithi132 bash[27079]: audit 2020-07-16T14:45:18.432086+0000 mgr.x (mgr.34562) 3203 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:45:19.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:45:19 smithi132 bash[27079]: audit 2020-07-16T14:45:18.433418+0000 mgr.x (mgr.34562) 3204 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:45:19.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:45:19 smithi132 bash[27079]: audit 2020-07-16T14:45:18.434520+0000 mgr.x (mgr.34562) 3205 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:45:19.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:45:19 smithi132 bash[27079]: cephadm 2020-07-16T14:45:18.435228+0000 mgr.x (mgr.34562) 3206 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:45:19.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:45:19 smithi132 bash[27079]: cephadm 2020-07-16T14:45:18.436485+0000 mgr.x (mgr.34562) 3207 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:45:19.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:45:19 smithi132 bash[27079]: cephadm 2020-07-16T14:45:18.437607+0000 mgr.x (mgr.34562) 3208 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:45:19.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:45:19 smithi132 bash[27079]: cephadm 2020-07-16T14:45:18.437694+0000 mgr.x (mgr.34562) 3209 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:45:19.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:45:19 smithi188 bash[23329]: cluster 2020-07-16T14:45:18.385458+0000 mgr.x (mgr.34562) 3202 : cluster [DBG] pgmap v1999: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:45:19.925 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:45:19 smithi188 bash[23329]: audit 2020-07-16T14:45:18.432086+0000 mgr.x (mgr.34562) 3203 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:45:19.925 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:45:19 smithi188 bash[23329]: audit 2020-07-16T14:45:18.433418+0000 mgr.x (mgr.34562) 3204 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:45:19.926 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:45:19 smithi188 bash[23329]: audit 2020-07-16T14:45:18.434520+0000 mgr.x (mgr.34562) 3205 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:45:19.926 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:45:19 smithi188 bash[23329]: cephadm 2020-07-16T14:45:18.435228+0000 mgr.x (mgr.34562) 3206 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:45:19.926 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:45:19 smithi188 bash[23329]: cephadm 2020-07-16T14:45:18.436485+0000 mgr.x (mgr.34562) 3207 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:45:19.927 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:45:19 smithi188 bash[23329]: cephadm 2020-07-16T14:45:18.437607+0000 mgr.x (mgr.34562) 3208 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:45:19.927 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:45:19 smithi188 bash[23329]: cephadm 2020-07-16T14:45:18.437694+0000 mgr.x (mgr.34562) 3209 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:45:21.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:45:20 smithi132 bash[27079]: cluster 2020-07-16T14:45:20.385946+0000 mgr.x (mgr.34562) 3210 : cluster [DBG] pgmap v2000: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:45:21.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:45:20 smithi188 bash[23329]: cluster 2020-07-16T14:45:20.385946+0000 mgr.x (mgr.34562) 3210 : cluster [DBG] pgmap v2000: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:45:22.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:45:21 smithi188 bash[23329]: audit 2020-07-16T14:45:21.227527+0000 mon.b (mon.2) 776 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:45:22.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:45:21 smithi188 bash[23329]: cephadm 2020-07-16T14:45:21.228191+0000 mgr.x (mgr.34562) 3211 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:45:22.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:45:21 smithi188 bash[23329]: cephadm 2020-07-16T14:45:21.228584+0000 mgr.x (mgr.34562) 3212 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:45:22.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:45:21 smithi132 bash[27079]: audit 2020-07-16T14:45:21.227527+0000 mon.b (mon.2) 776 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:45:22.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:45:21 smithi132 bash[27079]: cephadm 2020-07-16T14:45:21.228191+0000 mgr.x (mgr.34562) 3211 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:45:22.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:45:21 smithi132 bash[27079]: cephadm 2020-07-16T14:45:21.228584+0000 mgr.x (mgr.34562) 3212 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:45:23.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:45:22 smithi188 bash[23329]: cluster 2020-07-16T14:45:22.386452+0000 mgr.x (mgr.34562) 3213 : cluster [DBG] pgmap v2001: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:45:23.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:45:22 smithi132 bash[27079]: cluster 2020-07-16T14:45:22.386452+0000 mgr.x (mgr.34562) 3213 : cluster [DBG] pgmap v2001: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:45:25.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:45:25 smithi132 bash[27079]: cluster 2020-07-16T14:45:24.386821+0000 mgr.x (mgr.34562) 3214 : cluster [DBG] pgmap v2002: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:45:25.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:45:25 smithi188 bash[23329]: cluster 2020-07-16T14:45:24.386821+0000 mgr.x (mgr.34562) 3214 : cluster [DBG] pgmap v2002: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:45:27.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:45:27 smithi132 bash[27079]: cluster 2020-07-16T14:45:26.387351+0000 mgr.x (mgr.34562) 3215 : cluster [DBG] pgmap v2003: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:45:27.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:45:27 smithi188 bash[23329]: cluster 2020-07-16T14:45:26.387351+0000 mgr.x (mgr.34562) 3215 : cluster [DBG] pgmap v2003: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:45:29.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:45:29 smithi132 bash[27079]: cluster 2020-07-16T14:45:28.387714+0000 mgr.x (mgr.34562) 3216 : cluster [DBG] pgmap v2004: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:45:29.927 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:45:29 smithi188 bash[23329]: cluster 2020-07-16T14:45:28.387714+0000 mgr.x (mgr.34562) 3216 : cluster [DBG] pgmap v2004: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:45:31.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:45:30 smithi188 bash[23329]: cluster 2020-07-16T14:45:30.388057+0000 mgr.x (mgr.34562) 3217 : cluster [DBG] pgmap v2005: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:45:31.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:45:30 smithi132 bash[27079]: cluster 2020-07-16T14:45:30.388057+0000 mgr.x (mgr.34562) 3217 : cluster [DBG] pgmap v2005: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:45:33.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:45:33 smithi132 bash[27079]: cluster 2020-07-16T14:45:32.388606+0000 mgr.x (mgr.34562) 3218 : cluster [DBG] pgmap v2006: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:45:33.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:45:33 smithi188 bash[23329]: cluster 2020-07-16T14:45:32.388606+0000 mgr.x (mgr.34562) 3218 : cluster [DBG] pgmap v2006: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:45:35.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:45:35 smithi132 bash[27079]: cluster 2020-07-16T14:45:34.389002+0000 mgr.x (mgr.34562) 3219 : cluster [DBG] pgmap v2007: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:45:35.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:45:35 smithi188 bash[23329]: cluster 2020-07-16T14:45:34.389002+0000 mgr.x (mgr.34562) 3219 : cluster [DBG] pgmap v2007: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:45:36.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:45:36 smithi132 bash[27079]: audit 2020-07-16T14:45:36.244045+0000 mon.b (mon.2) 777 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:45:36.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:45:36 smithi188 bash[23329]: audit 2020-07-16T14:45:36.244045+0000 mon.b (mon.2) 777 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:45:37.787 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:45:37 smithi132 bash[27079]: cephadm 2020-07-16T14:45:36.244691+0000 mgr.x (mgr.34562) 3220 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:45:37.787 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:45:37 smithi132 bash[27079]: cephadm 2020-07-16T14:45:36.244908+0000 mgr.x (mgr.34562) 3221 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:45:37.787 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:45:37 smithi132 bash[27079]: cluster 2020-07-16T14:45:36.389535+0000 mgr.x (mgr.34562) 3222 : cluster [DBG] pgmap v2008: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:45:37.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:45:37 smithi188 bash[23329]: cephadm 2020-07-16T14:45:36.244691+0000 mgr.x (mgr.34562) 3220 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:45:37.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:45:37 smithi188 bash[23329]: cephadm 2020-07-16T14:45:36.244908+0000 mgr.x (mgr.34562) 3221 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:45:37.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:45:37 smithi188 bash[23329]: cluster 2020-07-16T14:45:36.389535+0000 mgr.x (mgr.34562) 3222 : cluster [DBG] pgmap v2008: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:45:38.755 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:45:39.013 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:45:39.014 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (68m) 3m ago 71m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:45:39.014 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (71m) 3m ago 71m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:45:39.014 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (68m) 3m ago 74m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:45:39.015 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (68m) 3m ago 75m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:45:39.015 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 3m ago 76m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:45:39.015 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (74m) 3m ago 74m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:45:39.015 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (74m) 3m ago 74m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:45:39.015 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (71m) 3m ago 71m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:45:39.015 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (71m) 3m ago 71m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:45:39.016 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (73m) 3m ago 74m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:45:39.016 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (73m) 3m ago 73m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:45:39.016 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (73m) 3m ago 73m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:45:39.016 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (73m) 3m ago 73m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:45:39.016 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (72m) 3m ago 72m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:45:39.017 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (72m) 3m ago 72m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:45:39.017 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (72m) 3m ago 72m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:45:39.017 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (72m) 3m ago 72m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:45:39.017 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (70m) 3m ago 71m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:45:39.312 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:45:39.312 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:45:39.313 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:45:39.313 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:45:39.313 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:45:39.314 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:45:39.314 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:45:39.314 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:45:39.315 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:45:39.318 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:45:39.318 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:45:39.318 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:45:39.319 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:45:39.319 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:45:39.319 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:45:39.319 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:45:39.319 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:45:39.784 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:45:39 smithi132 bash[27079]: cluster 2020-07-16T14:45:38.390101+0000 mgr.x (mgr.34562) 3223 : cluster [DBG] pgmap v2009: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:45:39.784 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:45:39 smithi132 bash[27079]: audit 2020-07-16T14:45:39.310556+0000 mon.c (mon.1) 253 : audit [DBG] from='client.? 172.21.15.132:0/739746773' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:45:39.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:45:39 smithi188 bash[23329]: cluster 2020-07-16T14:45:38.390101+0000 mgr.x (mgr.34562) 3223 : cluster [DBG] pgmap v2009: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:45:39.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:45:39 smithi188 bash[23329]: audit 2020-07-16T14:45:39.310556+0000 mon.c (mon.1) 253 : audit [DBG] from='client.? 172.21.15.132:0/739746773' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:45:40.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:45:40 smithi132 bash[27079]: audit 2020-07-16T14:45:38.743381+0000 mgr.x (mgr.34562) 3224 : audit [DBG] from='client.26980 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:45:40.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:45:40 smithi132 bash[27079]: audit 2020-07-16T14:45:39.009523+0000 mgr.x (mgr.34562) 3225 : audit [DBG] from='client.26986 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:45:40.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:45:40 smithi188 bash[23329]: audit 2020-07-16T14:45:38.743381+0000 mgr.x (mgr.34562) 3224 : audit [DBG] from='client.26980 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:45:40.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:45:40 smithi188 bash[23329]: audit 2020-07-16T14:45:39.009523+0000 mgr.x (mgr.34562) 3225 : audit [DBG] from='client.26986 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:45:41.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:45:41 smithi132 bash[27079]: cluster 2020-07-16T14:45:40.390483+0000 mgr.x (mgr.34562) 3226 : cluster [DBG] pgmap v2010: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:45:41.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:45:41 smithi188 bash[23329]: cluster 2020-07-16T14:45:40.390483+0000 mgr.x (mgr.34562) 3226 : cluster [DBG] pgmap v2010: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:45:43.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:45:43 smithi132 bash[27079]: cluster 2020-07-16T14:45:42.390880+0000 mgr.x (mgr.34562) 3227 : cluster [DBG] pgmap v2011: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:45:43.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:45:43 smithi188 bash[23329]: cluster 2020-07-16T14:45:42.390880+0000 mgr.x (mgr.34562) 3227 : cluster [DBG] pgmap v2011: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:45:45.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:45:45 smithi132 bash[27079]: cluster 2020-07-16T14:45:44.391333+0000 mgr.x (mgr.34562) 3228 : cluster [DBG] pgmap v2012: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:45:45.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:45:45 smithi188 bash[23329]: cluster 2020-07-16T14:45:44.391333+0000 mgr.x (mgr.34562) 3228 : cluster [DBG] pgmap v2012: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:45:47.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:45:47 smithi132 bash[27079]: cluster 2020-07-16T14:45:46.391669+0000 mgr.x (mgr.34562) 3229 : cluster [DBG] pgmap v2013: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:45:47.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:45:47 smithi188 bash[23329]: cluster 2020-07-16T14:45:46.391669+0000 mgr.x (mgr.34562) 3229 : cluster [DBG] pgmap v2013: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:45:49.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:45:49 smithi132 bash[27079]: cluster 2020-07-16T14:45:48.392193+0000 mgr.x (mgr.34562) 3230 : cluster [DBG] pgmap v2014: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:45:49.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:45:49 smithi188 bash[23329]: cluster 2020-07-16T14:45:48.392193+0000 mgr.x (mgr.34562) 3230 : cluster [DBG] pgmap v2014: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:45:51.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:45:50 smithi188 bash[23329]: cluster 2020-07-16T14:45:50.392619+0000 mgr.x (mgr.34562) 3231 : cluster [DBG] pgmap v2015: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:45:51.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:45:50 smithi132 bash[27079]: cluster 2020-07-16T14:45:50.392619+0000 mgr.x (mgr.34562) 3231 : cluster [DBG] pgmap v2015: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:45:52.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:45:51 smithi188 bash[23329]: audit 2020-07-16T14:45:51.256987+0000 mon.b (mon.2) 778 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:45:52.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:45:51 smithi188 bash[23329]: cephadm 2020-07-16T14:45:51.257707+0000 mgr.x (mgr.34562) 3232 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:45:52.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:45:51 smithi188 bash[23329]: cephadm 2020-07-16T14:45:51.257782+0000 mgr.x (mgr.34562) 3233 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:45:52.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:45:51 smithi132 bash[27079]: audit 2020-07-16T14:45:51.256987+0000 mon.b (mon.2) 778 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:45:52.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:45:51 smithi132 bash[27079]: cephadm 2020-07-16T14:45:51.257707+0000 mgr.x (mgr.34562) 3232 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:45:52.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:45:51 smithi132 bash[27079]: cephadm 2020-07-16T14:45:51.257782+0000 mgr.x (mgr.34562) 3233 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:45:53.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:45:52 smithi188 bash[23329]: cluster 2020-07-16T14:45:52.393089+0000 mgr.x (mgr.34562) 3234 : cluster [DBG] pgmap v2016: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:45:53.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:45:52 smithi132 bash[27079]: cluster 2020-07-16T14:45:52.393089+0000 mgr.x (mgr.34562) 3234 : cluster [DBG] pgmap v2016: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:45:55.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:45:55 smithi132 bash[27079]: cluster 2020-07-16T14:45:54.393511+0000 mgr.x (mgr.34562) 3235 : cluster [DBG] pgmap v2017: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:45:55.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:45:55 smithi188 bash[23329]: cluster 2020-07-16T14:45:54.393511+0000 mgr.x (mgr.34562) 3235 : cluster [DBG] pgmap v2017: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:45:57.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:45:57 smithi132 bash[27079]: cluster 2020-07-16T14:45:56.393900+0000 mgr.x (mgr.34562) 3236 : cluster [DBG] pgmap v2018: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:45:57.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:45:57 smithi188 bash[23329]: cluster 2020-07-16T14:45:56.393900+0000 mgr.x (mgr.34562) 3236 : cluster [DBG] pgmap v2018: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:45:59.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:45:59 smithi132 bash[27079]: cluster 2020-07-16T14:45:58.394356+0000 mgr.x (mgr.34562) 3237 : cluster [DBG] pgmap v2019: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:45:59.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:45:59 smithi188 bash[23329]: cluster 2020-07-16T14:45:58.394356+0000 mgr.x (mgr.34562) 3237 : cluster [DBG] pgmap v2019: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:46:01.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:46:00 smithi188 bash[23329]: cluster 2020-07-16T14:46:00.394859+0000 mgr.x (mgr.34562) 3238 : cluster [DBG] pgmap v2020: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:46:01.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:46:00 smithi132 bash[27079]: cluster 2020-07-16T14:46:00.394859+0000 mgr.x (mgr.34562) 3238 : cluster [DBG] pgmap v2020: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:46:03.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:46:03 smithi132 bash[27079]: cluster 2020-07-16T14:46:02.395357+0000 mgr.x (mgr.34562) 3239 : cluster [DBG] pgmap v2021: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:46:03.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:46:03 smithi188 bash[23329]: cluster 2020-07-16T14:46:02.395357+0000 mgr.x (mgr.34562) 3239 : cluster [DBG] pgmap v2021: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:46:05.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:46:05 smithi132 bash[27079]: cluster 2020-07-16T14:46:04.395793+0000 mgr.x (mgr.34562) 3240 : cluster [DBG] pgmap v2022: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:46:05.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:46:05 smithi188 bash[23329]: cluster 2020-07-16T14:46:04.395793+0000 mgr.x (mgr.34562) 3240 : cluster [DBG] pgmap v2022: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:46:06.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:46:06 smithi132 bash[27079]: audit 2020-07-16T14:46:06.273604+0000 mon.b (mon.2) 779 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:46:06.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:46:06 smithi188 bash[23329]: audit 2020-07-16T14:46:06.273604+0000 mon.b (mon.2) 779 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:46:07.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:46:07 smithi132 bash[27079]: cephadm 2020-07-16T14:46:06.274303+0000 mgr.x (mgr.34562) 3241 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:46:07.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:46:07 smithi132 bash[27079]: cephadm 2020-07-16T14:46:06.274630+0000 mgr.x (mgr.34562) 3242 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:46:07.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:46:07 smithi132 bash[27079]: cluster 2020-07-16T14:46:06.396240+0000 mgr.x (mgr.34562) 3243 : cluster [DBG] pgmap v2023: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:46:07.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:46:07 smithi188 bash[23329]: cephadm 2020-07-16T14:46:06.274303+0000 mgr.x (mgr.34562) 3241 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:46:07.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:46:07 smithi188 bash[23329]: cephadm 2020-07-16T14:46:06.274630+0000 mgr.x (mgr.34562) 3242 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:46:07.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:46:07 smithi188 bash[23329]: cluster 2020-07-16T14:46:06.396240+0000 mgr.x (mgr.34562) 3243 : cluster [DBG] pgmap v2023: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:46:09.610 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:46:09.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:46:09 smithi132 bash[27079]: cluster 2020-07-16T14:46:08.396715+0000 mgr.x (mgr.34562) 3244 : cluster [DBG] pgmap v2024: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:46:09.885 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:46:09.885 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (68m) 4m ago 71m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:46:09.885 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (71m) 4m ago 71m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:46:09.886 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (69m) 4m ago 74m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:46:09.886 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (68m) 4m ago 76m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:46:09.886 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 4m ago 76m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:46:09.886 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (74m) 4m ago 74m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:46:09.886 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (75m) 4m ago 75m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:46:09.887 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (72m) 4m ago 72m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:46:09.887 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (72m) 4m ago 72m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:46:09.887 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (74m) 4m ago 74m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:46:09.887 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (74m) 4m ago 74m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:46:09.887 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (73m) 4m ago 73m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:46:09.887 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (73m) 4m ago 73m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:46:09.888 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (73m) 4m ago 73m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:46:09.888 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (73m) 4m ago 73m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:46:09.888 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (72m) 4m ago 72m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:46:09.888 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (72m) 4m ago 72m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:46:09.888 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (71m) 4m ago 72m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:46:09.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:46:09 smithi188 bash[23329]: cluster 2020-07-16T14:46:08.396715+0000 mgr.x (mgr.34562) 3244 : cluster [DBG] pgmap v2024: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:46:10.184 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:46:10.185 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:46:10.185 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:46:10.185 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:46:10.185 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:46:10.185 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:46:10.186 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:46:10.186 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:46:10.186 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:46:10.186 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:46:10.186 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:46:10.187 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:46:10.187 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:46:10.187 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:46:10.187 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:46:10.187 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:46:10.188 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:46:11.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:46:10 smithi188 bash[23329]: audit 2020-07-16T14:46:09.598389+0000 mgr.x (mgr.34562) 3245 : audit [DBG] from='client.26998 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:46:11.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:46:10 smithi188 bash[23329]: audit 2020-07-16T14:46:09.880654+0000 mgr.x (mgr.34562) 3246 : audit [DBG] from='client.27004 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:46:11.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:46:10 smithi188 bash[23329]: audit 2020-07-16T14:46:10.182728+0000 mon.c (mon.1) 254 : audit [DBG] from='client.? 172.21.15.132:0/1957048706' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:46:11.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:46:10 smithi188 bash[23329]: cluster 2020-07-16T14:46:10.397177+0000 mgr.x (mgr.34562) 3247 : cluster [DBG] pgmap v2025: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:46:11.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:46:10 smithi132 bash[27079]: audit 2020-07-16T14:46:09.598389+0000 mgr.x (mgr.34562) 3245 : audit [DBG] from='client.26998 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:46:11.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:46:10 smithi132 bash[27079]: audit 2020-07-16T14:46:09.880654+0000 mgr.x (mgr.34562) 3246 : audit [DBG] from='client.27004 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:46:11.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:46:10 smithi132 bash[27079]: audit 2020-07-16T14:46:10.182728+0000 mon.c (mon.1) 254 : audit [DBG] from='client.? 172.21.15.132:0/1957048706' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:46:11.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:46:10 smithi132 bash[27079]: cluster 2020-07-16T14:46:10.397177+0000 mgr.x (mgr.34562) 3247 : cluster [DBG] pgmap v2025: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:46:13.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:46:13 smithi132 bash[27079]: cluster 2020-07-16T14:46:12.397643+0000 mgr.x (mgr.34562) 3248 : cluster [DBG] pgmap v2026: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:46:13.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:46:13 smithi188 bash[23329]: cluster 2020-07-16T14:46:12.397643+0000 mgr.x (mgr.34562) 3248 : cluster [DBG] pgmap v2026: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:46:15.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:46:15 smithi132 bash[27079]: cluster 2020-07-16T14:46:14.398153+0000 mgr.x (mgr.34562) 3249 : cluster [DBG] pgmap v2027: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:46:15.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:46:15 smithi188 bash[23329]: cluster 2020-07-16T14:46:14.398153+0000 mgr.x (mgr.34562) 3249 : cluster [DBG] pgmap v2027: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:46:17.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:46:17 smithi132 bash[27079]: cluster 2020-07-16T14:46:16.398620+0000 mgr.x (mgr.34562) 3250 : cluster [DBG] pgmap v2028: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:46:17.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:46:17 smithi188 bash[23329]: cluster 2020-07-16T14:46:16.398620+0000 mgr.x (mgr.34562) 3250 : cluster [DBG] pgmap v2028: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:46:19.790 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:46:19 smithi132 bash[27079]: cluster 2020-07-16T14:46:18.399109+0000 mgr.x (mgr.34562) 3251 : cluster [DBG] pgmap v2029: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:46:19.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:46:19 smithi188 bash[23329]: cluster 2020-07-16T14:46:18.399109+0000 mgr.x (mgr.34562) 3251 : cluster [DBG] pgmap v2029: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:46:21.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:46:20 smithi188 bash[23329]: cluster 2020-07-16T14:46:20.399590+0000 mgr.x (mgr.34562) 3252 : cluster [DBG] pgmap v2030: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:46:21.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:46:20 smithi132 bash[27079]: cluster 2020-07-16T14:46:20.399590+0000 mgr.x (mgr.34562) 3252 : cluster [DBG] pgmap v2030: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:46:22.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:46:21 smithi188 bash[23329]: audit 2020-07-16T14:46:21.290825+0000 mon.b (mon.2) 780 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:46:22.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:46:21 smithi188 bash[23329]: audit 2020-07-16T14:46:21.291199+0000 mgr.x (mgr.34562) 3253 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:46:22.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:46:21 smithi188 bash[23329]: audit 2020-07-16T14:46:21.292231+0000 mon.b (mon.2) 781 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:46:22.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:46:21 smithi188 bash[23329]: audit 2020-07-16T14:46:21.292555+0000 mgr.x (mgr.34562) 3254 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:46:22.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:46:21 smithi188 bash[23329]: audit 2020-07-16T14:46:21.293418+0000 mon.b (mon.2) 782 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:46:22.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:46:21 smithi188 bash[23329]: audit 2020-07-16T14:46:21.293722+0000 mgr.x (mgr.34562) 3255 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:46:22.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:46:21 smithi188 bash[23329]: cephadm 2020-07-16T14:46:21.294407+0000 mgr.x (mgr.34562) 3256 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:46:22.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:46:21 smithi188 bash[23329]: audit 2020-07-16T14:46:21.294832+0000 mon.b (mon.2) 783 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:46:22.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:46:21 smithi188 bash[23329]: cephadm 2020-07-16T14:46:21.295692+0000 mgr.x (mgr.34562) 3257 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:46:22.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:46:21 smithi188 bash[23329]: audit 2020-07-16T14:46:21.296057+0000 mon.b (mon.2) 784 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:46:22.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:46:21 smithi188 bash[23329]: cephadm 2020-07-16T14:46:21.296755+0000 mgr.x (mgr.34562) 3258 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:46:22.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:46:21 smithi188 bash[23329]: cephadm 2020-07-16T14:46:21.297030+0000 mgr.x (mgr.34562) 3259 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:46:22.201 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:46:21 smithi132 bash[27079]: audit 2020-07-16T14:46:21.290825+0000 mon.b (mon.2) 780 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:46:22.201 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:46:21 smithi132 bash[27079]: audit 2020-07-16T14:46:21.291199+0000 mgr.x (mgr.34562) 3253 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:46:22.201 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:46:21 smithi132 bash[27079]: audit 2020-07-16T14:46:21.292231+0000 mon.b (mon.2) 781 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:46:22.202 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:46:21 smithi132 bash[27079]: audit 2020-07-16T14:46:21.292555+0000 mgr.x (mgr.34562) 3254 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:46:22.202 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:46:21 smithi132 bash[27079]: audit 2020-07-16T14:46:21.293418+0000 mon.b (mon.2) 782 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:46:22.202 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:46:21 smithi132 bash[27079]: audit 2020-07-16T14:46:21.293722+0000 mgr.x (mgr.34562) 3255 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:46:22.203 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:46:21 smithi132 bash[27079]: cephadm 2020-07-16T14:46:21.294407+0000 mgr.x (mgr.34562) 3256 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:46:22.203 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:46:21 smithi132 bash[27079]: audit 2020-07-16T14:46:21.294832+0000 mon.b (mon.2) 783 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:46:22.203 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:46:21 smithi132 bash[27079]: cephadm 2020-07-16T14:46:21.295692+0000 mgr.x (mgr.34562) 3257 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:46:22.203 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:46:21 smithi132 bash[27079]: audit 2020-07-16T14:46:21.296057+0000 mon.b (mon.2) 784 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:46:22.203 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:46:21 smithi132 bash[27079]: cephadm 2020-07-16T14:46:21.296755+0000 mgr.x (mgr.34562) 3258 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:46:22.204 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:46:21 smithi132 bash[27079]: cephadm 2020-07-16T14:46:21.297030+0000 mgr.x (mgr.34562) 3259 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:46:23.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:46:22 smithi188 bash[23329]: cluster 2020-07-16T14:46:22.400146+0000 mgr.x (mgr.34562) 3260 : cluster [DBG] pgmap v2031: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:46:23.209 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:46:22 smithi132 bash[27079]: cluster 2020-07-16T14:46:22.400146+0000 mgr.x (mgr.34562) 3260 : cluster [DBG] pgmap v2031: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:46:24.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:46:24 smithi132 bash[27079]: audit 2020-07-16T14:46:24.029784+0000 mon.b (mon.2) 785 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:46:24.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:46:24 smithi188 bash[23329]: audit 2020-07-16T14:46:24.029784+0000 mon.b (mon.2) 785 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:46:25.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:46:25 smithi188 bash[23329]: cephadm 2020-07-16T14:46:24.030480+0000 mgr.x (mgr.34562) 3261 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:46:25.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:46:25 smithi188 bash[23329]: cephadm 2020-07-16T14:46:24.030740+0000 mgr.x (mgr.34562) 3262 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:46:25.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:46:25 smithi188 bash[23329]: cluster 2020-07-16T14:46:24.400529+0000 mgr.x (mgr.34562) 3263 : cluster [DBG] pgmap v2032: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:46:25.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:46:25 smithi132 bash[27079]: cephadm 2020-07-16T14:46:24.030480+0000 mgr.x (mgr.34562) 3261 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:46:25.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:46:25 smithi132 bash[27079]: cephadm 2020-07-16T14:46:24.030740+0000 mgr.x (mgr.34562) 3262 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:46:25.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:46:25 smithi132 bash[27079]: cluster 2020-07-16T14:46:24.400529+0000 mgr.x (mgr.34562) 3263 : cluster [DBG] pgmap v2032: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:46:27.786 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:46:27 smithi132 bash[27079]: cluster 2020-07-16T14:46:26.400883+0000 mgr.x (mgr.34562) 3264 : cluster [DBG] pgmap v2033: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:46:27.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:46:27 smithi188 bash[23329]: cluster 2020-07-16T14:46:26.400883+0000 mgr.x (mgr.34562) 3264 : cluster [DBG] pgmap v2033: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:46:29.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:46:29 smithi132 bash[27079]: cluster 2020-07-16T14:46:28.401300+0000 mgr.x (mgr.34562) 3265 : cluster [DBG] pgmap v2034: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:46:29.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:46:29 smithi188 bash[23329]: cluster 2020-07-16T14:46:28.401300+0000 mgr.x (mgr.34562) 3265 : cluster [DBG] pgmap v2034: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:46:31.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:46:30 smithi188 bash[23329]: cluster 2020-07-16T14:46:30.401769+0000 mgr.x (mgr.34562) 3266 : cluster [DBG] pgmap v2035: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:46:31.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:46:30 smithi132 bash[27079]: cluster 2020-07-16T14:46:30.401769+0000 mgr.x (mgr.34562) 3266 : cluster [DBG] pgmap v2035: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:46:33.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:46:33 smithi132 bash[27079]: cluster 2020-07-16T14:46:32.402148+0000 mgr.x (mgr.34562) 3267 : cluster [DBG] pgmap v2036: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:46:33.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:46:33 smithi188 bash[23329]: cluster 2020-07-16T14:46:32.402148+0000 mgr.x (mgr.34562) 3267 : cluster [DBG] pgmap v2036: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:46:35.782 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:46:35 smithi132 bash[27079]: cluster 2020-07-16T14:46:34.402569+0000 mgr.x (mgr.34562) 3268 : cluster [DBG] pgmap v2037: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:46:35.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:46:35 smithi188 bash[23329]: cluster 2020-07-16T14:46:34.402569+0000 mgr.x (mgr.34562) 3268 : cluster [DBG] pgmap v2037: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:46:37.783 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:46:37 smithi132 bash[27079]: cluster 2020-07-16T14:46:36.403004+0000 mgr.x (mgr.34562) 3269 : cluster [DBG] pgmap v2038: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:46:37.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:46:37 smithi188 bash[23329]: cluster 2020-07-16T14:46:36.403004+0000 mgr.x (mgr.34562) 3269 : cluster [DBG] pgmap v2038: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:46:39.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:46:39 smithi132 bash[27079]: cluster 2020-07-16T14:46:38.403403+0000 mgr.x (mgr.34562) 3270 : cluster [DBG] pgmap v2039: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:46:39.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:46:39 smithi132 bash[27079]: audit 2020-07-16T14:46:39.046458+0000 mon.b (mon.2) 786 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:46:39.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:46:39 smithi188 bash[23329]: cluster 2020-07-16T14:46:38.403403+0000 mgr.x (mgr.34562) 3270 : cluster [DBG] pgmap v2039: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:46:39.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:46:39 smithi188 bash[23329]: audit 2020-07-16T14:46:39.046458+0000 mon.b (mon.2) 786 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:46:40.484 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:46:40.747 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:46:40.747 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (69m) 4m ago 72m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:46:40.747 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (72m) 4m ago 72m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:46:40.748 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (69m) 4m ago 75m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:46:40.748 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (69m) 4m ago 77m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:46:40.748 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 4m ago 77m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:46:40.748 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (75m) 4m ago 75m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:46:40.749 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (75m) 4m ago 75m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:46:40.749 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (72m) 4m ago 72m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:46:40.749 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (72m) 4m ago 72m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:46:40.749 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (75m) 4m ago 75m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:46:40.749 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (74m) 4m ago 74m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:46:40.750 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (74m) 4m ago 74m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:46:40.750 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (74m) 4m ago 74m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:46:40.750 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (73m) 4m ago 73m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:46:40.750 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (73m) 4m ago 73m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:46:40.750 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (73m) 4m ago 73m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:46:40.750 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (73m) 4m ago 73m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:46:40.751 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (71m) 4m ago 72m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:46:40.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:46:40 smithi132 bash[27079]: cephadm 2020-07-16T14:46:39.047227+0000 mgr.x (mgr.34562) 3271 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:46:40.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:46:40 smithi132 bash[27079]: cephadm 2020-07-16T14:46:39.047784+0000 mgr.x (mgr.34562) 3272 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:46:40.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:46:40 smithi188 bash[23329]: cephadm 2020-07-16T14:46:39.047227+0000 mgr.x (mgr.34562) 3271 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:46:40.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:46:40 smithi188 bash[23329]: cephadm 2020-07-16T14:46:39.047784+0000 mgr.x (mgr.34562) 3272 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:46:41.050 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:46:41.050 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:46:41.051 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:46:41.051 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:46:41.051 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:46:41.051 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:46:41.052 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:46:41.052 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:46:41.052 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:46:41.052 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:46:41.052 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:46:41.052 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:46:41.053 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:46:41.053 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:46:41.053 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:46:41.053 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:46:41.053 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:46:41.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:46:41 smithi132 bash[27079]: cluster 2020-07-16T14:46:40.403796+0000 mgr.x (mgr.34562) 3273 : cluster [DBG] pgmap v2040: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:46:41.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:46:41 smithi132 bash[27079]: audit 2020-07-16T14:46:40.472271+0000 mgr.x (mgr.34562) 3274 : audit [DBG] from='client.27016 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:46:41.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:46:41 smithi132 bash[27079]: audit 2020-07-16T14:46:41.042246+0000 mon.c (mon.1) 255 : audit [DBG] from='client.? 172.21.15.132:0/1735256544' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:46:41.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:46:41 smithi188 bash[23329]: cluster 2020-07-16T14:46:40.403796+0000 mgr.x (mgr.34562) 3273 : cluster [DBG] pgmap v2040: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:46:41.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:46:41 smithi188 bash[23329]: audit 2020-07-16T14:46:40.472271+0000 mgr.x (mgr.34562) 3274 : audit [DBG] from='client.27016 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:46:41.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:46:41 smithi188 bash[23329]: audit 2020-07-16T14:46:41.042246+0000 mon.c (mon.1) 255 : audit [DBG] from='client.? 172.21.15.132:0/1735256544' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:46:42.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:46:42 smithi132 bash[27079]: audit 2020-07-16T14:46:40.742993+0000 mgr.x (mgr.34562) 3275 : audit [DBG] from='client.27022 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:46:42.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:46:42 smithi188 bash[23329]: audit 2020-07-16T14:46:40.742993+0000 mgr.x (mgr.34562) 3275 : audit [DBG] from='client.27022 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:46:43.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:46:43 smithi132 bash[27079]: cluster 2020-07-16T14:46:42.404349+0000 mgr.x (mgr.34562) 3276 : cluster [DBG] pgmap v2041: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:46:43.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:46:43 smithi188 bash[23329]: cluster 2020-07-16T14:46:42.404349+0000 mgr.x (mgr.34562) 3276 : cluster [DBG] pgmap v2041: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:46:45.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:46:45 smithi132 bash[27079]: cluster 2020-07-16T14:46:44.404750+0000 mgr.x (mgr.34562) 3277 : cluster [DBG] pgmap v2042: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:46:45.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:46:45 smithi188 bash[23329]: cluster 2020-07-16T14:46:44.404750+0000 mgr.x (mgr.34562) 3277 : cluster [DBG] pgmap v2042: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:46:47.782 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:46:47 smithi132 bash[27079]: cluster 2020-07-16T14:46:46.405218+0000 mgr.x (mgr.34562) 3278 : cluster [DBG] pgmap v2043: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:46:47.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:46:47 smithi188 bash[23329]: cluster 2020-07-16T14:46:46.405218+0000 mgr.x (mgr.34562) 3278 : cluster [DBG] pgmap v2043: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:46:49.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:46:49 smithi132 bash[27079]: cluster 2020-07-16T14:46:48.405713+0000 mgr.x (mgr.34562) 3279 : cluster [DBG] pgmap v2044: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:46:49.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:46:49 smithi188 bash[23329]: cluster 2020-07-16T14:46:48.405713+0000 mgr.x (mgr.34562) 3279 : cluster [DBG] pgmap v2044: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:46:51.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:46:50 smithi188 bash[23329]: cluster 2020-07-16T14:46:50.406053+0000 mgr.x (mgr.34562) 3280 : cluster [DBG] pgmap v2045: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:46:51.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:46:50 smithi132 bash[27079]: cluster 2020-07-16T14:46:50.406053+0000 mgr.x (mgr.34562) 3280 : cluster [DBG] pgmap v2045: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:46:53.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:46:53 smithi132 bash[27079]: cluster 2020-07-16T14:46:52.406536+0000 mgr.x (mgr.34562) 3281 : cluster [DBG] pgmap v2046: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:46:53.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:46:53 smithi188 bash[23329]: cluster 2020-07-16T14:46:52.406536+0000 mgr.x (mgr.34562) 3281 : cluster [DBG] pgmap v2046: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:46:54.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:46:54 smithi132 bash[27079]: audit 2020-07-16T14:46:54.054514+0000 mon.b (mon.2) 787 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:46:54.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:46:54 smithi188 bash[23329]: audit 2020-07-16T14:46:54.054514+0000 mon.b (mon.2) 787 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:46:55.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:46:55 smithi132 bash[27079]: cephadm 2020-07-16T14:46:54.055257+0000 mgr.x (mgr.34562) 3282 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:46:55.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:46:55 smithi132 bash[27079]: cephadm 2020-07-16T14:46:54.055516+0000 mgr.x (mgr.34562) 3283 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:46:55.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:46:55 smithi132 bash[27079]: cluster 2020-07-16T14:46:54.407018+0000 mgr.x (mgr.34562) 3284 : cluster [DBG] pgmap v2047: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:46:55.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:46:55 smithi188 bash[23329]: cephadm 2020-07-16T14:46:54.055257+0000 mgr.x (mgr.34562) 3282 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:46:55.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:46:55 smithi188 bash[23329]: cephadm 2020-07-16T14:46:54.055516+0000 mgr.x (mgr.34562) 3283 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:46:55.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:46:55 smithi188 bash[23329]: cluster 2020-07-16T14:46:54.407018+0000 mgr.x (mgr.34562) 3284 : cluster [DBG] pgmap v2047: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:46:57.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:46:57 smithi132 bash[27079]: cluster 2020-07-16T14:46:56.407367+0000 mgr.x (mgr.34562) 3285 : cluster [DBG] pgmap v2048: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:46:57.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:46:57 smithi188 bash[23329]: cluster 2020-07-16T14:46:56.407367+0000 mgr.x (mgr.34562) 3285 : cluster [DBG] pgmap v2048: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:46:59.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:46:59 smithi132 bash[27079]: cluster 2020-07-16T14:46:58.407887+0000 mgr.x (mgr.34562) 3286 : cluster [DBG] pgmap v2049: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:46:59.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:46:59 smithi188 bash[23329]: cluster 2020-07-16T14:46:58.407887+0000 mgr.x (mgr.34562) 3286 : cluster [DBG] pgmap v2049: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:47:01.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:47:00 smithi188 bash[23329]: cluster 2020-07-16T14:47:00.408445+0000 mgr.x (mgr.34562) 3287 : cluster [DBG] pgmap v2050: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:47:01.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:47:00 smithi132 bash[27079]: cluster 2020-07-16T14:47:00.408445+0000 mgr.x (mgr.34562) 3287 : cluster [DBG] pgmap v2050: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:47:03.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:47:03 smithi132 bash[27079]: cluster 2020-07-16T14:47:02.408835+0000 mgr.x (mgr.34562) 3288 : cluster [DBG] pgmap v2051: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:47:03.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:47:03 smithi188 bash[23329]: cluster 2020-07-16T14:47:02.408835+0000 mgr.x (mgr.34562) 3288 : cluster [DBG] pgmap v2051: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:47:05.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:47:05 smithi132 bash[27079]: cluster 2020-07-16T14:47:04.409335+0000 mgr.x (mgr.34562) 3289 : cluster [DBG] pgmap v2052: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:47:05.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:47:05 smithi188 bash[23329]: cluster 2020-07-16T14:47:04.409335+0000 mgr.x (mgr.34562) 3289 : cluster [DBG] pgmap v2052: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:47:07.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:47:07 smithi132 bash[27079]: cluster 2020-07-16T14:47:06.409644+0000 mgr.x (mgr.34562) 3290 : cluster [DBG] pgmap v2053: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:47:07.926 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:47:07 smithi188 bash[23329]: cluster 2020-07-16T14:47:06.409644+0000 mgr.x (mgr.34562) 3290 : cluster [DBG] pgmap v2053: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:47:09.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:47:09 smithi132 bash[27079]: cluster 2020-07-16T14:47:08.410117+0000 mgr.x (mgr.34562) 3291 : cluster [DBG] pgmap v2054: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:47:09.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:47:09 smithi132 bash[27079]: audit 2020-07-16T14:47:09.071110+0000 mon.b (mon.2) 788 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:47:09.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:47:09 smithi188 bash[23329]: cluster 2020-07-16T14:47:08.410117+0000 mgr.x (mgr.34562) 3291 : cluster [DBG] pgmap v2054: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:47:09.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:47:09 smithi188 bash[23329]: audit 2020-07-16T14:47:09.071110+0000 mon.b (mon.2) 788 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:47:10.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:47:10 smithi132 bash[27079]: cephadm 2020-07-16T14:47:09.071810+0000 mgr.x (mgr.34562) 3292 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:47:10.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:47:10 smithi132 bash[27079]: cephadm 2020-07-16T14:47:09.072023+0000 mgr.x (mgr.34562) 3293 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:47:10.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:47:10 smithi188 bash[23329]: cephadm 2020-07-16T14:47:09.071810+0000 mgr.x (mgr.34562) 3292 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:47:10.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:47:10 smithi188 bash[23329]: cephadm 2020-07-16T14:47:09.072023+0000 mgr.x (mgr.34562) 3293 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:47:11.344 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:47:11.607 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:47:11.607 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (69m) 5m ago 72m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:47:11.608 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (72m) 5m ago 72m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:47:11.608 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (70m) 5m ago 75m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:47:11.608 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (69m) 5m ago 77m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:47:11.609 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 5m ago 77m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:47:11.609 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (76m) 5m ago 76m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:47:11.609 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (76m) 5m ago 76m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:47:11.611 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (73m) 5m ago 73m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:47:11.615 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (73m) 5m ago 73m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:47:11.616 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (75m) 5m ago 75m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:47:11.616 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (75m) 5m ago 75m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:47:11.616 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (74m) 5m ago 75m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:47:11.617 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (74m) 5m ago 74m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:47:11.617 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (74m) 5m ago 74m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:47:11.617 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (74m) 5m ago 74m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:47:11.618 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (73m) 5m ago 73m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:47:11.618 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (73m) 5m ago 73m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:47:11.621 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (72m) 5m ago 73m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:47:11.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:47:11 smithi132 bash[27079]: cluster 2020-07-16T14:47:10.410509+0000 mgr.x (mgr.34562) 3294 : cluster [DBG] pgmap v2055: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:47:11.908 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:47:11.909 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:47:11.909 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:47:11.909 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:47:11.910 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:47:11.910 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:47:11.910 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:47:11.910 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:47:11.910 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:47:11.911 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:47:11.911 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:47:11.911 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:47:11.911 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:47:11.911 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:47:11.911 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:47:11.912 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:47:11.912 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:47:11.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:47:11 smithi188 bash[23329]: cluster 2020-07-16T14:47:10.410509+0000 mgr.x (mgr.34562) 3294 : cluster [DBG] pgmap v2055: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:47:12.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:47:12 smithi132 bash[27079]: audit 2020-07-16T14:47:11.330035+0000 mgr.x (mgr.34562) 3295 : audit [DBG] from='client.27034 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:47:12.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:47:12 smithi132 bash[27079]: audit 2020-07-16T14:47:11.906411+0000 mon.c (mon.1) 256 : audit [DBG] from='client.? 172.21.15.132:0/2180646160' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:47:12.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:47:12 smithi188 bash[23329]: audit 2020-07-16T14:47:11.330035+0000 mgr.x (mgr.34562) 3295 : audit [DBG] from='client.27034 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:47:12.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:47:12 smithi188 bash[23329]: audit 2020-07-16T14:47:11.906411+0000 mon.c (mon.1) 256 : audit [DBG] from='client.? 172.21.15.132:0/2180646160' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:47:13.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:47:13 smithi132 bash[27079]: audit 2020-07-16T14:47:11.601054+0000 mgr.x (mgr.34562) 3296 : audit [DBG] from='client.27040 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:47:13.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:47:13 smithi132 bash[27079]: cluster 2020-07-16T14:47:12.410875+0000 mgr.x (mgr.34562) 3297 : cluster [DBG] pgmap v2056: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:47:13.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:47:13 smithi188 bash[23329]: audit 2020-07-16T14:47:11.601054+0000 mgr.x (mgr.34562) 3296 : audit [DBG] from='client.27040 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:47:13.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:47:13 smithi188 bash[23329]: cluster 2020-07-16T14:47:12.410875+0000 mgr.x (mgr.34562) 3297 : cluster [DBG] pgmap v2056: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:47:15.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:47:15 smithi132 bash[27079]: cluster 2020-07-16T14:47:14.411406+0000 mgr.x (mgr.34562) 3298 : cluster [DBG] pgmap v2057: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:47:15.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:47:15 smithi188 bash[23329]: cluster 2020-07-16T14:47:14.411406+0000 mgr.x (mgr.34562) 3298 : cluster [DBG] pgmap v2057: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:47:17.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:47:17 smithi132 bash[27079]: cluster 2020-07-16T14:47:16.411978+0000 mgr.x (mgr.34562) 3299 : cluster [DBG] pgmap v2058: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:47:17.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:47:17 smithi188 bash[23329]: cluster 2020-07-16T14:47:16.411978+0000 mgr.x (mgr.34562) 3299 : cluster [DBG] pgmap v2058: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:47:19.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:47:19 smithi132 bash[27079]: cluster 2020-07-16T14:47:18.412447+0000 mgr.x (mgr.34562) 3300 : cluster [DBG] pgmap v2059: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:47:19.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:47:19 smithi188 bash[23329]: cluster 2020-07-16T14:47:18.412447+0000 mgr.x (mgr.34562) 3300 : cluster [DBG] pgmap v2059: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:47:21.175 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:47:20 smithi188 bash[23329]: cluster 2020-07-16T14:47:20.412822+0000 mgr.x (mgr.34562) 3301 : cluster [DBG] pgmap v2060: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:47:21.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:47:20 smithi132 bash[27079]: cluster 2020-07-16T14:47:20.412822+0000 mgr.x (mgr.34562) 3301 : cluster [DBG] pgmap v2060: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:47:23.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:47:23 smithi132 bash[27079]: cluster 2020-07-16T14:47:22.413216+0000 mgr.x (mgr.34562) 3302 : cluster [DBG] pgmap v2061: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:47:23.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:47:23 smithi188 bash[23329]: cluster 2020-07-16T14:47:22.413216+0000 mgr.x (mgr.34562) 3302 : cluster [DBG] pgmap v2061: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:47:24.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:47:24 smithi132 bash[27079]: audit 2020-07-16T14:47:24.088563+0000 mon.b (mon.2) 789 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:47:24.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:47:24 smithi132 bash[27079]: audit 2020-07-16T14:47:24.090044+0000 mon.b (mon.2) 790 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:47:24.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:47:24 smithi132 bash[27079]: audit 2020-07-16T14:47:24.091243+0000 mon.b (mon.2) 791 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:47:24.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:47:24 smithi132 bash[27079]: audit 2020-07-16T14:47:24.092542+0000 mon.b (mon.2) 792 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:47:24.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:47:24 smithi132 bash[27079]: audit 2020-07-16T14:47:24.093838+0000 mon.b (mon.2) 793 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:47:24.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:47:24 smithi188 bash[23329]: audit 2020-07-16T14:47:24.088563+0000 mon.b (mon.2) 789 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:47:24.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:47:24 smithi188 bash[23329]: audit 2020-07-16T14:47:24.090044+0000 mon.b (mon.2) 790 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:47:24.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:47:24 smithi188 bash[23329]: audit 2020-07-16T14:47:24.091243+0000 mon.b (mon.2) 791 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:47:24.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:47:24 smithi188 bash[23329]: audit 2020-07-16T14:47:24.092542+0000 mon.b (mon.2) 792 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:47:24.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:47:24 smithi188 bash[23329]: audit 2020-07-16T14:47:24.093838+0000 mon.b (mon.2) 793 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:47:25.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:47:25 smithi132 bash[27079]: audit 2020-07-16T14:47:24.088930+0000 mgr.x (mgr.34562) 3303 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:47:25.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:47:25 smithi132 bash[27079]: audit 2020-07-16T14:47:24.090369+0000 mgr.x (mgr.34562) 3304 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:47:25.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:47:25 smithi132 bash[27079]: audit 2020-07-16T14:47:24.091510+0000 mgr.x (mgr.34562) 3305 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:47:25.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:47:25 smithi132 bash[27079]: cephadm 2020-07-16T14:47:24.092199+0000 mgr.x (mgr.34562) 3306 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:47:25.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:47:25 smithi132 bash[27079]: cephadm 2020-07-16T14:47:24.093404+0000 mgr.x (mgr.34562) 3307 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:47:25.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:47:25 smithi132 bash[27079]: cephadm 2020-07-16T14:47:24.094546+0000 mgr.x (mgr.34562) 3308 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:47:25.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:47:25 smithi132 bash[27079]: cephadm 2020-07-16T14:47:24.094720+0000 mgr.x (mgr.34562) 3309 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:47:25.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:47:25 smithi132 bash[27079]: cluster 2020-07-16T14:47:24.413534+0000 mgr.x (mgr.34562) 3310 : cluster [DBG] pgmap v2062: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:47:25.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:47:25 smithi188 bash[23329]: audit 2020-07-16T14:47:24.088930+0000 mgr.x (mgr.34562) 3303 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:47:25.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:47:25 smithi188 bash[23329]: audit 2020-07-16T14:47:24.090369+0000 mgr.x (mgr.34562) 3304 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:47:25.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:47:25 smithi188 bash[23329]: audit 2020-07-16T14:47:24.091510+0000 mgr.x (mgr.34562) 3305 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:47:25.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:47:25 smithi188 bash[23329]: cephadm 2020-07-16T14:47:24.092199+0000 mgr.x (mgr.34562) 3306 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:47:25.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:47:25 smithi188 bash[23329]: cephadm 2020-07-16T14:47:24.093404+0000 mgr.x (mgr.34562) 3307 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:47:25.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:47:25 smithi188 bash[23329]: cephadm 2020-07-16T14:47:24.094546+0000 mgr.x (mgr.34562) 3308 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:47:25.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:47:25 smithi188 bash[23329]: cephadm 2020-07-16T14:47:24.094720+0000 mgr.x (mgr.34562) 3309 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:47:25.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:47:25 smithi188 bash[23329]: cluster 2020-07-16T14:47:24.413534+0000 mgr.x (mgr.34562) 3310 : cluster [DBG] pgmap v2062: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:47:27.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:47:27 smithi132 bash[27079]: cluster 2020-07-16T14:47:26.413900+0000 mgr.x (mgr.34562) 3311 : cluster [DBG] pgmap v2063: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:47:27.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:47:27 smithi132 bash[27079]: audit 2020-07-16T14:47:26.776498+0000 mon.b (mon.2) 794 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:47:27.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:47:27 smithi188 bash[23329]: cluster 2020-07-16T14:47:26.413900+0000 mgr.x (mgr.34562) 3311 : cluster [DBG] pgmap v2063: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:47:27.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:47:27 smithi188 bash[23329]: audit 2020-07-16T14:47:26.776498+0000 mon.b (mon.2) 794 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:47:28.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:47:28 smithi132 bash[27079]: cephadm 2020-07-16T14:47:26.777136+0000 mgr.x (mgr.34562) 3312 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:47:28.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:47:28 smithi132 bash[27079]: cephadm 2020-07-16T14:47:26.777578+0000 mgr.x (mgr.34562) 3313 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:47:28.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:47:28 smithi188 bash[23329]: cephadm 2020-07-16T14:47:26.777136+0000 mgr.x (mgr.34562) 3312 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:47:28.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:47:28 smithi188 bash[23329]: cephadm 2020-07-16T14:47:26.777578+0000 mgr.x (mgr.34562) 3313 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:47:29.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:47:29 smithi132 bash[27079]: cluster 2020-07-16T14:47:28.414321+0000 mgr.x (mgr.34562) 3314 : cluster [DBG] pgmap v2064: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:47:29.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:47:29 smithi188 bash[23329]: cluster 2020-07-16T14:47:28.414321+0000 mgr.x (mgr.34562) 3314 : cluster [DBG] pgmap v2064: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:47:31.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:47:30 smithi188 bash[23329]: cluster 2020-07-16T14:47:30.414651+0000 mgr.x (mgr.34562) 3315 : cluster [DBG] pgmap v2065: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:47:31.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:47:30 smithi132 bash[27079]: cluster 2020-07-16T14:47:30.414651+0000 mgr.x (mgr.34562) 3315 : cluster [DBG] pgmap v2065: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:47:33.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:47:33 smithi132 bash[27079]: cluster 2020-07-16T14:47:32.415069+0000 mgr.x (mgr.34562) 3316 : cluster [DBG] pgmap v2066: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:47:33.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:47:33 smithi188 bash[23329]: cluster 2020-07-16T14:47:32.415069+0000 mgr.x (mgr.34562) 3316 : cluster [DBG] pgmap v2066: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:47:35.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:47:35 smithi132 bash[27079]: cluster 2020-07-16T14:47:34.415589+0000 mgr.x (mgr.34562) 3317 : cluster [DBG] pgmap v2067: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:47:35.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:47:35 smithi188 bash[23329]: cluster 2020-07-16T14:47:34.415589+0000 mgr.x (mgr.34562) 3317 : cluster [DBG] pgmap v2067: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:47:37.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:47:37 smithi132 bash[27079]: cluster 2020-07-16T14:47:36.416067+0000 mgr.x (mgr.34562) 3318 : cluster [DBG] pgmap v2068: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:47:37.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:47:37 smithi188 bash[23329]: cluster 2020-07-16T14:47:36.416067+0000 mgr.x (mgr.34562) 3318 : cluster [DBG] pgmap v2068: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:47:39.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:47:39 smithi132 bash[27079]: cluster 2020-07-16T14:47:38.416481+0000 mgr.x (mgr.34562) 3319 : cluster [DBG] pgmap v2069: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:47:39.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:47:39 smithi188 bash[23329]: cluster 2020-07-16T14:47:38.416481+0000 mgr.x (mgr.34562) 3319 : cluster [DBG] pgmap v2069: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:47:41.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:47:40 smithi188 bash[23329]: cluster 2020-07-16T14:47:40.416968+0000 mgr.x (mgr.34562) 3320 : cluster [DBG] pgmap v2070: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:47:41.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:47:40 smithi132 bash[27079]: cluster 2020-07-16T14:47:40.416968+0000 mgr.x (mgr.34562) 3320 : cluster [DBG] pgmap v2070: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:47:42.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:47:41 smithi188 bash[23329]: audit 2020-07-16T14:47:41.793029+0000 mon.b (mon.2) 795 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:47:42.206 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:47:42.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:47:41 smithi132 bash[27079]: audit 2020-07-16T14:47:41.793029+0000 mon.b (mon.2) 795 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:47:42.467 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:47:42.467 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (70m) 5m ago 73m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:47:42.467 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (73m) 5m ago 73m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:47:42.468 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (70m) 5m ago 76m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:47:42.468 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (70m) 5m ago 78m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:47:42.468 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 5m ago 78m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:47:42.468 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (76m) 5m ago 76m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:47:42.468 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (76m) 5m ago 76m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:47:42.469 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (73m) 5m ago 73m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:47:42.469 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (73m) 5m ago 73m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:47:42.469 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (76m) 5m ago 76m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:47:42.469 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (75m) 5m ago 75m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:47:42.469 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (75m) 5m ago 75m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:47:42.470 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (75m) 5m ago 75m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:47:42.470 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (74m) 5m ago 75m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:47:42.470 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (74m) 5m ago 74m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:47:42.470 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (74m) 5m ago 74m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:47:42.471 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (74m) 5m ago 74m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:47:42.471 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (72m) 5m ago 73m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:47:42.767 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:47:42.767 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:47:42.768 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:47:42.768 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:47:42.768 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:47:42.769 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:47:42.769 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:47:42.769 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:47:42.770 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:47:42.770 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:47:42.770 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:47:42.771 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:47:42.771 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:47:42.771 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:47:42.772 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:47:42.772 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:47:42.772 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:47:43.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:47:42 smithi188 bash[23329]: cephadm 2020-07-16T14:47:41.793744+0000 mgr.x (mgr.34562) 3321 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:47:43.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:47:42 smithi188 bash[23329]: cephadm 2020-07-16T14:47:41.793941+0000 mgr.x (mgr.34562) 3322 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:47:43.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:47:42 smithi188 bash[23329]: audit 2020-07-16T14:47:42.194051+0000 mgr.x (mgr.34562) 3323 : audit [DBG] from='client.27052 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:47:43.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:47:42 smithi188 bash[23329]: cluster 2020-07-16T14:47:42.417348+0000 mgr.x (mgr.34562) 3324 : cluster [DBG] pgmap v2071: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:47:43.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:47:42 smithi188 bash[23329]: audit 2020-07-16T14:47:42.462832+0000 mgr.x (mgr.34562) 3325 : audit [DBG] from='client.27058 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:47:43.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:47:42 smithi188 bash[23329]: audit 2020-07-16T14:47:42.766114+0000 mon.c (mon.1) 257 : audit [DBG] from='client.? 172.21.15.132:0/2307181399' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:47:43.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:47:42 smithi132 bash[27079]: cephadm 2020-07-16T14:47:41.793744+0000 mgr.x (mgr.34562) 3321 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:47:43.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:47:42 smithi132 bash[27079]: cephadm 2020-07-16T14:47:41.793941+0000 mgr.x (mgr.34562) 3322 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:47:43.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:47:42 smithi132 bash[27079]: audit 2020-07-16T14:47:42.194051+0000 mgr.x (mgr.34562) 3323 : audit [DBG] from='client.27052 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:47:43.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:47:42 smithi132 bash[27079]: cluster 2020-07-16T14:47:42.417348+0000 mgr.x (mgr.34562) 3324 : cluster [DBG] pgmap v2071: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:47:43.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:47:42 smithi132 bash[27079]: audit 2020-07-16T14:47:42.462832+0000 mgr.x (mgr.34562) 3325 : audit [DBG] from='client.27058 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:47:43.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:47:42 smithi132 bash[27079]: audit 2020-07-16T14:47:42.766114+0000 mon.c (mon.1) 257 : audit [DBG] from='client.? 172.21.15.132:0/2307181399' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:47:45.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:47:45 smithi132 bash[27079]: cluster 2020-07-16T14:47:44.417749+0000 mgr.x (mgr.34562) 3326 : cluster [DBG] pgmap v2072: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:47:45.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:47:45 smithi188 bash[23329]: cluster 2020-07-16T14:47:44.417749+0000 mgr.x (mgr.34562) 3326 : cluster [DBG] pgmap v2072: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:47:47.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:47:47 smithi132 bash[27079]: cluster 2020-07-16T14:47:46.418231+0000 mgr.x (mgr.34562) 3327 : cluster [DBG] pgmap v2073: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:47:47.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:47:47 smithi188 bash[23329]: cluster 2020-07-16T14:47:46.418231+0000 mgr.x (mgr.34562) 3327 : cluster [DBG] pgmap v2073: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:47:49.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:47:49 smithi132 bash[27079]: cluster 2020-07-16T14:47:48.418591+0000 mgr.x (mgr.34562) 3328 : cluster [DBG] pgmap v2074: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:47:49.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:47:49 smithi188 bash[23329]: cluster 2020-07-16T14:47:48.418591+0000 mgr.x (mgr.34562) 3328 : cluster [DBG] pgmap v2074: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:47:51.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:47:50 smithi188 bash[23329]: cluster 2020-07-16T14:47:50.418930+0000 mgr.x (mgr.34562) 3329 : cluster [DBG] pgmap v2075: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:47:51.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:47:50 smithi132 bash[27079]: cluster 2020-07-16T14:47:50.418930+0000 mgr.x (mgr.34562) 3329 : cluster [DBG] pgmap v2075: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:47:53.782 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:47:53 smithi132 bash[27079]: cluster 2020-07-16T14:47:52.419321+0000 mgr.x (mgr.34562) 3330 : cluster [DBG] pgmap v2076: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:47:53.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:47:53 smithi188 bash[23329]: cluster 2020-07-16T14:47:52.419321+0000 mgr.x (mgr.34562) 3330 : cluster [DBG] pgmap v2076: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:47:55.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:47:55 smithi132 bash[27079]: cluster 2020-07-16T14:47:54.419765+0000 mgr.x (mgr.34562) 3331 : cluster [DBG] pgmap v2077: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:47:55.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:47:55 smithi188 bash[23329]: cluster 2020-07-16T14:47:54.419765+0000 mgr.x (mgr.34562) 3331 : cluster [DBG] pgmap v2077: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:47:57.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:47:57 smithi132 bash[27079]: cluster 2020-07-16T14:47:56.420322+0000 mgr.x (mgr.34562) 3332 : cluster [DBG] pgmap v2078: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:47:57.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:47:57 smithi132 bash[27079]: audit 2020-07-16T14:47:56.809726+0000 mon.b (mon.2) 796 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:47:57.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:47:57 smithi188 bash[23329]: cluster 2020-07-16T14:47:56.420322+0000 mgr.x (mgr.34562) 3332 : cluster [DBG] pgmap v2078: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:47:57.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:47:57 smithi188 bash[23329]: audit 2020-07-16T14:47:56.809726+0000 mon.b (mon.2) 796 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:47:58.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:47:58 smithi132 bash[27079]: cephadm 2020-07-16T14:47:56.810454+0000 mgr.x (mgr.34562) 3333 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:47:58.782 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:47:58 smithi132 bash[27079]: cephadm 2020-07-16T14:47:56.810867+0000 mgr.x (mgr.34562) 3334 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:47:58.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:47:58 smithi188 bash[23329]: cephadm 2020-07-16T14:47:56.810454+0000 mgr.x (mgr.34562) 3333 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:47:58.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:47:58 smithi188 bash[23329]: cephadm 2020-07-16T14:47:56.810867+0000 mgr.x (mgr.34562) 3334 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:47:59.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:47:59 smithi132 bash[27079]: cluster 2020-07-16T14:47:58.420700+0000 mgr.x (mgr.34562) 3335 : cluster [DBG] pgmap v2079: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:47:59.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:47:59 smithi188 bash[23329]: cluster 2020-07-16T14:47:58.420700+0000 mgr.x (mgr.34562) 3335 : cluster [DBG] pgmap v2079: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:48:01.184 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:48:00 smithi188 bash[23329]: cluster 2020-07-16T14:48:00.421275+0000 mgr.x (mgr.34562) 3336 : cluster [DBG] pgmap v2080: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:48:01.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:48:00 smithi132 bash[27079]: cluster 2020-07-16T14:48:00.421275+0000 mgr.x (mgr.34562) 3336 : cluster [DBG] pgmap v2080: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:48:03.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:48:03 smithi132 bash[27079]: cluster 2020-07-16T14:48:02.421851+0000 mgr.x (mgr.34562) 3337 : cluster [DBG] pgmap v2081: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:48:03.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:48:03 smithi188 bash[23329]: cluster 2020-07-16T14:48:02.421851+0000 mgr.x (mgr.34562) 3337 : cluster [DBG] pgmap v2081: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:48:05.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:48:05 smithi132 bash[27079]: cluster 2020-07-16T14:48:04.422215+0000 mgr.x (mgr.34562) 3338 : cluster [DBG] pgmap v2082: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:48:05.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:48:05 smithi188 bash[23329]: cluster 2020-07-16T14:48:04.422215+0000 mgr.x (mgr.34562) 3338 : cluster [DBG] pgmap v2082: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:48:07.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:48:07 smithi132 bash[27079]: cluster 2020-07-16T14:48:06.422622+0000 mgr.x (mgr.34562) 3339 : cluster [DBG] pgmap v2083: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:48:07.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:48:07 smithi188 bash[23329]: cluster 2020-07-16T14:48:06.422622+0000 mgr.x (mgr.34562) 3339 : cluster [DBG] pgmap v2083: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:48:09.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:48:09 smithi132 bash[27079]: cluster 2020-07-16T14:48:08.423061+0000 mgr.x (mgr.34562) 3340 : cluster [DBG] pgmap v2084: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:48:09.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:48:09 smithi188 bash[23329]: cluster 2020-07-16T14:48:08.423061+0000 mgr.x (mgr.34562) 3340 : cluster [DBG] pgmap v2084: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:48:11.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:48:10 smithi188 bash[23329]: cluster 2020-07-16T14:48:10.423448+0000 mgr.x (mgr.34562) 3341 : cluster [DBG] pgmap v2085: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:48:11.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:48:10 smithi132 bash[27079]: cluster 2020-07-16T14:48:10.423448+0000 mgr.x (mgr.34562) 3341 : cluster [DBG] pgmap v2085: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:48:12.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:48:11 smithi188 bash[23329]: audit 2020-07-16T14:48:11.826360+0000 mon.b (mon.2) 797 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:48:12.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:48:11 smithi132 bash[27079]: audit 2020-07-16T14:48:11.826360+0000 mon.b (mon.2) 797 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:48:13.066 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:48:13.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:48:12 smithi188 bash[23329]: cephadm 2020-07-16T14:48:11.827085+0000 mgr.x (mgr.34562) 3342 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:48:13.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:48:12 smithi188 bash[23329]: cephadm 2020-07-16T14:48:11.827506+0000 mgr.x (mgr.34562) 3343 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:48:13.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:48:12 smithi188 bash[23329]: cluster 2020-07-16T14:48:12.423891+0000 mgr.x (mgr.34562) 3344 : cluster [DBG] pgmap v2086: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:48:13.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:48:12 smithi132 bash[27079]: cephadm 2020-07-16T14:48:11.827085+0000 mgr.x (mgr.34562) 3342 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:48:13.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:48:12 smithi132 bash[27079]: cephadm 2020-07-16T14:48:11.827506+0000 mgr.x (mgr.34562) 3343 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:48:13.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:48:12 smithi132 bash[27079]: cluster 2020-07-16T14:48:12.423891+0000 mgr.x (mgr.34562) 3344 : cluster [DBG] pgmap v2086: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:48:13.330 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:48:13.330 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (70m) 6m ago 74m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:48:13.330 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (73m) 6m ago 73m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:48:13.330 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (71m) 6m ago 76m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:48:13.331 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (70m) 6m ago 78m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:48:13.331 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 6m ago 78m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:48:13.331 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (77m) 6m ago 77m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:48:13.331 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (77m) 6m ago 77m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:48:13.331 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (74m) 6m ago 74m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:48:13.332 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (74m) 6m ago 74m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:48:13.332 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (76m) 6m ago 76m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:48:13.332 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (76m) 6m ago 76m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:48:13.332 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (76m) 6m ago 76m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:48:13.332 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (75m) 6m ago 75m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:48:13.333 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (75m) 6m ago 75m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:48:13.333 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (75m) 6m ago 75m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:48:13.333 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (74m) 6m ago 74m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:48:13.334 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (74m) 6m ago 74m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:48:13.334 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (73m) 6m ago 74m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:48:13.628 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:48:13.629 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:48:13.629 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:48:13.629 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:48:13.629 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:48:13.630 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:48:13.630 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:48:13.630 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:48:13.630 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:48:13.631 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:48:13.631 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:48:13.631 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:48:13.631 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:48:13.631 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:48:13.632 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:48:13.632 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:48:13.632 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:48:14.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:48:13 smithi188 bash[23329]: audit 2020-07-16T14:48:13.054933+0000 mgr.x (mgr.34562) 3345 : audit [DBG] from='client.27070 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:48:14.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:48:13 smithi188 bash[23329]: audit 2020-07-16T14:48:13.325639+0000 mgr.x (mgr.34562) 3346 : audit [DBG] from='client.27076 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:48:14.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:48:13 smithi188 bash[23329]: audit 2020-07-16T14:48:13.627565+0000 mon.c (mon.1) 258 : audit [DBG] from='client.? 172.21.15.132:0/892316097' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:48:14.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:48:13 smithi132 bash[27079]: audit 2020-07-16T14:48:13.054933+0000 mgr.x (mgr.34562) 3345 : audit [DBG] from='client.27070 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:48:14.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:48:13 smithi132 bash[27079]: audit 2020-07-16T14:48:13.325639+0000 mgr.x (mgr.34562) 3346 : audit [DBG] from='client.27076 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:48:14.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:48:13 smithi132 bash[27079]: audit 2020-07-16T14:48:13.627565+0000 mon.c (mon.1) 258 : audit [DBG] from='client.? 172.21.15.132:0/892316097' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:48:15.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:48:14 smithi188 bash[23329]: cluster 2020-07-16T14:48:14.424242+0000 mgr.x (mgr.34562) 3347 : cluster [DBG] pgmap v2087: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:48:15.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:48:14 smithi132 bash[27079]: cluster 2020-07-16T14:48:14.424242+0000 mgr.x (mgr.34562) 3347 : cluster [DBG] pgmap v2087: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:48:17.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:48:17 smithi132 bash[27079]: cluster 2020-07-16T14:48:16.424606+0000 mgr.x (mgr.34562) 3348 : cluster [DBG] pgmap v2088: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:48:17.927 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:48:17 smithi188 bash[23329]: cluster 2020-07-16T14:48:16.424606+0000 mgr.x (mgr.34562) 3348 : cluster [DBG] pgmap v2088: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:48:19.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:48:19 smithi132 bash[27079]: cluster 2020-07-16T14:48:18.425048+0000 mgr.x (mgr.34562) 3349 : cluster [DBG] pgmap v2089: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:48:19.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:48:19 smithi188 bash[23329]: cluster 2020-07-16T14:48:18.425048+0000 mgr.x (mgr.34562) 3349 : cluster [DBG] pgmap v2089: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:48:21.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:48:20 smithi188 bash[23329]: cluster 2020-07-16T14:48:20.425444+0000 mgr.x (mgr.34562) 3350 : cluster [DBG] pgmap v2090: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:48:21.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:48:20 smithi132 bash[27079]: cluster 2020-07-16T14:48:20.425444+0000 mgr.x (mgr.34562) 3350 : cluster [DBG] pgmap v2090: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:48:23.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:48:23 smithi132 bash[27079]: cluster 2020-07-16T14:48:22.425778+0000 mgr.x (mgr.34562) 3351 : cluster [DBG] pgmap v2091: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:48:23.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:48:23 smithi188 bash[23329]: cluster 2020-07-16T14:48:22.425778+0000 mgr.x (mgr.34562) 3351 : cluster [DBG] pgmap v2091: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:48:25.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:48:25 smithi132 bash[27079]: cluster 2020-07-16T14:48:24.426118+0000 mgr.x (mgr.34562) 3352 : cluster [DBG] pgmap v2092: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:48:25.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:48:25 smithi188 bash[23329]: cluster 2020-07-16T14:48:24.426118+0000 mgr.x (mgr.34562) 3352 : cluster [DBG] pgmap v2092: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:48:27.648 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:48:27 smithi132 bash[27079]: cluster 2020-07-16T14:48:26.426573+0000 mgr.x (mgr.34562) 3353 : cluster [DBG] pgmap v2093: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:48:27.648 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:48:27 smithi132 bash[27079]: audit 2020-07-16T14:48:26.833399+0000 mon.b (mon.2) 798 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:48:27.648 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:48:27 smithi132 bash[27079]: audit 2020-07-16T14:48:26.834811+0000 mon.b (mon.2) 799 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:48:27.649 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:48:27 smithi132 bash[27079]: audit 2020-07-16T14:48:26.836011+0000 mon.b (mon.2) 800 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:48:27.649 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:48:27 smithi132 bash[27079]: audit 2020-07-16T14:48:26.837463+0000 mon.b (mon.2) 801 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:48:27.649 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:48:27 smithi132 bash[27079]: audit 2020-07-16T14:48:26.838775+0000 mon.b (mon.2) 802 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:48:27.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:48:27 smithi188 bash[23329]: cluster 2020-07-16T14:48:26.426573+0000 mgr.x (mgr.34562) 3353 : cluster [DBG] pgmap v2093: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:48:27.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:48:27 smithi188 bash[23329]: audit 2020-07-16T14:48:26.833399+0000 mon.b (mon.2) 798 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:48:27.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:48:27 smithi188 bash[23329]: audit 2020-07-16T14:48:26.834811+0000 mon.b (mon.2) 799 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:48:27.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:48:27 smithi188 bash[23329]: audit 2020-07-16T14:48:26.836011+0000 mon.b (mon.2) 800 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:48:27.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:48:27 smithi188 bash[23329]: audit 2020-07-16T14:48:26.837463+0000 mon.b (mon.2) 801 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:48:27.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:48:27 smithi188 bash[23329]: audit 2020-07-16T14:48:26.838775+0000 mon.b (mon.2) 802 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:48:28.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:48:28 smithi132 bash[27079]: audit 2020-07-16T14:48:26.833748+0000 mgr.x (mgr.34562) 3354 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:48:28.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:48:28 smithi132 bash[27079]: audit 2020-07-16T14:48:26.835125+0000 mgr.x (mgr.34562) 3355 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:48:28.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:48:28 smithi132 bash[27079]: audit 2020-07-16T14:48:26.836330+0000 mgr.x (mgr.34562) 3356 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:48:28.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:48:28 smithi132 bash[27079]: cephadm 2020-07-16T14:48:26.837111+0000 mgr.x (mgr.34562) 3357 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:48:28.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:48:28 smithi132 bash[27079]: cephadm 2020-07-16T14:48:26.838314+0000 mgr.x (mgr.34562) 3358 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:48:28.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:48:28 smithi132 bash[27079]: cephadm 2020-07-16T14:48:26.839555+0000 mgr.x (mgr.34562) 3359 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:48:28.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:48:28 smithi132 bash[27079]: cephadm 2020-07-16T14:48:26.839862+0000 mgr.x (mgr.34562) 3360 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:48:28.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:48:28 smithi188 bash[23329]: audit 2020-07-16T14:48:26.833748+0000 mgr.x (mgr.34562) 3354 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:48:28.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:48:28 smithi188 bash[23329]: audit 2020-07-16T14:48:26.835125+0000 mgr.x (mgr.34562) 3355 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:48:28.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:48:28 smithi188 bash[23329]: audit 2020-07-16T14:48:26.836330+0000 mgr.x (mgr.34562) 3356 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:48:28.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:48:28 smithi188 bash[23329]: cephadm 2020-07-16T14:48:26.837111+0000 mgr.x (mgr.34562) 3357 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:48:28.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:48:28 smithi188 bash[23329]: cephadm 2020-07-16T14:48:26.838314+0000 mgr.x (mgr.34562) 3358 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:48:28.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:48:28 smithi188 bash[23329]: cephadm 2020-07-16T14:48:26.839555+0000 mgr.x (mgr.34562) 3359 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:48:28.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:48:28 smithi188 bash[23329]: cephadm 2020-07-16T14:48:26.839862+0000 mgr.x (mgr.34562) 3360 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:48:29.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:48:29 smithi132 bash[27079]: cluster 2020-07-16T14:48:28.426970+0000 mgr.x (mgr.34562) 3361 : cluster [DBG] pgmap v2094: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:48:29.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:48:29 smithi188 bash[23329]: cluster 2020-07-16T14:48:28.426970+0000 mgr.x (mgr.34562) 3361 : cluster [DBG] pgmap v2094: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:48:30.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:48:30 smithi132 bash[27079]: audit 2020-07-16T14:48:29.720407+0000 mon.b (mon.2) 803 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:48:30.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:48:30 smithi188 bash[23329]: audit 2020-07-16T14:48:29.720407+0000 mon.b (mon.2) 803 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:48:31.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:48:31 smithi132 bash[27079]: cephadm 2020-07-16T14:48:29.721007+0000 mgr.x (mgr.34562) 3362 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:48:31.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:48:31 smithi132 bash[27079]: cephadm 2020-07-16T14:48:29.721456+0000 mgr.x (mgr.34562) 3363 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:48:31.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:48:31 smithi132 bash[27079]: cluster 2020-07-16T14:48:30.427433+0000 mgr.x (mgr.34562) 3364 : cluster [DBG] pgmap v2095: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:48:31.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:48:31 smithi188 bash[23329]: cephadm 2020-07-16T14:48:29.721007+0000 mgr.x (mgr.34562) 3362 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:48:31.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:48:31 smithi188 bash[23329]: cephadm 2020-07-16T14:48:29.721456+0000 mgr.x (mgr.34562) 3363 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:48:31.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:48:31 smithi188 bash[23329]: cluster 2020-07-16T14:48:30.427433+0000 mgr.x (mgr.34562) 3364 : cluster [DBG] pgmap v2095: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:48:33.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:48:33 smithi132 bash[27079]: cluster 2020-07-16T14:48:32.427825+0000 mgr.x (mgr.34562) 3365 : cluster [DBG] pgmap v2096: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:48:33.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:48:33 smithi188 bash[23329]: cluster 2020-07-16T14:48:32.427825+0000 mgr.x (mgr.34562) 3365 : cluster [DBG] pgmap v2096: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:48:35.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:48:35 smithi132 bash[27079]: cluster 2020-07-16T14:48:34.428193+0000 mgr.x (mgr.34562) 3366 : cluster [DBG] pgmap v2097: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:48:35.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:48:35 smithi188 bash[23329]: cluster 2020-07-16T14:48:34.428193+0000 mgr.x (mgr.34562) 3366 : cluster [DBG] pgmap v2097: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:48:37.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:48:37 smithi132 bash[27079]: cluster 2020-07-16T14:48:36.428687+0000 mgr.x (mgr.34562) 3367 : cluster [DBG] pgmap v2098: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:48:37.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:48:37 smithi188 bash[23329]: cluster 2020-07-16T14:48:36.428687+0000 mgr.x (mgr.34562) 3367 : cluster [DBG] pgmap v2098: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:48:39.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:48:39 smithi132 bash[27079]: cluster 2020-07-16T14:48:38.429221+0000 mgr.x (mgr.34562) 3368 : cluster [DBG] pgmap v2099: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:48:39.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:48:39 smithi188 bash[23329]: cluster 2020-07-16T14:48:38.429221+0000 mgr.x (mgr.34562) 3368 : cluster [DBG] pgmap v2099: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:48:41.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:48:40 smithi188 bash[23329]: cluster 2020-07-16T14:48:40.429753+0000 mgr.x (mgr.34562) 3369 : cluster [DBG] pgmap v2100: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:48:41.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:48:40 smithi132 bash[27079]: cluster 2020-07-16T14:48:40.429753+0000 mgr.x (mgr.34562) 3369 : cluster [DBG] pgmap v2100: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:48:43.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:48:43 smithi132 bash[27079]: cluster 2020-07-16T14:48:42.430236+0000 mgr.x (mgr.34562) 3370 : cluster [DBG] pgmap v2101: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:48:43.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:48:43 smithi188 bash[23329]: cluster 2020-07-16T14:48:42.430236+0000 mgr.x (mgr.34562) 3370 : cluster [DBG] pgmap v2101: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:48:43.932 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:48:44.193 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:48:44.194 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (71m) 6m ago 74m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:48:44.194 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (74m) 6m ago 74m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:48:44.194 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (71m) 6m ago 77m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:48:44.194 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (71m) 6m ago 79m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:48:44.195 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 6m ago 79m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:48:44.195 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (77m) 6m ago 77m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:48:44.195 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (77m) 6m ago 77m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:48:44.195 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (74m) 6m ago 74m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:48:44.195 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (74m) 6m ago 74m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:48:44.196 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (77m) 6m ago 77m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:48:44.196 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (76m) 6m ago 76m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:48:44.196 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (76m) 6m ago 76m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:48:44.196 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (76m) 6m ago 76m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:48:44.196 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (75m) 6m ago 76m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:48:44.197 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (75m) 6m ago 75m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:48:44.197 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (75m) 6m ago 75m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:48:44.197 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (75m) 6m ago 75m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:48:44.197 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (73m) 6m ago 74m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:48:44.488 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:48:44.489 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:48:44.489 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:48:44.489 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:48:44.489 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:48:44.490 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:48:44.490 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:48:44.490 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:48:44.490 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:48:44.490 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:48:44.491 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:48:44.491 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:48:44.491 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:48:44.491 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:48:44.491 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:48:44.491 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:48:44.492 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:48:45.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:48:45 smithi132 bash[27079]: audit 2020-07-16T14:48:43.919481+0000 mgr.x (mgr.34562) 3371 : audit [DBG] from='client.27088 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:48:45.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:48:45 smithi132 bash[27079]: audit 2020-07-16T14:48:44.189425+0000 mgr.x (mgr.34562) 3372 : audit [DBG] from='client.27094 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:48:45.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:48:45 smithi132 bash[27079]: cluster 2020-07-16T14:48:44.430739+0000 mgr.x (mgr.34562) 3373 : cluster [DBG] pgmap v2102: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:48:45.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:48:45 smithi132 bash[27079]: audit 2020-07-16T14:48:44.487738+0000 mon.c (mon.1) 259 : audit [DBG] from='client.? 172.21.15.132:0/3383935439' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:48:45.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:48:45 smithi132 bash[27079]: audit 2020-07-16T14:48:44.736890+0000 mon.b (mon.2) 804 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:48:45.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:48:45 smithi188 bash[23329]: audit 2020-07-16T14:48:43.919481+0000 mgr.x (mgr.34562) 3371 : audit [DBG] from='client.27088 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:48:45.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:48:45 smithi188 bash[23329]: audit 2020-07-16T14:48:44.189425+0000 mgr.x (mgr.34562) 3372 : audit [DBG] from='client.27094 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:48:45.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:48:45 smithi188 bash[23329]: cluster 2020-07-16T14:48:44.430739+0000 mgr.x (mgr.34562) 3373 : cluster [DBG] pgmap v2102: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:48:45.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:48:45 smithi188 bash[23329]: audit 2020-07-16T14:48:44.487738+0000 mon.c (mon.1) 259 : audit [DBG] from='client.? 172.21.15.132:0/3383935439' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:48:45.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:48:45 smithi188 bash[23329]: audit 2020-07-16T14:48:44.736890+0000 mon.b (mon.2) 804 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:48:46.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:48:46 smithi132 bash[27079]: cephadm 2020-07-16T14:48:44.737623+0000 mgr.x (mgr.34562) 3374 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:48:46.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:48:46 smithi132 bash[27079]: cephadm 2020-07-16T14:48:44.737715+0000 mgr.x (mgr.34562) 3375 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:48:46.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:48:46 smithi188 bash[23329]: cephadm 2020-07-16T14:48:44.737623+0000 mgr.x (mgr.34562) 3374 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:48:46.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:48:46 smithi188 bash[23329]: cephadm 2020-07-16T14:48:44.737715+0000 mgr.x (mgr.34562) 3375 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:48:47.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:48:47 smithi132 bash[27079]: cluster 2020-07-16T14:48:46.431147+0000 mgr.x (mgr.34562) 3376 : cluster [DBG] pgmap v2103: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:48:47.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:48:47 smithi188 bash[23329]: cluster 2020-07-16T14:48:46.431147+0000 mgr.x (mgr.34562) 3376 : cluster [DBG] pgmap v2103: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:48:49.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:48:49 smithi132 bash[27079]: cluster 2020-07-16T14:48:48.431528+0000 mgr.x (mgr.34562) 3377 : cluster [DBG] pgmap v2104: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:48:49.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:48:49 smithi188 bash[23329]: cluster 2020-07-16T14:48:48.431528+0000 mgr.x (mgr.34562) 3377 : cluster [DBG] pgmap v2104: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:48:51.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:48:50 smithi188 bash[23329]: cluster 2020-07-16T14:48:50.431977+0000 mgr.x (mgr.34562) 3378 : cluster [DBG] pgmap v2105: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:48:51.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:48:50 smithi132 bash[27079]: cluster 2020-07-16T14:48:50.431977+0000 mgr.x (mgr.34562) 3378 : cluster [DBG] pgmap v2105: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:48:53.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:48:53 smithi132 bash[27079]: cluster 2020-07-16T14:48:52.432611+0000 mgr.x (mgr.34562) 3379 : cluster [DBG] pgmap v2106: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:48:53.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:48:53 smithi188 bash[23329]: cluster 2020-07-16T14:48:52.432611+0000 mgr.x (mgr.34562) 3379 : cluster [DBG] pgmap v2106: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:48:55.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:48:55 smithi132 bash[27079]: cluster 2020-07-16T14:48:54.433048+0000 mgr.x (mgr.34562) 3380 : cluster [DBG] pgmap v2107: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:48:55.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:48:55 smithi188 bash[23329]: cluster 2020-07-16T14:48:54.433048+0000 mgr.x (mgr.34562) 3380 : cluster [DBG] pgmap v2107: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:48:57.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:48:57 smithi132 bash[27079]: cluster 2020-07-16T14:48:56.433440+0000 mgr.x (mgr.34562) 3381 : cluster [DBG] pgmap v2108: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:48:57.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:48:57 smithi188 bash[23329]: cluster 2020-07-16T14:48:56.433440+0000 mgr.x (mgr.34562) 3381 : cluster [DBG] pgmap v2108: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:48:59.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:48:59 smithi132 bash[27079]: cluster 2020-07-16T14:48:58.433851+0000 mgr.x (mgr.34562) 3382 : cluster [DBG] pgmap v2109: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:48:59.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:48:59 smithi188 bash[23329]: cluster 2020-07-16T14:48:58.433851+0000 mgr.x (mgr.34562) 3382 : cluster [DBG] pgmap v2109: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:49:00.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:49:00 smithi132 bash[27079]: audit 2020-07-16T14:48:59.743957+0000 mon.b (mon.2) 805 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:49:00.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:49:00 smithi188 bash[23329]: audit 2020-07-16T14:48:59.743957+0000 mon.b (mon.2) 805 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:49:01.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:49:01 smithi132 bash[27079]: cephadm 2020-07-16T14:48:59.744701+0000 mgr.x (mgr.34562) 3383 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:49:01.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:49:01 smithi132 bash[27079]: cephadm 2020-07-16T14:48:59.745082+0000 mgr.x (mgr.34562) 3384 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:49:01.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:49:01 smithi132 bash[27079]: cluster 2020-07-16T14:49:00.434332+0000 mgr.x (mgr.34562) 3385 : cluster [DBG] pgmap v2110: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:49:01.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:49:01 smithi188 bash[23329]: cephadm 2020-07-16T14:48:59.744701+0000 mgr.x (mgr.34562) 3383 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:49:01.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:49:01 smithi188 bash[23329]: cephadm 2020-07-16T14:48:59.745082+0000 mgr.x (mgr.34562) 3384 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:49:01.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:49:01 smithi188 bash[23329]: cluster 2020-07-16T14:49:00.434332+0000 mgr.x (mgr.34562) 3385 : cluster [DBG] pgmap v2110: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:49:03.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:49:03 smithi132 bash[27079]: cluster 2020-07-16T14:49:02.434819+0000 mgr.x (mgr.34562) 3386 : cluster [DBG] pgmap v2111: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:49:03.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:49:03 smithi188 bash[23329]: cluster 2020-07-16T14:49:02.434819+0000 mgr.x (mgr.34562) 3386 : cluster [DBG] pgmap v2111: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:49:05.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:49:05 smithi132 bash[27079]: cluster 2020-07-16T14:49:04.435312+0000 mgr.x (mgr.34562) 3387 : cluster [DBG] pgmap v2112: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:49:05.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:49:05 smithi188 bash[23329]: cluster 2020-07-16T14:49:04.435312+0000 mgr.x (mgr.34562) 3387 : cluster [DBG] pgmap v2112: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:49:07.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:49:07 smithi132 bash[27079]: cluster 2020-07-16T14:49:06.435750+0000 mgr.x (mgr.34562) 3388 : cluster [DBG] pgmap v2113: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:49:07.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:49:07 smithi188 bash[23329]: cluster 2020-07-16T14:49:06.435750+0000 mgr.x (mgr.34562) 3388 : cluster [DBG] pgmap v2113: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:49:09.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:49:09 smithi132 bash[27079]: cluster 2020-07-16T14:49:08.436225+0000 mgr.x (mgr.34562) 3389 : cluster [DBG] pgmap v2114: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:49:09.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:49:09 smithi188 bash[23329]: cluster 2020-07-16T14:49:08.436225+0000 mgr.x (mgr.34562) 3389 : cluster [DBG] pgmap v2114: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:49:11.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:49:10 smithi188 bash[23329]: cluster 2020-07-16T14:49:10.436557+0000 mgr.x (mgr.34562) 3390 : cluster [DBG] pgmap v2115: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:49:11.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:49:10 smithi132 bash[27079]: cluster 2020-07-16T14:49:10.436557+0000 mgr.x (mgr.34562) 3390 : cluster [DBG] pgmap v2115: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:49:13.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:49:13 smithi132 bash[27079]: cluster 2020-07-16T14:49:12.437008+0000 mgr.x (mgr.34562) 3391 : cluster [DBG] pgmap v2116: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:49:13.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:49:13 smithi188 bash[23329]: cluster 2020-07-16T14:49:12.437008+0000 mgr.x (mgr.34562) 3391 : cluster [DBG] pgmap v2116: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:49:14.798 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:49:15.061 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:49:15.061 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (72m) 7m ago 75m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:49:15.062 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (74m) 7m ago 74m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:49:15.062 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (72m) 7m ago 77m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:49:15.062 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (71m) 7m ago 79m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:49:15.062 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 7m ago 79m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:49:15.063 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (78m) 7m ago 78m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:49:15.063 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (78m) 7m ago 78m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:49:15.063 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (75m) 7m ago 75m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:49:15.063 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (75m) 7m ago 75m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:49:15.063 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (77m) 7m ago 77m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:49:15.064 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (77m) 7m ago 77m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:49:15.064 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (77m) 7m ago 77m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:49:15.064 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (76m) 7m ago 76m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:49:15.064 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (76m) 7m ago 76m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:49:15.064 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (76m) 7m ago 76m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:49:15.064 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (75m) 7m ago 75m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:49:15.065 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (75m) 7m ago 75m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:49:15.065 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (74m) 7m ago 75m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:49:15.361 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:49:15.361 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:49:15.361 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:49:15.362 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:49:15.362 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:49:15.362 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:49:15.362 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:49:15.363 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:49:15.363 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:49:15.363 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:49:15.363 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:49:15.363 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:49:15.364 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:49:15.364 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:49:15.364 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:49:15.364 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:49:15.364 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:49:15.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:49:15 smithi132 bash[27079]: cluster 2020-07-16T14:49:14.437508+0000 mgr.x (mgr.34562) 3392 : cluster [DBG] pgmap v2117: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:49:15.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:49:15 smithi132 bash[27079]: audit 2020-07-16T14:49:14.759460+0000 mon.b (mon.2) 806 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:49:15.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:49:15 smithi132 bash[27079]: audit 2020-07-16T14:49:15.360164+0000 mon.c (mon.1) 260 : audit [DBG] from='client.? 172.21.15.132:0/1257183402' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:49:15.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:49:15 smithi188 bash[23329]: cluster 2020-07-16T14:49:14.437508+0000 mgr.x (mgr.34562) 3392 : cluster [DBG] pgmap v2117: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:49:15.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:49:15 smithi188 bash[23329]: audit 2020-07-16T14:49:14.759460+0000 mon.b (mon.2) 806 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:49:15.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:49:15 smithi188 bash[23329]: audit 2020-07-16T14:49:15.360164+0000 mon.c (mon.1) 260 : audit [DBG] from='client.? 172.21.15.132:0/1257183402' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:49:16.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:49:16 smithi132 bash[27079]: cephadm 2020-07-16T14:49:14.760173+0000 mgr.x (mgr.34562) 3393 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:49:16.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:49:16 smithi132 bash[27079]: cephadm 2020-07-16T14:49:14.760252+0000 mgr.x (mgr.34562) 3394 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:49:16.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:49:16 smithi132 bash[27079]: audit 2020-07-16T14:49:14.786688+0000 mgr.x (mgr.34562) 3395 : audit [DBG] from='client.27106 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:49:16.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:49:16 smithi132 bash[27079]: audit 2020-07-16T14:49:15.057081+0000 mgr.x (mgr.34562) 3396 : audit [DBG] from='client.27112 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:49:16.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:49:16 smithi188 bash[23329]: cephadm 2020-07-16T14:49:14.760173+0000 mgr.x (mgr.34562) 3393 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:49:16.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:49:16 smithi188 bash[23329]: cephadm 2020-07-16T14:49:14.760252+0000 mgr.x (mgr.34562) 3394 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:49:16.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:49:16 smithi188 bash[23329]: audit 2020-07-16T14:49:14.786688+0000 mgr.x (mgr.34562) 3395 : audit [DBG] from='client.27106 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:49:16.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:49:16 smithi188 bash[23329]: audit 2020-07-16T14:49:15.057081+0000 mgr.x (mgr.34562) 3396 : audit [DBG] from='client.27112 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:49:17.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:49:17 smithi132 bash[27079]: cluster 2020-07-16T14:49:16.437982+0000 mgr.x (mgr.34562) 3397 : cluster [DBG] pgmap v2118: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:49:17.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:49:17 smithi188 bash[23329]: cluster 2020-07-16T14:49:16.437982+0000 mgr.x (mgr.34562) 3397 : cluster [DBG] pgmap v2118: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:49:19.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:49:19 smithi132 bash[27079]: cluster 2020-07-16T14:49:18.438442+0000 mgr.x (mgr.34562) 3398 : cluster [DBG] pgmap v2119: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:49:19.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:49:19 smithi188 bash[23329]: cluster 2020-07-16T14:49:18.438442+0000 mgr.x (mgr.34562) 3398 : cluster [DBG] pgmap v2119: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:49:21.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:49:20 smithi188 bash[23329]: cluster 2020-07-16T14:49:20.439029+0000 mgr.x (mgr.34562) 3399 : cluster [DBG] pgmap v2120: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:49:21.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:49:20 smithi132 bash[27079]: cluster 2020-07-16T14:49:20.439029+0000 mgr.x (mgr.34562) 3399 : cluster [DBG] pgmap v2120: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:49:23.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:49:23 smithi132 bash[27079]: cluster 2020-07-16T14:49:22.439545+0000 mgr.x (mgr.34562) 3400 : cluster [DBG] pgmap v2121: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:49:23.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:49:23 smithi188 bash[23329]: cluster 2020-07-16T14:49:22.439545+0000 mgr.x (mgr.34562) 3400 : cluster [DBG] pgmap v2121: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:49:25.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:49:25 smithi132 bash[27079]: cluster 2020-07-16T14:49:24.440005+0000 mgr.x (mgr.34562) 3401 : cluster [DBG] pgmap v2122: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:49:25.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:49:25 smithi188 bash[23329]: cluster 2020-07-16T14:49:24.440005+0000 mgr.x (mgr.34562) 3401 : cluster [DBG] pgmap v2122: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:49:27.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:49:27 smithi132 bash[27079]: cluster 2020-07-16T14:49:26.440452+0000 mgr.x (mgr.34562) 3402 : cluster [DBG] pgmap v2123: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:49:27.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:49:27 smithi188 bash[23329]: cluster 2020-07-16T14:49:26.440452+0000 mgr.x (mgr.34562) 3402 : cluster [DBG] pgmap v2123: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:49:29.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:49:29 smithi132 bash[27079]: cluster 2020-07-16T14:49:28.440966+0000 mgr.x (mgr.34562) 3403 : cluster [DBG] pgmap v2124: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:49:29.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:49:29 smithi188 bash[23329]: cluster 2020-07-16T14:49:28.440966+0000 mgr.x (mgr.34562) 3403 : cluster [DBG] pgmap v2124: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:49:30.506 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:49:30 smithi132 bash[27079]: audit 2020-07-16T14:49:29.778245+0000 mon.b (mon.2) 807 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:49:30.506 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:49:30 smithi132 bash[27079]: audit 2020-07-16T14:49:29.779720+0000 mon.b (mon.2) 808 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:49:30.507 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:49:30 smithi132 bash[27079]: audit 2020-07-16T14:49:29.780889+0000 mon.b (mon.2) 809 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:49:30.507 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:49:30 smithi132 bash[27079]: audit 2020-07-16T14:49:29.782303+0000 mon.b (mon.2) 810 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:49:30.507 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:49:30 smithi132 bash[27079]: audit 2020-07-16T14:49:29.783591+0000 mon.b (mon.2) 811 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:49:30.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:49:30 smithi188 bash[23329]: audit 2020-07-16T14:49:29.778245+0000 mon.b (mon.2) 807 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:49:30.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:49:30 smithi188 bash[23329]: audit 2020-07-16T14:49:29.779720+0000 mon.b (mon.2) 808 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:49:30.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:49:30 smithi188 bash[23329]: audit 2020-07-16T14:49:29.780889+0000 mon.b (mon.2) 809 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:49:30.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:49:30 smithi188 bash[23329]: audit 2020-07-16T14:49:29.782303+0000 mon.b (mon.2) 810 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:49:30.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:49:30 smithi188 bash[23329]: audit 2020-07-16T14:49:29.783591+0000 mon.b (mon.2) 811 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:49:31.763 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:49:31 smithi132 bash[27079]: audit 2020-07-16T14:49:29.778629+0000 mgr.x (mgr.34562) 3404 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:49:31.763 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:49:31 smithi132 bash[27079]: audit 2020-07-16T14:49:29.780027+0000 mgr.x (mgr.34562) 3405 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:49:31.764 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:49:31 smithi132 bash[27079]: audit 2020-07-16T14:49:29.781187+0000 mgr.x (mgr.34562) 3406 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:49:31.764 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:49:31 smithi132 bash[27079]: cephadm 2020-07-16T14:49:29.781918+0000 mgr.x (mgr.34562) 3407 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:49:31.764 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:49:31 smithi132 bash[27079]: cephadm 2020-07-16T14:49:29.783218+0000 mgr.x (mgr.34562) 3408 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:49:31.764 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:49:31 smithi132 bash[27079]: cephadm 2020-07-16T14:49:29.784384+0000 mgr.x (mgr.34562) 3409 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:49:31.764 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:49:31 smithi132 bash[27079]: cephadm 2020-07-16T14:49:29.784603+0000 mgr.x (mgr.34562) 3410 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:49:31.765 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:49:31 smithi132 bash[27079]: cluster 2020-07-16T14:49:30.441413+0000 mgr.x (mgr.34562) 3411 : cluster [DBG] pgmap v2125: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:49:31.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:49:31 smithi188 bash[23329]: audit 2020-07-16T14:49:29.778629+0000 mgr.x (mgr.34562) 3404 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:49:31.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:49:31 smithi188 bash[23329]: audit 2020-07-16T14:49:29.780027+0000 mgr.x (mgr.34562) 3405 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:49:31.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:49:31 smithi188 bash[23329]: audit 2020-07-16T14:49:29.781187+0000 mgr.x (mgr.34562) 3406 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:49:31.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:49:31 smithi188 bash[23329]: cephadm 2020-07-16T14:49:29.781918+0000 mgr.x (mgr.34562) 3407 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:49:31.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:49:31 smithi188 bash[23329]: cephadm 2020-07-16T14:49:29.783218+0000 mgr.x (mgr.34562) 3408 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:49:31.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:49:31 smithi188 bash[23329]: cephadm 2020-07-16T14:49:29.784384+0000 mgr.x (mgr.34562) 3409 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:49:31.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:49:31 smithi188 bash[23329]: cephadm 2020-07-16T14:49:29.784603+0000 mgr.x (mgr.34562) 3410 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:49:31.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:49:31 smithi188 bash[23329]: cluster 2020-07-16T14:49:30.441413+0000 mgr.x (mgr.34562) 3411 : cluster [DBG] pgmap v2125: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:49:33.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:49:33 smithi132 bash[27079]: cluster 2020-07-16T14:49:32.441737+0000 mgr.x (mgr.34562) 3412 : cluster [DBG] pgmap v2126: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:49:33.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:49:33 smithi132 bash[27079]: audit 2020-07-16T14:49:32.622571+0000 mon.b (mon.2) 812 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:49:33.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:49:33 smithi188 bash[23329]: cluster 2020-07-16T14:49:32.441737+0000 mgr.x (mgr.34562) 3412 : cluster [DBG] pgmap v2126: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:49:33.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:49:33 smithi188 bash[23329]: audit 2020-07-16T14:49:32.622571+0000 mon.b (mon.2) 812 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:49:34.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:49:34 smithi132 bash[27079]: cephadm 2020-07-16T14:49:32.623258+0000 mgr.x (mgr.34562) 3413 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:49:34.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:49:34 smithi132 bash[27079]: cephadm 2020-07-16T14:49:32.623629+0000 mgr.x (mgr.34562) 3414 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:49:34.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:49:34 smithi188 bash[23329]: cephadm 2020-07-16T14:49:32.623258+0000 mgr.x (mgr.34562) 3413 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:49:34.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:49:34 smithi188 bash[23329]: cephadm 2020-07-16T14:49:32.623629+0000 mgr.x (mgr.34562) 3414 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:49:35.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:49:35 smithi132 bash[27079]: cluster 2020-07-16T14:49:34.442105+0000 mgr.x (mgr.34562) 3415 : cluster [DBG] pgmap v2127: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:49:35.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:49:35 smithi188 bash[23329]: cluster 2020-07-16T14:49:34.442105+0000 mgr.x (mgr.34562) 3415 : cluster [DBG] pgmap v2127: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:49:37.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:49:37 smithi132 bash[27079]: cluster 2020-07-16T14:49:36.442580+0000 mgr.x (mgr.34562) 3416 : cluster [DBG] pgmap v2128: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:49:37.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:49:37 smithi188 bash[23329]: cluster 2020-07-16T14:49:36.442580+0000 mgr.x (mgr.34562) 3416 : cluster [DBG] pgmap v2128: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:49:39.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:49:39 smithi132 bash[27079]: cluster 2020-07-16T14:49:38.443104+0000 mgr.x (mgr.34562) 3417 : cluster [DBG] pgmap v2129: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:49:39.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:49:39 smithi188 bash[23329]: cluster 2020-07-16T14:49:38.443104+0000 mgr.x (mgr.34562) 3417 : cluster [DBG] pgmap v2129: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:49:41.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:49:40 smithi188 bash[23329]: cluster 2020-07-16T14:49:40.443524+0000 mgr.x (mgr.34562) 3418 : cluster [DBG] pgmap v2130: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:49:41.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:49:40 smithi132 bash[27079]: cluster 2020-07-16T14:49:40.443524+0000 mgr.x (mgr.34562) 3418 : cluster [DBG] pgmap v2130: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:49:43.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:49:43 smithi132 bash[27079]: cluster 2020-07-16T14:49:42.443973+0000 mgr.x (mgr.34562) 3419 : cluster [DBG] pgmap v2131: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:49:43.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:49:43 smithi188 bash[23329]: cluster 2020-07-16T14:49:42.443973+0000 mgr.x (mgr.34562) 3419 : cluster [DBG] pgmap v2131: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:49:45.660 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:49:45.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:49:45 smithi132 bash[27079]: cluster 2020-07-16T14:49:44.444371+0000 mgr.x (mgr.34562) 3420 : cluster [DBG] pgmap v2132: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:49:45.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:49:45 smithi188 bash[23329]: cluster 2020-07-16T14:49:44.444371+0000 mgr.x (mgr.34562) 3420 : cluster [DBG] pgmap v2132: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:49:45.922 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:49:45.923 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (72m) 7m ago 75m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:49:45.923 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (75m) 7m ago 75m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:49:45.923 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (72m) 7m ago 78m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:49:45.923 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (72m) 7m ago 80m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:49:45.923 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 7m ago 80m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:49:45.924 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (78m) 7m ago 78m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:49:45.924 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (78m) 7m ago 78m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:49:45.924 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (75m) 7m ago 75m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:49:45.924 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (75m) 7m ago 75m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:49:45.925 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (78m) 7m ago 78m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:49:45.925 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (77m) 7m ago 77m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:49:45.925 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (77m) 7m ago 77m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:49:45.925 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (77m) 7m ago 77m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:49:45.925 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (76m) 7m ago 77m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:49:45.926 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (76m) 7m ago 76m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:49:45.926 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (76m) 7m ago 76m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:49:45.926 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (76m) 7m ago 76m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:49:45.926 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (74m) 7m ago 75m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:49:46.219 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:49:46.220 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:49:46.220 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:49:46.220 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:49:46.220 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:49:46.220 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:49:46.221 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:49:46.221 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:49:46.221 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:49:46.221 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:49:46.221 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:49:46.222 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:49:46.222 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:49:46.222 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:49:46.222 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:49:46.222 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:49:46.223 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:49:46.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:49:46 smithi132 bash[27079]: audit 2020-07-16T14:49:46.218468+0000 mon.c (mon.1) 261 : audit [DBG] from='client.? 172.21.15.132:0/2487880457' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:49:46.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:49:46 smithi188 bash[23329]: audit 2020-07-16T14:49:46.218468+0000 mon.c (mon.1) 261 : audit [DBG] from='client.? 172.21.15.132:0/2487880457' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:49:47.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:49:47 smithi132 bash[27079]: audit 2020-07-16T14:49:45.648248+0000 mgr.x (mgr.34562) 3421 : audit [DBG] from='client.27124 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:49:47.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:49:47 smithi132 bash[27079]: audit 2020-07-16T14:49:45.918509+0000 mgr.x (mgr.34562) 3422 : audit [DBG] from='client.27130 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:49:47.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:49:47 smithi132 bash[27079]: cluster 2020-07-16T14:49:46.444761+0000 mgr.x (mgr.34562) 3423 : cluster [DBG] pgmap v2133: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:49:47.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:49:47 smithi188 bash[23329]: audit 2020-07-16T14:49:45.648248+0000 mgr.x (mgr.34562) 3421 : audit [DBG] from='client.27124 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:49:47.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:49:47 smithi188 bash[23329]: audit 2020-07-16T14:49:45.918509+0000 mgr.x (mgr.34562) 3422 : audit [DBG] from='client.27130 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:49:47.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:49:47 smithi188 bash[23329]: cluster 2020-07-16T14:49:46.444761+0000 mgr.x (mgr.34562) 3423 : cluster [DBG] pgmap v2133: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:49:48.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:49:48 smithi132 bash[27079]: audit 2020-07-16T14:49:47.639170+0000 mon.b (mon.2) 813 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:49:48.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:49:48 smithi188 bash[23329]: audit 2020-07-16T14:49:47.639170+0000 mon.b (mon.2) 813 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:49:49.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:49:49 smithi132 bash[27079]: cephadm 2020-07-16T14:49:47.639887+0000 mgr.x (mgr.34562) 3424 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:49:49.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:49:49 smithi132 bash[27079]: cephadm 2020-07-16T14:49:47.640316+0000 mgr.x (mgr.34562) 3425 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:49:49.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:49:49 smithi132 bash[27079]: cluster 2020-07-16T14:49:48.445294+0000 mgr.x (mgr.34562) 3426 : cluster [DBG] pgmap v2134: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:49:49.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:49:49 smithi188 bash[23329]: cephadm 2020-07-16T14:49:47.639887+0000 mgr.x (mgr.34562) 3424 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:49:49.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:49:49 smithi188 bash[23329]: cephadm 2020-07-16T14:49:47.640316+0000 mgr.x (mgr.34562) 3425 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:49:49.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:49:49 smithi188 bash[23329]: cluster 2020-07-16T14:49:48.445294+0000 mgr.x (mgr.34562) 3426 : cluster [DBG] pgmap v2134: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:49:51.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:49:50 smithi188 bash[23329]: cluster 2020-07-16T14:49:50.445646+0000 mgr.x (mgr.34562) 3427 : cluster [DBG] pgmap v2135: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:49:51.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:49:50 smithi132 bash[27079]: cluster 2020-07-16T14:49:50.445646+0000 mgr.x (mgr.34562) 3427 : cluster [DBG] pgmap v2135: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:49:53.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:49:53 smithi132 bash[27079]: cluster 2020-07-16T14:49:52.446085+0000 mgr.x (mgr.34562) 3428 : cluster [DBG] pgmap v2136: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:49:53.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:49:53 smithi188 bash[23329]: cluster 2020-07-16T14:49:52.446085+0000 mgr.x (mgr.34562) 3428 : cluster [DBG] pgmap v2136: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:49:55.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:49:55 smithi132 bash[27079]: cluster 2020-07-16T14:49:54.446574+0000 mgr.x (mgr.34562) 3429 : cluster [DBG] pgmap v2137: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:49:55.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:49:55 smithi188 bash[23329]: cluster 2020-07-16T14:49:54.446574+0000 mgr.x (mgr.34562) 3429 : cluster [DBG] pgmap v2137: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:49:57.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:49:57 smithi132 bash[27079]: cluster 2020-07-16T14:49:56.447030+0000 mgr.x (mgr.34562) 3430 : cluster [DBG] pgmap v2138: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:49:57.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:49:57 smithi188 bash[23329]: cluster 2020-07-16T14:49:56.447030+0000 mgr.x (mgr.34562) 3430 : cluster [DBG] pgmap v2138: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:49:59.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:49:59 smithi132 bash[27079]: cluster 2020-07-16T14:49:58.447452+0000 mgr.x (mgr.34562) 3431 : cluster [DBG] pgmap v2139: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:49:59.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:49:59 smithi188 bash[23329]: cluster 2020-07-16T14:49:58.447452+0000 mgr.x (mgr.34562) 3431 : cluster [DBG] pgmap v2139: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:50:01.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:50:00 smithi188 bash[23329]: cluster 2020-07-16T14:50:00.447801+0000 mgr.x (mgr.34562) 3432 : cluster [DBG] pgmap v2140: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:50:01.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:50:00 smithi132 bash[27079]: cluster 2020-07-16T14:50:00.447801+0000 mgr.x (mgr.34562) 3432 : cluster [DBG] pgmap v2140: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:50:03.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:50:03 smithi132 bash[27079]: cluster 2020-07-16T14:50:02.448369+0000 mgr.x (mgr.34562) 3433 : cluster [DBG] pgmap v2141: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:50:03.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:50:03 smithi132 bash[27079]: audit 2020-07-16T14:50:02.655768+0000 mon.b (mon.2) 814 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:50:03.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:50:03 smithi188 bash[23329]: cluster 2020-07-16T14:50:02.448369+0000 mgr.x (mgr.34562) 3433 : cluster [DBG] pgmap v2141: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:50:03.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:50:03 smithi188 bash[23329]: audit 2020-07-16T14:50:02.655768+0000 mon.b (mon.2) 814 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:50:04.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:50:04 smithi132 bash[27079]: cephadm 2020-07-16T14:50:02.656527+0000 mgr.x (mgr.34562) 3434 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:50:04.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:50:04 smithi132 bash[27079]: cephadm 2020-07-16T14:50:02.656995+0000 mgr.x (mgr.34562) 3435 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:50:04.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:50:04 smithi188 bash[23329]: cephadm 2020-07-16T14:50:02.656527+0000 mgr.x (mgr.34562) 3434 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:50:04.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:50:04 smithi188 bash[23329]: cephadm 2020-07-16T14:50:02.656995+0000 mgr.x (mgr.34562) 3435 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:50:05.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:50:05 smithi132 bash[27079]: cluster 2020-07-16T14:50:04.448850+0000 mgr.x (mgr.34562) 3436 : cluster [DBG] pgmap v2142: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:50:05.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:50:05 smithi188 bash[23329]: cluster 2020-07-16T14:50:04.448850+0000 mgr.x (mgr.34562) 3436 : cluster [DBG] pgmap v2142: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:50:07.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:50:07 smithi132 bash[27079]: cluster 2020-07-16T14:50:06.449307+0000 mgr.x (mgr.34562) 3437 : cluster [DBG] pgmap v2143: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:50:07.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:50:07 smithi188 bash[23329]: cluster 2020-07-16T14:50:06.449307+0000 mgr.x (mgr.34562) 3437 : cluster [DBG] pgmap v2143: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:50:09.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:50:09 smithi132 bash[27079]: cluster 2020-07-16T14:50:08.449863+0000 mgr.x (mgr.34562) 3438 : cluster [DBG] pgmap v2144: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:50:09.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:50:09 smithi188 bash[23329]: cluster 2020-07-16T14:50:08.449863+0000 mgr.x (mgr.34562) 3438 : cluster [DBG] pgmap v2144: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:50:11.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:50:10 smithi188 bash[23329]: cluster 2020-07-16T14:50:10.450221+0000 mgr.x (mgr.34562) 3439 : cluster [DBG] pgmap v2145: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:50:11.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:50:10 smithi132 bash[27079]: cluster 2020-07-16T14:50:10.450221+0000 mgr.x (mgr.34562) 3439 : cluster [DBG] pgmap v2145: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:50:13.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:50:13 smithi132 bash[27079]: cluster 2020-07-16T14:50:12.450723+0000 mgr.x (mgr.34562) 3440 : cluster [DBG] pgmap v2146: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:50:13.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:50:13 smithi188 bash[23329]: cluster 2020-07-16T14:50:12.450723+0000 mgr.x (mgr.34562) 3440 : cluster [DBG] pgmap v2146: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:50:15.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:50:15 smithi132 bash[27079]: cluster 2020-07-16T14:50:14.451103+0000 mgr.x (mgr.34562) 3441 : cluster [DBG] pgmap v2147: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:50:15.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:50:15 smithi188 bash[23329]: cluster 2020-07-16T14:50:14.451103+0000 mgr.x (mgr.34562) 3441 : cluster [DBG] pgmap v2147: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:50:16.518 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:50:16.781 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:50:16.782 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (73m) 8m ago 76m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:50:16.782 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (75m) 8m ago 75m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:50:16.782 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (73m) 8m ago 78m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:50:16.782 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (72m) 8m ago 80m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:50:16.783 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 8m ago 80m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:50:16.783 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (79m) 8m ago 79m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:50:16.783 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (79m) 8m ago 79m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:50:16.783 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (76m) 8m ago 76m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:50:16.783 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (76m) 8m ago 76m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:50:16.784 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (78m) 8m ago 78m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:50:16.784 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (78m) 8m ago 78m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:50:16.784 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (78m) 8m ago 78m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:50:16.784 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (77m) 8m ago 77m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:50:16.784 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (77m) 8m ago 77m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:50:16.785 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (77m) 8m ago 77m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:50:16.785 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (76m) 8m ago 76m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:50:16.785 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (76m) 8m ago 76m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:50:16.785 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (75m) 8m ago 76m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:50:17.081 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:50:17.081 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:50:17.082 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:50:17.082 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:50:17.082 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:50:17.083 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:50:17.083 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:50:17.083 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:50:17.084 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:50:17.084 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:50:17.084 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:50:17.084 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:50:17.084 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:50:17.085 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:50:17.085 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:50:17.085 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:50:17.085 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:50:17.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:50:17 smithi132 bash[27079]: cluster 2020-07-16T14:50:16.451472+0000 mgr.x (mgr.34562) 3442 : cluster [DBG] pgmap v2148: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:50:17.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:50:17 smithi132 bash[27079]: audit 2020-07-16T14:50:16.506500+0000 mgr.x (mgr.34562) 3443 : audit [DBG] from='client.27142 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:50:17.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:50:17 smithi132 bash[27079]: audit 2020-07-16T14:50:17.080030+0000 mon.c (mon.1) 262 : audit [DBG] from='client.? 172.21.15.132:0/547993802' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:50:17.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:50:17 smithi188 bash[23329]: cluster 2020-07-16T14:50:16.451472+0000 mgr.x (mgr.34562) 3442 : cluster [DBG] pgmap v2148: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:50:17.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:50:17 smithi188 bash[23329]: audit 2020-07-16T14:50:16.506500+0000 mgr.x (mgr.34562) 3443 : audit [DBG] from='client.27142 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:50:17.925 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:50:17 smithi188 bash[23329]: audit 2020-07-16T14:50:17.080030+0000 mon.c (mon.1) 262 : audit [DBG] from='client.? 172.21.15.132:0/547993802' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:50:18.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:50:18 smithi132 bash[27079]: audit 2020-07-16T14:50:16.777168+0000 mgr.x (mgr.34562) 3444 : audit [DBG] from='client.27148 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:50:18.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:50:18 smithi132 bash[27079]: audit 2020-07-16T14:50:17.672475+0000 mon.b (mon.2) 815 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:50:18.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:50:18 smithi188 bash[23329]: audit 2020-07-16T14:50:16.777168+0000 mgr.x (mgr.34562) 3444 : audit [DBG] from='client.27148 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:50:18.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:50:18 smithi188 bash[23329]: audit 2020-07-16T14:50:17.672475+0000 mon.b (mon.2) 815 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:50:19.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:50:19 smithi132 bash[27079]: cephadm 2020-07-16T14:50:17.673264+0000 mgr.x (mgr.34562) 3445 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:50:19.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:50:19 smithi132 bash[27079]: cephadm 2020-07-16T14:50:17.673627+0000 mgr.x (mgr.34562) 3446 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:50:19.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:50:19 smithi132 bash[27079]: cluster 2020-07-16T14:50:18.451907+0000 mgr.x (mgr.34562) 3447 : cluster [DBG] pgmap v2149: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:50:19.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:50:19 smithi188 bash[23329]: cephadm 2020-07-16T14:50:17.673264+0000 mgr.x (mgr.34562) 3445 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:50:19.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:50:19 smithi188 bash[23329]: cephadm 2020-07-16T14:50:17.673627+0000 mgr.x (mgr.34562) 3446 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:50:19.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:50:19 smithi188 bash[23329]: cluster 2020-07-16T14:50:18.451907+0000 mgr.x (mgr.34562) 3447 : cluster [DBG] pgmap v2149: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:50:21.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:50:20 smithi188 bash[23329]: cluster 2020-07-16T14:50:20.452268+0000 mgr.x (mgr.34562) 3448 : cluster [DBG] pgmap v2150: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:50:21.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:50:20 smithi132 bash[27079]: cluster 2020-07-16T14:50:20.452268+0000 mgr.x (mgr.34562) 3448 : cluster [DBG] pgmap v2150: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:50:23.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:50:23 smithi132 bash[27079]: cluster 2020-07-16T14:50:22.452592+0000 mgr.x (mgr.34562) 3449 : cluster [DBG] pgmap v2151: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:50:23.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:50:23 smithi188 bash[23329]: cluster 2020-07-16T14:50:22.452592+0000 mgr.x (mgr.34562) 3449 : cluster [DBG] pgmap v2151: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:50:25.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:50:25 smithi132 bash[27079]: cluster 2020-07-16T14:50:24.452950+0000 mgr.x (mgr.34562) 3450 : cluster [DBG] pgmap v2152: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:50:25.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:50:25 smithi188 bash[23329]: cluster 2020-07-16T14:50:24.452950+0000 mgr.x (mgr.34562) 3450 : cluster [DBG] pgmap v2152: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:50:27.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:50:27 smithi132 bash[27079]: cluster 2020-07-16T14:50:26.453443+0000 mgr.x (mgr.34562) 3451 : cluster [DBG] pgmap v2153: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:50:27.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:50:27 smithi188 bash[23329]: cluster 2020-07-16T14:50:26.453443+0000 mgr.x (mgr.34562) 3451 : cluster [DBG] pgmap v2153: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:50:29.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:50:29 smithi132 bash[27079]: cluster 2020-07-16T14:50:28.453817+0000 mgr.x (mgr.34562) 3452 : cluster [DBG] pgmap v2154: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:50:29.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:50:29 smithi188 bash[23329]: cluster 2020-07-16T14:50:28.453817+0000 mgr.x (mgr.34562) 3452 : cluster [DBG] pgmap v2154: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:50:31.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:50:30 smithi188 bash[23329]: cluster 2020-07-16T14:50:30.454182+0000 mgr.x (mgr.34562) 3453 : cluster [DBG] pgmap v2155: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:50:31.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:50:30 smithi132 bash[27079]: cluster 2020-07-16T14:50:30.454182+0000 mgr.x (mgr.34562) 3453 : cluster [DBG] pgmap v2155: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:50:33.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:50:33 smithi132 bash[27079]: cluster 2020-07-16T14:50:32.454593+0000 mgr.x (mgr.34562) 3454 : cluster [DBG] pgmap v2156: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:50:33.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:50:33 smithi132 bash[27079]: audit 2020-07-16T14:50:32.677263+0000 mon.b (mon.2) 816 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:50:33.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:50:33 smithi132 bash[27079]: audit 2020-07-16T14:50:32.678715+0000 mon.b (mon.2) 817 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:50:33.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:50:33 smithi132 bash[27079]: audit 2020-07-16T14:50:32.679888+0000 mon.b (mon.2) 818 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:50:33.782 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:50:33 smithi132 bash[27079]: audit 2020-07-16T14:50:32.681301+0000 mon.b (mon.2) 819 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:50:33.782 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:50:33 smithi132 bash[27079]: audit 2020-07-16T14:50:32.682478+0000 mon.b (mon.2) 820 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:50:33.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:50:33 smithi188 bash[23329]: cluster 2020-07-16T14:50:32.454593+0000 mgr.x (mgr.34562) 3454 : cluster [DBG] pgmap v2156: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:50:33.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:50:33 smithi188 bash[23329]: audit 2020-07-16T14:50:32.677263+0000 mon.b (mon.2) 816 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:50:33.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:50:33 smithi188 bash[23329]: audit 2020-07-16T14:50:32.678715+0000 mon.b (mon.2) 817 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:50:33.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:50:33 smithi188 bash[23329]: audit 2020-07-16T14:50:32.679888+0000 mon.b (mon.2) 818 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:50:33.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:50:33 smithi188 bash[23329]: audit 2020-07-16T14:50:32.681301+0000 mon.b (mon.2) 819 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:50:33.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:50:33 smithi188 bash[23329]: audit 2020-07-16T14:50:32.682478+0000 mon.b (mon.2) 820 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:50:34.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:50:34 smithi132 bash[27079]: audit 2020-07-16T14:50:32.677680+0000 mgr.x (mgr.34562) 3455 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:50:34.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:50:34 smithi132 bash[27079]: audit 2020-07-16T14:50:32.679023+0000 mgr.x (mgr.34562) 3456 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:50:34.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:50:34 smithi132 bash[27079]: audit 2020-07-16T14:50:32.680170+0000 mgr.x (mgr.34562) 3457 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:50:34.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:50:34 smithi132 bash[27079]: cephadm 2020-07-16T14:50:32.680957+0000 mgr.x (mgr.34562) 3458 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:50:34.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:50:34 smithi132 bash[27079]: cephadm 2020-07-16T14:50:32.682151+0000 mgr.x (mgr.34562) 3459 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:50:34.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:50:34 smithi132 bash[27079]: cephadm 2020-07-16T14:50:32.683211+0000 mgr.x (mgr.34562) 3460 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:50:34.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:50:34 smithi132 bash[27079]: cephadm 2020-07-16T14:50:32.683452+0000 mgr.x (mgr.34562) 3461 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:50:34.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:50:34 smithi188 bash[23329]: audit 2020-07-16T14:50:32.677680+0000 mgr.x (mgr.34562) 3455 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:50:34.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:50:34 smithi188 bash[23329]: audit 2020-07-16T14:50:32.679023+0000 mgr.x (mgr.34562) 3456 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:50:34.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:50:34 smithi188 bash[23329]: audit 2020-07-16T14:50:32.680170+0000 mgr.x (mgr.34562) 3457 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:50:34.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:50:34 smithi188 bash[23329]: cephadm 2020-07-16T14:50:32.680957+0000 mgr.x (mgr.34562) 3458 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:50:34.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:50:34 smithi188 bash[23329]: cephadm 2020-07-16T14:50:32.682151+0000 mgr.x (mgr.34562) 3459 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:50:34.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:50:34 smithi188 bash[23329]: cephadm 2020-07-16T14:50:32.683211+0000 mgr.x (mgr.34562) 3460 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:50:34.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:50:34 smithi188 bash[23329]: cephadm 2020-07-16T14:50:32.683452+0000 mgr.x (mgr.34562) 3461 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:50:35.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:50:35 smithi132 bash[27079]: cluster 2020-07-16T14:50:34.454999+0000 mgr.x (mgr.34562) 3462 : cluster [DBG] pgmap v2157: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:50:35.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:50:35 smithi188 bash[23329]: cluster 2020-07-16T14:50:34.454999+0000 mgr.x (mgr.34562) 3462 : cluster [DBG] pgmap v2157: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:50:36.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:50:36 smithi132 bash[27079]: audit 2020-07-16T14:50:35.541566+0000 mon.b (mon.2) 821 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:50:36.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:50:36 smithi132 bash[27079]: cephadm 2020-07-16T14:50:35.542200+0000 mgr.x (mgr.34562) 3463 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:50:36.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:50:36 smithi132 bash[27079]: cephadm 2020-07-16T14:50:35.542360+0000 mgr.x (mgr.34562) 3464 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:50:36.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:50:36 smithi188 bash[23329]: audit 2020-07-16T14:50:35.541566+0000 mon.b (mon.2) 821 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:50:36.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:50:36 smithi188 bash[23329]: cephadm 2020-07-16T14:50:35.542200+0000 mgr.x (mgr.34562) 3463 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:50:36.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:50:36 smithi188 bash[23329]: cephadm 2020-07-16T14:50:35.542360+0000 mgr.x (mgr.34562) 3464 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:50:37.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:50:37 smithi132 bash[27079]: cluster 2020-07-16T14:50:36.455383+0000 mgr.x (mgr.34562) 3465 : cluster [DBG] pgmap v2158: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:50:37.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:50:37 smithi188 bash[23329]: cluster 2020-07-16T14:50:36.455383+0000 mgr.x (mgr.34562) 3465 : cluster [DBG] pgmap v2158: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:50:39.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:50:39 smithi132 bash[27079]: cluster 2020-07-16T14:50:38.455848+0000 mgr.x (mgr.34562) 3466 : cluster [DBG] pgmap v2159: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:50:39.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:50:39 smithi188 bash[23329]: cluster 2020-07-16T14:50:38.455848+0000 mgr.x (mgr.34562) 3466 : cluster [DBG] pgmap v2159: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:50:41.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:50:40 smithi188 bash[23329]: cluster 2020-07-16T14:50:40.456390+0000 mgr.x (mgr.34562) 3467 : cluster [DBG] pgmap v2160: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:50:41.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:50:40 smithi132 bash[27079]: cluster 2020-07-16T14:50:40.456390+0000 mgr.x (mgr.34562) 3467 : cluster [DBG] pgmap v2160: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:50:43.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:50:43 smithi132 bash[27079]: cluster 2020-07-16T14:50:42.456849+0000 mgr.x (mgr.34562) 3468 : cluster [DBG] pgmap v2161: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:50:43.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:50:43 smithi188 bash[23329]: cluster 2020-07-16T14:50:42.456849+0000 mgr.x (mgr.34562) 3468 : cluster [DBG] pgmap v2161: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:50:45.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:50:45 smithi132 bash[27079]: cluster 2020-07-16T14:50:44.457293+0000 mgr.x (mgr.34562) 3469 : cluster [DBG] pgmap v2162: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:50:45.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:50:45 smithi188 bash[23329]: cluster 2020-07-16T14:50:44.457293+0000 mgr.x (mgr.34562) 3469 : cluster [DBG] pgmap v2162: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:50:47.381 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:50:47.645 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:50:47.645 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (73m) 8m ago 76m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:50:47.645 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (76m) 8m ago 76m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:50:47.646 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (73m) 8m ago 79m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:50:47.646 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (73m) 8m ago 81m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:50:47.646 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 8m ago 81m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:50:47.646 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (79m) 8m ago 79m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:50:47.646 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (79m) 8m ago 79m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:50:47.647 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (76m) 8m ago 76m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:50:47.647 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (76m) 8m ago 76m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:50:47.647 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (79m) 8m ago 79m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:50:47.647 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (78m) 8m ago 78m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:50:47.647 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (78m) 8m ago 78m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:50:47.648 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (78m) 8m ago 78m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:50:47.648 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (77m) 8m ago 78m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:50:47.648 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (77m) 8m ago 77m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:50:47.648 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (77m) 8m ago 77m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:50:47.648 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (77m) 8m ago 77m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:50:47.649 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (76m) 8m ago 76m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:50:47.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:50:47 smithi132 bash[27079]: cluster 2020-07-16T14:50:46.457801+0000 mgr.x (mgr.34562) 3470 : cluster [DBG] pgmap v2163: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:50:47.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:50:47 smithi188 bash[23329]: cluster 2020-07-16T14:50:46.457801+0000 mgr.x (mgr.34562) 3470 : cluster [DBG] pgmap v2163: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:50:47.942 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:50:47.943 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:50:47.943 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:50:47.943 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:50:47.943 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:50:47.944 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:50:47.944 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:50:47.944 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:50:47.944 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:50:47.944 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:50:47.945 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:50:47.945 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:50:47.945 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:50:47.945 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:50:47.946 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:50:47.946 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:50:47.946 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:50:48.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:50:48 smithi132 bash[27079]: audit 2020-07-16T14:50:47.369636+0000 mgr.x (mgr.34562) 3471 : audit [DBG] from='client.27160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:50:48.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:50:48 smithi132 bash[27079]: audit 2020-07-16T14:50:47.941665+0000 mon.c (mon.1) 263 : audit [DBG] from='client.? 172.21.15.132:0/530936953' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:50:48.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:50:48 smithi188 bash[23329]: audit 2020-07-16T14:50:47.369636+0000 mgr.x (mgr.34562) 3471 : audit [DBG] from='client.27160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:50:48.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:50:48 smithi188 bash[23329]: audit 2020-07-16T14:50:47.941665+0000 mon.c (mon.1) 263 : audit [DBG] from='client.? 172.21.15.132:0/530936953' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:50:49.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:50:49 smithi132 bash[27079]: audit 2020-07-16T14:50:47.640629+0000 mgr.x (mgr.34562) 3472 : audit [DBG] from='client.27166 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:50:49.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:50:49 smithi132 bash[27079]: cluster 2020-07-16T14:50:48.458355+0000 mgr.x (mgr.34562) 3473 : cluster [DBG] pgmap v2164: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:50:49.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:50:49 smithi188 bash[23329]: audit 2020-07-16T14:50:47.640629+0000 mgr.x (mgr.34562) 3472 : audit [DBG] from='client.27166 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:50:49.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:50:49 smithi188 bash[23329]: cluster 2020-07-16T14:50:48.458355+0000 mgr.x (mgr.34562) 3473 : cluster [DBG] pgmap v2164: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:50:51.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:50:50 smithi188 bash[23329]: cluster 2020-07-16T14:50:50.458760+0000 mgr.x (mgr.34562) 3474 : cluster [DBG] pgmap v2165: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:50:51.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:50:50 smithi188 bash[23329]: audit 2020-07-16T14:50:50.558095+0000 mon.b (mon.2) 822 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:50:51.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:50:50 smithi188 bash[23329]: cephadm 2020-07-16T14:50:50.558789+0000 mgr.x (mgr.34562) 3475 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:50:51.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:50:50 smithi188 bash[23329]: cephadm 2020-07-16T14:50:50.559202+0000 mgr.x (mgr.34562) 3476 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:50:51.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:50:50 smithi132 bash[27079]: cluster 2020-07-16T14:50:50.458760+0000 mgr.x (mgr.34562) 3474 : cluster [DBG] pgmap v2165: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:50:51.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:50:50 smithi132 bash[27079]: audit 2020-07-16T14:50:50.558095+0000 mon.b (mon.2) 822 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:50:51.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:50:50 smithi132 bash[27079]: cephadm 2020-07-16T14:50:50.558789+0000 mgr.x (mgr.34562) 3475 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:50:51.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:50:50 smithi132 bash[27079]: cephadm 2020-07-16T14:50:50.559202+0000 mgr.x (mgr.34562) 3476 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:50:53.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:50:53 smithi132 bash[27079]: cluster 2020-07-16T14:50:52.459314+0000 mgr.x (mgr.34562) 3477 : cluster [DBG] pgmap v2166: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:50:53.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:50:53 smithi188 bash[23329]: cluster 2020-07-16T14:50:52.459314+0000 mgr.x (mgr.34562) 3477 : cluster [DBG] pgmap v2166: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:50:55.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:50:55 smithi132 bash[27079]: cluster 2020-07-16T14:50:54.459722+0000 mgr.x (mgr.34562) 3478 : cluster [DBG] pgmap v2167: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:50:55.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:50:55 smithi188 bash[23329]: cluster 2020-07-16T14:50:54.459722+0000 mgr.x (mgr.34562) 3478 : cluster [DBG] pgmap v2167: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:50:57.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:50:57 smithi132 bash[27079]: cluster 2020-07-16T14:50:56.460218+0000 mgr.x (mgr.34562) 3479 : cluster [DBG] pgmap v2168: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:50:57.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:50:57 smithi188 bash[23329]: cluster 2020-07-16T14:50:56.460218+0000 mgr.x (mgr.34562) 3479 : cluster [DBG] pgmap v2168: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:50:59.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:50:59 smithi132 bash[27079]: cluster 2020-07-16T14:50:58.460657+0000 mgr.x (mgr.34562) 3480 : cluster [DBG] pgmap v2169: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:50:59.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:50:59 smithi188 bash[23329]: cluster 2020-07-16T14:50:58.460657+0000 mgr.x (mgr.34562) 3480 : cluster [DBG] pgmap v2169: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:51:01.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:51:00 smithi188 bash[23329]: cluster 2020-07-16T14:51:00.461017+0000 mgr.x (mgr.34562) 3481 : cluster [DBG] pgmap v2170: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:51:01.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:51:00 smithi132 bash[27079]: cluster 2020-07-16T14:51:00.461017+0000 mgr.x (mgr.34562) 3481 : cluster [DBG] pgmap v2170: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:51:03.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:51:03 smithi132 bash[27079]: cluster 2020-07-16T14:51:02.461461+0000 mgr.x (mgr.34562) 3482 : cluster [DBG] pgmap v2171: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:51:03.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:51:03 smithi188 bash[23329]: cluster 2020-07-16T14:51:02.461461+0000 mgr.x (mgr.34562) 3482 : cluster [DBG] pgmap v2171: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:51:05.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:51:05 smithi132 bash[27079]: cluster 2020-07-16T14:51:04.461755+0000 mgr.x (mgr.34562) 3483 : cluster [DBG] pgmap v2172: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:51:05.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:51:05 smithi188 bash[23329]: cluster 2020-07-16T14:51:04.461755+0000 mgr.x (mgr.34562) 3483 : cluster [DBG] pgmap v2172: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:51:06.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:51:06 smithi132 bash[27079]: audit 2020-07-16T14:51:05.569808+0000 mon.b (mon.2) 823 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:51:06.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:51:06 smithi132 bash[27079]: cephadm 2020-07-16T14:51:05.570505+0000 mgr.x (mgr.34562) 3484 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:51:06.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:51:06 smithi132 bash[27079]: cephadm 2020-07-16T14:51:05.570916+0000 mgr.x (mgr.34562) 3485 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:51:06.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:51:06 smithi188 bash[23329]: audit 2020-07-16T14:51:05.569808+0000 mon.b (mon.2) 823 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:51:06.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:51:06 smithi188 bash[23329]: cephadm 2020-07-16T14:51:05.570505+0000 mgr.x (mgr.34562) 3484 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:51:06.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:51:06 smithi188 bash[23329]: cephadm 2020-07-16T14:51:05.570916+0000 mgr.x (mgr.34562) 3485 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:51:07.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:51:07 smithi188 bash[23329]: cluster 2020-07-16T14:51:06.462120+0000 mgr.x (mgr.34562) 3486 : cluster [DBG] pgmap v2173: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:51:08.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:51:07 smithi132 bash[27079]: cluster 2020-07-16T14:51:06.462120+0000 mgr.x (mgr.34562) 3486 : cluster [DBG] pgmap v2173: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:51:09.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:51:09 smithi188 bash[23329]: cluster 2020-07-16T14:51:08.462541+0000 mgr.x (mgr.34562) 3487 : cluster [DBG] pgmap v2174: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:51:10.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:51:09 smithi132 bash[27079]: cluster 2020-07-16T14:51:08.462541+0000 mgr.x (mgr.34562) 3487 : cluster [DBG] pgmap v2174: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:51:11.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:51:10 smithi188 bash[23329]: cluster 2020-07-16T14:51:10.463024+0000 mgr.x (mgr.34562) 3488 : cluster [DBG] pgmap v2175: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:51:11.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:51:10 smithi132 bash[27079]: cluster 2020-07-16T14:51:10.463024+0000 mgr.x (mgr.34562) 3488 : cluster [DBG] pgmap v2175: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:51:13.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:51:13 smithi132 bash[27079]: cluster 2020-07-16T14:51:12.463499+0000 mgr.x (mgr.34562) 3489 : cluster [DBG] pgmap v2176: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:51:13.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:51:13 smithi188 bash[23329]: cluster 2020-07-16T14:51:12.463499+0000 mgr.x (mgr.34562) 3489 : cluster [DBG] pgmap v2176: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:51:15.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:51:15 smithi132 bash[27079]: cluster 2020-07-16T14:51:14.463897+0000 mgr.x (mgr.34562) 3490 : cluster [DBG] pgmap v2177: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:51:15.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:51:15 smithi188 bash[23329]: cluster 2020-07-16T14:51:14.463897+0000 mgr.x (mgr.34562) 3490 : cluster [DBG] pgmap v2177: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:51:17.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:51:17 smithi132 bash[27079]: cluster 2020-07-16T14:51:16.464218+0000 mgr.x (mgr.34562) 3491 : cluster [DBG] pgmap v2178: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:51:17.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:51:17 smithi188 bash[23329]: cluster 2020-07-16T14:51:16.464218+0000 mgr.x (mgr.34562) 3491 : cluster [DBG] pgmap v2178: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:51:18.242 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:51:18.496 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:51:18.497 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (74m) 9m ago 77m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:51:18.497 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (76m) 9m ago 76m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:51:18.497 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (74m) 9m ago 79m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:51:18.498 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (73m) 9m ago 81m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:51:18.498 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 9m ago 81m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:51:18.498 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (80m) 9m ago 80m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:51:18.498 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (80m) 9m ago 80m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:51:18.498 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (77m) 9m ago 77m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:51:18.499 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (77m) 9m ago 77m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:51:18.499 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (79m) 9m ago 79m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:51:18.499 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (79m) 9m ago 79m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:51:18.499 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (79m) 9m ago 79m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:51:18.499 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (78m) 9m ago 78m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:51:18.500 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (78m) 9m ago 78m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:51:18.500 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (78m) 9m ago 78m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:51:18.500 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (77m) 9m ago 77m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:51:18.500 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (77m) 9m ago 77m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:51:18.500 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (76m) 9m ago 77m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:51:18.794 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:51:18.794 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:51:18.795 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:51:18.795 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:51:18.795 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:51:18.795 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:51:18.795 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:51:18.796 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:51:18.796 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:51:18.796 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:51:18.796 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:51:18.796 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:51:18.797 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:51:18.797 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:51:18.797 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:51:18.797 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:51:18.797 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:51:19.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:51:19 smithi132 bash[27079]: audit 2020-07-16T14:51:18.225393+0000 mgr.x (mgr.34562) 3492 : audit [DBG] from='client.27178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:51:19.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:51:19 smithi132 bash[27079]: cluster 2020-07-16T14:51:18.464656+0000 mgr.x (mgr.34562) 3493 : cluster [DBG] pgmap v2179: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:51:19.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:51:19 smithi132 bash[27079]: audit 2020-07-16T14:51:18.492709+0000 mgr.x (mgr.34562) 3494 : audit [DBG] from='client.27184 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:51:19.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:51:19 smithi132 bash[27079]: audit 2020-07-16T14:51:18.793147+0000 mon.c (mon.1) 264 : audit [DBG] from='client.? 172.21.15.132:0/802040029' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:51:19.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:51:19 smithi188 bash[23329]: audit 2020-07-16T14:51:18.225393+0000 mgr.x (mgr.34562) 3492 : audit [DBG] from='client.27178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:51:19.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:51:19 smithi188 bash[23329]: cluster 2020-07-16T14:51:18.464656+0000 mgr.x (mgr.34562) 3493 : cluster [DBG] pgmap v2179: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:51:19.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:51:19 smithi188 bash[23329]: audit 2020-07-16T14:51:18.492709+0000 mgr.x (mgr.34562) 3494 : audit [DBG] from='client.27184 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:51:19.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:51:19 smithi188 bash[23329]: audit 2020-07-16T14:51:18.793147+0000 mon.c (mon.1) 264 : audit [DBG] from='client.? 172.21.15.132:0/802040029' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:51:21.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:51:20 smithi188 bash[23329]: cluster 2020-07-16T14:51:20.465154+0000 mgr.x (mgr.34562) 3495 : cluster [DBG] pgmap v2180: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:51:21.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:51:20 smithi188 bash[23329]: audit 2020-07-16T14:51:20.578997+0000 mon.b (mon.2) 824 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:51:21.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:51:20 smithi188 bash[23329]: cephadm 2020-07-16T14:51:20.579974+0000 mgr.x (mgr.34562) 3496 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:51:21.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:51:20 smithi188 bash[23329]: cephadm 2020-07-16T14:51:20.580184+0000 mgr.x (mgr.34562) 3497 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:51:21.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:51:20 smithi132 bash[27079]: cluster 2020-07-16T14:51:20.465154+0000 mgr.x (mgr.34562) 3495 : cluster [DBG] pgmap v2180: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:51:21.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:51:20 smithi132 bash[27079]: audit 2020-07-16T14:51:20.578997+0000 mon.b (mon.2) 824 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:51:21.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:51:20 smithi132 bash[27079]: cephadm 2020-07-16T14:51:20.579974+0000 mgr.x (mgr.34562) 3496 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:51:21.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:51:20 smithi132 bash[27079]: cephadm 2020-07-16T14:51:20.580184+0000 mgr.x (mgr.34562) 3497 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:51:23.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:51:23 smithi132 bash[27079]: cluster 2020-07-16T14:51:22.465695+0000 mgr.x (mgr.34562) 3498 : cluster [DBG] pgmap v2181: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:51:23.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:51:23 smithi188 bash[23329]: cluster 2020-07-16T14:51:22.465695+0000 mgr.x (mgr.34562) 3498 : cluster [DBG] pgmap v2181: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:51:25.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:51:25 smithi132 bash[27079]: cluster 2020-07-16T14:51:24.466197+0000 mgr.x (mgr.34562) 3499 : cluster [DBG] pgmap v2182: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:51:25.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:51:25 smithi188 bash[23329]: cluster 2020-07-16T14:51:24.466197+0000 mgr.x (mgr.34562) 3499 : cluster [DBG] pgmap v2182: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:51:27.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:51:27 smithi188 bash[23329]: cluster 2020-07-16T14:51:26.466747+0000 mgr.x (mgr.34562) 3500 : cluster [DBG] pgmap v2183: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:51:28.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:51:27 smithi132 bash[27079]: cluster 2020-07-16T14:51:26.466747+0000 mgr.x (mgr.34562) 3500 : cluster [DBG] pgmap v2183: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:51:29.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:51:29 smithi188 bash[23329]: cluster 2020-07-16T14:51:28.467238+0000 mgr.x (mgr.34562) 3501 : cluster [DBG] pgmap v2184: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:51:30.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:51:29 smithi132 bash[27079]: cluster 2020-07-16T14:51:28.467238+0000 mgr.x (mgr.34562) 3501 : cluster [DBG] pgmap v2184: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:51:31.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:51:30 smithi188 bash[23329]: cluster 2020-07-16T14:51:30.467815+0000 mgr.x (mgr.34562) 3502 : cluster [DBG] pgmap v2185: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:51:31.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:51:30 smithi132 bash[27079]: cluster 2020-07-16T14:51:30.467815+0000 mgr.x (mgr.34562) 3502 : cluster [DBG] pgmap v2185: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:51:33.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:51:33 smithi132 bash[27079]: cluster 2020-07-16T14:51:32.468377+0000 mgr.x (mgr.34562) 3503 : cluster [DBG] pgmap v2186: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:51:33.925 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:51:33 smithi188 bash[23329]: cluster 2020-07-16T14:51:32.468377+0000 mgr.x (mgr.34562) 3503 : cluster [DBG] pgmap v2186: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:51:35.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:51:35 smithi132 bash[27079]: cluster 2020-07-16T14:51:34.468761+0000 mgr.x (mgr.34562) 3504 : cluster [DBG] pgmap v2187: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:51:35.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:51:35 smithi188 bash[23329]: cluster 2020-07-16T14:51:34.468761+0000 mgr.x (mgr.34562) 3504 : cluster [DBG] pgmap v2187: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:51:36.727 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:51:36 smithi132 bash[27079]: audit 2020-07-16T14:51:35.598536+0000 mon.b (mon.2) 825 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:51:36.728 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:51:36 smithi132 bash[27079]: audit 2020-07-16T14:51:35.598954+0000 mgr.x (mgr.34562) 3505 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:51:36.728 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:51:36 smithi132 bash[27079]: audit 2020-07-16T14:51:35.599997+0000 mon.b (mon.2) 826 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:51:36.728 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:51:36 smithi132 bash[27079]: audit 2020-07-16T14:51:35.600333+0000 mgr.x (mgr.34562) 3506 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:51:36.728 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:51:36 smithi132 bash[27079]: audit 2020-07-16T14:51:35.601209+0000 mon.b (mon.2) 827 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:51:36.729 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:51:36 smithi132 bash[27079]: audit 2020-07-16T14:51:35.601537+0000 mgr.x (mgr.34562) 3507 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:51:36.729 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:51:36 smithi132 bash[27079]: cephadm 2020-07-16T14:51:35.602247+0000 mgr.x (mgr.34562) 3508 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:51:36.729 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:51:36 smithi132 bash[27079]: audit 2020-07-16T14:51:35.602688+0000 mon.b (mon.2) 828 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:51:36.729 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:51:36 smithi132 bash[27079]: cephadm 2020-07-16T14:51:35.603519+0000 mgr.x (mgr.34562) 3509 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:51:36.730 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:51:36 smithi132 bash[27079]: audit 2020-07-16T14:51:35.603918+0000 mon.b (mon.2) 829 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:51:36.730 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:51:36 smithi132 bash[27079]: cephadm 2020-07-16T14:51:35.604656+0000 mgr.x (mgr.34562) 3510 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:51:36.730 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:51:36 smithi132 bash[27079]: cephadm 2020-07-16T14:51:35.604941+0000 mgr.x (mgr.34562) 3511 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:51:36.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:51:36 smithi188 bash[23329]: audit 2020-07-16T14:51:35.598536+0000 mon.b (mon.2) 825 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:51:36.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:51:36 smithi188 bash[23329]: audit 2020-07-16T14:51:35.598954+0000 mgr.x (mgr.34562) 3505 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:51:36.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:51:36 smithi188 bash[23329]: audit 2020-07-16T14:51:35.599997+0000 mon.b (mon.2) 826 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:51:36.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:51:36 smithi188 bash[23329]: audit 2020-07-16T14:51:35.600333+0000 mgr.x (mgr.34562) 3506 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:51:36.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:51:36 smithi188 bash[23329]: audit 2020-07-16T14:51:35.601209+0000 mon.b (mon.2) 827 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:51:36.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:51:36 smithi188 bash[23329]: audit 2020-07-16T14:51:35.601537+0000 mgr.x (mgr.34562) 3507 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:51:36.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:51:36 smithi188 bash[23329]: cephadm 2020-07-16T14:51:35.602247+0000 mgr.x (mgr.34562) 3508 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:51:36.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:51:36 smithi188 bash[23329]: audit 2020-07-16T14:51:35.602688+0000 mon.b (mon.2) 828 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:51:36.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:51:36 smithi188 bash[23329]: cephadm 2020-07-16T14:51:35.603519+0000 mgr.x (mgr.34562) 3509 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:51:36.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:51:36 smithi188 bash[23329]: audit 2020-07-16T14:51:35.603918+0000 mon.b (mon.2) 829 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:51:36.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:51:36 smithi188 bash[23329]: cephadm 2020-07-16T14:51:35.604656+0000 mgr.x (mgr.34562) 3510 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:51:36.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:51:36 smithi188 bash[23329]: cephadm 2020-07-16T14:51:35.604941+0000 mgr.x (mgr.34562) 3511 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:51:37.868 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:51:37 smithi132 bash[27079]: cluster 2020-07-16T14:51:36.469115+0000 mgr.x (mgr.34562) 3512 : cluster [DBG] pgmap v2188: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:51:37.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:51:37 smithi188 bash[23329]: cluster 2020-07-16T14:51:36.469115+0000 mgr.x (mgr.34562) 3512 : cluster [DBG] pgmap v2188: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:51:38.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:51:38 smithi132 bash[27079]: audit 2020-07-16T14:51:38.402831+0000 mon.b (mon.2) 830 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:51:38.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:51:38 smithi188 bash[23329]: audit 2020-07-16T14:51:38.402831+0000 mon.b (mon.2) 830 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:51:39.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:51:39 smithi188 bash[23329]: cephadm 2020-07-16T14:51:38.403537+0000 mgr.x (mgr.34562) 3513 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:51:39.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:51:39 smithi188 bash[23329]: cephadm 2020-07-16T14:51:38.403957+0000 mgr.x (mgr.34562) 3514 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:51:39.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:51:39 smithi188 bash[23329]: cluster 2020-07-16T14:51:38.469541+0000 mgr.x (mgr.34562) 3515 : cluster [DBG] pgmap v2189: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:51:40.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:51:39 smithi132 bash[27079]: cephadm 2020-07-16T14:51:38.403537+0000 mgr.x (mgr.34562) 3513 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:51:40.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:51:39 smithi132 bash[27079]: cephadm 2020-07-16T14:51:38.403957+0000 mgr.x (mgr.34562) 3514 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:51:40.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:51:39 smithi132 bash[27079]: cluster 2020-07-16T14:51:38.469541+0000 mgr.x (mgr.34562) 3515 : cluster [DBG] pgmap v2189: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:51:41.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:51:40 smithi188 bash[23329]: cluster 2020-07-16T14:51:40.470033+0000 mgr.x (mgr.34562) 3516 : cluster [DBG] pgmap v2190: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:51:41.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:51:40 smithi132 bash[27079]: cluster 2020-07-16T14:51:40.470033+0000 mgr.x (mgr.34562) 3516 : cluster [DBG] pgmap v2190: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:51:43.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:51:43 smithi132 bash[27079]: cluster 2020-07-16T14:51:42.470420+0000 mgr.x (mgr.34562) 3517 : cluster [DBG] pgmap v2191: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:51:43.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:51:43 smithi188 bash[23329]: cluster 2020-07-16T14:51:42.470420+0000 mgr.x (mgr.34562) 3517 : cluster [DBG] pgmap v2191: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:51:45.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:51:45 smithi132 bash[27079]: cluster 2020-07-16T14:51:44.470819+0000 mgr.x (mgr.34562) 3518 : cluster [DBG] pgmap v2192: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:51:45.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:51:45 smithi188 bash[23329]: cluster 2020-07-16T14:51:44.470819+0000 mgr.x (mgr.34562) 3518 : cluster [DBG] pgmap v2192: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:51:47.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:51:47 smithi188 bash[23329]: cluster 2020-07-16T14:51:46.471279+0000 mgr.x (mgr.34562) 3519 : cluster [DBG] pgmap v2193: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:51:48.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:51:47 smithi132 bash[27079]: cluster 2020-07-16T14:51:46.471279+0000 mgr.x (mgr.34562) 3519 : cluster [DBG] pgmap v2193: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:51:49.090 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:51:49.483 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:51:49.484 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (74m) 9m ago 77m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:51:49.484 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (77m) 9m ago 77m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:51:49.484 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (74m) 9m ago 80m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:51:49.485 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (74m) 9m ago 82m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:51:49.485 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 9m ago 82m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:51:49.485 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (80m) 9m ago 80m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:51:49.485 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (80m) 9m ago 80m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:51:49.485 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (77m) 9m ago 77m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:51:49.486 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (77m) 9m ago 77m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:51:49.486 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (80m) 9m ago 80m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:51:49.486 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (79m) 9m ago 79m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:51:49.486 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (79m) 9m ago 79m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:51:49.486 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (79m) 9m ago 79m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:51:49.487 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (78m) 9m ago 79m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:51:49.487 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (78m) 9m ago 78m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:51:49.487 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (78m) 9m ago 78m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:51:49.487 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (78m) 9m ago 78m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:51:49.487 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (77m) 9m ago 77m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:51:49.649 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:51:49.649 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:51:49.649 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:51:49.650 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:51:49.650 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:51:49.650 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:51:49.650 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:51:49.650 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:51:49.651 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:51:49.651 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:51:49.651 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:51:49.651 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:51:49.651 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:51:49.652 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:51:49.652 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:51:49.652 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:51:49.652 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:51:49.929 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:51:49 smithi188 bash[23329]: cluster 2020-07-16T14:51:48.471790+0000 mgr.x (mgr.34562) 3520 : cluster [DBG] pgmap v2194: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:51:50.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:51:49 smithi132 bash[27079]: cluster 2020-07-16T14:51:48.471790+0000 mgr.x (mgr.34562) 3520 : cluster [DBG] pgmap v2194: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:51:50.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:51:50 smithi188 bash[23329]: audit 2020-07-16T14:51:49.078533+0000 mgr.x (mgr.34562) 3521 : audit [DBG] from='client.27196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:51:50.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:51:50 smithi188 bash[23329]: audit 2020-07-16T14:51:49.346375+0000 mgr.x (mgr.34562) 3522 : audit [DBG] from='client.27202 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:51:50.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:51:50 smithi188 bash[23329]: audit 2020-07-16T14:51:49.648154+0000 mon.c (mon.1) 265 : audit [DBG] from='client.? 172.21.15.132:0/2247147305' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:51:51.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:51:50 smithi132 bash[27079]: audit 2020-07-16T14:51:49.078533+0000 mgr.x (mgr.34562) 3521 : audit [DBG] from='client.27196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:51:51.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:51:50 smithi132 bash[27079]: audit 2020-07-16T14:51:49.346375+0000 mgr.x (mgr.34562) 3522 : audit [DBG] from='client.27202 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:51:51.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:51:50 smithi132 bash[27079]: audit 2020-07-16T14:51:49.648154+0000 mon.c (mon.1) 265 : audit [DBG] from='client.? 172.21.15.132:0/2247147305' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:51:51.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:51:51 smithi188 bash[23329]: cluster 2020-07-16T14:51:50.472172+0000 mgr.x (mgr.34562) 3523 : cluster [DBG] pgmap v2195: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:51:52.035 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:51:51 smithi132 bash[27079]: cluster 2020-07-16T14:51:50.472172+0000 mgr.x (mgr.34562) 3523 : cluster [DBG] pgmap v2195: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:51:53.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:51:53 smithi188 bash[23329]: cluster 2020-07-16T14:51:52.472544+0000 mgr.x (mgr.34562) 3524 : cluster [DBG] pgmap v2196: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:51:53.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:51:53 smithi188 bash[23329]: audit 2020-07-16T14:51:53.406178+0000 mon.b (mon.2) 831 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:51:54.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:51:53 smithi132 bash[27079]: cluster 2020-07-16T14:51:52.472544+0000 mgr.x (mgr.34562) 3524 : cluster [DBG] pgmap v2196: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:51:54.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:51:53 smithi132 bash[27079]: audit 2020-07-16T14:51:53.406178+0000 mon.b (mon.2) 831 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:51:54.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:51:54 smithi188 bash[23329]: cephadm 2020-07-16T14:51:53.406898+0000 mgr.x (mgr.34562) 3525 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:51:54.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:51:54 smithi188 bash[23329]: cephadm 2020-07-16T14:51:53.407332+0000 mgr.x (mgr.34562) 3526 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:51:55.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:51:54 smithi132 bash[27079]: cephadm 2020-07-16T14:51:53.406898+0000 mgr.x (mgr.34562) 3525 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:51:55.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:51:54 smithi132 bash[27079]: cephadm 2020-07-16T14:51:53.407332+0000 mgr.x (mgr.34562) 3526 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:51:55.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:51:55 smithi188 bash[23329]: cluster 2020-07-16T14:51:54.473012+0000 mgr.x (mgr.34562) 3527 : cluster [DBG] pgmap v2197: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:51:56.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:51:55 smithi132 bash[27079]: cluster 2020-07-16T14:51:54.473012+0000 mgr.x (mgr.34562) 3527 : cluster [DBG] pgmap v2197: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:51:57.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:51:57 smithi188 bash[23329]: cluster 2020-07-16T14:51:56.473494+0000 mgr.x (mgr.34562) 3528 : cluster [DBG] pgmap v2198: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:51:58.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:51:57 smithi132 bash[27079]: cluster 2020-07-16T14:51:56.473494+0000 mgr.x (mgr.34562) 3528 : cluster [DBG] pgmap v2198: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:51:59.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:51:59 smithi188 bash[23329]: cluster 2020-07-16T14:51:58.473859+0000 mgr.x (mgr.34562) 3529 : cluster [DBG] pgmap v2199: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:52:00.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:51:59 smithi132 bash[27079]: cluster 2020-07-16T14:51:58.473859+0000 mgr.x (mgr.34562) 3529 : cluster [DBG] pgmap v2199: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:52:01.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:00 smithi188 bash[23329]: cluster 2020-07-16T14:52:00.474340+0000 mgr.x (mgr.34562) 3530 : cluster [DBG] pgmap v2200: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:52:01.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:00 smithi132 bash[27079]: cluster 2020-07-16T14:52:00.474340+0000 mgr.x (mgr.34562) 3530 : cluster [DBG] pgmap v2200: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:52:03.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:03 smithi188 bash[23329]: cluster 2020-07-16T14:52:02.474898+0000 mgr.x (mgr.34562) 3531 : cluster [DBG] pgmap v2201: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:52:04.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:03 smithi132 bash[27079]: cluster 2020-07-16T14:52:02.474898+0000 mgr.x (mgr.34562) 3531 : cluster [DBG] pgmap v2201: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:52:05.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:05 smithi188 bash[23329]: cluster 2020-07-16T14:52:04.475220+0000 mgr.x (mgr.34562) 3532 : cluster [DBG] pgmap v2202: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:52:06.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:05 smithi132 bash[27079]: cluster 2020-07-16T14:52:04.475220+0000 mgr.x (mgr.34562) 3532 : cluster [DBG] pgmap v2202: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:52:07.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:07 smithi188 bash[23329]: cluster 2020-07-16T14:52:06.475538+0000 mgr.x (mgr.34562) 3533 : cluster [DBG] pgmap v2203: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:52:08.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:07 smithi132 bash[27079]: cluster 2020-07-16T14:52:06.475538+0000 mgr.x (mgr.34562) 3533 : cluster [DBG] pgmap v2203: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:52:08.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:08 smithi188 bash[23329]: audit 2020-07-16T14:52:08.422934+0000 mon.b (mon.2) 832 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:52:09.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:08 smithi132 bash[27079]: audit 2020-07-16T14:52:08.422934+0000 mon.b (mon.2) 832 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:52:09.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:09 smithi188 bash[23329]: cephadm 2020-07-16T14:52:08.423691+0000 mgr.x (mgr.34562) 3534 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:52:09.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:09 smithi188 bash[23329]: cephadm 2020-07-16T14:52:08.423783+0000 mgr.x (mgr.34562) 3535 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:52:09.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:09 smithi188 bash[23329]: cluster 2020-07-16T14:52:08.475998+0000 mgr.x (mgr.34562) 3536 : cluster [DBG] pgmap v2204: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:52:10.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:09 smithi132 bash[27079]: cephadm 2020-07-16T14:52:08.423691+0000 mgr.x (mgr.34562) 3534 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:52:10.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:09 smithi132 bash[27079]: cephadm 2020-07-16T14:52:08.423783+0000 mgr.x (mgr.34562) 3535 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:52:10.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:09 smithi132 bash[27079]: cluster 2020-07-16T14:52:08.475998+0000 mgr.x (mgr.34562) 3536 : cluster [DBG] pgmap v2204: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:52:11.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:10 smithi132 bash[27079]: cluster 2020-07-16T14:52:10.476506+0000 mgr.x (mgr.34562) 3537 : cluster [DBG] pgmap v2205: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:52:11.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:10 smithi188 bash[23329]: cluster 2020-07-16T14:52:10.476506+0000 mgr.x (mgr.34562) 3537 : cluster [DBG] pgmap v2205: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:52:13.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:13 smithi188 bash[23329]: cluster 2020-07-16T14:52:12.477038+0000 mgr.x (mgr.34562) 3538 : cluster [DBG] pgmap v2206: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:52:14.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:13 smithi132 bash[27079]: cluster 2020-07-16T14:52:12.477038+0000 mgr.x (mgr.34562) 3538 : cluster [DBG] pgmap v2206: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:52:15.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:15 smithi188 bash[23329]: cluster 2020-07-16T14:52:14.477564+0000 mgr.x (mgr.34562) 3539 : cluster [DBG] pgmap v2207: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:52:16.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:15 smithi132 bash[27079]: cluster 2020-07-16T14:52:14.477564+0000 mgr.x (mgr.34562) 3539 : cluster [DBG] pgmap v2207: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:52:17.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:17 smithi188 bash[23329]: cluster 2020-07-16T14:52:16.478019+0000 mgr.x (mgr.34562) 3540 : cluster [DBG] pgmap v2208: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:52:18.034 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:17 smithi132 bash[27079]: cluster 2020-07-16T14:52:16.478019+0000 mgr.x (mgr.34562) 3540 : cluster [DBG] pgmap v2208: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:52:19.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:19 smithi188 bash[23329]: cluster 2020-07-16T14:52:18.478447+0000 mgr.x (mgr.34562) 3541 : cluster [DBG] pgmap v2209: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:52:19.959 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:52:20.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:19 smithi132 bash[27079]: cluster 2020-07-16T14:52:18.478447+0000 mgr.x (mgr.34562) 3541 : cluster [DBG] pgmap v2209: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:52:20.223 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:52:20.223 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (75m) 10m ago 78m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:52:20.223 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (77m) 10m ago 77m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:52:20.224 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (75m) 10m ago 80m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:52:20.224 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (74m) 10m ago 82m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:52:20.224 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 10m ago 82m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:52:20.224 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (81m) 10m ago 81m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:52:20.224 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (81m) 10m ago 81m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:52:20.225 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (78m) 10m ago 78m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:52:20.225 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (78m) 10m ago 78m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:52:20.225 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (80m) 10m ago 80m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:52:20.225 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (80m) 10m ago 80m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:52:20.225 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (80m) 10m ago 80m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:52:20.226 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (79m) 10m ago 79m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:52:20.226 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (79m) 10m ago 79m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:52:20.226 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (79m) 10m ago 79m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:52:20.226 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (78m) 10m ago 79m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:52:20.226 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (78m) 10m ago 78m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:52:20.226 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (77m) 10m ago 78m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:52:20.520 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:52:20.520 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:52:20.521 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:52:20.521 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:52:20.521 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:52:20.521 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:52:20.521 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:52:20.522 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:52:20.522 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:52:20.522 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:52:20.522 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:52:20.522 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:52:20.523 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:52:20.523 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:52:20.523 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:52:20.523 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:52:20.523 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:52:21.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:20 smithi188 bash[23329]: audit 2020-07-16T14:52:19.948043+0000 mgr.x (mgr.34562) 3542 : audit [DBG] from='client.27214 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:52:21.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:20 smithi188 bash[23329]: audit 2020-07-16T14:52:20.218722+0000 mgr.x (mgr.34562) 3543 : audit [DBG] from='client.27220 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:52:21.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:20 smithi188 bash[23329]: cluster 2020-07-16T14:52:20.478882+0000 mgr.x (mgr.34562) 3544 : cluster [DBG] pgmap v2210: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:52:21.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:20 smithi188 bash[23329]: audit 2020-07-16T14:52:20.519377+0000 mon.c (mon.1) 266 : audit [DBG] from='client.? 172.21.15.132:0/1094647688' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:52:21.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:20 smithi132 bash[27079]: audit 2020-07-16T14:52:19.948043+0000 mgr.x (mgr.34562) 3542 : audit [DBG] from='client.27214 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:52:21.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:20 smithi132 bash[27079]: audit 2020-07-16T14:52:20.218722+0000 mgr.x (mgr.34562) 3543 : audit [DBG] from='client.27220 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:52:21.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:20 smithi132 bash[27079]: cluster 2020-07-16T14:52:20.478882+0000 mgr.x (mgr.34562) 3544 : cluster [DBG] pgmap v2210: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:52:21.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:20 smithi132 bash[27079]: audit 2020-07-16T14:52:20.519377+0000 mon.c (mon.1) 266 : audit [DBG] from='client.? 172.21.15.132:0/1094647688' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:52:23.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:23 smithi188 bash[23329]: cluster 2020-07-16T14:52:22.479327+0000 mgr.x (mgr.34562) 3545 : cluster [DBG] pgmap v2211: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:52:23.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:23 smithi188 bash[23329]: audit 2020-07-16T14:52:23.433252+0000 mon.b (mon.2) 833 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:52:24.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:23 smithi132 bash[27079]: cluster 2020-07-16T14:52:22.479327+0000 mgr.x (mgr.34562) 3545 : cluster [DBG] pgmap v2211: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:52:24.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:23 smithi132 bash[27079]: audit 2020-07-16T14:52:23.433252+0000 mon.b (mon.2) 833 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:52:24.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:24 smithi188 bash[23329]: cephadm 2020-07-16T14:52:23.433982+0000 mgr.x (mgr.34562) 3546 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:52:24.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:24 smithi188 bash[23329]: cephadm 2020-07-16T14:52:23.434414+0000 mgr.x (mgr.34562) 3547 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:52:25.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:24 smithi132 bash[27079]: cephadm 2020-07-16T14:52:23.433982+0000 mgr.x (mgr.34562) 3546 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:52:25.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:24 smithi132 bash[27079]: cephadm 2020-07-16T14:52:23.434414+0000 mgr.x (mgr.34562) 3547 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:52:25.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:25 smithi188 bash[23329]: cluster 2020-07-16T14:52:24.479835+0000 mgr.x (mgr.34562) 3548 : cluster [DBG] pgmap v2212: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:52:26.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:25 smithi132 bash[27079]: cluster 2020-07-16T14:52:24.479835+0000 mgr.x (mgr.34562) 3548 : cluster [DBG] pgmap v2212: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:52:27.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:27 smithi188 bash[23329]: cluster 2020-07-16T14:52:26.480244+0000 mgr.x (mgr.34562) 3549 : cluster [DBG] pgmap v2213: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:52:28.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:27 smithi132 bash[27079]: cluster 2020-07-16T14:52:26.480244+0000 mgr.x (mgr.34562) 3549 : cluster [DBG] pgmap v2213: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:52:29.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:29 smithi188 bash[23329]: cluster 2020-07-16T14:52:28.480658+0000 mgr.x (mgr.34562) 3550 : cluster [DBG] pgmap v2214: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:52:30.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:29 smithi132 bash[27079]: cluster 2020-07-16T14:52:28.480658+0000 mgr.x (mgr.34562) 3550 : cluster [DBG] pgmap v2214: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:52:31.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:30 smithi132 bash[27079]: cluster 2020-07-16T14:52:30.481100+0000 mgr.x (mgr.34562) 3551 : cluster [DBG] pgmap v2215: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:52:31.433 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:30 smithi188 bash[23329]: cluster 2020-07-16T14:52:30.481100+0000 mgr.x (mgr.34562) 3551 : cluster [DBG] pgmap v2215: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:52:33.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:33 smithi188 bash[23329]: cluster 2020-07-16T14:52:32.481634+0000 mgr.x (mgr.34562) 3552 : cluster [DBG] pgmap v2216: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:52:34.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:33 smithi132 bash[27079]: cluster 2020-07-16T14:52:32.481634+0000 mgr.x (mgr.34562) 3552 : cluster [DBG] pgmap v2216: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:52:35.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:35 smithi188 bash[23329]: cluster 2020-07-16T14:52:34.482138+0000 mgr.x (mgr.34562) 3553 : cluster [DBG] pgmap v2217: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:52:36.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:35 smithi132 bash[27079]: cluster 2020-07-16T14:52:34.482138+0000 mgr.x (mgr.34562) 3553 : cluster [DBG] pgmap v2217: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:52:37.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:37 smithi188 bash[23329]: cluster 2020-07-16T14:52:36.482580+0000 mgr.x (mgr.34562) 3554 : cluster [DBG] pgmap v2218: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:52:38.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:37 smithi132 bash[27079]: cluster 2020-07-16T14:52:36.482580+0000 mgr.x (mgr.34562) 3554 : cluster [DBG] pgmap v2218: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:52:38.872 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:38 smithi188 bash[23329]: audit 2020-07-16T14:52:38.450557+0000 mon.b (mon.2) 834 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T14:52:38.872 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:38 smithi188 bash[23329]: audit 2020-07-16T14:52:38.450851+0000 mon.b (mon.2) 835 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T14:52:39.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:38 smithi132 bash[27079]: audit 2020-07-16T14:52:38.450557+0000 mon.b (mon.2) 834 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T14:52:39.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:38 smithi132 bash[27079]: audit 2020-07-16T14:52:38.450851+0000 mon.b (mon.2) 835 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T14:52:39.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:39 smithi188 bash[23329]: cluster 2020-07-16T14:52:38.482945+0000 mgr.x (mgr.34562) 3555 : cluster [DBG] pgmap v2219: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:52:39.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:39 smithi132 bash[27079]: cluster 2020-07-16T14:52:38.482945+0000 mgr.x (mgr.34562) 3555 : cluster [DBG] pgmap v2219: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:52:41.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:40 smithi188 bash[23329]: cluster 2020-07-16T14:52:40.483395+0000 mgr.x (mgr.34562) 3556 : cluster [DBG] pgmap v2220: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:52:41.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:40 smithi188 bash[23329]: audit 2020-07-16T14:52:40.632814+0000 mon.b (mon.2) 836 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:52:40.630814\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.630873\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.630910\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.630940\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.631136\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.631347\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.631547\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.631737\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.631780\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:52:40.631859\", \"last_device_update\": \"2020-07-16T14:33:41.233618\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:44:15.518016\"}"}]: dispatch 2020-07-16T14:52:41.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:40 smithi188 bash[23329]: audit 2020-07-16T14:52:40.633056+0000 mon.c (mon.1) 267 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:52:40.630814\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.630873\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.630910\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.630940\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.631136\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.631347\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.631547\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.631737\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.631780\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:52:40.631859\", \"last_device_update\": \"2020-07-16T14:33:41.233618\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:44:15.518016\"}"}]: dispatch 2020-07-16T14:52:41.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:40 smithi188 bash[23329]: audit 2020-07-16T14:52:40.635783+0000 mon.c (mon.1) 268 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:52:40.630814\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.630873\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.630910\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.630940\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.631136\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.631347\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.631547\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.631737\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.631780\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:52:40.631859\", \"last_device_update\": \"2020-07-16T14:33:41.233618\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:44:15.518016\"}"}]': finished 2020-07-16T14:52:41.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:40 smithi132 bash[27079]: cluster 2020-07-16T14:52:40.483395+0000 mgr.x (mgr.34562) 3556 : cluster [DBG] pgmap v2220: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:52:41.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:40 smithi132 bash[27079]: audit 2020-07-16T14:52:40.632814+0000 mon.b (mon.2) 836 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:52:40.630814\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.630873\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.630910\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.630940\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.631136\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.631347\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.631547\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.631737\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.631780\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:52:40.631859\", \"last_device_update\": \"2020-07-16T14:33:41.233618\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:44:15.518016\"}"}]: dispatch 2020-07-16T14:52:41.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:40 smithi132 bash[27079]: audit 2020-07-16T14:52:40.633056+0000 mon.c (mon.1) 267 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:52:40.630814\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.630873\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.630910\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.630940\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.631136\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.631347\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.631547\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.631737\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.631780\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:52:40.631859\", \"last_device_update\": \"2020-07-16T14:33:41.233618\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:44:15.518016\"}"}]: dispatch 2020-07-16T14:52:41.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:40 smithi132 bash[27079]: audit 2020-07-16T14:52:40.635783+0000 mon.c (mon.1) 268 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:52:40.630814\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.630873\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.630910\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.630940\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.631136\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.631347\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.631547\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.631737\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.631780\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:52:40.631859\", \"last_device_update\": \"2020-07-16T14:33:41.233618\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:44:15.518016\"}"}]': finished 2020-07-16T14:52:42.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:41 smithi132 bash[27079]: audit 2020-07-16T14:52:40.929322+0000 mon.b (mon.2) 837 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.927892\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.927959\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.927990\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928144\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928244\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928369\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928473\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928507\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928536\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:52:40.928621\", \"last_device_update\": \"2020-07-16T14:34:46.715995\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:44:15.520478\"}"}]: dispatch 2020-07-16T14:52:42.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:41 smithi132 bash[27079]: audit 2020-07-16T14:52:40.929657+0000 mon.c (mon.1) 269 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.927892\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.927959\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.927990\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928144\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928244\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928369\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928473\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928507\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928536\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:52:40.928621\", \"last_device_update\": \"2020-07-16T14:34:46.715995\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:44:15.520478\"}"}]: dispatch 2020-07-16T14:52:42.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:41 smithi132 bash[27079]: audit 2020-07-16T14:52:40.931761+0000 mon.c (mon.1) 270 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.927892\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.927959\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.927990\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928144\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928244\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928369\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928473\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928507\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928536\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:52:40.928621\", \"last_device_update\": \"2020-07-16T14:34:46.715995\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:44:15.520478\"}"}]': finished 2020-07-16T14:52:42.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:41 smithi132 bash[27079]: audit 2020-07-16T14:52:40.934741+0000 mon.b (mon.2) 838 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:52:42.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:41 smithi132 bash[27079]: audit 2020-07-16T14:52:40.935033+0000 mgr.x (mgr.34562) 3557 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:52:42.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:41 smithi132 bash[27079]: audit 2020-07-16T14:52:40.935729+0000 mon.b (mon.2) 839 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:52:42.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:41 smithi132 bash[27079]: audit 2020-07-16T14:52:40.935975+0000 mgr.x (mgr.34562) 3558 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:52:42.033 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:41 smithi132 bash[27079]: audit 2020-07-16T14:52:40.936586+0000 mon.b (mon.2) 840 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:52:42.033 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:41 smithi132 bash[27079]: audit 2020-07-16T14:52:40.936808+0000 mgr.x (mgr.34562) 3559 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:52:42.033 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:41 smithi132 bash[27079]: cephadm 2020-07-16T14:52:40.937335+0000 mgr.x (mgr.34562) 3560 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:52:42.033 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:41 smithi132 bash[27079]: audit 2020-07-16T14:52:40.937659+0000 mon.b (mon.2) 841 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:52:42.033 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:41 smithi132 bash[27079]: cephadm 2020-07-16T14:52:40.938338+0000 mgr.x (mgr.34562) 3561 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:52:42.034 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:41 smithi132 bash[27079]: audit 2020-07-16T14:52:40.938639+0000 mon.b (mon.2) 842 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:52:42.034 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:41 smithi132 bash[27079]: cephadm 2020-07-16T14:52:40.939175+0000 mgr.x (mgr.34562) 3562 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:52:42.034 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:41 smithi132 bash[27079]: cephadm 2020-07-16T14:52:40.939350+0000 mgr.x (mgr.34562) 3563 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:52:42.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:41 smithi188 bash[23329]: audit 2020-07-16T14:52:40.929322+0000 mon.b (mon.2) 837 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.927892\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.927959\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.927990\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928144\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928244\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928369\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928473\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928507\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928536\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:52:40.928621\", \"last_device_update\": \"2020-07-16T14:34:46.715995\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:44:15.520478\"}"}]: dispatch 2020-07-16T14:52:42.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:41 smithi188 bash[23329]: audit 2020-07-16T14:52:40.929657+0000 mon.c (mon.1) 269 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.927892\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.927959\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.927990\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928144\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928244\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928369\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928473\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928507\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928536\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:52:40.928621\", \"last_device_update\": \"2020-07-16T14:34:46.715995\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:44:15.520478\"}"}]: dispatch 2020-07-16T14:52:42.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:41 smithi188 bash[23329]: audit 2020-07-16T14:52:40.931761+0000 mon.c (mon.1) 270 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.927892\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.927959\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.927990\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928144\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928244\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928369\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928473\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928507\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928536\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:52:40.928621\", \"last_device_update\": \"2020-07-16T14:34:46.715995\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:44:15.520478\"}"}]': finished 2020-07-16T14:52:42.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:41 smithi188 bash[23329]: audit 2020-07-16T14:52:40.934741+0000 mon.b (mon.2) 838 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:52:42.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:41 smithi188 bash[23329]: audit 2020-07-16T14:52:40.935033+0000 mgr.x (mgr.34562) 3557 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:52:42.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:41 smithi188 bash[23329]: audit 2020-07-16T14:52:40.935729+0000 mon.b (mon.2) 839 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:52:42.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:41 smithi188 bash[23329]: audit 2020-07-16T14:52:40.935975+0000 mgr.x (mgr.34562) 3558 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:52:42.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:41 smithi188 bash[23329]: audit 2020-07-16T14:52:40.936586+0000 mon.b (mon.2) 840 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:52:42.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:41 smithi188 bash[23329]: audit 2020-07-16T14:52:40.936808+0000 mgr.x (mgr.34562) 3559 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:52:42.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:41 smithi188 bash[23329]: cephadm 2020-07-16T14:52:40.937335+0000 mgr.x (mgr.34562) 3560 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:52:42.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:41 smithi188 bash[23329]: audit 2020-07-16T14:52:40.937659+0000 mon.b (mon.2) 841 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:52:42.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:41 smithi188 bash[23329]: cephadm 2020-07-16T14:52:40.938338+0000 mgr.x (mgr.34562) 3561 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:52:42.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:41 smithi188 bash[23329]: audit 2020-07-16T14:52:40.938639+0000 mon.b (mon.2) 842 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:52:42.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:41 smithi188 bash[23329]: cephadm 2020-07-16T14:52:40.939175+0000 mgr.x (mgr.34562) 3562 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:52:42.425 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:41 smithi188 bash[23329]: cephadm 2020-07-16T14:52:40.939350+0000 mgr.x (mgr.34562) 3563 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:52:43.249 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:42 smithi132 bash[27079]: cluster 2020-07-16T14:52:42.483831+0000 mgr.x (mgr.34562) 3564 : cluster [DBG] pgmap v2221: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:52:43.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:42 smithi188 bash[23329]: cluster 2020-07-16T14:52:42.483831+0000 mgr.x (mgr.34562) 3564 : cluster [DBG] pgmap v2221: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:52:44.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:43 smithi132 bash[27079]: audit 2020-07-16T14:52:43.776438+0000 mon.b (mon.2) 843 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:52:44.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:43 smithi188 bash[23329]: audit 2020-07-16T14:52:43.776438+0000 mon.b (mon.2) 843 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:52:45.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:44 smithi132 bash[27079]: cephadm 2020-07-16T14:52:43.777105+0000 mgr.x (mgr.34562) 3565 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:52:45.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:44 smithi132 bash[27079]: cephadm 2020-07-16T14:52:43.777265+0000 mgr.x (mgr.34562) 3566 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:52:45.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:44 smithi132 bash[27079]: cluster 2020-07-16T14:52:44.484382+0000 mgr.x (mgr.34562) 3567 : cluster [DBG] pgmap v2222: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:52:45.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:44 smithi188 bash[23329]: cephadm 2020-07-16T14:52:43.777105+0000 mgr.x (mgr.34562) 3565 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:52:45.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:44 smithi188 bash[23329]: cephadm 2020-07-16T14:52:43.777265+0000 mgr.x (mgr.34562) 3566 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:52:45.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:44 smithi188 bash[23329]: cluster 2020-07-16T14:52:44.484382+0000 mgr.x (mgr.34562) 3567 : cluster [DBG] pgmap v2222: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:52:47.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:47 smithi188 bash[23329]: cluster 2020-07-16T14:52:46.484917+0000 mgr.x (mgr.34562) 3568 : cluster [DBG] pgmap v2223: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:52:48.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:47 smithi132 bash[27079]: cluster 2020-07-16T14:52:46.484917+0000 mgr.x (mgr.34562) 3568 : cluster [DBG] pgmap v2223: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:52:49.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:49 smithi188 bash[23329]: cluster 2020-07-16T14:52:48.485411+0000 mgr.x (mgr.34562) 3569 : cluster [DBG] pgmap v2224: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:52:50.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:49 smithi132 bash[27079]: cluster 2020-07-16T14:52:48.485411+0000 mgr.x (mgr.34562) 3569 : cluster [DBG] pgmap v2224: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:52:50.818 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:52:51.079 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:52:51.080 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (75m) 10s ago 78m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:52:51.080 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (78m) 10s ago 78m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:52:51.080 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (75m) 10s ago 81m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:52:51.080 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (75m) 10s ago 83m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:52:51.081 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 10s ago 83m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:52:51.081 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (81m) 10s ago 81m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:52:51.081 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (81m) 10s ago 81m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:52:51.082 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (78m) 10s ago 78m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:52:51.082 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (78m) 10s ago 78m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:52:51.082 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (81m) 10s ago 81m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:52:51.082 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (80m) 10s ago 80m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:52:51.083 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (80m) 10s ago 80m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:52:51.083 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (80m) 10s ago 80m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:52:51.083 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (79m) 10s ago 80m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:52:51.083 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (79m) 10s ago 79m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:52:51.083 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (79m) 10s ago 79m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:52:51.084 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (79m) 10s ago 79m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:52:51.084 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (78m) 10s ago 78m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:52:51.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:50 smithi132 bash[27079]: cluster 2020-07-16T14:52:50.485807+0000 mgr.x (mgr.34562) 3570 : cluster [DBG] pgmap v2225: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:52:51.376 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:52:51.377 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:52:51.377 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:52:51.377 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:52:51.378 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:52:51.378 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:52:51.378 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:52:51.378 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:52:51.379 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:52:51.379 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:52:51.379 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:52:51.379 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:52:51.379 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:52:51.380 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:52:51.380 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:52:51.380 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:52:51.380 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:52:51.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:50 smithi188 bash[23329]: cluster 2020-07-16T14:52:50.485807+0000 mgr.x (mgr.34562) 3570 : cluster [DBG] pgmap v2225: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:52:52.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:51 smithi132 bash[27079]: audit 2020-07-16T14:52:50.805709+0000 mgr.x (mgr.34562) 3571 : audit [DBG] from='client.27232 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:52:52.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:51 smithi132 bash[27079]: audit 2020-07-16T14:52:51.075108+0000 mgr.x (mgr.34562) 3572 : audit [DBG] from='client.27238 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:52:52.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:51 smithi132 bash[27079]: audit 2020-07-16T14:52:51.375463+0000 mon.c (mon.1) 271 : audit [DBG] from='client.? 172.21.15.132:0/3471509295' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:52:52.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:51 smithi188 bash[23329]: audit 2020-07-16T14:52:50.805709+0000 mgr.x (mgr.34562) 3571 : audit [DBG] from='client.27232 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:52:52.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:51 smithi188 bash[23329]: audit 2020-07-16T14:52:51.075108+0000 mgr.x (mgr.34562) 3572 : audit [DBG] from='client.27238 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:52:52.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:51 smithi188 bash[23329]: audit 2020-07-16T14:52:51.375463+0000 mon.c (mon.1) 271 : audit [DBG] from='client.? 172.21.15.132:0/3471509295' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:52:53.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:52 smithi132 bash[27079]: cluster 2020-07-16T14:52:52.486194+0000 mgr.x (mgr.34562) 3573 : cluster [DBG] pgmap v2226: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:52:53.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:52 smithi188 bash[23329]: cluster 2020-07-16T14:52:52.486194+0000 mgr.x (mgr.34562) 3573 : cluster [DBG] pgmap v2226: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:52:55.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:55 smithi188 bash[23329]: cluster 2020-07-16T14:52:54.486576+0000 mgr.x (mgr.34562) 3574 : cluster [DBG] pgmap v2227: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:52:56.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:55 smithi132 bash[27079]: cluster 2020-07-16T14:52:54.486576+0000 mgr.x (mgr.34562) 3574 : cluster [DBG] pgmap v2227: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:52:57.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:57 smithi188 bash[23329]: cluster 2020-07-16T14:52:56.486971+0000 mgr.x (mgr.34562) 3575 : cluster [DBG] pgmap v2228: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:52:58.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:57 smithi132 bash[27079]: cluster 2020-07-16T14:52:56.486971+0000 mgr.x (mgr.34562) 3575 : cluster [DBG] pgmap v2228: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:52:59.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:59 smithi188 bash[23329]: cluster 2020-07-16T14:52:58.487369+0000 mgr.x (mgr.34562) 3576 : cluster [DBG] pgmap v2229: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:52:59.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:52:59 smithi188 bash[23329]: audit 2020-07-16T14:52:58.792954+0000 mon.b (mon.2) 844 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:53:00.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:59 smithi132 bash[27079]: cluster 2020-07-16T14:52:58.487369+0000 mgr.x (mgr.34562) 3576 : cluster [DBG] pgmap v2229: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:53:00.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:52:59 smithi132 bash[27079]: audit 2020-07-16T14:52:58.792954+0000 mon.b (mon.2) 844 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:53:00.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:53:00 smithi188 bash[23329]: cephadm 2020-07-16T14:52:58.793719+0000 mgr.x (mgr.34562) 3577 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:53:00.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:53:00 smithi188 bash[23329]: cephadm 2020-07-16T14:52:58.794022+0000 mgr.x (mgr.34562) 3578 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:53:01.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:53:00 smithi132 bash[27079]: cephadm 2020-07-16T14:52:58.793719+0000 mgr.x (mgr.34562) 3577 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:53:01.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:53:00 smithi132 bash[27079]: cephadm 2020-07-16T14:52:58.794022+0000 mgr.x (mgr.34562) 3578 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:53:01.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:53:01 smithi188 bash[23329]: cluster 2020-07-16T14:53:00.487776+0000 mgr.x (mgr.34562) 3579 : cluster [DBG] pgmap v2230: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:53:02.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:53:01 smithi132 bash[27079]: cluster 2020-07-16T14:53:00.487776+0000 mgr.x (mgr.34562) 3579 : cluster [DBG] pgmap v2230: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:53:03.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:53:03 smithi188 bash[23329]: cluster 2020-07-16T14:53:02.488298+0000 mgr.x (mgr.34562) 3580 : cluster [DBG] pgmap v2231: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:53:04.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:53:03 smithi132 bash[27079]: cluster 2020-07-16T14:53:02.488298+0000 mgr.x (mgr.34562) 3580 : cluster [DBG] pgmap v2231: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:53:05.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:53:05 smithi188 bash[23329]: cluster 2020-07-16T14:53:04.488694+0000 mgr.x (mgr.34562) 3581 : cluster [DBG] pgmap v2232: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:53:06.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:53:05 smithi132 bash[27079]: cluster 2020-07-16T14:53:04.488694+0000 mgr.x (mgr.34562) 3581 : cluster [DBG] pgmap v2232: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:53:07.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:53:07 smithi188 bash[23329]: cluster 2020-07-16T14:53:06.489179+0000 mgr.x (mgr.34562) 3582 : cluster [DBG] pgmap v2233: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:53:08.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:53:07 smithi132 bash[27079]: cluster 2020-07-16T14:53:06.489179+0000 mgr.x (mgr.34562) 3582 : cluster [DBG] pgmap v2233: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:53:09.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:53:09 smithi188 bash[23329]: cluster 2020-07-16T14:53:08.489776+0000 mgr.x (mgr.34562) 3583 : cluster [DBG] pgmap v2234: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:53:10.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:53:09 smithi132 bash[27079]: cluster 2020-07-16T14:53:08.489776+0000 mgr.x (mgr.34562) 3583 : cluster [DBG] pgmap v2234: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:53:11.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:53:10 smithi132 bash[27079]: cluster 2020-07-16T14:53:10.490203+0000 mgr.x (mgr.34562) 3584 : cluster [DBG] pgmap v2235: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:53:11.428 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:53:10 smithi188 bash[23329]: cluster 2020-07-16T14:53:10.490203+0000 mgr.x (mgr.34562) 3584 : cluster [DBG] pgmap v2235: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:53:13.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:53:13 smithi188 bash[23329]: cluster 2020-07-16T14:53:12.490586+0000 mgr.x (mgr.34562) 3585 : cluster [DBG] pgmap v2236: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:53:14.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:53:13 smithi132 bash[27079]: cluster 2020-07-16T14:53:12.490586+0000 mgr.x (mgr.34562) 3585 : cluster [DBG] pgmap v2236: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:53:14.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:53:14 smithi188 bash[23329]: audit 2020-07-16T14:53:13.809772+0000 mon.b (mon.2) 845 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:53:15.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:53:14 smithi132 bash[27079]: audit 2020-07-16T14:53:13.809772+0000 mon.b (mon.2) 845 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:53:15.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:53:15 smithi188 bash[23329]: cephadm 2020-07-16T14:53:13.810476+0000 mgr.x (mgr.34562) 3586 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:53:15.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:53:15 smithi188 bash[23329]: cephadm 2020-07-16T14:53:13.810896+0000 mgr.x (mgr.34562) 3587 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:53:15.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:53:15 smithi188 bash[23329]: cluster 2020-07-16T14:53:14.491059+0000 mgr.x (mgr.34562) 3588 : cluster [DBG] pgmap v2237: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:53:16.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:53:15 smithi132 bash[27079]: cephadm 2020-07-16T14:53:13.810476+0000 mgr.x (mgr.34562) 3586 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:53:16.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:53:15 smithi132 bash[27079]: cephadm 2020-07-16T14:53:13.810896+0000 mgr.x (mgr.34562) 3587 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:53:16.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:53:15 smithi132 bash[27079]: cluster 2020-07-16T14:53:14.491059+0000 mgr.x (mgr.34562) 3588 : cluster [DBG] pgmap v2237: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:53:17.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:53:17 smithi188 bash[23329]: cluster 2020-07-16T14:53:16.491596+0000 mgr.x (mgr.34562) 3589 : cluster [DBG] pgmap v2238: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:53:18.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:53:17 smithi132 bash[27079]: cluster 2020-07-16T14:53:16.491596+0000 mgr.x (mgr.34562) 3589 : cluster [DBG] pgmap v2238: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:53:19.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:53:19 smithi188 bash[23329]: cluster 2020-07-16T14:53:18.492142+0000 mgr.x (mgr.34562) 3590 : cluster [DBG] pgmap v2239: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:53:20.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:53:19 smithi132 bash[27079]: cluster 2020-07-16T14:53:18.492142+0000 mgr.x (mgr.34562) 3590 : cluster [DBG] pgmap v2239: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:53:21.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:53:20 smithi132 bash[27079]: cluster 2020-07-16T14:53:20.492550+0000 mgr.x (mgr.34562) 3591 : cluster [DBG] pgmap v2240: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:53:21.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:53:20 smithi188 bash[23329]: cluster 2020-07-16T14:53:20.492550+0000 mgr.x (mgr.34562) 3591 : cluster [DBG] pgmap v2240: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:53:21.676 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:53:21.937 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:53:21.938 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (76m) 41s ago 79m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:53:21.938 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (78m) 41s ago 78m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:53:21.938 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (76m) 41s ago 81m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:53:21.939 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (75m) 41s ago 83m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:53:21.939 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 41s ago 83m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:53:21.939 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (82m) 41s ago 82m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:53:21.939 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (82m) 41s ago 82m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:53:21.940 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (79m) 41s ago 79m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:53:21.940 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (79m) 41s ago 79m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:53:21.940 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (81m) 41s ago 81m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:53:21.941 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (81m) 41s ago 81m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:53:21.941 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (81m) 41s ago 81m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:53:21.941 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (80m) 41s ago 80m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:53:21.942 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (80m) 41s ago 80m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:53:21.942 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (80m) 41s ago 80m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:53:21.942 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (80m) 41s ago 80m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:53:21.942 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (79m) 41s ago 79m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:53:21.943 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (78m) 41s ago 79m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:53:22.233 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:53:22.233 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:53:22.234 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:53:22.234 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:53:22.234 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:53:22.234 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:53:22.234 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:53:22.235 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:53:22.235 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:53:22.235 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:53:22.235 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:53:22.235 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:53:22.235 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:53:22.236 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:53:22.236 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:53:22.236 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:53:22.236 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:53:22.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:53:22 smithi188 bash[23329]: audit 2020-07-16T14:53:22.232355+0000 mon.c (mon.1) 272 : audit [DBG] from='client.? 172.21.15.132:0/1953106598' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:53:22.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:53:22 smithi132 bash[27079]: audit 2020-07-16T14:53:22.232355+0000 mon.c (mon.1) 272 : audit [DBG] from='client.? 172.21.15.132:0/1953106598' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:53:23.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:53:23 smithi188 bash[23329]: audit 2020-07-16T14:53:21.664038+0000 mgr.x (mgr.34562) 3592 : audit [DBG] from='client.27250 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:53:23.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:53:23 smithi188 bash[23329]: audit 2020-07-16T14:53:21.932529+0000 mgr.x (mgr.34562) 3593 : audit [DBG] from='client.27256 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:53:23.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:53:23 smithi188 bash[23329]: cluster 2020-07-16T14:53:22.493025+0000 mgr.x (mgr.34562) 3594 : cluster [DBG] pgmap v2241: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:53:23.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:53:23 smithi132 bash[27079]: audit 2020-07-16T14:53:21.664038+0000 mgr.x (mgr.34562) 3592 : audit [DBG] from='client.27250 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:53:23.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:53:23 smithi132 bash[27079]: audit 2020-07-16T14:53:21.932529+0000 mgr.x (mgr.34562) 3593 : audit [DBG] from='client.27256 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:53:23.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:53:23 smithi132 bash[27079]: cluster 2020-07-16T14:53:22.493025+0000 mgr.x (mgr.34562) 3594 : cluster [DBG] pgmap v2241: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:53:25.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:53:25 smithi188 bash[23329]: cluster 2020-07-16T14:53:24.493444+0000 mgr.x (mgr.34562) 3595 : cluster [DBG] pgmap v2242: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:53:26.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:53:25 smithi132 bash[27079]: cluster 2020-07-16T14:53:24.493444+0000 mgr.x (mgr.34562) 3595 : cluster [DBG] pgmap v2242: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:53:27.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:53:27 smithi188 bash[23329]: cluster 2020-07-16T14:53:26.493793+0000 mgr.x (mgr.34562) 3596 : cluster [DBG] pgmap v2243: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:53:28.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:53:27 smithi132 bash[27079]: cluster 2020-07-16T14:53:26.493793+0000 mgr.x (mgr.34562) 3596 : cluster [DBG] pgmap v2243: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:53:29.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:53:29 smithi188 bash[23329]: cluster 2020-07-16T14:53:28.494172+0000 mgr.x (mgr.34562) 3597 : cluster [DBG] pgmap v2244: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:53:29.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:53:29 smithi188 bash[23329]: audit 2020-07-16T14:53:28.819435+0000 mon.b (mon.2) 846 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:53:30.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:53:29 smithi132 bash[27079]: cluster 2020-07-16T14:53:28.494172+0000 mgr.x (mgr.34562) 3597 : cluster [DBG] pgmap v2244: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:53:30.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:53:29 smithi132 bash[27079]: audit 2020-07-16T14:53:28.819435+0000 mon.b (mon.2) 846 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:53:30.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:53:30 smithi188 bash[23329]: cephadm 2020-07-16T14:53:28.820159+0000 mgr.x (mgr.34562) 3598 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:53:30.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:53:30 smithi188 bash[23329]: cephadm 2020-07-16T14:53:28.820320+0000 mgr.x (mgr.34562) 3599 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:53:31.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:53:30 smithi132 bash[27079]: cephadm 2020-07-16T14:53:28.820159+0000 mgr.x (mgr.34562) 3598 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:53:31.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:53:30 smithi132 bash[27079]: cephadm 2020-07-16T14:53:28.820320+0000 mgr.x (mgr.34562) 3599 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:53:31.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:53:31 smithi188 bash[23329]: cluster 2020-07-16T14:53:30.494695+0000 mgr.x (mgr.34562) 3600 : cluster [DBG] pgmap v2245: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:53:32.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:53:31 smithi132 bash[27079]: cluster 2020-07-16T14:53:30.494695+0000 mgr.x (mgr.34562) 3600 : cluster [DBG] pgmap v2245: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:53:33.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:53:33 smithi188 bash[23329]: cluster 2020-07-16T14:53:32.495169+0000 mgr.x (mgr.34562) 3601 : cluster [DBG] pgmap v2246: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:53:34.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:53:33 smithi132 bash[27079]: cluster 2020-07-16T14:53:32.495169+0000 mgr.x (mgr.34562) 3601 : cluster [DBG] pgmap v2246: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:53:35.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:53:35 smithi188 bash[23329]: cluster 2020-07-16T14:53:34.495673+0000 mgr.x (mgr.34562) 3602 : cluster [DBG] pgmap v2247: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:53:36.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:53:35 smithi132 bash[27079]: cluster 2020-07-16T14:53:34.495673+0000 mgr.x (mgr.34562) 3602 : cluster [DBG] pgmap v2247: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:53:37.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:53:37 smithi188 bash[23329]: cluster 2020-07-16T14:53:36.496138+0000 mgr.x (mgr.34562) 3603 : cluster [DBG] pgmap v2248: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:53:38.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:53:37 smithi132 bash[27079]: cluster 2020-07-16T14:53:36.496138+0000 mgr.x (mgr.34562) 3603 : cluster [DBG] pgmap v2248: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:53:39.925 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:53:39 smithi188 bash[23329]: cluster 2020-07-16T14:53:38.496681+0000 mgr.x (mgr.34562) 3604 : cluster [DBG] pgmap v2249: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:53:40.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:53:39 smithi132 bash[27079]: cluster 2020-07-16T14:53:38.496681+0000 mgr.x (mgr.34562) 3604 : cluster [DBG] pgmap v2249: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:53:41.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:53:40 smithi132 bash[27079]: cluster 2020-07-16T14:53:40.497186+0000 mgr.x (mgr.34562) 3605 : cluster [DBG] pgmap v2250: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:53:41.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:53:40 smithi188 bash[23329]: cluster 2020-07-16T14:53:40.497186+0000 mgr.x (mgr.34562) 3605 : cluster [DBG] pgmap v2250: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:53:43.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:53:43 smithi188 bash[23329]: cluster 2020-07-16T14:53:42.497701+0000 mgr.x (mgr.34562) 3606 : cluster [DBG] pgmap v2251: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:53:44.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:53:43 smithi132 bash[27079]: cluster 2020-07-16T14:53:42.497701+0000 mgr.x (mgr.34562) 3606 : cluster [DBG] pgmap v2251: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:53:44.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:53:44 smithi188 bash[23329]: audit 2020-07-16T14:53:43.828302+0000 mon.b (mon.2) 847 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:53:44.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:53:44 smithi188 bash[23329]: audit 2020-07-16T14:53:43.829844+0000 mon.b (mon.2) 848 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:53:44.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:53:44 smithi188 bash[23329]: audit 2020-07-16T14:53:43.831052+0000 mon.b (mon.2) 849 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:53:44.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:53:44 smithi188 bash[23329]: audit 2020-07-16T14:53:43.832459+0000 mon.b (mon.2) 850 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:53:44.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:53:44 smithi188 bash[23329]: audit 2020-07-16T14:53:43.833694+0000 mon.b (mon.2) 851 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:53:45.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:53:44 smithi132 bash[27079]: audit 2020-07-16T14:53:43.828302+0000 mon.b (mon.2) 847 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:53:45.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:53:44 smithi132 bash[27079]: audit 2020-07-16T14:53:43.829844+0000 mon.b (mon.2) 848 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:53:45.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:53:44 smithi132 bash[27079]: audit 2020-07-16T14:53:43.831052+0000 mon.b (mon.2) 849 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:53:45.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:53:44 smithi132 bash[27079]: audit 2020-07-16T14:53:43.832459+0000 mon.b (mon.2) 850 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:53:45.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:53:44 smithi132 bash[27079]: audit 2020-07-16T14:53:43.833694+0000 mon.b (mon.2) 851 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:53:45.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:53:45 smithi188 bash[23329]: audit 2020-07-16T14:53:43.828691+0000 mgr.x (mgr.34562) 3607 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:53:45.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:53:45 smithi188 bash[23329]: audit 2020-07-16T14:53:43.830161+0000 mgr.x (mgr.34562) 3608 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:53:45.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:53:45 smithi188 bash[23329]: audit 2020-07-16T14:53:43.831359+0000 mgr.x (mgr.34562) 3609 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:53:45.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:53:45 smithi188 bash[23329]: cephadm 2020-07-16T14:53:43.832077+0000 mgr.x (mgr.34562) 3610 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:53:45.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:53:45 smithi188 bash[23329]: cephadm 2020-07-16T14:53:43.833269+0000 mgr.x (mgr.34562) 3611 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:53:45.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:53:45 smithi188 bash[23329]: cephadm 2020-07-16T14:53:43.834384+0000 mgr.x (mgr.34562) 3612 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:53:45.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:53:45 smithi188 bash[23329]: cephadm 2020-07-16T14:53:43.834677+0000 mgr.x (mgr.34562) 3613 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:53:45.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:53:45 smithi188 bash[23329]: cluster 2020-07-16T14:53:44.498136+0000 mgr.x (mgr.34562) 3614 : cluster [DBG] pgmap v2252: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:53:46.006 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:53:45 smithi132 bash[27079]: audit 2020-07-16T14:53:43.828691+0000 mgr.x (mgr.34562) 3607 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:53:46.007 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:53:45 smithi132 bash[27079]: audit 2020-07-16T14:53:43.830161+0000 mgr.x (mgr.34562) 3608 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:53:46.007 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:53:45 smithi132 bash[27079]: audit 2020-07-16T14:53:43.831359+0000 mgr.x (mgr.34562) 3609 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:53:46.007 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:53:45 smithi132 bash[27079]: cephadm 2020-07-16T14:53:43.832077+0000 mgr.x (mgr.34562) 3610 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:53:46.008 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:53:45 smithi132 bash[27079]: cephadm 2020-07-16T14:53:43.833269+0000 mgr.x (mgr.34562) 3611 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:53:46.008 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:53:45 smithi132 bash[27079]: cephadm 2020-07-16T14:53:43.834384+0000 mgr.x (mgr.34562) 3612 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:53:46.008 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:53:45 smithi132 bash[27079]: cephadm 2020-07-16T14:53:43.834677+0000 mgr.x (mgr.34562) 3613 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:53:46.008 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:53:45 smithi132 bash[27079]: cluster 2020-07-16T14:53:44.498136+0000 mgr.x (mgr.34562) 3614 : cluster [DBG] pgmap v2252: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:53:46.933 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:53:46 smithi188 bash[23329]: audit 2020-07-16T14:53:46.545428+0000 mon.b (mon.2) 852 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:53:47.033 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:53:46 smithi132 bash[27079]: audit 2020-07-16T14:53:46.545428+0000 mon.b (mon.2) 852 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:53:47.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:53:47 smithi188 bash[23329]: cluster 2020-07-16T14:53:46.498550+0000 mgr.x (mgr.34562) 3615 : cluster [DBG] pgmap v2253: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:53:47.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:53:47 smithi188 bash[23329]: cephadm 2020-07-16T14:53:46.546030+0000 mgr.x (mgr.34562) 3616 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:53:47.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:53:47 smithi188 bash[23329]: cephadm 2020-07-16T14:53:46.546166+0000 mgr.x (mgr.34562) 3617 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:53:48.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:53:47 smithi132 bash[27079]: cluster 2020-07-16T14:53:46.498550+0000 mgr.x (mgr.34562) 3615 : cluster [DBG] pgmap v2253: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:53:48.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:53:47 smithi132 bash[27079]: cephadm 2020-07-16T14:53:46.546030+0000 mgr.x (mgr.34562) 3616 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:53:48.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:53:47 smithi132 bash[27079]: cephadm 2020-07-16T14:53:46.546166+0000 mgr.x (mgr.34562) 3617 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:53:49.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:53:49 smithi188 bash[23329]: cluster 2020-07-16T14:53:48.498962+0000 mgr.x (mgr.34562) 3618 : cluster [DBG] pgmap v2254: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:53:50.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:53:49 smithi132 bash[27079]: cluster 2020-07-16T14:53:48.498962+0000 mgr.x (mgr.34562) 3618 : cluster [DBG] pgmap v2254: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:53:51.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:53:50 smithi132 bash[27079]: cluster 2020-07-16T14:53:50.499408+0000 mgr.x (mgr.34562) 3619 : cluster [DBG] pgmap v2255: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:53:51.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:53:50 smithi188 bash[23329]: cluster 2020-07-16T14:53:50.499408+0000 mgr.x (mgr.34562) 3619 : cluster [DBG] pgmap v2255: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:53:52.531 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:53:52.794 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:53:52.794 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (76m) 72s ago 79m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:53:52.794 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (79m) 71s ago 79m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:53:52.795 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (76m) 71s ago 82m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:53:52.795 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (76m) 72s ago 84m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:53:52.795 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 72s ago 84m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:53:52.795 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (82m) 71s ago 82m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:53:52.795 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (82m) 72s ago 82m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:53:52.796 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (79m) 72s ago 79m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:53:52.796 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (79m) 71s ago 79m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:53:52.796 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (82m) 72s ago 82m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:53:52.796 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (81m) 72s ago 81m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:53:52.796 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (81m) 72s ago 81m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:53:52.796 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (81m) 72s ago 81m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:53:52.797 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (80m) 71s ago 81m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:53:52.797 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (80m) 71s ago 80m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:53:52.797 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (80m) 71s ago 80m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:53:52.797 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (80m) 71s ago 80m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:53:52.797 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (79m) 71s ago 79m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:53:53.090 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:53:53.090 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:53:53.091 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:53:53.091 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:53:53.091 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:53:53.091 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:53:53.092 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:53:53.092 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:53:53.092 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:53:53.092 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:53:53.092 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:53:53.092 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:53:53.093 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:53:53.093 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:53:53.093 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:53:53.093 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:53:53.093 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:53:53.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:53:53 smithi188 bash[23329]: cluster 2020-07-16T14:53:52.499888+0000 mgr.x (mgr.34562) 3620 : cluster [DBG] pgmap v2256: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:53:53.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:53:53 smithi188 bash[23329]: audit 2020-07-16T14:53:52.519568+0000 mgr.x (mgr.34562) 3621 : audit [DBG] from='client.27268 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:53:53.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:53:53 smithi188 bash[23329]: audit 2020-07-16T14:53:53.089486+0000 mon.c (mon.1) 273 : audit [DBG] from='client.? 172.21.15.132:0/3630532512' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:53:54.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:53:53 smithi132 bash[27079]: cluster 2020-07-16T14:53:52.499888+0000 mgr.x (mgr.34562) 3620 : cluster [DBG] pgmap v2256: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:53:54.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:53:53 smithi132 bash[27079]: audit 2020-07-16T14:53:52.519568+0000 mgr.x (mgr.34562) 3621 : audit [DBG] from='client.27268 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:53:54.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:53:53 smithi132 bash[27079]: audit 2020-07-16T14:53:53.089486+0000 mon.c (mon.1) 273 : audit [DBG] from='client.? 172.21.15.132:0/3630532512' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:53:54.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:53:54 smithi188 bash[23329]: audit 2020-07-16T14:53:52.789813+0000 mgr.x (mgr.34562) 3622 : audit [DBG] from='client.27274 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:53:55.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:53:54 smithi132 bash[27079]: audit 2020-07-16T14:53:52.789813+0000 mgr.x (mgr.34562) 3622 : audit [DBG] from='client.27274 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:53:55.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:53:55 smithi188 bash[23329]: cluster 2020-07-16T14:53:54.500396+0000 mgr.x (mgr.34562) 3623 : cluster [DBG] pgmap v2257: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:53:56.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:53:55 smithi132 bash[27079]: cluster 2020-07-16T14:53:54.500396+0000 mgr.x (mgr.34562) 3623 : cluster [DBG] pgmap v2257: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:53:57.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:53:57 smithi188 bash[23329]: cluster 2020-07-16T14:53:56.500781+0000 mgr.x (mgr.34562) 3624 : cluster [DBG] pgmap v2258: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:53:58.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:53:57 smithi132 bash[27079]: cluster 2020-07-16T14:53:56.500781+0000 mgr.x (mgr.34562) 3624 : cluster [DBG] pgmap v2258: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:53:59.926 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:53:59 smithi188 bash[23329]: cluster 2020-07-16T14:53:58.501222+0000 mgr.x (mgr.34562) 3625 : cluster [DBG] pgmap v2259: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:54:00.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:53:59 smithi132 bash[27079]: cluster 2020-07-16T14:53:58.501222+0000 mgr.x (mgr.34562) 3625 : cluster [DBG] pgmap v2259: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:54:01.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:00 smithi132 bash[27079]: cluster 2020-07-16T14:54:00.501667+0000 mgr.x (mgr.34562) 3626 : cluster [DBG] pgmap v2260: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:54:01.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:00 smithi188 bash[23329]: cluster 2020-07-16T14:54:00.501667+0000 mgr.x (mgr.34562) 3626 : cluster [DBG] pgmap v2260: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:54:02.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:01 smithi132 bash[27079]: audit 2020-07-16T14:54:01.553978+0000 mon.b (mon.2) 853 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:54:02.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:01 smithi132 bash[27079]: cephadm 2020-07-16T14:54:01.554707+0000 mgr.x (mgr.34562) 3627 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:54:02.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:01 smithi132 bash[27079]: cephadm 2020-07-16T14:54:01.554902+0000 mgr.x (mgr.34562) 3628 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:54:02.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:01 smithi188 bash[23329]: audit 2020-07-16T14:54:01.553978+0000 mon.b (mon.2) 853 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:54:02.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:01 smithi188 bash[23329]: cephadm 2020-07-16T14:54:01.554707+0000 mgr.x (mgr.34562) 3627 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:54:02.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:01 smithi188 bash[23329]: cephadm 2020-07-16T14:54:01.554902+0000 mgr.x (mgr.34562) 3628 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:54:03.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:02 smithi132 bash[27079]: cluster 2020-07-16T14:54:02.502076+0000 mgr.x (mgr.34562) 3629 : cluster [DBG] pgmap v2261: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:54:03.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:02 smithi188 bash[23329]: cluster 2020-07-16T14:54:02.502076+0000 mgr.x (mgr.34562) 3629 : cluster [DBG] pgmap v2261: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:54:05.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:05 smithi188 bash[23329]: cluster 2020-07-16T14:54:04.502455+0000 mgr.x (mgr.34562) 3630 : cluster [DBG] pgmap v2262: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:54:06.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:05 smithi132 bash[27079]: cluster 2020-07-16T14:54:04.502455+0000 mgr.x (mgr.34562) 3630 : cluster [DBG] pgmap v2262: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:54:07.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:07 smithi188 bash[23329]: cluster 2020-07-16T14:54:06.502854+0000 mgr.x (mgr.34562) 3631 : cluster [DBG] pgmap v2263: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:54:08.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:07 smithi132 bash[27079]: cluster 2020-07-16T14:54:06.502854+0000 mgr.x (mgr.34562) 3631 : cluster [DBG] pgmap v2263: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:54:09.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:09 smithi188 bash[23329]: cluster 2020-07-16T14:54:08.503411+0000 mgr.x (mgr.34562) 3632 : cluster [DBG] pgmap v2264: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:54:10.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:09 smithi132 bash[27079]: cluster 2020-07-16T14:54:08.503411+0000 mgr.x (mgr.34562) 3632 : cluster [DBG] pgmap v2264: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:54:11.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:10 smithi132 bash[27079]: cluster 2020-07-16T14:54:10.503806+0000 mgr.x (mgr.34562) 3633 : cluster [DBG] pgmap v2265: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:54:11.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:10 smithi188 bash[23329]: cluster 2020-07-16T14:54:10.503806+0000 mgr.x (mgr.34562) 3633 : cluster [DBG] pgmap v2265: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:54:13.931 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:13 smithi188 bash[23329]: cluster 2020-07-16T14:54:12.504171+0000 mgr.x (mgr.34562) 3634 : cluster [DBG] pgmap v2266: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:54:14.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:13 smithi132 bash[27079]: cluster 2020-07-16T14:54:12.504171+0000 mgr.x (mgr.34562) 3634 : cluster [DBG] pgmap v2266: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:54:15.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:15 smithi188 bash[23329]: cluster 2020-07-16T14:54:14.504547+0000 mgr.x (mgr.34562) 3635 : cluster [DBG] pgmap v2267: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:54:16.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:15 smithi132 bash[27079]: cluster 2020-07-16T14:54:14.504547+0000 mgr.x (mgr.34562) 3635 : cluster [DBG] pgmap v2267: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:54:16.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:16 smithi188 bash[23329]: audit 2020-07-16T14:54:16.561910+0000 mon.b (mon.2) 854 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:54:17.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:16 smithi132 bash[27079]: audit 2020-07-16T14:54:16.561910+0000 mon.b (mon.2) 854 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:54:17.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:17 smithi188 bash[23329]: cluster 2020-07-16T14:54:16.504998+0000 mgr.x (mgr.34562) 3636 : cluster [DBG] pgmap v2268: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:54:17.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:17 smithi188 bash[23329]: cephadm 2020-07-16T14:54:16.562644+0000 mgr.x (mgr.34562) 3637 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:54:17.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:17 smithi188 bash[23329]: cephadm 2020-07-16T14:54:16.562965+0000 mgr.x (mgr.34562) 3638 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:54:18.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:17 smithi132 bash[27079]: cluster 2020-07-16T14:54:16.504998+0000 mgr.x (mgr.34562) 3636 : cluster [DBG] pgmap v2268: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:54:18.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:17 smithi132 bash[27079]: cephadm 2020-07-16T14:54:16.562644+0000 mgr.x (mgr.34562) 3637 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:54:18.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:17 smithi132 bash[27079]: cephadm 2020-07-16T14:54:16.562965+0000 mgr.x (mgr.34562) 3638 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:54:19.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:19 smithi188 bash[23329]: cluster 2020-07-16T14:54:18.505403+0000 mgr.x (mgr.34562) 3639 : cluster [DBG] pgmap v2269: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:54:20.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:19 smithi132 bash[27079]: cluster 2020-07-16T14:54:18.505403+0000 mgr.x (mgr.34562) 3639 : cluster [DBG] pgmap v2269: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:54:21.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:20 smithi132 bash[27079]: cluster 2020-07-16T14:54:20.505906+0000 mgr.x (mgr.34562) 3640 : cluster [DBG] pgmap v2270: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:54:21.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:20 smithi188 bash[23329]: cluster 2020-07-16T14:54:20.505906+0000 mgr.x (mgr.34562) 3640 : cluster [DBG] pgmap v2270: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:54:23.389 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:54:23.655 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:54:23.655 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (77m) 103s ago 80m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:54:23.656 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (79m) 102s ago 79m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:54:23.656 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (77m) 102s ago 83m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:54:23.656 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (76m) 103s ago 84m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:54:23.656 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 103s ago 84m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:54:23.656 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (83m) 102s ago 83m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:54:23.657 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (83m) 103s ago 83m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:54:23.657 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (80m) 103s ago 80m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:54:23.657 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (80m) 102s ago 80m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:54:23.657 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (82m) 103s ago 82m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:54:23.657 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (82m) 103s ago 82m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:54:23.658 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (82m) 103s ago 82m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:54:23.658 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (81m) 103s ago 81m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:54:23.658 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (81m) 102s ago 81m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:54:23.658 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (81m) 102s ago 81m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:54:23.658 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (81m) 102s ago 81m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:54:23.659 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (80m) 102s ago 80m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:54:23.659 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (79m) 102s ago 80m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:54:23.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:23 smithi188 bash[23329]: cluster 2020-07-16T14:54:22.506354+0000 mgr.x (mgr.34562) 3641 : cluster [DBG] pgmap v2271: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:54:23.953 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:54:23.954 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:54:23.954 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:54:23.954 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:54:23.954 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:54:23.955 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:54:23.955 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:54:23.955 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:54:23.955 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:54:23.955 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:54:23.956 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:54:23.956 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:54:23.956 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:54:23.956 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:54:23.956 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:54:23.957 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:54:23.957 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:54:24.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:23 smithi132 bash[27079]: cluster 2020-07-16T14:54:22.506354+0000 mgr.x (mgr.34562) 3641 : cluster [DBG] pgmap v2271: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:54:24.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:24 smithi188 bash[23329]: audit 2020-07-16T14:54:23.377944+0000 mgr.x (mgr.34562) 3642 : audit [DBG] from='client.27286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:54:24.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:24 smithi188 bash[23329]: audit 2020-07-16T14:54:23.952865+0000 mon.c (mon.1) 274 : audit [DBG] from='client.? 172.21.15.132:0/3628465359' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:54:25.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:24 smithi132 bash[27079]: audit 2020-07-16T14:54:23.377944+0000 mgr.x (mgr.34562) 3642 : audit [DBG] from='client.27286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:54:25.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:24 smithi132 bash[27079]: audit 2020-07-16T14:54:23.952865+0000 mon.c (mon.1) 274 : audit [DBG] from='client.? 172.21.15.132:0/3628465359' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:54:25.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:25 smithi188 bash[23329]: audit 2020-07-16T14:54:23.650959+0000 mgr.x (mgr.34562) 3643 : audit [DBG] from='client.27292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:54:25.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:25 smithi188 bash[23329]: cluster 2020-07-16T14:54:24.506819+0000 mgr.x (mgr.34562) 3644 : cluster [DBG] pgmap v2272: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:54:26.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:25 smithi132 bash[27079]: audit 2020-07-16T14:54:23.650959+0000 mgr.x (mgr.34562) 3643 : audit [DBG] from='client.27292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:54:26.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:25 smithi132 bash[27079]: cluster 2020-07-16T14:54:24.506819+0000 mgr.x (mgr.34562) 3644 : cluster [DBG] pgmap v2272: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:54:27.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:27 smithi188 bash[23329]: cluster 2020-07-16T14:54:26.507243+0000 mgr.x (mgr.34562) 3645 : cluster [DBG] pgmap v2273: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:54:28.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:27 smithi132 bash[27079]: cluster 2020-07-16T14:54:26.507243+0000 mgr.x (mgr.34562) 3645 : cluster [DBG] pgmap v2273: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:54:29.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:29 smithi188 bash[23329]: cluster 2020-07-16T14:54:28.507599+0000 mgr.x (mgr.34562) 3646 : cluster [DBG] pgmap v2274: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:54:30.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:29 smithi132 bash[27079]: cluster 2020-07-16T14:54:28.507599+0000 mgr.x (mgr.34562) 3646 : cluster [DBG] pgmap v2274: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:54:31.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:30 smithi132 bash[27079]: cluster 2020-07-16T14:54:30.508030+0000 mgr.x (mgr.34562) 3647 : cluster [DBG] pgmap v2275: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:54:31.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:30 smithi188 bash[23329]: cluster 2020-07-16T14:54:30.508030+0000 mgr.x (mgr.34562) 3647 : cluster [DBG] pgmap v2275: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:54:32.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:31 smithi132 bash[27079]: audit 2020-07-16T14:54:31.578560+0000 mon.b (mon.2) 855 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:54:32.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:31 smithi132 bash[27079]: cephadm 2020-07-16T14:54:31.579306+0000 mgr.x (mgr.34562) 3648 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:54:32.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:31 smithi132 bash[27079]: cephadm 2020-07-16T14:54:31.579736+0000 mgr.x (mgr.34562) 3649 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:54:32.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:31 smithi188 bash[23329]: audit 2020-07-16T14:54:31.578560+0000 mon.b (mon.2) 855 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:54:32.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:31 smithi188 bash[23329]: cephadm 2020-07-16T14:54:31.579306+0000 mgr.x (mgr.34562) 3648 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:54:32.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:31 smithi188 bash[23329]: cephadm 2020-07-16T14:54:31.579736+0000 mgr.x (mgr.34562) 3649 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:54:33.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:32 smithi132 bash[27079]: cluster 2020-07-16T14:54:32.508533+0000 mgr.x (mgr.34562) 3650 : cluster [DBG] pgmap v2276: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:54:33.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:32 smithi188 bash[23329]: cluster 2020-07-16T14:54:32.508533+0000 mgr.x (mgr.34562) 3650 : cluster [DBG] pgmap v2276: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:54:35.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:35 smithi188 bash[23329]: cluster 2020-07-16T14:54:34.508919+0000 mgr.x (mgr.34562) 3651 : cluster [DBG] pgmap v2277: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:54:36.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:35 smithi132 bash[27079]: cluster 2020-07-16T14:54:34.508919+0000 mgr.x (mgr.34562) 3651 : cluster [DBG] pgmap v2277: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:54:37.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:37 smithi188 bash[23329]: cluster 2020-07-16T14:54:36.509486+0000 mgr.x (mgr.34562) 3652 : cluster [DBG] pgmap v2278: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:54:38.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:37 smithi132 bash[27079]: cluster 2020-07-16T14:54:36.509486+0000 mgr.x (mgr.34562) 3652 : cluster [DBG] pgmap v2278: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:54:39.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:39 smithi188 bash[23329]: cluster 2020-07-16T14:54:38.509990+0000 mgr.x (mgr.34562) 3653 : cluster [DBG] pgmap v2279: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:54:40.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:39 smithi132 bash[27079]: cluster 2020-07-16T14:54:38.509990+0000 mgr.x (mgr.34562) 3653 : cluster [DBG] pgmap v2279: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:54:41.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:40 smithi132 bash[27079]: cluster 2020-07-16T14:54:40.510456+0000 mgr.x (mgr.34562) 3654 : cluster [DBG] pgmap v2280: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:54:41.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:40 smithi188 bash[23329]: cluster 2020-07-16T14:54:40.510456+0000 mgr.x (mgr.34562) 3654 : cluster [DBG] pgmap v2280: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:54:43.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:43 smithi188 bash[23329]: cluster 2020-07-16T14:54:42.510852+0000 mgr.x (mgr.34562) 3655 : cluster [DBG] pgmap v2281: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:54:44.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:43 smithi132 bash[27079]: cluster 2020-07-16T14:54:42.510852+0000 mgr.x (mgr.34562) 3655 : cluster [DBG] pgmap v2281: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:54:45.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:45 smithi188 bash[23329]: cluster 2020-07-16T14:54:44.511353+0000 mgr.x (mgr.34562) 3656 : cluster [DBG] pgmap v2282: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:54:46.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:45 smithi132 bash[27079]: cluster 2020-07-16T14:54:44.511353+0000 mgr.x (mgr.34562) 3656 : cluster [DBG] pgmap v2282: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:54:47.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:47 smithi188 bash[23329]: cluster 2020-07-16T14:54:46.511773+0000 mgr.x (mgr.34562) 3657 : cluster [DBG] pgmap v2283: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:54:47.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:47 smithi188 bash[23329]: audit 2020-07-16T14:54:46.822014+0000 mon.b (mon.2) 856 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:52:40.630814\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.630873\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.630910\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.630940\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.631136\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.631347\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.631547\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.631737\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.631780\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:52:40.631859\", \"last_device_update\": \"2020-07-16T14:33:41.233618\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:54:46.820826\"}"}]: dispatch 2020-07-16T14:54:47.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:47 smithi188 bash[23329]: audit 2020-07-16T14:54:46.822362+0000 mon.c (mon.1) 275 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:52:40.630814\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.630873\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.630910\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.630940\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.631136\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.631347\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.631547\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.631737\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.631780\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:52:40.631859\", \"last_device_update\": \"2020-07-16T14:33:41.233618\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:54:46.820826\"}"}]: dispatch 2020-07-16T14:54:47.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:47 smithi188 bash[23329]: audit 2020-07-16T14:54:46.825182+0000 mon.c (mon.1) 276 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:52:40.630814\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.630873\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.630910\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.630940\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.631136\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.631347\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.631547\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.631737\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.631780\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:52:40.631859\", \"last_device_update\": \"2020-07-16T14:33:41.233618\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:54:46.820826\"}"}]': finished 2020-07-16T14:54:47.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:47 smithi188 bash[23329]: audit 2020-07-16T14:54:46.827116+0000 mon.b (mon.2) 857 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.927892\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.927959\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.927990\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928144\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928244\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928369\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928473\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928507\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928536\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:52:40.928621\", \"last_device_update\": \"2020-07-16T14:34:46.715995\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:54:46.826399\"}"}]: dispatch 2020-07-16T14:54:47.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:47 smithi188 bash[23329]: audit 2020-07-16T14:54:46.827361+0000 mon.c (mon.1) 277 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.927892\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.927959\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.927990\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928144\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928244\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928369\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928473\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928507\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928536\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:52:40.928621\", \"last_device_update\": \"2020-07-16T14:34:46.715995\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:54:46.826399\"}"}]: dispatch 2020-07-16T14:54:47.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:47 smithi188 bash[23329]: audit 2020-07-16T14:54:46.829301+0000 mon.c (mon.1) 278 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.927892\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.927959\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.927990\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928144\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928244\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928369\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928473\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928507\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928536\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:52:40.928621\", \"last_device_update\": \"2020-07-16T14:34:46.715995\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:54:46.826399\"}"}]': finished 2020-07-16T14:54:47.926 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:47 smithi188 bash[23329]: audit 2020-07-16T14:54:46.832107+0000 mon.b (mon.2) 858 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:54:47.926 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:47 smithi188 bash[23329]: audit 2020-07-16T14:54:46.833060+0000 mon.b (mon.2) 859 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:54:47.926 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:47 smithi188 bash[23329]: audit 2020-07-16T14:54:46.833878+0000 mon.b (mon.2) 860 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:54:47.926 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:47 smithi188 bash[23329]: audit 2020-07-16T14:54:46.834829+0000 mon.b (mon.2) 861 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:54:47.927 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:47 smithi188 bash[23329]: audit 2020-07-16T14:54:46.835624+0000 mon.b (mon.2) 862 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:54:48.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:47 smithi132 bash[27079]: cluster 2020-07-16T14:54:46.511773+0000 mgr.x (mgr.34562) 3657 : cluster [DBG] pgmap v2283: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:54:48.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:47 smithi132 bash[27079]: audit 2020-07-16T14:54:46.822014+0000 mon.b (mon.2) 856 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:52:40.630814\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.630873\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.630910\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.630940\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.631136\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.631347\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.631547\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.631737\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.631780\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:52:40.631859\", \"last_device_update\": \"2020-07-16T14:33:41.233618\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:54:46.820826\"}"}]: dispatch 2020-07-16T14:54:48.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:47 smithi132 bash[27079]: audit 2020-07-16T14:54:46.822362+0000 mon.c (mon.1) 275 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:52:40.630814\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.630873\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.630910\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.630940\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.631136\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.631347\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.631547\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.631737\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.631780\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:52:40.631859\", \"last_device_update\": \"2020-07-16T14:33:41.233618\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:54:46.820826\"}"}]: dispatch 2020-07-16T14:54:48.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:47 smithi132 bash[27079]: audit 2020-07-16T14:54:46.825182+0000 mon.c (mon.1) 276 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T14:52:40.630814\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.630873\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.630910\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.630940\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.631136\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.631347\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.631547\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.631737\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.631780\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T14:52:40.631859\", \"last_device_update\": \"2020-07-16T14:33:41.233618\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:54:46.820826\"}"}]': finished 2020-07-16T14:54:48.033 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:47 smithi132 bash[27079]: audit 2020-07-16T14:54:46.827116+0000 mon.b (mon.2) 857 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.927892\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.927959\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.927990\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928144\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928244\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928369\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928473\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928507\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928536\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:52:40.928621\", \"last_device_update\": \"2020-07-16T14:34:46.715995\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:54:46.826399\"}"}]: dispatch 2020-07-16T14:54:48.033 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:47 smithi132 bash[27079]: audit 2020-07-16T14:54:46.827361+0000 mon.c (mon.1) 277 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.927892\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.927959\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.927990\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928144\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928244\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928369\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928473\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928507\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928536\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:52:40.928621\", \"last_device_update\": \"2020-07-16T14:34:46.715995\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:54:46.826399\"}"}]: dispatch 2020-07-16T14:54:48.033 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:47 smithi132 bash[27079]: audit 2020-07-16T14:54:46.829301+0000 mon.c (mon.1) 278 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.927892\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.927959\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.927990\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928144\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928244\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928369\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928473\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928507\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T14:52:40.928536\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T14:52:40.928621\", \"last_device_update\": \"2020-07-16T14:34:46.715995\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:54:46.826399\"}"}]': finished 2020-07-16T14:54:48.038 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:47 smithi132 bash[27079]: audit 2020-07-16T14:54:46.832107+0000 mon.b (mon.2) 858 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:54:48.038 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:47 smithi132 bash[27079]: audit 2020-07-16T14:54:46.833060+0000 mon.b (mon.2) 859 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:54:48.039 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:47 smithi132 bash[27079]: audit 2020-07-16T14:54:46.833878+0000 mon.b (mon.2) 860 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:54:48.039 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:47 smithi132 bash[27079]: audit 2020-07-16T14:54:46.834829+0000 mon.b (mon.2) 861 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:54:48.039 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:47 smithi132 bash[27079]: audit 2020-07-16T14:54:46.835624+0000 mon.b (mon.2) 862 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:54:48.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:48 smithi188 bash[23329]: audit 2020-07-16T14:54:46.832389+0000 mgr.x (mgr.34562) 3658 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:54:48.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:48 smithi188 bash[23329]: audit 2020-07-16T14:54:46.833307+0000 mgr.x (mgr.34562) 3659 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:54:48.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:48 smithi188 bash[23329]: audit 2020-07-16T14:54:46.834083+0000 mgr.x (mgr.34562) 3660 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:54:48.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:48 smithi188 bash[23329]: cephadm 2020-07-16T14:54:46.834605+0000 mgr.x (mgr.34562) 3661 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:54:48.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:48 smithi188 bash[23329]: cephadm 2020-07-16T14:54:46.835416+0000 mgr.x (mgr.34562) 3662 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:54:48.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:48 smithi188 bash[23329]: cephadm 2020-07-16T14:54:46.836114+0000 mgr.x (mgr.34562) 3663 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:54:48.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:48 smithi188 bash[23329]: cephadm 2020-07-16T14:54:46.836246+0000 mgr.x (mgr.34562) 3664 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:54:49.005 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:48 smithi132 bash[27079]: audit 2020-07-16T14:54:46.832389+0000 mgr.x (mgr.34562) 3658 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:54:49.005 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:48 smithi132 bash[27079]: audit 2020-07-16T14:54:46.833307+0000 mgr.x (mgr.34562) 3659 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:54:49.005 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:48 smithi132 bash[27079]: audit 2020-07-16T14:54:46.834083+0000 mgr.x (mgr.34562) 3660 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:54:49.005 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:48 smithi132 bash[27079]: cephadm 2020-07-16T14:54:46.834605+0000 mgr.x (mgr.34562) 3661 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:54:49.006 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:48 smithi132 bash[27079]: cephadm 2020-07-16T14:54:46.835416+0000 mgr.x (mgr.34562) 3662 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:54:49.006 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:48 smithi132 bash[27079]: cephadm 2020-07-16T14:54:46.836114+0000 mgr.x (mgr.34562) 3663 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:54:49.006 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:48 smithi132 bash[27079]: cephadm 2020-07-16T14:54:46.836246+0000 mgr.x (mgr.34562) 3664 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:54:49.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:49 smithi188 bash[23329]: cluster 2020-07-16T14:54:48.512300+0000 mgr.x (mgr.34562) 3665 : cluster [DBG] pgmap v2284: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:54:50.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:49 smithi132 bash[27079]: cluster 2020-07-16T14:54:48.512300+0000 mgr.x (mgr.34562) 3665 : cluster [DBG] pgmap v2284: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:54:50.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:50 smithi188 bash[23329]: audit 2020-07-16T14:54:49.623344+0000 mon.b (mon.2) 863 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:54:50.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:50 smithi188 bash[23329]: cephadm 2020-07-16T14:54:49.624025+0000 mgr.x (mgr.34562) 3666 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:54:50.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:50 smithi188 bash[23329]: cephadm 2020-07-16T14:54:49.624212+0000 mgr.x (mgr.34562) 3667 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:54:51.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:50 smithi132 bash[27079]: audit 2020-07-16T14:54:49.623344+0000 mon.b (mon.2) 863 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:54:51.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:50 smithi132 bash[27079]: cephadm 2020-07-16T14:54:49.624025+0000 mgr.x (mgr.34562) 3666 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:54:51.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:50 smithi132 bash[27079]: cephadm 2020-07-16T14:54:49.624212+0000 mgr.x (mgr.34562) 3667 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:54:51.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:51 smithi188 bash[23329]: cluster 2020-07-16T14:54:50.512723+0000 mgr.x (mgr.34562) 3668 : cluster [DBG] pgmap v2285: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:54:52.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:51 smithi132 bash[27079]: cluster 2020-07-16T14:54:50.512723+0000 mgr.x (mgr.34562) 3668 : cluster [DBG] pgmap v2285: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:54:53.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:53 smithi188 bash[23329]: cluster 2020-07-16T14:54:52.513270+0000 mgr.x (mgr.34562) 3669 : cluster [DBG] pgmap v2286: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:54:54.033 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:53 smithi132 bash[27079]: cluster 2020-07-16T14:54:52.513270+0000 mgr.x (mgr.34562) 3669 : cluster [DBG] pgmap v2286: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:54:54.249 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:54:54.511 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:54:54.511 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (77m) 2m ago 80m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:54:54.511 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (80m) 2m ago 80m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:54:54.511 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (77m) 2m ago 83m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:54:54.512 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (77m) 2m ago 85m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:54:54.512 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 2m ago 85m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:54:54.512 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (83m) 2m ago 83m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:54:54.512 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (83m) 2m ago 83m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:54:54.513 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (80m) 2m ago 80m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:54:54.513 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (80m) 2m ago 80m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:54:54.513 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (83m) 2m ago 83m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:54:54.513 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (82m) 2m ago 83m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:54:54.513 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (82m) 2m ago 82m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:54:54.514 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (82m) 2m ago 82m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:54:54.514 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (81m) 2m ago 82m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:54:54.514 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (81m) 2m ago 81m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:54:54.514 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (81m) 2m ago 81m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:54:54.514 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (81m) 2m ago 81m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:54:54.514 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (80m) 2m ago 80m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:54:54.812 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:54:54.813 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:54:54.813 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:54:54.813 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:54:54.813 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:54:54.814 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:54:54.814 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:54:54.814 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:54:54.814 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:54:54.814 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:54:54.815 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:54:54.815 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:54:54.815 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:54:54.815 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:54:54.815 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:54:54.816 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:54:54.816 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:54:55.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:55 smithi188 bash[23329]: audit 2020-07-16T14:54:54.237714+0000 mgr.x (mgr.34562) 3670 : audit [DBG] from='client.27304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:54:55.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:55 smithi188 bash[23329]: audit 2020-07-16T14:54:54.505707+0000 mgr.x (mgr.34562) 3671 : audit [DBG] from='client.27310 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:54:55.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:55 smithi188 bash[23329]: cluster 2020-07-16T14:54:54.513649+0000 mgr.x (mgr.34562) 3672 : cluster [DBG] pgmap v2287: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:54:55.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:55 smithi188 bash[23329]: audit 2020-07-16T14:54:54.811876+0000 mon.c (mon.1) 279 : audit [DBG] from='client.? 172.21.15.132:0/226815291' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:54:56.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:55 smithi132 bash[27079]: audit 2020-07-16T14:54:54.237714+0000 mgr.x (mgr.34562) 3670 : audit [DBG] from='client.27304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:54:56.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:55 smithi132 bash[27079]: audit 2020-07-16T14:54:54.505707+0000 mgr.x (mgr.34562) 3671 : audit [DBG] from='client.27310 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:54:56.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:55 smithi132 bash[27079]: cluster 2020-07-16T14:54:54.513649+0000 mgr.x (mgr.34562) 3672 : cluster [DBG] pgmap v2287: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:54:56.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:55 smithi132 bash[27079]: audit 2020-07-16T14:54:54.811876+0000 mon.c (mon.1) 279 : audit [DBG] from='client.? 172.21.15.132:0/226815291' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:54:57.930 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:57 smithi188 bash[23329]: cluster 2020-07-16T14:54:56.513980+0000 mgr.x (mgr.34562) 3673 : cluster [DBG] pgmap v2288: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:54:58.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:57 smithi132 bash[27079]: cluster 2020-07-16T14:54:56.513980+0000 mgr.x (mgr.34562) 3673 : cluster [DBG] pgmap v2288: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:54:59.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:54:59 smithi188 bash[23329]: cluster 2020-07-16T14:54:58.514386+0000 mgr.x (mgr.34562) 3674 : cluster [DBG] pgmap v2289: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:55:00.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:54:59 smithi132 bash[27079]: cluster 2020-07-16T14:54:58.514386+0000 mgr.x (mgr.34562) 3674 : cluster [DBG] pgmap v2289: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:55:01.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:55:00 smithi132 bash[27079]: cluster 2020-07-16T14:55:00.514796+0000 mgr.x (mgr.34562) 3675 : cluster [DBG] pgmap v2290: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:55:01.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:55:00 smithi188 bash[23329]: cluster 2020-07-16T14:55:00.514796+0000 mgr.x (mgr.34562) 3675 : cluster [DBG] pgmap v2290: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:55:03.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:55:03 smithi188 bash[23329]: cluster 2020-07-16T14:55:02.515401+0000 mgr.x (mgr.34562) 3676 : cluster [DBG] pgmap v2291: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:55:04.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:55:03 smithi132 bash[27079]: cluster 2020-07-16T14:55:02.515401+0000 mgr.x (mgr.34562) 3676 : cluster [DBG] pgmap v2291: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:55:05.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:55:05 smithi188 bash[23329]: cluster 2020-07-16T14:55:04.515904+0000 mgr.x (mgr.34562) 3677 : cluster [DBG] pgmap v2292: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:55:05.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:55:05 smithi188 bash[23329]: audit 2020-07-16T14:55:04.625801+0000 mon.b (mon.2) 864 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:55:05.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:55:05 smithi188 bash[23329]: cephadm 2020-07-16T14:55:04.626568+0000 mgr.x (mgr.34562) 3678 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:55:05.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:55:05 smithi188 bash[23329]: cephadm 2020-07-16T14:55:04.626905+0000 mgr.x (mgr.34562) 3679 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:55:06.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:55:05 smithi132 bash[27079]: cluster 2020-07-16T14:55:04.515904+0000 mgr.x (mgr.34562) 3677 : cluster [DBG] pgmap v2292: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:55:06.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:55:05 smithi132 bash[27079]: audit 2020-07-16T14:55:04.625801+0000 mon.b (mon.2) 864 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:55:06.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:55:05 smithi132 bash[27079]: cephadm 2020-07-16T14:55:04.626568+0000 mgr.x (mgr.34562) 3678 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:55:06.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:55:05 smithi132 bash[27079]: cephadm 2020-07-16T14:55:04.626905+0000 mgr.x (mgr.34562) 3679 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:55:07.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:55:07 smithi188 bash[23329]: cluster 2020-07-16T14:55:06.516254+0000 mgr.x (mgr.34562) 3680 : cluster [DBG] pgmap v2293: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:55:08.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:55:07 smithi132 bash[27079]: cluster 2020-07-16T14:55:06.516254+0000 mgr.x (mgr.34562) 3680 : cluster [DBG] pgmap v2293: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:55:09.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:55:09 smithi188 bash[23329]: cluster 2020-07-16T14:55:08.516727+0000 mgr.x (mgr.34562) 3681 : cluster [DBG] pgmap v2294: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:55:10.033 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:55:09 smithi132 bash[27079]: cluster 2020-07-16T14:55:08.516727+0000 mgr.x (mgr.34562) 3681 : cluster [DBG] pgmap v2294: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:55:11.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:55:10 smithi132 bash[27079]: cluster 2020-07-16T14:55:10.517109+0000 mgr.x (mgr.34562) 3682 : cluster [DBG] pgmap v2295: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:55:11.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:55:10 smithi188 bash[23329]: cluster 2020-07-16T14:55:10.517109+0000 mgr.x (mgr.34562) 3682 : cluster [DBG] pgmap v2295: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:55:13.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:55:13 smithi188 bash[23329]: cluster 2020-07-16T14:55:12.517495+0000 mgr.x (mgr.34562) 3683 : cluster [DBG] pgmap v2296: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:55:14.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:55:13 smithi132 bash[27079]: cluster 2020-07-16T14:55:12.517495+0000 mgr.x (mgr.34562) 3683 : cluster [DBG] pgmap v2296: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:55:15.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:55:15 smithi188 bash[23329]: cluster 2020-07-16T14:55:14.517847+0000 mgr.x (mgr.34562) 3684 : cluster [DBG] pgmap v2297: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:55:16.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:55:15 smithi132 bash[27079]: cluster 2020-07-16T14:55:14.517847+0000 mgr.x (mgr.34562) 3684 : cluster [DBG] pgmap v2297: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:55:17.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:55:17 smithi188 bash[23329]: cluster 2020-07-16T14:55:16.518174+0000 mgr.x (mgr.34562) 3685 : cluster [DBG] pgmap v2298: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:55:18.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:55:17 smithi132 bash[27079]: cluster 2020-07-16T14:55:16.518174+0000 mgr.x (mgr.34562) 3685 : cluster [DBG] pgmap v2298: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:55:19.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:55:19 smithi188 bash[23329]: cluster 2020-07-16T14:55:18.518597+0000 mgr.x (mgr.34562) 3686 : cluster [DBG] pgmap v2299: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:55:20.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:55:19 smithi132 bash[27079]: cluster 2020-07-16T14:55:18.518597+0000 mgr.x (mgr.34562) 3686 : cluster [DBG] pgmap v2299: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:55:20.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:55:20 smithi188 bash[23329]: audit 2020-07-16T14:55:19.642505+0000 mon.b (mon.2) 865 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:55:20.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:55:20 smithi188 bash[23329]: cephadm 2020-07-16T14:55:19.643196+0000 mgr.x (mgr.34562) 3687 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:55:20.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:55:20 smithi188 bash[23329]: cephadm 2020-07-16T14:55:19.643616+0000 mgr.x (mgr.34562) 3688 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:55:21.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:55:20 smithi132 bash[27079]: audit 2020-07-16T14:55:19.642505+0000 mon.b (mon.2) 865 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:55:21.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:55:20 smithi132 bash[27079]: cephadm 2020-07-16T14:55:19.643196+0000 mgr.x (mgr.34562) 3687 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:55:21.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:55:20 smithi132 bash[27079]: cephadm 2020-07-16T14:55:19.643616+0000 mgr.x (mgr.34562) 3688 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:55:21.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:55:21 smithi188 bash[23329]: cluster 2020-07-16T14:55:20.518992+0000 mgr.x (mgr.34562) 3689 : cluster [DBG] pgmap v2300: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:55:22.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:55:21 smithi132 bash[27079]: cluster 2020-07-16T14:55:20.518992+0000 mgr.x (mgr.34562) 3689 : cluster [DBG] pgmap v2300: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:55:23.926 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:55:23 smithi188 bash[23329]: cluster 2020-07-16T14:55:22.519448+0000 mgr.x (mgr.34562) 3690 : cluster [DBG] pgmap v2301: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:55:24.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:55:23 smithi132 bash[27079]: cluster 2020-07-16T14:55:22.519448+0000 mgr.x (mgr.34562) 3690 : cluster [DBG] pgmap v2301: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:55:25.119 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:55:25.381 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:55:25.382 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (78m) 2m ago 81m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:55:25.382 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (80m) 2m ago 80m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:55:25.382 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (78m) 2m ago 84m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:55:25.382 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (77m) 2m ago 85m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:55:25.382 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 2m ago 85m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:55:25.383 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (84m) 2m ago 84m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:55:25.383 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (84m) 2m ago 84m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:55:25.383 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (81m) 2m ago 81m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:55:25.383 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (81m) 2m ago 81m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:55:25.383 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (83m) 2m ago 83m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:55:25.384 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (83m) 2m ago 83m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:55:25.384 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (83m) 2m ago 83m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:55:25.384 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (82m) 2m ago 82m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:55:25.384 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (82m) 2m ago 82m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:55:25.384 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (82m) 2m ago 82m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:55:25.385 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (82m) 2m ago 82m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:55:25.385 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (81m) 2m ago 81m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:55:25.385 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (80m) 2m ago 81m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:55:25.687 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:55:25.688 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:55:25.688 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:55:25.688 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:55:25.688 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:55:25.688 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:55:25.689 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:55:25.689 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:55:25.689 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:55:25.689 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:55:25.689 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:55:25.690 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:55:25.690 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:55:25.690 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:55:25.690 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:55:25.690 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:55:25.691 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:55:25.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:55:25 smithi188 bash[23329]: cluster 2020-07-16T14:55:24.519858+0000 mgr.x (mgr.34562) 3691 : cluster [DBG] pgmap v2302: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:55:26.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:55:25 smithi132 bash[27079]: cluster 2020-07-16T14:55:24.519858+0000 mgr.x (mgr.34562) 3691 : cluster [DBG] pgmap v2302: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:55:26.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:55:26 smithi188 bash[23329]: audit 2020-07-16T14:55:25.107701+0000 mgr.x (mgr.34562) 3692 : audit [DBG] from='client.27322 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:55:26.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:55:26 smithi188 bash[23329]: audit 2020-07-16T14:55:25.377122+0000 mgr.x (mgr.34562) 3693 : audit [DBG] from='client.27328 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:55:26.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:55:26 smithi188 bash[23329]: audit 2020-07-16T14:55:25.681601+0000 mon.c (mon.1) 280 : audit [DBG] from='client.? 172.21.15.132:0/1754924166' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:55:27.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:55:26 smithi132 bash[27079]: audit 2020-07-16T14:55:25.107701+0000 mgr.x (mgr.34562) 3692 : audit [DBG] from='client.27322 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:55:27.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:55:26 smithi132 bash[27079]: audit 2020-07-16T14:55:25.377122+0000 mgr.x (mgr.34562) 3693 : audit [DBG] from='client.27328 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:55:27.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:55:26 smithi132 bash[27079]: audit 2020-07-16T14:55:25.681601+0000 mon.c (mon.1) 280 : audit [DBG] from='client.? 172.21.15.132:0/1754924166' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:55:27.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:55:27 smithi188 bash[23329]: cluster 2020-07-16T14:55:26.520165+0000 mgr.x (mgr.34562) 3694 : cluster [DBG] pgmap v2303: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:55:28.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:55:27 smithi132 bash[27079]: cluster 2020-07-16T14:55:26.520165+0000 mgr.x (mgr.34562) 3694 : cluster [DBG] pgmap v2303: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:55:29.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:55:29 smithi188 bash[23329]: cluster 2020-07-16T14:55:28.520534+0000 mgr.x (mgr.34562) 3695 : cluster [DBG] pgmap v2304: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:55:30.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:55:29 smithi132 bash[27079]: cluster 2020-07-16T14:55:28.520534+0000 mgr.x (mgr.34562) 3695 : cluster [DBG] pgmap v2304: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:55:31.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:55:30 smithi132 bash[27079]: cluster 2020-07-16T14:55:30.520924+0000 mgr.x (mgr.34562) 3696 : cluster [DBG] pgmap v2305: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:55:31.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:55:30 smithi188 bash[23329]: cluster 2020-07-16T14:55:30.520924+0000 mgr.x (mgr.34562) 3696 : cluster [DBG] pgmap v2305: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:55:33.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:55:33 smithi188 bash[23329]: cluster 2020-07-16T14:55:32.521462+0000 mgr.x (mgr.34562) 3697 : cluster [DBG] pgmap v2306: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:55:34.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:55:33 smithi132 bash[27079]: cluster 2020-07-16T14:55:32.521462+0000 mgr.x (mgr.34562) 3697 : cluster [DBG] pgmap v2306: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:55:35.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:55:35 smithi188 bash[23329]: cluster 2020-07-16T14:55:34.521853+0000 mgr.x (mgr.34562) 3698 : cluster [DBG] pgmap v2307: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:55:35.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:55:35 smithi188 bash[23329]: audit 2020-07-16T14:55:34.650986+0000 mon.b (mon.2) 866 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:55:35.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:55:35 smithi188 bash[23329]: cephadm 2020-07-16T14:55:34.651732+0000 mgr.x (mgr.34562) 3699 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:55:35.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:55:35 smithi188 bash[23329]: cephadm 2020-07-16T14:55:34.651890+0000 mgr.x (mgr.34562) 3700 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:55:36.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:55:35 smithi132 bash[27079]: cluster 2020-07-16T14:55:34.521853+0000 mgr.x (mgr.34562) 3698 : cluster [DBG] pgmap v2307: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:55:36.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:55:35 smithi132 bash[27079]: audit 2020-07-16T14:55:34.650986+0000 mon.b (mon.2) 866 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:55:36.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:55:35 smithi132 bash[27079]: cephadm 2020-07-16T14:55:34.651732+0000 mgr.x (mgr.34562) 3699 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:55:36.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:55:35 smithi132 bash[27079]: cephadm 2020-07-16T14:55:34.651890+0000 mgr.x (mgr.34562) 3700 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:55:37.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:55:37 smithi188 bash[23329]: cluster 2020-07-16T14:55:36.522398+0000 mgr.x (mgr.34562) 3701 : cluster [DBG] pgmap v2308: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:55:38.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:55:37 smithi132 bash[27079]: cluster 2020-07-16T14:55:36.522398+0000 mgr.x (mgr.34562) 3701 : cluster [DBG] pgmap v2308: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:55:39.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:55:39 smithi188 bash[23329]: cluster 2020-07-16T14:55:38.522880+0000 mgr.x (mgr.34562) 3702 : cluster [DBG] pgmap v2309: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:55:40.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:55:39 smithi132 bash[27079]: cluster 2020-07-16T14:55:38.522880+0000 mgr.x (mgr.34562) 3702 : cluster [DBG] pgmap v2309: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:55:41.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:55:40 smithi132 bash[27079]: cluster 2020-07-16T14:55:40.523382+0000 mgr.x (mgr.34562) 3703 : cluster [DBG] pgmap v2310: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:55:41.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:55:40 smithi188 bash[23329]: cluster 2020-07-16T14:55:40.523382+0000 mgr.x (mgr.34562) 3703 : cluster [DBG] pgmap v2310: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:55:43.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:55:43 smithi188 bash[23329]: cluster 2020-07-16T14:55:42.523939+0000 mgr.x (mgr.34562) 3704 : cluster [DBG] pgmap v2311: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:55:44.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:55:43 smithi132 bash[27079]: cluster 2020-07-16T14:55:42.523939+0000 mgr.x (mgr.34562) 3704 : cluster [DBG] pgmap v2311: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:55:45.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:55:45 smithi188 bash[23329]: cluster 2020-07-16T14:55:44.524367+0000 mgr.x (mgr.34562) 3705 : cluster [DBG] pgmap v2312: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:55:46.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:55:45 smithi132 bash[27079]: cluster 2020-07-16T14:55:44.524367+0000 mgr.x (mgr.34562) 3705 : cluster [DBG] pgmap v2312: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:55:47.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:55:47 smithi188 bash[23329]: cluster 2020-07-16T14:55:46.524703+0000 mgr.x (mgr.34562) 3706 : cluster [DBG] pgmap v2313: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:55:48.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:55:47 smithi132 bash[27079]: cluster 2020-07-16T14:55:46.524703+0000 mgr.x (mgr.34562) 3706 : cluster [DBG] pgmap v2313: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:55:49.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:55:49 smithi188 bash[23329]: cluster 2020-07-16T14:55:48.525223+0000 mgr.x (mgr.34562) 3707 : cluster [DBG] pgmap v2314: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:55:50.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:55:49 smithi132 bash[27079]: cluster 2020-07-16T14:55:48.525223+0000 mgr.x (mgr.34562) 3707 : cluster [DBG] pgmap v2314: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:55:50.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:55:50 smithi132 bash[27079]: audit 2020-07-16T14:55:49.670778+0000 mon.b (mon.2) 867 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:55:50.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:55:50 smithi132 bash[27079]: audit 2020-07-16T14:55:49.672157+0000 mon.b (mon.2) 868 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:55:50.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:55:50 smithi132 bash[27079]: audit 2020-07-16T14:55:49.673377+0000 mon.b (mon.2) 869 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:55:50.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:55:50 smithi132 bash[27079]: audit 2020-07-16T14:55:49.674644+0000 mon.b (mon.2) 870 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:55:50.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:55:50 smithi132 bash[27079]: audit 2020-07-16T14:55:49.675989+0000 mon.b (mon.2) 871 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:55:50.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:55:50 smithi188 bash[23329]: audit 2020-07-16T14:55:49.670778+0000 mon.b (mon.2) 867 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:55:50.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:55:50 smithi188 bash[23329]: audit 2020-07-16T14:55:49.672157+0000 mon.b (mon.2) 868 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:55:50.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:55:50 smithi188 bash[23329]: audit 2020-07-16T14:55:49.673377+0000 mon.b (mon.2) 869 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:55:50.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:55:50 smithi188 bash[23329]: audit 2020-07-16T14:55:49.674644+0000 mon.b (mon.2) 870 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:55:50.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:55:50 smithi188 bash[23329]: audit 2020-07-16T14:55:49.675989+0000 mon.b (mon.2) 871 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:55:51.920 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:55:51 smithi132 bash[27079]: audit 2020-07-16T14:55:49.671144+0000 mgr.x (mgr.34562) 3708 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:55:51.920 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:55:51 smithi132 bash[27079]: audit 2020-07-16T14:55:49.672463+0000 mgr.x (mgr.34562) 3709 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:55:51.921 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:55:51 smithi132 bash[27079]: audit 2020-07-16T14:55:49.673647+0000 mgr.x (mgr.34562) 3710 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:55:51.921 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:55:51 smithi132 bash[27079]: cephadm 2020-07-16T14:55:49.674354+0000 mgr.x (mgr.34562) 3711 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:55:51.921 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:55:51 smithi132 bash[27079]: cephadm 2020-07-16T14:55:49.675542+0000 mgr.x (mgr.34562) 3712 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:55:51.921 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:55:51 smithi132 bash[27079]: cephadm 2020-07-16T14:55:49.676779+0000 mgr.x (mgr.34562) 3713 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:55:51.922 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:55:51 smithi132 bash[27079]: cephadm 2020-07-16T14:55:49.676975+0000 mgr.x (mgr.34562) 3714 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:55:51.922 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:55:51 smithi132 bash[27079]: cluster 2020-07-16T14:55:50.525623+0000 mgr.x (mgr.34562) 3715 : cluster [DBG] pgmap v2315: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:55:51.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:55:51 smithi188 bash[23329]: audit 2020-07-16T14:55:49.671144+0000 mgr.x (mgr.34562) 3708 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:55:51.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:55:51 smithi188 bash[23329]: audit 2020-07-16T14:55:49.672463+0000 mgr.x (mgr.34562) 3709 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:55:51.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:55:51 smithi188 bash[23329]: audit 2020-07-16T14:55:49.673647+0000 mgr.x (mgr.34562) 3710 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:55:51.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:55:51 smithi188 bash[23329]: cephadm 2020-07-16T14:55:49.674354+0000 mgr.x (mgr.34562) 3711 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:55:51.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:55:51 smithi188 bash[23329]: cephadm 2020-07-16T14:55:49.675542+0000 mgr.x (mgr.34562) 3712 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:55:51.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:55:51 smithi188 bash[23329]: cephadm 2020-07-16T14:55:49.676779+0000 mgr.x (mgr.34562) 3713 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:55:51.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:55:51 smithi188 bash[23329]: cephadm 2020-07-16T14:55:49.676975+0000 mgr.x (mgr.34562) 3714 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:55:51.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:55:51 smithi188 bash[23329]: cluster 2020-07-16T14:55:50.525623+0000 mgr.x (mgr.34562) 3715 : cluster [DBG] pgmap v2315: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:55:52.784 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:55:52 smithi132 bash[27079]: audit 2020-07-16T14:55:52.438546+0000 mon.b (mon.2) 872 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:55:52.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:55:52 smithi188 bash[23329]: audit 2020-07-16T14:55:52.438546+0000 mon.b (mon.2) 872 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:55:53.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:55:53 smithi188 bash[23329]: cephadm 2020-07-16T14:55:52.439146+0000 mgr.x (mgr.34562) 3716 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:55:53.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:55:53 smithi188 bash[23329]: cephadm 2020-07-16T14:55:52.439564+0000 mgr.x (mgr.34562) 3717 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:55:53.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:55:53 smithi188 bash[23329]: cluster 2020-07-16T14:55:52.526069+0000 mgr.x (mgr.34562) 3718 : cluster [DBG] pgmap v2316: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:55:54.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:55:53 smithi132 bash[27079]: cephadm 2020-07-16T14:55:52.439146+0000 mgr.x (mgr.34562) 3716 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:55:54.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:55:53 smithi132 bash[27079]: cephadm 2020-07-16T14:55:52.439564+0000 mgr.x (mgr.34562) 3717 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:55:54.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:55:53 smithi132 bash[27079]: cluster 2020-07-16T14:55:52.526069+0000 mgr.x (mgr.34562) 3718 : cluster [DBG] pgmap v2316: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:55:55.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:55:55 smithi188 bash[23329]: cluster 2020-07-16T14:55:54.526550+0000 mgr.x (mgr.34562) 3719 : cluster [DBG] pgmap v2317: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:55:55.980 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:55:56.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:55:55 smithi132 bash[27079]: cluster 2020-07-16T14:55:54.526550+0000 mgr.x (mgr.34562) 3719 : cluster [DBG] pgmap v2317: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:55:56.240 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:55:56.241 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (78m) 3m ago 81m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:55:56.241 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (81m) 3m ago 81m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:55:56.242 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (79m) 3m ago 84m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:55:56.242 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (78m) 3m ago 86m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:55:56.242 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 3m ago 86m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:55:56.243 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (84m) 3m ago 84m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:55:56.243 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (84m) 3m ago 84m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:55:56.243 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (81m) 3m ago 81m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:55:56.244 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (81m) 3m ago 81m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:55:56.244 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (84m) 3m ago 84m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:55:56.244 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (84m) 3m ago 84m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:55:56.245 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (83m) 3m ago 83m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:55:56.245 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (83m) 3m ago 83m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:55:56.245 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (82m) 3m ago 83m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:55:56.246 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (82m) 3m ago 82m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:55:56.246 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (82m) 3m ago 82m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:55:56.246 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (82m) 3m ago 82m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:55:56.247 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (81m) 3m ago 81m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:55:56.539 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:55:56.539 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:55:56.539 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:55:56.540 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:55:56.540 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:55:56.540 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:55:56.540 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:55:56.540 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:55:56.541 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:55:56.541 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:55:56.541 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:55:56.541 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:55:56.541 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:55:56.541 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:55:56.542 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:55:56.542 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:55:56.542 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:55:56.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:55:56 smithi188 bash[23329]: audit 2020-07-16T14:55:56.537956+0000 mon.c (mon.1) 281 : audit [DBG] from='client.? 172.21.15.132:0/271516543' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:55:57.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:55:56 smithi132 bash[27079]: audit 2020-07-16T14:55:56.537956+0000 mon.c (mon.1) 281 : audit [DBG] from='client.? 172.21.15.132:0/271516543' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:55:57.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:55:57 smithi188 bash[23329]: audit 2020-07-16T14:55:55.968854+0000 mgr.x (mgr.34562) 3720 : audit [DBG] from='client.27340 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:55:57.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:55:57 smithi188 bash[23329]: audit 2020-07-16T14:55:56.236362+0000 mgr.x (mgr.34562) 3721 : audit [DBG] from='client.27346 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:55:57.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:55:57 smithi188 bash[23329]: cluster 2020-07-16T14:55:56.527149+0000 mgr.x (mgr.34562) 3722 : cluster [DBG] pgmap v2318: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:55:58.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:55:57 smithi132 bash[27079]: audit 2020-07-16T14:55:55.968854+0000 mgr.x (mgr.34562) 3720 : audit [DBG] from='client.27340 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:55:58.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:55:57 smithi132 bash[27079]: audit 2020-07-16T14:55:56.236362+0000 mgr.x (mgr.34562) 3721 : audit [DBG] from='client.27346 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:55:58.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:55:57 smithi132 bash[27079]: cluster 2020-07-16T14:55:56.527149+0000 mgr.x (mgr.34562) 3722 : cluster [DBG] pgmap v2318: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:55:59.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:55:59 smithi188 bash[23329]: cluster 2020-07-16T14:55:58.527515+0000 mgr.x (mgr.34562) 3723 : cluster [DBG] pgmap v2319: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:56:00.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:55:59 smithi132 bash[27079]: cluster 2020-07-16T14:55:58.527515+0000 mgr.x (mgr.34562) 3723 : cluster [DBG] pgmap v2319: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:56:01.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:56:00 smithi132 bash[27079]: cluster 2020-07-16T14:56:00.527983+0000 mgr.x (mgr.34562) 3724 : cluster [DBG] pgmap v2320: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:56:01.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:56:00 smithi188 bash[23329]: cluster 2020-07-16T14:56:00.527983+0000 mgr.x (mgr.34562) 3724 : cluster [DBG] pgmap v2320: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:56:03.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:56:03 smithi188 bash[23329]: cluster 2020-07-16T14:56:02.528403+0000 mgr.x (mgr.34562) 3725 : cluster [DBG] pgmap v2321: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:56:04.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:56:03 smithi132 bash[27079]: cluster 2020-07-16T14:56:02.528403+0000 mgr.x (mgr.34562) 3725 : cluster [DBG] pgmap v2321: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:56:05.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:56:05 smithi188 bash[23329]: cluster 2020-07-16T14:56:04.528854+0000 mgr.x (mgr.34562) 3726 : cluster [DBG] pgmap v2322: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:56:06.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:56:05 smithi132 bash[27079]: cluster 2020-07-16T14:56:04.528854+0000 mgr.x (mgr.34562) 3726 : cluster [DBG] pgmap v2322: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:56:07.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:56:07 smithi188 bash[23329]: cluster 2020-07-16T14:56:06.529375+0000 mgr.x (mgr.34562) 3727 : cluster [DBG] pgmap v2323: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:56:07.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:56:07 smithi188 bash[23329]: audit 2020-07-16T14:56:07.441808+0000 mon.b (mon.2) 873 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:56:08.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:56:07 smithi132 bash[27079]: cluster 2020-07-16T14:56:06.529375+0000 mgr.x (mgr.34562) 3727 : cluster [DBG] pgmap v2323: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:56:08.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:56:07 smithi132 bash[27079]: audit 2020-07-16T14:56:07.441808+0000 mon.b (mon.2) 873 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:56:08.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:56:08 smithi188 bash[23329]: cephadm 2020-07-16T14:56:07.442581+0000 mgr.x (mgr.34562) 3728 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:56:08.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:56:08 smithi188 bash[23329]: cephadm 2020-07-16T14:56:07.442897+0000 mgr.x (mgr.34562) 3729 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:56:09.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:56:08 smithi132 bash[27079]: cephadm 2020-07-16T14:56:07.442581+0000 mgr.x (mgr.34562) 3728 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:56:09.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:56:08 smithi132 bash[27079]: cephadm 2020-07-16T14:56:07.442897+0000 mgr.x (mgr.34562) 3729 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:56:09.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:56:09 smithi188 bash[23329]: cluster 2020-07-16T14:56:08.529779+0000 mgr.x (mgr.34562) 3730 : cluster [DBG] pgmap v2324: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:56:10.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:56:09 smithi132 bash[27079]: cluster 2020-07-16T14:56:08.529779+0000 mgr.x (mgr.34562) 3730 : cluster [DBG] pgmap v2324: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:56:11.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:56:10 smithi132 bash[27079]: cluster 2020-07-16T14:56:10.530233+0000 mgr.x (mgr.34562) 3731 : cluster [DBG] pgmap v2325: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:56:11.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:56:10 smithi188 bash[23329]: cluster 2020-07-16T14:56:10.530233+0000 mgr.x (mgr.34562) 3731 : cluster [DBG] pgmap v2325: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:56:13.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:56:13 smithi188 bash[23329]: cluster 2020-07-16T14:56:12.530673+0000 mgr.x (mgr.34562) 3732 : cluster [DBG] pgmap v2326: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:56:14.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:56:13 smithi132 bash[27079]: cluster 2020-07-16T14:56:12.530673+0000 mgr.x (mgr.34562) 3732 : cluster [DBG] pgmap v2326: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:56:15.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:56:15 smithi188 bash[23329]: cluster 2020-07-16T14:56:14.531174+0000 mgr.x (mgr.34562) 3733 : cluster [DBG] pgmap v2327: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:56:16.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:56:15 smithi132 bash[27079]: cluster 2020-07-16T14:56:14.531174+0000 mgr.x (mgr.34562) 3733 : cluster [DBG] pgmap v2327: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:56:17.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:56:17 smithi188 bash[23329]: cluster 2020-07-16T14:56:16.531740+0000 mgr.x (mgr.34562) 3734 : cluster [DBG] pgmap v2328: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:56:18.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:56:17 smithi132 bash[27079]: cluster 2020-07-16T14:56:16.531740+0000 mgr.x (mgr.34562) 3734 : cluster [DBG] pgmap v2328: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:56:19.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:56:19 smithi188 bash[23329]: cluster 2020-07-16T14:56:18.532265+0000 mgr.x (mgr.34562) 3735 : cluster [DBG] pgmap v2329: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:56:20.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:56:19 smithi132 bash[27079]: cluster 2020-07-16T14:56:18.532265+0000 mgr.x (mgr.34562) 3735 : cluster [DBG] pgmap v2329: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:56:21.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:56:20 smithi132 bash[27079]: cluster 2020-07-16T14:56:20.532674+0000 mgr.x (mgr.34562) 3736 : cluster [DBG] pgmap v2330: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:56:21.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:56:20 smithi188 bash[23329]: cluster 2020-07-16T14:56:20.532674+0000 mgr.x (mgr.34562) 3736 : cluster [DBG] pgmap v2330: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:56:22.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:56:22 smithi132 bash[27079]: audit 2020-07-16T14:56:22.458592+0000 mon.b (mon.2) 874 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:56:22.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:56:22 smithi188 bash[23329]: audit 2020-07-16T14:56:22.458592+0000 mon.b (mon.2) 874 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:56:23.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:56:23 smithi132 bash[27079]: cephadm 2020-07-16T14:56:22.459293+0000 mgr.x (mgr.34562) 3737 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:56:23.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:56:23 smithi132 bash[27079]: cephadm 2020-07-16T14:56:22.459372+0000 mgr.x (mgr.34562) 3738 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:56:23.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:56:23 smithi132 bash[27079]: cluster 2020-07-16T14:56:22.533096+0000 mgr.x (mgr.34562) 3739 : cluster [DBG] pgmap v2331: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:56:23.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:56:23 smithi188 bash[23329]: cephadm 2020-07-16T14:56:22.459293+0000 mgr.x (mgr.34562) 3737 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:56:23.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:56:23 smithi188 bash[23329]: cephadm 2020-07-16T14:56:22.459372+0000 mgr.x (mgr.34562) 3738 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:56:23.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:56:23 smithi188 bash[23329]: cluster 2020-07-16T14:56:22.533096+0000 mgr.x (mgr.34562) 3739 : cluster [DBG] pgmap v2331: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:56:25.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:56:25 smithi188 bash[23329]: cluster 2020-07-16T14:56:24.533652+0000 mgr.x (mgr.34562) 3740 : cluster [DBG] pgmap v2332: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:56:26.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:56:25 smithi132 bash[27079]: cluster 2020-07-16T14:56:24.533652+0000 mgr.x (mgr.34562) 3740 : cluster [DBG] pgmap v2332: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:56:26.842 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:56:27.100 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:56:27.101 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (79m) 3m ago 82m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:56:27.101 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (81m) 3m ago 81m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:56:27.101 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (79m) 3m ago 85m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:56:27.101 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (78m) 3m ago 86m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:56:27.101 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 3m ago 86m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:56:27.102 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (85m) 3m ago 85m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:56:27.102 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (85m) 3m ago 85m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:56:27.102 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (82m) 3m ago 82m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:56:27.102 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (82m) 3m ago 82m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:56:27.102 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (84m) 3m ago 84m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:56:27.103 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (84m) 3m ago 84m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:56:27.103 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (84m) 3m ago 84m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:56:27.103 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (83m) 3m ago 83m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:56:27.103 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (83m) 3m ago 83m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:56:27.103 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (83m) 3m ago 83m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:56:27.105 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (83m) 3m ago 83m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:56:27.105 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (82m) 3m ago 82m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:56:27.105 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (81m) 3m ago 82m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:56:27.399 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:56:27.399 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:56:27.399 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:56:27.399 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:56:27.400 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:56:27.400 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:56:27.400 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:56:27.400 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:56:27.400 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:56:27.401 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:56:27.401 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:56:27.401 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:56:27.402 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:56:27.402 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:56:27.402 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:56:27.402 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:56:27.402 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:56:27.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:56:27 smithi188 bash[23329]: cluster 2020-07-16T14:56:26.534078+0000 mgr.x (mgr.34562) 3741 : cluster [DBG] pgmap v2333: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:56:27.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:56:27 smithi188 bash[23329]: audit 2020-07-16T14:56:27.395825+0000 mon.c (mon.1) 282 : audit [DBG] from='client.? 172.21.15.132:0/4247514714' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:56:28.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:56:27 smithi132 bash[27079]: cluster 2020-07-16T14:56:26.534078+0000 mgr.x (mgr.34562) 3741 : cluster [DBG] pgmap v2333: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:56:28.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:56:27 smithi132 bash[27079]: audit 2020-07-16T14:56:27.395825+0000 mon.c (mon.1) 282 : audit [DBG] from='client.? 172.21.15.132:0/4247514714' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:56:28.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:56:28 smithi188 bash[23329]: audit 2020-07-16T14:56:26.830666+0000 mgr.x (mgr.34562) 3742 : audit [DBG] from='client.27358 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:56:28.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:56:28 smithi188 bash[23329]: audit 2020-07-16T14:56:27.096200+0000 mgr.x (mgr.34562) 3743 : audit [DBG] from='client.27364 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:56:29.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:56:28 smithi132 bash[27079]: audit 2020-07-16T14:56:26.830666+0000 mgr.x (mgr.34562) 3742 : audit [DBG] from='client.27358 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:56:29.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:56:28 smithi132 bash[27079]: audit 2020-07-16T14:56:27.096200+0000 mgr.x (mgr.34562) 3743 : audit [DBG] from='client.27364 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:56:29.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:56:29 smithi188 bash[23329]: cluster 2020-07-16T14:56:28.534475+0000 mgr.x (mgr.34562) 3744 : cluster [DBG] pgmap v2334: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:56:30.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:56:29 smithi132 bash[27079]: cluster 2020-07-16T14:56:28.534475+0000 mgr.x (mgr.34562) 3744 : cluster [DBG] pgmap v2334: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:56:31.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:56:30 smithi132 bash[27079]: cluster 2020-07-16T14:56:30.534910+0000 mgr.x (mgr.34562) 3745 : cluster [DBG] pgmap v2335: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:56:31.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:56:30 smithi188 bash[23329]: cluster 2020-07-16T14:56:30.534910+0000 mgr.x (mgr.34562) 3745 : cluster [DBG] pgmap v2335: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:56:33.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:56:33 smithi188 bash[23329]: cluster 2020-07-16T14:56:32.535326+0000 mgr.x (mgr.34562) 3746 : cluster [DBG] pgmap v2336: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:56:34.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:56:33 smithi132 bash[27079]: cluster 2020-07-16T14:56:32.535326+0000 mgr.x (mgr.34562) 3746 : cluster [DBG] pgmap v2336: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:56:35.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:56:35 smithi188 bash[23329]: cluster 2020-07-16T14:56:34.535648+0000 mgr.x (mgr.34562) 3747 : cluster [DBG] pgmap v2337: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:56:36.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:56:35 smithi132 bash[27079]: cluster 2020-07-16T14:56:34.535648+0000 mgr.x (mgr.34562) 3747 : cluster [DBG] pgmap v2337: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:56:37.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:56:37 smithi188 bash[23329]: cluster 2020-07-16T14:56:36.535959+0000 mgr.x (mgr.34562) 3748 : cluster [DBG] pgmap v2338: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:56:37.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:56:37 smithi188 bash[23329]: audit 2020-07-16T14:56:37.468715+0000 mon.b (mon.2) 875 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:56:38.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:56:37 smithi132 bash[27079]: cluster 2020-07-16T14:56:36.535959+0000 mgr.x (mgr.34562) 3748 : cluster [DBG] pgmap v2338: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:56:38.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:56:37 smithi132 bash[27079]: audit 2020-07-16T14:56:37.468715+0000 mon.b (mon.2) 875 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:56:38.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:56:38 smithi188 bash[23329]: cephadm 2020-07-16T14:56:37.469440+0000 mgr.x (mgr.34562) 3749 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:56:38.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:56:38 smithi188 bash[23329]: cephadm 2020-07-16T14:56:37.469673+0000 mgr.x (mgr.34562) 3750 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:56:39.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:56:38 smithi132 bash[27079]: cephadm 2020-07-16T14:56:37.469440+0000 mgr.x (mgr.34562) 3749 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:56:39.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:56:38 smithi132 bash[27079]: cephadm 2020-07-16T14:56:37.469673+0000 mgr.x (mgr.34562) 3750 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:56:39.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:56:39 smithi188 bash[23329]: cluster 2020-07-16T14:56:38.536413+0000 mgr.x (mgr.34562) 3751 : cluster [DBG] pgmap v2339: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:56:40.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:56:39 smithi132 bash[27079]: cluster 2020-07-16T14:56:38.536413+0000 mgr.x (mgr.34562) 3751 : cluster [DBG] pgmap v2339: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:56:41.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:56:40 smithi132 bash[27079]: cluster 2020-07-16T14:56:40.536860+0000 mgr.x (mgr.34562) 3752 : cluster [DBG] pgmap v2340: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:56:41.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:56:40 smithi188 bash[23329]: cluster 2020-07-16T14:56:40.536860+0000 mgr.x (mgr.34562) 3752 : cluster [DBG] pgmap v2340: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:56:43.925 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:56:43 smithi188 bash[23329]: cluster 2020-07-16T14:56:42.537380+0000 mgr.x (mgr.34562) 3753 : cluster [DBG] pgmap v2341: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:56:44.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:56:43 smithi132 bash[27079]: cluster 2020-07-16T14:56:42.537380+0000 mgr.x (mgr.34562) 3753 : cluster [DBG] pgmap v2341: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:56:45.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:56:45 smithi188 bash[23329]: cluster 2020-07-16T14:56:44.537828+0000 mgr.x (mgr.34562) 3754 : cluster [DBG] pgmap v2342: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:56:46.041 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:56:45 smithi132 bash[27079]: cluster 2020-07-16T14:56:44.537828+0000 mgr.x (mgr.34562) 3754 : cluster [DBG] pgmap v2342: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:56:47.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:56:47 smithi188 bash[23329]: cluster 2020-07-16T14:56:46.538222+0000 mgr.x (mgr.34562) 3755 : cluster [DBG] pgmap v2343: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:56:48.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:56:47 smithi132 bash[27079]: cluster 2020-07-16T14:56:46.538222+0000 mgr.x (mgr.34562) 3755 : cluster [DBG] pgmap v2343: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:56:49.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:56:49 smithi188 bash[23329]: cluster 2020-07-16T14:56:48.538727+0000 mgr.x (mgr.34562) 3756 : cluster [DBG] pgmap v2344: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:56:50.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:56:49 smithi132 bash[27079]: cluster 2020-07-16T14:56:48.538727+0000 mgr.x (mgr.34562) 3756 : cluster [DBG] pgmap v2344: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:56:51.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:56:50 smithi132 bash[27079]: cluster 2020-07-16T14:56:50.539175+0000 mgr.x (mgr.34562) 3757 : cluster [DBG] pgmap v2345: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:56:51.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:56:50 smithi188 bash[23329]: cluster 2020-07-16T14:56:50.539175+0000 mgr.x (mgr.34562) 3757 : cluster [DBG] pgmap v2345: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:56:52.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:56:52 smithi188 bash[23329]: audit 2020-07-16T14:56:52.487975+0000 mon.b (mon.2) 876 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:56:52.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:56:52 smithi188 bash[23329]: audit 2020-07-16T14:56:52.489365+0000 mon.b (mon.2) 877 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:56:52.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:56:52 smithi188 bash[23329]: audit 2020-07-16T14:56:52.490654+0000 mon.b (mon.2) 878 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:56:52.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:56:52 smithi188 bash[23329]: audit 2020-07-16T14:56:52.491993+0000 mon.b (mon.2) 879 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:56:52.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:56:52 smithi188 bash[23329]: audit 2020-07-16T14:56:52.493296+0000 mon.b (mon.2) 880 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:56:52.960 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:56:52 smithi132 bash[27079]: audit 2020-07-16T14:56:52.487975+0000 mon.b (mon.2) 876 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:56:52.960 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:56:52 smithi132 bash[27079]: audit 2020-07-16T14:56:52.489365+0000 mon.b (mon.2) 877 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:56:52.961 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:56:52 smithi132 bash[27079]: audit 2020-07-16T14:56:52.490654+0000 mon.b (mon.2) 878 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:56:52.961 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:56:52 smithi132 bash[27079]: audit 2020-07-16T14:56:52.491993+0000 mon.b (mon.2) 879 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:56:52.961 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:56:52 smithi132 bash[27079]: audit 2020-07-16T14:56:52.493296+0000 mon.b (mon.2) 880 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:56:53.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:56:53 smithi132 bash[27079]: audit 2020-07-16T14:56:52.488364+0000 mgr.x (mgr.34562) 3758 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:56:53.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:56:53 smithi132 bash[27079]: audit 2020-07-16T14:56:52.489736+0000 mgr.x (mgr.34562) 3759 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:56:53.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:56:53 smithi132 bash[27079]: audit 2020-07-16T14:56:52.490949+0000 mgr.x (mgr.34562) 3760 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:56:53.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:56:53 smithi132 bash[27079]: cephadm 2020-07-16T14:56:52.491688+0000 mgr.x (mgr.34562) 3761 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:56:53.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:56:53 smithi132 bash[27079]: cephadm 2020-07-16T14:56:52.492897+0000 mgr.x (mgr.34562) 3762 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:56:53.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:56:53 smithi132 bash[27079]: cephadm 2020-07-16T14:56:52.493990+0000 mgr.x (mgr.34562) 3763 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:56:53.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:56:53 smithi132 bash[27079]: cephadm 2020-07-16T14:56:52.494107+0000 mgr.x (mgr.34562) 3764 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:56:53.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:56:53 smithi132 bash[27079]: cluster 2020-07-16T14:56:52.539542+0000 mgr.x (mgr.34562) 3765 : cluster [DBG] pgmap v2346: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:56:53.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:56:53 smithi188 bash[23329]: audit 2020-07-16T14:56:52.488364+0000 mgr.x (mgr.34562) 3758 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:56:53.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:56:53 smithi188 bash[23329]: audit 2020-07-16T14:56:52.489736+0000 mgr.x (mgr.34562) 3759 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:56:53.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:56:53 smithi188 bash[23329]: audit 2020-07-16T14:56:52.490949+0000 mgr.x (mgr.34562) 3760 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:56:53.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:56:53 smithi188 bash[23329]: cephadm 2020-07-16T14:56:52.491688+0000 mgr.x (mgr.34562) 3761 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:56:53.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:56:53 smithi188 bash[23329]: cephadm 2020-07-16T14:56:52.492897+0000 mgr.x (mgr.34562) 3762 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:56:53.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:56:53 smithi188 bash[23329]: cephadm 2020-07-16T14:56:52.493990+0000 mgr.x (mgr.34562) 3763 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:56:53.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:56:53 smithi188 bash[23329]: cephadm 2020-07-16T14:56:52.494107+0000 mgr.x (mgr.34562) 3764 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:56:53.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:56:53 smithi188 bash[23329]: cluster 2020-07-16T14:56:52.539542+0000 mgr.x (mgr.34562) 3765 : cluster [DBG] pgmap v2346: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:56:55.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:56:55 smithi188 bash[23329]: cluster 2020-07-16T14:56:54.540026+0000 mgr.x (mgr.34562) 3766 : cluster [DBG] pgmap v2347: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:56:55.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:56:55 smithi188 bash[23329]: audit 2020-07-16T14:56:55.258116+0000 mon.b (mon.2) 881 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:56:56.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:56:55 smithi132 bash[27079]: cluster 2020-07-16T14:56:54.540026+0000 mgr.x (mgr.34562) 3766 : cluster [DBG] pgmap v2347: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:56:56.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:56:55 smithi132 bash[27079]: audit 2020-07-16T14:56:55.258116+0000 mon.b (mon.2) 881 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:56:56.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:56:56 smithi188 bash[23329]: cephadm 2020-07-16T14:56:55.258776+0000 mgr.x (mgr.34562) 3767 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:56:56.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:56:56 smithi188 bash[23329]: cephadm 2020-07-16T14:56:55.258970+0000 mgr.x (mgr.34562) 3768 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:56:57.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:56:56 smithi132 bash[27079]: cephadm 2020-07-16T14:56:55.258776+0000 mgr.x (mgr.34562) 3767 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:56:57.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:56:56 smithi132 bash[27079]: cephadm 2020-07-16T14:56:55.258970+0000 mgr.x (mgr.34562) 3768 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:56:57.694 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:56:57.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:56:57 smithi188 bash[23329]: cluster 2020-07-16T14:56:56.540375+0000 mgr.x (mgr.34562) 3769 : cluster [DBG] pgmap v2348: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:56:57.952 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:56:57.952 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (79m) 4m ago 82m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:56:57.953 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (82m) 4m ago 82m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:56:57.953 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (80m) 4m ago 85m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:56:57.953 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (79m) 4m ago 87m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:56:57.953 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 4m ago 87m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:56:57.953 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (85m) 4m ago 85m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:56:57.954 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (85m) 4m ago 85m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:56:57.954 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (82m) 4m ago 82m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:56:57.954 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (82m) 4m ago 83m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:56:57.954 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (85m) 4m ago 85m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:56:57.954 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (85m) 4m ago 85m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:56:57.955 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (84m) 4m ago 84m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:56:57.955 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (84m) 4m ago 84m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:56:57.955 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (83m) 4m ago 84m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:56:57.955 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (83m) 4m ago 83m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:56:57.955 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (83m) 4m ago 83m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:56:57.956 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (83m) 4m ago 83m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:56:57.956 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (82m) 4m ago 83m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:56:58.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:56:57 smithi132 bash[27079]: cluster 2020-07-16T14:56:56.540375+0000 mgr.x (mgr.34562) 3769 : cluster [DBG] pgmap v2348: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:56:58.255 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:56:58.255 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:56:58.255 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:56:58.255 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:56:58.256 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:56:58.256 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:56:58.256 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:56:58.256 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:56:58.256 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:56:58.257 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:56:58.257 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:56:58.257 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:56:58.257 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:56:58.257 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:56:58.257 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:56:58.258 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:56:58.258 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:56:58.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:56:58 smithi188 bash[23329]: audit 2020-07-16T14:56:58.253979+0000 mon.c (mon.1) 283 : audit [DBG] from='client.? 172.21.15.132:0/496098774' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:56:59.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:56:58 smithi132 bash[27079]: audit 2020-07-16T14:56:58.253979+0000 mon.c (mon.1) 283 : audit [DBG] from='client.? 172.21.15.132:0/496098774' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:56:59.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:56:59 smithi188 bash[23329]: audit 2020-07-16T14:56:57.682684+0000 mgr.x (mgr.34562) 3770 : audit [DBG] from='client.27376 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:56:59.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:56:59 smithi188 bash[23329]: audit 2020-07-16T14:56:57.948164+0000 mgr.x (mgr.34562) 3771 : audit [DBG] from='client.27382 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:56:59.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:56:59 smithi188 bash[23329]: cluster 2020-07-16T14:56:58.540856+0000 mgr.x (mgr.34562) 3772 : cluster [DBG] pgmap v2349: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:57:00.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:56:59 smithi132 bash[27079]: audit 2020-07-16T14:56:57.682684+0000 mgr.x (mgr.34562) 3770 : audit [DBG] from='client.27376 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:57:00.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:56:59 smithi132 bash[27079]: audit 2020-07-16T14:56:57.948164+0000 mgr.x (mgr.34562) 3771 : audit [DBG] from='client.27382 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:57:00.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:56:59 smithi132 bash[27079]: cluster 2020-07-16T14:56:58.540856+0000 mgr.x (mgr.34562) 3772 : cluster [DBG] pgmap v2349: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:57:01.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:57:00 smithi132 bash[27079]: cluster 2020-07-16T14:57:00.541273+0000 mgr.x (mgr.34562) 3773 : cluster [DBG] pgmap v2350: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:57:01.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:57:00 smithi188 bash[23329]: cluster 2020-07-16T14:57:00.541273+0000 mgr.x (mgr.34562) 3773 : cluster [DBG] pgmap v2350: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:57:03.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:57:03 smithi188 bash[23329]: cluster 2020-07-16T14:57:02.541801+0000 mgr.x (mgr.34562) 3774 : cluster [DBG] pgmap v2351: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:57:04.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:57:03 smithi132 bash[27079]: cluster 2020-07-16T14:57:02.541801+0000 mgr.x (mgr.34562) 3774 : cluster [DBG] pgmap v2351: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:57:05.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:57:05 smithi188 bash[23329]: cluster 2020-07-16T14:57:04.542168+0000 mgr.x (mgr.34562) 3775 : cluster [DBG] pgmap v2352: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:57:06.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:57:05 smithi132 bash[27079]: cluster 2020-07-16T14:57:04.542168+0000 mgr.x (mgr.34562) 3775 : cluster [DBG] pgmap v2352: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:57:07.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:57:07 smithi188 bash[23329]: cluster 2020-07-16T14:57:06.542577+0000 mgr.x (mgr.34562) 3776 : cluster [DBG] pgmap v2353: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:57:08.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:57:07 smithi132 bash[27079]: cluster 2020-07-16T14:57:06.542577+0000 mgr.x (mgr.34562) 3776 : cluster [DBG] pgmap v2353: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:57:09.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:57:09 smithi188 bash[23329]: cluster 2020-07-16T14:57:08.543022+0000 mgr.x (mgr.34562) 3777 : cluster [DBG] pgmap v2354: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:57:10.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:57:09 smithi132 bash[27079]: cluster 2020-07-16T14:57:08.543022+0000 mgr.x (mgr.34562) 3777 : cluster [DBG] pgmap v2354: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:57:11.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:57:10 smithi132 bash[27079]: audit 2020-07-16T14:57:10.272083+0000 mon.b (mon.2) 882 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:57:11.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:57:10 smithi132 bash[27079]: cephadm 2020-07-16T14:57:10.272794+0000 mgr.x (mgr.34562) 3778 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:57:11.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:57:10 smithi132 bash[27079]: cephadm 2020-07-16T14:57:10.272875+0000 mgr.x (mgr.34562) 3779 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:57:11.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:57:10 smithi132 bash[27079]: cluster 2020-07-16T14:57:10.543395+0000 mgr.x (mgr.34562) 3780 : cluster [DBG] pgmap v2355: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:57:11.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:57:10 smithi188 bash[23329]: audit 2020-07-16T14:57:10.272083+0000 mon.b (mon.2) 882 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:57:11.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:57:10 smithi188 bash[23329]: cephadm 2020-07-16T14:57:10.272794+0000 mgr.x (mgr.34562) 3778 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:57:11.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:57:10 smithi188 bash[23329]: cephadm 2020-07-16T14:57:10.272875+0000 mgr.x (mgr.34562) 3779 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:57:11.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:57:10 smithi188 bash[23329]: cluster 2020-07-16T14:57:10.543395+0000 mgr.x (mgr.34562) 3780 : cluster [DBG] pgmap v2355: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:57:13.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:57:13 smithi188 bash[23329]: cluster 2020-07-16T14:57:12.543756+0000 mgr.x (mgr.34562) 3781 : cluster [DBG] pgmap v2356: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:57:14.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:57:13 smithi132 bash[27079]: cluster 2020-07-16T14:57:12.543756+0000 mgr.x (mgr.34562) 3781 : cluster [DBG] pgmap v2356: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:57:15.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:57:15 smithi188 bash[23329]: cluster 2020-07-16T14:57:14.544114+0000 mgr.x (mgr.34562) 3782 : cluster [DBG] pgmap v2357: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:57:16.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:57:15 smithi132 bash[27079]: cluster 2020-07-16T14:57:14.544114+0000 mgr.x (mgr.34562) 3782 : cluster [DBG] pgmap v2357: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:57:17.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:57:17 smithi188 bash[23329]: cluster 2020-07-16T14:57:16.544627+0000 mgr.x (mgr.34562) 3783 : cluster [DBG] pgmap v2358: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:57:18.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:57:17 smithi132 bash[27079]: cluster 2020-07-16T14:57:16.544627+0000 mgr.x (mgr.34562) 3783 : cluster [DBG] pgmap v2358: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:57:19.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:57:19 smithi188 bash[23329]: cluster 2020-07-16T14:57:18.545112+0000 mgr.x (mgr.34562) 3784 : cluster [DBG] pgmap v2359: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:57:20.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:57:19 smithi132 bash[27079]: cluster 2020-07-16T14:57:18.545112+0000 mgr.x (mgr.34562) 3784 : cluster [DBG] pgmap v2359: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:57:21.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:57:20 smithi132 bash[27079]: cluster 2020-07-16T14:57:20.545639+0000 mgr.x (mgr.34562) 3785 : cluster [DBG] pgmap v2360: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:57:21.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:57:20 smithi188 bash[23329]: cluster 2020-07-16T14:57:20.545639+0000 mgr.x (mgr.34562) 3785 : cluster [DBG] pgmap v2360: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:57:23.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:57:23 smithi188 bash[23329]: cluster 2020-07-16T14:57:22.546210+0000 mgr.x (mgr.34562) 3786 : cluster [DBG] pgmap v2361: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:57:24.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:57:23 smithi132 bash[27079]: cluster 2020-07-16T14:57:22.546210+0000 mgr.x (mgr.34562) 3786 : cluster [DBG] pgmap v2361: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:57:25.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:57:25 smithi188 bash[23329]: cluster 2020-07-16T14:57:24.546506+0000 mgr.x (mgr.34562) 3787 : cluster [DBG] pgmap v2362: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:57:25.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:57:25 smithi188 bash[23329]: audit 2020-07-16T14:57:25.273806+0000 mon.b (mon.2) 883 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:57:26.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:57:25 smithi132 bash[27079]: cluster 2020-07-16T14:57:24.546506+0000 mgr.x (mgr.34562) 3787 : cluster [DBG] pgmap v2362: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:57:26.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:57:25 smithi132 bash[27079]: audit 2020-07-16T14:57:25.273806+0000 mon.b (mon.2) 883 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:57:26.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:57:26 smithi188 bash[23329]: cephadm 2020-07-16T14:57:25.274557+0000 mgr.x (mgr.34562) 3788 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:57:26.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:57:26 smithi188 bash[23329]: cephadm 2020-07-16T14:57:25.274853+0000 mgr.x (mgr.34562) 3789 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:57:27.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:57:26 smithi132 bash[27079]: cephadm 2020-07-16T14:57:25.274557+0000 mgr.x (mgr.34562) 3788 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:57:27.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:57:26 smithi132 bash[27079]: cephadm 2020-07-16T14:57:25.274853+0000 mgr.x (mgr.34562) 3789 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:57:27.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:57:27 smithi188 bash[23329]: cluster 2020-07-16T14:57:26.546906+0000 mgr.x (mgr.34562) 3790 : cluster [DBG] pgmap v2363: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:57:28.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:57:27 smithi132 bash[27079]: cluster 2020-07-16T14:57:26.546906+0000 mgr.x (mgr.34562) 3790 : cluster [DBG] pgmap v2363: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:57:28.554 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:57:28.818 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:57:28.818 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (80m) 4m ago 83m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:57:28.818 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (82m) 4m ago 82m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:57:28.819 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (80m) 4m ago 86m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:57:28.819 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (79m) 4m ago 87m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:57:28.819 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 4m ago 87m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:57:28.819 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (86m) 4m ago 86m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:57:28.819 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (86m) 4m ago 86m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:57:28.820 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (83m) 4m ago 83m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:57:28.820 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (83m) 4m ago 83m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:57:28.820 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (85m) 4m ago 85m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:57:28.820 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (85m) 4m ago 85m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:57:28.820 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (85m) 4m ago 85m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:57:28.821 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (84m) 4m ago 85m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:57:28.821 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (84m) 4m ago 84m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:57:28.821 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (84m) 4m ago 84m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:57:28.821 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (84m) 4m ago 84m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:57:28.821 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (83m) 4m ago 83m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:57:28.822 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (82m) 4m ago 83m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:57:29.113 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:57:29.113 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:57:29.114 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:57:29.114 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:57:29.114 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:57:29.114 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:57:29.115 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:57:29.115 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:57:29.115 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:57:29.115 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:57:29.115 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:57:29.116 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:57:29.116 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:57:29.116 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:57:29.116 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:57:29.116 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:57:29.117 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:57:29.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:57:29 smithi188 bash[23329]: audit 2020-07-16T14:57:28.542820+0000 mgr.x (mgr.34562) 3791 : audit [DBG] from='client.27394 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:57:29.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:57:29 smithi188 bash[23329]: cluster 2020-07-16T14:57:28.547262+0000 mgr.x (mgr.34562) 3792 : cluster [DBG] pgmap v2364: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:57:29.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:57:29 smithi188 bash[23329]: audit 2020-07-16T14:57:29.112147+0000 mon.c (mon.1) 284 : audit [DBG] from='client.? 172.21.15.132:0/3254918158' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:57:30.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:57:29 smithi132 bash[27079]: audit 2020-07-16T14:57:28.542820+0000 mgr.x (mgr.34562) 3791 : audit [DBG] from='client.27394 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:57:30.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:57:29 smithi132 bash[27079]: cluster 2020-07-16T14:57:28.547262+0000 mgr.x (mgr.34562) 3792 : cluster [DBG] pgmap v2364: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:57:30.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:57:29 smithi132 bash[27079]: audit 2020-07-16T14:57:29.112147+0000 mon.c (mon.1) 284 : audit [DBG] from='client.? 172.21.15.132:0/3254918158' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:57:30.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:57:30 smithi188 bash[23329]: audit 2020-07-16T14:57:28.813525+0000 mgr.x (mgr.34562) 3793 : audit [DBG] from='client.27400 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:57:31.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:57:30 smithi132 bash[27079]: audit 2020-07-16T14:57:28.813525+0000 mgr.x (mgr.34562) 3793 : audit [DBG] from='client.27400 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:57:31.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:57:31 smithi188 bash[23329]: cluster 2020-07-16T14:57:30.547664+0000 mgr.x (mgr.34562) 3794 : cluster [DBG] pgmap v2365: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:57:32.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:57:31 smithi132 bash[27079]: cluster 2020-07-16T14:57:30.547664+0000 mgr.x (mgr.34562) 3794 : cluster [DBG] pgmap v2365: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:57:33.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:57:33 smithi188 bash[23329]: cluster 2020-07-16T14:57:32.548175+0000 mgr.x (mgr.34562) 3795 : cluster [DBG] pgmap v2366: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:57:34.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:57:33 smithi132 bash[27079]: cluster 2020-07-16T14:57:32.548175+0000 mgr.x (mgr.34562) 3795 : cluster [DBG] pgmap v2366: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:57:35.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:57:35 smithi188 bash[23329]: cluster 2020-07-16T14:57:34.548622+0000 mgr.x (mgr.34562) 3796 : cluster [DBG] pgmap v2367: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:57:36.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:57:35 smithi132 bash[27079]: cluster 2020-07-16T14:57:34.548622+0000 mgr.x (mgr.34562) 3796 : cluster [DBG] pgmap v2367: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:57:37.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:57:37 smithi188 bash[23329]: cluster 2020-07-16T14:57:36.548993+0000 mgr.x (mgr.34562) 3797 : cluster [DBG] pgmap v2368: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:57:38.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:57:37 smithi132 bash[27079]: cluster 2020-07-16T14:57:36.548993+0000 mgr.x (mgr.34562) 3797 : cluster [DBG] pgmap v2368: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:57:39.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:57:39 smithi188 bash[23329]: cluster 2020-07-16T14:57:38.549437+0000 mgr.x (mgr.34562) 3798 : cluster [DBG] pgmap v2369: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:57:40.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:57:39 smithi132 bash[27079]: cluster 2020-07-16T14:57:38.549437+0000 mgr.x (mgr.34562) 3798 : cluster [DBG] pgmap v2369: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:57:41.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:57:41 smithi132 bash[27079]: audit 2020-07-16T14:57:40.290661+0000 mon.b (mon.2) 884 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:57:41.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:57:41 smithi132 bash[27079]: cephadm 2020-07-16T14:57:40.291388+0000 mgr.x (mgr.34562) 3799 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:57:41.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:57:41 smithi132 bash[27079]: cephadm 2020-07-16T14:57:40.291564+0000 mgr.x (mgr.34562) 3800 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:57:41.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:57:41 smithi132 bash[27079]: cluster 2020-07-16T14:57:40.549831+0000 mgr.x (mgr.34562) 3801 : cluster [DBG] pgmap v2370: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:57:41.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:57:41 smithi188 bash[23329]: audit 2020-07-16T14:57:40.290661+0000 mon.b (mon.2) 884 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:57:41.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:57:41 smithi188 bash[23329]: cephadm 2020-07-16T14:57:40.291388+0000 mgr.x (mgr.34562) 3799 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:57:41.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:57:41 smithi188 bash[23329]: cephadm 2020-07-16T14:57:40.291564+0000 mgr.x (mgr.34562) 3800 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:57:41.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:57:41 smithi188 bash[23329]: cluster 2020-07-16T14:57:40.549831+0000 mgr.x (mgr.34562) 3801 : cluster [DBG] pgmap v2370: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:57:43.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:57:43 smithi188 bash[23329]: cluster 2020-07-16T14:57:42.550218+0000 mgr.x (mgr.34562) 3802 : cluster [DBG] pgmap v2371: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:57:44.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:57:43 smithi132 bash[27079]: cluster 2020-07-16T14:57:42.550218+0000 mgr.x (mgr.34562) 3802 : cluster [DBG] pgmap v2371: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:57:45.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:57:45 smithi188 bash[23329]: cluster 2020-07-16T14:57:44.550730+0000 mgr.x (mgr.34562) 3803 : cluster [DBG] pgmap v2372: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:57:46.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:57:45 smithi132 bash[27079]: cluster 2020-07-16T14:57:44.550730+0000 mgr.x (mgr.34562) 3803 : cluster [DBG] pgmap v2372: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:57:47.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:57:47 smithi188 bash[23329]: cluster 2020-07-16T14:57:46.551261+0000 mgr.x (mgr.34562) 3804 : cluster [DBG] pgmap v2373: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:57:48.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:57:47 smithi132 bash[27079]: cluster 2020-07-16T14:57:46.551261+0000 mgr.x (mgr.34562) 3804 : cluster [DBG] pgmap v2373: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:57:49.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:57:49 smithi188 bash[23329]: cluster 2020-07-16T14:57:48.551631+0000 mgr.x (mgr.34562) 3805 : cluster [DBG] pgmap v2374: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:57:50.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:57:49 smithi132 bash[27079]: cluster 2020-07-16T14:57:48.551631+0000 mgr.x (mgr.34562) 3805 : cluster [DBG] pgmap v2374: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:57:51.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:57:51 smithi132 bash[27079]: cluster 2020-07-16T14:57:50.552152+0000 mgr.x (mgr.34562) 3806 : cluster [DBG] pgmap v2375: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:57:51.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:57:51 smithi188 bash[23329]: cluster 2020-07-16T14:57:50.552152+0000 mgr.x (mgr.34562) 3806 : cluster [DBG] pgmap v2375: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:57:53.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:57:53 smithi188 bash[23329]: cluster 2020-07-16T14:57:52.552728+0000 mgr.x (mgr.34562) 3807 : cluster [DBG] pgmap v2376: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:57:54.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:57:53 smithi132 bash[27079]: cluster 2020-07-16T14:57:52.552728+0000 mgr.x (mgr.34562) 3807 : cluster [DBG] pgmap v2376: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:57:55.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:57:55 smithi188 bash[23329]: cluster 2020-07-16T14:57:54.553271+0000 mgr.x (mgr.34562) 3808 : cluster [DBG] pgmap v2377: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:57:55.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:57:55 smithi188 bash[23329]: audit 2020-07-16T14:57:55.309858+0000 mon.b (mon.2) 885 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:57:55.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:57:55 smithi188 bash[23329]: audit 2020-07-16T14:57:55.311311+0000 mon.b (mon.2) 886 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:57:55.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:57:55 smithi188 bash[23329]: audit 2020-07-16T14:57:55.312471+0000 mon.b (mon.2) 887 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:57:55.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:57:55 smithi188 bash[23329]: audit 2020-07-16T14:57:55.313833+0000 mon.b (mon.2) 888 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:57:55.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:57:55 smithi188 bash[23329]: audit 2020-07-16T14:57:55.315046+0000 mon.b (mon.2) 889 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:57:56.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:57:55 smithi132 bash[27079]: cluster 2020-07-16T14:57:54.553271+0000 mgr.x (mgr.34562) 3808 : cluster [DBG] pgmap v2377: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:57:56.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:57:55 smithi132 bash[27079]: audit 2020-07-16T14:57:55.309858+0000 mon.b (mon.2) 885 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:57:56.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:57:55 smithi132 bash[27079]: audit 2020-07-16T14:57:55.311311+0000 mon.b (mon.2) 886 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:57:56.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:57:55 smithi132 bash[27079]: audit 2020-07-16T14:57:55.312471+0000 mon.b (mon.2) 887 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:57:56.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:57:55 smithi132 bash[27079]: audit 2020-07-16T14:57:55.313833+0000 mon.b (mon.2) 888 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:57:56.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:57:55 smithi132 bash[27079]: audit 2020-07-16T14:57:55.315046+0000 mon.b (mon.2) 889 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:57:56.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:57:56 smithi188 bash[23329]: audit 2020-07-16T14:57:55.310259+0000 mgr.x (mgr.34562) 3809 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:57:56.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:57:56 smithi188 bash[23329]: audit 2020-07-16T14:57:55.311588+0000 mgr.x (mgr.34562) 3810 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:57:56.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:57:56 smithi188 bash[23329]: audit 2020-07-16T14:57:55.312763+0000 mgr.x (mgr.34562) 3811 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:57:56.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:57:56 smithi188 bash[23329]: cephadm 2020-07-16T14:57:55.313498+0000 mgr.x (mgr.34562) 3812 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:57:56.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:57:56 smithi188 bash[23329]: cephadm 2020-07-16T14:57:55.314704+0000 mgr.x (mgr.34562) 3813 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:57:56.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:57:56 smithi188 bash[23329]: cephadm 2020-07-16T14:57:55.315780+0000 mgr.x (mgr.34562) 3814 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:57:56.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:57:56 smithi188 bash[23329]: cephadm 2020-07-16T14:57:55.315849+0000 mgr.x (mgr.34562) 3815 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:57:57.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:57:56 smithi132 bash[27079]: audit 2020-07-16T14:57:55.310259+0000 mgr.x (mgr.34562) 3809 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:57:57.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:57:56 smithi132 bash[27079]: audit 2020-07-16T14:57:55.311588+0000 mgr.x (mgr.34562) 3810 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:57:57.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:57:56 smithi132 bash[27079]: audit 2020-07-16T14:57:55.312763+0000 mgr.x (mgr.34562) 3811 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:57:57.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:57:56 smithi132 bash[27079]: cephadm 2020-07-16T14:57:55.313498+0000 mgr.x (mgr.34562) 3812 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:57:57.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:57:56 smithi132 bash[27079]: cephadm 2020-07-16T14:57:55.314704+0000 mgr.x (mgr.34562) 3813 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:57:57.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:57:56 smithi132 bash[27079]: cephadm 2020-07-16T14:57:55.315780+0000 mgr.x (mgr.34562) 3814 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:57:57.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:57:56 smithi132 bash[27079]: cephadm 2020-07-16T14:57:55.315849+0000 mgr.x (mgr.34562) 3815 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:57:57.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:57:57 smithi132 bash[27079]: cluster 2020-07-16T14:57:56.553674+0000 mgr.x (mgr.34562) 3816 : cluster [DBG] pgmap v2378: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:57:57.928 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:57:57 smithi188 bash[23329]: cluster 2020-07-16T14:57:56.553674+0000 mgr.x (mgr.34562) 3816 : cluster [DBG] pgmap v2378: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:57:58.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:57:58 smithi188 bash[23329]: audit 2020-07-16T14:57:58.027565+0000 mon.b (mon.2) 890 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:57:59.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:57:58 smithi132 bash[27079]: audit 2020-07-16T14:57:58.027565+0000 mon.b (mon.2) 890 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:57:59.409 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:57:59.674 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:57:59.674 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (80m) 5m ago 83m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:57:59.674 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (83m) 5m ago 83m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:57:59.675 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (81m) 5m ago 86m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:57:59.675 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (80m) 5m ago 88m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:57:59.675 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 5m ago 88m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:57:59.675 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (86m) 5m ago 86m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:57:59.675 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (87m) 5m ago 87m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:57:59.676 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (83m) 5m ago 84m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:57:59.676 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (83m) 5m ago 84m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:57:59.676 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (86m) 5m ago 86m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:57:59.676 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (86m) 5m ago 86m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:57:59.676 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (85m) 5m ago 85m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:57:59.677 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (85m) 5m ago 85m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:57:59.677 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (84m) 5m ago 85m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:57:59.677 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (84m) 5m ago 84m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:57:59.677 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (84m) 5m ago 84m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:57:59.677 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (84m) 5m ago 84m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:57:59.678 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (83m) 5m ago 84m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:57:59.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:57:59 smithi188 bash[23329]: cephadm 2020-07-16T14:57:58.028195+0000 mgr.x (mgr.34562) 3817 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:57:59.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:57:59 smithi188 bash[23329]: cephadm 2020-07-16T14:57:58.028627+0000 mgr.x (mgr.34562) 3818 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:57:59.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:57:59 smithi188 bash[23329]: cluster 2020-07-16T14:57:58.554102+0000 mgr.x (mgr.34562) 3819 : cluster [DBG] pgmap v2379: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:57:59.982 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:57:59.982 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:57:59.982 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:57:59.983 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:57:59.983 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:57:59.983 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:57:59.983 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:57:59.983 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:57:59.984 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:57:59.984 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:57:59.984 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:57:59.984 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:57:59.984 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:57:59.984 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:57:59.985 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:57:59.985 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:57:59.985 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:58:00.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:57:59 smithi132 bash[27079]: cephadm 2020-07-16T14:57:58.028195+0000 mgr.x (mgr.34562) 3817 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:58:00.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:57:59 smithi132 bash[27079]: cephadm 2020-07-16T14:57:58.028627+0000 mgr.x (mgr.34562) 3818 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:58:00.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:57:59 smithi132 bash[27079]: cluster 2020-07-16T14:57:58.554102+0000 mgr.x (mgr.34562) 3819 : cluster [DBG] pgmap v2379: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:58:00.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:58:00 smithi188 bash[23329]: audit 2020-07-16T14:57:59.398031+0000 mgr.x (mgr.34562) 3820 : audit [DBG] from='client.27412 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:58:00.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:58:00 smithi188 bash[23329]: audit 2020-07-16T14:57:59.668895+0000 mgr.x (mgr.34562) 3821 : audit [DBG] from='client.27418 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:58:00.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:58:00 smithi188 bash[23329]: audit 2020-07-16T14:57:59.981197+0000 mon.c (mon.1) 285 : audit [DBG] from='client.? 172.21.15.132:0/1046664219' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:58:01.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:58:00 smithi132 bash[27079]: audit 2020-07-16T14:57:59.398031+0000 mgr.x (mgr.34562) 3820 : audit [DBG] from='client.27412 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:58:01.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:58:00 smithi132 bash[27079]: audit 2020-07-16T14:57:59.668895+0000 mgr.x (mgr.34562) 3821 : audit [DBG] from='client.27418 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:58:01.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:58:00 smithi132 bash[27079]: audit 2020-07-16T14:57:59.981197+0000 mon.c (mon.1) 285 : audit [DBG] from='client.? 172.21.15.132:0/1046664219' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:58:01.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:58:01 smithi188 bash[23329]: cluster 2020-07-16T14:58:00.554519+0000 mgr.x (mgr.34562) 3822 : cluster [DBG] pgmap v2380: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:58:02.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:58:01 smithi132 bash[27079]: cluster 2020-07-16T14:58:00.554519+0000 mgr.x (mgr.34562) 3822 : cluster [DBG] pgmap v2380: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:58:03.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:58:03 smithi188 bash[23329]: cluster 2020-07-16T14:58:02.554906+0000 mgr.x (mgr.34562) 3823 : cluster [DBG] pgmap v2381: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:58:04.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:58:03 smithi132 bash[27079]: cluster 2020-07-16T14:58:02.554906+0000 mgr.x (mgr.34562) 3823 : cluster [DBG] pgmap v2381: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:58:05.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:58:05 smithi188 bash[23329]: cluster 2020-07-16T14:58:04.555453+0000 mgr.x (mgr.34562) 3824 : cluster [DBG] pgmap v2382: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:58:06.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:58:05 smithi132 bash[27079]: cluster 2020-07-16T14:58:04.555453+0000 mgr.x (mgr.34562) 3824 : cluster [DBG] pgmap v2382: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:58:07.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:58:07 smithi188 bash[23329]: cluster 2020-07-16T14:58:06.555984+0000 mgr.x (mgr.34562) 3825 : cluster [DBG] pgmap v2383: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:58:08.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:58:07 smithi132 bash[27079]: cluster 2020-07-16T14:58:06.555984+0000 mgr.x (mgr.34562) 3825 : cluster [DBG] pgmap v2383: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:58:09.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:58:09 smithi188 bash[23329]: cluster 2020-07-16T14:58:08.556394+0000 mgr.x (mgr.34562) 3826 : cluster [DBG] pgmap v2384: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:58:10.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:58:09 smithi132 bash[27079]: cluster 2020-07-16T14:58:08.556394+0000 mgr.x (mgr.34562) 3826 : cluster [DBG] pgmap v2384: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:58:11.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:58:11 smithi132 bash[27079]: cluster 2020-07-16T14:58:10.556960+0000 mgr.x (mgr.34562) 3827 : cluster [DBG] pgmap v2385: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:58:11.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:58:11 smithi188 bash[23329]: cluster 2020-07-16T14:58:10.556960+0000 mgr.x (mgr.34562) 3827 : cluster [DBG] pgmap v2385: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:58:13.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:58:13 smithi188 bash[23329]: cluster 2020-07-16T14:58:12.557516+0000 mgr.x (mgr.34562) 3828 : cluster [DBG] pgmap v2386: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:58:13.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:58:13 smithi188 bash[23329]: audit 2020-07-16T14:58:13.044147+0000 mon.b (mon.2) 891 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:58:14.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:58:13 smithi132 bash[27079]: cluster 2020-07-16T14:58:12.557516+0000 mgr.x (mgr.34562) 3828 : cluster [DBG] pgmap v2386: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:58:14.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:58:13 smithi132 bash[27079]: audit 2020-07-16T14:58:13.044147+0000 mon.b (mon.2) 891 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:58:14.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:58:14 smithi188 bash[23329]: cephadm 2020-07-16T14:58:13.044909+0000 mgr.x (mgr.34562) 3829 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:58:14.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:58:14 smithi188 bash[23329]: cephadm 2020-07-16T14:58:13.045066+0000 mgr.x (mgr.34562) 3830 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:58:15.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:58:14 smithi132 bash[27079]: cephadm 2020-07-16T14:58:13.044909+0000 mgr.x (mgr.34562) 3829 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:58:15.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:58:14 smithi132 bash[27079]: cephadm 2020-07-16T14:58:13.045066+0000 mgr.x (mgr.34562) 3830 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:58:15.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:58:15 smithi188 bash[23329]: cluster 2020-07-16T14:58:14.558017+0000 mgr.x (mgr.34562) 3831 : cluster [DBG] pgmap v2387: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:58:16.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:58:15 smithi132 bash[27079]: cluster 2020-07-16T14:58:14.558017+0000 mgr.x (mgr.34562) 3831 : cluster [DBG] pgmap v2387: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:58:17.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:58:17 smithi188 bash[23329]: cluster 2020-07-16T14:58:16.558403+0000 mgr.x (mgr.34562) 3832 : cluster [DBG] pgmap v2388: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:58:18.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:58:17 smithi132 bash[27079]: cluster 2020-07-16T14:58:16.558403+0000 mgr.x (mgr.34562) 3832 : cluster [DBG] pgmap v2388: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:58:19.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:58:19 smithi188 bash[23329]: cluster 2020-07-16T14:58:18.558807+0000 mgr.x (mgr.34562) 3833 : cluster [DBG] pgmap v2389: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:58:20.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:58:19 smithi132 bash[27079]: cluster 2020-07-16T14:58:18.558807+0000 mgr.x (mgr.34562) 3833 : cluster [DBG] pgmap v2389: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:58:21.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:58:21 smithi132 bash[27079]: cluster 2020-07-16T14:58:20.559350+0000 mgr.x (mgr.34562) 3834 : cluster [DBG] pgmap v2390: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:58:21.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:58:21 smithi188 bash[23329]: cluster 2020-07-16T14:58:20.559350+0000 mgr.x (mgr.34562) 3834 : cluster [DBG] pgmap v2390: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:58:23.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:58:23 smithi188 bash[23329]: cluster 2020-07-16T14:58:22.559869+0000 mgr.x (mgr.34562) 3835 : cluster [DBG] pgmap v2391: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:58:24.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:58:23 smithi132 bash[27079]: cluster 2020-07-16T14:58:22.559869+0000 mgr.x (mgr.34562) 3835 : cluster [DBG] pgmap v2391: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:58:25.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:58:25 smithi188 bash[23329]: cluster 2020-07-16T14:58:24.560272+0000 mgr.x (mgr.34562) 3836 : cluster [DBG] pgmap v2392: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:58:26.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:58:25 smithi132 bash[27079]: cluster 2020-07-16T14:58:24.560272+0000 mgr.x (mgr.34562) 3836 : cluster [DBG] pgmap v2392: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:58:27.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:58:27 smithi188 bash[23329]: cluster 2020-07-16T14:58:26.560655+0000 mgr.x (mgr.34562) 3837 : cluster [DBG] pgmap v2393: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:58:28.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:58:27 smithi132 bash[27079]: cluster 2020-07-16T14:58:26.560655+0000 mgr.x (mgr.34562) 3837 : cluster [DBG] pgmap v2393: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:58:28.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:58:28 smithi188 bash[23329]: audit 2020-07-16T14:58:28.060994+0000 mon.b (mon.2) 892 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:58:29.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:58:28 smithi132 bash[27079]: audit 2020-07-16T14:58:28.060994+0000 mon.b (mon.2) 892 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:58:29.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:58:29 smithi188 bash[23329]: cephadm 2020-07-16T14:58:28.061710+0000 mgr.x (mgr.34562) 3838 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:58:29.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:58:29 smithi188 bash[23329]: cephadm 2020-07-16T14:58:28.061949+0000 mgr.x (mgr.34562) 3839 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:58:29.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:58:29 smithi188 bash[23329]: cluster 2020-07-16T14:58:28.561081+0000 mgr.x (mgr.34562) 3840 : cluster [DBG] pgmap v2394: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:58:30.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:58:29 smithi132 bash[27079]: cephadm 2020-07-16T14:58:28.061710+0000 mgr.x (mgr.34562) 3838 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:58:30.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:58:29 smithi132 bash[27079]: cephadm 2020-07-16T14:58:28.061949+0000 mgr.x (mgr.34562) 3839 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:58:30.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:58:29 smithi132 bash[27079]: cluster 2020-07-16T14:58:28.561081+0000 mgr.x (mgr.34562) 3840 : cluster [DBG] pgmap v2394: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:58:30.287 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:58:30.545 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:58:30.545 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (81m) 5m ago 84m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:58:30.546 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (83m) 5m ago 83m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:58:30.546 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (81m) 5m ago 87m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:58:30.546 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (81m) 5m ago 88m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:58:30.547 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 5m ago 88m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:58:30.547 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (87m) 5m ago 87m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:58:30.547 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (87m) 5m ago 87m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:58:30.548 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (84m) 5m ago 84m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:58:30.548 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (84m) 5m ago 84m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:58:30.548 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (86m) 5m ago 86m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:58:30.549 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (86m) 5m ago 86m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:58:30.549 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (86m) 5m ago 86m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:58:30.549 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (86m) 5m ago 86m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:58:30.550 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (85m) 5m ago 85m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:58:30.550 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (85m) 5m ago 85m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:58:30.550 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (85m) 5m ago 85m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:58:30.551 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (84m) 5m ago 84m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:58:30.551 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (83m) 5m ago 84m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:58:30.840 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:58:30.841 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:58:30.841 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:58:30.841 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:58:30.841 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:58:30.842 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:58:30.842 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:58:30.842 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:58:30.842 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:58:30.842 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:58:30.842 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:58:30.843 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:58:30.843 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:58:30.843 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:58:30.844 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:58:30.844 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:58:30.844 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:58:31.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:58:31 smithi132 bash[27079]: audit 2020-07-16T14:58:30.274500+0000 mgr.x (mgr.34562) 3841 : audit [DBG] from='client.27430 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:58:31.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:58:31 smithi132 bash[27079]: audit 2020-07-16T14:58:30.540655+0000 mgr.x (mgr.34562) 3842 : audit [DBG] from='client.27436 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:58:31.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:58:31 smithi132 bash[27079]: cluster 2020-07-16T14:58:30.561589+0000 mgr.x (mgr.34562) 3843 : cluster [DBG] pgmap v2395: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:58:31.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:58:31 smithi132 bash[27079]: audit 2020-07-16T14:58:30.839655+0000 mon.c (mon.1) 286 : audit [DBG] from='client.? 172.21.15.132:0/540744238' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:58:31.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:58:31 smithi188 bash[23329]: audit 2020-07-16T14:58:30.274500+0000 mgr.x (mgr.34562) 3841 : audit [DBG] from='client.27430 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:58:31.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:58:31 smithi188 bash[23329]: audit 2020-07-16T14:58:30.540655+0000 mgr.x (mgr.34562) 3842 : audit [DBG] from='client.27436 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:58:31.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:58:31 smithi188 bash[23329]: cluster 2020-07-16T14:58:30.561589+0000 mgr.x (mgr.34562) 3843 : cluster [DBG] pgmap v2395: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:58:31.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:58:31 smithi188 bash[23329]: audit 2020-07-16T14:58:30.839655+0000 mon.c (mon.1) 286 : audit [DBG] from='client.? 172.21.15.132:0/540744238' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:58:33.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:58:33 smithi188 bash[23329]: cluster 2020-07-16T14:58:32.562065+0000 mgr.x (mgr.34562) 3844 : cluster [DBG] pgmap v2396: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:58:34.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:58:33 smithi132 bash[27079]: cluster 2020-07-16T14:58:32.562065+0000 mgr.x (mgr.34562) 3844 : cluster [DBG] pgmap v2396: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:58:35.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:58:35 smithi188 bash[23329]: cluster 2020-07-16T14:58:34.562511+0000 mgr.x (mgr.34562) 3845 : cluster [DBG] pgmap v2397: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:58:36.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:58:35 smithi132 bash[27079]: cluster 2020-07-16T14:58:34.562511+0000 mgr.x (mgr.34562) 3845 : cluster [DBG] pgmap v2397: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:58:37.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:58:37 smithi188 bash[23329]: cluster 2020-07-16T14:58:36.562876+0000 mgr.x (mgr.34562) 3846 : cluster [DBG] pgmap v2398: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:58:38.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:58:37 smithi132 bash[27079]: cluster 2020-07-16T14:58:36.562876+0000 mgr.x (mgr.34562) 3846 : cluster [DBG] pgmap v2398: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:58:39.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:58:39 smithi188 bash[23329]: cluster 2020-07-16T14:58:38.563362+0000 mgr.x (mgr.34562) 3847 : cluster [DBG] pgmap v2399: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:58:40.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:58:39 smithi132 bash[27079]: cluster 2020-07-16T14:58:38.563362+0000 mgr.x (mgr.34562) 3847 : cluster [DBG] pgmap v2399: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:58:41.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:58:41 smithi132 bash[27079]: cluster 2020-07-16T14:58:40.563814+0000 mgr.x (mgr.34562) 3848 : cluster [DBG] pgmap v2400: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:58:41.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:58:41 smithi188 bash[23329]: cluster 2020-07-16T14:58:40.563814+0000 mgr.x (mgr.34562) 3848 : cluster [DBG] pgmap v2400: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:58:43.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:58:43 smithi188 bash[23329]: cluster 2020-07-16T14:58:42.564294+0000 mgr.x (mgr.34562) 3849 : cluster [DBG] pgmap v2401: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:58:44.247 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:58:43 smithi188 bash[23329]: audit 2020-07-16T14:58:43.077669+0000 mon.b (mon.2) 893 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:58:44.248 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:58:43 smithi132 bash[27079]: cluster 2020-07-16T14:58:42.564294+0000 mgr.x (mgr.34562) 3849 : cluster [DBG] pgmap v2401: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:58:44.249 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:58:43 smithi132 bash[27079]: audit 2020-07-16T14:58:43.077669+0000 mon.b (mon.2) 893 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:58:44.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:58:44 smithi188 bash[23329]: cephadm 2020-07-16T14:58:43.078444+0000 mgr.x (mgr.34562) 3850 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:58:44.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:58:44 smithi188 bash[23329]: cephadm 2020-07-16T14:58:43.078871+0000 mgr.x (mgr.34562) 3851 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:58:45.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:58:44 smithi132 bash[27079]: cephadm 2020-07-16T14:58:43.078444+0000 mgr.x (mgr.34562) 3850 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:58:45.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:58:44 smithi132 bash[27079]: cephadm 2020-07-16T14:58:43.078871+0000 mgr.x (mgr.34562) 3851 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:58:45.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:58:45 smithi188 bash[23329]: cluster 2020-07-16T14:58:44.564841+0000 mgr.x (mgr.34562) 3852 : cluster [DBG] pgmap v2402: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:58:46.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:58:45 smithi132 bash[27079]: cluster 2020-07-16T14:58:44.564841+0000 mgr.x (mgr.34562) 3852 : cluster [DBG] pgmap v2402: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:58:47.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:58:47 smithi188 bash[23329]: cluster 2020-07-16T14:58:46.565398+0000 mgr.x (mgr.34562) 3853 : cluster [DBG] pgmap v2403: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:58:48.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:58:47 smithi132 bash[27079]: cluster 2020-07-16T14:58:46.565398+0000 mgr.x (mgr.34562) 3853 : cluster [DBG] pgmap v2403: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:58:49.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:58:49 smithi188 bash[23329]: cluster 2020-07-16T14:58:48.565821+0000 mgr.x (mgr.34562) 3854 : cluster [DBG] pgmap v2404: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:58:50.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:58:49 smithi132 bash[27079]: cluster 2020-07-16T14:58:48.565821+0000 mgr.x (mgr.34562) 3854 : cluster [DBG] pgmap v2404: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:58:51.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:58:51 smithi132 bash[27079]: cluster 2020-07-16T14:58:50.566326+0000 mgr.x (mgr.34562) 3855 : cluster [DBG] pgmap v2405: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:58:51.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:58:51 smithi188 bash[23329]: cluster 2020-07-16T14:58:50.566326+0000 mgr.x (mgr.34562) 3855 : cluster [DBG] pgmap v2405: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:58:53.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:58:53 smithi188 bash[23329]: cluster 2020-07-16T14:58:52.566727+0000 mgr.x (mgr.34562) 3856 : cluster [DBG] pgmap v2406: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:58:54.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:58:53 smithi132 bash[27079]: cluster 2020-07-16T14:58:52.566727+0000 mgr.x (mgr.34562) 3856 : cluster [DBG] pgmap v2406: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:58:55.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:58:55 smithi188 bash[23329]: cluster 2020-07-16T14:58:54.567164+0000 mgr.x (mgr.34562) 3857 : cluster [DBG] pgmap v2407: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:58:56.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:58:55 smithi132 bash[27079]: cluster 2020-07-16T14:58:54.567164+0000 mgr.x (mgr.34562) 3857 : cluster [DBG] pgmap v2407: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:58:57.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:58:57 smithi188 bash[23329]: cluster 2020-07-16T14:58:56.567600+0000 mgr.x (mgr.34562) 3858 : cluster [DBG] pgmap v2408: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:58:58.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:58:57 smithi132 bash[27079]: cluster 2020-07-16T14:58:56.567600+0000 mgr.x (mgr.34562) 3858 : cluster [DBG] pgmap v2408: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:58:58.901 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:58:58 smithi132 bash[27079]: audit 2020-07-16T14:58:58.096842+0000 mon.b (mon.2) 894 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:58:58.901 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:58:58 smithi132 bash[27079]: audit 2020-07-16T14:58:58.098197+0000 mon.b (mon.2) 895 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:58:58.902 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:58:58 smithi132 bash[27079]: audit 2020-07-16T14:58:58.099389+0000 mon.b (mon.2) 896 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:58:58.902 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:58:58 smithi132 bash[27079]: audit 2020-07-16T14:58:58.100755+0000 mon.b (mon.2) 897 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:58:58.902 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:58:58 smithi132 bash[27079]: audit 2020-07-16T14:58:58.101968+0000 mon.b (mon.2) 898 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:58:58.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:58:58 smithi188 bash[23329]: audit 2020-07-16T14:58:58.096842+0000 mon.b (mon.2) 894 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:58:58.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:58:58 smithi188 bash[23329]: audit 2020-07-16T14:58:58.098197+0000 mon.b (mon.2) 895 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:58:58.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:58:58 smithi188 bash[23329]: audit 2020-07-16T14:58:58.099389+0000 mon.b (mon.2) 896 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:58:58.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:58:58 smithi188 bash[23329]: audit 2020-07-16T14:58:58.100755+0000 mon.b (mon.2) 897 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T14:58:58.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:58:58 smithi188 bash[23329]: audit 2020-07-16T14:58:58.101968+0000 mon.b (mon.2) 898 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:58:59.936 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:58:59 smithi188 bash[23329]: audit 2020-07-16T14:58:58.097204+0000 mgr.x (mgr.34562) 3859 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:58:59.942 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:58:59 smithi188 bash[23329]: audit 2020-07-16T14:58:58.098491+0000 mgr.x (mgr.34562) 3860 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:58:59.942 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:58:59 smithi188 bash[23329]: audit 2020-07-16T14:58:58.099657+0000 mgr.x (mgr.34562) 3861 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:58:59.942 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:58:59 smithi188 bash[23329]: cephadm 2020-07-16T14:58:58.100361+0000 mgr.x (mgr.34562) 3862 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:58:59.943 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:58:59 smithi188 bash[23329]: cephadm 2020-07-16T14:58:58.101565+0000 mgr.x (mgr.34562) 3863 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:58:59.943 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:58:59 smithi188 bash[23329]: cephadm 2020-07-16T14:58:58.102647+0000 mgr.x (mgr.34562) 3864 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:58:59.943 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:58:59 smithi188 bash[23329]: cephadm 2020-07-16T14:58:58.102830+0000 mgr.x (mgr.34562) 3865 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:58:59.944 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:58:59 smithi188 bash[23329]: cluster 2020-07-16T14:58:58.568036+0000 mgr.x (mgr.34562) 3866 : cluster [DBG] pgmap v2409: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:59:00.015 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:58:59 smithi132 bash[27079]: audit 2020-07-16T14:58:58.097204+0000 mgr.x (mgr.34562) 3859 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T14:59:00.015 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:58:59 smithi132 bash[27079]: audit 2020-07-16T14:58:58.098491+0000 mgr.x (mgr.34562) 3860 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T14:59:00.016 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:58:59 smithi132 bash[27079]: audit 2020-07-16T14:58:58.099657+0000 mgr.x (mgr.34562) 3861 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T14:59:00.016 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:58:59 smithi132 bash[27079]: cephadm 2020-07-16T14:58:58.100361+0000 mgr.x (mgr.34562) 3862 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T14:59:00.016 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:58:59 smithi132 bash[27079]: cephadm 2020-07-16T14:58:58.101565+0000 mgr.x (mgr.34562) 3863 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T14:59:00.016 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:58:59 smithi132 bash[27079]: cephadm 2020-07-16T14:58:58.102647+0000 mgr.x (mgr.34562) 3864 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T14:59:00.017 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:58:59 smithi132 bash[27079]: cephadm 2020-07-16T14:58:58.102830+0000 mgr.x (mgr.34562) 3865 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T14:59:00.017 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:58:59 smithi132 bash[27079]: cluster 2020-07-16T14:58:58.568036+0000 mgr.x (mgr.34562) 3866 : cluster [DBG] pgmap v2409: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:59:01.136 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:59:01.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:59:01 smithi132 bash[27079]: cluster 2020-07-16T14:59:00.568541+0000 mgr.x (mgr.34562) 3867 : cluster [DBG] pgmap v2410: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:59:01.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:59:01 smithi132 bash[27079]: audit 2020-07-16T14:59:00.899015+0000 mon.b (mon.2) 899 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:59:01.396 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:59:01.397 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (81m) 6m ago 84m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:59:01.397 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (84m) 6m ago 84m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:59:01.397 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (82m) 6m ago 87m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:59:01.397 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (81m) 6m ago 89m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:59:01.398 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 6m ago 89m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:59:01.398 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (87m) 6m ago 87m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:59:01.398 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (88m) 6m ago 88m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:59:01.398 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (85m) 6m ago 85m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:59:01.398 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (84m) 6m ago 85m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:59:01.399 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (87m) 6m ago 87m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:59:01.399 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (87m) 6m ago 87m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:59:01.399 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (86m) 6m ago 86m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:59:01.399 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (86m) 6m ago 86m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:59:01.399 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (85m) 6m ago 86m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:59:01.400 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (85m) 6m ago 85m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:59:01.400 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (85m) 6m ago 85m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:59:01.400 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (85m) 6m ago 85m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:59:01.400 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (84m) 6m ago 85m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:59:01.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:59:01 smithi188 bash[23329]: cluster 2020-07-16T14:59:00.568541+0000 mgr.x (mgr.34562) 3867 : cluster [DBG] pgmap v2410: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:59:01.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:59:01 smithi188 bash[23329]: audit 2020-07-16T14:59:00.899015+0000 mon.b (mon.2) 899 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:59:01.696 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:59:01.696 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:59:01.696 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:59:01.696 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:59:01.697 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:59:01.697 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:59:01.697 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:59:01.697 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:59:01.697 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:59:01.698 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:59:01.698 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:59:01.698 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:59:01.698 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:59:01.698 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:59:01.699 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:59:01.699 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:59:01.699 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:59:02.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:59:02 smithi132 bash[27079]: cephadm 2020-07-16T14:59:00.899591+0000 mgr.x (mgr.34562) 3868 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:59:02.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:59:02 smithi132 bash[27079]: cephadm 2020-07-16T14:59:00.899732+0000 mgr.x (mgr.34562) 3869 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:59:02.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:59:02 smithi132 bash[27079]: audit 2020-07-16T14:59:01.125147+0000 mgr.x (mgr.34562) 3870 : audit [DBG] from='client.27448 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:59:02.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:59:02 smithi132 bash[27079]: audit 2020-07-16T14:59:01.392022+0000 mgr.x (mgr.34562) 3871 : audit [DBG] from='client.27454 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:59:02.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:59:02 smithi132 bash[27079]: audit 2020-07-16T14:59:01.695036+0000 mon.c (mon.1) 287 : audit [DBG] from='client.? 172.21.15.132:0/2142096491' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:59:02.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:59:02 smithi188 bash[23329]: cephadm 2020-07-16T14:59:00.899591+0000 mgr.x (mgr.34562) 3868 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:59:02.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:59:02 smithi188 bash[23329]: cephadm 2020-07-16T14:59:00.899732+0000 mgr.x (mgr.34562) 3869 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:59:02.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:59:02 smithi188 bash[23329]: audit 2020-07-16T14:59:01.125147+0000 mgr.x (mgr.34562) 3870 : audit [DBG] from='client.27448 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:59:02.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:59:02 smithi188 bash[23329]: audit 2020-07-16T14:59:01.392022+0000 mgr.x (mgr.34562) 3871 : audit [DBG] from='client.27454 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:59:02.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:59:02 smithi188 bash[23329]: audit 2020-07-16T14:59:01.695036+0000 mon.c (mon.1) 287 : audit [DBG] from='client.? 172.21.15.132:0/2142096491' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:59:03.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:59:03 smithi132 bash[27079]: cluster 2020-07-16T14:59:02.569034+0000 mgr.x (mgr.34562) 3872 : cluster [DBG] pgmap v2411: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:59:03.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:59:03 smithi188 bash[23329]: cluster 2020-07-16T14:59:02.569034+0000 mgr.x (mgr.34562) 3872 : cluster [DBG] pgmap v2411: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:59:05.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:59:05 smithi188 bash[23329]: cluster 2020-07-16T14:59:04.569498+0000 mgr.x (mgr.34562) 3873 : cluster [DBG] pgmap v2412: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:59:06.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:59:05 smithi132 bash[27079]: cluster 2020-07-16T14:59:04.569498+0000 mgr.x (mgr.34562) 3873 : cluster [DBG] pgmap v2412: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:59:07.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:59:07 smithi188 bash[23329]: cluster 2020-07-16T14:59:06.569825+0000 mgr.x (mgr.34562) 3874 : cluster [DBG] pgmap v2413: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:59:08.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:59:07 smithi132 bash[27079]: cluster 2020-07-16T14:59:06.569825+0000 mgr.x (mgr.34562) 3874 : cluster [DBG] pgmap v2413: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:59:09.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:59:09 smithi188 bash[23329]: cluster 2020-07-16T14:59:08.570268+0000 mgr.x (mgr.34562) 3875 : cluster [DBG] pgmap v2414: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:59:10.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:59:09 smithi132 bash[27079]: cluster 2020-07-16T14:59:08.570268+0000 mgr.x (mgr.34562) 3875 : cluster [DBG] pgmap v2414: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:59:11.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:59:11 smithi132 bash[27079]: cluster 2020-07-16T14:59:10.570710+0000 mgr.x (mgr.34562) 3876 : cluster [DBG] pgmap v2415: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:59:11.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:59:11 smithi188 bash[23329]: cluster 2020-07-16T14:59:10.570710+0000 mgr.x (mgr.34562) 3876 : cluster [DBG] pgmap v2415: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:59:13.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:59:13 smithi188 bash[23329]: cluster 2020-07-16T14:59:12.571111+0000 mgr.x (mgr.34562) 3877 : cluster [DBG] pgmap v2416: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:59:14.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:59:13 smithi132 bash[27079]: cluster 2020-07-16T14:59:12.571111+0000 mgr.x (mgr.34562) 3877 : cluster [DBG] pgmap v2416: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:59:15.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:59:15 smithi188 bash[23329]: cluster 2020-07-16T14:59:14.571478+0000 mgr.x (mgr.34562) 3878 : cluster [DBG] pgmap v2417: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:59:16.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:59:15 smithi132 bash[27079]: cluster 2020-07-16T14:59:14.571478+0000 mgr.x (mgr.34562) 3878 : cluster [DBG] pgmap v2417: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:59:16.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:59:16 smithi188 bash[23329]: audit 2020-07-16T14:59:15.915411+0000 mon.b (mon.2) 900 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:59:17.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:59:16 smithi132 bash[27079]: audit 2020-07-16T14:59:15.915411+0000 mon.b (mon.2) 900 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:59:17.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:59:17 smithi188 bash[23329]: cephadm 2020-07-16T14:59:15.916201+0000 mgr.x (mgr.34562) 3879 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:59:17.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:59:17 smithi188 bash[23329]: cephadm 2020-07-16T14:59:15.916481+0000 mgr.x (mgr.34562) 3880 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:59:17.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:59:17 smithi188 bash[23329]: cluster 2020-07-16T14:59:16.571892+0000 mgr.x (mgr.34562) 3881 : cluster [DBG] pgmap v2418: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:59:18.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:59:17 smithi132 bash[27079]: cephadm 2020-07-16T14:59:15.916201+0000 mgr.x (mgr.34562) 3879 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:59:18.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:59:17 smithi132 bash[27079]: cephadm 2020-07-16T14:59:15.916481+0000 mgr.x (mgr.34562) 3880 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:59:18.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:59:17 smithi132 bash[27079]: cluster 2020-07-16T14:59:16.571892+0000 mgr.x (mgr.34562) 3881 : cluster [DBG] pgmap v2418: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:59:19.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:59:19 smithi188 bash[23329]: cluster 2020-07-16T14:59:18.572279+0000 mgr.x (mgr.34562) 3882 : cluster [DBG] pgmap v2419: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:59:20.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:59:19 smithi132 bash[27079]: cluster 2020-07-16T14:59:18.572279+0000 mgr.x (mgr.34562) 3882 : cluster [DBG] pgmap v2419: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:59:21.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:59:21 smithi132 bash[27079]: cluster 2020-07-16T14:59:20.572781+0000 mgr.x (mgr.34562) 3883 : cluster [DBG] pgmap v2420: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:59:21.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:59:21 smithi188 bash[23329]: cluster 2020-07-16T14:59:20.572781+0000 mgr.x (mgr.34562) 3883 : cluster [DBG] pgmap v2420: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:59:23.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:59:23 smithi188 bash[23329]: cluster 2020-07-16T14:59:22.573271+0000 mgr.x (mgr.34562) 3884 : cluster [DBG] pgmap v2421: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:59:24.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:59:23 smithi132 bash[27079]: cluster 2020-07-16T14:59:22.573271+0000 mgr.x (mgr.34562) 3884 : cluster [DBG] pgmap v2421: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:59:25.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:59:25 smithi188 bash[23329]: cluster 2020-07-16T14:59:24.573643+0000 mgr.x (mgr.34562) 3885 : cluster [DBG] pgmap v2422: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:59:26.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:59:25 smithi132 bash[27079]: cluster 2020-07-16T14:59:24.573643+0000 mgr.x (mgr.34562) 3885 : cluster [DBG] pgmap v2422: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:59:27.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:59:27 smithi188 bash[23329]: cluster 2020-07-16T14:59:26.574109+0000 mgr.x (mgr.34562) 3886 : cluster [DBG] pgmap v2423: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:59:28.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:59:27 smithi132 bash[27079]: cluster 2020-07-16T14:59:26.574109+0000 mgr.x (mgr.34562) 3886 : cluster [DBG] pgmap v2423: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:59:29.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:59:29 smithi188 bash[23329]: cluster 2020-07-16T14:59:28.574513+0000 mgr.x (mgr.34562) 3887 : cluster [DBG] pgmap v2424: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:59:30.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:59:29 smithi132 bash[27079]: cluster 2020-07-16T14:59:28.574513+0000 mgr.x (mgr.34562) 3887 : cluster [DBG] pgmap v2424: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:59:31.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:59:31 smithi132 bash[27079]: cluster 2020-07-16T14:59:30.574913+0000 mgr.x (mgr.34562) 3888 : cluster [DBG] pgmap v2425: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:59:31.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:59:31 smithi132 bash[27079]: audit 2020-07-16T14:59:30.932044+0000 mon.b (mon.2) 901 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:59:31.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:59:31 smithi188 bash[23329]: cluster 2020-07-16T14:59:30.574913+0000 mgr.x (mgr.34562) 3888 : cluster [DBG] pgmap v2425: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:59:31.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:59:31 smithi188 bash[23329]: audit 2020-07-16T14:59:30.932044+0000 mon.b (mon.2) 901 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:59:31.992 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T14:59:32.254 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T14:59:32.255 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (82m) 6m ago 85m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T14:59:32.255 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (85m) 6m ago 85m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T14:59:32.256 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (82m) 6m ago 88m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T14:59:32.256 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (82m) 6m ago 89m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T14:59:32.256 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 6m ago 89m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T14:59:32.257 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (88m) 6m ago 88m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T14:59:32.257 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (88m) 6m ago 88m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T14:59:32.257 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (85m) 6m ago 85m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T14:59:32.258 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (85m) 6m ago 85m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T14:59:32.258 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (87m) 6m ago 87m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T14:59:32.258 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (87m) 6m ago 87m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T14:59:32.259 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (87m) 6m ago 87m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T14:59:32.259 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (87m) 6m ago 87m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T14:59:32.259 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (86m) 6m ago 86m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T14:59:32.260 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (86m) 6m ago 86m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T14:59:32.260 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (86m) 6m ago 86m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T14:59:32.260 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (85m) 6m ago 85m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T14:59:32.261 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (84m) 6m ago 85m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T14:59:32.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:59:32 smithi132 bash[27079]: cephadm 2020-07-16T14:59:30.932790+0000 mgr.x (mgr.34562) 3889 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:59:32.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:59:32 smithi132 bash[27079]: cephadm 2020-07-16T14:59:30.932917+0000 mgr.x (mgr.34562) 3890 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:59:32.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:59:32 smithi188 bash[23329]: cephadm 2020-07-16T14:59:30.932790+0000 mgr.x (mgr.34562) 3889 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:59:32.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:59:32 smithi188 bash[23329]: cephadm 2020-07-16T14:59:30.932917+0000 mgr.x (mgr.34562) 3890 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:59:32.552 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T14:59:32.552 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T14:59:32.552 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T14:59:32.552 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T14:59:32.553 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:59:32.553 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T14:59:32.553 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T14:59:32.553 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:59:32.553 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T14:59:32.554 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T14:59:32.554 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T14:59:32.554 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T14:59:32.554 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T14:59:32.554 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T14:59:32.555 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T14:59:32.555 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T14:59:32.555 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T14:59:33.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:59:33 smithi188 bash[23329]: audit 2020-07-16T14:59:31.980825+0000 mgr.x (mgr.34562) 3891 : audit [DBG] from='client.27466 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:59:33.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:59:33 smithi188 bash[23329]: audit 2020-07-16T14:59:32.250381+0000 mgr.x (mgr.34562) 3892 : audit [DBG] from='client.27472 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:59:33.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:59:33 smithi188 bash[23329]: audit 2020-07-16T14:59:32.551181+0000 mon.c (mon.1) 288 : audit [DBG] from='client.? 172.21.15.132:0/3989459737' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:59:33.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:59:33 smithi188 bash[23329]: cluster 2020-07-16T14:59:32.575343+0000 mgr.x (mgr.34562) 3893 : cluster [DBG] pgmap v2426: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:59:33.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:59:33 smithi132 bash[27079]: audit 2020-07-16T14:59:31.980825+0000 mgr.x (mgr.34562) 3891 : audit [DBG] from='client.27466 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:59:33.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:59:33 smithi132 bash[27079]: audit 2020-07-16T14:59:32.250381+0000 mgr.x (mgr.34562) 3892 : audit [DBG] from='client.27472 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T14:59:33.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:59:33 smithi132 bash[27079]: audit 2020-07-16T14:59:32.551181+0000 mon.c (mon.1) 288 : audit [DBG] from='client.? 172.21.15.132:0/3989459737' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T14:59:33.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:59:33 smithi132 bash[27079]: cluster 2020-07-16T14:59:32.575343+0000 mgr.x (mgr.34562) 3893 : cluster [DBG] pgmap v2426: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:59:35.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:59:35 smithi188 bash[23329]: cluster 2020-07-16T14:59:34.575693+0000 mgr.x (mgr.34562) 3894 : cluster [DBG] pgmap v2427: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:59:36.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:59:35 smithi132 bash[27079]: cluster 2020-07-16T14:59:34.575693+0000 mgr.x (mgr.34562) 3894 : cluster [DBG] pgmap v2427: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:59:37.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:59:37 smithi188 bash[23329]: cluster 2020-07-16T14:59:36.576075+0000 mgr.x (mgr.34562) 3895 : cluster [DBG] pgmap v2428: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:59:38.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:59:37 smithi132 bash[27079]: cluster 2020-07-16T14:59:36.576075+0000 mgr.x (mgr.34562) 3895 : cluster [DBG] pgmap v2428: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:59:39.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:59:39 smithi188 bash[23329]: cluster 2020-07-16T14:59:38.576470+0000 mgr.x (mgr.34562) 3896 : cluster [DBG] pgmap v2429: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:59:40.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:59:39 smithi132 bash[27079]: cluster 2020-07-16T14:59:38.576470+0000 mgr.x (mgr.34562) 3896 : cluster [DBG] pgmap v2429: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:59:41.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:59:41 smithi132 bash[27079]: cluster 2020-07-16T14:59:40.576893+0000 mgr.x (mgr.34562) 3897 : cluster [DBG] pgmap v2430: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:59:41.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:59:41 smithi188 bash[23329]: cluster 2020-07-16T14:59:40.576893+0000 mgr.x (mgr.34562) 3897 : cluster [DBG] pgmap v2430: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:59:43.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:59:43 smithi188 bash[23329]: cluster 2020-07-16T14:59:42.577437+0000 mgr.x (mgr.34562) 3898 : cluster [DBG] pgmap v2431: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:59:44.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:59:43 smithi132 bash[27079]: cluster 2020-07-16T14:59:42.577437+0000 mgr.x (mgr.34562) 3898 : cluster [DBG] pgmap v2431: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:59:45.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:59:45 smithi188 bash[23329]: cluster 2020-07-16T14:59:44.577749+0000 mgr.x (mgr.34562) 3899 : cluster [DBG] pgmap v2432: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:59:46.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:59:45 smithi132 bash[27079]: cluster 2020-07-16T14:59:44.577749+0000 mgr.x (mgr.34562) 3899 : cluster [DBG] pgmap v2432: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:59:46.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:59:46 smithi188 bash[23329]: audit 2020-07-16T14:59:45.947108+0000 mon.b (mon.2) 902 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:59:47.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:59:46 smithi132 bash[27079]: audit 2020-07-16T14:59:45.947108+0000 mon.b (mon.2) 902 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T14:59:47.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:59:47 smithi188 bash[23329]: cephadm 2020-07-16T14:59:45.947788+0000 mgr.x (mgr.34562) 3900 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:59:47.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:59:47 smithi188 bash[23329]: cephadm 2020-07-16T14:59:45.948101+0000 mgr.x (mgr.34562) 3901 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:59:47.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:59:47 smithi188 bash[23329]: cluster 2020-07-16T14:59:46.578142+0000 mgr.x (mgr.34562) 3902 : cluster [DBG] pgmap v2433: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:59:48.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:59:47 smithi132 bash[27079]: cephadm 2020-07-16T14:59:45.947788+0000 mgr.x (mgr.34562) 3900 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T14:59:48.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:59:47 smithi132 bash[27079]: cephadm 2020-07-16T14:59:45.948101+0000 mgr.x (mgr.34562) 3901 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T14:59:48.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:59:47 smithi132 bash[27079]: cluster 2020-07-16T14:59:46.578142+0000 mgr.x (mgr.34562) 3902 : cluster [DBG] pgmap v2433: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:59:49.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:59:49 smithi188 bash[23329]: cluster 2020-07-16T14:59:48.578653+0000 mgr.x (mgr.34562) 3903 : cluster [DBG] pgmap v2434: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:59:50.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:59:49 smithi132 bash[27079]: cluster 2020-07-16T14:59:48.578653+0000 mgr.x (mgr.34562) 3903 : cluster [DBG] pgmap v2434: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:59:51.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:59:51 smithi188 bash[23329]: cluster 2020-07-16T14:59:50.579048+0000 mgr.x (mgr.34562) 3904 : cluster [DBG] pgmap v2435: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:59:51.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:59:51 smithi132 bash[27079]: cluster 2020-07-16T14:59:50.579048+0000 mgr.x (mgr.34562) 3904 : cluster [DBG] pgmap v2435: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:59:53.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:59:53 smithi188 bash[23329]: cluster 2020-07-16T14:59:52.579597+0000 mgr.x (mgr.34562) 3905 : cluster [DBG] pgmap v2436: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:59:54.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:59:53 smithi132 bash[27079]: cluster 2020-07-16T14:59:52.579597+0000 mgr.x (mgr.34562) 3905 : cluster [DBG] pgmap v2436: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:59:55.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:59:55 smithi188 bash[23329]: cluster 2020-07-16T14:59:54.580116+0000 mgr.x (mgr.34562) 3906 : cluster [DBG] pgmap v2437: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:59:56.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:59:55 smithi132 bash[27079]: cluster 2020-07-16T14:59:54.580116+0000 mgr.x (mgr.34562) 3906 : cluster [DBG] pgmap v2437: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:59:57.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:59:57 smithi188 bash[23329]: cluster 2020-07-16T14:59:56.580494+0000 mgr.x (mgr.34562) 3907 : cluster [DBG] pgmap v2438: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:59:58.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:59:57 smithi132 bash[27079]: cluster 2020-07-16T14:59:56.580494+0000 mgr.x (mgr.34562) 3907 : cluster [DBG] pgmap v2438: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T14:59:59.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 14:59:59 smithi188 bash[23329]: cluster 2020-07-16T14:59:58.581017+0000 mgr.x (mgr.34562) 3908 : cluster [DBG] pgmap v2439: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:00:00.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 14:59:59 smithi132 bash[27079]: cluster 2020-07-16T14:59:58.581017+0000 mgr.x (mgr.34562) 3908 : cluster [DBG] pgmap v2439: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:00:00.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:00:00 smithi188 bash[23329]: cluster 2020-07-16T15:00:00.000176+0000 mon.c (mon.1) 289 : cluster [WRN] overall HEALTH_WARN 1/3 mons down, quorum c,b 2020-07-16T15:00:01.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:00:00 smithi132 bash[27079]: cluster 2020-07-16T15:00:00.000176+0000 mon.c (mon.1) 289 : cluster [WRN] overall HEALTH_WARN 1/3 mons down, quorum c,b 2020-07-16T15:00:01.873 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:00:01 smithi132 bash[27079]: cluster 2020-07-16T15:00:00.581535+0000 mgr.x (mgr.34562) 3909 : cluster [DBG] pgmap v2440: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:00:01.873 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:00:01 smithi132 bash[27079]: audit 2020-07-16T15:00:00.966264+0000 mon.b (mon.2) 903 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:00:01.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:00:01 smithi132 bash[27079]: audit 2020-07-16T15:00:00.967704+0000 mon.b (mon.2) 904 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:00:01.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:00:01 smithi132 bash[27079]: audit 2020-07-16T15:00:00.968920+0000 mon.b (mon.2) 905 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:00:01.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:00:01 smithi132 bash[27079]: audit 2020-07-16T15:00:00.970323+0000 mon.b (mon.2) 906 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:00:01.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:00:01 smithi132 bash[27079]: audit 2020-07-16T15:00:00.971676+0000 mon.b (mon.2) 907 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:00:01.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:00:01 smithi188 bash[23329]: cluster 2020-07-16T15:00:00.581535+0000 mgr.x (mgr.34562) 3909 : cluster [DBG] pgmap v2440: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:00:01.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:00:01 smithi188 bash[23329]: audit 2020-07-16T15:00:00.966264+0000 mon.b (mon.2) 903 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:00:01.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:00:01 smithi188 bash[23329]: audit 2020-07-16T15:00:00.967704+0000 mon.b (mon.2) 904 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:00:01.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:00:01 smithi188 bash[23329]: audit 2020-07-16T15:00:00.968920+0000 mon.b (mon.2) 905 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:00:01.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:00:01 smithi188 bash[23329]: audit 2020-07-16T15:00:00.970323+0000 mon.b (mon.2) 906 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:00:01.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:00:01 smithi188 bash[23329]: audit 2020-07-16T15:00:00.971676+0000 mon.b (mon.2) 907 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:00:02.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:00:02 smithi132 bash[27079]: audit 2020-07-16T15:00:00.966673+0000 mgr.x (mgr.34562) 3910 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:00:02.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:00:02 smithi132 bash[27079]: audit 2020-07-16T15:00:00.968009+0000 mgr.x (mgr.34562) 3911 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:00:02.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:00:02 smithi132 bash[27079]: audit 2020-07-16T15:00:00.969234+0000 mgr.x (mgr.34562) 3912 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:00:02.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:00:02 smithi132 bash[27079]: cephadm 2020-07-16T15:00:00.969980+0000 mgr.x (mgr.34562) 3913 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:00:02.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:00:02 smithi132 bash[27079]: cephadm 2020-07-16T15:00:00.971164+0000 mgr.x (mgr.34562) 3914 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:00:02.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:00:02 smithi132 bash[27079]: cephadm 2020-07-16T15:00:00.972362+0000 mgr.x (mgr.34562) 3915 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:00:02.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:00:02 smithi132 bash[27079]: cephadm 2020-07-16T15:00:00.972655+0000 mgr.x (mgr.34562) 3916 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:00:02.860 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:00:02.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:00:02 smithi188 bash[23329]: audit 2020-07-16T15:00:00.966673+0000 mgr.x (mgr.34562) 3910 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:00:02.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:00:02 smithi188 bash[23329]: audit 2020-07-16T15:00:00.968009+0000 mgr.x (mgr.34562) 3911 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:00:02.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:00:02 smithi188 bash[23329]: audit 2020-07-16T15:00:00.969234+0000 mgr.x (mgr.34562) 3912 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:00:02.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:00:02 smithi188 bash[23329]: cephadm 2020-07-16T15:00:00.969980+0000 mgr.x (mgr.34562) 3913 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:00:02.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:00:02 smithi188 bash[23329]: cephadm 2020-07-16T15:00:00.971164+0000 mgr.x (mgr.34562) 3914 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:00:02.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:00:02 smithi188 bash[23329]: cephadm 2020-07-16T15:00:00.972362+0000 mgr.x (mgr.34562) 3915 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:00:02.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:00:02 smithi188 bash[23329]: cephadm 2020-07-16T15:00:00.972655+0000 mgr.x (mgr.34562) 3916 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:00:03.142 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:00:03.143 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (82m) 7m ago 85m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:00:03.143 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (85m) 7m ago 85m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:00:03.143 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (83m) 7m ago 88m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:00:03.145 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (82m) 7m ago 90m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:00:03.145 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 7m ago 90m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:00:03.145 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (88m) 7m ago 88m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:00:03.146 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (89m) 7m ago 89m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:00:03.146 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (86m) 7m ago 86m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:00:03.146 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (86m) 7m ago 86m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:00:03.146 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (88m) 7m ago 88m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:00:03.146 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (88m) 7m ago 88m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:00:03.147 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (87m) 7m ago 87m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:00:03.147 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (87m) 7m ago 87m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:00:03.147 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (87m) 7m ago 87m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:00:03.147 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (86m) 7m ago 87m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:00:03.147 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (86m) 7m ago 86m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:00:03.148 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (86m) 7m ago 86m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:00:03.148 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (85m) 7m ago 86m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:00:03.458 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:00:03.458 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:00:03.459 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:00:03.459 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:00:03.459 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:00:03.459 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:00:03.460 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:00:03.460 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:00:03.460 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:00:03.460 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:00:03.460 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:00:03.460 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:00:03.461 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:00:03.461 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:00:03.461 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:00:03.461 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:00:03.461 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:00:03.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:00:03 smithi188 bash[23329]: cluster 2020-07-16T15:00:02.582058+0000 mgr.x (mgr.34562) 3917 : cluster [DBG] pgmap v2441: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:00:03.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:00:03 smithi188 bash[23329]: audit 2020-07-16T15:00:03.457501+0000 mon.c (mon.1) 290 : audit [DBG] from='client.? 172.21.15.132:0/1620665746' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:00:04.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:00:03 smithi132 bash[27079]: cluster 2020-07-16T15:00:02.582058+0000 mgr.x (mgr.34562) 3917 : cluster [DBG] pgmap v2441: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:00:04.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:00:03 smithi132 bash[27079]: audit 2020-07-16T15:00:03.457501+0000 mon.c (mon.1) 290 : audit [DBG] from='client.? 172.21.15.132:0/1620665746' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:00:04.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:00:04 smithi188 bash[23329]: audit 2020-07-16T15:00:02.848653+0000 mgr.x (mgr.34562) 3918 : audit [DBG] from='client.27484 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:00:04.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:00:04 smithi188 bash[23329]: audit 2020-07-16T15:00:03.138350+0000 mgr.x (mgr.34562) 3919 : audit [DBG] from='client.27490 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:00:04.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:00:04 smithi188 bash[23329]: audit 2020-07-16T15:00:03.816508+0000 mon.b (mon.2) 908 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:00:05.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:00:04 smithi132 bash[27079]: audit 2020-07-16T15:00:02.848653+0000 mgr.x (mgr.34562) 3918 : audit [DBG] from='client.27484 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:00:05.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:00:04 smithi132 bash[27079]: audit 2020-07-16T15:00:03.138350+0000 mgr.x (mgr.34562) 3919 : audit [DBG] from='client.27490 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:00:05.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:00:04 smithi132 bash[27079]: audit 2020-07-16T15:00:03.816508+0000 mon.b (mon.2) 908 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:00:05.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:00:05 smithi188 bash[23329]: cephadm 2020-07-16T15:00:03.817150+0000 mgr.x (mgr.34562) 3920 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:00:05.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:00:05 smithi188 bash[23329]: cephadm 2020-07-16T15:00:03.817314+0000 mgr.x (mgr.34562) 3921 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:00:05.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:00:05 smithi188 bash[23329]: cluster 2020-07-16T15:00:04.582439+0000 mgr.x (mgr.34562) 3922 : cluster [DBG] pgmap v2442: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:00:06.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:00:05 smithi132 bash[27079]: cephadm 2020-07-16T15:00:03.817150+0000 mgr.x (mgr.34562) 3920 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:00:06.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:00:05 smithi132 bash[27079]: cephadm 2020-07-16T15:00:03.817314+0000 mgr.x (mgr.34562) 3921 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:00:06.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:00:05 smithi132 bash[27079]: cluster 2020-07-16T15:00:04.582439+0000 mgr.x (mgr.34562) 3922 : cluster [DBG] pgmap v2442: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:00:08.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:00:07 smithi132 bash[27079]: cluster 2020-07-16T15:00:06.582899+0000 mgr.x (mgr.34562) 3923 : cluster [DBG] pgmap v2443: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:00:08.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:00:07 smithi188 bash[23329]: cluster 2020-07-16T15:00:06.582899+0000 mgr.x (mgr.34562) 3923 : cluster [DBG] pgmap v2443: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:00:10.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:00:09 smithi132 bash[27079]: cluster 2020-07-16T15:00:08.583389+0000 mgr.x (mgr.34562) 3924 : cluster [DBG] pgmap v2444: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:00:10.176 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:00:09 smithi188 bash[23329]: cluster 2020-07-16T15:00:08.583389+0000 mgr.x (mgr.34562) 3924 : cluster [DBG] pgmap v2444: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:00:11.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:00:11 smithi188 bash[23329]: cluster 2020-07-16T15:00:10.583825+0000 mgr.x (mgr.34562) 3925 : cluster [DBG] pgmap v2445: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:00:11.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:00:11 smithi132 bash[27079]: cluster 2020-07-16T15:00:10.583825+0000 mgr.x (mgr.34562) 3925 : cluster [DBG] pgmap v2445: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:00:13.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:00:13 smithi188 bash[23329]: cluster 2020-07-16T15:00:12.584315+0000 mgr.x (mgr.34562) 3926 : cluster [DBG] pgmap v2446: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:00:14.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:00:13 smithi132 bash[27079]: cluster 2020-07-16T15:00:12.584315+0000 mgr.x (mgr.34562) 3926 : cluster [DBG] pgmap v2446: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:00:15.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:00:15 smithi188 bash[23329]: cluster 2020-07-16T15:00:14.584656+0000 mgr.x (mgr.34562) 3927 : cluster [DBG] pgmap v2447: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:00:16.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:00:15 smithi132 bash[27079]: cluster 2020-07-16T15:00:14.584656+0000 mgr.x (mgr.34562) 3927 : cluster [DBG] pgmap v2447: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:00:17.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:00:17 smithi188 bash[23329]: cluster 2020-07-16T15:00:16.585194+0000 mgr.x (mgr.34562) 3928 : cluster [DBG] pgmap v2448: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:00:18.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:00:17 smithi132 bash[27079]: cluster 2020-07-16T15:00:16.585194+0000 mgr.x (mgr.34562) 3928 : cluster [DBG] pgmap v2448: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:00:19.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:00:19 smithi188 bash[23329]: cluster 2020-07-16T15:00:18.585715+0000 mgr.x (mgr.34562) 3929 : cluster [DBG] pgmap v2449: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:00:19.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:00:19 smithi188 bash[23329]: audit 2020-07-16T15:00:18.833049+0000 mon.b (mon.2) 909 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:00:20.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:00:19 smithi132 bash[27079]: cluster 2020-07-16T15:00:18.585715+0000 mgr.x (mgr.34562) 3929 : cluster [DBG] pgmap v2449: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:00:20.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:00:19 smithi132 bash[27079]: audit 2020-07-16T15:00:18.833049+0000 mon.b (mon.2) 909 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:00:20.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:00:20 smithi188 bash[23329]: cephadm 2020-07-16T15:00:18.833882+0000 mgr.x (mgr.34562) 3930 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:00:20.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:00:20 smithi188 bash[23329]: cephadm 2020-07-16T15:00:18.834390+0000 mgr.x (mgr.34562) 3931 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:00:21.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:00:20 smithi132 bash[27079]: cephadm 2020-07-16T15:00:18.833882+0000 mgr.x (mgr.34562) 3930 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:00:21.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:00:20 smithi132 bash[27079]: cephadm 2020-07-16T15:00:18.834390+0000 mgr.x (mgr.34562) 3931 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:00:21.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:00:21 smithi188 bash[23329]: cluster 2020-07-16T15:00:20.586198+0000 mgr.x (mgr.34562) 3932 : cluster [DBG] pgmap v2450: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:00:22.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:00:21 smithi132 bash[27079]: cluster 2020-07-16T15:00:20.586198+0000 mgr.x (mgr.34562) 3932 : cluster [DBG] pgmap v2450: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:00:23.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:00:23 smithi188 bash[23329]: cluster 2020-07-16T15:00:22.586711+0000 mgr.x (mgr.34562) 3933 : cluster [DBG] pgmap v2451: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:00:24.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:00:23 smithi132 bash[27079]: cluster 2020-07-16T15:00:22.586711+0000 mgr.x (mgr.34562) 3933 : cluster [DBG] pgmap v2451: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:00:25.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:00:25 smithi188 bash[23329]: cluster 2020-07-16T15:00:24.587224+0000 mgr.x (mgr.34562) 3934 : cluster [DBG] pgmap v2452: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:00:26.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:00:25 smithi132 bash[27079]: cluster 2020-07-16T15:00:24.587224+0000 mgr.x (mgr.34562) 3934 : cluster [DBG] pgmap v2452: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:00:27.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:00:27 smithi188 bash[23329]: cluster 2020-07-16T15:00:26.587695+0000 mgr.x (mgr.34562) 3935 : cluster [DBG] pgmap v2453: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:00:28.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:00:27 smithi132 bash[27079]: cluster 2020-07-16T15:00:26.587695+0000 mgr.x (mgr.34562) 3935 : cluster [DBG] pgmap v2453: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:00:29.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:00:29 smithi188 bash[23329]: cluster 2020-07-16T15:00:28.588180+0000 mgr.x (mgr.34562) 3936 : cluster [DBG] pgmap v2454: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:00:30.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:00:29 smithi132 bash[27079]: cluster 2020-07-16T15:00:28.588180+0000 mgr.x (mgr.34562) 3936 : cluster [DBG] pgmap v2454: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:00:31.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:00:31 smithi188 bash[23329]: cluster 2020-07-16T15:00:30.588668+0000 mgr.x (mgr.34562) 3937 : cluster [DBG] pgmap v2455: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:00:31.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:00:31 smithi132 bash[27079]: cluster 2020-07-16T15:00:30.588668+0000 mgr.x (mgr.34562) 3937 : cluster [DBG] pgmap v2455: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:00:33.759 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:00:33.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:00:33 smithi188 bash[23329]: cluster 2020-07-16T15:00:32.589070+0000 mgr.x (mgr.34562) 3938 : cluster [DBG] pgmap v2456: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:00:34.021 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:00:34.021 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (83m) 7m ago 86m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:00:34.021 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (86m) 7m ago 86m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:00:34.022 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (83m) 7m ago 89m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:00:34.022 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (83m) 7m ago 90m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:00:34.022 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 7m ago 90m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:00:34.022 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (89m) 7m ago 89m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:00:34.023 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (89m) 7m ago 89m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:00:34.023 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (86m) 7m ago 86m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:00:34.023 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (86m) 7m ago 86m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:00:34.023 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (88m) 7m ago 88m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:00:34.023 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (88m) 7m ago 88m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:00:34.024 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (88m) 7m ago 88m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:00:34.024 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (88m) 7m ago 88m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:00:34.024 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (87m) 7m ago 87m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:00:34.024 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (87m) 7m ago 87m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:00:34.024 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (87m) 7m ago 87m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:00:34.025 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (86m) 7m ago 86m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:00:34.025 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (85m) 7m ago 86m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:00:34.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:00:33 smithi132 bash[27079]: cluster 2020-07-16T15:00:32.589070+0000 mgr.x (mgr.34562) 3938 : cluster [DBG] pgmap v2456: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:00:34.321 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:00:34.321 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:00:34.322 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:00:34.322 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:00:34.322 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:00:34.322 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:00:34.322 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:00:34.323 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:00:34.323 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:00:34.323 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:00:34.324 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:00:34.324 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:00:34.324 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:00:34.325 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:00:34.325 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:00:34.325 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:00:34.325 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:00:34.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:00:34 smithi188 bash[23329]: audit 2020-07-16T15:00:33.846845+0000 mon.b (mon.2) 910 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:00:34.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:00:34 smithi188 bash[23329]: audit 2020-07-16T15:00:34.317835+0000 mon.c (mon.1) 291 : audit [DBG] from='client.? 172.21.15.132:0/2747784256' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:00:35.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:00:34 smithi132 bash[27079]: audit 2020-07-16T15:00:33.846845+0000 mon.b (mon.2) 910 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:00:35.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:00:34 smithi132 bash[27079]: audit 2020-07-16T15:00:34.317835+0000 mon.c (mon.1) 291 : audit [DBG] from='client.? 172.21.15.132:0/2747784256' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:00:35.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:00:35 smithi188 bash[23329]: audit 2020-07-16T15:00:33.746970+0000 mgr.x (mgr.34562) 3939 : audit [DBG] from='client.27502 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:00:35.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:00:35 smithi188 bash[23329]: cephadm 2020-07-16T15:00:33.847545+0000 mgr.x (mgr.34562) 3940 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:00:35.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:00:35 smithi188 bash[23329]: cephadm 2020-07-16T15:00:33.847954+0000 mgr.x (mgr.34562) 3941 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:00:35.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:00:35 smithi188 bash[23329]: audit 2020-07-16T15:00:34.016070+0000 mgr.x (mgr.34562) 3942 : audit [DBG] from='client.27508 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:00:35.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:00:35 smithi188 bash[23329]: cluster 2020-07-16T15:00:34.589559+0000 mgr.x (mgr.34562) 3943 : cluster [DBG] pgmap v2457: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:00:36.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:00:35 smithi132 bash[27079]: audit 2020-07-16T15:00:33.746970+0000 mgr.x (mgr.34562) 3939 : audit [DBG] from='client.27502 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:00:36.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:00:35 smithi132 bash[27079]: cephadm 2020-07-16T15:00:33.847545+0000 mgr.x (mgr.34562) 3940 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:00:36.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:00:35 smithi132 bash[27079]: cephadm 2020-07-16T15:00:33.847954+0000 mgr.x (mgr.34562) 3941 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:00:36.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:00:35 smithi132 bash[27079]: audit 2020-07-16T15:00:34.016070+0000 mgr.x (mgr.34562) 3942 : audit [DBG] from='client.27508 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:00:36.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:00:35 smithi132 bash[27079]: cluster 2020-07-16T15:00:34.589559+0000 mgr.x (mgr.34562) 3943 : cluster [DBG] pgmap v2457: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:00:37.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:00:37 smithi188 bash[23329]: cluster 2020-07-16T15:00:36.590116+0000 mgr.x (mgr.34562) 3944 : cluster [DBG] pgmap v2458: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:00:38.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:00:37 smithi132 bash[27079]: cluster 2020-07-16T15:00:36.590116+0000 mgr.x (mgr.34562) 3944 : cluster [DBG] pgmap v2458: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:00:39.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:00:39 smithi188 bash[23329]: cluster 2020-07-16T15:00:38.590631+0000 mgr.x (mgr.34562) 3945 : cluster [DBG] pgmap v2459: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:00:40.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:00:39 smithi132 bash[27079]: cluster 2020-07-16T15:00:38.590631+0000 mgr.x (mgr.34562) 3945 : cluster [DBG] pgmap v2459: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:00:41.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:00:41 smithi188 bash[23329]: cluster 2020-07-16T15:00:40.591007+0000 mgr.x (mgr.34562) 3946 : cluster [DBG] pgmap v2460: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:00:41.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:00:41 smithi132 bash[27079]: cluster 2020-07-16T15:00:40.591007+0000 mgr.x (mgr.34562) 3946 : cluster [DBG] pgmap v2460: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:00:43.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:00:43 smithi188 bash[23329]: cluster 2020-07-16T15:00:42.591397+0000 mgr.x (mgr.34562) 3947 : cluster [DBG] pgmap v2461: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:00:44.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:00:43 smithi132 bash[27079]: cluster 2020-07-16T15:00:42.591397+0000 mgr.x (mgr.34562) 3947 : cluster [DBG] pgmap v2461: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:00:45.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:00:45 smithi188 bash[23329]: cluster 2020-07-16T15:00:44.591793+0000 mgr.x (mgr.34562) 3948 : cluster [DBG] pgmap v2462: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:00:46.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:00:45 smithi132 bash[27079]: cluster 2020-07-16T15:00:44.591793+0000 mgr.x (mgr.34562) 3948 : cluster [DBG] pgmap v2462: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:00:47.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:00:47 smithi188 bash[23329]: cluster 2020-07-16T15:00:46.592194+0000 mgr.x (mgr.34562) 3949 : cluster [DBG] pgmap v2463: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:00:48.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:00:47 smithi132 bash[27079]: cluster 2020-07-16T15:00:46.592194+0000 mgr.x (mgr.34562) 3949 : cluster [DBG] pgmap v2463: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:00:49.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:00:49 smithi188 bash[23329]: cluster 2020-07-16T15:00:48.592711+0000 mgr.x (mgr.34562) 3950 : cluster [DBG] pgmap v2464: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:00:49.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:00:49 smithi188 bash[23329]: audit 2020-07-16T15:00:48.863431+0000 mon.b (mon.2) 911 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:00:50.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:00:49 smithi132 bash[27079]: cluster 2020-07-16T15:00:48.592711+0000 mgr.x (mgr.34562) 3950 : cluster [DBG] pgmap v2464: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:00:50.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:00:49 smithi132 bash[27079]: audit 2020-07-16T15:00:48.863431+0000 mon.b (mon.2) 911 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:00:50.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:00:50 smithi188 bash[23329]: cephadm 2020-07-16T15:00:48.864179+0000 mgr.x (mgr.34562) 3951 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:00:50.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:00:50 smithi188 bash[23329]: cephadm 2020-07-16T15:00:48.864613+0000 mgr.x (mgr.34562) 3952 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:00:51.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:00:50 smithi132 bash[27079]: cephadm 2020-07-16T15:00:48.864179+0000 mgr.x (mgr.34562) 3951 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:00:51.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:00:50 smithi132 bash[27079]: cephadm 2020-07-16T15:00:48.864613+0000 mgr.x (mgr.34562) 3952 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:00:51.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:00:51 smithi188 bash[23329]: cluster 2020-07-16T15:00:50.593113+0000 mgr.x (mgr.34562) 3953 : cluster [DBG] pgmap v2465: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:00:52.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:00:51 smithi132 bash[27079]: cluster 2020-07-16T15:00:50.593113+0000 mgr.x (mgr.34562) 3953 : cluster [DBG] pgmap v2465: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:00:53.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:00:53 smithi188 bash[23329]: cluster 2020-07-16T15:00:52.593511+0000 mgr.x (mgr.34562) 3954 : cluster [DBG] pgmap v2466: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:00:54.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:00:53 smithi132 bash[27079]: cluster 2020-07-16T15:00:52.593511+0000 mgr.x (mgr.34562) 3954 : cluster [DBG] pgmap v2466: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:00:55.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:00:55 smithi188 bash[23329]: cluster 2020-07-16T15:00:54.593893+0000 mgr.x (mgr.34562) 3955 : cluster [DBG] pgmap v2467: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:00:56.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:00:55 smithi132 bash[27079]: cluster 2020-07-16T15:00:54.593893+0000 mgr.x (mgr.34562) 3955 : cluster [DBG] pgmap v2467: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:00:57.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:00:57 smithi188 bash[23329]: cluster 2020-07-16T15:00:56.594464+0000 mgr.x (mgr.34562) 3956 : cluster [DBG] pgmap v2468: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:00:58.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:00:57 smithi132 bash[27079]: cluster 2020-07-16T15:00:56.594464+0000 mgr.x (mgr.34562) 3956 : cluster [DBG] pgmap v2468: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:01:00.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:00:59 smithi132 bash[27079]: cluster 2020-07-16T15:00:58.594933+0000 mgr.x (mgr.34562) 3957 : cluster [DBG] pgmap v2469: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:01:00.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:00:59 smithi188 bash[23329]: cluster 2020-07-16T15:00:58.594933+0000 mgr.x (mgr.34562) 3957 : cluster [DBG] pgmap v2469: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:01:01.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:01:01 smithi188 bash[23329]: cluster 2020-07-16T15:01:00.595341+0000 mgr.x (mgr.34562) 3958 : cluster [DBG] pgmap v2470: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:01:01.483 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:01:01 smithi132 bash[27079]: cluster 2020-07-16T15:01:00.595341+0000 mgr.x (mgr.34562) 3958 : cluster [DBG] pgmap v2470: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:01:03.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:01:03 smithi188 bash[23329]: cluster 2020-07-16T15:01:02.595784+0000 mgr.x (mgr.34562) 3959 : cluster [DBG] pgmap v2471: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:01:04.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:01:03 smithi132 bash[27079]: cluster 2020-07-16T15:01:02.595784+0000 mgr.x (mgr.34562) 3959 : cluster [DBG] pgmap v2471: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:01:04.623 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:01:04.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:01:04 smithi132 bash[27079]: audit 2020-07-16T15:01:03.879359+0000 mon.b (mon.2) 912 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:01:04.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:01:04 smithi132 bash[27079]: audit 2020-07-16T15:01:03.880772+0000 mon.b (mon.2) 913 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:01:04.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:01:04 smithi132 bash[27079]: audit 2020-07-16T15:01:03.882020+0000 mon.b (mon.2) 914 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:01:04.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:01:04 smithi132 bash[27079]: audit 2020-07-16T15:01:03.883509+0000 mon.b (mon.2) 915 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:01:04.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:01:04 smithi132 bash[27079]: audit 2020-07-16T15:01:03.884843+0000 mon.b (mon.2) 916 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:01:04.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:01:04 smithi188 bash[23329]: audit 2020-07-16T15:01:03.879359+0000 mon.b (mon.2) 912 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:01:04.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:01:04 smithi188 bash[23329]: audit 2020-07-16T15:01:03.880772+0000 mon.b (mon.2) 913 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:01:04.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:01:04 smithi188 bash[23329]: audit 2020-07-16T15:01:03.882020+0000 mon.b (mon.2) 914 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:01:04.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:01:04 smithi188 bash[23329]: audit 2020-07-16T15:01:03.883509+0000 mon.b (mon.2) 915 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:01:04.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:01:04 smithi188 bash[23329]: audit 2020-07-16T15:01:03.884843+0000 mon.b (mon.2) 916 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:01:04.922 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:01:04.923 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (83m) 8m ago 86m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:01:04.923 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (86m) 8m ago 86m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:01:04.923 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (84m) 8m ago 89m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:01:04.924 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (83m) 8m ago 91m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:01:04.924 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 8m ago 91m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:01:04.924 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (89m) 8m ago 89m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:01:04.924 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (90m) 8m ago 90m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:01:04.924 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (87m) 8m ago 87m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:01:04.925 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (87m) 8m ago 87m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:01:04.925 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (89m) 8m ago 89m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:01:04.925 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (89m) 8m ago 89m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:01:04.926 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (88m) 8m ago 88m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:01:04.926 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (88m) 8m ago 88m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:01:04.926 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (88m) 8m ago 88m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:01:04.926 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (88m) 8m ago 88m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:01:04.927 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (87m) 8m ago 87m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:01:04.927 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (87m) 8m ago 87m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:01:04.927 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (86m) 8m ago 87m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:01:05.231 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:01:05.232 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:01:05.232 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:01:05.232 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:01:05.233 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:01:05.233 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:01:05.233 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:01:05.233 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:01:05.233 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:01:05.234 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:01:05.234 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:01:05.234 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:01:05.234 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:01:05.234 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:01:05.234 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:01:05.235 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:01:05.235 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:01:05.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:01:05 smithi132 bash[27079]: audit 2020-07-16T15:01:03.879734+0000 mgr.x (mgr.34562) 3960 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:01:05.782 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:01:05 smithi132 bash[27079]: audit 2020-07-16T15:01:03.881076+0000 mgr.x (mgr.34562) 3961 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:01:05.782 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:01:05 smithi132 bash[27079]: audit 2020-07-16T15:01:03.882339+0000 mgr.x (mgr.34562) 3962 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:01:05.782 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:01:05 smithi132 bash[27079]: cephadm 2020-07-16T15:01:03.883066+0000 mgr.x (mgr.34562) 3963 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:01:05.782 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:01:05 smithi132 bash[27079]: cephadm 2020-07-16T15:01:03.884312+0000 mgr.x (mgr.34562) 3964 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:01:05.783 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:01:05 smithi132 bash[27079]: cephadm 2020-07-16T15:01:03.885548+0000 mgr.x (mgr.34562) 3965 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:01:05.783 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:01:05 smithi132 bash[27079]: cephadm 2020-07-16T15:01:03.885623+0000 mgr.x (mgr.34562) 3966 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:01:05.783 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:01:05 smithi132 bash[27079]: cluster 2020-07-16T15:01:04.596155+0000 mgr.x (mgr.34562) 3967 : cluster [DBG] pgmap v2472: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:01:05.783 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:01:05 smithi132 bash[27079]: audit 2020-07-16T15:01:04.612082+0000 mgr.x (mgr.34562) 3968 : audit [DBG] from='client.27520 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:01:05.783 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:01:05 smithi132 bash[27079]: audit 2020-07-16T15:01:05.230934+0000 mon.c (mon.1) 292 : audit [DBG] from='client.? 172.21.15.132:0/2663611410' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:01:05.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:01:05 smithi188 bash[23329]: audit 2020-07-16T15:01:03.879734+0000 mgr.x (mgr.34562) 3960 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:01:05.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:01:05 smithi188 bash[23329]: audit 2020-07-16T15:01:03.881076+0000 mgr.x (mgr.34562) 3961 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:01:05.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:01:05 smithi188 bash[23329]: audit 2020-07-16T15:01:03.882339+0000 mgr.x (mgr.34562) 3962 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:01:05.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:01:05 smithi188 bash[23329]: cephadm 2020-07-16T15:01:03.883066+0000 mgr.x (mgr.34562) 3963 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:01:05.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:01:05 smithi188 bash[23329]: cephadm 2020-07-16T15:01:03.884312+0000 mgr.x (mgr.34562) 3964 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:01:05.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:01:05 smithi188 bash[23329]: cephadm 2020-07-16T15:01:03.885548+0000 mgr.x (mgr.34562) 3965 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:01:05.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:01:05 smithi188 bash[23329]: cephadm 2020-07-16T15:01:03.885623+0000 mgr.x (mgr.34562) 3966 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:01:05.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:01:05 smithi188 bash[23329]: cluster 2020-07-16T15:01:04.596155+0000 mgr.x (mgr.34562) 3967 : cluster [DBG] pgmap v2472: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:01:05.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:01:05 smithi188 bash[23329]: audit 2020-07-16T15:01:04.612082+0000 mgr.x (mgr.34562) 3968 : audit [DBG] from='client.27520 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:01:05.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:01:05 smithi188 bash[23329]: audit 2020-07-16T15:01:05.230934+0000 mon.c (mon.1) 292 : audit [DBG] from='client.? 172.21.15.132:0/2663611410' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:01:06.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:01:06 smithi188 bash[23329]: audit 2020-07-16T15:01:04.917975+0000 mgr.x (mgr.34562) 3969 : audit [DBG] from='client.27526 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:01:07.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:01:06 smithi132 bash[27079]: audit 2020-07-16T15:01:04.917975+0000 mgr.x (mgr.34562) 3969 : audit [DBG] from='client.27526 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:01:07.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:01:07 smithi188 bash[23329]: cluster 2020-07-16T15:01:06.596536+0000 mgr.x (mgr.34562) 3970 : cluster [DBG] pgmap v2473: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:01:07.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:01:07 smithi188 bash[23329]: audit 2020-07-16T15:01:06.753726+0000 mon.b (mon.2) 917 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:01:08.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:01:07 smithi132 bash[27079]: cluster 2020-07-16T15:01:06.596536+0000 mgr.x (mgr.34562) 3970 : cluster [DBG] pgmap v2473: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:01:08.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:01:07 smithi132 bash[27079]: audit 2020-07-16T15:01:06.753726+0000 mon.b (mon.2) 917 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:01:09.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:01:08 smithi132 bash[27079]: cephadm 2020-07-16T15:01:06.754337+0000 mgr.x (mgr.34562) 3971 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:01:09.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:01:08 smithi132 bash[27079]: cephadm 2020-07-16T15:01:06.754761+0000 mgr.x (mgr.34562) 3972 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:01:09.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:01:08 smithi188 bash[23329]: cephadm 2020-07-16T15:01:06.754337+0000 mgr.x (mgr.34562) 3971 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:01:09.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:01:08 smithi188 bash[23329]: cephadm 2020-07-16T15:01:06.754761+0000 mgr.x (mgr.34562) 3972 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:01:10.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:01:09 smithi132 bash[27079]: cluster 2020-07-16T15:01:08.597087+0000 mgr.x (mgr.34562) 3973 : cluster [DBG] pgmap v2474: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:01:10.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:01:09 smithi188 bash[23329]: cluster 2020-07-16T15:01:08.597087+0000 mgr.x (mgr.34562) 3973 : cluster [DBG] pgmap v2474: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:01:11.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:01:11 smithi188 bash[23329]: cluster 2020-07-16T15:01:10.597550+0000 mgr.x (mgr.34562) 3974 : cluster [DBG] pgmap v2475: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:01:11.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:01:11 smithi132 bash[27079]: cluster 2020-07-16T15:01:10.597550+0000 mgr.x (mgr.34562) 3974 : cluster [DBG] pgmap v2475: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:01:13.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:01:13 smithi188 bash[23329]: cluster 2020-07-16T15:01:12.597997+0000 mgr.x (mgr.34562) 3975 : cluster [DBG] pgmap v2476: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:01:14.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:01:13 smithi132 bash[27079]: cluster 2020-07-16T15:01:12.597997+0000 mgr.x (mgr.34562) 3975 : cluster [DBG] pgmap v2476: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:01:15.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:01:15 smithi188 bash[23329]: cluster 2020-07-16T15:01:14.598389+0000 mgr.x (mgr.34562) 3976 : cluster [DBG] pgmap v2477: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:01:16.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:01:15 smithi132 bash[27079]: cluster 2020-07-16T15:01:14.598389+0000 mgr.x (mgr.34562) 3976 : cluster [DBG] pgmap v2477: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:01:17.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:01:17 smithi188 bash[23329]: cluster 2020-07-16T15:01:16.598770+0000 mgr.x (mgr.34562) 3977 : cluster [DBG] pgmap v2478: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:01:18.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:01:17 smithi132 bash[27079]: cluster 2020-07-16T15:01:16.598770+0000 mgr.x (mgr.34562) 3977 : cluster [DBG] pgmap v2478: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:01:19.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:01:19 smithi188 bash[23329]: cluster 2020-07-16T15:01:18.599350+0000 mgr.x (mgr.34562) 3978 : cluster [DBG] pgmap v2479: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:01:20.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:01:19 smithi132 bash[27079]: cluster 2020-07-16T15:01:18.599350+0000 mgr.x (mgr.34562) 3978 : cluster [DBG] pgmap v2479: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:01:21.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:01:21 smithi188 bash[23329]: cluster 2020-07-16T15:01:20.599809+0000 mgr.x (mgr.34562) 3979 : cluster [DBG] pgmap v2480: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:01:21.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:01:21 smithi132 bash[27079]: cluster 2020-07-16T15:01:20.599809+0000 mgr.x (mgr.34562) 3979 : cluster [DBG] pgmap v2480: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:01:22.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:01:22 smithi188 bash[23329]: audit 2020-07-16T15:01:21.769872+0000 mon.b (mon.2) 918 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:01:22.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:01:22 smithi132 bash[27079]: audit 2020-07-16T15:01:21.769872+0000 mon.b (mon.2) 918 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:01:23.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:01:23 smithi188 bash[23329]: cephadm 2020-07-16T15:01:21.770629+0000 mgr.x (mgr.34562) 3980 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:01:23.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:01:23 smithi188 bash[23329]: cephadm 2020-07-16T15:01:21.770704+0000 mgr.x (mgr.34562) 3981 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:01:23.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:01:23 smithi188 bash[23329]: cluster 2020-07-16T15:01:22.600350+0000 mgr.x (mgr.34562) 3982 : cluster [DBG] pgmap v2481: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:01:23.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:01:23 smithi132 bash[27079]: cephadm 2020-07-16T15:01:21.770629+0000 mgr.x (mgr.34562) 3980 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:01:23.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:01:23 smithi132 bash[27079]: cephadm 2020-07-16T15:01:21.770704+0000 mgr.x (mgr.34562) 3981 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:01:23.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:01:23 smithi132 bash[27079]: cluster 2020-07-16T15:01:22.600350+0000 mgr.x (mgr.34562) 3982 : cluster [DBG] pgmap v2481: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:01:25.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:01:25 smithi188 bash[23329]: cluster 2020-07-16T15:01:24.600821+0000 mgr.x (mgr.34562) 3983 : cluster [DBG] pgmap v2482: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:01:26.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:01:25 smithi132 bash[27079]: cluster 2020-07-16T15:01:24.600821+0000 mgr.x (mgr.34562) 3983 : cluster [DBG] pgmap v2482: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:01:27.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:01:27 smithi188 bash[23329]: cluster 2020-07-16T15:01:26.601260+0000 mgr.x (mgr.34562) 3984 : cluster [DBG] pgmap v2483: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:01:28.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:01:27 smithi132 bash[27079]: cluster 2020-07-16T15:01:26.601260+0000 mgr.x (mgr.34562) 3984 : cluster [DBG] pgmap v2483: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:01:29.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:01:29 smithi188 bash[23329]: cluster 2020-07-16T15:01:28.601738+0000 mgr.x (mgr.34562) 3985 : cluster [DBG] pgmap v2484: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:01:30.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:01:29 smithi132 bash[27079]: cluster 2020-07-16T15:01:28.601738+0000 mgr.x (mgr.34562) 3985 : cluster [DBG] pgmap v2484: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:01:31.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:01:31 smithi188 bash[23329]: cluster 2020-07-16T15:01:30.602238+0000 mgr.x (mgr.34562) 3986 : cluster [DBG] pgmap v2485: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:01:31.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:01:31 smithi132 bash[27079]: cluster 2020-07-16T15:01:30.602238+0000 mgr.x (mgr.34562) 3986 : cluster [DBG] pgmap v2485: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:01:33.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:01:33 smithi188 bash[23329]: cluster 2020-07-16T15:01:32.602836+0000 mgr.x (mgr.34562) 3987 : cluster [DBG] pgmap v2486: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:01:34.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:01:33 smithi132 bash[27079]: cluster 2020-07-16T15:01:32.602836+0000 mgr.x (mgr.34562) 3987 : cluster [DBG] pgmap v2486: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:01:35.530 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:01:35.795 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:01:35.795 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (84m) 8m ago 87m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:01:35.795 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (87m) 8m ago 87m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:01:35.796 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (84m) 8m ago 90m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:01:35.796 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (84m) 8m ago 91m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:01:35.796 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 8m ago 92m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:01:35.796 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (90m) 8m ago 90m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:01:35.797 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (90m) 8m ago 90m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:01:35.797 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (87m) 8m ago 87m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:01:35.797 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (87m) 8m ago 87m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:01:35.797 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (89m) 8m ago 89m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:01:35.797 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (89m) 8m ago 89m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:01:35.798 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (89m) 8m ago 89m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:01:35.798 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (89m) 8m ago 89m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:01:35.798 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (88m) 8m ago 88m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:01:35.798 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (88m) 8m ago 88m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:01:35.798 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (88m) 8m ago 88m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:01:35.798 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (87m) 8m ago 87m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:01:35.799 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (86m) 8m ago 87m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:01:35.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:01:35 smithi188 bash[23329]: cluster 2020-07-16T15:01:34.603258+0000 mgr.x (mgr.34562) 3988 : cluster [DBG] pgmap v2487: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:01:36.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:01:35 smithi132 bash[27079]: cluster 2020-07-16T15:01:34.603258+0000 mgr.x (mgr.34562) 3988 : cluster [DBG] pgmap v2487: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:01:36.098 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:01:36.098 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:01:36.098 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:01:36.098 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:01:36.099 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:01:36.099 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:01:36.099 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:01:36.099 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:01:36.099 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:01:36.100 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:01:36.100 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:01:36.100 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:01:36.100 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:01:36.100 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:01:36.100 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:01:36.101 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:01:36.101 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:01:36.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:01:36 smithi188 bash[23329]: audit 2020-07-16T15:01:35.518557+0000 mgr.x (mgr.34562) 3989 : audit [DBG] from='client.27538 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:01:36.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:01:36 smithi188 bash[23329]: audit 2020-07-16T15:01:36.091763+0000 mon.c (mon.1) 293 : audit [DBG] from='client.? 172.21.15.132:0/2930117642' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:01:37.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:01:36 smithi132 bash[27079]: audit 2020-07-16T15:01:35.518557+0000 mgr.x (mgr.34562) 3989 : audit [DBG] from='client.27538 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:01:37.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:01:36 smithi132 bash[27079]: audit 2020-07-16T15:01:36.091763+0000 mon.c (mon.1) 293 : audit [DBG] from='client.? 172.21.15.132:0/2930117642' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:01:37.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:01:37 smithi188 bash[23329]: audit 2020-07-16T15:01:35.791026+0000 mgr.x (mgr.34562) 3990 : audit [DBG] from='client.27544 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:01:37.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:01:37 smithi188 bash[23329]: cluster 2020-07-16T15:01:36.603776+0000 mgr.x (mgr.34562) 3991 : cluster [DBG] pgmap v2488: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:01:37.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:01:37 smithi188 bash[23329]: audit 2020-07-16T15:01:36.786545+0000 mon.b (mon.2) 919 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:01:38.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:01:37 smithi132 bash[27079]: audit 2020-07-16T15:01:35.791026+0000 mgr.x (mgr.34562) 3990 : audit [DBG] from='client.27544 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:01:38.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:01:37 smithi132 bash[27079]: cluster 2020-07-16T15:01:36.603776+0000 mgr.x (mgr.34562) 3991 : cluster [DBG] pgmap v2488: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:01:38.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:01:37 smithi132 bash[27079]: audit 2020-07-16T15:01:36.786545+0000 mon.b (mon.2) 919 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:01:39.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:01:38 smithi132 bash[27079]: cephadm 2020-07-16T15:01:36.787233+0000 mgr.x (mgr.34562) 3992 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:01:39.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:01:38 smithi132 bash[27079]: cephadm 2020-07-16T15:01:36.787631+0000 mgr.x (mgr.34562) 3993 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:01:39.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:01:38 smithi188 bash[23329]: cephadm 2020-07-16T15:01:36.787233+0000 mgr.x (mgr.34562) 3992 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:01:39.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:01:38 smithi188 bash[23329]: cephadm 2020-07-16T15:01:36.787631+0000 mgr.x (mgr.34562) 3993 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:01:40.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:01:39 smithi132 bash[27079]: cluster 2020-07-16T15:01:38.604194+0000 mgr.x (mgr.34562) 3994 : cluster [DBG] pgmap v2489: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:01:40.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:01:39 smithi188 bash[23329]: cluster 2020-07-16T15:01:38.604194+0000 mgr.x (mgr.34562) 3994 : cluster [DBG] pgmap v2489: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:01:41.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:01:41 smithi188 bash[23329]: cluster 2020-07-16T15:01:40.604712+0000 mgr.x (mgr.34562) 3995 : cluster [DBG] pgmap v2490: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:01:41.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:01:41 smithi132 bash[27079]: cluster 2020-07-16T15:01:40.604712+0000 mgr.x (mgr.34562) 3995 : cluster [DBG] pgmap v2490: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:01:43.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:01:43 smithi188 bash[23329]: cluster 2020-07-16T15:01:42.605213+0000 mgr.x (mgr.34562) 3996 : cluster [DBG] pgmap v2491: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:01:44.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:01:43 smithi132 bash[27079]: cluster 2020-07-16T15:01:42.605213+0000 mgr.x (mgr.34562) 3996 : cluster [DBG] pgmap v2491: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:01:45.925 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:01:45 smithi188 bash[23329]: cluster 2020-07-16T15:01:44.605736+0000 mgr.x (mgr.34562) 3997 : cluster [DBG] pgmap v2492: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:01:46.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:01:45 smithi132 bash[27079]: cluster 2020-07-16T15:01:44.605736+0000 mgr.x (mgr.34562) 3997 : cluster [DBG] pgmap v2492: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:01:47.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:01:47 smithi188 bash[23329]: cluster 2020-07-16T15:01:46.606162+0000 mgr.x (mgr.34562) 3998 : cluster [DBG] pgmap v2493: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:01:48.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:01:47 smithi132 bash[27079]: cluster 2020-07-16T15:01:46.606162+0000 mgr.x (mgr.34562) 3998 : cluster [DBG] pgmap v2493: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:01:50.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:01:49 smithi132 bash[27079]: cluster 2020-07-16T15:01:48.606604+0000 mgr.x (mgr.34562) 3999 : cluster [DBG] pgmap v2494: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:01:50.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:01:49 smithi188 bash[23329]: cluster 2020-07-16T15:01:48.606604+0000 mgr.x (mgr.34562) 3999 : cluster [DBG] pgmap v2494: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:01:51.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:01:51 smithi188 bash[23329]: cluster 2020-07-16T15:01:50.606995+0000 mgr.x (mgr.34562) 4000 : cluster [DBG] pgmap v2495: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:01:51.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:01:51 smithi132 bash[27079]: cluster 2020-07-16T15:01:50.606995+0000 mgr.x (mgr.34562) 4000 : cluster [DBG] pgmap v2495: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:01:52.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:01:52 smithi188 bash[23329]: audit 2020-07-16T15:01:51.803312+0000 mon.b (mon.2) 920 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:01:52.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:01:52 smithi132 bash[27079]: audit 2020-07-16T15:01:51.803312+0000 mon.b (mon.2) 920 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:01:53.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:01:53 smithi188 bash[23329]: cephadm 2020-07-16T15:01:51.804442+0000 mgr.x (mgr.34562) 4001 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:01:53.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:01:53 smithi188 bash[23329]: cephadm 2020-07-16T15:01:51.804624+0000 mgr.x (mgr.34562) 4002 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:01:53.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:01:53 smithi188 bash[23329]: cluster 2020-07-16T15:01:52.607455+0000 mgr.x (mgr.34562) 4003 : cluster [DBG] pgmap v2496: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:01:53.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:01:53 smithi132 bash[27079]: cephadm 2020-07-16T15:01:51.804442+0000 mgr.x (mgr.34562) 4001 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:01:53.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:01:53 smithi132 bash[27079]: cephadm 2020-07-16T15:01:51.804624+0000 mgr.x (mgr.34562) 4002 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:01:53.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:01:53 smithi132 bash[27079]: cluster 2020-07-16T15:01:52.607455+0000 mgr.x (mgr.34562) 4003 : cluster [DBG] pgmap v2496: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:01:55.928 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:01:55 smithi188 bash[23329]: cluster 2020-07-16T15:01:54.607838+0000 mgr.x (mgr.34562) 4004 : cluster [DBG] pgmap v2497: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:01:56.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:01:55 smithi132 bash[27079]: cluster 2020-07-16T15:01:54.607838+0000 mgr.x (mgr.34562) 4004 : cluster [DBG] pgmap v2497: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:01:57.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:01:57 smithi188 bash[23329]: cluster 2020-07-16T15:01:56.608201+0000 mgr.x (mgr.34562) 4005 : cluster [DBG] pgmap v2498: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:01:58.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:01:57 smithi132 bash[27079]: cluster 2020-07-16T15:01:56.608201+0000 mgr.x (mgr.34562) 4005 : cluster [DBG] pgmap v2498: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:02:00.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:01:59 smithi132 bash[27079]: cluster 2020-07-16T15:01:58.608508+0000 mgr.x (mgr.34562) 4006 : cluster [DBG] pgmap v2499: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:02:00.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:01:59 smithi188 bash[23329]: cluster 2020-07-16T15:01:58.608508+0000 mgr.x (mgr.34562) 4006 : cluster [DBG] pgmap v2499: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:02:01.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:02:01 smithi188 bash[23329]: cluster 2020-07-16T15:02:00.608862+0000 mgr.x (mgr.34562) 4007 : cluster [DBG] pgmap v2500: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:02:01.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:02:01 smithi132 bash[27079]: cluster 2020-07-16T15:02:00.608862+0000 mgr.x (mgr.34562) 4007 : cluster [DBG] pgmap v2500: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:02:03.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:02:03 smithi188 bash[23329]: cluster 2020-07-16T15:02:02.609382+0000 mgr.x (mgr.34562) 4008 : cluster [DBG] pgmap v2501: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:02:04.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:02:03 smithi132 bash[27079]: cluster 2020-07-16T15:02:02.609382+0000 mgr.x (mgr.34562) 4008 : cluster [DBG] pgmap v2501: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:02:05.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:02:05 smithi188 bash[23329]: cluster 2020-07-16T15:02:04.609777+0000 mgr.x (mgr.34562) 4009 : cluster [DBG] pgmap v2502: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:02:06.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:02:05 smithi132 bash[27079]: cluster 2020-07-16T15:02:04.609777+0000 mgr.x (mgr.34562) 4009 : cluster [DBG] pgmap v2502: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:02:06.391 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:02:06.652 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:02:06.653 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (84m) 9m ago 87m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:02:06.653 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (87m) 9m ago 87m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:02:06.653 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (85m) 9m ago 90m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:02:06.653 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (84m) 9m ago 92m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:02:06.654 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 9m ago 92m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:02:06.654 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (90m) 9m ago 90m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:02:06.654 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (91m) 9m ago 91m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:02:06.654 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (88m) 9m ago 88m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:02:06.654 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (88m) 9m ago 88m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:02:06.655 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (90m) 9m ago 90m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:02:06.655 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (90m) 9m ago 90m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:02:06.655 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (89m) 9m ago 89m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:02:06.655 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (89m) 9m ago 89m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:02:06.655 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (89m) 9m ago 89m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:02:06.656 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (89m) 9m ago 89m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:02:06.656 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (88m) 9m ago 88m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:02:06.656 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (88m) 9m ago 88m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:02:06.656 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (87m) 9m ago 88m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:02:06.982 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:02:06.982 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:02:06.983 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:02:06.983 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:02:06.983 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:02:06.983 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:02:06.983 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:02:06.984 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:02:06.984 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:02:06.984 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:02:06.984 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:02:06.984 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:02:06.985 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:02:06.985 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:02:06.985 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:02:06.985 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:02:06.985 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:02:08.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:02:07 smithi132 bash[27079]: audit 2020-07-16T15:02:06.380211+0000 mgr.x (mgr.34562) 4010 : audit [DBG] from='client.27556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:02:08.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:02:07 smithi132 bash[27079]: cluster 2020-07-16T15:02:06.610243+0000 mgr.x (mgr.34562) 4011 : cluster [DBG] pgmap v2503: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:02:08.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:02:07 smithi132 bash[27079]: audit 2020-07-16T15:02:06.648078+0000 mgr.x (mgr.34562) 4012 : audit [DBG] from='client.27562 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:02:08.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:02:07 smithi132 bash[27079]: audit 2020-07-16T15:02:06.822548+0000 mon.b (mon.2) 921 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:02:08.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:02:07 smithi132 bash[27079]: audit 2020-07-16T15:02:06.823871+0000 mon.b (mon.2) 922 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:02:08.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:02:07 smithi132 bash[27079]: audit 2020-07-16T15:02:06.825085+0000 mon.b (mon.2) 923 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:02:08.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:02:07 smithi132 bash[27079]: audit 2020-07-16T15:02:06.826570+0000 mon.b (mon.2) 924 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:02:08.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:02:07 smithi132 bash[27079]: audit 2020-07-16T15:02:06.827939+0000 mon.b (mon.2) 925 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:02:08.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:02:07 smithi132 bash[27079]: audit 2020-07-16T15:02:06.972947+0000 mon.c (mon.1) 294 : audit [DBG] from='client.? 172.21.15.132:0/3745623602' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:02:08.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:02:07 smithi188 bash[23329]: audit 2020-07-16T15:02:06.380211+0000 mgr.x (mgr.34562) 4010 : audit [DBG] from='client.27556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:02:08.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:02:07 smithi188 bash[23329]: cluster 2020-07-16T15:02:06.610243+0000 mgr.x (mgr.34562) 4011 : cluster [DBG] pgmap v2503: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:02:08.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:02:07 smithi188 bash[23329]: audit 2020-07-16T15:02:06.648078+0000 mgr.x (mgr.34562) 4012 : audit [DBG] from='client.27562 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:02:08.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:02:07 smithi188 bash[23329]: audit 2020-07-16T15:02:06.822548+0000 mon.b (mon.2) 921 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:02:08.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:02:07 smithi188 bash[23329]: audit 2020-07-16T15:02:06.823871+0000 mon.b (mon.2) 922 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:02:08.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:02:07 smithi188 bash[23329]: audit 2020-07-16T15:02:06.825085+0000 mon.b (mon.2) 923 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:02:08.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:02:07 smithi188 bash[23329]: audit 2020-07-16T15:02:06.826570+0000 mon.b (mon.2) 924 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:02:08.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:02:07 smithi188 bash[23329]: audit 2020-07-16T15:02:06.827939+0000 mon.b (mon.2) 925 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:02:08.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:02:07 smithi188 bash[23329]: audit 2020-07-16T15:02:06.972947+0000 mon.c (mon.1) 294 : audit [DBG] from='client.? 172.21.15.132:0/3745623602' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:02:08.927 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:02:08 smithi132 bash[27079]: audit 2020-07-16T15:02:06.822872+0000 mgr.x (mgr.34562) 4013 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:02:08.928 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:02:08 smithi132 bash[27079]: audit 2020-07-16T15:02:06.824197+0000 mgr.x (mgr.34562) 4014 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:02:08.928 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:02:08 smithi132 bash[27079]: audit 2020-07-16T15:02:06.825396+0000 mgr.x (mgr.34562) 4015 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:02:08.928 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:02:08 smithi132 bash[27079]: cephadm 2020-07-16T15:02:06.826105+0000 mgr.x (mgr.34562) 4016 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:02:08.928 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:02:08 smithi132 bash[27079]: cephadm 2020-07-16T15:02:06.827417+0000 mgr.x (mgr.34562) 4017 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:02:08.929 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:02:08 smithi132 bash[27079]: cephadm 2020-07-16T15:02:06.828702+0000 mgr.x (mgr.34562) 4018 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:02:08.929 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:02:08 smithi132 bash[27079]: cephadm 2020-07-16T15:02:06.828894+0000 mgr.x (mgr.34562) 4019 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:02:09.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:02:08 smithi188 bash[23329]: audit 2020-07-16T15:02:06.822872+0000 mgr.x (mgr.34562) 4013 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:02:09.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:02:08 smithi188 bash[23329]: audit 2020-07-16T15:02:06.824197+0000 mgr.x (mgr.34562) 4014 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:02:09.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:02:08 smithi188 bash[23329]: audit 2020-07-16T15:02:06.825396+0000 mgr.x (mgr.34562) 4015 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:02:09.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:02:08 smithi188 bash[23329]: cephadm 2020-07-16T15:02:06.826105+0000 mgr.x (mgr.34562) 4016 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:02:09.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:02:08 smithi188 bash[23329]: cephadm 2020-07-16T15:02:06.827417+0000 mgr.x (mgr.34562) 4017 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:02:09.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:02:08 smithi188 bash[23329]: cephadm 2020-07-16T15:02:06.828702+0000 mgr.x (mgr.34562) 4018 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:02:09.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:02:08 smithi188 bash[23329]: cephadm 2020-07-16T15:02:06.828894+0000 mgr.x (mgr.34562) 4019 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:02:09.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:02:09 smithi132 bash[27079]: cluster 2020-07-16T15:02:08.610717+0000 mgr.x (mgr.34562) 4020 : cluster [DBG] pgmap v2504: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:02:09.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:02:09 smithi132 bash[27079]: audit 2020-07-16T15:02:09.463419+0000 mon.b (mon.2) 926 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:02:10.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:02:09 smithi188 bash[23329]: cluster 2020-07-16T15:02:08.610717+0000 mgr.x (mgr.34562) 4020 : cluster [DBG] pgmap v2504: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:02:10.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:02:09 smithi188 bash[23329]: audit 2020-07-16T15:02:09.463419+0000 mon.b (mon.2) 926 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:02:11.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:02:10 smithi132 bash[27079]: cephadm 2020-07-16T15:02:09.464024+0000 mgr.x (mgr.34562) 4021 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:02:11.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:02:10 smithi132 bash[27079]: cephadm 2020-07-16T15:02:09.464394+0000 mgr.x (mgr.34562) 4022 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:02:11.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:02:10 smithi188 bash[23329]: cephadm 2020-07-16T15:02:09.464024+0000 mgr.x (mgr.34562) 4021 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:02:11.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:02:10 smithi188 bash[23329]: cephadm 2020-07-16T15:02:09.464394+0000 mgr.x (mgr.34562) 4022 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:02:12.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:02:11 smithi132 bash[27079]: cluster 2020-07-16T15:02:10.611123+0000 mgr.x (mgr.34562) 4023 : cluster [DBG] pgmap v2505: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:02:12.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:02:11 smithi188 bash[23329]: cluster 2020-07-16T15:02:10.611123+0000 mgr.x (mgr.34562) 4023 : cluster [DBG] pgmap v2505: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:02:14.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:02:13 smithi132 bash[27079]: cluster 2020-07-16T15:02:12.611523+0000 mgr.x (mgr.34562) 4024 : cluster [DBG] pgmap v2506: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:02:14.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:02:13 smithi188 bash[23329]: cluster 2020-07-16T15:02:12.611523+0000 mgr.x (mgr.34562) 4024 : cluster [DBG] pgmap v2506: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:02:16.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:02:15 smithi132 bash[27079]: cluster 2020-07-16T15:02:14.611989+0000 mgr.x (mgr.34562) 4025 : cluster [DBG] pgmap v2507: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:02:16.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:02:15 smithi188 bash[23329]: cluster 2020-07-16T15:02:14.611989+0000 mgr.x (mgr.34562) 4025 : cluster [DBG] pgmap v2507: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:02:18.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:02:17 smithi132 bash[27079]: cluster 2020-07-16T15:02:16.612497+0000 mgr.x (mgr.34562) 4026 : cluster [DBG] pgmap v2508: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:02:18.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:02:17 smithi188 bash[23329]: cluster 2020-07-16T15:02:16.612497+0000 mgr.x (mgr.34562) 4026 : cluster [DBG] pgmap v2508: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:02:20.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:02:19 smithi132 bash[27079]: cluster 2020-07-16T15:02:18.612859+0000 mgr.x (mgr.34562) 4027 : cluster [DBG] pgmap v2509: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:02:20.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:02:19 smithi188 bash[23329]: cluster 2020-07-16T15:02:18.612859+0000 mgr.x (mgr.34562) 4027 : cluster [DBG] pgmap v2509: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:02:21.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:02:21 smithi188 bash[23329]: cluster 2020-07-16T15:02:20.613275+0000 mgr.x (mgr.34562) 4028 : cluster [DBG] pgmap v2510: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:02:21.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:02:21 smithi132 bash[27079]: cluster 2020-07-16T15:02:20.613275+0000 mgr.x (mgr.34562) 4028 : cluster [DBG] pgmap v2510: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:02:23.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:02:23 smithi188 bash[23329]: cluster 2020-07-16T15:02:22.613772+0000 mgr.x (mgr.34562) 4029 : cluster [DBG] pgmap v2511: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:02:24.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:02:23 smithi132 bash[27079]: cluster 2020-07-16T15:02:22.613772+0000 mgr.x (mgr.34562) 4029 : cluster [DBG] pgmap v2511: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:02:25.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:02:24 smithi132 bash[27079]: audit 2020-07-16T15:02:24.480043+0000 mon.b (mon.2) 927 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:02:25.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:02:24 smithi188 bash[23329]: audit 2020-07-16T15:02:24.480043+0000 mon.b (mon.2) 927 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:02:26.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:02:25 smithi132 bash[27079]: cephadm 2020-07-16T15:02:24.480739+0000 mgr.x (mgr.34562) 4030 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:02:26.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:02:25 smithi132 bash[27079]: cephadm 2020-07-16T15:02:24.480972+0000 mgr.x (mgr.34562) 4031 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:02:26.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:02:25 smithi132 bash[27079]: cluster 2020-07-16T15:02:24.614102+0000 mgr.x (mgr.34562) 4032 : cluster [DBG] pgmap v2512: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:02:26.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:02:25 smithi188 bash[23329]: cephadm 2020-07-16T15:02:24.480739+0000 mgr.x (mgr.34562) 4030 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:02:26.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:02:25 smithi188 bash[23329]: cephadm 2020-07-16T15:02:24.480972+0000 mgr.x (mgr.34562) 4031 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:02:26.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:02:25 smithi188 bash[23329]: cluster 2020-07-16T15:02:24.614102+0000 mgr.x (mgr.34562) 4032 : cluster [DBG] pgmap v2512: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:02:28.033 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:02:27 smithi132 bash[27079]: cluster 2020-07-16T15:02:26.614668+0000 mgr.x (mgr.34562) 4033 : cluster [DBG] pgmap v2513: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:02:28.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:02:27 smithi188 bash[23329]: cluster 2020-07-16T15:02:26.614668+0000 mgr.x (mgr.34562) 4033 : cluster [DBG] pgmap v2513: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:02:30.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:02:29 smithi132 bash[27079]: cluster 2020-07-16T15:02:28.615150+0000 mgr.x (mgr.34562) 4034 : cluster [DBG] pgmap v2514: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:02:30.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:02:29 smithi188 bash[23329]: cluster 2020-07-16T15:02:28.615150+0000 mgr.x (mgr.34562) 4034 : cluster [DBG] pgmap v2514: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:02:31.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:02:31 smithi188 bash[23329]: cluster 2020-07-16T15:02:30.615610+0000 mgr.x (mgr.34562) 4035 : cluster [DBG] pgmap v2515: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:02:31.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:02:31 smithi132 bash[27079]: cluster 2020-07-16T15:02:30.615610+0000 mgr.x (mgr.34562) 4035 : cluster [DBG] pgmap v2515: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:02:34.034 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:02:33 smithi132 bash[27079]: cluster 2020-07-16T15:02:32.616157+0000 mgr.x (mgr.34562) 4036 : cluster [DBG] pgmap v2516: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:02:34.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:02:33 smithi188 bash[23329]: cluster 2020-07-16T15:02:32.616157+0000 mgr.x (mgr.34562) 4036 : cluster [DBG] pgmap v2516: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:02:36.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:02:35 smithi132 bash[27079]: cluster 2020-07-16T15:02:34.616671+0000 mgr.x (mgr.34562) 4037 : cluster [DBG] pgmap v2517: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:02:36.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:02:35 smithi188 bash[23329]: cluster 2020-07-16T15:02:34.616671+0000 mgr.x (mgr.34562) 4037 : cluster [DBG] pgmap v2517: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:02:37.272 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:02:37.534 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:02:37.534 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (85m) 9m ago 88m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:02:37.534 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (88m) 9m ago 88m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:02:37.534 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (85m) 9m ago 91m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:02:37.535 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (85m) 9m ago 92m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:02:37.535 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 9m ago 93m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:02:37.535 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (91m) 9m ago 91m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:02:37.535 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (91m) 9m ago 91m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:02:37.536 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (88m) 9m ago 88m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:02:37.536 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (88m) 9m ago 88m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:02:37.536 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (90m) 9m ago 90m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:02:37.536 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (90m) 9m ago 90m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:02:37.536 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (90m) 9m ago 90m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:02:37.537 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (90m) 9m ago 90m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:02:37.537 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (89m) 9m ago 89m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:02:37.537 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (89m) 9m ago 89m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:02:37.537 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (89m) 9m ago 89m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:02:37.538 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (88m) 9m ago 89m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:02:37.538 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (87m) 9m ago 88m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:02:37.833 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:02:37.833 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:02:37.834 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:02:37.834 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:02:37.834 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:02:37.834 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:02:37.834 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:02:37.835 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:02:37.835 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:02:37.835 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:02:37.835 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:02:37.836 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:02:37.836 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:02:37.836 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:02:37.836 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:02:37.836 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:02:37.837 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:02:38.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:02:37 smithi132 bash[27079]: cluster 2020-07-16T15:02:36.617219+0000 mgr.x (mgr.34562) 4038 : cluster [DBG] pgmap v2518: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:02:38.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:02:37 smithi188 bash[23329]: cluster 2020-07-16T15:02:36.617219+0000 mgr.x (mgr.34562) 4038 : cluster [DBG] pgmap v2518: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:02:39.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:02:38 smithi132 bash[27079]: audit 2020-07-16T15:02:37.260754+0000 mgr.x (mgr.34562) 4039 : audit [DBG] from='client.27574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:02:39.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:02:38 smithi132 bash[27079]: audit 2020-07-16T15:02:37.529727+0000 mgr.x (mgr.34562) 4040 : audit [DBG] from='client.27580 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:02:39.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:02:38 smithi132 bash[27079]: audit 2020-07-16T15:02:37.832307+0000 mon.c (mon.1) 295 : audit [DBG] from='client.? 172.21.15.132:0/1167464731' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:02:39.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:02:38 smithi188 bash[23329]: audit 2020-07-16T15:02:37.260754+0000 mgr.x (mgr.34562) 4039 : audit [DBG] from='client.27574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:02:39.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:02:38 smithi188 bash[23329]: audit 2020-07-16T15:02:37.529727+0000 mgr.x (mgr.34562) 4040 : audit [DBG] from='client.27580 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:02:39.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:02:38 smithi188 bash[23329]: audit 2020-07-16T15:02:37.832307+0000 mon.c (mon.1) 295 : audit [DBG] from='client.? 172.21.15.132:0/1167464731' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:02:40.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:02:39 smithi132 bash[27079]: cluster 2020-07-16T15:02:38.617606+0000 mgr.x (mgr.34562) 4041 : cluster [DBG] pgmap v2519: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:02:40.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:02:39 smithi132 bash[27079]: audit 2020-07-16T15:02:39.496614+0000 mon.b (mon.2) 928 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:02:40.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:02:39 smithi188 bash[23329]: cluster 2020-07-16T15:02:38.617606+0000 mgr.x (mgr.34562) 4041 : cluster [DBG] pgmap v2519: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:02:40.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:02:39 smithi188 bash[23329]: audit 2020-07-16T15:02:39.496614+0000 mon.b (mon.2) 928 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:02:41.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:02:40 smithi132 bash[27079]: cephadm 2020-07-16T15:02:39.497389+0000 mgr.x (mgr.34562) 4042 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:02:41.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:02:40 smithi132 bash[27079]: cephadm 2020-07-16T15:02:39.497553+0000 mgr.x (mgr.34562) 4043 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:02:41.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:02:40 smithi188 bash[23329]: cephadm 2020-07-16T15:02:39.497389+0000 mgr.x (mgr.34562) 4042 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:02:41.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:02:40 smithi188 bash[23329]: cephadm 2020-07-16T15:02:39.497553+0000 mgr.x (mgr.34562) 4043 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:02:42.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:02:41 smithi132 bash[27079]: cluster 2020-07-16T15:02:40.618095+0000 mgr.x (mgr.34562) 4044 : cluster [DBG] pgmap v2520: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:02:42.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:02:41 smithi188 bash[23329]: cluster 2020-07-16T15:02:40.618095+0000 mgr.x (mgr.34562) 4044 : cluster [DBG] pgmap v2520: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:02:44.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:02:43 smithi132 bash[27079]: cluster 2020-07-16T15:02:42.618472+0000 mgr.x (mgr.34562) 4045 : cluster [DBG] pgmap v2521: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:02:44.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:02:43 smithi188 bash[23329]: cluster 2020-07-16T15:02:42.618472+0000 mgr.x (mgr.34562) 4045 : cluster [DBG] pgmap v2521: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:02:46.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:02:45 smithi132 bash[27079]: cluster 2020-07-16T15:02:44.618932+0000 mgr.x (mgr.34562) 4046 : cluster [DBG] pgmap v2522: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:02:46.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:02:45 smithi188 bash[23329]: cluster 2020-07-16T15:02:44.618932+0000 mgr.x (mgr.34562) 4046 : cluster [DBG] pgmap v2522: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:02:48.035 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:02:47 smithi132 bash[27079]: cluster 2020-07-16T15:02:46.619439+0000 mgr.x (mgr.34562) 4047 : cluster [DBG] pgmap v2523: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:02:48.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:02:47 smithi188 bash[23329]: cluster 2020-07-16T15:02:46.619439+0000 mgr.x (mgr.34562) 4047 : cluster [DBG] pgmap v2523: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:02:50.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:02:49 smithi132 bash[27079]: cluster 2020-07-16T15:02:48.619895+0000 mgr.x (mgr.34562) 4048 : cluster [DBG] pgmap v2524: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:02:50.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:02:49 smithi188 bash[23329]: cluster 2020-07-16T15:02:48.619895+0000 mgr.x (mgr.34562) 4048 : cluster [DBG] pgmap v2524: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:02:51.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:02:51 smithi188 bash[23329]: cluster 2020-07-16T15:02:50.620436+0000 mgr.x (mgr.34562) 4049 : cluster [DBG] pgmap v2525: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:02:51.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:02:51 smithi132 bash[27079]: cluster 2020-07-16T15:02:50.620436+0000 mgr.x (mgr.34562) 4049 : cluster [DBG] pgmap v2525: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:02:54.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:02:53 smithi132 bash[27079]: cluster 2020-07-16T15:02:52.620983+0000 mgr.x (mgr.34562) 4050 : cluster [DBG] pgmap v2526: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:02:54.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:02:53 smithi188 bash[23329]: cluster 2020-07-16T15:02:52.620983+0000 mgr.x (mgr.34562) 4050 : cluster [DBG] pgmap v2526: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:02:55.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:02:54 smithi132 bash[27079]: audit 2020-07-16T15:02:54.513348+0000 mon.b (mon.2) 929 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:02:55.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:02:54 smithi188 bash[23329]: audit 2020-07-16T15:02:54.513348+0000 mon.b (mon.2) 929 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:02:56.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:02:55 smithi132 bash[27079]: cephadm 2020-07-16T15:02:54.514050+0000 mgr.x (mgr.34562) 4051 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:02:56.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:02:55 smithi132 bash[27079]: cephadm 2020-07-16T15:02:54.514503+0000 mgr.x (mgr.34562) 4052 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:02:56.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:02:55 smithi132 bash[27079]: cluster 2020-07-16T15:02:54.621346+0000 mgr.x (mgr.34562) 4053 : cluster [DBG] pgmap v2527: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:02:56.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:02:55 smithi188 bash[23329]: cephadm 2020-07-16T15:02:54.514050+0000 mgr.x (mgr.34562) 4051 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:02:56.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:02:55 smithi188 bash[23329]: cephadm 2020-07-16T15:02:54.514503+0000 mgr.x (mgr.34562) 4052 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:02:56.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:02:55 smithi188 bash[23329]: cluster 2020-07-16T15:02:54.621346+0000 mgr.x (mgr.34562) 4053 : cluster [DBG] pgmap v2527: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:02:58.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:02:57 smithi132 bash[27079]: cluster 2020-07-16T15:02:56.621827+0000 mgr.x (mgr.34562) 4054 : cluster [DBG] pgmap v2528: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:02:58.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:02:57 smithi188 bash[23329]: cluster 2020-07-16T15:02:56.621827+0000 mgr.x (mgr.34562) 4054 : cluster [DBG] pgmap v2528: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:03:00.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:02:59 smithi132 bash[27079]: cluster 2020-07-16T15:02:58.622217+0000 mgr.x (mgr.34562) 4055 : cluster [DBG] pgmap v2529: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:03:00.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:02:59 smithi188 bash[23329]: cluster 2020-07-16T15:02:58.622217+0000 mgr.x (mgr.34562) 4055 : cluster [DBG] pgmap v2529: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:03:01.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:01 smithi188 bash[23329]: cluster 2020-07-16T15:03:00.622633+0000 mgr.x (mgr.34562) 4056 : cluster [DBG] pgmap v2530: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:03:01.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:01 smithi132 bash[27079]: cluster 2020-07-16T15:03:00.622633+0000 mgr.x (mgr.34562) 4056 : cluster [DBG] pgmap v2530: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:03:04.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:03 smithi132 bash[27079]: cluster 2020-07-16T15:03:02.623154+0000 mgr.x (mgr.34562) 4057 : cluster [DBG] pgmap v2531: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:03:04.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:03 smithi188 bash[23329]: cluster 2020-07-16T15:03:02.623154+0000 mgr.x (mgr.34562) 4057 : cluster [DBG] pgmap v2531: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:03:06.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:05 smithi132 bash[27079]: cluster 2020-07-16T15:03:04.623652+0000 mgr.x (mgr.34562) 4058 : cluster [DBG] pgmap v2532: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:03:06.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:05 smithi188 bash[23329]: cluster 2020-07-16T15:03:04.623652+0000 mgr.x (mgr.34562) 4058 : cluster [DBG] pgmap v2532: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:03:08.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:07 smithi132 bash[27079]: cluster 2020-07-16T15:03:06.624220+0000 mgr.x (mgr.34562) 4059 : cluster [DBG] pgmap v2533: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:03:08.132 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:03:08.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:07 smithi188 bash[23329]: cluster 2020-07-16T15:03:06.624220+0000 mgr.x (mgr.34562) 4059 : cluster [DBG] pgmap v2533: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:03:08.393 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:03:08.394 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (85m) 10m ago 88m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:03:08.394 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (88m) 10m ago 88m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:03:08.394 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (86m) 10m ago 91m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:03:08.395 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (85m) 10m ago 93m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:03:08.395 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 10m ago 93m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:03:08.395 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (91m) 10m ago 91m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:03:08.396 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (92m) 10m ago 92m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:03:08.396 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (89m) 10m ago 89m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:03:08.396 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (89m) 10m ago 89m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:03:08.397 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (91m) 10m ago 91m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:03:08.397 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (91m) 10m ago 91m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:03:08.397 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (90m) 10m ago 90m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:03:08.397 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (90m) 10m ago 90m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:03:08.398 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (90m) 10m ago 90m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:03:08.398 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (90m) 10m ago 90m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:03:08.398 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (89m) 10m ago 89m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:03:08.398 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (89m) 10m ago 89m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:03:08.398 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (88m) 10m ago 89m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:03:08.692 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:03:08.692 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:03:08.692 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:03:08.692 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:03:08.693 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:03:08.693 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:03:08.693 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:03:08.693 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:03:08.693 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:03:08.694 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:03:08.694 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:03:08.694 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:03:08.694 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:03:08.694 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:03:08.695 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:03:08.695 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:03:08.695 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:03:10.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:09 smithi132 bash[27079]: audit 2020-07-16T15:03:08.120892+0000 mgr.x (mgr.34562) 4060 : audit [DBG] from='client.27592 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:03:10.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:09 smithi132 bash[27079]: audit 2020-07-16T15:03:08.389029+0000 mgr.x (mgr.34562) 4061 : audit [DBG] from='client.27598 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:03:10.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:09 smithi132 bash[27079]: cluster 2020-07-16T15:03:08.624605+0000 mgr.x (mgr.34562) 4062 : cluster [DBG] pgmap v2534: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:03:10.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:09 smithi132 bash[27079]: audit 2020-07-16T15:03:08.691208+0000 mon.c (mon.1) 296 : audit [DBG] from='client.? 172.21.15.132:0/2967020926' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:03:10.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:09 smithi132 bash[27079]: audit 2020-07-16T15:03:09.530485+0000 mon.b (mon.2) 930 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T15:03:10.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:09 smithi132 bash[27079]: audit 2020-07-16T15:03:09.530764+0000 mon.b (mon.2) 931 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T15:03:10.118 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:09 smithi188 bash[23329]: audit 2020-07-16T15:03:08.120892+0000 mgr.x (mgr.34562) 4060 : audit [DBG] from='client.27592 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:03:10.118 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:09 smithi188 bash[23329]: audit 2020-07-16T15:03:08.389029+0000 mgr.x (mgr.34562) 4061 : audit [DBG] from='client.27598 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:03:10.119 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:09 smithi188 bash[23329]: cluster 2020-07-16T15:03:08.624605+0000 mgr.x (mgr.34562) 4062 : cluster [DBG] pgmap v2534: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:03:10.119 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:09 smithi188 bash[23329]: audit 2020-07-16T15:03:08.691208+0000 mon.c (mon.1) 296 : audit [DBG] from='client.? 172.21.15.132:0/2967020926' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:03:10.119 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:09 smithi188 bash[23329]: audit 2020-07-16T15:03:09.530485+0000 mon.b (mon.2) 930 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T15:03:10.119 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:09 smithi188 bash[23329]: audit 2020-07-16T15:03:09.530764+0000 mon.b (mon.2) 931 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T15:03:11.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:11 smithi188 bash[23329]: cluster 2020-07-16T15:03:10.624918+0000 mgr.x (mgr.34562) 4063 : cluster [DBG] pgmap v2535: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:03:11.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:11 smithi132 bash[27079]: cluster 2020-07-16T15:03:10.624918+0000 mgr.x (mgr.34562) 4063 : cluster [DBG] pgmap v2535: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:03:12.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:12 smithi188 bash[23329]: audit 2020-07-16T15:03:11.716476+0000 mon.b (mon.2) 932 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:03:11.714962\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715018\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715053\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715081\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715244\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715377\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715484\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715603\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715636\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:03:11.715711\", \"last_device_update\": \"2020-07-16T14:33:41.233618\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:54:46.820826\"}"}]: dispatch 2020-07-16T15:03:12.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:12 smithi188 bash[23329]: audit 2020-07-16T15:03:11.716917+0000 mon.c (mon.1) 297 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:03:11.714962\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715018\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715053\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715081\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715244\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715377\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715484\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715603\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715636\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:03:11.715711\", \"last_device_update\": \"2020-07-16T14:33:41.233618\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:54:46.820826\"}"}]: dispatch 2020-07-16T15:03:12.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:12 smithi188 bash[23329]: audit 2020-07-16T15:03:11.719543+0000 mon.c (mon.1) 298 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:03:11.714962\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715018\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715053\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715081\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715244\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715377\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715484\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715603\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715636\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:03:11.715711\", \"last_device_update\": \"2020-07-16T14:33:41.233618\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:54:46.820826\"}"}]': finished 2020-07-16T15:03:12.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:12 smithi132 bash[27079]: audit 2020-07-16T15:03:11.716476+0000 mon.b (mon.2) 932 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:03:11.714962\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715018\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715053\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715081\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715244\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715377\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715484\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715603\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715636\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:03:11.715711\", \"last_device_update\": \"2020-07-16T14:33:41.233618\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:54:46.820826\"}"}]: dispatch 2020-07-16T15:03:12.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:12 smithi132 bash[27079]: audit 2020-07-16T15:03:11.716917+0000 mon.c (mon.1) 297 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:03:11.714962\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715018\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715053\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715081\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715244\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715377\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715484\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715603\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715636\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:03:11.715711\", \"last_device_update\": \"2020-07-16T14:33:41.233618\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:54:46.820826\"}"}]: dispatch 2020-07-16T15:03:12.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:12 smithi132 bash[27079]: audit 2020-07-16T15:03:11.719543+0000 mon.c (mon.1) 298 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:03:11.714962\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715018\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715053\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715081\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715244\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715377\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715484\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715603\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715636\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:03:11.715711\", \"last_device_update\": \"2020-07-16T14:33:41.233618\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:54:46.820826\"}"}]': finished 2020-07-16T15:03:13.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:13 smithi132 bash[27079]: audit 2020-07-16T15:03:12.223388+0000 mon.b (mon.2) 933 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.221886\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.221954\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.221985\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222141\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222243\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222368\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222472\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222506\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222535\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:03:12.222624\", \"last_device_update\": \"2020-07-16T14:34:46.715995\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:54:46.826399\"}"}]: dispatch 2020-07-16T15:03:13.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:13 smithi132 bash[27079]: audit 2020-07-16T15:03:12.223725+0000 mon.c (mon.1) 299 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.221886\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.221954\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.221985\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222141\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222243\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222368\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222472\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222506\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222535\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:03:12.222624\", \"last_device_update\": \"2020-07-16T14:34:46.715995\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:54:46.826399\"}"}]: dispatch 2020-07-16T15:03:13.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:13 smithi132 bash[27079]: audit 2020-07-16T15:03:12.226057+0000 mon.c (mon.1) 300 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.221886\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.221954\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.221985\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222141\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222243\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222368\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222472\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222506\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222535\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:03:12.222624\", \"last_device_update\": \"2020-07-16T14:34:46.715995\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:54:46.826399\"}"}]': finished 2020-07-16T15:03:13.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:13 smithi132 bash[27079]: audit 2020-07-16T15:03:12.231498+0000 mon.b (mon.2) 934 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:03:13.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:13 smithi132 bash[27079]: audit 2020-07-16T15:03:12.231767+0000 mgr.x (mgr.34562) 4064 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:03:13.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:13 smithi132 bash[27079]: audit 2020-07-16T15:03:12.232455+0000 mon.b (mon.2) 935 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:03:13.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:13 smithi132 bash[27079]: audit 2020-07-16T15:03:12.232675+0000 mgr.x (mgr.34562) 4065 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:03:13.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:13 smithi132 bash[27079]: audit 2020-07-16T15:03:12.233258+0000 mon.b (mon.2) 936 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:03:13.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:13 smithi132 bash[27079]: audit 2020-07-16T15:03:12.233527+0000 mgr.x (mgr.34562) 4066 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:03:13.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:13 smithi132 bash[27079]: cephadm 2020-07-16T15:03:12.234060+0000 mgr.x (mgr.34562) 4067 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:03:13.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:13 smithi132 bash[27079]: audit 2020-07-16T15:03:12.234263+0000 mon.b (mon.2) 937 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:03:13.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:13 smithi132 bash[27079]: cephadm 2020-07-16T15:03:12.234837+0000 mgr.x (mgr.34562) 4068 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:03:13.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:13 smithi132 bash[27079]: audit 2020-07-16T15:03:12.235056+0000 mon.b (mon.2) 938 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:03:13.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:13 smithi132 bash[27079]: cephadm 2020-07-16T15:03:12.235521+0000 mgr.x (mgr.34562) 4069 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:03:13.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:13 smithi132 bash[27079]: cephadm 2020-07-16T15:03:12.235664+0000 mgr.x (mgr.34562) 4070 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:03:13.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:13 smithi132 bash[27079]: cluster 2020-07-16T15:03:12.625297+0000 mgr.x (mgr.34562) 4071 : cluster [DBG] pgmap v2536: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:03:13.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:13 smithi188 bash[23329]: audit 2020-07-16T15:03:12.223388+0000 mon.b (mon.2) 933 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.221886\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.221954\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.221985\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222141\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222243\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222368\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222472\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222506\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222535\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:03:12.222624\", \"last_device_update\": \"2020-07-16T14:34:46.715995\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:54:46.826399\"}"}]: dispatch 2020-07-16T15:03:13.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:13 smithi188 bash[23329]: audit 2020-07-16T15:03:12.223725+0000 mon.c (mon.1) 299 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.221886\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.221954\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.221985\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222141\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222243\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222368\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222472\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222506\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222535\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:03:12.222624\", \"last_device_update\": \"2020-07-16T14:34:46.715995\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:54:46.826399\"}"}]: dispatch 2020-07-16T15:03:13.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:13 smithi188 bash[23329]: audit 2020-07-16T15:03:12.226057+0000 mon.c (mon.1) 300 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.221886\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.221954\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.221985\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222141\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222243\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222368\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222472\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222506\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222535\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:03:12.222624\", \"last_device_update\": \"2020-07-16T14:34:46.715995\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T14:54:46.826399\"}"}]': finished 2020-07-16T15:03:13.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:13 smithi188 bash[23329]: audit 2020-07-16T15:03:12.231498+0000 mon.b (mon.2) 934 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:03:13.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:13 smithi188 bash[23329]: audit 2020-07-16T15:03:12.231767+0000 mgr.x (mgr.34562) 4064 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:03:13.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:13 smithi188 bash[23329]: audit 2020-07-16T15:03:12.232455+0000 mon.b (mon.2) 935 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:03:13.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:13 smithi188 bash[23329]: audit 2020-07-16T15:03:12.232675+0000 mgr.x (mgr.34562) 4065 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:03:13.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:13 smithi188 bash[23329]: audit 2020-07-16T15:03:12.233258+0000 mon.b (mon.2) 936 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:03:13.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:13 smithi188 bash[23329]: audit 2020-07-16T15:03:12.233527+0000 mgr.x (mgr.34562) 4066 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:03:13.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:13 smithi188 bash[23329]: cephadm 2020-07-16T15:03:12.234060+0000 mgr.x (mgr.34562) 4067 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:03:13.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:13 smithi188 bash[23329]: audit 2020-07-16T15:03:12.234263+0000 mon.b (mon.2) 937 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:03:13.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:13 smithi188 bash[23329]: cephadm 2020-07-16T15:03:12.234837+0000 mgr.x (mgr.34562) 4068 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:03:13.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:13 smithi188 bash[23329]: audit 2020-07-16T15:03:12.235056+0000 mon.b (mon.2) 938 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:03:13.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:13 smithi188 bash[23329]: cephadm 2020-07-16T15:03:12.235521+0000 mgr.x (mgr.34562) 4069 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:03:13.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:13 smithi188 bash[23329]: cephadm 2020-07-16T15:03:12.235664+0000 mgr.x (mgr.34562) 4070 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:03:13.425 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:13 smithi188 bash[23329]: cluster 2020-07-16T15:03:12.625297+0000 mgr.x (mgr.34562) 4071 : cluster [DBG] pgmap v2536: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:03:16.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:15 smithi132 bash[27079]: cluster 2020-07-16T15:03:14.625732+0000 mgr.x (mgr.34562) 4072 : cluster [DBG] pgmap v2537: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:03:16.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:15 smithi132 bash[27079]: audit 2020-07-16T15:03:14.948591+0000 mon.b (mon.2) 939 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:03:16.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:15 smithi188 bash[23329]: cluster 2020-07-16T15:03:14.625732+0000 mgr.x (mgr.34562) 4072 : cluster [DBG] pgmap v2537: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:03:16.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:15 smithi188 bash[23329]: audit 2020-07-16T15:03:14.948591+0000 mon.b (mon.2) 939 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:03:17.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:16 smithi132 bash[27079]: cephadm 2020-07-16T15:03:14.949227+0000 mgr.x (mgr.34562) 4073 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:03:17.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:16 smithi132 bash[27079]: cephadm 2020-07-16T15:03:14.949400+0000 mgr.x (mgr.34562) 4074 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:03:17.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:16 smithi188 bash[23329]: cephadm 2020-07-16T15:03:14.949227+0000 mgr.x (mgr.34562) 4073 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:03:17.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:16 smithi188 bash[23329]: cephadm 2020-07-16T15:03:14.949400+0000 mgr.x (mgr.34562) 4074 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:03:18.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:17 smithi132 bash[27079]: cluster 2020-07-16T15:03:16.626268+0000 mgr.x (mgr.34562) 4075 : cluster [DBG] pgmap v2538: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:03:18.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:17 smithi188 bash[23329]: cluster 2020-07-16T15:03:16.626268+0000 mgr.x (mgr.34562) 4075 : cluster [DBG] pgmap v2538: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:03:20.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:19 smithi132 bash[27079]: cluster 2020-07-16T15:03:18.626751+0000 mgr.x (mgr.34562) 4076 : cluster [DBG] pgmap v2539: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:03:20.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:19 smithi188 bash[23329]: cluster 2020-07-16T15:03:18.626751+0000 mgr.x (mgr.34562) 4076 : cluster [DBG] pgmap v2539: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:03:21.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:21 smithi188 bash[23329]: cluster 2020-07-16T15:03:20.627264+0000 mgr.x (mgr.34562) 4077 : cluster [DBG] pgmap v2540: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:03:21.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:21 smithi132 bash[27079]: cluster 2020-07-16T15:03:20.627264+0000 mgr.x (mgr.34562) 4077 : cluster [DBG] pgmap v2540: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:03:24.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:23 smithi132 bash[27079]: cluster 2020-07-16T15:03:22.627664+0000 mgr.x (mgr.34562) 4078 : cluster [DBG] pgmap v2541: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:03:24.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:23 smithi188 bash[23329]: cluster 2020-07-16T15:03:22.627664+0000 mgr.x (mgr.34562) 4078 : cluster [DBG] pgmap v2541: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:03:26.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:25 smithi132 bash[27079]: cluster 2020-07-16T15:03:24.628051+0000 mgr.x (mgr.34562) 4079 : cluster [DBG] pgmap v2542: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:03:26.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:25 smithi188 bash[23329]: cluster 2020-07-16T15:03:24.628051+0000 mgr.x (mgr.34562) 4079 : cluster [DBG] pgmap v2542: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:03:28.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:27 smithi132 bash[27079]: cluster 2020-07-16T15:03:26.628529+0000 mgr.x (mgr.34562) 4080 : cluster [DBG] pgmap v2543: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:03:28.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:27 smithi188 bash[23329]: cluster 2020-07-16T15:03:26.628529+0000 mgr.x (mgr.34562) 4080 : cluster [DBG] pgmap v2543: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:03:30.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:29 smithi132 bash[27079]: cluster 2020-07-16T15:03:28.628987+0000 mgr.x (mgr.34562) 4081 : cluster [DBG] pgmap v2544: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:03:30.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:29 smithi188 bash[23329]: cluster 2020-07-16T15:03:28.628987+0000 mgr.x (mgr.34562) 4081 : cluster [DBG] pgmap v2544: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:03:31.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:30 smithi132 bash[27079]: audit 2020-07-16T15:03:29.961782+0000 mon.b (mon.2) 940 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:03:31.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:30 smithi188 bash[23329]: audit 2020-07-16T15:03:29.961782+0000 mon.b (mon.2) 940 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:03:32.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:31 smithi132 bash[27079]: cephadm 2020-07-16T15:03:29.962468+0000 mgr.x (mgr.34562) 4082 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:03:32.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:31 smithi132 bash[27079]: cephadm 2020-07-16T15:03:29.962546+0000 mgr.x (mgr.34562) 4083 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:03:32.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:31 smithi132 bash[27079]: cluster 2020-07-16T15:03:30.629521+0000 mgr.x (mgr.34562) 4084 : cluster [DBG] pgmap v2545: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:03:32.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:31 smithi188 bash[23329]: cephadm 2020-07-16T15:03:29.962468+0000 mgr.x (mgr.34562) 4082 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:03:32.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:31 smithi188 bash[23329]: cephadm 2020-07-16T15:03:29.962546+0000 mgr.x (mgr.34562) 4083 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:03:32.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:31 smithi188 bash[23329]: cluster 2020-07-16T15:03:30.629521+0000 mgr.x (mgr.34562) 4084 : cluster [DBG] pgmap v2545: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:03:34.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:33 smithi132 bash[27079]: cluster 2020-07-16T15:03:32.629896+0000 mgr.x (mgr.34562) 4085 : cluster [DBG] pgmap v2546: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:03:34.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:33 smithi188 bash[23329]: cluster 2020-07-16T15:03:32.629896+0000 mgr.x (mgr.34562) 4085 : cluster [DBG] pgmap v2546: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:03:36.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:35 smithi132 bash[27079]: cluster 2020-07-16T15:03:34.630320+0000 mgr.x (mgr.34562) 4086 : cluster [DBG] pgmap v2547: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:03:36.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:35 smithi188 bash[23329]: cluster 2020-07-16T15:03:34.630320+0000 mgr.x (mgr.34562) 4086 : cluster [DBG] pgmap v2547: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:03:38.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:37 smithi132 bash[27079]: cluster 2020-07-16T15:03:36.630750+0000 mgr.x (mgr.34562) 4087 : cluster [DBG] pgmap v2548: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:03:38.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:37 smithi188 bash[23329]: cluster 2020-07-16T15:03:36.630750+0000 mgr.x (mgr.34562) 4087 : cluster [DBG] pgmap v2548: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:03:38.989 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:03:39.249 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:03:39.250 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (86m) 27s ago 89m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:03:39.250 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (89m) 27s ago 89m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:03:39.250 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (86m) 27s ago 92m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:03:39.250 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (86m) 27s ago 93m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:03:39.251 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 27s ago 94m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:03:39.251 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (92m) 27s ago 92m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:03:39.251 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (92m) 27s ago 92m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:03:39.251 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (89m) 27s ago 89m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:03:39.252 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (89m) 27s ago 89m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:03:39.252 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (91m) 27s ago 92m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:03:39.252 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (91m) 27s ago 91m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:03:39.252 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (91m) 27s ago 91m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:03:39.253 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (91m) 27s ago 91m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:03:39.253 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (90m) 27s ago 90m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:03:39.253 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (90m) 27s ago 90m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:03:39.253 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (90m) 27s ago 90m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:03:39.253 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (90m) 27s ago 90m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:03:39.254 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (88m) 27s ago 89m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:03:39.551 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:03:39.551 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:03:39.552 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:03:39.552 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:03:39.552 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:03:39.552 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:03:39.553 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:03:39.553 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:03:39.553 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:03:39.553 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:03:39.553 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:03:39.553 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:03:39.554 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:03:39.554 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:03:39.554 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:03:39.554 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:03:39.554 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:03:40.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:39 smithi132 bash[27079]: cluster 2020-07-16T15:03:38.631128+0000 mgr.x (mgr.34562) 4088 : cluster [DBG] pgmap v2549: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:03:40.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:39 smithi132 bash[27079]: audit 2020-07-16T15:03:39.550446+0000 mon.c (mon.1) 301 : audit [DBG] from='client.? 172.21.15.132:0/2660816895' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:03:40.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:39 smithi188 bash[23329]: cluster 2020-07-16T15:03:38.631128+0000 mgr.x (mgr.34562) 4088 : cluster [DBG] pgmap v2549: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:03:40.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:39 smithi188 bash[23329]: audit 2020-07-16T15:03:39.550446+0000 mon.c (mon.1) 301 : audit [DBG] from='client.? 172.21.15.132:0/2660816895' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:03:41.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:40 smithi132 bash[27079]: audit 2020-07-16T15:03:38.977416+0000 mgr.x (mgr.34562) 4089 : audit [DBG] from='client.27610 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:03:41.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:40 smithi132 bash[27079]: audit 2020-07-16T15:03:39.245301+0000 mgr.x (mgr.34562) 4090 : audit [DBG] from='client.27616 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:03:41.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:40 smithi188 bash[23329]: audit 2020-07-16T15:03:38.977416+0000 mgr.x (mgr.34562) 4089 : audit [DBG] from='client.27610 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:03:41.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:40 smithi188 bash[23329]: audit 2020-07-16T15:03:39.245301+0000 mgr.x (mgr.34562) 4090 : audit [DBG] from='client.27616 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:03:42.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:41 smithi132 bash[27079]: cluster 2020-07-16T15:03:40.631619+0000 mgr.x (mgr.34562) 4091 : cluster [DBG] pgmap v2550: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:03:42.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:41 smithi188 bash[23329]: cluster 2020-07-16T15:03:40.631619+0000 mgr.x (mgr.34562) 4091 : cluster [DBG] pgmap v2550: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:03:44.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:43 smithi132 bash[27079]: cluster 2020-07-16T15:03:42.632031+0000 mgr.x (mgr.34562) 4092 : cluster [DBG] pgmap v2551: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:03:44.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:43 smithi188 bash[23329]: cluster 2020-07-16T15:03:42.632031+0000 mgr.x (mgr.34562) 4092 : cluster [DBG] pgmap v2551: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:03:46.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:45 smithi132 bash[27079]: cluster 2020-07-16T15:03:44.632500+0000 mgr.x (mgr.34562) 4093 : cluster [DBG] pgmap v2552: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:03:46.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:45 smithi132 bash[27079]: audit 2020-07-16T15:03:44.967871+0000 mon.b (mon.2) 941 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:03:46.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:45 smithi188 bash[23329]: cluster 2020-07-16T15:03:44.632500+0000 mgr.x (mgr.34562) 4093 : cluster [DBG] pgmap v2552: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:03:46.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:45 smithi188 bash[23329]: audit 2020-07-16T15:03:44.967871+0000 mon.b (mon.2) 941 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:03:47.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:46 smithi132 bash[27079]: cephadm 2020-07-16T15:03:44.968660+0000 mgr.x (mgr.34562) 4094 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:03:47.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:46 smithi132 bash[27079]: cephadm 2020-07-16T15:03:44.968770+0000 mgr.x (mgr.34562) 4095 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:03:47.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:46 smithi188 bash[23329]: cephadm 2020-07-16T15:03:44.968660+0000 mgr.x (mgr.34562) 4094 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:03:47.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:46 smithi188 bash[23329]: cephadm 2020-07-16T15:03:44.968770+0000 mgr.x (mgr.34562) 4095 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:03:48.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:47 smithi132 bash[27079]: cluster 2020-07-16T15:03:46.633023+0000 mgr.x (mgr.34562) 4096 : cluster [DBG] pgmap v2553: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:03:48.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:47 smithi188 bash[23329]: cluster 2020-07-16T15:03:46.633023+0000 mgr.x (mgr.34562) 4096 : cluster [DBG] pgmap v2553: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:03:50.034 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:49 smithi132 bash[27079]: cluster 2020-07-16T15:03:48.633530+0000 mgr.x (mgr.34562) 4097 : cluster [DBG] pgmap v2554: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:03:50.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:49 smithi188 bash[23329]: cluster 2020-07-16T15:03:48.633530+0000 mgr.x (mgr.34562) 4097 : cluster [DBG] pgmap v2554: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:03:51.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:51 smithi188 bash[23329]: cluster 2020-07-16T15:03:50.633946+0000 mgr.x (mgr.34562) 4098 : cluster [DBG] pgmap v2555: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:03:51.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:51 smithi132 bash[27079]: cluster 2020-07-16T15:03:50.633946+0000 mgr.x (mgr.34562) 4098 : cluster [DBG] pgmap v2555: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:03:54.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:53 smithi132 bash[27079]: cluster 2020-07-16T15:03:52.634328+0000 mgr.x (mgr.34562) 4099 : cluster [DBG] pgmap v2556: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:03:54.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:53 smithi188 bash[23329]: cluster 2020-07-16T15:03:52.634328+0000 mgr.x (mgr.34562) 4099 : cluster [DBG] pgmap v2556: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:03:56.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:55 smithi132 bash[27079]: cluster 2020-07-16T15:03:54.634783+0000 mgr.x (mgr.34562) 4100 : cluster [DBG] pgmap v2557: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:03:56.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:55 smithi188 bash[23329]: cluster 2020-07-16T15:03:54.634783+0000 mgr.x (mgr.34562) 4100 : cluster [DBG] pgmap v2557: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:03:58.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:57 smithi132 bash[27079]: cluster 2020-07-16T15:03:56.635156+0000 mgr.x (mgr.34562) 4101 : cluster [DBG] pgmap v2558: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:03:58.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:57 smithi188 bash[23329]: cluster 2020-07-16T15:03:56.635156+0000 mgr.x (mgr.34562) 4101 : cluster [DBG] pgmap v2558: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:04:00.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:03:59 smithi132 bash[27079]: cluster 2020-07-16T15:03:58.635571+0000 mgr.x (mgr.34562) 4102 : cluster [DBG] pgmap v2559: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:04:00.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:03:59 smithi188 bash[23329]: cluster 2020-07-16T15:03:58.635571+0000 mgr.x (mgr.34562) 4102 : cluster [DBG] pgmap v2559: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:04:01.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:00 smithi132 bash[27079]: audit 2020-07-16T15:03:59.984434+0000 mon.b (mon.2) 942 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:04:01.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:00 smithi188 bash[23329]: audit 2020-07-16T15:03:59.984434+0000 mon.b (mon.2) 942 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:04:02.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:01 smithi132 bash[27079]: cephadm 2020-07-16T15:03:59.985144+0000 mgr.x (mgr.34562) 4103 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:04:02.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:01 smithi132 bash[27079]: cephadm 2020-07-16T15:03:59.985221+0000 mgr.x (mgr.34562) 4104 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:04:02.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:01 smithi132 bash[27079]: cluster 2020-07-16T15:04:00.635970+0000 mgr.x (mgr.34562) 4105 : cluster [DBG] pgmap v2560: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:04:02.152 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:01 smithi188 bash[23329]: cephadm 2020-07-16T15:03:59.985144+0000 mgr.x (mgr.34562) 4103 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:04:02.153 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:01 smithi188 bash[23329]: cephadm 2020-07-16T15:03:59.985221+0000 mgr.x (mgr.34562) 4104 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:04:02.153 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:01 smithi188 bash[23329]: cluster 2020-07-16T15:04:00.635970+0000 mgr.x (mgr.34562) 4105 : cluster [DBG] pgmap v2560: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:04:04.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:03 smithi132 bash[27079]: cluster 2020-07-16T15:04:02.636476+0000 mgr.x (mgr.34562) 4106 : cluster [DBG] pgmap v2561: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:04:04.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:03 smithi188 bash[23329]: cluster 2020-07-16T15:04:02.636476+0000 mgr.x (mgr.34562) 4106 : cluster [DBG] pgmap v2561: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:04:06.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:05 smithi132 bash[27079]: cluster 2020-07-16T15:04:04.636939+0000 mgr.x (mgr.34562) 4107 : cluster [DBG] pgmap v2562: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:04:06.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:05 smithi188 bash[23329]: cluster 2020-07-16T15:04:04.636939+0000 mgr.x (mgr.34562) 4107 : cluster [DBG] pgmap v2562: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:04:08.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:07 smithi132 bash[27079]: cluster 2020-07-16T15:04:06.637382+0000 mgr.x (mgr.34562) 4108 : cluster [DBG] pgmap v2563: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:04:08.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:07 smithi188 bash[23329]: cluster 2020-07-16T15:04:06.637382+0000 mgr.x (mgr.34562) 4108 : cluster [DBG] pgmap v2563: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:04:09.869 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:04:10.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:09 smithi132 bash[27079]: cluster 2020-07-16T15:04:08.637885+0000 mgr.x (mgr.34562) 4109 : cluster [DBG] pgmap v2564: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:04:10.131 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:04:10.132 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (86m) 58s ago 89m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:04:10.132 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (89m) 57s ago 89m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:04:10.132 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (87m) 57s ago 92m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:04:10.133 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (86m) 58s ago 94m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:04:10.133 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 58s ago 94m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:04:10.133 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (92m) 57s ago 92m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:04:10.134 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (93m) 58s ago 93m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:04:10.134 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (90m) 58s ago 90m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:04:10.134 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (90m) 57s ago 90m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:04:10.135 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (92m) 58s ago 92m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:04:10.135 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (92m) 58s ago 92m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:04:10.135 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (91m) 58s ago 91m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:04:10.136 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (91m) 58s ago 91m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:04:10.136 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (91m) 57s ago 91m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:04:10.136 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (91m) 57s ago 91m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:04:10.136 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (90m) 57s ago 90m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:04:10.137 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (90m) 57s ago 90m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:04:10.137 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (89m) 57s ago 90m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:04:10.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:09 smithi188 bash[23329]: cluster 2020-07-16T15:04:08.637885+0000 mgr.x (mgr.34562) 4109 : cluster [DBG] pgmap v2564: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:04:10.426 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:04:10.427 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:04:10.427 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:04:10.427 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:04:10.428 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:04:10.428 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:04:10.428 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:04:10.428 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:04:10.429 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:04:10.429 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:04:10.429 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:04:10.429 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:04:10.429 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:04:10.430 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:04:10.430 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:04:10.430 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:04:10.430 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:04:11.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:11 smithi188 bash[23329]: audit 2020-07-16T15:04:09.857510+0000 mgr.x (mgr.34562) 4110 : audit [DBG] from='client.27628 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:04:11.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:11 smithi188 bash[23329]: audit 2020-07-16T15:04:10.127151+0000 mgr.x (mgr.34562) 4111 : audit [DBG] from='client.27634 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:04:11.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:11 smithi188 bash[23329]: audit 2020-07-16T15:04:10.425794+0000 mon.c (mon.1) 302 : audit [DBG] from='client.? 172.21.15.132:0/3183800389' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:04:11.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:11 smithi188 bash[23329]: cluster 2020-07-16T15:04:10.638214+0000 mgr.x (mgr.34562) 4112 : cluster [DBG] pgmap v2565: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:04:11.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:11 smithi132 bash[27079]: audit 2020-07-16T15:04:09.857510+0000 mgr.x (mgr.34562) 4110 : audit [DBG] from='client.27628 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:04:11.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:11 smithi132 bash[27079]: audit 2020-07-16T15:04:10.127151+0000 mgr.x (mgr.34562) 4111 : audit [DBG] from='client.27634 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:04:11.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:11 smithi132 bash[27079]: audit 2020-07-16T15:04:10.425794+0000 mon.c (mon.1) 302 : audit [DBG] from='client.? 172.21.15.132:0/3183800389' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:04:11.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:11 smithi132 bash[27079]: cluster 2020-07-16T15:04:10.638214+0000 mgr.x (mgr.34562) 4112 : cluster [DBG] pgmap v2565: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:04:14.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:13 smithi132 bash[27079]: cluster 2020-07-16T15:04:12.638751+0000 mgr.x (mgr.34562) 4113 : cluster [DBG] pgmap v2566: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:04:14.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:13 smithi188 bash[23329]: cluster 2020-07-16T15:04:12.638751+0000 mgr.x (mgr.34562) 4113 : cluster [DBG] pgmap v2566: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:04:16.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:15 smithi132 bash[27079]: cluster 2020-07-16T15:04:14.639198+0000 mgr.x (mgr.34562) 4114 : cluster [DBG] pgmap v2567: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:04:16.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:15 smithi132 bash[27079]: audit 2020-07-16T15:04:15.001487+0000 mon.b (mon.2) 943 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T15:04:16.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:15 smithi188 bash[23329]: cluster 2020-07-16T15:04:14.639198+0000 mgr.x (mgr.34562) 4114 : cluster [DBG] pgmap v2567: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:04:16.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:15 smithi188 bash[23329]: audit 2020-07-16T15:04:15.001487+0000 mon.b (mon.2) 943 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T15:04:18.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:17 smithi132 bash[27079]: cluster 2020-07-16T15:04:16.639568+0000 mgr.x (mgr.34562) 4115 : cluster [DBG] pgmap v2568: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:04:18.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:17 smithi188 bash[23329]: cluster 2020-07-16T15:04:16.639568+0000 mgr.x (mgr.34562) 4115 : cluster [DBG] pgmap v2568: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:04:18.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:18 smithi132 bash[27079]: audit 2020-07-16T15:04:17.837385+0000 mon.b (mon.2) 944 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T15:04:18.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:18 smithi132 bash[27079]: audit 2020-07-16T15:04:18.043472+0000 mon.b (mon.2) 945 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:03:11.714962\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715018\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715053\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715081\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715244\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715377\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715484\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715603\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715636\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:03:11.715711\", \"last_device_update\": \"2020-07-16T15:04:18.042470\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:54:46.820826\"}"}]: dispatch 2020-07-16T15:04:18.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:18 smithi132 bash[27079]: audit 2020-07-16T15:04:18.043936+0000 mon.c (mon.1) 303 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:03:11.714962\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715018\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715053\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715081\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715244\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715377\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715484\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715603\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715636\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:03:11.715711\", \"last_device_update\": \"2020-07-16T15:04:18.042470\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:54:46.820826\"}"}]: dispatch 2020-07-16T15:04:18.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:18 smithi132 bash[27079]: audit 2020-07-16T15:04:18.046601+0000 mon.c (mon.1) 304 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:03:11.714962\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715018\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715053\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715081\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715244\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715377\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715484\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715603\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715636\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:03:11.715711\", \"last_device_update\": \"2020-07-16T15:04:18.042470\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:54:46.820826\"}"}]': finished 2020-07-16T15:04:18.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:18 smithi132 bash[27079]: audit 2020-07-16T15:04:18.049952+0000 mon.b (mon.2) 946 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:04:18.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:18 smithi132 bash[27079]: audit 2020-07-16T15:04:18.051302+0000 mon.b (mon.2) 947 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:04:18.782 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:18 smithi132 bash[27079]: audit 2020-07-16T15:04:18.052477+0000 mon.b (mon.2) 948 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:04:18.782 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:18 smithi132 bash[27079]: audit 2020-07-16T15:04:18.054024+0000 mon.b (mon.2) 949 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:04:18.782 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:18 smithi132 bash[27079]: audit 2020-07-16T15:04:18.055177+0000 mon.b (mon.2) 950 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:04:19.072 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:18 smithi188 bash[23329]: audit 2020-07-16T15:04:17.837385+0000 mon.b (mon.2) 944 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T15:04:19.073 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:18 smithi188 bash[23329]: audit 2020-07-16T15:04:18.043472+0000 mon.b (mon.2) 945 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:03:11.714962\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715018\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715053\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715081\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715244\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715377\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715484\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715603\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715636\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:03:11.715711\", \"last_device_update\": \"2020-07-16T15:04:18.042470\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:54:46.820826\"}"}]: dispatch 2020-07-16T15:04:19.073 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:18 smithi188 bash[23329]: audit 2020-07-16T15:04:18.043936+0000 mon.c (mon.1) 303 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:03:11.714962\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715018\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715053\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715081\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715244\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715377\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715484\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715603\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715636\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:03:11.715711\", \"last_device_update\": \"2020-07-16T15:04:18.042470\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:54:46.820826\"}"}]: dispatch 2020-07-16T15:04:19.073 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:18 smithi188 bash[23329]: audit 2020-07-16T15:04:18.046601+0000 mon.c (mon.1) 304 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:03:11.714962\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715018\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715053\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715081\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715244\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715377\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715484\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715603\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715636\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:03:11.715711\", \"last_device_update\": \"2020-07-16T15:04:18.042470\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T14:54:46.820826\"}"}]': finished 2020-07-16T15:04:19.074 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:18 smithi188 bash[23329]: audit 2020-07-16T15:04:18.049952+0000 mon.b (mon.2) 946 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:04:19.074 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:18 smithi188 bash[23329]: audit 2020-07-16T15:04:18.051302+0000 mon.b (mon.2) 947 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:04:19.074 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:18 smithi188 bash[23329]: audit 2020-07-16T15:04:18.052477+0000 mon.b (mon.2) 948 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:04:19.074 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:18 smithi188 bash[23329]: audit 2020-07-16T15:04:18.054024+0000 mon.b (mon.2) 949 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:04:19.075 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:18 smithi188 bash[23329]: audit 2020-07-16T15:04:18.055177+0000 mon.b (mon.2) 950 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:04:20.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:19 smithi132 bash[27079]: audit 2020-07-16T15:04:18.050317+0000 mgr.x (mgr.34562) 4116 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:04:20.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:19 smithi132 bash[27079]: audit 2020-07-16T15:04:18.051635+0000 mgr.x (mgr.34562) 4117 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:04:20.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:19 smithi132 bash[27079]: audit 2020-07-16T15:04:18.052813+0000 mgr.x (mgr.34562) 4118 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:04:20.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:19 smithi132 bash[27079]: cephadm 2020-07-16T15:04:18.053582+0000 mgr.x (mgr.34562) 4119 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:04:20.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:19 smithi132 bash[27079]: cephadm 2020-07-16T15:04:18.054817+0000 mgr.x (mgr.34562) 4120 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:04:20.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:19 smithi132 bash[27079]: cephadm 2020-07-16T15:04:18.055903+0000 mgr.x (mgr.34562) 4121 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:04:20.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:19 smithi132 bash[27079]: cephadm 2020-07-16T15:04:18.056143+0000 mgr.x (mgr.34562) 4122 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:04:20.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:19 smithi132 bash[27079]: cluster 2020-07-16T15:04:18.639966+0000 mgr.x (mgr.34562) 4123 : cluster [DBG] pgmap v2569: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:04:20.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:19 smithi188 bash[23329]: audit 2020-07-16T15:04:18.050317+0000 mgr.x (mgr.34562) 4116 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:04:20.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:19 smithi188 bash[23329]: audit 2020-07-16T15:04:18.051635+0000 mgr.x (mgr.34562) 4117 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:04:20.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:19 smithi188 bash[23329]: audit 2020-07-16T15:04:18.052813+0000 mgr.x (mgr.34562) 4118 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:04:20.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:19 smithi188 bash[23329]: cephadm 2020-07-16T15:04:18.053582+0000 mgr.x (mgr.34562) 4119 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:04:20.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:19 smithi188 bash[23329]: cephadm 2020-07-16T15:04:18.054817+0000 mgr.x (mgr.34562) 4120 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:04:20.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:19 smithi188 bash[23329]: cephadm 2020-07-16T15:04:18.055903+0000 mgr.x (mgr.34562) 4121 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:04:20.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:19 smithi188 bash[23329]: cephadm 2020-07-16T15:04:18.056143+0000 mgr.x (mgr.34562) 4122 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:04:20.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:19 smithi188 bash[23329]: cluster 2020-07-16T15:04:18.639966+0000 mgr.x (mgr.34562) 4123 : cluster [DBG] pgmap v2569: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:04:21.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:21 smithi188 bash[23329]: cluster 2020-07-16T15:04:20.640473+0000 mgr.x (mgr.34562) 4124 : cluster [DBG] pgmap v2570: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:04:21.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:21 smithi188 bash[23329]: audit 2020-07-16T15:04:20.690913+0000 mon.b (mon.2) 951 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:04:21.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:21 smithi188 bash[23329]: cephadm 2020-07-16T15:04:20.691546+0000 mgr.x (mgr.34562) 4125 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:04:21.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:21 smithi188 bash[23329]: cephadm 2020-07-16T15:04:20.691937+0000 mgr.x (mgr.34562) 4126 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:04:21.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:21 smithi132 bash[27079]: cluster 2020-07-16T15:04:20.640473+0000 mgr.x (mgr.34562) 4124 : cluster [DBG] pgmap v2570: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:04:21.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:21 smithi132 bash[27079]: audit 2020-07-16T15:04:20.690913+0000 mon.b (mon.2) 951 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:04:21.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:21 smithi132 bash[27079]: cephadm 2020-07-16T15:04:20.691546+0000 mgr.x (mgr.34562) 4125 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:04:21.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:21 smithi132 bash[27079]: cephadm 2020-07-16T15:04:20.691937+0000 mgr.x (mgr.34562) 4126 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:04:24.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:23 smithi132 bash[27079]: cluster 2020-07-16T15:04:22.640917+0000 mgr.x (mgr.34562) 4127 : cluster [DBG] pgmap v2571: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:04:24.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:23 smithi188 bash[23329]: cluster 2020-07-16T15:04:22.640917+0000 mgr.x (mgr.34562) 4127 : cluster [DBG] pgmap v2571: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:04:26.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:25 smithi132 bash[27079]: cluster 2020-07-16T15:04:24.641275+0000 mgr.x (mgr.34562) 4128 : cluster [DBG] pgmap v2572: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:04:26.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:25 smithi188 bash[23329]: cluster 2020-07-16T15:04:24.641275+0000 mgr.x (mgr.34562) 4128 : cluster [DBG] pgmap v2572: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:04:28.037 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:27 smithi132 bash[27079]: cluster 2020-07-16T15:04:26.641724+0000 mgr.x (mgr.34562) 4129 : cluster [DBG] pgmap v2573: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:04:28.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:27 smithi188 bash[23329]: cluster 2020-07-16T15:04:26.641724+0000 mgr.x (mgr.34562) 4129 : cluster [DBG] pgmap v2573: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:04:30.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:29 smithi132 bash[27079]: cluster 2020-07-16T15:04:28.642048+0000 mgr.x (mgr.34562) 4130 : cluster [DBG] pgmap v2574: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:04:30.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:29 smithi188 bash[23329]: cluster 2020-07-16T15:04:28.642048+0000 mgr.x (mgr.34562) 4130 : cluster [DBG] pgmap v2574: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:04:31.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:31 smithi188 bash[23329]: cluster 2020-07-16T15:04:30.642432+0000 mgr.x (mgr.34562) 4131 : cluster [DBG] pgmap v2575: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:04:31.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:31 smithi132 bash[27079]: cluster 2020-07-16T15:04:30.642432+0000 mgr.x (mgr.34562) 4131 : cluster [DBG] pgmap v2575: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:04:34.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:33 smithi132 bash[27079]: cluster 2020-07-16T15:04:32.642852+0000 mgr.x (mgr.34562) 4132 : cluster [DBG] pgmap v2576: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:04:34.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:33 smithi188 bash[23329]: cluster 2020-07-16T15:04:32.642852+0000 mgr.x (mgr.34562) 4132 : cluster [DBG] pgmap v2576: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:04:36.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:35 smithi132 bash[27079]: cluster 2020-07-16T15:04:34.643273+0000 mgr.x (mgr.34562) 4133 : cluster [DBG] pgmap v2577: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:04:36.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:35 smithi188 bash[23329]: cluster 2020-07-16T15:04:34.643273+0000 mgr.x (mgr.34562) 4133 : cluster [DBG] pgmap v2577: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:04:37.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:36 smithi132 bash[27079]: audit 2020-07-16T15:04:35.706681+0000 mon.b (mon.2) 952 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:04:37.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:36 smithi132 bash[27079]: cephadm 2020-07-16T15:04:35.707390+0000 mgr.x (mgr.34562) 4134 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:04:37.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:36 smithi132 bash[27079]: cephadm 2020-07-16T15:04:35.707812+0000 mgr.x (mgr.34562) 4135 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:04:37.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:36 smithi188 bash[23329]: audit 2020-07-16T15:04:35.706681+0000 mon.b (mon.2) 952 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:04:37.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:36 smithi188 bash[23329]: cephadm 2020-07-16T15:04:35.707390+0000 mgr.x (mgr.34562) 4134 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:04:37.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:36 smithi188 bash[23329]: cephadm 2020-07-16T15:04:35.707812+0000 mgr.x (mgr.34562) 4135 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:04:38.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:37 smithi132 bash[27079]: cluster 2020-07-16T15:04:36.643743+0000 mgr.x (mgr.34562) 4136 : cluster [DBG] pgmap v2578: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:04:38.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:37 smithi188 bash[23329]: cluster 2020-07-16T15:04:36.643743+0000 mgr.x (mgr.34562) 4136 : cluster [DBG] pgmap v2578: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:04:40.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:39 smithi132 bash[27079]: cluster 2020-07-16T15:04:38.644063+0000 mgr.x (mgr.34562) 4137 : cluster [DBG] pgmap v2579: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:04:40.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:39 smithi188 bash[23329]: cluster 2020-07-16T15:04:38.644063+0000 mgr.x (mgr.34562) 4137 : cluster [DBG] pgmap v2579: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:04:40.723 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:04:40.984 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:04:40.984 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (87m) 89s ago 90m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:04:40.984 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (90m) 88s ago 90m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:04:40.984 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (87m) 88s ago 93m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:04:40.985 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (87m) 89s ago 95m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:04:40.985 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 89s ago 95m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:04:40.985 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (93m) 88s ago 93m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:04:40.985 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (93m) 89s ago 93m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:04:40.985 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (90m) 89s ago 90m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:04:40.986 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (90m) 88s ago 90m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:04:40.986 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (93m) 89s ago 93m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:04:40.986 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (92m) 89s ago 92m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:04:40.986 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (92m) 89s ago 92m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:04:40.986 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (92m) 89s ago 92m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:04:40.987 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (91m) 88s ago 91m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:04:40.987 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (91m) 88s ago 91m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:04:40.987 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (91m) 88s ago 91m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:04:40.987 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (91m) 88s ago 91m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:04:40.987 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (89m) 88s ago 90m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:04:41.282 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:04:41.282 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:04:41.283 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:04:41.283 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:04:41.283 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:04:41.283 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:04:41.283 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:04:41.284 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:04:41.284 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:04:41.284 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:04:41.284 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:04:41.284 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:04:41.285 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:04:41.285 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:04:41.285 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:04:41.285 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:04:41.285 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:04:41.426 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:41 smithi188 bash[23329]: cluster 2020-07-16T15:04:40.644443+0000 mgr.x (mgr.34562) 4138 : cluster [DBG] pgmap v2580: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:04:41.427 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:41 smithi188 bash[23329]: audit 2020-07-16T15:04:40.712296+0000 mgr.x (mgr.34562) 4139 : audit [DBG] from='client.27646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:04:41.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:41 smithi132 bash[27079]: cluster 2020-07-16T15:04:40.644443+0000 mgr.x (mgr.34562) 4138 : cluster [DBG] pgmap v2580: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:04:41.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:41 smithi132 bash[27079]: audit 2020-07-16T15:04:40.712296+0000 mgr.x (mgr.34562) 4139 : audit [DBG] from='client.27646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:04:42.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:42 smithi188 bash[23329]: audit 2020-07-16T15:04:40.979703+0000 mgr.x (mgr.34562) 4140 : audit [DBG] from='client.27652 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:04:42.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:42 smithi188 bash[23329]: audit 2020-07-16T15:04:41.281298+0000 mon.c (mon.1) 305 : audit [DBG] from='client.? 172.21.15.132:0/3624370904' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:04:42.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:42 smithi132 bash[27079]: audit 2020-07-16T15:04:40.979703+0000 mgr.x (mgr.34562) 4140 : audit [DBG] from='client.27652 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:04:42.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:42 smithi132 bash[27079]: audit 2020-07-16T15:04:41.281298+0000 mon.c (mon.1) 305 : audit [DBG] from='client.? 172.21.15.132:0/3624370904' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:04:43.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:43 smithi188 bash[23329]: cluster 2020-07-16T15:04:42.644793+0000 mgr.x (mgr.34562) 4141 : cluster [DBG] pgmap v2581: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:04:43.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:43 smithi132 bash[27079]: cluster 2020-07-16T15:04:42.644793+0000 mgr.x (mgr.34562) 4141 : cluster [DBG] pgmap v2581: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:04:46.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:45 smithi132 bash[27079]: cluster 2020-07-16T15:04:44.645255+0000 mgr.x (mgr.34562) 4142 : cluster [DBG] pgmap v2582: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:04:46.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:45 smithi188 bash[23329]: cluster 2020-07-16T15:04:44.645255+0000 mgr.x (mgr.34562) 4142 : cluster [DBG] pgmap v2582: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:04:48.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:47 smithi132 bash[27079]: cluster 2020-07-16T15:04:46.645811+0000 mgr.x (mgr.34562) 4143 : cluster [DBG] pgmap v2583: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:04:48.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:47 smithi188 bash[23329]: cluster 2020-07-16T15:04:46.645811+0000 mgr.x (mgr.34562) 4143 : cluster [DBG] pgmap v2583: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:04:50.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:49 smithi132 bash[27079]: cluster 2020-07-16T15:04:48.646360+0000 mgr.x (mgr.34562) 4144 : cluster [DBG] pgmap v2584: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:04:50.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:49 smithi188 bash[23329]: cluster 2020-07-16T15:04:48.646360+0000 mgr.x (mgr.34562) 4144 : cluster [DBG] pgmap v2584: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:04:51.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:51 smithi188 bash[23329]: cluster 2020-07-16T15:04:50.646872+0000 mgr.x (mgr.34562) 4145 : cluster [DBG] pgmap v2585: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:04:51.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:51 smithi188 bash[23329]: audit 2020-07-16T15:04:50.723445+0000 mon.b (mon.2) 953 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:04:51.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:51 smithi188 bash[23329]: cephadm 2020-07-16T15:04:50.724146+0000 mgr.x (mgr.34562) 4146 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:04:51.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:51 smithi188 bash[23329]: cephadm 2020-07-16T15:04:50.724382+0000 mgr.x (mgr.34562) 4147 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:04:51.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:51 smithi132 bash[27079]: cluster 2020-07-16T15:04:50.646872+0000 mgr.x (mgr.34562) 4145 : cluster [DBG] pgmap v2585: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:04:51.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:51 smithi132 bash[27079]: audit 2020-07-16T15:04:50.723445+0000 mon.b (mon.2) 953 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:04:51.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:51 smithi132 bash[27079]: cephadm 2020-07-16T15:04:50.724146+0000 mgr.x (mgr.34562) 4146 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:04:51.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:51 smithi132 bash[27079]: cephadm 2020-07-16T15:04:50.724382+0000 mgr.x (mgr.34562) 4147 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:04:54.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:53 smithi132 bash[27079]: cluster 2020-07-16T15:04:52.647362+0000 mgr.x (mgr.34562) 4148 : cluster [DBG] pgmap v2586: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:04:54.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:53 smithi188 bash[23329]: cluster 2020-07-16T15:04:52.647362+0000 mgr.x (mgr.34562) 4148 : cluster [DBG] pgmap v2586: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:04:56.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:55 smithi132 bash[27079]: cluster 2020-07-16T15:04:54.647761+0000 mgr.x (mgr.34562) 4149 : cluster [DBG] pgmap v2587: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:04:56.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:55 smithi188 bash[23329]: cluster 2020-07-16T15:04:54.647761+0000 mgr.x (mgr.34562) 4149 : cluster [DBG] pgmap v2587: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:04:58.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:57 smithi132 bash[27079]: cluster 2020-07-16T15:04:56.648320+0000 mgr.x (mgr.34562) 4150 : cluster [DBG] pgmap v2588: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:04:58.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:57 smithi188 bash[23329]: cluster 2020-07-16T15:04:56.648320+0000 mgr.x (mgr.34562) 4150 : cluster [DBG] pgmap v2588: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:05:00.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:04:59 smithi132 bash[27079]: cluster 2020-07-16T15:04:58.648693+0000 mgr.x (mgr.34562) 4151 : cluster [DBG] pgmap v2589: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:05:00.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:04:59 smithi188 bash[23329]: cluster 2020-07-16T15:04:58.648693+0000 mgr.x (mgr.34562) 4151 : cluster [DBG] pgmap v2589: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:05:01.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:01 smithi188 bash[23329]: cluster 2020-07-16T15:05:00.649160+0000 mgr.x (mgr.34562) 4152 : cluster [DBG] pgmap v2590: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:05:01.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:01 smithi132 bash[27079]: cluster 2020-07-16T15:05:00.649160+0000 mgr.x (mgr.34562) 4152 : cluster [DBG] pgmap v2590: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:05:04.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:03 smithi132 bash[27079]: cluster 2020-07-16T15:05:02.649687+0000 mgr.x (mgr.34562) 4153 : cluster [DBG] pgmap v2591: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:05:04.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:03 smithi188 bash[23329]: cluster 2020-07-16T15:05:02.649687+0000 mgr.x (mgr.34562) 4153 : cluster [DBG] pgmap v2591: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:05:06.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:05 smithi132 bash[27079]: cluster 2020-07-16T15:05:04.650189+0000 mgr.x (mgr.34562) 4154 : cluster [DBG] pgmap v2592: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:05:06.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:05 smithi188 bash[23329]: cluster 2020-07-16T15:05:04.650189+0000 mgr.x (mgr.34562) 4154 : cluster [DBG] pgmap v2592: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:05:07.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:06 smithi132 bash[27079]: audit 2020-07-16T15:05:05.740177+0000 mon.b (mon.2) 954 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:05:07.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:06 smithi132 bash[27079]: cephadm 2020-07-16T15:05:05.740964+0000 mgr.x (mgr.34562) 4155 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:05:07.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:06 smithi132 bash[27079]: cephadm 2020-07-16T15:05:05.741313+0000 mgr.x (mgr.34562) 4156 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:05:07.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:06 smithi188 bash[23329]: audit 2020-07-16T15:05:05.740177+0000 mon.b (mon.2) 954 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:05:07.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:06 smithi188 bash[23329]: cephadm 2020-07-16T15:05:05.740964+0000 mgr.x (mgr.34562) 4155 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:05:07.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:06 smithi188 bash[23329]: cephadm 2020-07-16T15:05:05.741313+0000 mgr.x (mgr.34562) 4156 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:05:08.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:07 smithi132 bash[27079]: cluster 2020-07-16T15:05:06.650590+0000 mgr.x (mgr.34562) 4157 : cluster [DBG] pgmap v2593: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:05:08.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:07 smithi188 bash[23329]: cluster 2020-07-16T15:05:06.650590+0000 mgr.x (mgr.34562) 4157 : cluster [DBG] pgmap v2593: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:05:10.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:09 smithi132 bash[27079]: cluster 2020-07-16T15:05:08.651044+0000 mgr.x (mgr.34562) 4158 : cluster [DBG] pgmap v2594: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:05:10.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:09 smithi188 bash[23329]: cluster 2020-07-16T15:05:08.651044+0000 mgr.x (mgr.34562) 4158 : cluster [DBG] pgmap v2594: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:05:11.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:11 smithi188 bash[23329]: cluster 2020-07-16T15:05:10.651461+0000 mgr.x (mgr.34562) 4159 : cluster [DBG] pgmap v2595: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:05:11.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:11 smithi132 bash[27079]: cluster 2020-07-16T15:05:10.651461+0000 mgr.x (mgr.34562) 4159 : cluster [DBG] pgmap v2595: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:05:11.581 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:05:11.842 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:05:11.843 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (87m) 2m ago 90m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:05:11.843 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (90m) 119s ago 90m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:05:11.843 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (88m) 119s ago 93m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:05:11.843 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (87m) 2m ago 95m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:05:11.844 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 2m ago 95m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:05:11.844 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (94m) 119s ago 94m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:05:11.844 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (94m) 2m ago 94m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:05:11.844 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (91m) 2m ago 91m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:05:11.844 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (91m) 119s ago 91m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:05:11.845 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (93m) 2m ago 93m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:05:11.845 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (93m) 2m ago 93m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:05:11.845 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (92m) 2m ago 93m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:05:11.845 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (92m) 2m ago 92m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:05:11.845 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (92m) 119s ago 92m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:05:11.846 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (92m) 119s ago 92m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:05:11.846 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (91m) 119s ago 91m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:05:11.846 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (91m) 119s ago 91m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:05:11.846 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (90m) 119s ago 91m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:05:12.140 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:05:12.141 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:05:12.141 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:05:12.141 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:05:12.141 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:05:12.141 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:05:12.142 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:05:12.142 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:05:12.142 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:05:12.142 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:05:12.143 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:05:12.143 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:05:12.143 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:05:12.143 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:05:12.143 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:05:12.144 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:05:12.144 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:05:12.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:12 smithi188 bash[23329]: audit 2020-07-16T15:05:11.569391+0000 mgr.x (mgr.34562) 4160 : audit [DBG] from='client.27664 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:05:12.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:12 smithi132 bash[27079]: audit 2020-07-16T15:05:11.569391+0000 mgr.x (mgr.34562) 4160 : audit [DBG] from='client.27664 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:05:13.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:13 smithi188 bash[23329]: audit 2020-07-16T15:05:11.838645+0000 mgr.x (mgr.34562) 4161 : audit [DBG] from='client.27670 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:05:13.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:13 smithi188 bash[23329]: audit 2020-07-16T15:05:12.139648+0000 mon.c (mon.1) 306 : audit [DBG] from='client.? 172.21.15.132:0/2621200193' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:05:13.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:13 smithi188 bash[23329]: cluster 2020-07-16T15:05:12.651952+0000 mgr.x (mgr.34562) 4162 : cluster [DBG] pgmap v2596: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:05:13.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:13 smithi132 bash[27079]: audit 2020-07-16T15:05:11.838645+0000 mgr.x (mgr.34562) 4161 : audit [DBG] from='client.27670 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:05:13.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:13 smithi132 bash[27079]: audit 2020-07-16T15:05:12.139648+0000 mon.c (mon.1) 306 : audit [DBG] from='client.? 172.21.15.132:0/2621200193' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:05:13.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:13 smithi132 bash[27079]: cluster 2020-07-16T15:05:12.651952+0000 mgr.x (mgr.34562) 4162 : cluster [DBG] pgmap v2596: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:05:16.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:15 smithi132 bash[27079]: cluster 2020-07-16T15:05:14.652448+0000 mgr.x (mgr.34562) 4163 : cluster [DBG] pgmap v2597: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:05:16.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:15 smithi188 bash[23329]: cluster 2020-07-16T15:05:14.652448+0000 mgr.x (mgr.34562) 4163 : cluster [DBG] pgmap v2597: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:05:18.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:17 smithi132 bash[27079]: cluster 2020-07-16T15:05:16.652804+0000 mgr.x (mgr.34562) 4164 : cluster [DBG] pgmap v2598: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:05:18.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:17 smithi188 bash[23329]: cluster 2020-07-16T15:05:16.652804+0000 mgr.x (mgr.34562) 4164 : cluster [DBG] pgmap v2598: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:05:20.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:19 smithi132 bash[27079]: cluster 2020-07-16T15:05:18.653294+0000 mgr.x (mgr.34562) 4165 : cluster [DBG] pgmap v2599: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:05:20.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:19 smithi188 bash[23329]: cluster 2020-07-16T15:05:18.653294+0000 mgr.x (mgr.34562) 4165 : cluster [DBG] pgmap v2599: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:05:21.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:21 smithi188 bash[23329]: cluster 2020-07-16T15:05:20.653664+0000 mgr.x (mgr.34562) 4166 : cluster [DBG] pgmap v2600: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:05:21.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:21 smithi188 bash[23329]: audit 2020-07-16T15:05:20.983115+0000 mon.b (mon.2) 955 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:03:11.714962\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715018\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715053\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715081\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715244\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715377\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715484\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715603\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715636\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:03:11.715711\", \"last_device_update\": \"2020-07-16T15:04:18.042470\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:05:20.982249\"}"}]: dispatch 2020-07-16T15:05:21.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:21 smithi188 bash[23329]: audit 2020-07-16T15:05:20.983720+0000 mon.c (mon.1) 307 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:03:11.714962\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715018\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715053\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715081\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715244\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715377\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715484\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715603\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715636\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:03:11.715711\", \"last_device_update\": \"2020-07-16T15:04:18.042470\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:05:20.982249\"}"}]: dispatch 2020-07-16T15:05:21.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:21 smithi188 bash[23329]: audit 2020-07-16T15:05:20.986349+0000 mon.c (mon.1) 308 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:03:11.714962\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715018\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715053\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715081\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715244\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715377\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715484\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715603\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715636\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:03:11.715711\", \"last_device_update\": \"2020-07-16T15:04:18.042470\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:05:20.982249\"}"}]': finished 2020-07-16T15:05:21.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:21 smithi188 bash[23329]: audit 2020-07-16T15:05:20.989428+0000 mon.b (mon.2) 956 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.221886\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.221954\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.221985\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222141\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222243\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222368\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222472\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222506\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222535\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:03:12.222624\", \"last_device_update\": \"2020-07-16T14:34:46.715995\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:05:20.988668\"}"}]: dispatch 2020-07-16T15:05:21.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:21 smithi188 bash[23329]: audit 2020-07-16T15:05:20.989800+0000 mon.c (mon.1) 309 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.221886\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.221954\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.221985\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222141\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222243\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222368\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222472\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222506\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222535\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:03:12.222624\", \"last_device_update\": \"2020-07-16T14:34:46.715995\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:05:20.988668\"}"}]: dispatch 2020-07-16T15:05:21.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:21 smithi188 bash[23329]: audit 2020-07-16T15:05:20.993997+0000 mon.c (mon.1) 310 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.221886\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.221954\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.221985\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222141\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222243\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222368\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222472\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222506\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222535\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:03:12.222624\", \"last_device_update\": \"2020-07-16T14:34:46.715995\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:05:20.988668\"}"}]': finished 2020-07-16T15:05:21.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:21 smithi188 bash[23329]: audit 2020-07-16T15:05:20.995458+0000 mon.b (mon.2) 957 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T15:05:21.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:21 smithi132 bash[27079]: cluster 2020-07-16T15:05:20.653664+0000 mgr.x (mgr.34562) 4166 : cluster [DBG] pgmap v2600: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:05:21.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:21 smithi132 bash[27079]: audit 2020-07-16T15:05:20.983115+0000 mon.b (mon.2) 955 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:03:11.714962\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715018\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715053\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715081\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715244\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715377\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715484\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715603\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715636\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:03:11.715711\", \"last_device_update\": \"2020-07-16T15:04:18.042470\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:05:20.982249\"}"}]: dispatch 2020-07-16T15:05:21.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:21 smithi132 bash[27079]: audit 2020-07-16T15:05:20.983720+0000 mon.c (mon.1) 307 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:03:11.714962\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715018\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715053\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715081\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715244\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715377\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715484\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715603\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715636\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:03:11.715711\", \"last_device_update\": \"2020-07-16T15:04:18.042470\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:05:20.982249\"}"}]: dispatch 2020-07-16T15:05:21.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:21 smithi132 bash[27079]: audit 2020-07-16T15:05:20.986349+0000 mon.c (mon.1) 308 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:03:11.714962\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715018\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715053\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715081\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715244\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715377\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715484\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715603\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:11.715636\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:03:11.715711\", \"last_device_update\": \"2020-07-16T15:04:18.042470\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:05:20.982249\"}"}]': finished 2020-07-16T15:05:21.532 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:21 smithi132 bash[27079]: audit 2020-07-16T15:05:20.989428+0000 mon.b (mon.2) 956 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.221886\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.221954\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.221985\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222141\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222243\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222368\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222472\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222506\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222535\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:03:12.222624\", \"last_device_update\": \"2020-07-16T14:34:46.715995\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:05:20.988668\"}"}]: dispatch 2020-07-16T15:05:21.532 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:21 smithi132 bash[27079]: audit 2020-07-16T15:05:20.989800+0000 mon.c (mon.1) 309 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.221886\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.221954\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.221985\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222141\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222243\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222368\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222472\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222506\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222535\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:03:12.222624\", \"last_device_update\": \"2020-07-16T14:34:46.715995\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:05:20.988668\"}"}]: dispatch 2020-07-16T15:05:21.532 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:21 smithi132 bash[27079]: audit 2020-07-16T15:05:20.993997+0000 mon.c (mon.1) 310 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.221886\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.221954\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.221985\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222141\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222243\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222368\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222472\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222506\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222535\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:03:12.222624\", \"last_device_update\": \"2020-07-16T14:34:46.715995\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:05:20.988668\"}"}]': finished 2020-07-16T15:05:21.533 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:21 smithi132 bash[27079]: audit 2020-07-16T15:05:20.995458+0000 mon.b (mon.2) 957 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T15:05:24.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:23 smithi132 bash[27079]: cluster 2020-07-16T15:05:22.654037+0000 mgr.x (mgr.34562) 4167 : cluster [DBG] pgmap v2601: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:05:24.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:23 smithi132 bash[27079]: audit 2020-07-16T15:05:23.687577+0000 mon.b (mon.2) 958 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T15:05:24.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:23 smithi188 bash[23329]: cluster 2020-07-16T15:05:22.654037+0000 mgr.x (mgr.34562) 4167 : cluster [DBG] pgmap v2601: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:05:24.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:23 smithi188 bash[23329]: audit 2020-07-16T15:05:23.687577+0000 mon.b (mon.2) 958 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T15:05:25.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:24 smithi132 bash[27079]: audit 2020-07-16T15:05:23.896879+0000 mon.b (mon.2) 959 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.221886\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.221954\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.221985\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222141\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222243\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222368\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222472\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222506\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222535\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:03:12.222624\", \"last_device_update\": \"2020-07-16T15:05:23.895950\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:05:20.988668\"}"}]: dispatch 2020-07-16T15:05:25.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:24 smithi132 bash[27079]: audit 2020-07-16T15:05:23.897482+0000 mon.c (mon.1) 311 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.221886\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.221954\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.221985\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222141\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222243\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222368\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222472\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222506\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222535\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:03:12.222624\", \"last_device_update\": \"2020-07-16T15:05:23.895950\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:05:20.988668\"}"}]: dispatch 2020-07-16T15:05:25.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:24 smithi132 bash[27079]: audit 2020-07-16T15:05:23.900263+0000 mon.c (mon.1) 312 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.221886\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.221954\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.221985\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222141\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222243\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222368\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222472\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222506\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222535\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:03:12.222624\", \"last_device_update\": \"2020-07-16T15:05:23.895950\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:05:20.988668\"}"}]': finished 2020-07-16T15:05:25.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:24 smithi132 bash[27079]: audit 2020-07-16T15:05:23.903541+0000 mon.b (mon.2) 960 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:05:25.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:24 smithi132 bash[27079]: audit 2020-07-16T15:05:23.904576+0000 mon.b (mon.2) 961 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:05:25.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:24 smithi132 bash[27079]: audit 2020-07-16T15:05:23.905406+0000 mon.b (mon.2) 962 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:05:25.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:24 smithi132 bash[27079]: audit 2020-07-16T15:05:23.906384+0000 mon.b (mon.2) 963 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:05:25.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:24 smithi132 bash[27079]: audit 2020-07-16T15:05:23.907261+0000 mon.b (mon.2) 964 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:05:25.073 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:24 smithi188 bash[23329]: audit 2020-07-16T15:05:23.896879+0000 mon.b (mon.2) 959 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.221886\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.221954\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.221985\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222141\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222243\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222368\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222472\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222506\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222535\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:03:12.222624\", \"last_device_update\": \"2020-07-16T15:05:23.895950\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:05:20.988668\"}"}]: dispatch 2020-07-16T15:05:25.073 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:24 smithi188 bash[23329]: audit 2020-07-16T15:05:23.897482+0000 mon.c (mon.1) 311 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.221886\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.221954\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.221985\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222141\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222243\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222368\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222472\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222506\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222535\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:03:12.222624\", \"last_device_update\": \"2020-07-16T15:05:23.895950\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:05:20.988668\"}"}]: dispatch 2020-07-16T15:05:25.073 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:24 smithi188 bash[23329]: audit 2020-07-16T15:05:23.900263+0000 mon.c (mon.1) 312 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.221886\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.221954\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.221985\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222141\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222243\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222368\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222472\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222506\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:03:12.222535\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:03:12.222624\", \"last_device_update\": \"2020-07-16T15:05:23.895950\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:05:20.988668\"}"}]': finished 2020-07-16T15:05:25.074 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:24 smithi188 bash[23329]: audit 2020-07-16T15:05:23.903541+0000 mon.b (mon.2) 960 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:05:25.074 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:24 smithi188 bash[23329]: audit 2020-07-16T15:05:23.904576+0000 mon.b (mon.2) 961 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:05:25.074 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:24 smithi188 bash[23329]: audit 2020-07-16T15:05:23.905406+0000 mon.b (mon.2) 962 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:05:25.074 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:24 smithi188 bash[23329]: audit 2020-07-16T15:05:23.906384+0000 mon.b (mon.2) 963 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:05:25.075 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:24 smithi188 bash[23329]: audit 2020-07-16T15:05:23.907261+0000 mon.b (mon.2) 964 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:05:25.966 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:25 smithi132 bash[27079]: audit 2020-07-16T15:05:23.903878+0000 mgr.x (mgr.34562) 4168 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:05:25.966 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:25 smithi132 bash[27079]: audit 2020-07-16T15:05:23.904816+0000 mgr.x (mgr.34562) 4169 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:05:25.967 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:25 smithi132 bash[27079]: audit 2020-07-16T15:05:23.905611+0000 mgr.x (mgr.34562) 4170 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:05:25.967 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:25 smithi132 bash[27079]: cephadm 2020-07-16T15:05:23.906099+0000 mgr.x (mgr.34562) 4171 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:05:25.967 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:25 smithi132 bash[27079]: cephadm 2020-07-16T15:05:23.907004+0000 mgr.x (mgr.34562) 4172 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:05:25.967 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:25 smithi132 bash[27079]: cephadm 2020-07-16T15:05:23.907786+0000 mgr.x (mgr.34562) 4173 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:05:25.968 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:25 smithi132 bash[27079]: cephadm 2020-07-16T15:05:23.907945+0000 mgr.x (mgr.34562) 4174 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:05:25.968 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:25 smithi132 bash[27079]: cluster 2020-07-16T15:05:24.654490+0000 mgr.x (mgr.34562) 4175 : cluster [DBG] pgmap v2602: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:05:26.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:25 smithi188 bash[23329]: audit 2020-07-16T15:05:23.903878+0000 mgr.x (mgr.34562) 4168 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:05:26.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:25 smithi188 bash[23329]: audit 2020-07-16T15:05:23.904816+0000 mgr.x (mgr.34562) 4169 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:05:26.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:25 smithi188 bash[23329]: audit 2020-07-16T15:05:23.905611+0000 mgr.x (mgr.34562) 4170 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:05:26.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:25 smithi188 bash[23329]: cephadm 2020-07-16T15:05:23.906099+0000 mgr.x (mgr.34562) 4171 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:05:26.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:25 smithi188 bash[23329]: cephadm 2020-07-16T15:05:23.907004+0000 mgr.x (mgr.34562) 4172 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:05:26.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:25 smithi188 bash[23329]: cephadm 2020-07-16T15:05:23.907786+0000 mgr.x (mgr.34562) 4173 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:05:26.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:25 smithi188 bash[23329]: cephadm 2020-07-16T15:05:23.907945+0000 mgr.x (mgr.34562) 4174 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:05:26.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:25 smithi188 bash[23329]: cluster 2020-07-16T15:05:24.654490+0000 mgr.x (mgr.34562) 4175 : cluster [DBG] pgmap v2602: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:05:28.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:27 smithi132 bash[27079]: cluster 2020-07-16T15:05:26.654936+0000 mgr.x (mgr.34562) 4176 : cluster [DBG] pgmap v2603: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:05:28.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:27 smithi132 bash[27079]: audit 2020-07-16T15:05:26.724312+0000 mon.b (mon.2) 965 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:05:28.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:27 smithi132 bash[27079]: cephadm 2020-07-16T15:05:26.724904+0000 mgr.x (mgr.34562) 4177 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:05:28.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:27 smithi132 bash[27079]: cephadm 2020-07-16T15:05:26.725311+0000 mgr.x (mgr.34562) 4178 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:05:28.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:27 smithi188 bash[23329]: cluster 2020-07-16T15:05:26.654936+0000 mgr.x (mgr.34562) 4176 : cluster [DBG] pgmap v2603: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:05:28.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:27 smithi188 bash[23329]: audit 2020-07-16T15:05:26.724312+0000 mon.b (mon.2) 965 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:05:28.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:27 smithi188 bash[23329]: cephadm 2020-07-16T15:05:26.724904+0000 mgr.x (mgr.34562) 4177 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:05:28.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:27 smithi188 bash[23329]: cephadm 2020-07-16T15:05:26.725311+0000 mgr.x (mgr.34562) 4178 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:05:30.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:29 smithi132 bash[27079]: cluster 2020-07-16T15:05:28.655359+0000 mgr.x (mgr.34562) 4179 : cluster [DBG] pgmap v2604: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:05:30.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:29 smithi188 bash[23329]: cluster 2020-07-16T15:05:28.655359+0000 mgr.x (mgr.34562) 4179 : cluster [DBG] pgmap v2604: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:05:31.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:31 smithi188 bash[23329]: cluster 2020-07-16T15:05:30.655806+0000 mgr.x (mgr.34562) 4180 : cluster [DBG] pgmap v2605: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:05:31.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:31 smithi132 bash[27079]: cluster 2020-07-16T15:05:30.655806+0000 mgr.x (mgr.34562) 4180 : cluster [DBG] pgmap v2605: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:05:34.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:33 smithi132 bash[27079]: cluster 2020-07-16T15:05:32.656269+0000 mgr.x (mgr.34562) 4181 : cluster [DBG] pgmap v2606: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:05:34.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:33 smithi188 bash[23329]: cluster 2020-07-16T15:05:32.656269+0000 mgr.x (mgr.34562) 4181 : cluster [DBG] pgmap v2606: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:05:36.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:35 smithi132 bash[27079]: cluster 2020-07-16T15:05:34.656773+0000 mgr.x (mgr.34562) 4182 : cluster [DBG] pgmap v2607: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:05:36.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:35 smithi188 bash[23329]: cluster 2020-07-16T15:05:34.656773+0000 mgr.x (mgr.34562) 4182 : cluster [DBG] pgmap v2607: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:05:38.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:37 smithi132 bash[27079]: cluster 2020-07-16T15:05:36.657294+0000 mgr.x (mgr.34562) 4183 : cluster [DBG] pgmap v2608: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:05:38.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:37 smithi188 bash[23329]: cluster 2020-07-16T15:05:36.657294+0000 mgr.x (mgr.34562) 4183 : cluster [DBG] pgmap v2608: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:05:40.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:39 smithi132 bash[27079]: cluster 2020-07-16T15:05:38.657749+0000 mgr.x (mgr.34562) 4184 : cluster [DBG] pgmap v2609: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:05:40.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:39 smithi188 bash[23329]: cluster 2020-07-16T15:05:38.657749+0000 mgr.x (mgr.34562) 4184 : cluster [DBG] pgmap v2609: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:05:41.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:41 smithi188 bash[23329]: cluster 2020-07-16T15:05:40.658191+0000 mgr.x (mgr.34562) 4185 : cluster [DBG] pgmap v2610: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:05:41.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:41 smithi132 bash[27079]: cluster 2020-07-16T15:05:40.658191+0000 mgr.x (mgr.34562) 4185 : cluster [DBG] pgmap v2610: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:05:42.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:42 smithi188 bash[23329]: audit 2020-07-16T15:05:41.732742+0000 mon.b (mon.2) 966 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:05:42.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:42 smithi188 bash[23329]: cephadm 2020-07-16T15:05:41.733458+0000 mgr.x (mgr.34562) 4186 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:05:42.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:42 smithi188 bash[23329]: cephadm 2020-07-16T15:05:41.733770+0000 mgr.x (mgr.34562) 4187 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:05:42.442 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:05:42.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:42 smithi132 bash[27079]: audit 2020-07-16T15:05:41.732742+0000 mon.b (mon.2) 966 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:05:42.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:42 smithi132 bash[27079]: cephadm 2020-07-16T15:05:41.733458+0000 mgr.x (mgr.34562) 4186 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:05:42.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:42 smithi132 bash[27079]: cephadm 2020-07-16T15:05:41.733770+0000 mgr.x (mgr.34562) 4187 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:05:42.701 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:05:42.701 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (88m) 2m ago 91m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:05:42.702 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (91m) 2m ago 91m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:05:42.702 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (88m) 2m ago 94m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:05:42.702 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (88m) 2m ago 96m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:05:42.702 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 2m ago 96m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:05:42.703 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (94m) 2m ago 94m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:05:42.703 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (94m) 2m ago 94m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:05:42.703 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (91m) 2m ago 91m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:05:42.703 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (91m) 2m ago 91m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:05:42.704 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (94m) 2m ago 94m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:05:42.704 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (93m) 2m ago 93m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:05:42.704 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (93m) 2m ago 93m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:05:42.704 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (93m) 2m ago 93m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:05:42.704 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (92m) 2m ago 93m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:05:42.705 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (92m) 2m ago 92m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:05:42.705 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (92m) 2m ago 92m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:05:42.705 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (92m) 2m ago 92m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:05:42.705 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (90m) 2m ago 91m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:05:43.002 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:05:43.002 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:05:43.002 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:05:43.002 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:05:43.003 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:05:43.003 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:05:43.003 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:05:43.003 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:05:43.003 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:05:43.004 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:05:43.004 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:05:43.004 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:05:43.004 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:05:43.004 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:05:43.005 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:05:43.005 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:05:43.005 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:05:43.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:43 smithi188 bash[23329]: audit 2020-07-16T15:05:42.430398+0000 mgr.x (mgr.34562) 4188 : audit [DBG] from='client.27682 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:05:43.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:43 smithi188 bash[23329]: cluster 2020-07-16T15:05:42.658653+0000 mgr.x (mgr.34562) 4189 : cluster [DBG] pgmap v2611: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:05:43.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:43 smithi188 bash[23329]: audit 2020-07-16T15:05:42.697090+0000 mgr.x (mgr.34562) 4190 : audit [DBG] from='client.27688 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:05:43.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:43 smithi188 bash[23329]: audit 2020-07-16T15:05:43.000287+0000 mon.c (mon.1) 313 : audit [DBG] from='client.? 172.21.15.132:0/2623393585' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:05:43.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:43 smithi132 bash[27079]: audit 2020-07-16T15:05:42.430398+0000 mgr.x (mgr.34562) 4188 : audit [DBG] from='client.27682 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:05:43.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:43 smithi132 bash[27079]: cluster 2020-07-16T15:05:42.658653+0000 mgr.x (mgr.34562) 4189 : cluster [DBG] pgmap v2611: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:05:43.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:43 smithi132 bash[27079]: audit 2020-07-16T15:05:42.697090+0000 mgr.x (mgr.34562) 4190 : audit [DBG] from='client.27688 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:05:43.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:43 smithi132 bash[27079]: audit 2020-07-16T15:05:43.000287+0000 mon.c (mon.1) 313 : audit [DBG] from='client.? 172.21.15.132:0/2623393585' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:05:46.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:45 smithi132 bash[27079]: cluster 2020-07-16T15:05:44.659093+0000 mgr.x (mgr.34562) 4191 : cluster [DBG] pgmap v2612: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:05:46.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:45 smithi188 bash[23329]: cluster 2020-07-16T15:05:44.659093+0000 mgr.x (mgr.34562) 4191 : cluster [DBG] pgmap v2612: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:05:48.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:47 smithi132 bash[27079]: cluster 2020-07-16T15:05:46.659499+0000 mgr.x (mgr.34562) 4192 : cluster [DBG] pgmap v2613: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:05:48.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:47 smithi188 bash[23329]: cluster 2020-07-16T15:05:46.659499+0000 mgr.x (mgr.34562) 4192 : cluster [DBG] pgmap v2613: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:05:50.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:49 smithi132 bash[27079]: cluster 2020-07-16T15:05:48.659997+0000 mgr.x (mgr.34562) 4193 : cluster [DBG] pgmap v2614: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:05:50.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:49 smithi188 bash[23329]: cluster 2020-07-16T15:05:48.659997+0000 mgr.x (mgr.34562) 4193 : cluster [DBG] pgmap v2614: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:05:51.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:51 smithi188 bash[23329]: cluster 2020-07-16T15:05:50.660528+0000 mgr.x (mgr.34562) 4194 : cluster [DBG] pgmap v2615: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:05:51.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:51 smithi132 bash[27079]: cluster 2020-07-16T15:05:50.660528+0000 mgr.x (mgr.34562) 4194 : cluster [DBG] pgmap v2615: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:05:54.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:53 smithi132 bash[27079]: cluster 2020-07-16T15:05:52.661018+0000 mgr.x (mgr.34562) 4195 : cluster [DBG] pgmap v2616: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:05:54.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:53 smithi188 bash[23329]: cluster 2020-07-16T15:05:52.661018+0000 mgr.x (mgr.34562) 4195 : cluster [DBG] pgmap v2616: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:05:56.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:55 smithi132 bash[27079]: cluster 2020-07-16T15:05:54.661418+0000 mgr.x (mgr.34562) 4196 : cluster [DBG] pgmap v2617: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:05:56.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:55 smithi188 bash[23329]: cluster 2020-07-16T15:05:54.661418+0000 mgr.x (mgr.34562) 4196 : cluster [DBG] pgmap v2617: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:05:58.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:57 smithi132 bash[27079]: cluster 2020-07-16T15:05:56.661949+0000 mgr.x (mgr.34562) 4197 : cluster [DBG] pgmap v2618: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:05:58.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:57 smithi132 bash[27079]: audit 2020-07-16T15:05:56.742019+0000 mon.b (mon.2) 967 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:05:58.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:57 smithi132 bash[27079]: cephadm 2020-07-16T15:05:56.742688+0000 mgr.x (mgr.34562) 4198 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:05:58.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:57 smithi132 bash[27079]: cephadm 2020-07-16T15:05:56.743117+0000 mgr.x (mgr.34562) 4199 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:05:58.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:57 smithi188 bash[23329]: cluster 2020-07-16T15:05:56.661949+0000 mgr.x (mgr.34562) 4197 : cluster [DBG] pgmap v2618: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:05:58.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:57 smithi188 bash[23329]: audit 2020-07-16T15:05:56.742019+0000 mon.b (mon.2) 967 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:05:58.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:57 smithi188 bash[23329]: cephadm 2020-07-16T15:05:56.742688+0000 mgr.x (mgr.34562) 4198 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:05:58.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:57 smithi188 bash[23329]: cephadm 2020-07-16T15:05:56.743117+0000 mgr.x (mgr.34562) 4199 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:06:00.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:05:59 smithi132 bash[27079]: cluster 2020-07-16T15:05:58.662420+0000 mgr.x (mgr.34562) 4200 : cluster [DBG] pgmap v2619: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:06:00.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:05:59 smithi188 bash[23329]: cluster 2020-07-16T15:05:58.662420+0000 mgr.x (mgr.34562) 4200 : cluster [DBG] pgmap v2619: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:06:01.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:06:01 smithi188 bash[23329]: cluster 2020-07-16T15:06:00.662894+0000 mgr.x (mgr.34562) 4201 : cluster [DBG] pgmap v2620: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:06:01.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:06:01 smithi132 bash[27079]: cluster 2020-07-16T15:06:00.662894+0000 mgr.x (mgr.34562) 4201 : cluster [DBG] pgmap v2620: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:06:04.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:06:03 smithi132 bash[27079]: cluster 2020-07-16T15:06:02.663404+0000 mgr.x (mgr.34562) 4202 : cluster [DBG] pgmap v2621: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:06:04.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:06:03 smithi188 bash[23329]: cluster 2020-07-16T15:06:02.663404+0000 mgr.x (mgr.34562) 4202 : cluster [DBG] pgmap v2621: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:06:06.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:06:05 smithi132 bash[27079]: cluster 2020-07-16T15:06:04.663743+0000 mgr.x (mgr.34562) 4203 : cluster [DBG] pgmap v2622: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:06:06.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:06:05 smithi188 bash[23329]: cluster 2020-07-16T15:06:04.663743+0000 mgr.x (mgr.34562) 4203 : cluster [DBG] pgmap v2622: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:06:08.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:06:07 smithi132 bash[27079]: cluster 2020-07-16T15:06:06.664304+0000 mgr.x (mgr.34562) 4204 : cluster [DBG] pgmap v2623: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:06:08.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:06:07 smithi188 bash[23329]: cluster 2020-07-16T15:06:06.664304+0000 mgr.x (mgr.34562) 4204 : cluster [DBG] pgmap v2623: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:06:10.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:06:09 smithi132 bash[27079]: cluster 2020-07-16T15:06:08.664752+0000 mgr.x (mgr.34562) 4205 : cluster [DBG] pgmap v2624: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:06:10.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:06:09 smithi188 bash[23329]: cluster 2020-07-16T15:06:08.664752+0000 mgr.x (mgr.34562) 4205 : cluster [DBG] pgmap v2624: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:06:11.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:06:11 smithi188 bash[23329]: cluster 2020-07-16T15:06:10.665262+0000 mgr.x (mgr.34562) 4206 : cluster [DBG] pgmap v2625: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:06:11.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:06:11 smithi132 bash[27079]: cluster 2020-07-16T15:06:10.665262+0000 mgr.x (mgr.34562) 4206 : cluster [DBG] pgmap v2625: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:06:12.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:06:12 smithi188 bash[23329]: audit 2020-07-16T15:06:11.758609+0000 mon.b (mon.2) 968 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:06:12.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:06:12 smithi188 bash[23329]: cephadm 2020-07-16T15:06:11.759340+0000 mgr.x (mgr.34562) 4207 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:06:12.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:06:12 smithi188 bash[23329]: cephadm 2020-07-16T15:06:11.759728+0000 mgr.x (mgr.34562) 4208 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:06:12.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:06:12 smithi132 bash[27079]: audit 2020-07-16T15:06:11.758609+0000 mon.b (mon.2) 968 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:06:12.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:06:12 smithi132 bash[27079]: cephadm 2020-07-16T15:06:11.759340+0000 mgr.x (mgr.34562) 4207 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:06:12.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:06:12 smithi132 bash[27079]: cephadm 2020-07-16T15:06:11.759728+0000 mgr.x (mgr.34562) 4208 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:06:13.298 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:06:13.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:06:13 smithi188 bash[23329]: cluster 2020-07-16T15:06:12.665695+0000 mgr.x (mgr.34562) 4209 : cluster [DBG] pgmap v2626: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:06:13.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:06:13 smithi132 bash[27079]: cluster 2020-07-16T15:06:12.665695+0000 mgr.x (mgr.34562) 4209 : cluster [DBG] pgmap v2626: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:06:13.557 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:06:13.558 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (88m) 3m ago 92m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:06:13.558 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (91m) 3m ago 91m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:06:13.558 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (89m) 3m ago 94m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:06:13.558 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (88m) 3m ago 96m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:06:13.559 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 3m ago 96m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:06:13.559 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (95m) 3m ago 95m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:06:13.559 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (95m) 3m ago 95m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:06:13.559 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (92m) 3m ago 92m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:06:13.559 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (92m) 3m ago 92m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:06:13.559 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (94m) 3m ago 94m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:06:13.560 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (94m) 3m ago 94m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:06:13.560 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (94m) 3m ago 94m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:06:13.560 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (93m) 3m ago 93m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:06:13.560 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (93m) 3m ago 93m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:06:13.560 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (93m) 3m ago 93m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:06:13.561 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (92m) 3m ago 92m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:06:13.561 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (92m) 3m ago 92m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:06:13.561 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (91m) 3m ago 92m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:06:13.856 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:06:13.856 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:06:13.856 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:06:13.856 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:06:13.857 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:06:13.857 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:06:13.857 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:06:13.857 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:06:13.857 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:06:13.858 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:06:13.858 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:06:13.858 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:06:13.858 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:06:13.858 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:06:13.859 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:06:13.859 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:06:13.859 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:06:14.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:06:14 smithi188 bash[23329]: audit 2020-07-16T15:06:13.286614+0000 mgr.x (mgr.34562) 4210 : audit [DBG] from='client.27700 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:06:14.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:06:14 smithi188 bash[23329]: audit 2020-07-16T15:06:13.553443+0000 mgr.x (mgr.34562) 4211 : audit [DBG] from='client.27706 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:06:14.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:06:14 smithi188 bash[23329]: audit 2020-07-16T15:06:13.855218+0000 mon.c (mon.1) 314 : audit [DBG] from='client.? 172.21.15.132:0/3888187898' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:06:14.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:06:14 smithi132 bash[27079]: audit 2020-07-16T15:06:13.286614+0000 mgr.x (mgr.34562) 4210 : audit [DBG] from='client.27700 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:06:14.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:06:14 smithi132 bash[27079]: audit 2020-07-16T15:06:13.553443+0000 mgr.x (mgr.34562) 4211 : audit [DBG] from='client.27706 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:06:14.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:06:14 smithi132 bash[27079]: audit 2020-07-16T15:06:13.855218+0000 mon.c (mon.1) 314 : audit [DBG] from='client.? 172.21.15.132:0/3888187898' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:06:15.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:06:15 smithi188 bash[23329]: cluster 2020-07-16T15:06:14.666128+0000 mgr.x (mgr.34562) 4212 : cluster [DBG] pgmap v2627: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:06:15.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:06:15 smithi132 bash[27079]: cluster 2020-07-16T15:06:14.666128+0000 mgr.x (mgr.34562) 4212 : cluster [DBG] pgmap v2627: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:06:18.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:06:17 smithi132 bash[27079]: cluster 2020-07-16T15:06:16.666550+0000 mgr.x (mgr.34562) 4213 : cluster [DBG] pgmap v2628: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:06:18.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:06:17 smithi188 bash[23329]: cluster 2020-07-16T15:06:16.666550+0000 mgr.x (mgr.34562) 4213 : cluster [DBG] pgmap v2628: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:06:20.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:06:19 smithi132 bash[27079]: cluster 2020-07-16T15:06:18.667050+0000 mgr.x (mgr.34562) 4214 : cluster [DBG] pgmap v2629: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:06:20.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:06:19 smithi188 bash[23329]: cluster 2020-07-16T15:06:18.667050+0000 mgr.x (mgr.34562) 4214 : cluster [DBG] pgmap v2629: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:06:21.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:06:21 smithi188 bash[23329]: cluster 2020-07-16T15:06:20.667597+0000 mgr.x (mgr.34562) 4215 : cluster [DBG] pgmap v2630: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:06:21.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:06:21 smithi132 bash[27079]: cluster 2020-07-16T15:06:20.667597+0000 mgr.x (mgr.34562) 4215 : cluster [DBG] pgmap v2630: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:06:24.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:06:23 smithi132 bash[27079]: cluster 2020-07-16T15:06:22.668090+0000 mgr.x (mgr.34562) 4216 : cluster [DBG] pgmap v2631: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:06:24.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:06:23 smithi188 bash[23329]: cluster 2020-07-16T15:06:22.668090+0000 mgr.x (mgr.34562) 4216 : cluster [DBG] pgmap v2631: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:06:26.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:06:25 smithi132 bash[27079]: cluster 2020-07-16T15:06:24.668576+0000 mgr.x (mgr.34562) 4217 : cluster [DBG] pgmap v2632: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:06:26.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:06:25 smithi188 bash[23329]: cluster 2020-07-16T15:06:24.668576+0000 mgr.x (mgr.34562) 4217 : cluster [DBG] pgmap v2632: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:06:28.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:06:27 smithi132 bash[27079]: cluster 2020-07-16T15:06:26.669063+0000 mgr.x (mgr.34562) 4218 : cluster [DBG] pgmap v2633: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:06:28.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:06:27 smithi132 bash[27079]: audit 2020-07-16T15:06:26.763340+0000 mon.b (mon.2) 969 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:06:28.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:06:27 smithi132 bash[27079]: audit 2020-07-16T15:06:26.763696+0000 mgr.x (mgr.34562) 4219 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:06:28.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:06:27 smithi132 bash[27079]: audit 2020-07-16T15:06:26.764733+0000 mon.b (mon.2) 970 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:06:28.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:06:27 smithi132 bash[27079]: audit 2020-07-16T15:06:26.765076+0000 mgr.x (mgr.34562) 4220 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:06:28.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:06:27 smithi132 bash[27079]: audit 2020-07-16T15:06:26.765914+0000 mon.b (mon.2) 971 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:06:28.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:06:27 smithi132 bash[27079]: audit 2020-07-16T15:06:26.766244+0000 mgr.x (mgr.34562) 4221 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:06:28.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:06:27 smithi132 bash[27079]: cephadm 2020-07-16T15:06:26.766945+0000 mgr.x (mgr.34562) 4222 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:06:28.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:06:27 smithi132 bash[27079]: audit 2020-07-16T15:06:26.767314+0000 mon.b (mon.2) 972 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:06:28.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:06:27 smithi132 bash[27079]: cephadm 2020-07-16T15:06:26.768161+0000 mgr.x (mgr.34562) 4223 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:06:28.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:06:27 smithi132 bash[27079]: audit 2020-07-16T15:06:26.768478+0000 mon.b (mon.2) 973 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:06:28.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:06:27 smithi132 bash[27079]: cephadm 2020-07-16T15:06:26.769155+0000 mgr.x (mgr.34562) 4224 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:06:28.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:06:27 smithi132 bash[27079]: cephadm 2020-07-16T15:06:26.769402+0000 mgr.x (mgr.34562) 4225 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:06:28.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:06:27 smithi188 bash[23329]: cluster 2020-07-16T15:06:26.669063+0000 mgr.x (mgr.34562) 4218 : cluster [DBG] pgmap v2633: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:06:28.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:06:27 smithi188 bash[23329]: audit 2020-07-16T15:06:26.763340+0000 mon.b (mon.2) 969 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:06:28.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:06:27 smithi188 bash[23329]: audit 2020-07-16T15:06:26.763696+0000 mgr.x (mgr.34562) 4219 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:06:28.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:06:27 smithi188 bash[23329]: audit 2020-07-16T15:06:26.764733+0000 mon.b (mon.2) 970 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:06:28.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:06:27 smithi188 bash[23329]: audit 2020-07-16T15:06:26.765076+0000 mgr.x (mgr.34562) 4220 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:06:28.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:06:27 smithi188 bash[23329]: audit 2020-07-16T15:06:26.765914+0000 mon.b (mon.2) 971 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:06:28.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:06:27 smithi188 bash[23329]: audit 2020-07-16T15:06:26.766244+0000 mgr.x (mgr.34562) 4221 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:06:28.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:06:27 smithi188 bash[23329]: cephadm 2020-07-16T15:06:26.766945+0000 mgr.x (mgr.34562) 4222 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:06:28.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:06:27 smithi188 bash[23329]: audit 2020-07-16T15:06:26.767314+0000 mon.b (mon.2) 972 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:06:28.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:06:27 smithi188 bash[23329]: cephadm 2020-07-16T15:06:26.768161+0000 mgr.x (mgr.34562) 4223 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:06:28.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:06:27 smithi188 bash[23329]: audit 2020-07-16T15:06:26.768478+0000 mon.b (mon.2) 973 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:06:28.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:06:27 smithi188 bash[23329]: cephadm 2020-07-16T15:06:26.769155+0000 mgr.x (mgr.34562) 4224 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:06:28.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:06:27 smithi188 bash[23329]: cephadm 2020-07-16T15:06:26.769402+0000 mgr.x (mgr.34562) 4225 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:06:30.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:06:29 smithi132 bash[27079]: cluster 2020-07-16T15:06:28.669540+0000 mgr.x (mgr.34562) 4226 : cluster [DBG] pgmap v2634: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:06:30.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:06:29 smithi132 bash[27079]: audit 2020-07-16T15:06:29.543091+0000 mon.b (mon.2) 974 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:06:30.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:06:29 smithi188 bash[23329]: cluster 2020-07-16T15:06:28.669540+0000 mgr.x (mgr.34562) 4226 : cluster [DBG] pgmap v2634: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:06:30.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:06:29 smithi188 bash[23329]: audit 2020-07-16T15:06:29.543091+0000 mon.b (mon.2) 974 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:06:31.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:06:30 smithi132 bash[27079]: cephadm 2020-07-16T15:06:29.543745+0000 mgr.x (mgr.34562) 4227 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:06:31.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:06:30 smithi132 bash[27079]: cephadm 2020-07-16T15:06:29.544142+0000 mgr.x (mgr.34562) 4228 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:06:31.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:06:30 smithi188 bash[23329]: cephadm 2020-07-16T15:06:29.543745+0000 mgr.x (mgr.34562) 4227 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:06:31.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:06:30 smithi188 bash[23329]: cephadm 2020-07-16T15:06:29.544142+0000 mgr.x (mgr.34562) 4228 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:06:32.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:06:31 smithi132 bash[27079]: cluster 2020-07-16T15:06:30.670065+0000 mgr.x (mgr.34562) 4229 : cluster [DBG] pgmap v2635: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:06:32.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:06:31 smithi188 bash[23329]: cluster 2020-07-16T15:06:30.670065+0000 mgr.x (mgr.34562) 4229 : cluster [DBG] pgmap v2635: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:06:34.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:06:33 smithi132 bash[27079]: cluster 2020-07-16T15:06:32.670633+0000 mgr.x (mgr.34562) 4230 : cluster [DBG] pgmap v2636: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:06:34.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:06:33 smithi188 bash[23329]: cluster 2020-07-16T15:06:32.670633+0000 mgr.x (mgr.34562) 4230 : cluster [DBG] pgmap v2636: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:06:36.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:06:35 smithi132 bash[27079]: cluster 2020-07-16T15:06:34.671084+0000 mgr.x (mgr.34562) 4231 : cluster [DBG] pgmap v2637: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:06:36.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:06:35 smithi188 bash[23329]: cluster 2020-07-16T15:06:34.671084+0000 mgr.x (mgr.34562) 4231 : cluster [DBG] pgmap v2637: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:06:38.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:06:37 smithi132 bash[27079]: cluster 2020-07-16T15:06:36.671461+0000 mgr.x (mgr.34562) 4232 : cluster [DBG] pgmap v2638: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:06:38.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:06:37 smithi188 bash[23329]: cluster 2020-07-16T15:06:36.671461+0000 mgr.x (mgr.34562) 4232 : cluster [DBG] pgmap v2638: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:06:40.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:06:39 smithi132 bash[27079]: cluster 2020-07-16T15:06:38.671815+0000 mgr.x (mgr.34562) 4233 : cluster [DBG] pgmap v2639: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:06:40.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:06:39 smithi188 bash[23329]: cluster 2020-07-16T15:06:38.671815+0000 mgr.x (mgr.34562) 4233 : cluster [DBG] pgmap v2639: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:06:41.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:06:41 smithi188 bash[23329]: cluster 2020-07-16T15:06:40.672345+0000 mgr.x (mgr.34562) 4234 : cluster [DBG] pgmap v2640: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:06:41.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:06:41 smithi132 bash[27079]: cluster 2020-07-16T15:06:40.672345+0000 mgr.x (mgr.34562) 4234 : cluster [DBG] pgmap v2640: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:06:44.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:06:43 smithi132 bash[27079]: cluster 2020-07-16T15:06:42.672917+0000 mgr.x (mgr.34562) 4235 : cluster [DBG] pgmap v2641: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:06:44.155 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:06:44.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:06:43 smithi188 bash[23329]: cluster 2020-07-16T15:06:42.672917+0000 mgr.x (mgr.34562) 4235 : cluster [DBG] pgmap v2641: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:06:44.418 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:06:44.418 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (89m) 3m ago 92m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:06:44.419 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (92m) 3m ago 92m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:06:44.419 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (89m) 3m ago 95m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:06:44.419 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (89m) 3m ago 97m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:06:44.420 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 3m ago 97m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:06:44.420 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (95m) 3m ago 95m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:06:44.420 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (95m) 3m ago 95m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:06:44.420 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (92m) 3m ago 92m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:06:44.421 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (92m) 3m ago 92m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:06:44.421 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (95m) 3m ago 95m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:06:44.421 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (94m) 3m ago 94m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:06:44.421 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (94m) 3m ago 94m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:06:44.428 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (94m) 3m ago 94m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:06:44.428 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (93m) 3m ago 94m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:06:44.428 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (93m) 3m ago 93m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:06:44.429 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (93m) 3m ago 93m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:06:44.429 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (93m) 3m ago 93m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:06:44.429 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (91m) 3m ago 92m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:06:44.721 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:06:44.721 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:06:44.722 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:06:44.722 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:06:44.722 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:06:44.722 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:06:44.722 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:06:44.723 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:06:44.723 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:06:44.723 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:06:44.723 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:06:44.723 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:06:44.724 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:06:44.724 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:06:44.724 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:06:44.724 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:06:44.724 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:06:45.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:06:44 smithi132 bash[27079]: audit 2020-07-16T15:06:44.559735+0000 mon.b (mon.2) 975 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:06:45.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:06:44 smithi132 bash[27079]: audit 2020-07-16T15:06:44.720327+0000 mon.c (mon.1) 315 : audit [DBG] from='client.? 172.21.15.132:0/731302644' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:06:45.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:06:44 smithi188 bash[23329]: audit 2020-07-16T15:06:44.559735+0000 mon.b (mon.2) 975 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:06:45.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:06:44 smithi188 bash[23329]: audit 2020-07-16T15:06:44.720327+0000 mon.c (mon.1) 315 : audit [DBG] from='client.? 172.21.15.132:0/731302644' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:06:46.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:06:45 smithi132 bash[27079]: audit 2020-07-16T15:06:44.143943+0000 mgr.x (mgr.34562) 4236 : audit [DBG] from='client.27718 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:06:46.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:06:45 smithi132 bash[27079]: audit 2020-07-16T15:06:44.413848+0000 mgr.x (mgr.34562) 4237 : audit [DBG] from='client.27724 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:06:46.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:06:45 smithi132 bash[27079]: cephadm 2020-07-16T15:06:44.560442+0000 mgr.x (mgr.34562) 4238 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:06:46.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:06:45 smithi132 bash[27079]: cephadm 2020-07-16T15:06:44.560575+0000 mgr.x (mgr.34562) 4239 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:06:46.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:06:45 smithi132 bash[27079]: cluster 2020-07-16T15:06:44.673434+0000 mgr.x (mgr.34562) 4240 : cluster [DBG] pgmap v2642: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:06:46.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:06:45 smithi188 bash[23329]: audit 2020-07-16T15:06:44.143943+0000 mgr.x (mgr.34562) 4236 : audit [DBG] from='client.27718 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:06:46.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:06:45 smithi188 bash[23329]: audit 2020-07-16T15:06:44.413848+0000 mgr.x (mgr.34562) 4237 : audit [DBG] from='client.27724 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:06:46.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:06:45 smithi188 bash[23329]: cephadm 2020-07-16T15:06:44.560442+0000 mgr.x (mgr.34562) 4238 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:06:46.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:06:45 smithi188 bash[23329]: cephadm 2020-07-16T15:06:44.560575+0000 mgr.x (mgr.34562) 4239 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:06:46.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:06:45 smithi188 bash[23329]: cluster 2020-07-16T15:06:44.673434+0000 mgr.x (mgr.34562) 4240 : cluster [DBG] pgmap v2642: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:06:48.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:06:47 smithi132 bash[27079]: cluster 2020-07-16T15:06:46.673811+0000 mgr.x (mgr.34562) 4241 : cluster [DBG] pgmap v2643: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:06:48.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:06:47 smithi188 bash[23329]: cluster 2020-07-16T15:06:46.673811+0000 mgr.x (mgr.34562) 4241 : cluster [DBG] pgmap v2643: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:06:50.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:06:49 smithi132 bash[27079]: cluster 2020-07-16T15:06:48.674209+0000 mgr.x (mgr.34562) 4242 : cluster [DBG] pgmap v2644: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:06:50.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:06:49 smithi188 bash[23329]: cluster 2020-07-16T15:06:48.674209+0000 mgr.x (mgr.34562) 4242 : cluster [DBG] pgmap v2644: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:06:51.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:06:51 smithi188 bash[23329]: cluster 2020-07-16T15:06:50.674586+0000 mgr.x (mgr.34562) 4243 : cluster [DBG] pgmap v2645: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:06:51.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:06:51 smithi132 bash[27079]: cluster 2020-07-16T15:06:50.674586+0000 mgr.x (mgr.34562) 4243 : cluster [DBG] pgmap v2645: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:06:54.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:06:53 smithi132 bash[27079]: cluster 2020-07-16T15:06:52.675123+0000 mgr.x (mgr.34562) 4244 : cluster [DBG] pgmap v2646: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:06:54.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:06:53 smithi188 bash[23329]: cluster 2020-07-16T15:06:52.675123+0000 mgr.x (mgr.34562) 4244 : cluster [DBG] pgmap v2646: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:06:56.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:06:55 smithi132 bash[27079]: cluster 2020-07-16T15:06:54.675474+0000 mgr.x (mgr.34562) 4245 : cluster [DBG] pgmap v2647: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:06:56.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:06:55 smithi188 bash[23329]: cluster 2020-07-16T15:06:54.675474+0000 mgr.x (mgr.34562) 4245 : cluster [DBG] pgmap v2647: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:06:58.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:06:57 smithi132 bash[27079]: cluster 2020-07-16T15:06:56.675928+0000 mgr.x (mgr.34562) 4246 : cluster [DBG] pgmap v2648: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:06:58.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:06:57 smithi188 bash[23329]: cluster 2020-07-16T15:06:56.675928+0000 mgr.x (mgr.34562) 4246 : cluster [DBG] pgmap v2648: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:07:00.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:06:59 smithi132 bash[27079]: cluster 2020-07-16T15:06:58.676274+0000 mgr.x (mgr.34562) 4247 : cluster [DBG] pgmap v2649: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:07:00.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:06:59 smithi132 bash[27079]: audit 2020-07-16T15:06:59.572180+0000 mon.b (mon.2) 976 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:07:00.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:06:59 smithi188 bash[23329]: cluster 2020-07-16T15:06:58.676274+0000 mgr.x (mgr.34562) 4247 : cluster [DBG] pgmap v2649: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:07:00.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:06:59 smithi188 bash[23329]: audit 2020-07-16T15:06:59.572180+0000 mon.b (mon.2) 976 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:07:01.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:07:00 smithi132 bash[27079]: cephadm 2020-07-16T15:06:59.572882+0000 mgr.x (mgr.34562) 4248 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:07:01.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:07:00 smithi132 bash[27079]: cephadm 2020-07-16T15:06:59.573118+0000 mgr.x (mgr.34562) 4249 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:07:01.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:07:00 smithi188 bash[23329]: cephadm 2020-07-16T15:06:59.572882+0000 mgr.x (mgr.34562) 4248 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:07:01.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:07:00 smithi188 bash[23329]: cephadm 2020-07-16T15:06:59.573118+0000 mgr.x (mgr.34562) 4249 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:07:02.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:07:01 smithi132 bash[27079]: cluster 2020-07-16T15:07:00.676670+0000 mgr.x (mgr.34562) 4250 : cluster [DBG] pgmap v2650: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:07:02.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:07:01 smithi188 bash[23329]: cluster 2020-07-16T15:07:00.676670+0000 mgr.x (mgr.34562) 4250 : cluster [DBG] pgmap v2650: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:07:04.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:07:03 smithi132 bash[27079]: cluster 2020-07-16T15:07:02.677061+0000 mgr.x (mgr.34562) 4251 : cluster [DBG] pgmap v2651: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:07:04.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:07:03 smithi188 bash[23329]: cluster 2020-07-16T15:07:02.677061+0000 mgr.x (mgr.34562) 4251 : cluster [DBG] pgmap v2651: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:07:06.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:07:05 smithi132 bash[27079]: cluster 2020-07-16T15:07:04.677547+0000 mgr.x (mgr.34562) 4252 : cluster [DBG] pgmap v2652: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:07:06.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:07:05 smithi188 bash[23329]: cluster 2020-07-16T15:07:04.677547+0000 mgr.x (mgr.34562) 4252 : cluster [DBG] pgmap v2652: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:07:08.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:07:07 smithi132 bash[27079]: cluster 2020-07-16T15:07:06.677909+0000 mgr.x (mgr.34562) 4253 : cluster [DBG] pgmap v2653: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:07:08.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:07:07 smithi188 bash[23329]: cluster 2020-07-16T15:07:06.677909+0000 mgr.x (mgr.34562) 4253 : cluster [DBG] pgmap v2653: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:07:10.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:07:09 smithi132 bash[27079]: cluster 2020-07-16T15:07:08.678281+0000 mgr.x (mgr.34562) 4254 : cluster [DBG] pgmap v2654: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:07:10.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:07:09 smithi188 bash[23329]: cluster 2020-07-16T15:07:08.678281+0000 mgr.x (mgr.34562) 4254 : cluster [DBG] pgmap v2654: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:07:11.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:07:11 smithi188 bash[23329]: cluster 2020-07-16T15:07:10.678750+0000 mgr.x (mgr.34562) 4255 : cluster [DBG] pgmap v2655: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:07:11.532 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:07:11 smithi132 bash[27079]: cluster 2020-07-16T15:07:10.678750+0000 mgr.x (mgr.34562) 4255 : cluster [DBG] pgmap v2655: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:07:14.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:07:13 smithi132 bash[27079]: cluster 2020-07-16T15:07:12.679131+0000 mgr.x (mgr.34562) 4256 : cluster [DBG] pgmap v2656: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:07:14.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:07:13 smithi188 bash[23329]: cluster 2020-07-16T15:07:12.679131+0000 mgr.x (mgr.34562) 4256 : cluster [DBG] pgmap v2656: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:07:15.022 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:07:15.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:07:14 smithi132 bash[27079]: audit 2020-07-16T15:07:14.586770+0000 mon.b (mon.2) 977 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:07:15.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:07:14 smithi188 bash[23329]: audit 2020-07-16T15:07:14.586770+0000 mon.b (mon.2) 977 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:07:15.286 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:07:15.287 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (90m) 4m ago 93m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:07:15.287 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (92m) 4m ago 92m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:07:15.288 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (90m) 4m ago 95m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:07:15.288 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (89m) 4m ago 97m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:07:15.288 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 4m ago 97m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:07:15.289 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (96m) 4m ago 96m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:07:15.289 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (96m) 4m ago 96m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:07:15.289 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (93m) 4m ago 93m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:07:15.290 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (93m) 4m ago 93m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:07:15.290 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (95m) 4m ago 95m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:07:15.290 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (95m) 4m ago 95m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:07:15.291 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (95m) 4m ago 95m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:07:15.291 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (94m) 4m ago 94m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:07:15.291 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (94m) 4m ago 94m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:07:15.295 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (94m) 4m ago 94m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:07:15.295 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (93m) 4m ago 93m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:07:15.295 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (93m) 4m ago 93m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:07:15.296 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (92m) 4m ago 93m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:07:15.580 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:07:15.580 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:07:15.580 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:07:15.581 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:07:15.581 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:07:15.581 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:07:15.581 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:07:15.582 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:07:15.582 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:07:15.582 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:07:15.582 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:07:15.582 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:07:15.582 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:07:15.583 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:07:15.583 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:07:15.583 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:07:15.583 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:07:16.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:07:15 smithi132 bash[27079]: cephadm 2020-07-16T15:07:14.587510+0000 mgr.x (mgr.34562) 4257 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:07:16.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:07:15 smithi132 bash[27079]: cephadm 2020-07-16T15:07:14.587916+0000 mgr.x (mgr.34562) 4258 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:07:16.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:07:15 smithi132 bash[27079]: cluster 2020-07-16T15:07:14.679479+0000 mgr.x (mgr.34562) 4259 : cluster [DBG] pgmap v2657: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:07:16.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:07:15 smithi132 bash[27079]: audit 2020-07-16T15:07:15.579434+0000 mon.c (mon.1) 316 : audit [DBG] from='client.? 172.21.15.132:0/156981853' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:07:16.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:07:15 smithi188 bash[23329]: cephadm 2020-07-16T15:07:14.587510+0000 mgr.x (mgr.34562) 4257 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:07:16.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:07:15 smithi188 bash[23329]: cephadm 2020-07-16T15:07:14.587916+0000 mgr.x (mgr.34562) 4258 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:07:16.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:07:15 smithi188 bash[23329]: cluster 2020-07-16T15:07:14.679479+0000 mgr.x (mgr.34562) 4259 : cluster [DBG] pgmap v2657: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:07:16.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:07:15 smithi188 bash[23329]: audit 2020-07-16T15:07:15.579434+0000 mon.c (mon.1) 316 : audit [DBG] from='client.? 172.21.15.132:0/156981853' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:07:17.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:07:16 smithi132 bash[27079]: audit 2020-07-16T15:07:15.010275+0000 mgr.x (mgr.34562) 4260 : audit [DBG] from='client.27736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:07:17.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:07:16 smithi132 bash[27079]: audit 2020-07-16T15:07:15.279071+0000 mgr.x (mgr.34562) 4261 : audit [DBG] from='client.27742 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:07:17.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:07:16 smithi188 bash[23329]: audit 2020-07-16T15:07:15.010275+0000 mgr.x (mgr.34562) 4260 : audit [DBG] from='client.27736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:07:17.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:07:16 smithi188 bash[23329]: audit 2020-07-16T15:07:15.279071+0000 mgr.x (mgr.34562) 4261 : audit [DBG] from='client.27742 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:07:18.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:07:17 smithi132 bash[27079]: cluster 2020-07-16T15:07:16.680000+0000 mgr.x (mgr.34562) 4262 : cluster [DBG] pgmap v2658: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:07:18.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:07:17 smithi188 bash[23329]: cluster 2020-07-16T15:07:16.680000+0000 mgr.x (mgr.34562) 4262 : cluster [DBG] pgmap v2658: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:07:20.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:07:19 smithi132 bash[27079]: cluster 2020-07-16T15:07:18.680588+0000 mgr.x (mgr.34562) 4263 : cluster [DBG] pgmap v2659: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:07:20.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:07:19 smithi188 bash[23329]: cluster 2020-07-16T15:07:18.680588+0000 mgr.x (mgr.34562) 4263 : cluster [DBG] pgmap v2659: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:07:21.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:07:21 smithi188 bash[23329]: cluster 2020-07-16T15:07:20.681009+0000 mgr.x (mgr.34562) 4264 : cluster [DBG] pgmap v2660: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:07:21.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:07:21 smithi132 bash[27079]: cluster 2020-07-16T15:07:20.681009+0000 mgr.x (mgr.34562) 4264 : cluster [DBG] pgmap v2660: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:07:24.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:07:23 smithi132 bash[27079]: cluster 2020-07-16T15:07:22.681473+0000 mgr.x (mgr.34562) 4265 : cluster [DBG] pgmap v2661: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:07:24.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:07:23 smithi188 bash[23329]: cluster 2020-07-16T15:07:22.681473+0000 mgr.x (mgr.34562) 4265 : cluster [DBG] pgmap v2661: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:07:26.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:07:25 smithi132 bash[27079]: cluster 2020-07-16T15:07:24.681944+0000 mgr.x (mgr.34562) 4266 : cluster [DBG] pgmap v2662: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:07:26.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:07:25 smithi188 bash[23329]: cluster 2020-07-16T15:07:24.681944+0000 mgr.x (mgr.34562) 4266 : cluster [DBG] pgmap v2662: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:07:28.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:07:27 smithi132 bash[27079]: cluster 2020-07-16T15:07:26.682370+0000 mgr.x (mgr.34562) 4267 : cluster [DBG] pgmap v2663: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:07:28.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:07:27 smithi188 bash[23329]: cluster 2020-07-16T15:07:26.682370+0000 mgr.x (mgr.34562) 4267 : cluster [DBG] pgmap v2663: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:07:30.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:07:29 smithi132 bash[27079]: cluster 2020-07-16T15:07:28.682782+0000 mgr.x (mgr.34562) 4268 : cluster [DBG] pgmap v2664: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:07:30.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:07:29 smithi132 bash[27079]: audit 2020-07-16T15:07:29.606055+0000 mon.b (mon.2) 978 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:07:30.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:07:29 smithi132 bash[27079]: audit 2020-07-16T15:07:29.607457+0000 mon.b (mon.2) 979 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:07:30.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:07:29 smithi132 bash[27079]: audit 2020-07-16T15:07:29.608820+0000 mon.b (mon.2) 980 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:07:30.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:07:29 smithi132 bash[27079]: audit 2020-07-16T15:07:29.610320+0000 mon.b (mon.2) 981 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:07:30.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:07:29 smithi132 bash[27079]: audit 2020-07-16T15:07:29.611715+0000 mon.b (mon.2) 982 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:07:30.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:07:29 smithi188 bash[23329]: cluster 2020-07-16T15:07:28.682782+0000 mgr.x (mgr.34562) 4268 : cluster [DBG] pgmap v2664: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:07:30.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:07:29 smithi188 bash[23329]: audit 2020-07-16T15:07:29.606055+0000 mon.b (mon.2) 978 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:07:30.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:07:29 smithi188 bash[23329]: audit 2020-07-16T15:07:29.607457+0000 mon.b (mon.2) 979 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:07:30.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:07:29 smithi188 bash[23329]: audit 2020-07-16T15:07:29.608820+0000 mon.b (mon.2) 980 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:07:30.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:07:29 smithi188 bash[23329]: audit 2020-07-16T15:07:29.610320+0000 mon.b (mon.2) 981 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:07:30.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:07:29 smithi188 bash[23329]: audit 2020-07-16T15:07:29.611715+0000 mon.b (mon.2) 982 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:07:30.751 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:07:30 smithi132 bash[27079]: audit 2020-07-16T15:07:29.606436+0000 mgr.x (mgr.34562) 4269 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:07:30.751 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:07:30 smithi132 bash[27079]: audit 2020-07-16T15:07:29.607789+0000 mgr.x (mgr.34562) 4270 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:07:30.752 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:07:30 smithi132 bash[27079]: audit 2020-07-16T15:07:29.609108+0000 mgr.x (mgr.34562) 4271 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:07:30.752 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:07:30 smithi132 bash[27079]: cephadm 2020-07-16T15:07:29.609846+0000 mgr.x (mgr.34562) 4272 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:07:30.752 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:07:30 smithi132 bash[27079]: cephadm 2020-07-16T15:07:29.611173+0000 mgr.x (mgr.34562) 4273 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:07:30.752 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:07:30 smithi132 bash[27079]: cephadm 2020-07-16T15:07:29.612451+0000 mgr.x (mgr.34562) 4274 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:07:30.752 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:07:30 smithi132 bash[27079]: cephadm 2020-07-16T15:07:29.612632+0000 mgr.x (mgr.34562) 4275 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:07:31.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:07:30 smithi188 bash[23329]: audit 2020-07-16T15:07:29.606436+0000 mgr.x (mgr.34562) 4269 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:07:31.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:07:30 smithi188 bash[23329]: audit 2020-07-16T15:07:29.607789+0000 mgr.x (mgr.34562) 4270 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:07:31.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:07:30 smithi188 bash[23329]: audit 2020-07-16T15:07:29.609108+0000 mgr.x (mgr.34562) 4271 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:07:31.175 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:07:30 smithi188 bash[23329]: cephadm 2020-07-16T15:07:29.609846+0000 mgr.x (mgr.34562) 4272 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:07:31.175 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:07:30 smithi188 bash[23329]: cephadm 2020-07-16T15:07:29.611173+0000 mgr.x (mgr.34562) 4273 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:07:31.175 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:07:30 smithi188 bash[23329]: cephadm 2020-07-16T15:07:29.612451+0000 mgr.x (mgr.34562) 4274 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:07:31.175 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:07:30 smithi188 bash[23329]: cephadm 2020-07-16T15:07:29.612632+0000 mgr.x (mgr.34562) 4275 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:07:32.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:07:31 smithi132 bash[27079]: cluster 2020-07-16T15:07:30.683313+0000 mgr.x (mgr.34562) 4276 : cluster [DBG] pgmap v2665: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:07:32.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:07:31 smithi188 bash[23329]: cluster 2020-07-16T15:07:30.683313+0000 mgr.x (mgr.34562) 4276 : cluster [DBG] pgmap v2665: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:07:33.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:07:32 smithi132 bash[27079]: audit 2020-07-16T15:07:32.362457+0000 mon.b (mon.2) 983 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:07:33.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:07:32 smithi188 bash[23329]: audit 2020-07-16T15:07:32.362457+0000 mon.b (mon.2) 983 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:07:34.033 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:07:33 smithi132 bash[27079]: cephadm 2020-07-16T15:07:32.363111+0000 mgr.x (mgr.34562) 4277 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:07:34.034 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:07:33 smithi132 bash[27079]: cephadm 2020-07-16T15:07:32.363300+0000 mgr.x (mgr.34562) 4278 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:07:34.034 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:07:33 smithi132 bash[27079]: cluster 2020-07-16T15:07:32.683760+0000 mgr.x (mgr.34562) 4279 : cluster [DBG] pgmap v2666: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:07:34.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:07:33 smithi188 bash[23329]: cephadm 2020-07-16T15:07:32.363111+0000 mgr.x (mgr.34562) 4277 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:07:34.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:07:33 smithi188 bash[23329]: cephadm 2020-07-16T15:07:32.363300+0000 mgr.x (mgr.34562) 4278 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:07:34.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:07:33 smithi188 bash[23329]: cluster 2020-07-16T15:07:32.683760+0000 mgr.x (mgr.34562) 4279 : cluster [DBG] pgmap v2666: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:07:36.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:07:35 smithi132 bash[27079]: cluster 2020-07-16T15:07:34.684132+0000 mgr.x (mgr.34562) 4280 : cluster [DBG] pgmap v2667: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:07:36.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:07:35 smithi188 bash[23329]: cluster 2020-07-16T15:07:34.684132+0000 mgr.x (mgr.34562) 4280 : cluster [DBG] pgmap v2667: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:07:38.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:07:37 smithi132 bash[27079]: cluster 2020-07-16T15:07:36.684639+0000 mgr.x (mgr.34562) 4281 : cluster [DBG] pgmap v2668: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:07:38.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:07:37 smithi188 bash[23329]: cluster 2020-07-16T15:07:36.684639+0000 mgr.x (mgr.34562) 4281 : cluster [DBG] pgmap v2668: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:07:40.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:07:39 smithi132 bash[27079]: cluster 2020-07-16T15:07:38.685131+0000 mgr.x (mgr.34562) 4282 : cluster [DBG] pgmap v2669: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:07:40.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:07:39 smithi188 bash[23329]: cluster 2020-07-16T15:07:38.685131+0000 mgr.x (mgr.34562) 4282 : cluster [DBG] pgmap v2669: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:07:41.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:07:41 smithi188 bash[23329]: cluster 2020-07-16T15:07:40.685587+0000 mgr.x (mgr.34562) 4283 : cluster [DBG] pgmap v2670: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:07:41.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:07:41 smithi132 bash[27079]: cluster 2020-07-16T15:07:40.685587+0000 mgr.x (mgr.34562) 4283 : cluster [DBG] pgmap v2670: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:07:44.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:07:43 smithi132 bash[27079]: cluster 2020-07-16T15:07:42.686029+0000 mgr.x (mgr.34562) 4284 : cluster [DBG] pgmap v2671: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:07:44.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:07:43 smithi188 bash[23329]: cluster 2020-07-16T15:07:42.686029+0000 mgr.x (mgr.34562) 4284 : cluster [DBG] pgmap v2671: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:07:45.879 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:07:46.034 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:07:45 smithi132 bash[27079]: cluster 2020-07-16T15:07:44.686430+0000 mgr.x (mgr.34562) 4285 : cluster [DBG] pgmap v2672: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:07:46.141 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:07:46.142 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (90m) 4m ago 93m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:07:46.142 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (93m) 4m ago 93m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:07:46.142 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (90m) 4m ago 96m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:07:46.143 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (90m) 4m ago 98m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:07:46.143 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 4m ago 98m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:07:46.143 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (96m) 4m ago 96m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:07:46.143 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (96m) 4m ago 96m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:07:46.143 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (93m) 4m ago 93m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:07:46.144 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (93m) 4m ago 93m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:07:46.144 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (96m) 4m ago 96m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:07:46.144 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (95m) 4m ago 95m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:07:46.144 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (95m) 4m ago 95m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:07:46.144 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (95m) 4m ago 95m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:07:46.145 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (94m) 4m ago 95m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:07:46.145 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (94m) 4m ago 94m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:07:46.145 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (94m) 4m ago 94m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:07:46.145 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (94m) 4m ago 94m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:07:46.145 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (92m) 4m ago 93m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:07:46.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:07:45 smithi188 bash[23329]: cluster 2020-07-16T15:07:44.686430+0000 mgr.x (mgr.34562) 4285 : cluster [DBG] pgmap v2672: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:07:46.440 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:07:46.441 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:07:46.441 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:07:46.441 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:07:46.441 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:07:46.442 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:07:46.442 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:07:46.442 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:07:46.442 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:07:46.442 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:07:46.443 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:07:46.443 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:07:46.443 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:07:46.443 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:07:46.443 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:07:46.444 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:07:46.444 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:07:47.035 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:07:46 smithi132 bash[27079]: audit 2020-07-16T15:07:46.439589+0000 mon.c (mon.1) 317 : audit [DBG] from='client.? 172.21.15.132:0/2005904407' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:07:47.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:07:46 smithi188 bash[23329]: audit 2020-07-16T15:07:46.439589+0000 mon.c (mon.1) 317 : audit [DBG] from='client.? 172.21.15.132:0/2005904407' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:07:48.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:07:47 smithi132 bash[27079]: audit 2020-07-16T15:07:45.867225+0000 mgr.x (mgr.34562) 4286 : audit [DBG] from='client.27754 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:07:48.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:07:47 smithi132 bash[27079]: audit 2020-07-16T15:07:46.137004+0000 mgr.x (mgr.34562) 4287 : audit [DBG] from='client.27760 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:07:48.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:07:47 smithi132 bash[27079]: cluster 2020-07-16T15:07:46.686937+0000 mgr.x (mgr.34562) 4288 : cluster [DBG] pgmap v2673: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:07:48.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:07:47 smithi132 bash[27079]: audit 2020-07-16T15:07:47.379135+0000 mon.b (mon.2) 984 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:07:48.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:07:47 smithi188 bash[23329]: audit 2020-07-16T15:07:45.867225+0000 mgr.x (mgr.34562) 4286 : audit [DBG] from='client.27754 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:07:48.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:07:47 smithi188 bash[23329]: audit 2020-07-16T15:07:46.137004+0000 mgr.x (mgr.34562) 4287 : audit [DBG] from='client.27760 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:07:48.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:07:47 smithi188 bash[23329]: cluster 2020-07-16T15:07:46.686937+0000 mgr.x (mgr.34562) 4288 : cluster [DBG] pgmap v2673: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:07:48.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:07:47 smithi188 bash[23329]: audit 2020-07-16T15:07:47.379135+0000 mon.b (mon.2) 984 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:07:49.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:07:48 smithi132 bash[27079]: cephadm 2020-07-16T15:07:47.379866+0000 mgr.x (mgr.34562) 4289 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:07:49.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:07:48 smithi132 bash[27079]: cephadm 2020-07-16T15:07:47.380311+0000 mgr.x (mgr.34562) 4290 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:07:49.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:07:48 smithi188 bash[23329]: cephadm 2020-07-16T15:07:47.379866+0000 mgr.x (mgr.34562) 4289 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:07:49.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:07:48 smithi188 bash[23329]: cephadm 2020-07-16T15:07:47.380311+0000 mgr.x (mgr.34562) 4290 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:07:50.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:07:49 smithi132 bash[27079]: cluster 2020-07-16T15:07:48.687394+0000 mgr.x (mgr.34562) 4291 : cluster [DBG] pgmap v2674: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:07:50.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:07:49 smithi188 bash[23329]: cluster 2020-07-16T15:07:48.687394+0000 mgr.x (mgr.34562) 4291 : cluster [DBG] pgmap v2674: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:07:51.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:07:51 smithi188 bash[23329]: cluster 2020-07-16T15:07:50.687905+0000 mgr.x (mgr.34562) 4292 : cluster [DBG] pgmap v2675: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:07:51.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:07:51 smithi132 bash[27079]: cluster 2020-07-16T15:07:50.687905+0000 mgr.x (mgr.34562) 4292 : cluster [DBG] pgmap v2675: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:07:54.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:07:53 smithi132 bash[27079]: cluster 2020-07-16T15:07:52.688297+0000 mgr.x (mgr.34562) 4293 : cluster [DBG] pgmap v2676: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:07:54.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:07:53 smithi188 bash[23329]: cluster 2020-07-16T15:07:52.688297+0000 mgr.x (mgr.34562) 4293 : cluster [DBG] pgmap v2676: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:07:56.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:07:55 smithi132 bash[27079]: cluster 2020-07-16T15:07:54.688677+0000 mgr.x (mgr.34562) 4294 : cluster [DBG] pgmap v2677: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:07:56.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:07:55 smithi188 bash[23329]: cluster 2020-07-16T15:07:54.688677+0000 mgr.x (mgr.34562) 4294 : cluster [DBG] pgmap v2677: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:07:58.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:07:57 smithi132 bash[27079]: cluster 2020-07-16T15:07:56.689168+0000 mgr.x (mgr.34562) 4295 : cluster [DBG] pgmap v2678: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:07:58.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:07:57 smithi188 bash[23329]: cluster 2020-07-16T15:07:56.689168+0000 mgr.x (mgr.34562) 4295 : cluster [DBG] pgmap v2678: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:08:00.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:07:59 smithi132 bash[27079]: cluster 2020-07-16T15:07:58.689657+0000 mgr.x (mgr.34562) 4296 : cluster [DBG] pgmap v2679: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:08:00.178 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:07:59 smithi188 bash[23329]: cluster 2020-07-16T15:07:58.689657+0000 mgr.x (mgr.34562) 4296 : cluster [DBG] pgmap v2679: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:08:01.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:08:01 smithi188 bash[23329]: cluster 2020-07-16T15:08:00.690047+0000 mgr.x (mgr.34562) 4297 : cluster [DBG] pgmap v2680: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:08:01.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:08:01 smithi132 bash[27079]: cluster 2020-07-16T15:08:00.690047+0000 mgr.x (mgr.34562) 4297 : cluster [DBG] pgmap v2680: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:08:02.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:08:02 smithi132 bash[27079]: audit 2020-07-16T15:08:02.395872+0000 mon.b (mon.2) 985 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:08:02.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:08:02 smithi188 bash[23329]: audit 2020-07-16T15:08:02.395872+0000 mon.b (mon.2) 985 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:08:03.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:08:03 smithi132 bash[27079]: cephadm 2020-07-16T15:08:02.396550+0000 mgr.x (mgr.34562) 4298 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:08:03.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:08:03 smithi132 bash[27079]: cephadm 2020-07-16T15:08:02.396966+0000 mgr.x (mgr.34562) 4299 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:08:03.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:08:03 smithi132 bash[27079]: cluster 2020-07-16T15:08:02.690607+0000 mgr.x (mgr.34562) 4300 : cluster [DBG] pgmap v2681: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:08:03.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:08:03 smithi188 bash[23329]: cephadm 2020-07-16T15:08:02.396550+0000 mgr.x (mgr.34562) 4298 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:08:03.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:08:03 smithi188 bash[23329]: cephadm 2020-07-16T15:08:02.396966+0000 mgr.x (mgr.34562) 4299 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:08:03.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:08:03 smithi188 bash[23329]: cluster 2020-07-16T15:08:02.690607+0000 mgr.x (mgr.34562) 4300 : cluster [DBG] pgmap v2681: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:08:06.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:08:05 smithi132 bash[27079]: cluster 2020-07-16T15:08:04.691153+0000 mgr.x (mgr.34562) 4301 : cluster [DBG] pgmap v2682: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:08:06.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:08:05 smithi188 bash[23329]: cluster 2020-07-16T15:08:04.691153+0000 mgr.x (mgr.34562) 4301 : cluster [DBG] pgmap v2682: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:08:08.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:08:07 smithi132 bash[27079]: cluster 2020-07-16T15:08:06.691541+0000 mgr.x (mgr.34562) 4302 : cluster [DBG] pgmap v2683: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:08:08.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:08:07 smithi188 bash[23329]: cluster 2020-07-16T15:08:06.691541+0000 mgr.x (mgr.34562) 4302 : cluster [DBG] pgmap v2683: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:08:10.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:08:09 smithi132 bash[27079]: cluster 2020-07-16T15:08:08.692033+0000 mgr.x (mgr.34562) 4303 : cluster [DBG] pgmap v2684: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:08:10.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:08:09 smithi188 bash[23329]: cluster 2020-07-16T15:08:08.692033+0000 mgr.x (mgr.34562) 4303 : cluster [DBG] pgmap v2684: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:08:11.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:08:11 smithi188 bash[23329]: cluster 2020-07-16T15:08:10.692489+0000 mgr.x (mgr.34562) 4304 : cluster [DBG] pgmap v2685: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:08:11.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:08:11 smithi132 bash[27079]: cluster 2020-07-16T15:08:10.692489+0000 mgr.x (mgr.34562) 4304 : cluster [DBG] pgmap v2685: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:08:14.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:08:13 smithi132 bash[27079]: cluster 2020-07-16T15:08:12.692903+0000 mgr.x (mgr.34562) 4305 : cluster [DBG] pgmap v2686: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:08:14.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:08:13 smithi188 bash[23329]: cluster 2020-07-16T15:08:12.692903+0000 mgr.x (mgr.34562) 4305 : cluster [DBG] pgmap v2686: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:08:16.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:08:15 smithi132 bash[27079]: cluster 2020-07-16T15:08:14.693469+0000 mgr.x (mgr.34562) 4306 : cluster [DBG] pgmap v2687: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:08:16.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:08:15 smithi188 bash[23329]: cluster 2020-07-16T15:08:14.693469+0000 mgr.x (mgr.34562) 4306 : cluster [DBG] pgmap v2687: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:08:16.744 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:08:16.998 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:08:16.998 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (91m) 5m ago 94m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:08:16.998 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (93m) 5m ago 93m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:08:16.998 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (91m) 5m ago 96m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:08:16.999 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (90m) 5m ago 98m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:08:16.999 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 5m ago 98m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:08:16.999 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (97m) 5m ago 97m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:08:16.999 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (97m) 5m ago 97m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:08:16.999 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (94m) 5m ago 94m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:08:17.000 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (94m) 5m ago 94m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:08:17.000 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (96m) 5m ago 96m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:08:17.000 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (96m) 5m ago 96m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:08:17.000 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (96m) 5m ago 96m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:08:17.000 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (95m) 5m ago 95m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:08:17.001 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (95m) 5m ago 95m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:08:17.001 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (95m) 5m ago 95m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:08:17.001 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (94m) 5m ago 94m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:08:17.001 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (94m) 5m ago 94m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:08:17.001 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (93m) 5m ago 94m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:08:17.293 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:08:17.294 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:08:17.294 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:08:17.294 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:08:17.294 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:08:17.294 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:08:17.295 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:08:17.295 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:08:17.295 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:08:17.295 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:08:17.295 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:08:17.296 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:08:17.296 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:08:17.296 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:08:17.296 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:08:17.296 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:08:17.297 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:08:18.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:08:17 smithi132 bash[27079]: cluster 2020-07-16T15:08:16.693930+0000 mgr.x (mgr.34562) 4307 : cluster [DBG] pgmap v2688: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:08:18.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:08:17 smithi132 bash[27079]: audit 2020-07-16T15:08:16.727670+0000 mgr.x (mgr.34562) 4308 : audit [DBG] from='client.27772 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:08:18.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:08:17 smithi132 bash[27079]: audit 2020-07-16T15:08:17.292795+0000 mon.c (mon.1) 318 : audit [DBG] from='client.? 172.21.15.132:0/3419100138' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:08:18.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:08:17 smithi132 bash[27079]: audit 2020-07-16T15:08:17.405675+0000 mon.b (mon.2) 986 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:08:18.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:08:17 smithi188 bash[23329]: cluster 2020-07-16T15:08:16.693930+0000 mgr.x (mgr.34562) 4307 : cluster [DBG] pgmap v2688: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:08:18.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:08:17 smithi188 bash[23329]: audit 2020-07-16T15:08:16.727670+0000 mgr.x (mgr.34562) 4308 : audit [DBG] from='client.27772 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:08:18.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:08:17 smithi188 bash[23329]: audit 2020-07-16T15:08:17.292795+0000 mon.c (mon.1) 318 : audit [DBG] from='client.? 172.21.15.132:0/3419100138' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:08:18.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:08:17 smithi188 bash[23329]: audit 2020-07-16T15:08:17.405675+0000 mon.b (mon.2) 986 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:08:19.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:08:18 smithi132 bash[27079]: audit 2020-07-16T15:08:16.993475+0000 mgr.x (mgr.34562) 4309 : audit [DBG] from='client.27778 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:08:19.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:08:18 smithi132 bash[27079]: cephadm 2020-07-16T15:08:17.406348+0000 mgr.x (mgr.34562) 4310 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:08:19.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:08:18 smithi132 bash[27079]: cephadm 2020-07-16T15:08:17.406427+0000 mgr.x (mgr.34562) 4311 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:08:19.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:08:18 smithi188 bash[23329]: audit 2020-07-16T15:08:16.993475+0000 mgr.x (mgr.34562) 4309 : audit [DBG] from='client.27778 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:08:19.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:08:18 smithi188 bash[23329]: cephadm 2020-07-16T15:08:17.406348+0000 mgr.x (mgr.34562) 4310 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:08:19.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:08:18 smithi188 bash[23329]: cephadm 2020-07-16T15:08:17.406427+0000 mgr.x (mgr.34562) 4311 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:08:20.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:08:19 smithi132 bash[27079]: cluster 2020-07-16T15:08:18.694391+0000 mgr.x (mgr.34562) 4312 : cluster [DBG] pgmap v2689: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:08:20.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:08:19 smithi188 bash[23329]: cluster 2020-07-16T15:08:18.694391+0000 mgr.x (mgr.34562) 4312 : cluster [DBG] pgmap v2689: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:08:21.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:08:21 smithi188 bash[23329]: cluster 2020-07-16T15:08:20.694794+0000 mgr.x (mgr.34562) 4313 : cluster [DBG] pgmap v2690: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:08:21.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:08:21 smithi132 bash[27079]: cluster 2020-07-16T15:08:20.694794+0000 mgr.x (mgr.34562) 4313 : cluster [DBG] pgmap v2690: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:08:24.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:08:23 smithi132 bash[27079]: cluster 2020-07-16T15:08:22.695355+0000 mgr.x (mgr.34562) 4314 : cluster [DBG] pgmap v2691: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:08:24.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:08:23 smithi188 bash[23329]: cluster 2020-07-16T15:08:22.695355+0000 mgr.x (mgr.34562) 4314 : cluster [DBG] pgmap v2691: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:08:26.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:08:25 smithi132 bash[27079]: cluster 2020-07-16T15:08:24.695796+0000 mgr.x (mgr.34562) 4315 : cluster [DBG] pgmap v2692: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:08:26.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:08:25 smithi188 bash[23329]: cluster 2020-07-16T15:08:24.695796+0000 mgr.x (mgr.34562) 4315 : cluster [DBG] pgmap v2692: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:08:28.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:08:27 smithi132 bash[27079]: cluster 2020-07-16T15:08:26.696248+0000 mgr.x (mgr.34562) 4316 : cluster [DBG] pgmap v2693: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:08:28.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:08:27 smithi188 bash[23329]: cluster 2020-07-16T15:08:26.696248+0000 mgr.x (mgr.34562) 4316 : cluster [DBG] pgmap v2693: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:08:30.034 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:08:29 smithi132 bash[27079]: cluster 2020-07-16T15:08:28.696714+0000 mgr.x (mgr.34562) 4317 : cluster [DBG] pgmap v2694: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:08:30.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:08:29 smithi188 bash[23329]: cluster 2020-07-16T15:08:28.696714+0000 mgr.x (mgr.34562) 4317 : cluster [DBG] pgmap v2694: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:08:31.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:08:31 smithi188 bash[23329]: cluster 2020-07-16T15:08:30.697098+0000 mgr.x (mgr.34562) 4318 : cluster [DBG] pgmap v2695: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:08:31.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:08:31 smithi132 bash[27079]: cluster 2020-07-16T15:08:30.697098+0000 mgr.x (mgr.34562) 4318 : cluster [DBG] pgmap v2695: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:08:32.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:08:32 smithi132 bash[27079]: audit 2020-07-16T15:08:32.424687+0000 mon.b (mon.2) 987 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:08:32.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:08:32 smithi132 bash[27079]: audit 2020-07-16T15:08:32.426069+0000 mon.b (mon.2) 988 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:08:32.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:08:32 smithi132 bash[27079]: audit 2020-07-16T15:08:32.427322+0000 mon.b (mon.2) 989 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:08:32.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:08:32 smithi132 bash[27079]: audit 2020-07-16T15:08:32.428774+0000 mon.b (mon.2) 990 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:08:32.782 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:08:32 smithi132 bash[27079]: audit 2020-07-16T15:08:32.429938+0000 mon.b (mon.2) 991 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:08:32.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:08:32 smithi188 bash[23329]: audit 2020-07-16T15:08:32.424687+0000 mon.b (mon.2) 987 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:08:32.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:08:32 smithi188 bash[23329]: audit 2020-07-16T15:08:32.426069+0000 mon.b (mon.2) 988 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:08:32.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:08:32 smithi188 bash[23329]: audit 2020-07-16T15:08:32.427322+0000 mon.b (mon.2) 989 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:08:32.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:08:32 smithi188 bash[23329]: audit 2020-07-16T15:08:32.428774+0000 mon.b (mon.2) 990 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:08:32.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:08:32 smithi188 bash[23329]: audit 2020-07-16T15:08:32.429938+0000 mon.b (mon.2) 991 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:08:33.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:08:33 smithi132 bash[27079]: audit 2020-07-16T15:08:32.425063+0000 mgr.x (mgr.34562) 4319 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:08:33.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:08:33 smithi132 bash[27079]: audit 2020-07-16T15:08:32.426425+0000 mgr.x (mgr.34562) 4320 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:08:33.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:08:33 smithi132 bash[27079]: audit 2020-07-16T15:08:32.427606+0000 mgr.x (mgr.34562) 4321 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:08:33.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:08:33 smithi132 bash[27079]: cephadm 2020-07-16T15:08:32.428333+0000 mgr.x (mgr.34562) 4322 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:08:33.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:08:33 smithi132 bash[27079]: cephadm 2020-07-16T15:08:32.429597+0000 mgr.x (mgr.34562) 4323 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:08:33.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:08:33 smithi132 bash[27079]: cephadm 2020-07-16T15:08:32.430653+0000 mgr.x (mgr.34562) 4324 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:08:33.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:08:33 smithi132 bash[27079]: cephadm 2020-07-16T15:08:32.430943+0000 mgr.x (mgr.34562) 4325 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:08:33.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:08:33 smithi132 bash[27079]: cluster 2020-07-16T15:08:32.697522+0000 mgr.x (mgr.34562) 4326 : cluster [DBG] pgmap v2696: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:08:33.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:08:33 smithi188 bash[23329]: audit 2020-07-16T15:08:32.425063+0000 mgr.x (mgr.34562) 4319 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:08:33.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:08:33 smithi188 bash[23329]: audit 2020-07-16T15:08:32.426425+0000 mgr.x (mgr.34562) 4320 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:08:33.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:08:33 smithi188 bash[23329]: audit 2020-07-16T15:08:32.427606+0000 mgr.x (mgr.34562) 4321 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:08:33.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:08:33 smithi188 bash[23329]: cephadm 2020-07-16T15:08:32.428333+0000 mgr.x (mgr.34562) 4322 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:08:33.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:08:33 smithi188 bash[23329]: cephadm 2020-07-16T15:08:32.429597+0000 mgr.x (mgr.34562) 4323 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:08:33.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:08:33 smithi188 bash[23329]: cephadm 2020-07-16T15:08:32.430653+0000 mgr.x (mgr.34562) 4324 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:08:33.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:08:33 smithi188 bash[23329]: cephadm 2020-07-16T15:08:32.430943+0000 mgr.x (mgr.34562) 4325 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:08:33.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:08:33 smithi188 bash[23329]: cluster 2020-07-16T15:08:32.697522+0000 mgr.x (mgr.34562) 4326 : cluster [DBG] pgmap v2696: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:08:36.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:08:35 smithi132 bash[27079]: cluster 2020-07-16T15:08:34.698028+0000 mgr.x (mgr.34562) 4327 : cluster [DBG] pgmap v2697: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:08:36.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:08:35 smithi132 bash[27079]: audit 2020-07-16T15:08:35.227050+0000 mon.b (mon.2) 992 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:08:36.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:08:35 smithi188 bash[23329]: cluster 2020-07-16T15:08:34.698028+0000 mgr.x (mgr.34562) 4327 : cluster [DBG] pgmap v2697: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:08:36.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:08:35 smithi188 bash[23329]: audit 2020-07-16T15:08:35.227050+0000 mon.b (mon.2) 992 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:08:37.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:08:36 smithi132 bash[27079]: cephadm 2020-07-16T15:08:35.227646+0000 mgr.x (mgr.34562) 4328 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:08:37.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:08:36 smithi132 bash[27079]: cephadm 2020-07-16T15:08:35.227917+0000 mgr.x (mgr.34562) 4329 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:08:37.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:08:36 smithi188 bash[23329]: cephadm 2020-07-16T15:08:35.227646+0000 mgr.x (mgr.34562) 4328 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:08:37.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:08:36 smithi188 bash[23329]: cephadm 2020-07-16T15:08:35.227917+0000 mgr.x (mgr.34562) 4329 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:08:38.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:08:37 smithi132 bash[27079]: cluster 2020-07-16T15:08:36.698459+0000 mgr.x (mgr.34562) 4330 : cluster [DBG] pgmap v2698: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:08:38.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:08:37 smithi188 bash[23329]: cluster 2020-07-16T15:08:36.698459+0000 mgr.x (mgr.34562) 4330 : cluster [DBG] pgmap v2698: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:08:40.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:08:39 smithi132 bash[27079]: cluster 2020-07-16T15:08:38.698934+0000 mgr.x (mgr.34562) 4331 : cluster [DBG] pgmap v2699: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:08:40.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:08:39 smithi188 bash[23329]: cluster 2020-07-16T15:08:38.698934+0000 mgr.x (mgr.34562) 4331 : cluster [DBG] pgmap v2699: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:08:41.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:08:41 smithi188 bash[23329]: cluster 2020-07-16T15:08:40.699279+0000 mgr.x (mgr.34562) 4332 : cluster [DBG] pgmap v2700: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:08:41.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:08:41 smithi132 bash[27079]: cluster 2020-07-16T15:08:40.699279+0000 mgr.x (mgr.34562) 4332 : cluster [DBG] pgmap v2700: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:08:44.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:08:43 smithi132 bash[27079]: cluster 2020-07-16T15:08:42.699658+0000 mgr.x (mgr.34562) 4333 : cluster [DBG] pgmap v2701: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:08:44.175 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:08:43 smithi188 bash[23329]: cluster 2020-07-16T15:08:42.699658+0000 mgr.x (mgr.34562) 4333 : cluster [DBG] pgmap v2701: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:08:46.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:08:45 smithi132 bash[27079]: cluster 2020-07-16T15:08:44.700126+0000 mgr.x (mgr.34562) 4334 : cluster [DBG] pgmap v2702: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:08:46.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:08:45 smithi188 bash[23329]: cluster 2020-07-16T15:08:44.700126+0000 mgr.x (mgr.34562) 4334 : cluster [DBG] pgmap v2702: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:08:47.594 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:08:47.856 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:08:47.856 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (91m) 5m ago 94m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:08:47.856 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (94m) 5m ago 94m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:08:47.856 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (91m) 5m ago 97m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:08:47.857 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (91m) 5m ago 99m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:08:47.857 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 5m ago 99m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:08:47.857 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (97m) 5m ago 97m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:08:47.857 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (97m) 5m ago 97m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:08:47.858 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (94m) 5m ago 94m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:08:47.858 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (94m) 5m ago 94m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:08:47.858 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (97m) 5m ago 97m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:08:47.858 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (96m) 5m ago 96m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:08:47.858 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (96m) 5m ago 96m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:08:47.859 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (96m) 5m ago 96m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:08:47.859 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (95m) 5m ago 96m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:08:47.859 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (95m) 5m ago 95m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:08:47.859 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (95m) 5m ago 95m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:08:47.859 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (95m) 5m ago 95m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:08:47.860 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (94m) 5m ago 94m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:08:48.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:08:47 smithi132 bash[27079]: cluster 2020-07-16T15:08:46.700633+0000 mgr.x (mgr.34562) 4335 : cluster [DBG] pgmap v2703: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:08:48.156 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:08:48.156 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:08:48.156 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:08:48.156 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:08:48.157 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:08:48.157 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:08:48.157 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:08:48.157 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:08:48.157 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:08:48.158 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:08:48.158 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:08:48.158 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:08:48.158 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:08:48.159 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:08:48.159 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:08:48.159 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:08:48.159 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:08:48.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:08:47 smithi188 bash[23329]: cluster 2020-07-16T15:08:46.700633+0000 mgr.x (mgr.34562) 4335 : cluster [DBG] pgmap v2703: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:08:49.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:08:48 smithi132 bash[27079]: audit 2020-07-16T15:08:47.582554+0000 mgr.x (mgr.34562) 4336 : audit [DBG] from='client.27790 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:08:49.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:08:48 smithi132 bash[27079]: audit 2020-07-16T15:08:48.154998+0000 mon.c (mon.1) 319 : audit [DBG] from='client.? 172.21.15.132:0/1838498179' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:08:49.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:08:48 smithi188 bash[23329]: audit 2020-07-16T15:08:47.582554+0000 mgr.x (mgr.34562) 4336 : audit [DBG] from='client.27790 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:08:49.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:08:48 smithi188 bash[23329]: audit 2020-07-16T15:08:48.154998+0000 mon.c (mon.1) 319 : audit [DBG] from='client.? 172.21.15.132:0/1838498179' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:08:50.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:08:49 smithi132 bash[27079]: audit 2020-07-16T15:08:47.851583+0000 mgr.x (mgr.34562) 4337 : audit [DBG] from='client.27796 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:08:50.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:08:49 smithi132 bash[27079]: cluster 2020-07-16T15:08:48.701159+0000 mgr.x (mgr.34562) 4338 : cluster [DBG] pgmap v2704: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:08:50.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:08:49 smithi188 bash[23329]: audit 2020-07-16T15:08:47.851583+0000 mgr.x (mgr.34562) 4337 : audit [DBG] from='client.27796 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:08:50.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:08:49 smithi188 bash[23329]: cluster 2020-07-16T15:08:48.701159+0000 mgr.x (mgr.34562) 4338 : cluster [DBG] pgmap v2704: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:08:51.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:08:51 smithi188 bash[23329]: audit 2020-07-16T15:08:50.243425+0000 mon.b (mon.2) 993 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:08:51.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:08:51 smithi188 bash[23329]: cephadm 2020-07-16T15:08:50.244157+0000 mgr.x (mgr.34562) 4339 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:08:51.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:08:51 smithi188 bash[23329]: cephadm 2020-07-16T15:08:50.244575+0000 mgr.x (mgr.34562) 4340 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:08:51.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:08:51 smithi188 bash[23329]: cluster 2020-07-16T15:08:50.701547+0000 mgr.x (mgr.34562) 4341 : cluster [DBG] pgmap v2705: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:08:51.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:08:51 smithi132 bash[27079]: audit 2020-07-16T15:08:50.243425+0000 mon.b (mon.2) 993 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:08:51.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:08:51 smithi132 bash[27079]: cephadm 2020-07-16T15:08:50.244157+0000 mgr.x (mgr.34562) 4339 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:08:51.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:08:51 smithi132 bash[27079]: cephadm 2020-07-16T15:08:50.244575+0000 mgr.x (mgr.34562) 4340 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:08:51.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:08:51 smithi132 bash[27079]: cluster 2020-07-16T15:08:50.701547+0000 mgr.x (mgr.34562) 4341 : cluster [DBG] pgmap v2705: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:08:54.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:08:53 smithi132 bash[27079]: cluster 2020-07-16T15:08:52.702083+0000 mgr.x (mgr.34562) 4342 : cluster [DBG] pgmap v2706: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:08:54.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:08:53 smithi188 bash[23329]: cluster 2020-07-16T15:08:52.702083+0000 mgr.x (mgr.34562) 4342 : cluster [DBG] pgmap v2706: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:08:56.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:08:55 smithi132 bash[27079]: cluster 2020-07-16T15:08:54.702566+0000 mgr.x (mgr.34562) 4343 : cluster [DBG] pgmap v2707: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:08:56.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:08:55 smithi188 bash[23329]: cluster 2020-07-16T15:08:54.702566+0000 mgr.x (mgr.34562) 4343 : cluster [DBG] pgmap v2707: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:08:58.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:08:57 smithi132 bash[27079]: cluster 2020-07-16T15:08:56.702950+0000 mgr.x (mgr.34562) 4344 : cluster [DBG] pgmap v2708: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:08:58.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:08:57 smithi188 bash[23329]: cluster 2020-07-16T15:08:56.702950+0000 mgr.x (mgr.34562) 4344 : cluster [DBG] pgmap v2708: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:09:00.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:08:59 smithi132 bash[27079]: cluster 2020-07-16T15:08:58.703361+0000 mgr.x (mgr.34562) 4345 : cluster [DBG] pgmap v2709: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:09:00.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:08:59 smithi188 bash[23329]: cluster 2020-07-16T15:08:58.703361+0000 mgr.x (mgr.34562) 4345 : cluster [DBG] pgmap v2709: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:09:01.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:09:01 smithi188 bash[23329]: cluster 2020-07-16T15:09:00.703794+0000 mgr.x (mgr.34562) 4346 : cluster [DBG] pgmap v2710: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:09:01.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:09:01 smithi132 bash[27079]: cluster 2020-07-16T15:09:00.703794+0000 mgr.x (mgr.34562) 4346 : cluster [DBG] pgmap v2710: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:09:04.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:09:03 smithi132 bash[27079]: cluster 2020-07-16T15:09:02.704183+0000 mgr.x (mgr.34562) 4347 : cluster [DBG] pgmap v2711: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:09:04.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:09:03 smithi188 bash[23329]: cluster 2020-07-16T15:09:02.704183+0000 mgr.x (mgr.34562) 4347 : cluster [DBG] pgmap v2711: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:09:06.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:09:05 smithi132 bash[27079]: cluster 2020-07-16T15:09:04.704536+0000 mgr.x (mgr.34562) 4348 : cluster [DBG] pgmap v2712: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:09:06.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:09:05 smithi132 bash[27079]: audit 2020-07-16T15:09:05.260068+0000 mon.b (mon.2) 994 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:09:06.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:09:05 smithi188 bash[23329]: cluster 2020-07-16T15:09:04.704536+0000 mgr.x (mgr.34562) 4348 : cluster [DBG] pgmap v2712: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:09:06.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:09:05 smithi188 bash[23329]: audit 2020-07-16T15:09:05.260068+0000 mon.b (mon.2) 994 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:09:07.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:09:06 smithi132 bash[27079]: cephadm 2020-07-16T15:09:05.260801+0000 mgr.x (mgr.34562) 4349 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:09:07.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:09:06 smithi132 bash[27079]: cephadm 2020-07-16T15:09:05.261106+0000 mgr.x (mgr.34562) 4350 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:09:07.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:09:06 smithi188 bash[23329]: cephadm 2020-07-16T15:09:05.260801+0000 mgr.x (mgr.34562) 4349 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:09:07.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:09:06 smithi188 bash[23329]: cephadm 2020-07-16T15:09:05.261106+0000 mgr.x (mgr.34562) 4350 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:09:08.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:09:07 smithi132 bash[27079]: cluster 2020-07-16T15:09:06.705141+0000 mgr.x (mgr.34562) 4351 : cluster [DBG] pgmap v2713: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:09:08.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:09:07 smithi188 bash[23329]: cluster 2020-07-16T15:09:06.705141+0000 mgr.x (mgr.34562) 4351 : cluster [DBG] pgmap v2713: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:09:10.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:09:09 smithi132 bash[27079]: cluster 2020-07-16T15:09:08.705567+0000 mgr.x (mgr.34562) 4352 : cluster [DBG] pgmap v2714: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:09:10.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:09:09 smithi188 bash[23329]: cluster 2020-07-16T15:09:08.705567+0000 mgr.x (mgr.34562) 4352 : cluster [DBG] pgmap v2714: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:09:11.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:09:11 smithi188 bash[23329]: cluster 2020-07-16T15:09:10.706056+0000 mgr.x (mgr.34562) 4353 : cluster [DBG] pgmap v2715: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:09:11.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:09:11 smithi132 bash[27079]: cluster 2020-07-16T15:09:10.706056+0000 mgr.x (mgr.34562) 4353 : cluster [DBG] pgmap v2715: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:09:14.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:09:13 smithi132 bash[27079]: cluster 2020-07-16T15:09:12.706455+0000 mgr.x (mgr.34562) 4354 : cluster [DBG] pgmap v2716: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:09:14.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:09:13 smithi188 bash[23329]: cluster 2020-07-16T15:09:12.706455+0000 mgr.x (mgr.34562) 4354 : cluster [DBG] pgmap v2716: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:09:16.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:09:15 smithi132 bash[27079]: cluster 2020-07-16T15:09:14.706963+0000 mgr.x (mgr.34562) 4355 : cluster [DBG] pgmap v2717: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:09:16.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:09:15 smithi188 bash[23329]: cluster 2020-07-16T15:09:14.706963+0000 mgr.x (mgr.34562) 4355 : cluster [DBG] pgmap v2717: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:09:18.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:09:17 smithi132 bash[27079]: cluster 2020-07-16T15:09:16.707415+0000 mgr.x (mgr.34562) 4356 : cluster [DBG] pgmap v2718: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:09:18.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:09:17 smithi188 bash[23329]: cluster 2020-07-16T15:09:16.707415+0000 mgr.x (mgr.34562) 4356 : cluster [DBG] pgmap v2718: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:09:18.456 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:09:18.717 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:09:18.717 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (92m) 6m ago 95m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:09:18.717 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (94m) 6m ago 94m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:09:18.717 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (92m) 6m ago 97m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:09:18.718 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (91m) 6m ago 99m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:09:18.718 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 6m ago 99m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:09:18.718 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (98m) 6m ago 98m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:09:18.718 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (98m) 6m ago 98m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:09:18.719 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (95m) 6m ago 95m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:09:18.719 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (95m) 6m ago 95m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:09:18.719 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (97m) 6m ago 97m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:09:18.719 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (97m) 6m ago 97m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:09:18.719 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (97m) 6m ago 97m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:09:18.719 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (96m) 6m ago 96m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:09:18.720 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (96m) 6m ago 96m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:09:18.720 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (96m) 6m ago 96m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:09:18.720 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (95m) 6m ago 95m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:09:18.720 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (95m) 6m ago 95m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:09:18.720 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (94m) 6m ago 95m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:09:19.012 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:09:19.013 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:09:19.013 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:09:19.013 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:09:19.014 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:09:19.014 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:09:19.014 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:09:19.014 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:09:19.014 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:09:19.015 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:09:19.015 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:09:19.015 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:09:19.015 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:09:19.015 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:09:19.015 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:09:19.016 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:09:19.016 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:09:20.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:09:19 smithi132 bash[27079]: audit 2020-07-16T15:09:18.444953+0000 mgr.x (mgr.34562) 4357 : audit [DBG] from='client.27808 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:09:20.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:09:19 smithi132 bash[27079]: cluster 2020-07-16T15:09:18.707883+0000 mgr.x (mgr.34562) 4358 : cluster [DBG] pgmap v2719: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:09:20.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:09:19 smithi132 bash[27079]: audit 2020-07-16T15:09:18.712743+0000 mgr.x (mgr.34562) 4359 : audit [DBG] from='client.27814 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:09:20.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:09:19 smithi132 bash[27079]: audit 2020-07-16T15:09:19.011922+0000 mon.c (mon.1) 320 : audit [DBG] from='client.? 172.21.15.132:0/3313404172' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:09:20.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:09:19 smithi188 bash[23329]: audit 2020-07-16T15:09:18.444953+0000 mgr.x (mgr.34562) 4357 : audit [DBG] from='client.27808 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:09:20.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:09:19 smithi188 bash[23329]: cluster 2020-07-16T15:09:18.707883+0000 mgr.x (mgr.34562) 4358 : cluster [DBG] pgmap v2719: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:09:20.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:09:19 smithi188 bash[23329]: audit 2020-07-16T15:09:18.712743+0000 mgr.x (mgr.34562) 4359 : audit [DBG] from='client.27814 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:09:20.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:09:19 smithi188 bash[23329]: audit 2020-07-16T15:09:19.011922+0000 mon.c (mon.1) 320 : audit [DBG] from='client.? 172.21.15.132:0/3313404172' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:09:21.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:09:21 smithi188 bash[23329]: audit 2020-07-16T15:09:20.273766+0000 mon.b (mon.2) 995 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:09:21.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:09:21 smithi188 bash[23329]: cephadm 2020-07-16T15:09:20.274526+0000 mgr.x (mgr.34562) 4360 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:09:21.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:09:21 smithi188 bash[23329]: cephadm 2020-07-16T15:09:20.274935+0000 mgr.x (mgr.34562) 4361 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:09:21.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:09:21 smithi188 bash[23329]: cluster 2020-07-16T15:09:20.708430+0000 mgr.x (mgr.34562) 4362 : cluster [DBG] pgmap v2720: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:09:21.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:09:21 smithi132 bash[27079]: audit 2020-07-16T15:09:20.273766+0000 mon.b (mon.2) 995 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:09:21.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:09:21 smithi132 bash[27079]: cephadm 2020-07-16T15:09:20.274526+0000 mgr.x (mgr.34562) 4360 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:09:21.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:09:21 smithi132 bash[27079]: cephadm 2020-07-16T15:09:20.274935+0000 mgr.x (mgr.34562) 4361 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:09:21.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:09:21 smithi132 bash[27079]: cluster 2020-07-16T15:09:20.708430+0000 mgr.x (mgr.34562) 4362 : cluster [DBG] pgmap v2720: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:09:24.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:09:23 smithi132 bash[27079]: cluster 2020-07-16T15:09:22.708877+0000 mgr.x (mgr.34562) 4363 : cluster [DBG] pgmap v2721: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:09:24.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:09:23 smithi188 bash[23329]: cluster 2020-07-16T15:09:22.708877+0000 mgr.x (mgr.34562) 4363 : cluster [DBG] pgmap v2721: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:09:26.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:09:25 smithi132 bash[27079]: cluster 2020-07-16T15:09:24.709328+0000 mgr.x (mgr.34562) 4364 : cluster [DBG] pgmap v2722: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:09:26.180 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:09:25 smithi188 bash[23329]: cluster 2020-07-16T15:09:24.709328+0000 mgr.x (mgr.34562) 4364 : cluster [DBG] pgmap v2722: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:09:28.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:09:27 smithi132 bash[27079]: cluster 2020-07-16T15:09:26.709697+0000 mgr.x (mgr.34562) 4365 : cluster [DBG] pgmap v2723: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:09:28.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:09:27 smithi188 bash[23329]: cluster 2020-07-16T15:09:26.709697+0000 mgr.x (mgr.34562) 4365 : cluster [DBG] pgmap v2723: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:09:30.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:09:29 smithi132 bash[27079]: cluster 2020-07-16T15:09:28.710045+0000 mgr.x (mgr.34562) 4366 : cluster [DBG] pgmap v2724: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:09:30.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:09:29 smithi188 bash[23329]: cluster 2020-07-16T15:09:28.710045+0000 mgr.x (mgr.34562) 4366 : cluster [DBG] pgmap v2724: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:09:31.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:09:31 smithi188 bash[23329]: cluster 2020-07-16T15:09:30.710448+0000 mgr.x (mgr.34562) 4367 : cluster [DBG] pgmap v2725: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:09:31.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:09:31 smithi132 bash[27079]: cluster 2020-07-16T15:09:30.710448+0000 mgr.x (mgr.34562) 4367 : cluster [DBG] pgmap v2725: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:09:34.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:09:33 smithi132 bash[27079]: cluster 2020-07-16T15:09:32.710793+0000 mgr.x (mgr.34562) 4368 : cluster [DBG] pgmap v2726: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:09:34.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:09:33 smithi188 bash[23329]: cluster 2020-07-16T15:09:32.710793+0000 mgr.x (mgr.34562) 4368 : cluster [DBG] pgmap v2726: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:09:36.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:09:35 smithi132 bash[27079]: cluster 2020-07-16T15:09:34.711311+0000 mgr.x (mgr.34562) 4369 : cluster [DBG] pgmap v2727: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:09:36.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:09:35 smithi132 bash[27079]: audit 2020-07-16T15:09:35.280360+0000 mon.b (mon.2) 996 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:09:36.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:09:35 smithi132 bash[27079]: audit 2020-07-16T15:09:35.281779+0000 mon.b (mon.2) 997 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:09:36.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:09:35 smithi132 bash[27079]: audit 2020-07-16T15:09:35.282984+0000 mon.b (mon.2) 998 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:09:36.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:09:35 smithi132 bash[27079]: audit 2020-07-16T15:09:35.284457+0000 mon.b (mon.2) 999 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:09:36.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:09:35 smithi132 bash[27079]: audit 2020-07-16T15:09:35.285611+0000 mon.b (mon.2) 1000 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:09:36.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:09:35 smithi188 bash[23329]: cluster 2020-07-16T15:09:34.711311+0000 mgr.x (mgr.34562) 4369 : cluster [DBG] pgmap v2727: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:09:36.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:09:35 smithi188 bash[23329]: audit 2020-07-16T15:09:35.280360+0000 mon.b (mon.2) 996 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:09:36.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:09:35 smithi188 bash[23329]: audit 2020-07-16T15:09:35.281779+0000 mon.b (mon.2) 997 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:09:36.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:09:35 smithi188 bash[23329]: audit 2020-07-16T15:09:35.282984+0000 mon.b (mon.2) 998 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:09:36.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:09:35 smithi188 bash[23329]: audit 2020-07-16T15:09:35.284457+0000 mon.b (mon.2) 999 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:09:36.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:09:35 smithi188 bash[23329]: audit 2020-07-16T15:09:35.285611+0000 mon.b (mon.2) 1000 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:09:37.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:09:36 smithi132 bash[27079]: audit 2020-07-16T15:09:35.280727+0000 mgr.x (mgr.34562) 4370 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:09:37.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:09:36 smithi132 bash[27079]: audit 2020-07-16T15:09:35.282088+0000 mgr.x (mgr.34562) 4371 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:09:37.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:09:36 smithi132 bash[27079]: audit 2020-07-16T15:09:35.283254+0000 mgr.x (mgr.34562) 4372 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:09:37.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:09:36 smithi132 bash[27079]: cephadm 2020-07-16T15:09:35.284004+0000 mgr.x (mgr.34562) 4373 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:09:37.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:09:36 smithi132 bash[27079]: cephadm 2020-07-16T15:09:35.285276+0000 mgr.x (mgr.34562) 4374 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:09:37.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:09:36 smithi132 bash[27079]: cephadm 2020-07-16T15:09:35.286362+0000 mgr.x (mgr.34562) 4375 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:09:37.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:09:36 smithi132 bash[27079]: cephadm 2020-07-16T15:09:35.286432+0000 mgr.x (mgr.34562) 4376 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:09:37.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:09:36 smithi188 bash[23329]: audit 2020-07-16T15:09:35.280727+0000 mgr.x (mgr.34562) 4370 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:09:37.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:09:36 smithi188 bash[23329]: audit 2020-07-16T15:09:35.282088+0000 mgr.x (mgr.34562) 4371 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:09:37.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:09:36 smithi188 bash[23329]: audit 2020-07-16T15:09:35.283254+0000 mgr.x (mgr.34562) 4372 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:09:37.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:09:36 smithi188 bash[23329]: cephadm 2020-07-16T15:09:35.284004+0000 mgr.x (mgr.34562) 4373 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:09:37.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:09:36 smithi188 bash[23329]: cephadm 2020-07-16T15:09:35.285276+0000 mgr.x (mgr.34562) 4374 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:09:37.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:09:36 smithi188 bash[23329]: cephadm 2020-07-16T15:09:35.286362+0000 mgr.x (mgr.34562) 4375 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:09:37.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:09:36 smithi188 bash[23329]: cephadm 2020-07-16T15:09:35.286432+0000 mgr.x (mgr.34562) 4376 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:09:38.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:09:37 smithi132 bash[27079]: cluster 2020-07-16T15:09:36.711857+0000 mgr.x (mgr.34562) 4377 : cluster [DBG] pgmap v2728: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:09:38.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:09:37 smithi188 bash[23329]: cluster 2020-07-16T15:09:36.711857+0000 mgr.x (mgr.34562) 4377 : cluster [DBG] pgmap v2728: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:09:39.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:09:38 smithi188 bash[23329]: audit 2020-07-16T15:09:38.121685+0000 mon.b (mon.2) 1001 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:09:39.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:09:38 smithi132 bash[27079]: audit 2020-07-16T15:09:38.121685+0000 mon.b (mon.2) 1001 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:09:40.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:09:39 smithi188 bash[23329]: cephadm 2020-07-16T15:09:38.122248+0000 mgr.x (mgr.34562) 4378 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:09:40.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:09:39 smithi188 bash[23329]: cephadm 2020-07-16T15:09:38.122332+0000 mgr.x (mgr.34562) 4379 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:09:40.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:09:39 smithi188 bash[23329]: cluster 2020-07-16T15:09:38.712327+0000 mgr.x (mgr.34562) 4380 : cluster [DBG] pgmap v2729: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:09:40.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:09:39 smithi132 bash[27079]: cephadm 2020-07-16T15:09:38.122248+0000 mgr.x (mgr.34562) 4378 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:09:40.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:09:39 smithi132 bash[27079]: cephadm 2020-07-16T15:09:38.122332+0000 mgr.x (mgr.34562) 4379 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:09:40.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:09:39 smithi132 bash[27079]: cluster 2020-07-16T15:09:38.712327+0000 mgr.x (mgr.34562) 4380 : cluster [DBG] pgmap v2729: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:09:41.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:09:41 smithi132 bash[27079]: cluster 2020-07-16T15:09:40.712797+0000 mgr.x (mgr.34562) 4381 : cluster [DBG] pgmap v2730: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:09:41.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:09:41 smithi188 bash[23329]: cluster 2020-07-16T15:09:40.712797+0000 mgr.x (mgr.34562) 4381 : cluster [DBG] pgmap v2730: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:09:44.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:09:43 smithi132 bash[27079]: cluster 2020-07-16T15:09:42.713164+0000 mgr.x (mgr.34562) 4382 : cluster [DBG] pgmap v2731: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:09:44.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:09:43 smithi188 bash[23329]: cluster 2020-07-16T15:09:42.713164+0000 mgr.x (mgr.34562) 4382 : cluster [DBG] pgmap v2731: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:09:46.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:09:45 smithi132 bash[27079]: cluster 2020-07-16T15:09:44.713516+0000 mgr.x (mgr.34562) 4383 : cluster [DBG] pgmap v2732: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:09:46.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:09:45 smithi188 bash[23329]: cluster 2020-07-16T15:09:44.713516+0000 mgr.x (mgr.34562) 4383 : cluster [DBG] pgmap v2732: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:09:48.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:09:47 smithi132 bash[27079]: cluster 2020-07-16T15:09:46.714129+0000 mgr.x (mgr.34562) 4384 : cluster [DBG] pgmap v2733: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:09:48.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:09:47 smithi188 bash[23329]: cluster 2020-07-16T15:09:46.714129+0000 mgr.x (mgr.34562) 4384 : cluster [DBG] pgmap v2733: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:09:49.312 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:09:49.575 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:09:49.575 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (92m) 6m ago 95m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:09:49.575 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (95m) 6m ago 95m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:09:49.575 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (92m) 6m ago 98m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:09:49.576 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (92m) 6m ago 100m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:09:49.576 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 6m ago 100m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:09:49.576 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (98m) 6m ago 98m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:09:49.576 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (98m) 6m ago 98m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:09:49.576 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (95m) 6m ago 95m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:09:49.577 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (95m) 6m ago 95m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:09:49.577 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (98m) 6m ago 98m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:09:49.577 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (97m) 6m ago 97m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:09:49.577 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (97m) 6m ago 97m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:09:49.577 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (97m) 6m ago 97m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:09:49.578 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (96m) 6m ago 97m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:09:49.578 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (96m) 6m ago 96m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:09:49.578 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (96m) 6m ago 96m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:09:49.578 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (96m) 6m ago 96m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:09:49.579 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (95m) 6m ago 95m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:09:49.890 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:09:49.890 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:09:49.891 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:09:49.891 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:09:49.891 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:09:49.891 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:09:49.891 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:09:49.892 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:09:49.892 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:09:49.892 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:09:49.892 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:09:49.892 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:09:49.893 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:09:49.893 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:09:49.893 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:09:49.893 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:09:49.893 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:09:50.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:09:49 smithi132 bash[27079]: cluster 2020-07-16T15:09:48.714713+0000 mgr.x (mgr.34562) 4385 : cluster [DBG] pgmap v2734: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:09:50.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:09:49 smithi188 bash[23329]: cluster 2020-07-16T15:09:48.714713+0000 mgr.x (mgr.34562) 4385 : cluster [DBG] pgmap v2734: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:09:51.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:09:50 smithi188 bash[23329]: audit 2020-07-16T15:09:49.301257+0000 mgr.x (mgr.34562) 4386 : audit [DBG] from='client.27826 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:09:51.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:09:50 smithi188 bash[23329]: audit 2020-07-16T15:09:49.570791+0000 mgr.x (mgr.34562) 4387 : audit [DBG] from='client.27832 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:09:51.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:09:50 smithi188 bash[23329]: audit 2020-07-16T15:09:49.889501+0000 mon.c (mon.1) 321 : audit [DBG] from='client.? 172.21.15.132:0/414751689' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:09:51.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:09:50 smithi132 bash[27079]: audit 2020-07-16T15:09:49.301257+0000 mgr.x (mgr.34562) 4386 : audit [DBG] from='client.27826 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:09:51.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:09:50 smithi132 bash[27079]: audit 2020-07-16T15:09:49.570791+0000 mgr.x (mgr.34562) 4387 : audit [DBG] from='client.27832 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:09:51.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:09:50 smithi132 bash[27079]: audit 2020-07-16T15:09:49.889501+0000 mon.c (mon.1) 321 : audit [DBG] from='client.? 172.21.15.132:0/414751689' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:09:52.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:09:51 smithi188 bash[23329]: cluster 2020-07-16T15:09:50.715102+0000 mgr.x (mgr.34562) 4388 : cluster [DBG] pgmap v2735: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:09:52.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:09:51 smithi132 bash[27079]: cluster 2020-07-16T15:09:50.715102+0000 mgr.x (mgr.34562) 4388 : cluster [DBG] pgmap v2735: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:09:54.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:09:53 smithi188 bash[23329]: cluster 2020-07-16T15:09:52.715513+0000 mgr.x (mgr.34562) 4389 : cluster [DBG] pgmap v2736: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:09:54.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:09:53 smithi188 bash[23329]: audit 2020-07-16T15:09:53.128045+0000 mon.b (mon.2) 1002 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:09:54.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:09:53 smithi132 bash[27079]: cluster 2020-07-16T15:09:52.715513+0000 mgr.x (mgr.34562) 4389 : cluster [DBG] pgmap v2736: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:09:54.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:09:53 smithi132 bash[27079]: audit 2020-07-16T15:09:53.128045+0000 mon.b (mon.2) 1002 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:09:55.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:09:54 smithi188 bash[23329]: cephadm 2020-07-16T15:09:53.128811+0000 mgr.x (mgr.34562) 4390 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:09:55.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:09:54 smithi188 bash[23329]: cephadm 2020-07-16T15:09:53.129182+0000 mgr.x (mgr.34562) 4391 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:09:55.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:09:54 smithi132 bash[27079]: cephadm 2020-07-16T15:09:53.128811+0000 mgr.x (mgr.34562) 4390 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:09:55.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:09:54 smithi132 bash[27079]: cephadm 2020-07-16T15:09:53.129182+0000 mgr.x (mgr.34562) 4391 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:09:56.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:09:55 smithi188 bash[23329]: cluster 2020-07-16T15:09:54.715857+0000 mgr.x (mgr.34562) 4392 : cluster [DBG] pgmap v2737: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:09:56.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:09:55 smithi132 bash[27079]: cluster 2020-07-16T15:09:54.715857+0000 mgr.x (mgr.34562) 4392 : cluster [DBG] pgmap v2737: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:09:58.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:09:57 smithi188 bash[23329]: cluster 2020-07-16T15:09:56.716295+0000 mgr.x (mgr.34562) 4393 : cluster [DBG] pgmap v2738: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:09:58.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:09:57 smithi132 bash[27079]: cluster 2020-07-16T15:09:56.716295+0000 mgr.x (mgr.34562) 4393 : cluster [DBG] pgmap v2738: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:10:00.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:09:59 smithi188 bash[23329]: cluster 2020-07-16T15:09:58.716747+0000 mgr.x (mgr.34562) 4394 : cluster [DBG] pgmap v2739: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:10:00.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:09:59 smithi132 bash[27079]: cluster 2020-07-16T15:09:58.716747+0000 mgr.x (mgr.34562) 4394 : cluster [DBG] pgmap v2739: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:10:01.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:10:01 smithi132 bash[27079]: cluster 2020-07-16T15:10:00.717142+0000 mgr.x (mgr.34562) 4395 : cluster [DBG] pgmap v2740: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:10:01.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:10:01 smithi188 bash[23329]: cluster 2020-07-16T15:10:00.717142+0000 mgr.x (mgr.34562) 4395 : cluster [DBG] pgmap v2740: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:10:04.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:10:03 smithi132 bash[27079]: cluster 2020-07-16T15:10:02.717591+0000 mgr.x (mgr.34562) 4396 : cluster [DBG] pgmap v2741: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:10:04.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:10:03 smithi188 bash[23329]: cluster 2020-07-16T15:10:02.717591+0000 mgr.x (mgr.34562) 4396 : cluster [DBG] pgmap v2741: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:10:06.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:10:05 smithi132 bash[27079]: cluster 2020-07-16T15:10:04.717884+0000 mgr.x (mgr.34562) 4397 : cluster [DBG] pgmap v2742: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:10:06.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:10:05 smithi188 bash[23329]: cluster 2020-07-16T15:10:04.717884+0000 mgr.x (mgr.34562) 4397 : cluster [DBG] pgmap v2742: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:10:08.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:10:07 smithi188 bash[23329]: cluster 2020-07-16T15:10:06.718332+0000 mgr.x (mgr.34562) 4398 : cluster [DBG] pgmap v2743: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:10:08.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:10:07 smithi132 bash[27079]: cluster 2020-07-16T15:10:06.718332+0000 mgr.x (mgr.34562) 4398 : cluster [DBG] pgmap v2743: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:10:09.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:10:08 smithi188 bash[23329]: audit 2020-07-16T15:10:08.136297+0000 mon.b (mon.2) 1003 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:10:09.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:10:08 smithi132 bash[27079]: audit 2020-07-16T15:10:08.136297+0000 mon.b (mon.2) 1003 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:10:10.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:10:09 smithi188 bash[23329]: cephadm 2020-07-16T15:10:08.137015+0000 mgr.x (mgr.34562) 4399 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:10:10.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:10:09 smithi188 bash[23329]: cephadm 2020-07-16T15:10:08.137249+0000 mgr.x (mgr.34562) 4400 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:10:10.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:10:09 smithi188 bash[23329]: cluster 2020-07-16T15:10:08.718665+0000 mgr.x (mgr.34562) 4401 : cluster [DBG] pgmap v2744: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:10:10.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:10:09 smithi132 bash[27079]: cephadm 2020-07-16T15:10:08.137015+0000 mgr.x (mgr.34562) 4399 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:10:10.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:10:09 smithi132 bash[27079]: cephadm 2020-07-16T15:10:08.137249+0000 mgr.x (mgr.34562) 4400 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:10:10.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:10:09 smithi132 bash[27079]: cluster 2020-07-16T15:10:08.718665+0000 mgr.x (mgr.34562) 4401 : cluster [DBG] pgmap v2744: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:10:11.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:10:11 smithi132 bash[27079]: cluster 2020-07-16T15:10:10.719069+0000 mgr.x (mgr.34562) 4402 : cluster [DBG] pgmap v2745: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:10:11.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:10:11 smithi188 bash[23329]: cluster 2020-07-16T15:10:10.719069+0000 mgr.x (mgr.34562) 4402 : cluster [DBG] pgmap v2745: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:10:14.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:10:13 smithi132 bash[27079]: cluster 2020-07-16T15:10:12.719449+0000 mgr.x (mgr.34562) 4403 : cluster [DBG] pgmap v2746: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:10:14.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:10:13 smithi188 bash[23329]: cluster 2020-07-16T15:10:12.719449+0000 mgr.x (mgr.34562) 4403 : cluster [DBG] pgmap v2746: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:10:16.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:10:15 smithi132 bash[27079]: cluster 2020-07-16T15:10:14.719774+0000 mgr.x (mgr.34562) 4404 : cluster [DBG] pgmap v2747: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:10:16.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:10:15 smithi188 bash[23329]: cluster 2020-07-16T15:10:14.719774+0000 mgr.x (mgr.34562) 4404 : cluster [DBG] pgmap v2747: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:10:18.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:10:17 smithi188 bash[23329]: cluster 2020-07-16T15:10:16.720340+0000 mgr.x (mgr.34562) 4405 : cluster [DBG] pgmap v2748: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:10:18.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:10:17 smithi132 bash[27079]: cluster 2020-07-16T15:10:16.720340+0000 mgr.x (mgr.34562) 4405 : cluster [DBG] pgmap v2748: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:10:20.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:10:19 smithi188 bash[23329]: cluster 2020-07-16T15:10:18.720680+0000 mgr.x (mgr.34562) 4406 : cluster [DBG] pgmap v2749: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:10:20.187 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:10:20.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:10:19 smithi132 bash[27079]: cluster 2020-07-16T15:10:18.720680+0000 mgr.x (mgr.34562) 4406 : cluster [DBG] pgmap v2749: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:10:20.449 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:10:20.449 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (93m) 7m ago 96m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:10:20.449 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (95m) 7m ago 95m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:10:20.449 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (93m) 7m ago 98m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:10:20.450 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (92m) 7m ago 100m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:10:20.450 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 7m ago 100m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:10:20.450 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (99m) 7m ago 99m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:10:20.450 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (99m) 7m ago 99m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:10:20.450 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (96m) 7m ago 96m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:10:20.451 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (96m) 7m ago 96m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:10:20.451 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (98m) 7m ago 98m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:10:20.451 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (98m) 7m ago 98m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:10:20.451 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (98m) 7m ago 98m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:10:20.451 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (97m) 7m ago 97m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:10:20.452 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (97m) 7m ago 97m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:10:20.452 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (97m) 7m ago 97m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:10:20.452 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (96m) 7m ago 97m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:10:20.452 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (96m) 7m ago 96m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:10:20.452 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (95m) 7m ago 96m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:10:20.745 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:10:20.745 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:10:20.745 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:10:20.745 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:10:20.746 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:10:20.746 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:10:20.746 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:10:20.746 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:10:20.746 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:10:20.747 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:10:20.747 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:10:20.747 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:10:20.747 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:10:20.747 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:10:20.748 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:10:20.748 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:10:20.748 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:10:21.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:10:21 smithi132 bash[27079]: audit 2020-07-16T15:10:20.175757+0000 mgr.x (mgr.34562) 4407 : audit [DBG] from='client.27844 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:10:21.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:10:21 smithi132 bash[27079]: audit 2020-07-16T15:10:20.444381+0000 mgr.x (mgr.34562) 4408 : audit [DBG] from='client.27850 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:10:21.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:10:21 smithi132 bash[27079]: cluster 2020-07-16T15:10:20.721019+0000 mgr.x (mgr.34562) 4409 : cluster [DBG] pgmap v2750: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:10:21.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:10:21 smithi132 bash[27079]: audit 2020-07-16T15:10:20.744037+0000 mon.c (mon.1) 322 : audit [DBG] from='client.? 172.21.15.132:0/2800370107' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:10:21.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:10:21 smithi188 bash[23329]: audit 2020-07-16T15:10:20.175757+0000 mgr.x (mgr.34562) 4407 : audit [DBG] from='client.27844 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:10:21.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:10:21 smithi188 bash[23329]: audit 2020-07-16T15:10:20.444381+0000 mgr.x (mgr.34562) 4408 : audit [DBG] from='client.27850 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:10:21.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:10:21 smithi188 bash[23329]: cluster 2020-07-16T15:10:20.721019+0000 mgr.x (mgr.34562) 4409 : cluster [DBG] pgmap v2750: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:10:21.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:10:21 smithi188 bash[23329]: audit 2020-07-16T15:10:20.744037+0000 mon.c (mon.1) 322 : audit [DBG] from='client.? 172.21.15.132:0/2800370107' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:10:24.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:10:23 smithi132 bash[27079]: cluster 2020-07-16T15:10:22.721516+0000 mgr.x (mgr.34562) 4410 : cluster [DBG] pgmap v2751: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:10:24.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:10:23 smithi132 bash[27079]: audit 2020-07-16T15:10:23.152397+0000 mon.b (mon.2) 1004 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:10:24.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:10:23 smithi188 bash[23329]: cluster 2020-07-16T15:10:22.721516+0000 mgr.x (mgr.34562) 4410 : cluster [DBG] pgmap v2751: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:10:24.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:10:23 smithi188 bash[23329]: audit 2020-07-16T15:10:23.152397+0000 mon.b (mon.2) 1004 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:10:25.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:10:24 smithi188 bash[23329]: cephadm 2020-07-16T15:10:23.153134+0000 mgr.x (mgr.34562) 4411 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:10:25.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:10:24 smithi188 bash[23329]: cephadm 2020-07-16T15:10:23.153256+0000 mgr.x (mgr.34562) 4412 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:10:25.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:10:24 smithi132 bash[27079]: cephadm 2020-07-16T15:10:23.153134+0000 mgr.x (mgr.34562) 4411 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:10:25.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:10:24 smithi132 bash[27079]: cephadm 2020-07-16T15:10:23.153256+0000 mgr.x (mgr.34562) 4412 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:10:26.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:10:25 smithi188 bash[23329]: cluster 2020-07-16T15:10:24.721929+0000 mgr.x (mgr.34562) 4413 : cluster [DBG] pgmap v2752: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:10:26.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:10:25 smithi132 bash[27079]: cluster 2020-07-16T15:10:24.721929+0000 mgr.x (mgr.34562) 4413 : cluster [DBG] pgmap v2752: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:10:28.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:10:27 smithi188 bash[23329]: cluster 2020-07-16T15:10:26.722513+0000 mgr.x (mgr.34562) 4414 : cluster [DBG] pgmap v2753: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:10:28.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:10:27 smithi132 bash[27079]: cluster 2020-07-16T15:10:26.722513+0000 mgr.x (mgr.34562) 4414 : cluster [DBG] pgmap v2753: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:10:30.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:10:29 smithi188 bash[23329]: cluster 2020-07-16T15:10:28.722947+0000 mgr.x (mgr.34562) 4415 : cluster [DBG] pgmap v2754: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:10:30.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:10:29 smithi132 bash[27079]: cluster 2020-07-16T15:10:28.722947+0000 mgr.x (mgr.34562) 4415 : cluster [DBG] pgmap v2754: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:10:31.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:10:31 smithi132 bash[27079]: cluster 2020-07-16T15:10:30.723431+0000 mgr.x (mgr.34562) 4416 : cluster [DBG] pgmap v2755: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:10:31.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:10:31 smithi188 bash[23329]: cluster 2020-07-16T15:10:30.723431+0000 mgr.x (mgr.34562) 4416 : cluster [DBG] pgmap v2755: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:10:34.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:10:33 smithi188 bash[23329]: cluster 2020-07-16T15:10:32.723834+0000 mgr.x (mgr.34562) 4417 : cluster [DBG] pgmap v2756: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:10:34.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:10:33 smithi132 bash[27079]: cluster 2020-07-16T15:10:32.723834+0000 mgr.x (mgr.34562) 4417 : cluster [DBG] pgmap v2756: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:10:36.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:10:35 smithi188 bash[23329]: cluster 2020-07-16T15:10:34.724157+0000 mgr.x (mgr.34562) 4418 : cluster [DBG] pgmap v2757: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:10:36.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:10:35 smithi132 bash[27079]: cluster 2020-07-16T15:10:34.724157+0000 mgr.x (mgr.34562) 4418 : cluster [DBG] pgmap v2757: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:10:38.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:10:37 smithi188 bash[23329]: cluster 2020-07-16T15:10:36.724471+0000 mgr.x (mgr.34562) 4419 : cluster [DBG] pgmap v2758: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:10:38.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:10:37 smithi132 bash[27079]: cluster 2020-07-16T15:10:36.724471+0000 mgr.x (mgr.34562) 4419 : cluster [DBG] pgmap v2758: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:10:38.957 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:10:38 smithi132 bash[27079]: audit 2020-07-16T15:10:38.171946+0000 mon.b (mon.2) 1005 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:10:38.957 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:10:38 smithi132 bash[27079]: audit 2020-07-16T15:10:38.173266+0000 mon.b (mon.2) 1006 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:10:38.957 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:10:38 smithi132 bash[27079]: audit 2020-07-16T15:10:38.174485+0000 mon.b (mon.2) 1007 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:10:38.958 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:10:38 smithi132 bash[27079]: audit 2020-07-16T15:10:38.175924+0000 mon.b (mon.2) 1008 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:10:38.958 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:10:38 smithi132 bash[27079]: audit 2020-07-16T15:10:38.177207+0000 mon.b (mon.2) 1009 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:10:39.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:10:38 smithi188 bash[23329]: audit 2020-07-16T15:10:38.171946+0000 mon.b (mon.2) 1005 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:10:39.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:10:38 smithi188 bash[23329]: audit 2020-07-16T15:10:38.173266+0000 mon.b (mon.2) 1006 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:10:39.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:10:38 smithi188 bash[23329]: audit 2020-07-16T15:10:38.174485+0000 mon.b (mon.2) 1007 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:10:39.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:10:38 smithi188 bash[23329]: audit 2020-07-16T15:10:38.175924+0000 mon.b (mon.2) 1008 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:10:39.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:10:38 smithi188 bash[23329]: audit 2020-07-16T15:10:38.177207+0000 mon.b (mon.2) 1009 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:10:40.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:10:39 smithi132 bash[27079]: audit 2020-07-16T15:10:38.172323+0000 mgr.x (mgr.34562) 4420 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:10:40.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:10:39 smithi132 bash[27079]: audit 2020-07-16T15:10:38.173624+0000 mgr.x (mgr.34562) 4421 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:10:40.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:10:39 smithi132 bash[27079]: audit 2020-07-16T15:10:38.174760+0000 mgr.x (mgr.34562) 4422 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:10:40.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:10:39 smithi132 bash[27079]: cephadm 2020-07-16T15:10:38.175483+0000 mgr.x (mgr.34562) 4423 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:10:40.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:10:39 smithi132 bash[27079]: cephadm 2020-07-16T15:10:38.176871+0000 mgr.x (mgr.34562) 4424 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:10:40.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:10:39 smithi132 bash[27079]: cephadm 2020-07-16T15:10:38.177963+0000 mgr.x (mgr.34562) 4425 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:10:40.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:10:39 smithi132 bash[27079]: cephadm 2020-07-16T15:10:38.178136+0000 mgr.x (mgr.34562) 4426 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:10:40.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:10:39 smithi132 bash[27079]: cluster 2020-07-16T15:10:38.724832+0000 mgr.x (mgr.34562) 4427 : cluster [DBG] pgmap v2759: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:10:40.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:10:39 smithi188 bash[23329]: audit 2020-07-16T15:10:38.172323+0000 mgr.x (mgr.34562) 4420 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:10:40.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:10:39 smithi188 bash[23329]: audit 2020-07-16T15:10:38.173624+0000 mgr.x (mgr.34562) 4421 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:10:40.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:10:39 smithi188 bash[23329]: audit 2020-07-16T15:10:38.174760+0000 mgr.x (mgr.34562) 4422 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:10:40.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:10:39 smithi188 bash[23329]: cephadm 2020-07-16T15:10:38.175483+0000 mgr.x (mgr.34562) 4423 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:10:40.180 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:10:39 smithi188 bash[23329]: cephadm 2020-07-16T15:10:38.176871+0000 mgr.x (mgr.34562) 4424 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:10:40.180 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:10:39 smithi188 bash[23329]: cephadm 2020-07-16T15:10:38.177963+0000 mgr.x (mgr.34562) 4425 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:10:40.180 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:10:39 smithi188 bash[23329]: cephadm 2020-07-16T15:10:38.178136+0000 mgr.x (mgr.34562) 4426 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:10:40.180 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:10:39 smithi188 bash[23329]: cluster 2020-07-16T15:10:38.724832+0000 mgr.x (mgr.34562) 4427 : cluster [DBG] pgmap v2759: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:10:41.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:10:41 smithi132 bash[27079]: cluster 2020-07-16T15:10:40.725210+0000 mgr.x (mgr.34562) 4428 : cluster [DBG] pgmap v2760: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:10:41.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:10:41 smithi132 bash[27079]: audit 2020-07-16T15:10:40.948607+0000 mon.b (mon.2) 1010 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:10:41.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:10:41 smithi188 bash[23329]: cluster 2020-07-16T15:10:40.725210+0000 mgr.x (mgr.34562) 4428 : cluster [DBG] pgmap v2760: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:10:41.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:10:41 smithi188 bash[23329]: audit 2020-07-16T15:10:40.948607+0000 mon.b (mon.2) 1010 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:10:42.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:10:42 smithi132 bash[27079]: cephadm 2020-07-16T15:10:40.949209+0000 mgr.x (mgr.34562) 4429 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:10:42.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:10:42 smithi132 bash[27079]: cephadm 2020-07-16T15:10:40.949431+0000 mgr.x (mgr.34562) 4430 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:10:42.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:10:42 smithi188 bash[23329]: cephadm 2020-07-16T15:10:40.949209+0000 mgr.x (mgr.34562) 4429 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:10:42.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:10:42 smithi188 bash[23329]: cephadm 2020-07-16T15:10:40.949431+0000 mgr.x (mgr.34562) 4430 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:10:43.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:10:43 smithi132 bash[27079]: cluster 2020-07-16T15:10:42.725573+0000 mgr.x (mgr.34562) 4431 : cluster [DBG] pgmap v2761: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:10:43.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:10:43 smithi188 bash[23329]: cluster 2020-07-16T15:10:42.725573+0000 mgr.x (mgr.34562) 4431 : cluster [DBG] pgmap v2761: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:10:46.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:10:45 smithi188 bash[23329]: cluster 2020-07-16T15:10:44.726017+0000 mgr.x (mgr.34562) 4432 : cluster [DBG] pgmap v2762: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:10:46.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:10:45 smithi132 bash[27079]: cluster 2020-07-16T15:10:44.726017+0000 mgr.x (mgr.34562) 4432 : cluster [DBG] pgmap v2762: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:10:48.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:10:47 smithi188 bash[23329]: cluster 2020-07-16T15:10:46.726393+0000 mgr.x (mgr.34562) 4433 : cluster [DBG] pgmap v2763: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:10:48.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:10:47 smithi132 bash[27079]: cluster 2020-07-16T15:10:46.726393+0000 mgr.x (mgr.34562) 4433 : cluster [DBG] pgmap v2763: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:10:50.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:10:49 smithi188 bash[23329]: cluster 2020-07-16T15:10:48.726885+0000 mgr.x (mgr.34562) 4434 : cluster [DBG] pgmap v2764: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:10:50.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:10:49 smithi132 bash[27079]: cluster 2020-07-16T15:10:48.726885+0000 mgr.x (mgr.34562) 4434 : cluster [DBG] pgmap v2764: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:10:51.044 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:10:51.306 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:10:51.306 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (93m) 7m ago 96m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:10:51.307 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (96m) 7m ago 96m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:10:51.307 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (93m) 7m ago 99m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:10:51.307 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (93m) 7m ago 101m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:10:51.307 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 7m ago 101m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:10:51.307 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (99m) 7m ago 99m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:10:51.308 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (99m) 7m ago 99m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:10:51.308 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (96m) 7m ago 96m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:10:51.308 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (96m) 7m ago 96m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:10:51.308 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (99m) 7m ago 99m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:10:51.308 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (98m) 7m ago 98m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:10:51.309 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (98m) 7m ago 98m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:10:51.309 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (98m) 7m ago 98m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:10:51.309 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (97m) 7m ago 98m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:10:51.309 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (97m) 7m ago 97m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:10:51.309 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (97m) 7m ago 97m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:10:51.309 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (97m) 7m ago 97m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:10:51.310 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (96m) 7m ago 96m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:10:51.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:10:51 smithi132 bash[27079]: cluster 2020-07-16T15:10:50.727384+0000 mgr.x (mgr.34562) 4435 : cluster [DBG] pgmap v2765: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:10:51.602 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:10:51.602 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:10:51.603 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:10:51.603 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:10:51.603 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:10:51.603 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:10:51.603 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:10:51.604 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:10:51.604 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:10:51.604 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:10:51.604 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:10:51.604 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:10:51.605 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:10:51.605 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:10:51.605 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:10:51.605 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:10:51.605 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:10:51.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:10:51 smithi188 bash[23329]: cluster 2020-07-16T15:10:50.727384+0000 mgr.x (mgr.34562) 4435 : cluster [DBG] pgmap v2765: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:10:52.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:10:52 smithi132 bash[27079]: audit 2020-07-16T15:10:51.032585+0000 mgr.x (mgr.34562) 4436 : audit [DBG] from='client.27862 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:10:52.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:10:52 smithi132 bash[27079]: audit 2020-07-16T15:10:51.301995+0000 mgr.x (mgr.34562) 4437 : audit [DBG] from='client.27868 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:10:52.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:10:52 smithi132 bash[27079]: audit 2020-07-16T15:10:51.601485+0000 mon.c (mon.1) 323 : audit [DBG] from='client.? 172.21.15.132:0/3615376640' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:10:52.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:10:52 smithi188 bash[23329]: audit 2020-07-16T15:10:51.032585+0000 mgr.x (mgr.34562) 4436 : audit [DBG] from='client.27862 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:10:52.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:10:52 smithi188 bash[23329]: audit 2020-07-16T15:10:51.301995+0000 mgr.x (mgr.34562) 4437 : audit [DBG] from='client.27868 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:10:52.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:10:52 smithi188 bash[23329]: audit 2020-07-16T15:10:51.601485+0000 mon.c (mon.1) 323 : audit [DBG] from='client.? 172.21.15.132:0/3615376640' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:10:53.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:10:53 smithi132 bash[27079]: cluster 2020-07-16T15:10:52.727845+0000 mgr.x (mgr.34562) 4438 : cluster [DBG] pgmap v2766: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:10:53.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:10:53 smithi188 bash[23329]: cluster 2020-07-16T15:10:52.727845+0000 mgr.x (mgr.34562) 4438 : cluster [DBG] pgmap v2766: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:10:56.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:10:55 smithi188 bash[23329]: cluster 2020-07-16T15:10:54.728275+0000 mgr.x (mgr.34562) 4439 : cluster [DBG] pgmap v2767: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:10:56.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:10:55 smithi132 bash[27079]: cluster 2020-07-16T15:10:54.728275+0000 mgr.x (mgr.34562) 4439 : cluster [DBG] pgmap v2767: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:10:57.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:10:56 smithi188 bash[23329]: audit 2020-07-16T15:10:55.964990+0000 mon.b (mon.2) 1011 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:10:57.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:10:56 smithi132 bash[27079]: audit 2020-07-16T15:10:55.964990+0000 mon.b (mon.2) 1011 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:10:58.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:10:57 smithi188 bash[23329]: cephadm 2020-07-16T15:10:55.965709+0000 mgr.x (mgr.34562) 4440 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:10:58.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:10:57 smithi188 bash[23329]: cephadm 2020-07-16T15:10:55.966019+0000 mgr.x (mgr.34562) 4441 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:10:58.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:10:57 smithi188 bash[23329]: cluster 2020-07-16T15:10:56.728714+0000 mgr.x (mgr.34562) 4442 : cluster [DBG] pgmap v2768: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:10:58.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:10:57 smithi132 bash[27079]: cephadm 2020-07-16T15:10:55.965709+0000 mgr.x (mgr.34562) 4440 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:10:58.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:10:57 smithi132 bash[27079]: cephadm 2020-07-16T15:10:55.966019+0000 mgr.x (mgr.34562) 4441 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:10:58.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:10:57 smithi132 bash[27079]: cluster 2020-07-16T15:10:56.728714+0000 mgr.x (mgr.34562) 4442 : cluster [DBG] pgmap v2768: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:11:00.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:10:59 smithi188 bash[23329]: cluster 2020-07-16T15:10:58.729064+0000 mgr.x (mgr.34562) 4443 : cluster [DBG] pgmap v2769: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:11:00.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:10:59 smithi132 bash[27079]: cluster 2020-07-16T15:10:58.729064+0000 mgr.x (mgr.34562) 4443 : cluster [DBG] pgmap v2769: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:11:01.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:11:01 smithi132 bash[27079]: cluster 2020-07-16T15:11:00.729578+0000 mgr.x (mgr.34562) 4444 : cluster [DBG] pgmap v2770: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:11:01.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:11:01 smithi188 bash[23329]: cluster 2020-07-16T15:11:00.729578+0000 mgr.x (mgr.34562) 4444 : cluster [DBG] pgmap v2770: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:11:04.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:11:03 smithi188 bash[23329]: cluster 2020-07-16T15:11:02.730090+0000 mgr.x (mgr.34562) 4445 : cluster [DBG] pgmap v2771: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:11:04.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:11:03 smithi132 bash[27079]: cluster 2020-07-16T15:11:02.730090+0000 mgr.x (mgr.34562) 4445 : cluster [DBG] pgmap v2771: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:11:06.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:11:05 smithi188 bash[23329]: cluster 2020-07-16T15:11:04.730470+0000 mgr.x (mgr.34562) 4446 : cluster [DBG] pgmap v2772: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:11:06.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:11:05 smithi132 bash[27079]: cluster 2020-07-16T15:11:04.730470+0000 mgr.x (mgr.34562) 4446 : cluster [DBG] pgmap v2772: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:11:08.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:11:07 smithi188 bash[23329]: cluster 2020-07-16T15:11:06.730984+0000 mgr.x (mgr.34562) 4447 : cluster [DBG] pgmap v2773: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:11:08.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:11:07 smithi132 bash[27079]: cluster 2020-07-16T15:11:06.730984+0000 mgr.x (mgr.34562) 4447 : cluster [DBG] pgmap v2773: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:11:10.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:11:09 smithi188 bash[23329]: cluster 2020-07-16T15:11:08.731361+0000 mgr.x (mgr.34562) 4448 : cluster [DBG] pgmap v2774: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:11:10.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:11:09 smithi132 bash[27079]: cluster 2020-07-16T15:11:08.731361+0000 mgr.x (mgr.34562) 4448 : cluster [DBG] pgmap v2774: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:11:11.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:11:11 smithi132 bash[27079]: cluster 2020-07-16T15:11:10.731783+0000 mgr.x (mgr.34562) 4449 : cluster [DBG] pgmap v2775: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:11:11.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:11:11 smithi132 bash[27079]: audit 2020-07-16T15:11:10.981369+0000 mon.b (mon.2) 1012 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:11:11.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:11:11 smithi188 bash[23329]: cluster 2020-07-16T15:11:10.731783+0000 mgr.x (mgr.34562) 4449 : cluster [DBG] pgmap v2775: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:11:11.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:11:11 smithi188 bash[23329]: audit 2020-07-16T15:11:10.981369+0000 mon.b (mon.2) 1012 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:11:12.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:11:12 smithi132 bash[27079]: cephadm 2020-07-16T15:11:10.982002+0000 mgr.x (mgr.34562) 4450 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:11:12.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:11:12 smithi132 bash[27079]: cephadm 2020-07-16T15:11:10.982137+0000 mgr.x (mgr.34562) 4451 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:11:12.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:11:12 smithi188 bash[23329]: cephadm 2020-07-16T15:11:10.982002+0000 mgr.x (mgr.34562) 4450 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:11:12.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:11:12 smithi188 bash[23329]: cephadm 2020-07-16T15:11:10.982137+0000 mgr.x (mgr.34562) 4451 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:11:13.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:11:13 smithi132 bash[27079]: cluster 2020-07-16T15:11:12.732349+0000 mgr.x (mgr.34562) 4452 : cluster [DBG] pgmap v2776: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:11:13.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:11:13 smithi188 bash[23329]: cluster 2020-07-16T15:11:12.732349+0000 mgr.x (mgr.34562) 4452 : cluster [DBG] pgmap v2776: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:11:16.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:11:15 smithi188 bash[23329]: cluster 2020-07-16T15:11:14.732728+0000 mgr.x (mgr.34562) 4453 : cluster [DBG] pgmap v2777: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:11:16.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:11:15 smithi132 bash[27079]: cluster 2020-07-16T15:11:14.732728+0000 mgr.x (mgr.34562) 4453 : cluster [DBG] pgmap v2777: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:11:18.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:11:17 smithi188 bash[23329]: cluster 2020-07-16T15:11:16.733225+0000 mgr.x (mgr.34562) 4454 : cluster [DBG] pgmap v2778: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:11:18.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:11:17 smithi132 bash[27079]: cluster 2020-07-16T15:11:16.733225+0000 mgr.x (mgr.34562) 4454 : cluster [DBG] pgmap v2778: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:11:20.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:11:19 smithi188 bash[23329]: cluster 2020-07-16T15:11:18.733564+0000 mgr.x (mgr.34562) 4455 : cluster [DBG] pgmap v2779: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:11:20.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:11:19 smithi132 bash[27079]: cluster 2020-07-16T15:11:18.733564+0000 mgr.x (mgr.34562) 4455 : cluster [DBG] pgmap v2779: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:11:21.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:11:21 smithi132 bash[27079]: cluster 2020-07-16T15:11:20.733842+0000 mgr.x (mgr.34562) 4456 : cluster [DBG] pgmap v2780: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:11:21.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:11:21 smithi188 bash[23329]: cluster 2020-07-16T15:11:20.733842+0000 mgr.x (mgr.34562) 4456 : cluster [DBG] pgmap v2780: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:11:21.903 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:11:22.163 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:11:22.163 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (94m) 8m ago 97m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:11:22.164 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (96m) 8m ago 96m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:11:22.164 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (94m) 8m ago 99m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:11:22.164 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (93m) 8m ago 101m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:11:22.164 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 8m ago 101m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:11:22.164 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (100m) 8m ago 100m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:11:22.165 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (100m) 8m ago 100m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:11:22.165 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (97m) 8m ago 97m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:11:22.165 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (97m) 8m ago 97m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:11:22.165 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (99m) 8m ago 99m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:11:22.165 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (99m) 8m ago 99m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:11:22.166 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (99m) 8m ago 99m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:11:22.166 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (98m) 8m ago 98m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:11:22.167 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (98m) 8m ago 98m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:11:22.168 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (98m) 8m ago 98m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:11:22.168 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (98m) 8m ago 98m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:11:22.168 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (97m) 8m ago 97m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:11:22.168 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (96m) 8m ago 97m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:11:22.463 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:11:22.463 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:11:22.463 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:11:22.464 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:11:22.464 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:11:22.464 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:11:22.464 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:11:22.464 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:11:22.465 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:11:22.465 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:11:22.465 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:11:22.465 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:11:22.466 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:11:22.466 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:11:22.466 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:11:22.466 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:11:22.467 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:11:22.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:11:22 smithi132 bash[27079]: audit 2020-07-16T15:11:22.462225+0000 mon.c (mon.1) 324 : audit [DBG] from='client.? 172.21.15.132:0/242757696' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:11:22.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:11:22 smithi188 bash[23329]: audit 2020-07-16T15:11:22.462225+0000 mon.c (mon.1) 324 : audit [DBG] from='client.? 172.21.15.132:0/242757696' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:11:23.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:11:23 smithi132 bash[27079]: audit 2020-07-16T15:11:21.891930+0000 mgr.x (mgr.34562) 4457 : audit [DBG] from='client.27880 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:11:23.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:11:23 smithi132 bash[27079]: audit 2020-07-16T15:11:22.158918+0000 mgr.x (mgr.34562) 4458 : audit [DBG] from='client.27886 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:11:23.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:11:23 smithi132 bash[27079]: cluster 2020-07-16T15:11:22.734312+0000 mgr.x (mgr.34562) 4459 : cluster [DBG] pgmap v2781: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:11:23.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:11:23 smithi188 bash[23329]: audit 2020-07-16T15:11:21.891930+0000 mgr.x (mgr.34562) 4457 : audit [DBG] from='client.27880 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:11:23.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:11:23 smithi188 bash[23329]: audit 2020-07-16T15:11:22.158918+0000 mgr.x (mgr.34562) 4458 : audit [DBG] from='client.27886 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:11:23.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:11:23 smithi188 bash[23329]: cluster 2020-07-16T15:11:22.734312+0000 mgr.x (mgr.34562) 4459 : cluster [DBG] pgmap v2781: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:11:26.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:11:25 smithi188 bash[23329]: cluster 2020-07-16T15:11:24.734861+0000 mgr.x (mgr.34562) 4460 : cluster [DBG] pgmap v2782: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:11:26.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:11:25 smithi132 bash[27079]: cluster 2020-07-16T15:11:24.734861+0000 mgr.x (mgr.34562) 4460 : cluster [DBG] pgmap v2782: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:11:27.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:11:26 smithi188 bash[23329]: audit 2020-07-16T15:11:25.997763+0000 mon.b (mon.2) 1013 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:11:27.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:11:26 smithi132 bash[27079]: audit 2020-07-16T15:11:25.997763+0000 mon.b (mon.2) 1013 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:11:28.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:11:27 smithi188 bash[23329]: cephadm 2020-07-16T15:11:25.998428+0000 mgr.x (mgr.34562) 4461 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:11:28.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:11:27 smithi188 bash[23329]: cephadm 2020-07-16T15:11:25.998758+0000 mgr.x (mgr.34562) 4462 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:11:28.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:11:27 smithi188 bash[23329]: cluster 2020-07-16T15:11:26.735344+0000 mgr.x (mgr.34562) 4463 : cluster [DBG] pgmap v2783: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:11:28.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:11:27 smithi132 bash[27079]: cephadm 2020-07-16T15:11:25.998428+0000 mgr.x (mgr.34562) 4461 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:11:28.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:11:27 smithi132 bash[27079]: cephadm 2020-07-16T15:11:25.998758+0000 mgr.x (mgr.34562) 4462 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:11:28.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:11:27 smithi132 bash[27079]: cluster 2020-07-16T15:11:26.735344+0000 mgr.x (mgr.34562) 4463 : cluster [DBG] pgmap v2783: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:11:30.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:11:29 smithi188 bash[23329]: cluster 2020-07-16T15:11:28.735675+0000 mgr.x (mgr.34562) 4464 : cluster [DBG] pgmap v2784: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:11:30.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:11:29 smithi132 bash[27079]: cluster 2020-07-16T15:11:28.735675+0000 mgr.x (mgr.34562) 4464 : cluster [DBG] pgmap v2784: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:11:31.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:11:31 smithi132 bash[27079]: cluster 2020-07-16T15:11:30.736107+0000 mgr.x (mgr.34562) 4465 : cluster [DBG] pgmap v2785: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:11:31.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:11:31 smithi188 bash[23329]: cluster 2020-07-16T15:11:30.736107+0000 mgr.x (mgr.34562) 4465 : cluster [DBG] pgmap v2785: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:11:34.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:11:33 smithi188 bash[23329]: cluster 2020-07-16T15:11:32.736610+0000 mgr.x (mgr.34562) 4466 : cluster [DBG] pgmap v2786: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:11:34.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:11:33 smithi132 bash[27079]: cluster 2020-07-16T15:11:32.736610+0000 mgr.x (mgr.34562) 4466 : cluster [DBG] pgmap v2786: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:11:36.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:11:35 smithi188 bash[23329]: cluster 2020-07-16T15:11:34.736950+0000 mgr.x (mgr.34562) 4467 : cluster [DBG] pgmap v2787: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:11:36.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:11:35 smithi132 bash[27079]: cluster 2020-07-16T15:11:34.736950+0000 mgr.x (mgr.34562) 4467 : cluster [DBG] pgmap v2787: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:11:38.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:11:37 smithi188 bash[23329]: cluster 2020-07-16T15:11:36.737331+0000 mgr.x (mgr.34562) 4468 : cluster [DBG] pgmap v2788: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:11:38.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:11:37 smithi132 bash[27079]: cluster 2020-07-16T15:11:36.737331+0000 mgr.x (mgr.34562) 4468 : cluster [DBG] pgmap v2788: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:11:40.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:11:39 smithi188 bash[23329]: cluster 2020-07-16T15:11:38.737782+0000 mgr.x (mgr.34562) 4469 : cluster [DBG] pgmap v2789: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:11:40.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:11:39 smithi132 bash[27079]: cluster 2020-07-16T15:11:38.737782+0000 mgr.x (mgr.34562) 4469 : cluster [DBG] pgmap v2789: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:11:41.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:11:41 smithi132 bash[27079]: cluster 2020-07-16T15:11:40.738272+0000 mgr.x (mgr.34562) 4470 : cluster [DBG] pgmap v2790: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:11:41.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:11:41 smithi132 bash[27079]: audit 2020-07-16T15:11:41.016691+0000 mon.b (mon.2) 1014 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:11:41.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:11:41 smithi132 bash[27079]: audit 2020-07-16T15:11:41.018030+0000 mon.b (mon.2) 1015 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:11:41.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:11:41 smithi132 bash[27079]: audit 2020-07-16T15:11:41.019147+0000 mon.b (mon.2) 1016 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:11:41.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:11:41 smithi132 bash[27079]: audit 2020-07-16T15:11:41.020533+0000 mon.b (mon.2) 1017 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:11:41.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:11:41 smithi132 bash[27079]: audit 2020-07-16T15:11:41.021859+0000 mon.b (mon.2) 1018 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:11:41.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:11:41 smithi188 bash[23329]: cluster 2020-07-16T15:11:40.738272+0000 mgr.x (mgr.34562) 4470 : cluster [DBG] pgmap v2790: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:11:41.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:11:41 smithi188 bash[23329]: audit 2020-07-16T15:11:41.016691+0000 mon.b (mon.2) 1014 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:11:41.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:11:41 smithi188 bash[23329]: audit 2020-07-16T15:11:41.018030+0000 mon.b (mon.2) 1015 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:11:41.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:11:41 smithi188 bash[23329]: audit 2020-07-16T15:11:41.019147+0000 mon.b (mon.2) 1016 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:11:41.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:11:41 smithi188 bash[23329]: audit 2020-07-16T15:11:41.020533+0000 mon.b (mon.2) 1017 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:11:41.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:11:41 smithi188 bash[23329]: audit 2020-07-16T15:11:41.021859+0000 mon.b (mon.2) 1018 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:11:42.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:11:42 smithi132 bash[27079]: audit 2020-07-16T15:11:41.017045+0000 mgr.x (mgr.34562) 4471 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:11:42.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:11:42 smithi132 bash[27079]: audit 2020-07-16T15:11:41.018311+0000 mgr.x (mgr.34562) 4472 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:11:42.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:11:42 smithi132 bash[27079]: audit 2020-07-16T15:11:41.019468+0000 mgr.x (mgr.34562) 4473 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:11:42.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:11:42 smithi132 bash[27079]: cephadm 2020-07-16T15:11:41.020193+0000 mgr.x (mgr.34562) 4474 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:11:42.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:11:42 smithi132 bash[27079]: cephadm 2020-07-16T15:11:41.021409+0000 mgr.x (mgr.34562) 4475 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:11:42.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:11:42 smithi132 bash[27079]: cephadm 2020-07-16T15:11:41.022615+0000 mgr.x (mgr.34562) 4476 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:11:42.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:11:42 smithi132 bash[27079]: cephadm 2020-07-16T15:11:41.022710+0000 mgr.x (mgr.34562) 4477 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:11:42.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:11:42 smithi188 bash[23329]: audit 2020-07-16T15:11:41.017045+0000 mgr.x (mgr.34562) 4471 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:11:42.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:11:42 smithi188 bash[23329]: audit 2020-07-16T15:11:41.018311+0000 mgr.x (mgr.34562) 4472 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:11:42.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:11:42 smithi188 bash[23329]: audit 2020-07-16T15:11:41.019468+0000 mgr.x (mgr.34562) 4473 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:11:42.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:11:42 smithi188 bash[23329]: cephadm 2020-07-16T15:11:41.020193+0000 mgr.x (mgr.34562) 4474 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:11:42.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:11:42 smithi188 bash[23329]: cephadm 2020-07-16T15:11:41.021409+0000 mgr.x (mgr.34562) 4475 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:11:42.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:11:42 smithi188 bash[23329]: cephadm 2020-07-16T15:11:41.022615+0000 mgr.x (mgr.34562) 4476 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:11:42.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:11:42 smithi188 bash[23329]: cephadm 2020-07-16T15:11:41.022710+0000 mgr.x (mgr.34562) 4477 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:11:43.379 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:11:43 smithi132 bash[27079]: cluster 2020-07-16T15:11:42.738742+0000 mgr.x (mgr.34562) 4478 : cluster [DBG] pgmap v2791: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:11:43.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:11:43 smithi188 bash[23329]: cluster 2020-07-16T15:11:42.738742+0000 mgr.x (mgr.34562) 4478 : cluster [DBG] pgmap v2791: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:11:44.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:11:44 smithi132 bash[27079]: audit 2020-07-16T15:11:43.910683+0000 mon.b (mon.2) 1019 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:11:44.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:11:44 smithi188 bash[23329]: audit 2020-07-16T15:11:43.910683+0000 mon.b (mon.2) 1019 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:11:45.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:11:45 smithi132 bash[27079]: cephadm 2020-07-16T15:11:43.911269+0000 mgr.x (mgr.34562) 4479 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:11:45.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:11:45 smithi132 bash[27079]: cephadm 2020-07-16T15:11:43.911515+0000 mgr.x (mgr.34562) 4480 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:11:45.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:11:45 smithi132 bash[27079]: cluster 2020-07-16T15:11:44.739073+0000 mgr.x (mgr.34562) 4481 : cluster [DBG] pgmap v2792: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:11:45.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:11:45 smithi188 bash[23329]: cephadm 2020-07-16T15:11:43.911269+0000 mgr.x (mgr.34562) 4479 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:11:45.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:11:45 smithi188 bash[23329]: cephadm 2020-07-16T15:11:43.911515+0000 mgr.x (mgr.34562) 4480 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:11:45.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:11:45 smithi188 bash[23329]: cluster 2020-07-16T15:11:44.739073+0000 mgr.x (mgr.34562) 4481 : cluster [DBG] pgmap v2792: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:11:48.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:11:47 smithi188 bash[23329]: cluster 2020-07-16T15:11:46.739606+0000 mgr.x (mgr.34562) 4482 : cluster [DBG] pgmap v2793: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:11:48.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:11:47 smithi132 bash[27079]: cluster 2020-07-16T15:11:46.739606+0000 mgr.x (mgr.34562) 4482 : cluster [DBG] pgmap v2793: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:11:50.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:11:49 smithi188 bash[23329]: cluster 2020-07-16T15:11:48.740086+0000 mgr.x (mgr.34562) 4483 : cluster [DBG] pgmap v2794: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:11:50.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:11:49 smithi132 bash[27079]: cluster 2020-07-16T15:11:48.740086+0000 mgr.x (mgr.34562) 4483 : cluster [DBG] pgmap v2794: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:11:51.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:11:51 smithi132 bash[27079]: cluster 2020-07-16T15:11:50.740542+0000 mgr.x (mgr.34562) 4484 : cluster [DBG] pgmap v2795: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:11:51.679 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:11:51 smithi188 bash[23329]: cluster 2020-07-16T15:11:50.740542+0000 mgr.x (mgr.34562) 4484 : cluster [DBG] pgmap v2795: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:11:52.761 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:11:53.024 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:11:53.025 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (94m) 8m ago 97m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:11:53.025 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (97m) 8m ago 97m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:11:53.025 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (94m) 8m ago 100m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:11:53.025 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (94m) 8m ago 102m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:11:53.025 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 8m ago 102m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:11:53.026 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (100m) 8m ago 100m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:11:53.026 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (100m) 8m ago 100m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:11:53.026 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (97m) 8m ago 97m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:11:53.026 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (97m) 8m ago 97m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:11:53.026 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (100m) 8m ago 100m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:11:53.027 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (99m) 8m ago 99m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:11:53.027 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (99m) 8m ago 99m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:11:53.027 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (99m) 8m ago 99m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:11:53.027 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (98m) 8m ago 99m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:11:53.027 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (98m) 8m ago 98m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:11:53.028 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (98m) 8m ago 98m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:11:53.028 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (98m) 8m ago 98m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:11:53.028 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (97m) 8m ago 97m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:11:53.320 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:11:53.321 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:11:53.321 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:11:53.321 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:11:53.321 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:11:53.322 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:11:53.322 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:11:53.322 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:11:53.322 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:11:53.322 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:11:53.323 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:11:53.323 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:11:53.323 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:11:53.323 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:11:53.323 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:11:53.324 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:11:53.324 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:11:54.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:11:53 smithi188 bash[23329]: cluster 2020-07-16T15:11:52.741067+0000 mgr.x (mgr.34562) 4485 : cluster [DBG] pgmap v2796: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:11:54.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:11:53 smithi188 bash[23329]: audit 2020-07-16T15:11:52.749333+0000 mgr.x (mgr.34562) 4486 : audit [DBG] from='client.27898 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:11:54.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:11:53 smithi188 bash[23329]: audit 2020-07-16T15:11:53.319805+0000 mon.c (mon.1) 325 : audit [DBG] from='client.? 172.21.15.132:0/3230099221' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:11:54.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:11:53 smithi132 bash[27079]: cluster 2020-07-16T15:11:52.741067+0000 mgr.x (mgr.34562) 4485 : cluster [DBG] pgmap v2796: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:11:54.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:11:53 smithi132 bash[27079]: audit 2020-07-16T15:11:52.749333+0000 mgr.x (mgr.34562) 4486 : audit [DBG] from='client.27898 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:11:54.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:11:53 smithi132 bash[27079]: audit 2020-07-16T15:11:53.319805+0000 mon.c (mon.1) 325 : audit [DBG] from='client.? 172.21.15.132:0/3230099221' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:11:55.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:11:54 smithi188 bash[23329]: audit 2020-07-16T15:11:53.020254+0000 mgr.x (mgr.34562) 4487 : audit [DBG] from='client.27904 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:11:55.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:11:54 smithi132 bash[27079]: audit 2020-07-16T15:11:53.020254+0000 mgr.x (mgr.34562) 4487 : audit [DBG] from='client.27904 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:11:56.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:11:55 smithi188 bash[23329]: cluster 2020-07-16T15:11:54.741453+0000 mgr.x (mgr.34562) 4488 : cluster [DBG] pgmap v2797: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:11:56.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:11:55 smithi132 bash[27079]: cluster 2020-07-16T15:11:54.741453+0000 mgr.x (mgr.34562) 4488 : cluster [DBG] pgmap v2797: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:11:58.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:11:57 smithi188 bash[23329]: cluster 2020-07-16T15:11:56.741987+0000 mgr.x (mgr.34562) 4489 : cluster [DBG] pgmap v2798: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:11:58.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:11:57 smithi132 bash[27079]: cluster 2020-07-16T15:11:56.741987+0000 mgr.x (mgr.34562) 4489 : cluster [DBG] pgmap v2798: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:12:00.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:11:59 smithi188 bash[23329]: cluster 2020-07-16T15:11:58.742519+0000 mgr.x (mgr.34562) 4490 : cluster [DBG] pgmap v2799: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:12:00.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:11:59 smithi188 bash[23329]: audit 2020-07-16T15:11:58.927204+0000 mon.b (mon.2) 1020 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:12:00.288 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:11:59 smithi132 bash[27079]: cluster 2020-07-16T15:11:58.742519+0000 mgr.x (mgr.34562) 4490 : cluster [DBG] pgmap v2799: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:12:00.288 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:11:59 smithi132 bash[27079]: audit 2020-07-16T15:11:58.927204+0000 mon.b (mon.2) 1020 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:12:01.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:12:00 smithi188 bash[23329]: cephadm 2020-07-16T15:11:58.927915+0000 mgr.x (mgr.34562) 4491 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:12:01.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:12:00 smithi188 bash[23329]: cephadm 2020-07-16T15:11:58.928354+0000 mgr.x (mgr.34562) 4492 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:12:01.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:12:00 smithi132 bash[27079]: cephadm 2020-07-16T15:11:58.927915+0000 mgr.x (mgr.34562) 4491 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:12:01.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:12:00 smithi132 bash[27079]: cephadm 2020-07-16T15:11:58.928354+0000 mgr.x (mgr.34562) 4492 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:12:02.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:12:01 smithi188 bash[23329]: cluster 2020-07-16T15:12:00.742958+0000 mgr.x (mgr.34562) 4493 : cluster [DBG] pgmap v2800: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:12:02.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:12:01 smithi132 bash[27079]: cluster 2020-07-16T15:12:00.742958+0000 mgr.x (mgr.34562) 4493 : cluster [DBG] pgmap v2800: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:12:04.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:12:03 smithi188 bash[23329]: cluster 2020-07-16T15:12:02.743469+0000 mgr.x (mgr.34562) 4494 : cluster [DBG] pgmap v2801: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:12:04.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:12:03 smithi132 bash[27079]: cluster 2020-07-16T15:12:02.743469+0000 mgr.x (mgr.34562) 4494 : cluster [DBG] pgmap v2801: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:12:06.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:12:05 smithi188 bash[23329]: cluster 2020-07-16T15:12:04.743948+0000 mgr.x (mgr.34562) 4495 : cluster [DBG] pgmap v2802: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:12:06.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:12:05 smithi132 bash[27079]: cluster 2020-07-16T15:12:04.743948+0000 mgr.x (mgr.34562) 4495 : cluster [DBG] pgmap v2802: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:12:08.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:12:07 smithi188 bash[23329]: cluster 2020-07-16T15:12:06.744483+0000 mgr.x (mgr.34562) 4496 : cluster [DBG] pgmap v2803: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:12:08.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:12:07 smithi132 bash[27079]: cluster 2020-07-16T15:12:06.744483+0000 mgr.x (mgr.34562) 4496 : cluster [DBG] pgmap v2803: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:12:10.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:12:09 smithi188 bash[23329]: cluster 2020-07-16T15:12:08.744964+0000 mgr.x (mgr.34562) 4497 : cluster [DBG] pgmap v2804: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:12:10.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:12:09 smithi132 bash[27079]: cluster 2020-07-16T15:12:08.744964+0000 mgr.x (mgr.34562) 4497 : cluster [DBG] pgmap v2804: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:12:11.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:12:11 smithi132 bash[27079]: cluster 2020-07-16T15:12:10.745363+0000 mgr.x (mgr.34562) 4498 : cluster [DBG] pgmap v2805: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:12:11.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:12:11 smithi188 bash[23329]: cluster 2020-07-16T15:12:10.745363+0000 mgr.x (mgr.34562) 4498 : cluster [DBG] pgmap v2805: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:12:14.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:12:13 smithi188 bash[23329]: cluster 2020-07-16T15:12:12.745900+0000 mgr.x (mgr.34562) 4499 : cluster [DBG] pgmap v2806: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:12:14.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:12:13 smithi132 bash[27079]: cluster 2020-07-16T15:12:12.745900+0000 mgr.x (mgr.34562) 4499 : cluster [DBG] pgmap v2806: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:12:15.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:12:14 smithi188 bash[23329]: audit 2020-07-16T15:12:13.943883+0000 mon.b (mon.2) 1021 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:12:15.285 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:12:14 smithi132 bash[27079]: audit 2020-07-16T15:12:13.943883+0000 mon.b (mon.2) 1021 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:12:16.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:12:15 smithi188 bash[23329]: cephadm 2020-07-16T15:12:13.944554+0000 mgr.x (mgr.34562) 4500 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:12:16.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:12:15 smithi188 bash[23329]: cephadm 2020-07-16T15:12:13.944631+0000 mgr.x (mgr.34562) 4501 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:12:16.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:12:15 smithi188 bash[23329]: cluster 2020-07-16T15:12:14.746365+0000 mgr.x (mgr.34562) 4502 : cluster [DBG] pgmap v2807: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:12:16.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:12:15 smithi132 bash[27079]: cephadm 2020-07-16T15:12:13.944554+0000 mgr.x (mgr.34562) 4500 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:12:16.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:12:15 smithi132 bash[27079]: cephadm 2020-07-16T15:12:13.944631+0000 mgr.x (mgr.34562) 4501 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:12:16.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:12:15 smithi132 bash[27079]: cluster 2020-07-16T15:12:14.746365+0000 mgr.x (mgr.34562) 4502 : cluster [DBG] pgmap v2807: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:12:18.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:12:17 smithi188 bash[23329]: cluster 2020-07-16T15:12:16.746814+0000 mgr.x (mgr.34562) 4503 : cluster [DBG] pgmap v2808: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:12:18.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:12:17 smithi132 bash[27079]: cluster 2020-07-16T15:12:16.746814+0000 mgr.x (mgr.34562) 4503 : cluster [DBG] pgmap v2808: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:12:20.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:12:19 smithi188 bash[23329]: cluster 2020-07-16T15:12:18.747257+0000 mgr.x (mgr.34562) 4504 : cluster [DBG] pgmap v2809: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:12:20.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:12:19 smithi132 bash[27079]: cluster 2020-07-16T15:12:18.747257+0000 mgr.x (mgr.34562) 4504 : cluster [DBG] pgmap v2809: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:12:21.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:12:21 smithi132 bash[27079]: cluster 2020-07-16T15:12:20.747638+0000 mgr.x (mgr.34562) 4505 : cluster [DBG] pgmap v2810: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:12:21.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:12:21 smithi188 bash[23329]: cluster 2020-07-16T15:12:20.747638+0000 mgr.x (mgr.34562) 4505 : cluster [DBG] pgmap v2810: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:12:23.617 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:12:23.879 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:12:23.880 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (95m) 9m ago 98m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:12:23.880 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (97m) 9m ago 97m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:12:23.880 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (95m) 9m ago 101m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:12:23.880 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (94m) 9m ago 102m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:12:23.881 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 9m ago 102m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:12:23.881 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (101m) 9m ago 101m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:12:23.881 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (101m) 9m ago 101m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:12:23.881 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (98m) 9m ago 98m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:12:23.881 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (98m) 9m ago 98m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:12:23.882 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (100m) 9m ago 100m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:12:23.882 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (100m) 9m ago 100m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:12:23.882 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (100m) 9m ago 100m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:12:23.882 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (99m) 9m ago 99m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:12:23.883 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (99m) 9m ago 99m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:12:23.883 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (99m) 9m ago 99m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:12:23.883 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (99m) 9m ago 99m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:12:23.883 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (98m) 9m ago 98m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:12:23.883 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (97m) 9m ago 98m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:12:24.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:12:23 smithi188 bash[23329]: cluster 2020-07-16T15:12:22.748151+0000 mgr.x (mgr.34562) 4506 : cluster [DBG] pgmap v2811: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:12:24.174 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:12:24.174 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:12:24.175 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:12:24.175 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:12:24.175 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:12:24.175 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:12:24.175 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:12:24.176 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:12:24.176 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:12:24.176 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:12:24.176 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:12:24.176 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:12:24.177 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:12:24.177 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:12:24.177 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:12:24.177 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:12:24.177 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:12:24.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:12:23 smithi132 bash[27079]: cluster 2020-07-16T15:12:22.748151+0000 mgr.x (mgr.34562) 4506 : cluster [DBG] pgmap v2811: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:12:25.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:12:24 smithi188 bash[23329]: audit 2020-07-16T15:12:23.605597+0000 mgr.x (mgr.34562) 4507 : audit [DBG] from='client.27916 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:12:25.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:12:24 smithi188 bash[23329]: audit 2020-07-16T15:12:24.173780+0000 mon.c (mon.1) 326 : audit [DBG] from='client.? 172.21.15.132:0/4103839312' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:12:25.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:12:24 smithi132 bash[27079]: audit 2020-07-16T15:12:23.605597+0000 mgr.x (mgr.34562) 4507 : audit [DBG] from='client.27916 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:12:25.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:12:24 smithi132 bash[27079]: audit 2020-07-16T15:12:24.173780+0000 mon.c (mon.1) 326 : audit [DBG] from='client.? 172.21.15.132:0/4103839312' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:12:26.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:12:25 smithi188 bash[23329]: audit 2020-07-16T15:12:23.875218+0000 mgr.x (mgr.34562) 4508 : audit [DBG] from='client.27922 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:12:26.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:12:25 smithi188 bash[23329]: cluster 2020-07-16T15:12:24.748645+0000 mgr.x (mgr.34562) 4509 : cluster [DBG] pgmap v2812: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:12:26.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:12:25 smithi132 bash[27079]: audit 2020-07-16T15:12:23.875218+0000 mgr.x (mgr.34562) 4508 : audit [DBG] from='client.27922 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:12:26.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:12:25 smithi132 bash[27079]: cluster 2020-07-16T15:12:24.748645+0000 mgr.x (mgr.34562) 4509 : cluster [DBG] pgmap v2812: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:12:28.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:12:27 smithi188 bash[23329]: cluster 2020-07-16T15:12:26.749070+0000 mgr.x (mgr.34562) 4510 : cluster [DBG] pgmap v2813: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:12:28.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:12:27 smithi132 bash[27079]: cluster 2020-07-16T15:12:26.749070+0000 mgr.x (mgr.34562) 4510 : cluster [DBG] pgmap v2813: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:12:30.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:12:29 smithi188 bash[23329]: cluster 2020-07-16T15:12:28.749581+0000 mgr.x (mgr.34562) 4511 : cluster [DBG] pgmap v2814: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:12:30.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:12:29 smithi188 bash[23329]: audit 2020-07-16T15:12:28.960360+0000 mon.b (mon.2) 1022 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:12:30.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:12:29 smithi132 bash[27079]: cluster 2020-07-16T15:12:28.749581+0000 mgr.x (mgr.34562) 4511 : cluster [DBG] pgmap v2814: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:12:30.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:12:29 smithi132 bash[27079]: audit 2020-07-16T15:12:28.960360+0000 mon.b (mon.2) 1022 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:12:31.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:12:30 smithi188 bash[23329]: cephadm 2020-07-16T15:12:28.961098+0000 mgr.x (mgr.34562) 4512 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:12:31.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:12:30 smithi188 bash[23329]: cephadm 2020-07-16T15:12:28.961176+0000 mgr.x (mgr.34562) 4513 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:12:31.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:12:30 smithi132 bash[27079]: cephadm 2020-07-16T15:12:28.961098+0000 mgr.x (mgr.34562) 4512 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:12:31.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:12:30 smithi132 bash[27079]: cephadm 2020-07-16T15:12:28.961176+0000 mgr.x (mgr.34562) 4513 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:12:32.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:12:31 smithi188 bash[23329]: cluster 2020-07-16T15:12:30.749978+0000 mgr.x (mgr.34562) 4514 : cluster [DBG] pgmap v2815: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:12:32.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:12:31 smithi132 bash[27079]: cluster 2020-07-16T15:12:30.749978+0000 mgr.x (mgr.34562) 4514 : cluster [DBG] pgmap v2815: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:12:34.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:12:33 smithi188 bash[23329]: cluster 2020-07-16T15:12:32.750509+0000 mgr.x (mgr.34562) 4515 : cluster [DBG] pgmap v2816: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:12:34.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:12:33 smithi132 bash[27079]: cluster 2020-07-16T15:12:32.750509+0000 mgr.x (mgr.34562) 4515 : cluster [DBG] pgmap v2816: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:12:36.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:12:35 smithi188 bash[23329]: cluster 2020-07-16T15:12:34.751085+0000 mgr.x (mgr.34562) 4516 : cluster [DBG] pgmap v2817: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:12:36.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:12:35 smithi132 bash[27079]: cluster 2020-07-16T15:12:34.751085+0000 mgr.x (mgr.34562) 4516 : cluster [DBG] pgmap v2817: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:12:38.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:12:37 smithi188 bash[23329]: cluster 2020-07-16T15:12:36.751491+0000 mgr.x (mgr.34562) 4517 : cluster [DBG] pgmap v2818: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:12:38.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:12:37 smithi132 bash[27079]: cluster 2020-07-16T15:12:36.751491+0000 mgr.x (mgr.34562) 4517 : cluster [DBG] pgmap v2818: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:12:40.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:12:39 smithi188 bash[23329]: cluster 2020-07-16T15:12:38.752041+0000 mgr.x (mgr.34562) 4518 : cluster [DBG] pgmap v2819: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:12:40.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:12:39 smithi132 bash[27079]: cluster 2020-07-16T15:12:38.752041+0000 mgr.x (mgr.34562) 4518 : cluster [DBG] pgmap v2819: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:12:41.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:12:41 smithi132 bash[27079]: cluster 2020-07-16T15:12:40.752641+0000 mgr.x (mgr.34562) 4519 : cluster [DBG] pgmap v2820: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:12:41.677 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:12:41 smithi188 bash[23329]: cluster 2020-07-16T15:12:40.752641+0000 mgr.x (mgr.34562) 4519 : cluster [DBG] pgmap v2820: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:12:44.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:12:43 smithi188 bash[23329]: cluster 2020-07-16T15:12:42.753084+0000 mgr.x (mgr.34562) 4520 : cluster [DBG] pgmap v2821: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:12:44.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:12:43 smithi132 bash[27079]: cluster 2020-07-16T15:12:42.753084+0000 mgr.x (mgr.34562) 4520 : cluster [DBG] pgmap v2821: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:12:45.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:12:44 smithi132 bash[27079]: audit 2020-07-16T15:12:43.979515+0000 mon.b (mon.2) 1023 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:12:45.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:12:44 smithi132 bash[27079]: audit 2020-07-16T15:12:43.980842+0000 mon.b (mon.2) 1024 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:12:45.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:12:44 smithi132 bash[27079]: audit 2020-07-16T15:12:43.982091+0000 mon.b (mon.2) 1025 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:12:45.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:12:44 smithi132 bash[27079]: audit 2020-07-16T15:12:43.983580+0000 mon.b (mon.2) 1026 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:12:45.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:12:44 smithi132 bash[27079]: audit 2020-07-16T15:12:43.985039+0000 mon.b (mon.2) 1027 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:12:45.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:12:44 smithi188 bash[23329]: audit 2020-07-16T15:12:43.979515+0000 mon.b (mon.2) 1023 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:12:45.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:12:44 smithi188 bash[23329]: audit 2020-07-16T15:12:43.980842+0000 mon.b (mon.2) 1024 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:12:45.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:12:44 smithi188 bash[23329]: audit 2020-07-16T15:12:43.982091+0000 mon.b (mon.2) 1025 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:12:45.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:12:44 smithi188 bash[23329]: audit 2020-07-16T15:12:43.983580+0000 mon.b (mon.2) 1026 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:12:45.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:12:44 smithi188 bash[23329]: audit 2020-07-16T15:12:43.985039+0000 mon.b (mon.2) 1027 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:12:46.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:12:45 smithi188 bash[23329]: audit 2020-07-16T15:12:43.979885+0000 mgr.x (mgr.34562) 4521 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:12:46.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:12:45 smithi188 bash[23329]: audit 2020-07-16T15:12:43.981167+0000 mgr.x (mgr.34562) 4522 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:12:46.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:12:45 smithi188 bash[23329]: audit 2020-07-16T15:12:43.982412+0000 mgr.x (mgr.34562) 4523 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:12:46.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:12:45 smithi188 bash[23329]: cephadm 2020-07-16T15:12:43.983126+0000 mgr.x (mgr.34562) 4524 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:12:46.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:12:45 smithi188 bash[23329]: cephadm 2020-07-16T15:12:43.984458+0000 mgr.x (mgr.34562) 4525 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:12:46.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:12:45 smithi188 bash[23329]: cephadm 2020-07-16T15:12:43.985824+0000 mgr.x (mgr.34562) 4526 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:12:46.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:12:45 smithi188 bash[23329]: cephadm 2020-07-16T15:12:43.985899+0000 mgr.x (mgr.34562) 4527 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:12:46.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:12:45 smithi188 bash[23329]: cluster 2020-07-16T15:12:44.753590+0000 mgr.x (mgr.34562) 4528 : cluster [DBG] pgmap v2822: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:12:46.195 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:12:45 smithi132 bash[27079]: audit 2020-07-16T15:12:43.979885+0000 mgr.x (mgr.34562) 4521 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:12:46.195 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:12:45 smithi132 bash[27079]: audit 2020-07-16T15:12:43.981167+0000 mgr.x (mgr.34562) 4522 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:12:46.196 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:12:45 smithi132 bash[27079]: audit 2020-07-16T15:12:43.982412+0000 mgr.x (mgr.34562) 4523 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:12:46.196 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:12:45 smithi132 bash[27079]: cephadm 2020-07-16T15:12:43.983126+0000 mgr.x (mgr.34562) 4524 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:12:46.196 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:12:45 smithi132 bash[27079]: cephadm 2020-07-16T15:12:43.984458+0000 mgr.x (mgr.34562) 4525 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:12:46.197 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:12:45 smithi132 bash[27079]: cephadm 2020-07-16T15:12:43.985824+0000 mgr.x (mgr.34562) 4526 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:12:46.197 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:12:45 smithi132 bash[27079]: cephadm 2020-07-16T15:12:43.985899+0000 mgr.x (mgr.34562) 4527 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:12:46.197 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:12:45 smithi132 bash[27079]: cluster 2020-07-16T15:12:44.753590+0000 mgr.x (mgr.34562) 4528 : cluster [DBG] pgmap v2822: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:12:47.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:12:46 smithi132 bash[27079]: audit 2020-07-16T15:12:46.772118+0000 mon.b (mon.2) 1028 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:12:47.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:12:46 smithi188 bash[23329]: audit 2020-07-16T15:12:46.772118+0000 mon.b (mon.2) 1028 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:12:48.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:12:47 smithi188 bash[23329]: cluster 2020-07-16T15:12:46.754035+0000 mgr.x (mgr.34562) 4529 : cluster [DBG] pgmap v2823: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:12:48.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:12:47 smithi188 bash[23329]: cephadm 2020-07-16T15:12:46.772736+0000 mgr.x (mgr.34562) 4530 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:12:48.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:12:47 smithi188 bash[23329]: cephadm 2020-07-16T15:12:46.773138+0000 mgr.x (mgr.34562) 4531 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:12:48.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:12:47 smithi132 bash[27079]: cluster 2020-07-16T15:12:46.754035+0000 mgr.x (mgr.34562) 4529 : cluster [DBG] pgmap v2823: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:12:48.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:12:47 smithi132 bash[27079]: cephadm 2020-07-16T15:12:46.772736+0000 mgr.x (mgr.34562) 4530 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:12:48.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:12:47 smithi132 bash[27079]: cephadm 2020-07-16T15:12:46.773138+0000 mgr.x (mgr.34562) 4531 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:12:50.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:12:49 smithi188 bash[23329]: cluster 2020-07-16T15:12:48.754481+0000 mgr.x (mgr.34562) 4532 : cluster [DBG] pgmap v2824: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:12:50.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:12:49 smithi132 bash[27079]: cluster 2020-07-16T15:12:48.754481+0000 mgr.x (mgr.34562) 4532 : cluster [DBG] pgmap v2824: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:12:51.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:12:51 smithi132 bash[27079]: cluster 2020-07-16T15:12:50.755016+0000 mgr.x (mgr.34562) 4533 : cluster [DBG] pgmap v2825: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:12:51.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:12:51 smithi188 bash[23329]: cluster 2020-07-16T15:12:50.755016+0000 mgr.x (mgr.34562) 4533 : cluster [DBG] pgmap v2825: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:12:54.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:12:53 smithi188 bash[23329]: cluster 2020-07-16T15:12:52.755661+0000 mgr.x (mgr.34562) 4534 : cluster [DBG] pgmap v2826: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:12:54.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:12:53 smithi132 bash[27079]: cluster 2020-07-16T15:12:52.755661+0000 mgr.x (mgr.34562) 4534 : cluster [DBG] pgmap v2826: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:12:54.471 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:12:54.737 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:12:54.737 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (95m) 9m ago 98m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:12:54.738 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (98m) 9m ago 98m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:12:54.738 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (95m) 9m ago 101m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:12:54.738 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (95m) 9m ago 103m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:12:54.738 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 9m ago 103m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:12:54.739 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (101m) 9m ago 101m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:12:54.739 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (101m) 9m ago 101m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:12:54.739 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (98m) 9m ago 98m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:12:54.739 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (98m) 9m ago 98m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:12:54.739 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (101m) 9m ago 101m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:12:54.740 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (100m) 9m ago 101m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:12:54.740 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (100m) 9m ago 100m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:12:54.740 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (100m) 9m ago 100m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:12:54.740 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (99m) 9m ago 100m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:12:54.740 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (99m) 9m ago 99m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:12:54.740 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (99m) 9m ago 99m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:12:54.741 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (99m) 9m ago 99m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:12:54.741 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (98m) 9m ago 98m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:12:55.035 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:12:55.035 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:12:55.035 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:12:55.036 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:12:55.036 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:12:55.036 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:12:55.036 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:12:55.036 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:12:55.037 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:12:55.037 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:12:55.037 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:12:55.037 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:12:55.037 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:12:55.037 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:12:55.044 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:12:55.045 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:12:55.045 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:12:56.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:12:55 smithi188 bash[23329]: audit 2020-07-16T15:12:54.460074+0000 mgr.x (mgr.34562) 4535 : audit [DBG] from='client.27934 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:12:56.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:12:55 smithi188 bash[23329]: audit 2020-07-16T15:12:54.733114+0000 mgr.x (mgr.34562) 4536 : audit [DBG] from='client.27940 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:12:56.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:12:55 smithi188 bash[23329]: cluster 2020-07-16T15:12:54.756239+0000 mgr.x (mgr.34562) 4537 : cluster [DBG] pgmap v2827: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:12:56.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:12:55 smithi188 bash[23329]: audit 2020-07-16T15:12:55.034236+0000 mon.c (mon.1) 327 : audit [DBG] from='client.? 172.21.15.132:0/3832555316' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:12:56.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:12:55 smithi132 bash[27079]: audit 2020-07-16T15:12:54.460074+0000 mgr.x (mgr.34562) 4535 : audit [DBG] from='client.27934 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:12:56.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:12:55 smithi132 bash[27079]: audit 2020-07-16T15:12:54.733114+0000 mgr.x (mgr.34562) 4536 : audit [DBG] from='client.27940 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:12:56.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:12:55 smithi132 bash[27079]: cluster 2020-07-16T15:12:54.756239+0000 mgr.x (mgr.34562) 4537 : cluster [DBG] pgmap v2827: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:12:56.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:12:55 smithi132 bash[27079]: audit 2020-07-16T15:12:55.034236+0000 mon.c (mon.1) 327 : audit [DBG] from='client.? 172.21.15.132:0/3832555316' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:12:58.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:12:57 smithi188 bash[23329]: cluster 2020-07-16T15:12:56.756798+0000 mgr.x (mgr.34562) 4538 : cluster [DBG] pgmap v2828: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:12:58.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:12:57 smithi132 bash[27079]: cluster 2020-07-16T15:12:56.756798+0000 mgr.x (mgr.34562) 4538 : cluster [DBG] pgmap v2828: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:13:00.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:12:59 smithi188 bash[23329]: cluster 2020-07-16T15:12:58.757222+0000 mgr.x (mgr.34562) 4539 : cluster [DBG] pgmap v2829: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:13:00.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:12:59 smithi132 bash[27079]: cluster 2020-07-16T15:12:58.757222+0000 mgr.x (mgr.34562) 4539 : cluster [DBG] pgmap v2829: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:13:01.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:01 smithi132 bash[27079]: cluster 2020-07-16T15:13:00.757634+0000 mgr.x (mgr.34562) 4540 : cluster [DBG] pgmap v2830: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:13:01.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:01 smithi188 bash[23329]: cluster 2020-07-16T15:13:00.757634+0000 mgr.x (mgr.34562) 4540 : cluster [DBG] pgmap v2830: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:13:02.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:02 smithi132 bash[27079]: audit 2020-07-16T15:13:01.788718+0000 mon.b (mon.2) 1029 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:13:02.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:02 smithi132 bash[27079]: cephadm 2020-07-16T15:13:01.789635+0000 mgr.x (mgr.34562) 4541 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:13:02.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:02 smithi132 bash[27079]: cephadm 2020-07-16T15:13:01.789806+0000 mgr.x (mgr.34562) 4542 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:13:02.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:02 smithi188 bash[23329]: audit 2020-07-16T15:13:01.788718+0000 mon.b (mon.2) 1029 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:13:02.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:02 smithi188 bash[23329]: cephadm 2020-07-16T15:13:01.789635+0000 mgr.x (mgr.34562) 4541 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:13:02.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:02 smithi188 bash[23329]: cephadm 2020-07-16T15:13:01.789806+0000 mgr.x (mgr.34562) 4542 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:13:03.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:03 smithi132 bash[27079]: cluster 2020-07-16T15:13:02.758178+0000 mgr.x (mgr.34562) 4543 : cluster [DBG] pgmap v2831: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:13:03.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:03 smithi188 bash[23329]: cluster 2020-07-16T15:13:02.758178+0000 mgr.x (mgr.34562) 4543 : cluster [DBG] pgmap v2831: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:13:06.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:05 smithi188 bash[23329]: cluster 2020-07-16T15:13:04.758552+0000 mgr.x (mgr.34562) 4544 : cluster [DBG] pgmap v2832: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:13:06.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:05 smithi132 bash[27079]: cluster 2020-07-16T15:13:04.758552+0000 mgr.x (mgr.34562) 4544 : cluster [DBG] pgmap v2832: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:13:08.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:07 smithi188 bash[23329]: cluster 2020-07-16T15:13:06.758946+0000 mgr.x (mgr.34562) 4545 : cluster [DBG] pgmap v2833: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:13:08.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:07 smithi132 bash[27079]: cluster 2020-07-16T15:13:06.758946+0000 mgr.x (mgr.34562) 4545 : cluster [DBG] pgmap v2833: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:13:10.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:09 smithi188 bash[23329]: cluster 2020-07-16T15:13:08.759377+0000 mgr.x (mgr.34562) 4546 : cluster [DBG] pgmap v2834: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:13:10.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:09 smithi132 bash[27079]: cluster 2020-07-16T15:13:08.759377+0000 mgr.x (mgr.34562) 4546 : cluster [DBG] pgmap v2834: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:13:11.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:11 smithi132 bash[27079]: cluster 2020-07-16T15:13:10.759863+0000 mgr.x (mgr.34562) 4547 : cluster [DBG] pgmap v2835: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:13:11.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:11 smithi188 bash[23329]: cluster 2020-07-16T15:13:10.759863+0000 mgr.x (mgr.34562) 4547 : cluster [DBG] pgmap v2835: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:13:14.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:13 smithi188 bash[23329]: cluster 2020-07-16T15:13:12.760297+0000 mgr.x (mgr.34562) 4548 : cluster [DBG] pgmap v2836: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:13:14.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:13 smithi132 bash[27079]: cluster 2020-07-16T15:13:12.760297+0000 mgr.x (mgr.34562) 4548 : cluster [DBG] pgmap v2836: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:13:16.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:15 smithi188 bash[23329]: cluster 2020-07-16T15:13:14.760708+0000 mgr.x (mgr.34562) 4549 : cluster [DBG] pgmap v2837: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:13:16.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:15 smithi132 bash[27079]: cluster 2020-07-16T15:13:14.760708+0000 mgr.x (mgr.34562) 4549 : cluster [DBG] pgmap v2837: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:13:17.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:16 smithi188 bash[23329]: audit 2020-07-16T15:13:16.805489+0000 mon.b (mon.2) 1030 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:13:17.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:16 smithi132 bash[27079]: audit 2020-07-16T15:13:16.805489+0000 mon.b (mon.2) 1030 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:13:18.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:17 smithi188 bash[23329]: cluster 2020-07-16T15:13:16.761212+0000 mgr.x (mgr.34562) 4550 : cluster [DBG] pgmap v2838: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:13:18.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:17 smithi188 bash[23329]: cephadm 2020-07-16T15:13:16.806243+0000 mgr.x (mgr.34562) 4551 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:13:18.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:17 smithi188 bash[23329]: cephadm 2020-07-16T15:13:16.806693+0000 mgr.x (mgr.34562) 4552 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:13:18.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:17 smithi132 bash[27079]: cluster 2020-07-16T15:13:16.761212+0000 mgr.x (mgr.34562) 4550 : cluster [DBG] pgmap v2838: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:13:18.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:17 smithi132 bash[27079]: cephadm 2020-07-16T15:13:16.806243+0000 mgr.x (mgr.34562) 4551 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:13:18.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:17 smithi132 bash[27079]: cephadm 2020-07-16T15:13:16.806693+0000 mgr.x (mgr.34562) 4552 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:13:20.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:19 smithi188 bash[23329]: cluster 2020-07-16T15:13:18.761679+0000 mgr.x (mgr.34562) 4553 : cluster [DBG] pgmap v2839: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:13:20.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:19 smithi132 bash[27079]: cluster 2020-07-16T15:13:18.761679+0000 mgr.x (mgr.34562) 4553 : cluster [DBG] pgmap v2839: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:13:21.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:21 smithi132 bash[27079]: cluster 2020-07-16T15:13:20.762183+0000 mgr.x (mgr.34562) 4554 : cluster [DBG] pgmap v2840: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:13:21.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:21 smithi188 bash[23329]: cluster 2020-07-16T15:13:20.762183+0000 mgr.x (mgr.34562) 4554 : cluster [DBG] pgmap v2840: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:13:24.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:23 smithi188 bash[23329]: cluster 2020-07-16T15:13:22.762651+0000 mgr.x (mgr.34562) 4555 : cluster [DBG] pgmap v2841: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:13:24.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:23 smithi132 bash[27079]: cluster 2020-07-16T15:13:22.762651+0000 mgr.x (mgr.34562) 4555 : cluster [DBG] pgmap v2841: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:13:25.338 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:13:25.598 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:13:25.599 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (96m) 10m ago 99m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:13:25.599 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (98m) 10m ago 98m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:13:25.599 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (96m) 10m ago 102m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:13:25.599 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (95m) 10m ago 103m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:13:25.600 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 10m ago 103m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:13:25.600 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (102m) 10m ago 102m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:13:25.600 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (102m) 10m ago 102m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:13:25.600 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (99m) 10m ago 99m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:13:25.600 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (99m) 10m ago 99m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:13:25.601 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (101m) 10m ago 101m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:13:25.601 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (101m) 10m ago 101m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:13:25.601 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (101m) 10m ago 101m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:13:25.601 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (100m) 10m ago 100m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:13:25.602 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (100m) 10m ago 100m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:13:25.602 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (100m) 10m ago 100m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:13:25.602 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (100m) 10m ago 100m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:13:25.602 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (99m) 10m ago 99m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:13:25.603 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (98m) 10m ago 99m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:13:25.897 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:13:25.898 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:13:25.898 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:13:25.899 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:13:25.899 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:13:25.899 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:13:25.900 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:13:25.900 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:13:25.900 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:13:25.900 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:13:25.900 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:13:25.901 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:13:25.901 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:13:25.901 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:13:25.901 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:13:25.902 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:13:25.902 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:13:26.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:25 smithi188 bash[23329]: cluster 2020-07-16T15:13:24.763139+0000 mgr.x (mgr.34562) 4556 : cluster [DBG] pgmap v2842: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:13:26.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:25 smithi132 bash[27079]: cluster 2020-07-16T15:13:24.763139+0000 mgr.x (mgr.34562) 4556 : cluster [DBG] pgmap v2842: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:13:27.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:26 smithi188 bash[23329]: audit 2020-07-16T15:13:25.325492+0000 mgr.x (mgr.34562) 4557 : audit [DBG] from='client.27952 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:13:27.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:26 smithi188 bash[23329]: audit 2020-07-16T15:13:25.594435+0000 mgr.x (mgr.34562) 4558 : audit [DBG] from='client.27958 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:13:27.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:26 smithi188 bash[23329]: audit 2020-07-16T15:13:25.896817+0000 mon.c (mon.1) 328 : audit [DBG] from='client.? 172.21.15.132:0/2031068607' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:13:27.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:26 smithi132 bash[27079]: audit 2020-07-16T15:13:25.325492+0000 mgr.x (mgr.34562) 4557 : audit [DBG] from='client.27952 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:13:27.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:26 smithi132 bash[27079]: audit 2020-07-16T15:13:25.594435+0000 mgr.x (mgr.34562) 4558 : audit [DBG] from='client.27958 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:13:27.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:26 smithi132 bash[27079]: audit 2020-07-16T15:13:25.896817+0000 mon.c (mon.1) 328 : audit [DBG] from='client.? 172.21.15.132:0/2031068607' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:13:28.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:27 smithi188 bash[23329]: cluster 2020-07-16T15:13:26.763605+0000 mgr.x (mgr.34562) 4559 : cluster [DBG] pgmap v2843: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:13:28.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:27 smithi132 bash[27079]: cluster 2020-07-16T15:13:26.763605+0000 mgr.x (mgr.34562) 4559 : cluster [DBG] pgmap v2843: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:13:30.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:29 smithi188 bash[23329]: cluster 2020-07-16T15:13:28.763971+0000 mgr.x (mgr.34562) 4560 : cluster [DBG] pgmap v2844: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:13:30.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:29 smithi132 bash[27079]: cluster 2020-07-16T15:13:28.763971+0000 mgr.x (mgr.34562) 4560 : cluster [DBG] pgmap v2844: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:13:31.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:31 smithi132 bash[27079]: cluster 2020-07-16T15:13:30.764355+0000 mgr.x (mgr.34562) 4561 : cluster [DBG] pgmap v2845: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:13:31.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:31 smithi188 bash[23329]: cluster 2020-07-16T15:13:30.764355+0000 mgr.x (mgr.34562) 4561 : cluster [DBG] pgmap v2845: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:13:32.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:32 smithi132 bash[27079]: audit 2020-07-16T15:13:31.822308+0000 mon.b (mon.2) 1031 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:13:32.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:32 smithi132 bash[27079]: cephadm 2020-07-16T15:13:31.823054+0000 mgr.x (mgr.34562) 4562 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:13:32.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:32 smithi132 bash[27079]: cephadm 2020-07-16T15:13:31.823222+0000 mgr.x (mgr.34562) 4563 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:13:32.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:32 smithi188 bash[23329]: audit 2020-07-16T15:13:31.822308+0000 mon.b (mon.2) 1031 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:13:32.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:32 smithi188 bash[23329]: cephadm 2020-07-16T15:13:31.823054+0000 mgr.x (mgr.34562) 4562 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:13:32.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:32 smithi188 bash[23329]: cephadm 2020-07-16T15:13:31.823222+0000 mgr.x (mgr.34562) 4563 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:13:33.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:33 smithi132 bash[27079]: cluster 2020-07-16T15:13:32.764835+0000 mgr.x (mgr.34562) 4564 : cluster [DBG] pgmap v2846: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:13:33.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:33 smithi188 bash[23329]: cluster 2020-07-16T15:13:32.764835+0000 mgr.x (mgr.34562) 4564 : cluster [DBG] pgmap v2846: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:13:36.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:35 smithi188 bash[23329]: cluster 2020-07-16T15:13:34.765202+0000 mgr.x (mgr.34562) 4565 : cluster [DBG] pgmap v2847: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:13:36.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:35 smithi132 bash[27079]: cluster 2020-07-16T15:13:34.765202+0000 mgr.x (mgr.34562) 4565 : cluster [DBG] pgmap v2847: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:13:38.183 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:37 smithi188 bash[23329]: cluster 2020-07-16T15:13:36.765632+0000 mgr.x (mgr.34562) 4566 : cluster [DBG] pgmap v2848: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:13:38.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:37 smithi132 bash[27079]: cluster 2020-07-16T15:13:36.765632+0000 mgr.x (mgr.34562) 4566 : cluster [DBG] pgmap v2848: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:13:40.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:39 smithi188 bash[23329]: cluster 2020-07-16T15:13:38.766078+0000 mgr.x (mgr.34562) 4567 : cluster [DBG] pgmap v2849: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:13:40.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:39 smithi132 bash[27079]: cluster 2020-07-16T15:13:38.766078+0000 mgr.x (mgr.34562) 4567 : cluster [DBG] pgmap v2849: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:13:41.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:41 smithi132 bash[27079]: cluster 2020-07-16T15:13:40.766654+0000 mgr.x (mgr.34562) 4568 : cluster [DBG] pgmap v2850: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:13:41.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:41 smithi188 bash[23329]: cluster 2020-07-16T15:13:40.766654+0000 mgr.x (mgr.34562) 4568 : cluster [DBG] pgmap v2850: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:13:44.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:43 smithi188 bash[23329]: cluster 2020-07-16T15:13:42.767104+0000 mgr.x (mgr.34562) 4569 : cluster [DBG] pgmap v2851: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:13:44.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:43 smithi132 bash[27079]: cluster 2020-07-16T15:13:42.767104+0000 mgr.x (mgr.34562) 4569 : cluster [DBG] pgmap v2851: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:13:46.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:45 smithi188 bash[23329]: cluster 2020-07-16T15:13:44.767544+0000 mgr.x (mgr.34562) 4570 : cluster [DBG] pgmap v2852: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:13:46.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:45 smithi132 bash[27079]: cluster 2020-07-16T15:13:44.767544+0000 mgr.x (mgr.34562) 4570 : cluster [DBG] pgmap v2852: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:13:48.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:47 smithi188 bash[23329]: cluster 2020-07-16T15:13:46.767974+0000 mgr.x (mgr.34562) 4571 : cluster [DBG] pgmap v2853: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:13:48.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:47 smithi188 bash[23329]: audit 2020-07-16T15:13:46.839509+0000 mon.b (mon.2) 1032 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T15:13:48.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:47 smithi188 bash[23329]: audit 2020-07-16T15:13:46.839721+0000 mon.b (mon.2) 1033 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T15:13:48.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:47 smithi132 bash[27079]: cluster 2020-07-16T15:13:46.767974+0000 mgr.x (mgr.34562) 4571 : cluster [DBG] pgmap v2853: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:13:48.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:47 smithi132 bash[27079]: audit 2020-07-16T15:13:46.839509+0000 mon.b (mon.2) 1032 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T15:13:48.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:47 smithi132 bash[27079]: audit 2020-07-16T15:13:46.839721+0000 mon.b (mon.2) 1033 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T15:13:50.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:49 smithi188 bash[23329]: cluster 2020-07-16T15:13:48.768347+0000 mgr.x (mgr.34562) 4572 : cluster [DBG] pgmap v2854: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:13:50.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:49 smithi188 bash[23329]: audit 2020-07-16T15:13:49.050173+0000 mon.b (mon.2) 1034 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:13:49.048668\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.048727\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.048761\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.048789\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.048942\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.049043\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.049141\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.049239\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.049272\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:13:49.049371\", \"last_device_update\": \"2020-07-16T15:04:18.042470\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:05:20.982249\"}"}]: dispatch 2020-07-16T15:13:50.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:49 smithi188 bash[23329]: audit 2020-07-16T15:13:49.050690+0000 mon.c (mon.1) 329 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:13:49.048668\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.048727\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.048761\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.048789\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.048942\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.049043\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.049141\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.049239\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.049272\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:13:49.049371\", \"last_device_update\": \"2020-07-16T15:04:18.042470\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:05:20.982249\"}"}]: dispatch 2020-07-16T15:13:50.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:49 smithi188 bash[23329]: audit 2020-07-16T15:13:49.053557+0000 mon.c (mon.1) 330 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:13:49.048668\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.048727\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.048761\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.048789\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.048942\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.049043\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.049141\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.049239\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.049272\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:13:49.049371\", \"last_device_update\": \"2020-07-16T15:04:18.042470\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:05:20.982249\"}"}]': finished 2020-07-16T15:13:50.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:49 smithi188 bash[23329]: audit 2020-07-16T15:13:49.425091+0000 mon.b (mon.2) 1035 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.423601\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.423671\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.423702\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.423856\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.423957\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.424056\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.424153\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.424185\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.424213\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:13:49.424279\", \"last_device_update\": \"2020-07-16T15:05:23.895950\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:05:20.988668\"}"}]: dispatch 2020-07-16T15:13:50.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:49 smithi188 bash[23329]: audit 2020-07-16T15:13:49.425704+0000 mon.c (mon.1) 331 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.423601\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.423671\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.423702\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.423856\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.423957\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.424056\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.424153\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.424185\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.424213\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:13:49.424279\", \"last_device_update\": \"2020-07-16T15:05:23.895950\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:05:20.988668\"}"}]: dispatch 2020-07-16T15:13:50.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:49 smithi188 bash[23329]: audit 2020-07-16T15:13:49.428405+0000 mon.c (mon.1) 332 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.423601\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.423671\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.423702\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.423856\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.423957\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.424056\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.424153\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.424185\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.424213\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:13:49.424279\", \"last_device_update\": \"2020-07-16T15:05:23.895950\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:05:20.988668\"}"}]': finished 2020-07-16T15:13:50.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:49 smithi188 bash[23329]: audit 2020-07-16T15:13:49.436049+0000 mon.b (mon.2) 1036 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:13:50.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:49 smithi188 bash[23329]: audit 2020-07-16T15:13:49.439252+0000 mon.b (mon.2) 1037 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:13:50.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:49 smithi188 bash[23329]: audit 2020-07-16T15:13:49.440523+0000 mon.b (mon.2) 1038 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:13:50.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:49 smithi188 bash[23329]: audit 2020-07-16T15:13:49.441762+0000 mon.b (mon.2) 1039 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:13:50.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:49 smithi188 bash[23329]: audit 2020-07-16T15:13:49.442862+0000 mon.b (mon.2) 1040 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:13:50.181 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:49 smithi132 bash[27079]: cluster 2020-07-16T15:13:48.768347+0000 mgr.x (mgr.34562) 4572 : cluster [DBG] pgmap v2854: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:13:50.181 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:49 smithi132 bash[27079]: audit 2020-07-16T15:13:49.050173+0000 mon.b (mon.2) 1034 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:13:49.048668\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.048727\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.048761\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.048789\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.048942\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.049043\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.049141\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.049239\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.049272\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:13:49.049371\", \"last_device_update\": \"2020-07-16T15:04:18.042470\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:05:20.982249\"}"}]: dispatch 2020-07-16T15:13:50.181 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:49 smithi132 bash[27079]: audit 2020-07-16T15:13:49.050690+0000 mon.c (mon.1) 329 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:13:49.048668\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.048727\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.048761\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.048789\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.048942\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.049043\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.049141\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.049239\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.049272\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:13:49.049371\", \"last_device_update\": \"2020-07-16T15:04:18.042470\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:05:20.982249\"}"}]: dispatch 2020-07-16T15:13:50.182 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:49 smithi132 bash[27079]: audit 2020-07-16T15:13:49.053557+0000 mon.c (mon.1) 330 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:13:49.048668\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.048727\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.048761\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.048789\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.048942\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.049043\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.049141\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.049239\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.049272\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:13:49.049371\", \"last_device_update\": \"2020-07-16T15:04:18.042470\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:05:20.982249\"}"}]': finished 2020-07-16T15:13:50.182 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:49 smithi132 bash[27079]: audit 2020-07-16T15:13:49.425091+0000 mon.b (mon.2) 1035 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.423601\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.423671\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.423702\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.423856\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.423957\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.424056\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.424153\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.424185\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.424213\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:13:49.424279\", \"last_device_update\": \"2020-07-16T15:05:23.895950\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:05:20.988668\"}"}]: dispatch 2020-07-16T15:13:50.182 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:49 smithi132 bash[27079]: audit 2020-07-16T15:13:49.425704+0000 mon.c (mon.1) 331 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.423601\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.423671\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.423702\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.423856\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.423957\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.424056\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.424153\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.424185\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.424213\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:13:49.424279\", \"last_device_update\": \"2020-07-16T15:05:23.895950\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:05:20.988668\"}"}]: dispatch 2020-07-16T15:13:50.183 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:49 smithi132 bash[27079]: audit 2020-07-16T15:13:49.428405+0000 mon.c (mon.1) 332 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.423601\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.423671\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.423702\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.423856\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.423957\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.424056\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.424153\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.424185\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.424213\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:13:49.424279\", \"last_device_update\": \"2020-07-16T15:05:23.895950\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:05:20.988668\"}"}]': finished 2020-07-16T15:13:50.183 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:49 smithi132 bash[27079]: audit 2020-07-16T15:13:49.436049+0000 mon.b (mon.2) 1036 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:13:50.183 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:49 smithi132 bash[27079]: audit 2020-07-16T15:13:49.439252+0000 mon.b (mon.2) 1037 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:13:50.183 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:49 smithi132 bash[27079]: audit 2020-07-16T15:13:49.440523+0000 mon.b (mon.2) 1038 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:13:50.183 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:49 smithi132 bash[27079]: audit 2020-07-16T15:13:49.441762+0000 mon.b (mon.2) 1039 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:13:50.184 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:49 smithi132 bash[27079]: audit 2020-07-16T15:13:49.442862+0000 mon.b (mon.2) 1040 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:13:51.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:50 smithi188 bash[23329]: audit 2020-07-16T15:13:49.436436+0000 mgr.x (mgr.34562) 4573 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:13:51.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:50 smithi188 bash[23329]: audit 2020-07-16T15:13:49.439750+0000 mgr.x (mgr.34562) 4574 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:13:51.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:50 smithi188 bash[23329]: audit 2020-07-16T15:13:49.440910+0000 mgr.x (mgr.34562) 4575 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:13:51.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:50 smithi188 bash[23329]: cephadm 2020-07-16T15:13:49.441512+0000 mgr.x (mgr.34562) 4576 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:13:51.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:50 smithi188 bash[23329]: cephadm 2020-07-16T15:13:49.442482+0000 mgr.x (mgr.34562) 4577 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:13:51.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:50 smithi188 bash[23329]: cephadm 2020-07-16T15:13:49.443423+0000 mgr.x (mgr.34562) 4578 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:13:51.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:50 smithi188 bash[23329]: cephadm 2020-07-16T15:13:49.443471+0000 mgr.x (mgr.34562) 4579 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:13:51.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:50 smithi132 bash[27079]: audit 2020-07-16T15:13:49.436436+0000 mgr.x (mgr.34562) 4573 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:13:51.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:50 smithi132 bash[27079]: audit 2020-07-16T15:13:49.439750+0000 mgr.x (mgr.34562) 4574 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:13:51.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:50 smithi132 bash[27079]: audit 2020-07-16T15:13:49.440910+0000 mgr.x (mgr.34562) 4575 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:13:51.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:50 smithi132 bash[27079]: cephadm 2020-07-16T15:13:49.441512+0000 mgr.x (mgr.34562) 4576 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:13:51.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:50 smithi132 bash[27079]: cephadm 2020-07-16T15:13:49.442482+0000 mgr.x (mgr.34562) 4577 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:13:51.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:50 smithi132 bash[27079]: cephadm 2020-07-16T15:13:49.443423+0000 mgr.x (mgr.34562) 4578 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:13:51.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:50 smithi132 bash[27079]: cephadm 2020-07-16T15:13:49.443471+0000 mgr.x (mgr.34562) 4579 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:13:52.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:51 smithi132 bash[27079]: cluster 2020-07-16T15:13:50.768800+0000 mgr.x (mgr.34562) 4580 : cluster [DBG] pgmap v2855: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:13:52.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:51 smithi188 bash[23329]: cluster 2020-07-16T15:13:50.768800+0000 mgr.x (mgr.34562) 4580 : cluster [DBG] pgmap v2855: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:13:53.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:52 smithi188 bash[23329]: audit 2020-07-16T15:13:52.269705+0000 mon.b (mon.2) 1041 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:13:53.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:52 smithi132 bash[27079]: audit 2020-07-16T15:13:52.269705+0000 mon.b (mon.2) 1041 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:13:54.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:53 smithi188 bash[23329]: cephadm 2020-07-16T15:13:52.270331+0000 mgr.x (mgr.34562) 4581 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:13:54.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:53 smithi188 bash[23329]: cephadm 2020-07-16T15:13:52.270547+0000 mgr.x (mgr.34562) 4582 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:13:54.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:53 smithi188 bash[23329]: cluster 2020-07-16T15:13:52.769217+0000 mgr.x (mgr.34562) 4583 : cluster [DBG] pgmap v2856: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:13:54.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:53 smithi132 bash[27079]: cephadm 2020-07-16T15:13:52.270331+0000 mgr.x (mgr.34562) 4581 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:13:54.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:53 smithi132 bash[27079]: cephadm 2020-07-16T15:13:52.270547+0000 mgr.x (mgr.34562) 4582 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:13:54.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:53 smithi132 bash[27079]: cluster 2020-07-16T15:13:52.769217+0000 mgr.x (mgr.34562) 4583 : cluster [DBG] pgmap v2856: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:13:56.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:55 smithi188 bash[23329]: cluster 2020-07-16T15:13:54.769692+0000 mgr.x (mgr.34562) 4584 : cluster [DBG] pgmap v2857: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:13:56.195 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:13:56.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:55 smithi132 bash[27079]: cluster 2020-07-16T15:13:54.769692+0000 mgr.x (mgr.34562) 4584 : cluster [DBG] pgmap v2857: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:13:56.455 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:13:56.456 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (96m) 7s ago 99m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:13:56.456 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (99m) 7s ago 99m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:13:56.456 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (97m) 7s ago 102m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:13:56.456 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (96m) 7s ago 104m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:13:56.457 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 7s ago 104m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:13:56.457 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (102m) 7s ago 102m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:13:56.457 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (102m) 7s ago 102m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:13:56.457 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (99m) 7s ago 99m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:13:56.457 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (99m) 7s ago 99m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:13:56.458 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (102m) 7s ago 102m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:13:56.458 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (102m) 7s ago 102m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:13:56.458 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (101m) 7s ago 101m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:13:56.458 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (101m) 7s ago 101m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:13:56.458 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (100m) 7s ago 101m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:13:56.459 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (100m) 7s ago 100m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:13:56.459 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (100m) 7s ago 100m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:13:56.459 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (100m) 7s ago 100m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:13:56.459 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (99m) 7s ago 99m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:13:56.750 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:13:56.751 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:13:56.751 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:13:56.751 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:13:56.751 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:13:56.751 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:13:56.752 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:13:56.752 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:13:56.752 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:13:56.752 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:13:56.752 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:13:56.753 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:13:56.753 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:13:56.753 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:13:56.753 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:13:56.753 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:13:56.754 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:13:57.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:56 smithi188 bash[23329]: audit 2020-07-16T15:13:56.749900+0000 mon.c (mon.1) 333 : audit [DBG] from='client.? 172.21.15.132:0/2246732757' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:13:57.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:56 smithi132 bash[27079]: audit 2020-07-16T15:13:56.749900+0000 mon.c (mon.1) 333 : audit [DBG] from='client.? 172.21.15.132:0/2246732757' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:13:58.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:57 smithi188 bash[23329]: audit 2020-07-16T15:13:56.183486+0000 mgr.x (mgr.34562) 4585 : audit [DBG] from='client.27970 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:13:58.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:57 smithi188 bash[23329]: audit 2020-07-16T15:13:56.450910+0000 mgr.x (mgr.34562) 4586 : audit [DBG] from='client.27976 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:13:58.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:57 smithi188 bash[23329]: cluster 2020-07-16T15:13:56.770018+0000 mgr.x (mgr.34562) 4587 : cluster [DBG] pgmap v2858: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:13:58.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:57 smithi132 bash[27079]: audit 2020-07-16T15:13:56.183486+0000 mgr.x (mgr.34562) 4585 : audit [DBG] from='client.27970 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:13:58.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:57 smithi132 bash[27079]: audit 2020-07-16T15:13:56.450910+0000 mgr.x (mgr.34562) 4586 : audit [DBG] from='client.27976 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:13:58.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:57 smithi132 bash[27079]: cluster 2020-07-16T15:13:56.770018+0000 mgr.x (mgr.34562) 4587 : cluster [DBG] pgmap v2858: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:13:59.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:13:58 smithi188 bash[23329]: cluster 2020-07-16T15:13:58.770396+0000 mgr.x (mgr.34562) 4588 : cluster [DBG] pgmap v2859: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:13:59.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:13:58 smithi132 bash[27079]: cluster 2020-07-16T15:13:58.770396+0000 mgr.x (mgr.34562) 4588 : cluster [DBG] pgmap v2859: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:14:01.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:14:01 smithi132 bash[27079]: cluster 2020-07-16T15:14:00.770854+0000 mgr.x (mgr.34562) 4589 : cluster [DBG] pgmap v2860: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:14:01.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:14:01 smithi188 bash[23329]: cluster 2020-07-16T15:14:00.770854+0000 mgr.x (mgr.34562) 4589 : cluster [DBG] pgmap v2860: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:14:04.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:14:03 smithi188 bash[23329]: cluster 2020-07-16T15:14:02.771437+0000 mgr.x (mgr.34562) 4590 : cluster [DBG] pgmap v2861: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:14:04.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:14:03 smithi132 bash[27079]: cluster 2020-07-16T15:14:02.771437+0000 mgr.x (mgr.34562) 4590 : cluster [DBG] pgmap v2861: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:14:06.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:14:05 smithi188 bash[23329]: cluster 2020-07-16T15:14:04.771964+0000 mgr.x (mgr.34562) 4591 : cluster [DBG] pgmap v2862: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:14:06.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:14:05 smithi132 bash[27079]: cluster 2020-07-16T15:14:04.771964+0000 mgr.x (mgr.34562) 4591 : cluster [DBG] pgmap v2862: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:14:08.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:14:07 smithi188 bash[23329]: cluster 2020-07-16T15:14:06.772371+0000 mgr.x (mgr.34562) 4592 : cluster [DBG] pgmap v2863: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:14:08.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:14:07 smithi188 bash[23329]: audit 2020-07-16T15:14:07.282372+0000 mon.b (mon.2) 1042 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:14:08.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:14:07 smithi132 bash[27079]: cluster 2020-07-16T15:14:06.772371+0000 mgr.x (mgr.34562) 4592 : cluster [DBG] pgmap v2863: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:14:08.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:14:07 smithi132 bash[27079]: audit 2020-07-16T15:14:07.282372+0000 mon.b (mon.2) 1042 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:14:09.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:14:08 smithi188 bash[23329]: cephadm 2020-07-16T15:14:07.283064+0000 mgr.x (mgr.34562) 4593 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:14:09.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:14:08 smithi188 bash[23329]: cephadm 2020-07-16T15:14:07.283479+0000 mgr.x (mgr.34562) 4594 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:14:09.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:14:08 smithi132 bash[27079]: cephadm 2020-07-16T15:14:07.283064+0000 mgr.x (mgr.34562) 4593 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:14:09.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:14:08 smithi132 bash[27079]: cephadm 2020-07-16T15:14:07.283479+0000 mgr.x (mgr.34562) 4594 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:14:10.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:14:09 smithi188 bash[23329]: cluster 2020-07-16T15:14:08.772876+0000 mgr.x (mgr.34562) 4595 : cluster [DBG] pgmap v2864: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:14:10.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:14:09 smithi132 bash[27079]: cluster 2020-07-16T15:14:08.772876+0000 mgr.x (mgr.34562) 4595 : cluster [DBG] pgmap v2864: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:14:11.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:14:11 smithi132 bash[27079]: cluster 2020-07-16T15:14:10.773276+0000 mgr.x (mgr.34562) 4596 : cluster [DBG] pgmap v2865: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:14:11.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:14:11 smithi188 bash[23329]: cluster 2020-07-16T15:14:10.773276+0000 mgr.x (mgr.34562) 4596 : cluster [DBG] pgmap v2865: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:14:14.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:14:13 smithi188 bash[23329]: cluster 2020-07-16T15:14:12.773659+0000 mgr.x (mgr.34562) 4597 : cluster [DBG] pgmap v2866: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:14:14.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:14:13 smithi132 bash[27079]: cluster 2020-07-16T15:14:12.773659+0000 mgr.x (mgr.34562) 4597 : cluster [DBG] pgmap v2866: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:14:16.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:14:15 smithi188 bash[23329]: cluster 2020-07-16T15:14:14.774182+0000 mgr.x (mgr.34562) 4598 : cluster [DBG] pgmap v2867: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:14:16.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:14:15 smithi132 bash[27079]: cluster 2020-07-16T15:14:14.774182+0000 mgr.x (mgr.34562) 4598 : cluster [DBG] pgmap v2867: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:14:18.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:14:17 smithi188 bash[23329]: cluster 2020-07-16T15:14:16.774777+0000 mgr.x (mgr.34562) 4599 : cluster [DBG] pgmap v2868: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:14:18.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:14:17 smithi132 bash[27079]: cluster 2020-07-16T15:14:16.774777+0000 mgr.x (mgr.34562) 4599 : cluster [DBG] pgmap v2868: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:14:20.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:14:19 smithi188 bash[23329]: cluster 2020-07-16T15:14:18.775254+0000 mgr.x (mgr.34562) 4600 : cluster [DBG] pgmap v2869: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:14:20.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:14:19 smithi132 bash[27079]: cluster 2020-07-16T15:14:18.775254+0000 mgr.x (mgr.34562) 4600 : cluster [DBG] pgmap v2869: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:14:21.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:14:21 smithi132 bash[27079]: cluster 2020-07-16T15:14:20.775709+0000 mgr.x (mgr.34562) 4601 : cluster [DBG] pgmap v2870: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:14:21.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:14:21 smithi188 bash[23329]: cluster 2020-07-16T15:14:20.775709+0000 mgr.x (mgr.34562) 4601 : cluster [DBG] pgmap v2870: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:14:22.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:14:22 smithi188 bash[23329]: audit 2020-07-16T15:14:22.299017+0000 mon.b (mon.2) 1043 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:14:22.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:14:22 smithi132 bash[27079]: audit 2020-07-16T15:14:22.299017+0000 mon.b (mon.2) 1043 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:14:23.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:14:23 smithi188 bash[23329]: cephadm 2020-07-16T15:14:22.299728+0000 mgr.x (mgr.34562) 4602 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:14:23.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:14:23 smithi188 bash[23329]: cephadm 2020-07-16T15:14:22.299862+0000 mgr.x (mgr.34562) 4603 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:14:23.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:14:23 smithi188 bash[23329]: cluster 2020-07-16T15:14:22.776140+0000 mgr.x (mgr.34562) 4604 : cluster [DBG] pgmap v2871: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:14:23.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:14:23 smithi132 bash[27079]: cephadm 2020-07-16T15:14:22.299728+0000 mgr.x (mgr.34562) 4602 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:14:23.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:14:23 smithi132 bash[27079]: cephadm 2020-07-16T15:14:22.299862+0000 mgr.x (mgr.34562) 4603 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:14:23.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:14:23 smithi132 bash[27079]: cluster 2020-07-16T15:14:22.776140+0000 mgr.x (mgr.34562) 4604 : cluster [DBG] pgmap v2871: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:14:26.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:14:25 smithi188 bash[23329]: cluster 2020-07-16T15:14:24.776616+0000 mgr.x (mgr.34562) 4605 : cluster [DBG] pgmap v2872: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:14:26.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:14:25 smithi132 bash[27079]: cluster 2020-07-16T15:14:24.776616+0000 mgr.x (mgr.34562) 4605 : cluster [DBG] pgmap v2872: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:14:27.049 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:14:27.309 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:14:27.309 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (97m) 38s ago 100m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:14:27.310 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (99m) 37s ago 99m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:14:27.310 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (97m) 37s ago 103m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:14:27.310 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (96m) 38s ago 104m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:14:27.311 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 38s ago 104m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:14:27.311 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (103m) 37s ago 103m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:14:27.311 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (103m) 38s ago 103m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:14:27.312 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (100m) 38s ago 100m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:14:27.312 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (100m) 37s ago 100m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:14:27.312 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (102m) 38s ago 102m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:14:27.313 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (102m) 38s ago 102m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:14:27.313 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (102m) 38s ago 102m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:14:27.313 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (101m) 38s ago 101m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:14:27.314 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (101m) 37s ago 101m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:14:27.314 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (101m) 37s ago 101m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:14:27.314 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (101m) 37s ago 101m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:14:27.315 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (100m) 37s ago 100m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:14:27.315 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (99m) 37s ago 100m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:14:27.607 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:14:27.607 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:14:27.608 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:14:27.608 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:14:27.608 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:14:27.609 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:14:27.609 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:14:27.609 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:14:27.610 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:14:27.610 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:14:27.610 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:14:27.610 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:14:27.611 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:14:27.611 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:14:27.611 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:14:27.612 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:14:27.612 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:14:28.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:14:27 smithi188 bash[23329]: cluster 2020-07-16T15:14:26.777124+0000 mgr.x (mgr.34562) 4606 : cluster [DBG] pgmap v2873: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:14:28.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:14:27 smithi188 bash[23329]: audit 2020-07-16T15:14:27.606195+0000 mon.c (mon.1) 334 : audit [DBG] from='client.? 172.21.15.132:0/619102517' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:14:28.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:14:27 smithi132 bash[27079]: cluster 2020-07-16T15:14:26.777124+0000 mgr.x (mgr.34562) 4606 : cluster [DBG] pgmap v2873: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:14:28.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:14:27 smithi132 bash[27079]: audit 2020-07-16T15:14:27.606195+0000 mon.c (mon.1) 334 : audit [DBG] from='client.? 172.21.15.132:0/619102517' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:14:29.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:14:28 smithi188 bash[23329]: audit 2020-07-16T15:14:27.037827+0000 mgr.x (mgr.34562) 4607 : audit [DBG] from='client.27988 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:14:29.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:14:28 smithi188 bash[23329]: audit 2020-07-16T15:14:27.304522+0000 mgr.x (mgr.34562) 4608 : audit [DBG] from='client.27994 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:14:29.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:14:28 smithi132 bash[27079]: audit 2020-07-16T15:14:27.037827+0000 mgr.x (mgr.34562) 4607 : audit [DBG] from='client.27988 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:14:29.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:14:28 smithi132 bash[27079]: audit 2020-07-16T15:14:27.304522+0000 mgr.x (mgr.34562) 4608 : audit [DBG] from='client.27994 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:14:30.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:14:29 smithi188 bash[23329]: cluster 2020-07-16T15:14:28.777488+0000 mgr.x (mgr.34562) 4609 : cluster [DBG] pgmap v2874: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:14:30.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:14:29 smithi132 bash[27079]: cluster 2020-07-16T15:14:28.777488+0000 mgr.x (mgr.34562) 4609 : cluster [DBG] pgmap v2874: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:14:31.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:14:31 smithi132 bash[27079]: cluster 2020-07-16T15:14:30.777856+0000 mgr.x (mgr.34562) 4610 : cluster [DBG] pgmap v2875: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:14:31.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:14:31 smithi188 bash[23329]: cluster 2020-07-16T15:14:30.777856+0000 mgr.x (mgr.34562) 4610 : cluster [DBG] pgmap v2875: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:14:34.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:14:33 smithi188 bash[23329]: cluster 2020-07-16T15:14:32.778439+0000 mgr.x (mgr.34562) 4611 : cluster [DBG] pgmap v2876: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:14:34.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:14:33 smithi132 bash[27079]: cluster 2020-07-16T15:14:32.778439+0000 mgr.x (mgr.34562) 4611 : cluster [DBG] pgmap v2876: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:14:36.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:14:35 smithi188 bash[23329]: cluster 2020-07-16T15:14:34.778779+0000 mgr.x (mgr.34562) 4612 : cluster [DBG] pgmap v2877: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:14:36.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:14:35 smithi132 bash[27079]: cluster 2020-07-16T15:14:34.778779+0000 mgr.x (mgr.34562) 4612 : cluster [DBG] pgmap v2877: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:14:38.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:14:37 smithi188 bash[23329]: cluster 2020-07-16T15:14:36.779223+0000 mgr.x (mgr.34562) 4613 : cluster [DBG] pgmap v2878: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:14:38.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:14:37 smithi188 bash[23329]: audit 2020-07-16T15:14:37.315621+0000 mon.b (mon.2) 1044 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:14:38.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:14:37 smithi132 bash[27079]: cluster 2020-07-16T15:14:36.779223+0000 mgr.x (mgr.34562) 4613 : cluster [DBG] pgmap v2878: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:14:38.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:14:37 smithi132 bash[27079]: audit 2020-07-16T15:14:37.315621+0000 mon.b (mon.2) 1044 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:14:39.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:14:38 smithi188 bash[23329]: cephadm 2020-07-16T15:14:37.316272+0000 mgr.x (mgr.34562) 4614 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:14:39.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:14:38 smithi188 bash[23329]: cephadm 2020-07-16T15:14:37.316520+0000 mgr.x (mgr.34562) 4615 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:14:39.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:14:38 smithi132 bash[27079]: cephadm 2020-07-16T15:14:37.316272+0000 mgr.x (mgr.34562) 4614 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:14:39.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:14:38 smithi132 bash[27079]: cephadm 2020-07-16T15:14:37.316520+0000 mgr.x (mgr.34562) 4615 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:14:40.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:14:39 smithi188 bash[23329]: cluster 2020-07-16T15:14:38.779565+0000 mgr.x (mgr.34562) 4616 : cluster [DBG] pgmap v2879: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:14:40.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:14:39 smithi132 bash[27079]: cluster 2020-07-16T15:14:38.779565+0000 mgr.x (mgr.34562) 4616 : cluster [DBG] pgmap v2879: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:14:41.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:14:41 smithi132 bash[27079]: cluster 2020-07-16T15:14:40.780000+0000 mgr.x (mgr.34562) 4617 : cluster [DBG] pgmap v2880: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:14:41.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:14:41 smithi188 bash[23329]: cluster 2020-07-16T15:14:40.780000+0000 mgr.x (mgr.34562) 4617 : cluster [DBG] pgmap v2880: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:14:44.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:14:43 smithi188 bash[23329]: cluster 2020-07-16T15:14:42.780393+0000 mgr.x (mgr.34562) 4618 : cluster [DBG] pgmap v2881: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:14:44.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:14:43 smithi132 bash[27079]: cluster 2020-07-16T15:14:42.780393+0000 mgr.x (mgr.34562) 4618 : cluster [DBG] pgmap v2881: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:14:46.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:14:45 smithi188 bash[23329]: cluster 2020-07-16T15:14:44.780833+0000 mgr.x (mgr.34562) 4619 : cluster [DBG] pgmap v2882: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:14:46.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:14:45 smithi132 bash[27079]: cluster 2020-07-16T15:14:44.780833+0000 mgr.x (mgr.34562) 4619 : cluster [DBG] pgmap v2882: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:14:48.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:14:47 smithi188 bash[23329]: cluster 2020-07-16T15:14:46.781384+0000 mgr.x (mgr.34562) 4620 : cluster [DBG] pgmap v2883: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:14:48.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:14:47 smithi132 bash[27079]: cluster 2020-07-16T15:14:46.781384+0000 mgr.x (mgr.34562) 4620 : cluster [DBG] pgmap v2883: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:14:50.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:14:49 smithi188 bash[23329]: cluster 2020-07-16T15:14:48.781871+0000 mgr.x (mgr.34562) 4621 : cluster [DBG] pgmap v2884: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:14:50.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:14:49 smithi132 bash[27079]: cluster 2020-07-16T15:14:48.781871+0000 mgr.x (mgr.34562) 4621 : cluster [DBG] pgmap v2884: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:14:51.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:14:51 smithi132 bash[27079]: cluster 2020-07-16T15:14:50.782431+0000 mgr.x (mgr.34562) 4622 : cluster [DBG] pgmap v2885: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:14:51.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:14:51 smithi188 bash[23329]: cluster 2020-07-16T15:14:50.782431+0000 mgr.x (mgr.34562) 4622 : cluster [DBG] pgmap v2885: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:14:52.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:14:52 smithi188 bash[23329]: audit 2020-07-16T15:14:52.334889+0000 mon.b (mon.2) 1045 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:14:52.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:14:52 smithi188 bash[23329]: audit 2020-07-16T15:14:52.336319+0000 mon.b (mon.2) 1046 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:14:52.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:14:52 smithi188 bash[23329]: audit 2020-07-16T15:14:52.337557+0000 mon.b (mon.2) 1047 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:14:52.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:14:52 smithi188 bash[23329]: audit 2020-07-16T15:14:52.338931+0000 mon.b (mon.2) 1048 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:14:52.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:14:52 smithi188 bash[23329]: audit 2020-07-16T15:14:52.340190+0000 mon.b (mon.2) 1049 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:14:52.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:14:52 smithi132 bash[27079]: audit 2020-07-16T15:14:52.334889+0000 mon.b (mon.2) 1045 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:14:52.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:14:52 smithi132 bash[27079]: audit 2020-07-16T15:14:52.336319+0000 mon.b (mon.2) 1046 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:14:52.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:14:52 smithi132 bash[27079]: audit 2020-07-16T15:14:52.337557+0000 mon.b (mon.2) 1047 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:14:52.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:14:52 smithi132 bash[27079]: audit 2020-07-16T15:14:52.338931+0000 mon.b (mon.2) 1048 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:14:52.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:14:52 smithi132 bash[27079]: audit 2020-07-16T15:14:52.340190+0000 mon.b (mon.2) 1049 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:14:53.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:14:53 smithi188 bash[23329]: audit 2020-07-16T15:14:52.335293+0000 mgr.x (mgr.34562) 4623 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:14:53.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:14:53 smithi188 bash[23329]: audit 2020-07-16T15:14:52.336643+0000 mgr.x (mgr.34562) 4624 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:14:53.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:14:53 smithi188 bash[23329]: audit 2020-07-16T15:14:52.337836+0000 mgr.x (mgr.34562) 4625 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:14:53.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:14:53 smithi188 bash[23329]: cephadm 2020-07-16T15:14:52.338550+0000 mgr.x (mgr.34562) 4626 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:14:53.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:14:53 smithi188 bash[23329]: cephadm 2020-07-16T15:14:52.339833+0000 mgr.x (mgr.34562) 4627 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:14:53.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:14:53 smithi188 bash[23329]: cephadm 2020-07-16T15:14:52.340948+0000 mgr.x (mgr.34562) 4628 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:14:53.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:14:53 smithi188 bash[23329]: cephadm 2020-07-16T15:14:52.341031+0000 mgr.x (mgr.34562) 4629 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:14:53.675 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:14:53 smithi188 bash[23329]: cluster 2020-07-16T15:14:52.782860+0000 mgr.x (mgr.34562) 4630 : cluster [DBG] pgmap v2886: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:14:53.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:14:53 smithi132 bash[27079]: audit 2020-07-16T15:14:52.335293+0000 mgr.x (mgr.34562) 4623 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:14:53.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:14:53 smithi132 bash[27079]: audit 2020-07-16T15:14:52.336643+0000 mgr.x (mgr.34562) 4624 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:14:53.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:14:53 smithi132 bash[27079]: audit 2020-07-16T15:14:52.337836+0000 mgr.x (mgr.34562) 4625 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:14:53.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:14:53 smithi132 bash[27079]: cephadm 2020-07-16T15:14:52.338550+0000 mgr.x (mgr.34562) 4626 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:14:53.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:14:53 smithi132 bash[27079]: cephadm 2020-07-16T15:14:52.339833+0000 mgr.x (mgr.34562) 4627 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:14:53.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:14:53 smithi132 bash[27079]: cephadm 2020-07-16T15:14:52.340948+0000 mgr.x (mgr.34562) 4628 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:14:53.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:14:53 smithi132 bash[27079]: cephadm 2020-07-16T15:14:52.341031+0000 mgr.x (mgr.34562) 4629 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:14:53.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:14:53 smithi132 bash[27079]: cluster 2020-07-16T15:14:52.782860+0000 mgr.x (mgr.34562) 4630 : cluster [DBG] pgmap v2886: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:14:56.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:14:55 smithi188 bash[23329]: cluster 2020-07-16T15:14:54.783259+0000 mgr.x (mgr.34562) 4631 : cluster [DBG] pgmap v2887: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:14:56.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:14:55 smithi188 bash[23329]: audit 2020-07-16T15:14:55.147461+0000 mon.b (mon.2) 1050 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:14:56.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:14:55 smithi132 bash[27079]: cluster 2020-07-16T15:14:54.783259+0000 mgr.x (mgr.34562) 4631 : cluster [DBG] pgmap v2887: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:14:56.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:14:55 smithi132 bash[27079]: audit 2020-07-16T15:14:55.147461+0000 mon.b (mon.2) 1050 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:14:57.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:14:56 smithi188 bash[23329]: cephadm 2020-07-16T15:14:55.148074+0000 mgr.x (mgr.34562) 4632 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:14:57.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:14:56 smithi188 bash[23329]: cephadm 2020-07-16T15:14:55.148164+0000 mgr.x (mgr.34562) 4633 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:14:57.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:14:56 smithi132 bash[27079]: cephadm 2020-07-16T15:14:55.148074+0000 mgr.x (mgr.34562) 4632 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:14:57.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:14:56 smithi132 bash[27079]: cephadm 2020-07-16T15:14:55.148164+0000 mgr.x (mgr.34562) 4633 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:14:57.905 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:14:58.165 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:14:58.166 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (97m) 69s ago 100m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:14:58.166 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (100m) 68s ago 100m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:14:58.166 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (98m) 68s ago 103m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:14:58.166 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (97m) 69s ago 105m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:14:58.167 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 69s ago 105m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:14:58.167 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (103m) 68s ago 103m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:14:58.167 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (103m) 69s ago 103m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:14:58.167 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (100m) 69s ago 101m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:14:58.168 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (100m) 68s ago 101m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:14:58.168 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (103m) 69s ago 103m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:14:58.168 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (103m) 69s ago 103m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:14:58.168 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (102m) 69s ago 102m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:14:58.169 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (102m) 69s ago 102m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:14:58.169 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (101m) 68s ago 102m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:14:58.169 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (101m) 68s ago 101m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:14:58.169 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (101m) 68s ago 101m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:14:58.169 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (101m) 68s ago 101m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:14:58.170 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (100m) 68s ago 101m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:14:58.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:14:57 smithi188 bash[23329]: cluster 2020-07-16T15:14:56.783727+0000 mgr.x (mgr.34562) 4634 : cluster [DBG] pgmap v2888: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:14:58.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:14:57 smithi132 bash[27079]: cluster 2020-07-16T15:14:56.783727+0000 mgr.x (mgr.34562) 4634 : cluster [DBG] pgmap v2888: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:14:58.466 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:14:58.466 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:14:58.467 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:14:58.467 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:14:58.467 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:14:58.467 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:14:58.468 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:14:58.468 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:14:58.468 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:14:58.468 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:14:58.468 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:14:58.469 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:14:58.469 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:14:58.469 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:14:58.469 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:14:58.469 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:14:58.469 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:14:59.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:14:58 smithi188 bash[23329]: audit 2020-07-16T15:14:58.464912+0000 mon.c (mon.1) 335 : audit [DBG] from='client.? 172.21.15.132:0/1948624825' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:14:59.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:14:58 smithi132 bash[27079]: audit 2020-07-16T15:14:58.464912+0000 mon.c (mon.1) 335 : audit [DBG] from='client.? 172.21.15.132:0/1948624825' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:15:00.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:14:59 smithi188 bash[23329]: audit 2020-07-16T15:14:57.894043+0000 mgr.x (mgr.34562) 4635 : audit [DBG] from='client.28006 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:15:00.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:14:59 smithi188 bash[23329]: audit 2020-07-16T15:14:58.161212+0000 mgr.x (mgr.34562) 4636 : audit [DBG] from='client.28012 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:15:00.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:14:59 smithi188 bash[23329]: cluster 2020-07-16T15:14:58.784164+0000 mgr.x (mgr.34562) 4637 : cluster [DBG] pgmap v2889: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:15:00.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:14:59 smithi132 bash[27079]: audit 2020-07-16T15:14:57.894043+0000 mgr.x (mgr.34562) 4635 : audit [DBG] from='client.28006 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:15:00.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:14:59 smithi132 bash[27079]: audit 2020-07-16T15:14:58.161212+0000 mgr.x (mgr.34562) 4636 : audit [DBG] from='client.28012 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:15:00.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:14:59 smithi132 bash[27079]: cluster 2020-07-16T15:14:58.784164+0000 mgr.x (mgr.34562) 4637 : cluster [DBG] pgmap v2889: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:15:01.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:15:01 smithi132 bash[27079]: cluster 2020-07-16T15:15:00.784578+0000 mgr.x (mgr.34562) 4638 : cluster [DBG] pgmap v2890: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:15:01.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:15:01 smithi188 bash[23329]: cluster 2020-07-16T15:15:00.784578+0000 mgr.x (mgr.34562) 4638 : cluster [DBG] pgmap v2890: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:15:04.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:15:03 smithi188 bash[23329]: cluster 2020-07-16T15:15:02.785154+0000 mgr.x (mgr.34562) 4639 : cluster [DBG] pgmap v2891: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:15:04.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:15:03 smithi132 bash[27079]: cluster 2020-07-16T15:15:02.785154+0000 mgr.x (mgr.34562) 4639 : cluster [DBG] pgmap v2891: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:15:06.175 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:15:05 smithi188 bash[23329]: cluster 2020-07-16T15:15:04.785605+0000 mgr.x (mgr.34562) 4640 : cluster [DBG] pgmap v2892: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:15:06.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:15:05 smithi132 bash[27079]: cluster 2020-07-16T15:15:04.785605+0000 mgr.x (mgr.34562) 4640 : cluster [DBG] pgmap v2892: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:15:08.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:15:07 smithi188 bash[23329]: cluster 2020-07-16T15:15:06.786128+0000 mgr.x (mgr.34562) 4641 : cluster [DBG] pgmap v2893: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:15:08.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:15:07 smithi132 bash[27079]: cluster 2020-07-16T15:15:06.786128+0000 mgr.x (mgr.34562) 4641 : cluster [DBG] pgmap v2893: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:15:10.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:15:09 smithi188 bash[23329]: cluster 2020-07-16T15:15:08.786574+0000 mgr.x (mgr.34562) 4642 : cluster [DBG] pgmap v2894: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:15:10.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:15:09 smithi132 bash[27079]: cluster 2020-07-16T15:15:08.786574+0000 mgr.x (mgr.34562) 4642 : cluster [DBG] pgmap v2894: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:15:11.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:15:10 smithi188 bash[23329]: audit 2020-07-16T15:15:10.163970+0000 mon.b (mon.2) 1051 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:15:11.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:15:10 smithi132 bash[27079]: audit 2020-07-16T15:15:10.163970+0000 mon.b (mon.2) 1051 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:15:12.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:15:11 smithi188 bash[23329]: cephadm 2020-07-16T15:15:10.164764+0000 mgr.x (mgr.34562) 4643 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:15:12.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:15:11 smithi188 bash[23329]: cephadm 2020-07-16T15:15:10.165184+0000 mgr.x (mgr.34562) 4644 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:15:12.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:15:11 smithi188 bash[23329]: cluster 2020-07-16T15:15:10.787061+0000 mgr.x (mgr.34562) 4645 : cluster [DBG] pgmap v2895: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:15:12.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:15:11 smithi132 bash[27079]: cephadm 2020-07-16T15:15:10.164764+0000 mgr.x (mgr.34562) 4643 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:15:12.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:15:11 smithi132 bash[27079]: cephadm 2020-07-16T15:15:10.165184+0000 mgr.x (mgr.34562) 4644 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:15:12.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:15:11 smithi132 bash[27079]: cluster 2020-07-16T15:15:10.787061+0000 mgr.x (mgr.34562) 4645 : cluster [DBG] pgmap v2895: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:15:14.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:15:13 smithi188 bash[23329]: cluster 2020-07-16T15:15:12.787530+0000 mgr.x (mgr.34562) 4646 : cluster [DBG] pgmap v2896: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:15:14.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:15:13 smithi132 bash[27079]: cluster 2020-07-16T15:15:12.787530+0000 mgr.x (mgr.34562) 4646 : cluster [DBG] pgmap v2896: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:15:16.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:15:15 smithi188 bash[23329]: cluster 2020-07-16T15:15:14.787894+0000 mgr.x (mgr.34562) 4647 : cluster [DBG] pgmap v2897: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:15:16.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:15:15 smithi132 bash[27079]: cluster 2020-07-16T15:15:14.787894+0000 mgr.x (mgr.34562) 4647 : cluster [DBG] pgmap v2897: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:15:17.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:15:16 smithi188 bash[23329]: cluster 2020-07-16T15:15:16.788423+0000 mgr.x (mgr.34562) 4648 : cluster [DBG] pgmap v2898: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:15:17.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:15:16 smithi132 bash[27079]: cluster 2020-07-16T15:15:16.788423+0000 mgr.x (mgr.34562) 4648 : cluster [DBG] pgmap v2898: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:15:20.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:15:19 smithi188 bash[23329]: cluster 2020-07-16T15:15:18.788818+0000 mgr.x (mgr.34562) 4649 : cluster [DBG] pgmap v2899: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:15:20.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:15:19 smithi132 bash[27079]: cluster 2020-07-16T15:15:18.788818+0000 mgr.x (mgr.34562) 4649 : cluster [DBG] pgmap v2899: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:15:21.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:15:21 smithi132 bash[27079]: cluster 2020-07-16T15:15:20.789304+0000 mgr.x (mgr.34562) 4650 : cluster [DBG] pgmap v2900: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:15:21.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:15:21 smithi188 bash[23329]: cluster 2020-07-16T15:15:20.789304+0000 mgr.x (mgr.34562) 4650 : cluster [DBG] pgmap v2900: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:15:24.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:15:23 smithi188 bash[23329]: cluster 2020-07-16T15:15:22.789710+0000 mgr.x (mgr.34562) 4651 : cluster [DBG] pgmap v2901: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:15:24.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:15:23 smithi132 bash[27079]: cluster 2020-07-16T15:15:22.789710+0000 mgr.x (mgr.34562) 4651 : cluster [DBG] pgmap v2901: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:15:26.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:15:25 smithi188 bash[23329]: cluster 2020-07-16T15:15:24.790178+0000 mgr.x (mgr.34562) 4652 : cluster [DBG] pgmap v2902: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:15:26.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:15:25 smithi188 bash[23329]: audit 2020-07-16T15:15:25.180706+0000 mon.b (mon.2) 1052 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:15:26.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:15:25 smithi132 bash[27079]: cluster 2020-07-16T15:15:24.790178+0000 mgr.x (mgr.34562) 4652 : cluster [DBG] pgmap v2902: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:15:26.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:15:25 smithi132 bash[27079]: audit 2020-07-16T15:15:25.180706+0000 mon.b (mon.2) 1052 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:15:27.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:15:26 smithi188 bash[23329]: cephadm 2020-07-16T15:15:25.181428+0000 mgr.x (mgr.34562) 4653 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:15:27.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:15:26 smithi188 bash[23329]: cephadm 2020-07-16T15:15:25.181505+0000 mgr.x (mgr.34562) 4654 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:15:27.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:15:26 smithi132 bash[27079]: cephadm 2020-07-16T15:15:25.181428+0000 mgr.x (mgr.34562) 4653 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:15:27.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:15:26 smithi132 bash[27079]: cephadm 2020-07-16T15:15:25.181505+0000 mgr.x (mgr.34562) 4654 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:15:28.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:15:27 smithi188 bash[23329]: cluster 2020-07-16T15:15:26.790698+0000 mgr.x (mgr.34562) 4655 : cluster [DBG] pgmap v2903: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:15:28.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:15:27 smithi132 bash[27079]: cluster 2020-07-16T15:15:26.790698+0000 mgr.x (mgr.34562) 4655 : cluster [DBG] pgmap v2903: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:15:28.764 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:15:29.024 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:15:29.025 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (98m) 99s ago 101m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:15:29.025 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (100m) 99s ago 100m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:15:29.025 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (98m) 99s ago 104m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:15:29.025 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (97m) 99s ago 105m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:15:29.026 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 99s ago 105m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:15:29.026 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (104m) 99s ago 104m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:15:29.026 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (104m) 99s ago 104m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:15:29.026 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (101m) 99s ago 101m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:15:29.026 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (101m) 99s ago 101m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:15:29.027 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (103m) 99s ago 103m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:15:29.027 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (103m) 99s ago 103m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:15:29.027 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (103m) 99s ago 103m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:15:29.027 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (103m) 99s ago 103m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:15:29.027 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (102m) 99s ago 102m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:15:29.027 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (102m) 99s ago 102m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:15:29.028 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (102m) 99s ago 102m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:15:29.028 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (101m) 99s ago 101m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:15:29.028 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (100m) 99s ago 101m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:15:29.329 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:15:29.329 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:15:29.329 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:15:29.330 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:15:29.330 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:15:29.330 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:15:29.330 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:15:29.330 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:15:29.331 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:15:29.331 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:15:29.331 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:15:29.331 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:15:29.331 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:15:29.332 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:15:29.332 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:15:29.332 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:15:29.332 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:15:30.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:15:29 smithi188 bash[23329]: audit 2020-07-16T15:15:28.752648+0000 mgr.x (mgr.34562) 4656 : audit [DBG] from='client.28024 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:15:30.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:15:29 smithi188 bash[23329]: cluster 2020-07-16T15:15:28.791136+0000 mgr.x (mgr.34562) 4657 : cluster [DBG] pgmap v2904: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:15:30.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:15:29 smithi188 bash[23329]: audit 2020-07-16T15:15:29.321943+0000 mon.c (mon.1) 336 : audit [DBG] from='client.? 172.21.15.132:0/3616072410' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:15:30.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:15:29 smithi132 bash[27079]: audit 2020-07-16T15:15:28.752648+0000 mgr.x (mgr.34562) 4656 : audit [DBG] from='client.28024 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:15:30.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:15:29 smithi132 bash[27079]: cluster 2020-07-16T15:15:28.791136+0000 mgr.x (mgr.34562) 4657 : cluster [DBG] pgmap v2904: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:15:30.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:15:29 smithi132 bash[27079]: audit 2020-07-16T15:15:29.321943+0000 mon.c (mon.1) 336 : audit [DBG] from='client.? 172.21.15.132:0/3616072410' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:15:31.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:15:30 smithi188 bash[23329]: audit 2020-07-16T15:15:29.020390+0000 mgr.x (mgr.34562) 4658 : audit [DBG] from='client.28030 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:15:31.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:15:30 smithi132 bash[27079]: audit 2020-07-16T15:15:29.020390+0000 mgr.x (mgr.34562) 4658 : audit [DBG] from='client.28030 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:15:32.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:15:31 smithi188 bash[23329]: cluster 2020-07-16T15:15:30.791644+0000 mgr.x (mgr.34562) 4659 : cluster [DBG] pgmap v2905: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:15:32.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:15:31 smithi132 bash[27079]: cluster 2020-07-16T15:15:30.791644+0000 mgr.x (mgr.34562) 4659 : cluster [DBG] pgmap v2905: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:15:33.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:15:32 smithi188 bash[23329]: cluster 2020-07-16T15:15:32.792136+0000 mgr.x (mgr.34562) 4660 : cluster [DBG] pgmap v2906: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:15:33.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:15:32 smithi132 bash[27079]: cluster 2020-07-16T15:15:32.792136+0000 mgr.x (mgr.34562) 4660 : cluster [DBG] pgmap v2906: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:15:36.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:15:35 smithi188 bash[23329]: cluster 2020-07-16T15:15:34.792606+0000 mgr.x (mgr.34562) 4661 : cluster [DBG] pgmap v2907: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:15:36.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:15:35 smithi132 bash[27079]: cluster 2020-07-16T15:15:34.792606+0000 mgr.x (mgr.34562) 4661 : cluster [DBG] pgmap v2907: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:15:38.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:15:37 smithi188 bash[23329]: cluster 2020-07-16T15:15:36.792977+0000 mgr.x (mgr.34562) 4662 : cluster [DBG] pgmap v2908: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:15:38.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:15:37 smithi132 bash[27079]: cluster 2020-07-16T15:15:36.792977+0000 mgr.x (mgr.34562) 4662 : cluster [DBG] pgmap v2908: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:15:40.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:15:39 smithi188 bash[23329]: cluster 2020-07-16T15:15:38.793385+0000 mgr.x (mgr.34562) 4663 : cluster [DBG] pgmap v2909: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:15:40.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:15:39 smithi132 bash[27079]: cluster 2020-07-16T15:15:38.793385+0000 mgr.x (mgr.34562) 4663 : cluster [DBG] pgmap v2909: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:15:41.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:15:40 smithi188 bash[23329]: audit 2020-07-16T15:15:40.197247+0000 mon.b (mon.2) 1053 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:15:41.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:15:40 smithi132 bash[27079]: audit 2020-07-16T15:15:40.197247+0000 mon.b (mon.2) 1053 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:15:42.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:15:41 smithi188 bash[23329]: cephadm 2020-07-16T15:15:40.197915+0000 mgr.x (mgr.34562) 4664 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:15:42.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:15:41 smithi188 bash[23329]: cephadm 2020-07-16T15:15:40.198279+0000 mgr.x (mgr.34562) 4665 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:15:42.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:15:41 smithi188 bash[23329]: cluster 2020-07-16T15:15:40.793981+0000 mgr.x (mgr.34562) 4666 : cluster [DBG] pgmap v2910: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:15:42.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:15:41 smithi132 bash[27079]: cephadm 2020-07-16T15:15:40.197915+0000 mgr.x (mgr.34562) 4664 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:15:42.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:15:41 smithi132 bash[27079]: cephadm 2020-07-16T15:15:40.198279+0000 mgr.x (mgr.34562) 4665 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:15:42.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:15:41 smithi132 bash[27079]: cluster 2020-07-16T15:15:40.793981+0000 mgr.x (mgr.34562) 4666 : cluster [DBG] pgmap v2910: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:15:44.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:15:43 smithi188 bash[23329]: cluster 2020-07-16T15:15:42.794583+0000 mgr.x (mgr.34562) 4667 : cluster [DBG] pgmap v2911: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:15:44.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:15:43 smithi132 bash[27079]: cluster 2020-07-16T15:15:42.794583+0000 mgr.x (mgr.34562) 4667 : cluster [DBG] pgmap v2911: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:15:46.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:15:45 smithi188 bash[23329]: cluster 2020-07-16T15:15:44.795081+0000 mgr.x (mgr.34562) 4668 : cluster [DBG] pgmap v2912: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:15:46.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:15:45 smithi132 bash[27079]: cluster 2020-07-16T15:15:44.795081+0000 mgr.x (mgr.34562) 4668 : cluster [DBG] pgmap v2912: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:15:47.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:15:46 smithi132 bash[27079]: cluster 2020-07-16T15:15:46.795573+0000 mgr.x (mgr.34562) 4669 : cluster [DBG] pgmap v2913: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:15:47.425 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:15:46 smithi188 bash[23329]: cluster 2020-07-16T15:15:46.795573+0000 mgr.x (mgr.34562) 4669 : cluster [DBG] pgmap v2913: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:15:50.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:15:49 smithi188 bash[23329]: cluster 2020-07-16T15:15:48.795932+0000 mgr.x (mgr.34562) 4670 : cluster [DBG] pgmap v2914: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:15:50.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:15:49 smithi132 bash[27079]: cluster 2020-07-16T15:15:48.795932+0000 mgr.x (mgr.34562) 4670 : cluster [DBG] pgmap v2914: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:15:51.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:15:51 smithi132 bash[27079]: cluster 2020-07-16T15:15:50.796410+0000 mgr.x (mgr.34562) 4671 : cluster [DBG] pgmap v2915: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:15:51.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:15:51 smithi188 bash[23329]: cluster 2020-07-16T15:15:50.796410+0000 mgr.x (mgr.34562) 4671 : cluster [DBG] pgmap v2915: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:15:54.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:15:53 smithi188 bash[23329]: cluster 2020-07-16T15:15:52.796929+0000 mgr.x (mgr.34562) 4672 : cluster [DBG] pgmap v2916: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:15:54.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:15:53 smithi132 bash[27079]: cluster 2020-07-16T15:15:52.796929+0000 mgr.x (mgr.34562) 4672 : cluster [DBG] pgmap v2916: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:15:56.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:15:55 smithi188 bash[23329]: cluster 2020-07-16T15:15:54.797466+0000 mgr.x (mgr.34562) 4673 : cluster [DBG] pgmap v2917: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:15:56.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:15:55 smithi188 bash[23329]: audit 2020-07-16T15:15:55.434160+0000 mon.b (mon.2) 1054 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.423601\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.423671\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.423702\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.423856\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.423957\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.424056\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.424153\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.424185\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.424213\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:13:49.424279\", \"last_device_update\": \"2020-07-16T15:05:23.895950\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:15:55.433337\"}"}]: dispatch 2020-07-16T15:15:56.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:15:55 smithi188 bash[23329]: audit 2020-07-16T15:15:55.434634+0000 mon.c (mon.1) 337 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.423601\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.423671\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.423702\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.423856\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.423957\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.424056\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.424153\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.424185\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.424213\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:13:49.424279\", \"last_device_update\": \"2020-07-16T15:05:23.895950\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:15:55.433337\"}"}]: dispatch 2020-07-16T15:15:56.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:15:55 smithi188 bash[23329]: audit 2020-07-16T15:15:55.435615+0000 mon.b (mon.2) 1055 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:13:49.048668\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.048727\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.048761\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.048789\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.048942\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.049043\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.049141\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.049239\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.049272\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:13:49.049371\", \"last_device_update\": \"2020-07-16T15:04:18.042470\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:15:55.434716\"}"}]: dispatch 2020-07-16T15:15:56.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:15:55 smithi188 bash[23329]: audit 2020-07-16T15:15:55.437432+0000 mon.c (mon.1) 338 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.423601\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.423671\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.423702\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.423856\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.423957\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.424056\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.424153\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.424185\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.424213\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:13:49.424279\", \"last_device_update\": \"2020-07-16T15:05:23.895950\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:15:55.433337\"}"}]': finished 2020-07-16T15:15:56.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:15:55 smithi188 bash[23329]: audit 2020-07-16T15:15:55.437665+0000 mon.c (mon.1) 339 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:13:49.048668\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.048727\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.048761\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.048789\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.048942\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.049043\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.049141\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.049239\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.049272\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:13:49.049371\", \"last_device_update\": \"2020-07-16T15:04:18.042470\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:15:55.434716\"}"}]: dispatch 2020-07-16T15:15:56.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:15:55 smithi188 bash[23329]: audit 2020-07-16T15:15:55.440172+0000 mon.c (mon.1) 340 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:13:49.048668\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.048727\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.048761\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.048789\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.048942\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.049043\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.049141\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.049239\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.049272\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:13:49.049371\", \"last_device_update\": \"2020-07-16T15:04:18.042470\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:15:55.434716\"}"}]': finished 2020-07-16T15:15:56.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:15:55 smithi188 bash[23329]: audit 2020-07-16T15:15:55.444831+0000 mon.b (mon.2) 1056 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:15:56.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:15:55 smithi188 bash[23329]: audit 2020-07-16T15:15:55.445826+0000 mon.b (mon.2) 1057 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:15:56.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:15:55 smithi188 bash[23329]: audit 2020-07-16T15:15:55.446662+0000 mon.b (mon.2) 1058 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:15:56.175 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:15:55 smithi188 bash[23329]: audit 2020-07-16T15:15:55.447654+0000 mon.b (mon.2) 1059 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:15:56.175 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:15:55 smithi188 bash[23329]: audit 2020-07-16T15:15:55.448671+0000 mon.b (mon.2) 1060 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:15:56.254 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:15:55 smithi132 bash[27079]: cluster 2020-07-16T15:15:54.797466+0000 mgr.x (mgr.34562) 4673 : cluster [DBG] pgmap v2917: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:15:56.254 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:15:55 smithi132 bash[27079]: audit 2020-07-16T15:15:55.434160+0000 mon.b (mon.2) 1054 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.423601\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.423671\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.423702\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.423856\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.423957\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.424056\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.424153\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.424185\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.424213\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:13:49.424279\", \"last_device_update\": \"2020-07-16T15:05:23.895950\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:15:55.433337\"}"}]: dispatch 2020-07-16T15:15:56.255 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:15:55 smithi132 bash[27079]: audit 2020-07-16T15:15:55.434634+0000 mon.c (mon.1) 337 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.423601\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.423671\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.423702\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.423856\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.423957\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.424056\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.424153\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.424185\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.424213\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:13:49.424279\", \"last_device_update\": \"2020-07-16T15:05:23.895950\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:15:55.433337\"}"}]: dispatch 2020-07-16T15:15:56.255 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:15:55 smithi132 bash[27079]: audit 2020-07-16T15:15:55.435615+0000 mon.b (mon.2) 1055 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:13:49.048668\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.048727\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.048761\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.048789\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.048942\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.049043\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.049141\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.049239\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.049272\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:13:49.049371\", \"last_device_update\": \"2020-07-16T15:04:18.042470\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:15:55.434716\"}"}]: dispatch 2020-07-16T15:15:56.255 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:15:55 smithi132 bash[27079]: audit 2020-07-16T15:15:55.437432+0000 mon.c (mon.1) 338 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.423601\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.423671\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.423702\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.423856\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.423957\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.424056\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.424153\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.424185\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.424213\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:13:49.424279\", \"last_device_update\": \"2020-07-16T15:05:23.895950\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:15:55.433337\"}"}]': finished 2020-07-16T15:15:56.256 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:15:55 smithi132 bash[27079]: audit 2020-07-16T15:15:55.437665+0000 mon.c (mon.1) 339 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:13:49.048668\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.048727\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.048761\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.048789\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.048942\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.049043\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.049141\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.049239\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.049272\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:13:49.049371\", \"last_device_update\": \"2020-07-16T15:04:18.042470\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:15:55.434716\"}"}]: dispatch 2020-07-16T15:15:56.256 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:15:55 smithi132 bash[27079]: audit 2020-07-16T15:15:55.440172+0000 mon.c (mon.1) 340 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:13:49.048668\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.048727\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.048761\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.048789\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.048942\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.049043\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.049141\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.049239\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:13:49.049272\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:13:49.049371\", \"last_device_update\": \"2020-07-16T15:04:18.042470\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:15:55.434716\"}"}]': finished 2020-07-16T15:15:56.256 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:15:55 smithi132 bash[27079]: audit 2020-07-16T15:15:55.444831+0000 mon.b (mon.2) 1056 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:15:56.256 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:15:55 smithi132 bash[27079]: audit 2020-07-16T15:15:55.445826+0000 mon.b (mon.2) 1057 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:15:56.257 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:15:55 smithi132 bash[27079]: audit 2020-07-16T15:15:55.446662+0000 mon.b (mon.2) 1058 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:15:56.257 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:15:55 smithi132 bash[27079]: audit 2020-07-16T15:15:55.447654+0000 mon.b (mon.2) 1059 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:15:56.257 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:15:55 smithi132 bash[27079]: audit 2020-07-16T15:15:55.448671+0000 mon.b (mon.2) 1060 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:15:57.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:15:56 smithi188 bash[23329]: audit 2020-07-16T15:15:55.445110+0000 mgr.x (mgr.34562) 4674 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:15:57.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:15:56 smithi188 bash[23329]: audit 2020-07-16T15:15:55.446074+0000 mgr.x (mgr.34562) 4675 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:15:57.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:15:56 smithi188 bash[23329]: audit 2020-07-16T15:15:55.446882+0000 mgr.x (mgr.34562) 4676 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:15:57.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:15:56 smithi188 bash[23329]: cephadm 2020-07-16T15:15:55.447414+0000 mgr.x (mgr.34562) 4677 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:15:57.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:15:56 smithi188 bash[23329]: cephadm 2020-07-16T15:15:55.448345+0000 mgr.x (mgr.34562) 4678 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:15:57.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:15:56 smithi188 bash[23329]: cephadm 2020-07-16T15:15:55.449181+0000 mgr.x (mgr.34562) 4679 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:15:57.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:15:56 smithi188 bash[23329]: cephadm 2020-07-16T15:15:55.449397+0000 mgr.x (mgr.34562) 4680 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:15:57.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:15:56 smithi132 bash[27079]: audit 2020-07-16T15:15:55.445110+0000 mgr.x (mgr.34562) 4674 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:15:57.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:15:56 smithi132 bash[27079]: audit 2020-07-16T15:15:55.446074+0000 mgr.x (mgr.34562) 4675 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:15:57.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:15:56 smithi132 bash[27079]: audit 2020-07-16T15:15:55.446882+0000 mgr.x (mgr.34562) 4676 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:15:57.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:15:56 smithi132 bash[27079]: cephadm 2020-07-16T15:15:55.447414+0000 mgr.x (mgr.34562) 4677 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:15:57.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:15:56 smithi132 bash[27079]: cephadm 2020-07-16T15:15:55.448345+0000 mgr.x (mgr.34562) 4678 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:15:57.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:15:56 smithi132 bash[27079]: cephadm 2020-07-16T15:15:55.449181+0000 mgr.x (mgr.34562) 4679 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:15:57.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:15:56 smithi132 bash[27079]: cephadm 2020-07-16T15:15:55.449397+0000 mgr.x (mgr.34562) 4680 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:15:58.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:15:57 smithi132 bash[27079]: cluster 2020-07-16T15:15:56.798046+0000 mgr.x (mgr.34562) 4681 : cluster [DBG] pgmap v2918: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:15:58.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:15:57 smithi188 bash[23329]: cluster 2020-07-16T15:15:56.798046+0000 mgr.x (mgr.34562) 4681 : cluster [DBG] pgmap v2918: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:15:59.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:15:58 smithi188 bash[23329]: audit 2020-07-16T15:15:58.275824+0000 mon.b (mon.2) 1061 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:15:59.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:15:58 smithi132 bash[27079]: audit 2020-07-16T15:15:58.275824+0000 mon.b (mon.2) 1061 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:15:59.617 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:15:59.893 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:15:59.893 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (98m) 2m ago 101m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:15:59.894 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (101m) 2m ago 101m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:15:59.894 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (99m) 2m ago 104m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:15:59.894 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (98m) 2m ago 106m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:15:59.894 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 2m ago 106m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:15:59.894 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (104m) 2m ago 104m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:15:59.895 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (105m) 2m ago 105m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:15:59.895 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (101m) 2m ago 102m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:15:59.895 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (101m) 2m ago 102m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:15:59.895 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (104m) 2m ago 104m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:15:59.895 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (104m) 2m ago 104m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:15:59.896 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (103m) 2m ago 103m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:15:59.896 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (103m) 2m ago 103m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:15:59.896 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (102m) 2m ago 103m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:15:59.896 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (102m) 2m ago 102m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:15:59.896 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (102m) 2m ago 102m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:15:59.897 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (102m) 2m ago 102m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:15:59.897 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (101m) 2m ago 102m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:16:00.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:15:59 smithi188 bash[23329]: cephadm 2020-07-16T15:15:58.276465+0000 mgr.x (mgr.34562) 4682 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:16:00.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:15:59 smithi188 bash[23329]: cephadm 2020-07-16T15:15:58.276877+0000 mgr.x (mgr.34562) 4683 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:16:00.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:15:59 smithi188 bash[23329]: cluster 2020-07-16T15:15:58.798452+0000 mgr.x (mgr.34562) 4684 : cluster [DBG] pgmap v2919: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:16:00.187 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:16:00.187 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:16:00.188 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:16:00.188 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:16:00.188 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:16:00.188 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:16:00.188 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:16:00.189 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:16:00.189 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:16:00.189 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:16:00.189 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:16:00.189 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:16:00.190 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:16:00.190 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:16:00.190 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:16:00.190 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:16:00.190 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:16:00.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:15:59 smithi132 bash[27079]: cephadm 2020-07-16T15:15:58.276465+0000 mgr.x (mgr.34562) 4682 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:16:00.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:15:59 smithi132 bash[27079]: cephadm 2020-07-16T15:15:58.276877+0000 mgr.x (mgr.34562) 4683 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:16:00.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:15:59 smithi132 bash[27079]: cluster 2020-07-16T15:15:58.798452+0000 mgr.x (mgr.34562) 4684 : cluster [DBG] pgmap v2919: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:16:01.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:16:00 smithi188 bash[23329]: audit 2020-07-16T15:15:59.606024+0000 mgr.x (mgr.34562) 4685 : audit [DBG] from='client.28042 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:16:01.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:16:00 smithi188 bash[23329]: audit 2020-07-16T15:15:59.888982+0000 mgr.x (mgr.34562) 4686 : audit [DBG] from='client.28048 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:16:01.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:16:00 smithi188 bash[23329]: audit 2020-07-16T15:16:00.186873+0000 mon.c (mon.1) 341 : audit [DBG] from='client.? 172.21.15.132:0/180192416' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:16:01.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:16:00 smithi188 bash[23329]: cluster 2020-07-16T15:16:00.798918+0000 mgr.x (mgr.34562) 4687 : cluster [DBG] pgmap v2920: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:16:01.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:16:00 smithi132 bash[27079]: audit 2020-07-16T15:15:59.606024+0000 mgr.x (mgr.34562) 4685 : audit [DBG] from='client.28042 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:16:01.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:16:00 smithi132 bash[27079]: audit 2020-07-16T15:15:59.888982+0000 mgr.x (mgr.34562) 4686 : audit [DBG] from='client.28048 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:16:01.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:16:00 smithi132 bash[27079]: audit 2020-07-16T15:16:00.186873+0000 mon.c (mon.1) 341 : audit [DBG] from='client.? 172.21.15.132:0/180192416' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:16:01.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:16:00 smithi132 bash[27079]: cluster 2020-07-16T15:16:00.798918+0000 mgr.x (mgr.34562) 4687 : cluster [DBG] pgmap v2920: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:16:04.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:16:03 smithi188 bash[23329]: cluster 2020-07-16T15:16:02.799458+0000 mgr.x (mgr.34562) 4688 : cluster [DBG] pgmap v2921: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:16:04.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:16:03 smithi132 bash[27079]: cluster 2020-07-16T15:16:02.799458+0000 mgr.x (mgr.34562) 4688 : cluster [DBG] pgmap v2921: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:16:06.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:16:05 smithi188 bash[23329]: cluster 2020-07-16T15:16:04.799930+0000 mgr.x (mgr.34562) 4689 : cluster [DBG] pgmap v2922: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:16:06.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:16:05 smithi132 bash[27079]: cluster 2020-07-16T15:16:04.799930+0000 mgr.x (mgr.34562) 4689 : cluster [DBG] pgmap v2922: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:16:08.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:16:07 smithi188 bash[23329]: cluster 2020-07-16T15:16:06.800517+0000 mgr.x (mgr.34562) 4690 : cluster [DBG] pgmap v2923: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:16:08.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:16:07 smithi132 bash[27079]: cluster 2020-07-16T15:16:06.800517+0000 mgr.x (mgr.34562) 4690 : cluster [DBG] pgmap v2923: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:16:10.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:16:09 smithi188 bash[23329]: cluster 2020-07-16T15:16:08.800871+0000 mgr.x (mgr.34562) 4691 : cluster [DBG] pgmap v2924: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:16:10.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:16:09 smithi132 bash[27079]: cluster 2020-07-16T15:16:08.800871+0000 mgr.x (mgr.34562) 4691 : cluster [DBG] pgmap v2924: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:16:11.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:16:11 smithi132 bash[27079]: cluster 2020-07-16T15:16:10.801379+0000 mgr.x (mgr.34562) 4692 : cluster [DBG] pgmap v2925: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:16:11.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:16:11 smithi188 bash[23329]: cluster 2020-07-16T15:16:10.801379+0000 mgr.x (mgr.34562) 4692 : cluster [DBG] pgmap v2925: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:16:14.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:16:13 smithi188 bash[23329]: cluster 2020-07-16T15:16:12.801844+0000 mgr.x (mgr.34562) 4693 : cluster [DBG] pgmap v2926: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:16:14.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:16:13 smithi188 bash[23329]: audit 2020-07-16T15:16:13.290354+0000 mon.b (mon.2) 1062 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:16:14.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:16:13 smithi132 bash[27079]: cluster 2020-07-16T15:16:12.801844+0000 mgr.x (mgr.34562) 4693 : cluster [DBG] pgmap v2926: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:16:14.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:16:13 smithi132 bash[27079]: audit 2020-07-16T15:16:13.290354+0000 mon.b (mon.2) 1062 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:16:15.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:16:14 smithi188 bash[23329]: cephadm 2020-07-16T15:16:13.291045+0000 mgr.x (mgr.34562) 4694 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:16:15.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:16:14 smithi188 bash[23329]: cephadm 2020-07-16T15:16:13.291430+0000 mgr.x (mgr.34562) 4695 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:16:15.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:16:14 smithi132 bash[27079]: cephadm 2020-07-16T15:16:13.291045+0000 mgr.x (mgr.34562) 4694 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:16:15.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:16:14 smithi132 bash[27079]: cephadm 2020-07-16T15:16:13.291430+0000 mgr.x (mgr.34562) 4695 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:16:16.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:16:15 smithi188 bash[23329]: cluster 2020-07-16T15:16:14.802354+0000 mgr.x (mgr.34562) 4696 : cluster [DBG] pgmap v2927: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:16:16.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:16:15 smithi132 bash[27079]: cluster 2020-07-16T15:16:14.802354+0000 mgr.x (mgr.34562) 4696 : cluster [DBG] pgmap v2927: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:16:18.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:16:17 smithi188 bash[23329]: cluster 2020-07-16T15:16:16.802721+0000 mgr.x (mgr.34562) 4697 : cluster [DBG] pgmap v2928: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:16:18.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:16:17 smithi132 bash[27079]: cluster 2020-07-16T15:16:16.802721+0000 mgr.x (mgr.34562) 4697 : cluster [DBG] pgmap v2928: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:16:20.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:16:19 smithi188 bash[23329]: cluster 2020-07-16T15:16:18.803195+0000 mgr.x (mgr.34562) 4698 : cluster [DBG] pgmap v2929: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:16:20.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:16:19 smithi132 bash[27079]: cluster 2020-07-16T15:16:18.803195+0000 mgr.x (mgr.34562) 4698 : cluster [DBG] pgmap v2929: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:16:21.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:16:21 smithi132 bash[27079]: cluster 2020-07-16T15:16:20.803550+0000 mgr.x (mgr.34562) 4699 : cluster [DBG] pgmap v2930: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:16:21.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:16:21 smithi188 bash[23329]: cluster 2020-07-16T15:16:20.803550+0000 mgr.x (mgr.34562) 4699 : cluster [DBG] pgmap v2930: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:16:24.179 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:16:23 smithi188 bash[23329]: cluster 2020-07-16T15:16:22.804101+0000 mgr.x (mgr.34562) 4700 : cluster [DBG] pgmap v2931: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:16:24.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:16:23 smithi132 bash[27079]: cluster 2020-07-16T15:16:22.804101+0000 mgr.x (mgr.34562) 4700 : cluster [DBG] pgmap v2931: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:16:26.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:16:25 smithi188 bash[23329]: cluster 2020-07-16T15:16:24.804567+0000 mgr.x (mgr.34562) 4701 : cluster [DBG] pgmap v2932: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:16:26.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:16:25 smithi132 bash[27079]: cluster 2020-07-16T15:16:24.804567+0000 mgr.x (mgr.34562) 4701 : cluster [DBG] pgmap v2932: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:16:28.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:16:27 smithi188 bash[23329]: cluster 2020-07-16T15:16:26.805093+0000 mgr.x (mgr.34562) 4702 : cluster [DBG] pgmap v2933: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:16:28.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:16:27 smithi132 bash[27079]: cluster 2020-07-16T15:16:26.805093+0000 mgr.x (mgr.34562) 4702 : cluster [DBG] pgmap v2933: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:16:29.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:16:28 smithi188 bash[23329]: audit 2020-07-16T15:16:28.306966+0000 mon.b (mon.2) 1063 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:16:29.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:16:28 smithi132 bash[27079]: audit 2020-07-16T15:16:28.306966+0000 mon.b (mon.2) 1063 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:16:30.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:16:29 smithi188 bash[23329]: cephadm 2020-07-16T15:16:28.307639+0000 mgr.x (mgr.34562) 4703 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:16:30.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:16:29 smithi188 bash[23329]: cephadm 2020-07-16T15:16:28.308047+0000 mgr.x (mgr.34562) 4704 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:16:30.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:16:29 smithi188 bash[23329]: cluster 2020-07-16T15:16:28.805558+0000 mgr.x (mgr.34562) 4705 : cluster [DBG] pgmap v2934: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:16:30.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:16:29 smithi132 bash[27079]: cephadm 2020-07-16T15:16:28.307639+0000 mgr.x (mgr.34562) 4703 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:16:30.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:16:29 smithi132 bash[27079]: cephadm 2020-07-16T15:16:28.308047+0000 mgr.x (mgr.34562) 4704 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:16:30.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:16:29 smithi132 bash[27079]: cluster 2020-07-16T15:16:28.805558+0000 mgr.x (mgr.34562) 4705 : cluster [DBG] pgmap v2934: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:16:30.488 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:16:30.750 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:16:30.751 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (99m) 2m ago 102m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:16:30.751 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (101m) 2m ago 101m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:16:30.751 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (99m) 2m ago 105m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:16:30.751 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (99m) 2m ago 106m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:16:30.752 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 2m ago 106m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:16:30.752 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (105m) 2m ago 105m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:16:30.752 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (105m) 2m ago 105m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:16:30.752 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (102m) 2m ago 102m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:16:30.752 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (102m) 2m ago 102m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:16:30.753 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (104m) 2m ago 104m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:16:30.753 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (104m) 2m ago 104m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:16:30.753 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (104m) 2m ago 104m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:16:30.754 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (104m) 2m ago 104m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:16:30.754 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (103m) 2m ago 103m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:16:30.754 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (103m) 2m ago 103m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:16:30.754 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (103m) 2m ago 103m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:16:30.754 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (102m) 2m ago 102m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:16:30.754 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (101m) 2m ago 102m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:16:31.046 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:16:31.047 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:16:31.047 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:16:31.047 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:16:31.047 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:16:31.048 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:16:31.048 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:16:31.048 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:16:31.048 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:16:31.048 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:16:31.049 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:16:31.049 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:16:31.049 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:16:31.049 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:16:31.049 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:16:31.050 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:16:31.050 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:16:31.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:16:31 smithi132 bash[27079]: audit 2020-07-16T15:16:30.476512+0000 mgr.x (mgr.34562) 4706 : audit [DBG] from='client.28060 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:16:31.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:16:31 smithi132 bash[27079]: audit 2020-07-16T15:16:30.744729+0000 mgr.x (mgr.34562) 4707 : audit [DBG] from='client.28066 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:16:31.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:16:31 smithi132 bash[27079]: cluster 2020-07-16T15:16:30.805898+0000 mgr.x (mgr.34562) 4708 : cluster [DBG] pgmap v2935: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:16:31.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:16:31 smithi132 bash[27079]: audit 2020-07-16T15:16:31.046018+0000 mon.c (mon.1) 342 : audit [DBG] from='client.? 172.21.15.132:0/2117097918' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:16:31.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:16:31 smithi188 bash[23329]: audit 2020-07-16T15:16:30.476512+0000 mgr.x (mgr.34562) 4706 : audit [DBG] from='client.28060 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:16:31.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:16:31 smithi188 bash[23329]: audit 2020-07-16T15:16:30.744729+0000 mgr.x (mgr.34562) 4707 : audit [DBG] from='client.28066 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:16:31.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:16:31 smithi188 bash[23329]: cluster 2020-07-16T15:16:30.805898+0000 mgr.x (mgr.34562) 4708 : cluster [DBG] pgmap v2935: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:16:31.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:16:31 smithi188 bash[23329]: audit 2020-07-16T15:16:31.046018+0000 mon.c (mon.1) 342 : audit [DBG] from='client.? 172.21.15.132:0/2117097918' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:16:34.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:16:33 smithi188 bash[23329]: cluster 2020-07-16T15:16:32.806294+0000 mgr.x (mgr.34562) 4709 : cluster [DBG] pgmap v2936: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:16:34.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:16:33 smithi132 bash[27079]: cluster 2020-07-16T15:16:32.806294+0000 mgr.x (mgr.34562) 4709 : cluster [DBG] pgmap v2936: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:16:36.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:16:35 smithi188 bash[23329]: cluster 2020-07-16T15:16:34.806810+0000 mgr.x (mgr.34562) 4710 : cluster [DBG] pgmap v2937: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:16:36.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:16:35 smithi132 bash[27079]: cluster 2020-07-16T15:16:34.806810+0000 mgr.x (mgr.34562) 4710 : cluster [DBG] pgmap v2937: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:16:38.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:16:37 smithi188 bash[23329]: cluster 2020-07-16T15:16:36.807219+0000 mgr.x (mgr.34562) 4711 : cluster [DBG] pgmap v2938: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:16:38.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:16:37 smithi132 bash[27079]: cluster 2020-07-16T15:16:36.807219+0000 mgr.x (mgr.34562) 4711 : cluster [DBG] pgmap v2938: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:16:40.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:16:39 smithi188 bash[23329]: cluster 2020-07-16T15:16:38.807668+0000 mgr.x (mgr.34562) 4712 : cluster [DBG] pgmap v2939: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:16:40.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:16:39 smithi132 bash[27079]: cluster 2020-07-16T15:16:38.807668+0000 mgr.x (mgr.34562) 4712 : cluster [DBG] pgmap v2939: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:16:41.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:16:41 smithi132 bash[27079]: cluster 2020-07-16T15:16:40.808040+0000 mgr.x (mgr.34562) 4713 : cluster [DBG] pgmap v2940: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:16:41.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:16:41 smithi188 bash[23329]: cluster 2020-07-16T15:16:40.808040+0000 mgr.x (mgr.34562) 4713 : cluster [DBG] pgmap v2940: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:16:44.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:16:43 smithi188 bash[23329]: cluster 2020-07-16T15:16:42.808461+0000 mgr.x (mgr.34562) 4714 : cluster [DBG] pgmap v2941: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:16:44.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:16:43 smithi188 bash[23329]: audit 2020-07-16T15:16:43.323514+0000 mon.b (mon.2) 1064 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:16:44.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:16:43 smithi132 bash[27079]: cluster 2020-07-16T15:16:42.808461+0000 mgr.x (mgr.34562) 4714 : cluster [DBG] pgmap v2941: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:16:44.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:16:43 smithi132 bash[27079]: audit 2020-07-16T15:16:43.323514+0000 mon.b (mon.2) 1064 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:16:45.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:16:44 smithi188 bash[23329]: cephadm 2020-07-16T15:16:43.324587+0000 mgr.x (mgr.34562) 4715 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:16:45.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:16:44 smithi188 bash[23329]: cephadm 2020-07-16T15:16:43.324661+0000 mgr.x (mgr.34562) 4716 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:16:45.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:16:44 smithi132 bash[27079]: cephadm 2020-07-16T15:16:43.324587+0000 mgr.x (mgr.34562) 4715 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:16:45.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:16:44 smithi132 bash[27079]: cephadm 2020-07-16T15:16:43.324661+0000 mgr.x (mgr.34562) 4716 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:16:46.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:16:45 smithi188 bash[23329]: cluster 2020-07-16T15:16:44.808971+0000 mgr.x (mgr.34562) 4717 : cluster [DBG] pgmap v2942: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:16:46.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:16:45 smithi132 bash[27079]: cluster 2020-07-16T15:16:44.808971+0000 mgr.x (mgr.34562) 4717 : cluster [DBG] pgmap v2942: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:16:48.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:16:47 smithi188 bash[23329]: cluster 2020-07-16T15:16:46.809451+0000 mgr.x (mgr.34562) 4718 : cluster [DBG] pgmap v2943: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:16:48.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:16:47 smithi132 bash[27079]: cluster 2020-07-16T15:16:46.809451+0000 mgr.x (mgr.34562) 4718 : cluster [DBG] pgmap v2943: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:16:49.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:16:48 smithi132 bash[27079]: cluster 2020-07-16T15:16:48.809964+0000 mgr.x (mgr.34562) 4719 : cluster [DBG] pgmap v2944: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:16:49.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:16:48 smithi188 bash[23329]: cluster 2020-07-16T15:16:48.809964+0000 mgr.x (mgr.34562) 4719 : cluster [DBG] pgmap v2944: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:16:51.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:16:51 smithi132 bash[27079]: cluster 2020-07-16T15:16:50.810457+0000 mgr.x (mgr.34562) 4720 : cluster [DBG] pgmap v2945: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:16:51.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:16:51 smithi188 bash[23329]: cluster 2020-07-16T15:16:50.810457+0000 mgr.x (mgr.34562) 4720 : cluster [DBG] pgmap v2945: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:16:54.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:16:53 smithi188 bash[23329]: cluster 2020-07-16T15:16:52.810900+0000 mgr.x (mgr.34562) 4721 : cluster [DBG] pgmap v2946: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:16:54.284 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:16:53 smithi132 bash[27079]: cluster 2020-07-16T15:16:52.810900+0000 mgr.x (mgr.34562) 4721 : cluster [DBG] pgmap v2946: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:16:56.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:16:55 smithi188 bash[23329]: cluster 2020-07-16T15:16:54.811387+0000 mgr.x (mgr.34562) 4722 : cluster [DBG] pgmap v2947: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:16:56.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:16:55 smithi132 bash[27079]: cluster 2020-07-16T15:16:54.811387+0000 mgr.x (mgr.34562) 4722 : cluster [DBG] pgmap v2947: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:16:58.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:16:57 smithi188 bash[23329]: cluster 2020-07-16T15:16:56.811826+0000 mgr.x (mgr.34562) 4723 : cluster [DBG] pgmap v2948: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:16:58.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:16:57 smithi132 bash[27079]: cluster 2020-07-16T15:16:56.811826+0000 mgr.x (mgr.34562) 4723 : cluster [DBG] pgmap v2948: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:16:59.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:16:58 smithi188 bash[23329]: audit 2020-07-16T15:16:58.328244+0000 mon.b (mon.2) 1065 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:16:59.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:16:58 smithi188 bash[23329]: audit 2020-07-16T15:16:58.329707+0000 mon.b (mon.2) 1066 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:16:59.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:16:58 smithi188 bash[23329]: audit 2020-07-16T15:16:58.330892+0000 mon.b (mon.2) 1067 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:16:59.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:16:58 smithi188 bash[23329]: audit 2020-07-16T15:16:58.332216+0000 mon.b (mon.2) 1068 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:16:59.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:16:58 smithi188 bash[23329]: audit 2020-07-16T15:16:58.333462+0000 mon.b (mon.2) 1069 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:16:59.230 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:16:58 smithi132 bash[27079]: audit 2020-07-16T15:16:58.328244+0000 mon.b (mon.2) 1065 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:16:59.230 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:16:58 smithi132 bash[27079]: audit 2020-07-16T15:16:58.329707+0000 mon.b (mon.2) 1066 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:16:59.230 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:16:58 smithi132 bash[27079]: audit 2020-07-16T15:16:58.330892+0000 mon.b (mon.2) 1067 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:16:59.231 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:16:58 smithi132 bash[27079]: audit 2020-07-16T15:16:58.332216+0000 mon.b (mon.2) 1068 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:16:59.231 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:16:58 smithi132 bash[27079]: audit 2020-07-16T15:16:58.333462+0000 mon.b (mon.2) 1069 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:17:00.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:16:59 smithi188 bash[23329]: audit 2020-07-16T15:16:58.328620+0000 mgr.x (mgr.34562) 4724 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:17:00.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:16:59 smithi188 bash[23329]: audit 2020-07-16T15:16:58.330026+0000 mgr.x (mgr.34562) 4725 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:17:00.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:16:59 smithi188 bash[23329]: audit 2020-07-16T15:16:58.331185+0000 mgr.x (mgr.34562) 4726 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:17:00.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:16:59 smithi188 bash[23329]: cephadm 2020-07-16T15:16:58.331921+0000 mgr.x (mgr.34562) 4727 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:17:00.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:16:59 smithi188 bash[23329]: cephadm 2020-07-16T15:16:58.333092+0000 mgr.x (mgr.34562) 4728 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:17:00.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:16:59 smithi188 bash[23329]: cephadm 2020-07-16T15:16:58.334179+0000 mgr.x (mgr.34562) 4729 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:17:00.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:16:59 smithi188 bash[23329]: cephadm 2020-07-16T15:16:58.334469+0000 mgr.x (mgr.34562) 4730 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:17:00.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:16:59 smithi188 bash[23329]: cluster 2020-07-16T15:16:58.812194+0000 mgr.x (mgr.34562) 4731 : cluster [DBG] pgmap v2949: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:17:00.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:16:59 smithi132 bash[27079]: audit 2020-07-16T15:16:58.328620+0000 mgr.x (mgr.34562) 4724 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:17:00.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:16:59 smithi132 bash[27079]: audit 2020-07-16T15:16:58.330026+0000 mgr.x (mgr.34562) 4725 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:17:00.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:16:59 smithi132 bash[27079]: audit 2020-07-16T15:16:58.331185+0000 mgr.x (mgr.34562) 4726 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:17:00.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:16:59 smithi132 bash[27079]: cephadm 2020-07-16T15:16:58.331921+0000 mgr.x (mgr.34562) 4727 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:17:00.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:16:59 smithi132 bash[27079]: cephadm 2020-07-16T15:16:58.333092+0000 mgr.x (mgr.34562) 4728 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:17:00.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:16:59 smithi132 bash[27079]: cephadm 2020-07-16T15:16:58.334179+0000 mgr.x (mgr.34562) 4729 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:17:00.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:16:59 smithi132 bash[27079]: cephadm 2020-07-16T15:16:58.334469+0000 mgr.x (mgr.34562) 4730 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:17:00.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:16:59 smithi132 bash[27079]: cluster 2020-07-16T15:16:58.812194+0000 mgr.x (mgr.34562) 4731 : cluster [DBG] pgmap v2949: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:17:01.341 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:17:01.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:17:01 smithi132 bash[27079]: cluster 2020-07-16T15:17:00.812641+0000 mgr.x (mgr.34562) 4732 : cluster [DBG] pgmap v2950: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:17:01.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:17:01 smithi132 bash[27079]: audit 2020-07-16T15:17:01.244421+0000 mon.b (mon.2) 1070 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:17:01.604 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:17:01.604 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (99m) 3m ago 102m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:17:01.605 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (102m) 3m ago 102m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:17:01.605 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (100m) 3m ago 105m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:17:01.605 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (99m) 3m ago 107m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:17:01.605 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 3m ago 107m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:17:01.606 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (105m) 3m ago 105m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:17:01.606 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (106m) 3m ago 106m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:17:01.606 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (103m) 3m ago 103m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:17:01.606 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (103m) 3m ago 103m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:17:01.606 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (105m) 3m ago 105m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:17:01.607 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (105m) 3m ago 105m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:17:01.607 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (104m) 3m ago 104m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:17:01.607 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (104m) 3m ago 104m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:17:01.607 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (103m) 3m ago 104m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:17:01.607 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (103m) 3m ago 103m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:17:01.608 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (103m) 3m ago 103m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:17:01.608 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (103m) 3m ago 103m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:17:01.608 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (102m) 3m ago 103m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:17:01.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:17:01 smithi188 bash[23329]: cluster 2020-07-16T15:17:00.812641+0000 mgr.x (mgr.34562) 4732 : cluster [DBG] pgmap v2950: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:17:01.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:17:01 smithi188 bash[23329]: audit 2020-07-16T15:17:01.244421+0000 mon.b (mon.2) 1070 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:17:01.913 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:17:01.913 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:17:01.914 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:17:01.914 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:17:01.914 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:17:01.915 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:17:01.915 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:17:01.915 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:17:01.915 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:17:01.916 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:17:01.916 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:17:01.916 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:17:01.917 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:17:01.917 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:17:01.917 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:17:01.917 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:17:01.918 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:17:02.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:17:02 smithi132 bash[27079]: cephadm 2020-07-16T15:17:01.245083+0000 mgr.x (mgr.34562) 4733 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:17:02.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:17:02 smithi132 bash[27079]: cephadm 2020-07-16T15:17:01.245403+0000 mgr.x (mgr.34562) 4734 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:17:02.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:17:02 smithi132 bash[27079]: audit 2020-07-16T15:17:01.329624+0000 mgr.x (mgr.34562) 4735 : audit [DBG] from='client.28078 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:17:02.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:17:02 smithi132 bash[27079]: audit 2020-07-16T15:17:01.599598+0000 mgr.x (mgr.34562) 4736 : audit [DBG] from='client.28084 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:17:02.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:17:02 smithi132 bash[27079]: audit 2020-07-16T15:17:01.909032+0000 mon.c (mon.1) 343 : audit [DBG] from='client.? 172.21.15.132:0/2592888600' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:17:02.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:17:02 smithi188 bash[23329]: cephadm 2020-07-16T15:17:01.245083+0000 mgr.x (mgr.34562) 4733 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:17:02.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:17:02 smithi188 bash[23329]: cephadm 2020-07-16T15:17:01.245403+0000 mgr.x (mgr.34562) 4734 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:17:02.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:17:02 smithi188 bash[23329]: audit 2020-07-16T15:17:01.329624+0000 mgr.x (mgr.34562) 4735 : audit [DBG] from='client.28078 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:17:02.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:17:02 smithi188 bash[23329]: audit 2020-07-16T15:17:01.599598+0000 mgr.x (mgr.34562) 4736 : audit [DBG] from='client.28084 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:17:02.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:17:02 smithi188 bash[23329]: audit 2020-07-16T15:17:01.909032+0000 mon.c (mon.1) 343 : audit [DBG] from='client.? 172.21.15.132:0/2592888600' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:17:03.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:17:03 smithi132 bash[27079]: cluster 2020-07-16T15:17:02.813193+0000 mgr.x (mgr.34562) 4737 : cluster [DBG] pgmap v2951: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:17:03.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:17:03 smithi188 bash[23329]: cluster 2020-07-16T15:17:02.813193+0000 mgr.x (mgr.34562) 4737 : cluster [DBG] pgmap v2951: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:17:06.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:17:05 smithi188 bash[23329]: cluster 2020-07-16T15:17:04.813558+0000 mgr.x (mgr.34562) 4738 : cluster [DBG] pgmap v2952: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:17:06.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:17:05 smithi132 bash[27079]: cluster 2020-07-16T15:17:04.813558+0000 mgr.x (mgr.34562) 4738 : cluster [DBG] pgmap v2952: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:17:08.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:17:07 smithi188 bash[23329]: cluster 2020-07-16T15:17:06.813952+0000 mgr.x (mgr.34562) 4739 : cluster [DBG] pgmap v2953: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:17:08.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:17:07 smithi132 bash[27079]: cluster 2020-07-16T15:17:06.813952+0000 mgr.x (mgr.34562) 4739 : cluster [DBG] pgmap v2953: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:17:10.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:17:09 smithi188 bash[23329]: cluster 2020-07-16T15:17:08.814417+0000 mgr.x (mgr.34562) 4740 : cluster [DBG] pgmap v2954: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:17:10.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:17:09 smithi132 bash[27079]: cluster 2020-07-16T15:17:08.814417+0000 mgr.x (mgr.34562) 4740 : cluster [DBG] pgmap v2954: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:17:11.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:17:11 smithi132 bash[27079]: cluster 2020-07-16T15:17:10.814842+0000 mgr.x (mgr.34562) 4741 : cluster [DBG] pgmap v2955: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:17:11.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:17:11 smithi188 bash[23329]: cluster 2020-07-16T15:17:10.814842+0000 mgr.x (mgr.34562) 4741 : cluster [DBG] pgmap v2955: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:17:14.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:17:13 smithi188 bash[23329]: cluster 2020-07-16T15:17:12.815371+0000 mgr.x (mgr.34562) 4742 : cluster [DBG] pgmap v2956: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:17:14.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:17:13 smithi132 bash[27079]: cluster 2020-07-16T15:17:12.815371+0000 mgr.x (mgr.34562) 4742 : cluster [DBG] pgmap v2956: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:17:16.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:17:15 smithi188 bash[23329]: cluster 2020-07-16T15:17:14.815798+0000 mgr.x (mgr.34562) 4743 : cluster [DBG] pgmap v2957: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:17:16.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:17:15 smithi132 bash[27079]: cluster 2020-07-16T15:17:14.815798+0000 mgr.x (mgr.34562) 4743 : cluster [DBG] pgmap v2957: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:17:17.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:17:16 smithi188 bash[23329]: audit 2020-07-16T15:17:16.260867+0000 mon.b (mon.2) 1071 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:17:17.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:17:16 smithi132 bash[27079]: audit 2020-07-16T15:17:16.260867+0000 mon.b (mon.2) 1071 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:17:18.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:17:17 smithi188 bash[23329]: cephadm 2020-07-16T15:17:16.261605+0000 mgr.x (mgr.34562) 4744 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:17:18.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:17:17 smithi188 bash[23329]: cephadm 2020-07-16T15:17:16.261706+0000 mgr.x (mgr.34562) 4745 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:17:18.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:17:17 smithi188 bash[23329]: cluster 2020-07-16T15:17:16.816243+0000 mgr.x (mgr.34562) 4746 : cluster [DBG] pgmap v2958: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:17:18.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:17:17 smithi132 bash[27079]: cephadm 2020-07-16T15:17:16.261605+0000 mgr.x (mgr.34562) 4744 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:17:18.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:17:17 smithi132 bash[27079]: cephadm 2020-07-16T15:17:16.261706+0000 mgr.x (mgr.34562) 4745 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:17:18.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:17:17 smithi132 bash[27079]: cluster 2020-07-16T15:17:16.816243+0000 mgr.x (mgr.34562) 4746 : cluster [DBG] pgmap v2958: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:17:19.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:17:18 smithi188 bash[23329]: cluster 2020-07-16T15:17:18.816557+0000 mgr.x (mgr.34562) 4747 : cluster [DBG] pgmap v2959: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:17:19.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:17:18 smithi132 bash[27079]: cluster 2020-07-16T15:17:18.816557+0000 mgr.x (mgr.34562) 4747 : cluster [DBG] pgmap v2959: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:17:21.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:17:21 smithi132 bash[27079]: cluster 2020-07-16T15:17:20.816998+0000 mgr.x (mgr.34562) 4748 : cluster [DBG] pgmap v2960: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:17:21.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:17:21 smithi188 bash[23329]: cluster 2020-07-16T15:17:20.816998+0000 mgr.x (mgr.34562) 4748 : cluster [DBG] pgmap v2960: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:17:24.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:17:23 smithi188 bash[23329]: cluster 2020-07-16T15:17:22.817557+0000 mgr.x (mgr.34562) 4749 : cluster [DBG] pgmap v2961: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:17:24.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:17:23 smithi132 bash[27079]: cluster 2020-07-16T15:17:22.817557+0000 mgr.x (mgr.34562) 4749 : cluster [DBG] pgmap v2961: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:17:26.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:17:25 smithi188 bash[23329]: cluster 2020-07-16T15:17:24.818106+0000 mgr.x (mgr.34562) 4750 : cluster [DBG] pgmap v2962: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:17:26.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:17:25 smithi132 bash[27079]: cluster 2020-07-16T15:17:24.818106+0000 mgr.x (mgr.34562) 4750 : cluster [DBG] pgmap v2962: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:17:28.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:17:27 smithi188 bash[23329]: cluster 2020-07-16T15:17:26.818517+0000 mgr.x (mgr.34562) 4751 : cluster [DBG] pgmap v2963: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:17:28.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:17:27 smithi132 bash[27079]: cluster 2020-07-16T15:17:26.818517+0000 mgr.x (mgr.34562) 4751 : cluster [DBG] pgmap v2963: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:17:30.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:17:29 smithi188 bash[23329]: cluster 2020-07-16T15:17:28.818890+0000 mgr.x (mgr.34562) 4752 : cluster [DBG] pgmap v2964: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:17:30.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:17:29 smithi132 bash[27079]: cluster 2020-07-16T15:17:28.818890+0000 mgr.x (mgr.34562) 4752 : cluster [DBG] pgmap v2964: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:17:31.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:17:31 smithi132 bash[27079]: cluster 2020-07-16T15:17:30.819371+0000 mgr.x (mgr.34562) 4753 : cluster [DBG] pgmap v2965: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:17:31.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:17:31 smithi188 bash[23329]: cluster 2020-07-16T15:17:30.819371+0000 mgr.x (mgr.34562) 4753 : cluster [DBG] pgmap v2965: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:17:32.206 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:17:32.467 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:17:32.467 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (100m) 3m ago 103m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:17:32.468 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (103m) 3m ago 103m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:17:32.468 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (100m) 3m ago 106m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:17:32.468 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (100m) 3m ago 107m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:17:32.468 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 3m ago 107m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:17:32.469 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (106m) 3m ago 106m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:17:32.469 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (106m) 3m ago 106m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:17:32.469 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (103m) 3m ago 103m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:17:32.469 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (103m) 3m ago 103m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:17:32.469 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (105m) 3m ago 105m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:17:32.470 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (105m) 3m ago 105m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:17:32.470 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (105m) 3m ago 105m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:17:32.470 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (105m) 3m ago 105m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:17:32.470 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (104m) 3m ago 104m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:17:32.471 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (104m) 3m ago 104m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:17:32.471 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (104m) 3m ago 104m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:17:32.471 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (103m) 3m ago 103m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:17:32.471 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (102m) 3m ago 103m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:17:32.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:17:32 smithi132 bash[27079]: audit 2020-07-16T15:17:31.276649+0000 mon.b (mon.2) 1072 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:17:32.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:17:32 smithi132 bash[27079]: cephadm 2020-07-16T15:17:31.277373+0000 mgr.x (mgr.34562) 4754 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:17:32.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:17:32 smithi132 bash[27079]: cephadm 2020-07-16T15:17:31.277645+0000 mgr.x (mgr.34562) 4755 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:17:32.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:17:32 smithi188 bash[23329]: audit 2020-07-16T15:17:31.276649+0000 mon.b (mon.2) 1072 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:17:32.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:17:32 smithi188 bash[23329]: cephadm 2020-07-16T15:17:31.277373+0000 mgr.x (mgr.34562) 4754 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:17:32.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:17:32 smithi188 bash[23329]: cephadm 2020-07-16T15:17:31.277645+0000 mgr.x (mgr.34562) 4755 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:17:32.765 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:17:32.766 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:17:32.766 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:17:32.766 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:17:32.766 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:17:32.767 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:17:32.767 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:17:32.767 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:17:32.767 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:17:32.767 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:17:32.768 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:17:32.768 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:17:32.768 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:17:32.768 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:17:32.769 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:17:32.769 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:17:32.769 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:17:33.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:17:33 smithi188 bash[23329]: audit 2020-07-16T15:17:32.194705+0000 mgr.x (mgr.34562) 4756 : audit [DBG] from='client.28096 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:17:33.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:17:33 smithi188 bash[23329]: audit 2020-07-16T15:17:32.462886+0000 mgr.x (mgr.34562) 4757 : audit [DBG] from='client.28102 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:17:33.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:17:33 smithi188 bash[23329]: audit 2020-07-16T15:17:32.764838+0000 mon.c (mon.1) 344 : audit [DBG] from='client.? 172.21.15.132:0/142533197' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:17:33.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:17:33 smithi188 bash[23329]: cluster 2020-07-16T15:17:32.819785+0000 mgr.x (mgr.34562) 4758 : cluster [DBG] pgmap v2966: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:17:33.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:17:33 smithi132 bash[27079]: audit 2020-07-16T15:17:32.194705+0000 mgr.x (mgr.34562) 4756 : audit [DBG] from='client.28096 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:17:33.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:17:33 smithi132 bash[27079]: audit 2020-07-16T15:17:32.462886+0000 mgr.x (mgr.34562) 4757 : audit [DBG] from='client.28102 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:17:33.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:17:33 smithi132 bash[27079]: audit 2020-07-16T15:17:32.764838+0000 mon.c (mon.1) 344 : audit [DBG] from='client.? 172.21.15.132:0/142533197' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:17:33.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:17:33 smithi132 bash[27079]: cluster 2020-07-16T15:17:32.819785+0000 mgr.x (mgr.34562) 4758 : cluster [DBG] pgmap v2966: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:17:36.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:17:35 smithi188 bash[23329]: cluster 2020-07-16T15:17:34.820186+0000 mgr.x (mgr.34562) 4759 : cluster [DBG] pgmap v2967: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:17:36.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:17:35 smithi132 bash[27079]: cluster 2020-07-16T15:17:34.820186+0000 mgr.x (mgr.34562) 4759 : cluster [DBG] pgmap v2967: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:17:38.175 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:17:37 smithi188 bash[23329]: cluster 2020-07-16T15:17:36.820599+0000 mgr.x (mgr.34562) 4760 : cluster [DBG] pgmap v2968: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:17:38.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:17:37 smithi132 bash[27079]: cluster 2020-07-16T15:17:36.820599+0000 mgr.x (mgr.34562) 4760 : cluster [DBG] pgmap v2968: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:17:40.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:17:39 smithi188 bash[23329]: cluster 2020-07-16T15:17:38.820939+0000 mgr.x (mgr.34562) 4761 : cluster [DBG] pgmap v2969: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:17:40.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:17:39 smithi132 bash[27079]: cluster 2020-07-16T15:17:38.820939+0000 mgr.x (mgr.34562) 4761 : cluster [DBG] pgmap v2969: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:17:41.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:17:41 smithi132 bash[27079]: cluster 2020-07-16T15:17:40.821318+0000 mgr.x (mgr.34562) 4762 : cluster [DBG] pgmap v2970: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:17:41.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:17:41 smithi188 bash[23329]: cluster 2020-07-16T15:17:40.821318+0000 mgr.x (mgr.34562) 4762 : cluster [DBG] pgmap v2970: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:17:44.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:17:43 smithi188 bash[23329]: cluster 2020-07-16T15:17:42.821786+0000 mgr.x (mgr.34562) 4763 : cluster [DBG] pgmap v2971: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:17:44.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:17:43 smithi132 bash[27079]: cluster 2020-07-16T15:17:42.821786+0000 mgr.x (mgr.34562) 4763 : cluster [DBG] pgmap v2971: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:17:46.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:17:45 smithi188 bash[23329]: cluster 2020-07-16T15:17:44.822273+0000 mgr.x (mgr.34562) 4764 : cluster [DBG] pgmap v2972: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:17:46.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:17:45 smithi132 bash[27079]: cluster 2020-07-16T15:17:44.822273+0000 mgr.x (mgr.34562) 4764 : cluster [DBG] pgmap v2972: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:17:47.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:17:46 smithi188 bash[23329]: audit 2020-07-16T15:17:46.281845+0000 mon.b (mon.2) 1073 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:17:47.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:17:46 smithi132 bash[27079]: audit 2020-07-16T15:17:46.281845+0000 mon.b (mon.2) 1073 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:17:48.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:17:47 smithi188 bash[23329]: cephadm 2020-07-16T15:17:46.282517+0000 mgr.x (mgr.34562) 4765 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:17:48.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:17:47 smithi188 bash[23329]: cephadm 2020-07-16T15:17:46.282908+0000 mgr.x (mgr.34562) 4766 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:17:48.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:17:47 smithi188 bash[23329]: cluster 2020-07-16T15:17:46.822707+0000 mgr.x (mgr.34562) 4767 : cluster [DBG] pgmap v2973: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:17:48.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:17:47 smithi132 bash[27079]: cephadm 2020-07-16T15:17:46.282517+0000 mgr.x (mgr.34562) 4765 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:17:48.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:17:47 smithi132 bash[27079]: cephadm 2020-07-16T15:17:46.282908+0000 mgr.x (mgr.34562) 4766 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:17:48.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:17:47 smithi132 bash[27079]: cluster 2020-07-16T15:17:46.822707+0000 mgr.x (mgr.34562) 4767 : cluster [DBG] pgmap v2973: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:17:49.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:17:48 smithi188 bash[23329]: cluster 2020-07-16T15:17:48.823208+0000 mgr.x (mgr.34562) 4768 : cluster [DBG] pgmap v2974: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:17:49.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:17:48 smithi132 bash[27079]: cluster 2020-07-16T15:17:48.823208+0000 mgr.x (mgr.34562) 4768 : cluster [DBG] pgmap v2974: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:17:51.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:17:51 smithi132 bash[27079]: cluster 2020-07-16T15:17:50.823551+0000 mgr.x (mgr.34562) 4769 : cluster [DBG] pgmap v2975: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:17:51.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:17:51 smithi188 bash[23329]: cluster 2020-07-16T15:17:50.823551+0000 mgr.x (mgr.34562) 4769 : cluster [DBG] pgmap v2975: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:17:54.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:17:53 smithi188 bash[23329]: cluster 2020-07-16T15:17:52.823923+0000 mgr.x (mgr.34562) 4770 : cluster [DBG] pgmap v2976: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:17:54.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:17:53 smithi132 bash[27079]: cluster 2020-07-16T15:17:52.823923+0000 mgr.x (mgr.34562) 4770 : cluster [DBG] pgmap v2976: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:17:56.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:17:55 smithi188 bash[23329]: cluster 2020-07-16T15:17:54.824337+0000 mgr.x (mgr.34562) 4771 : cluster [DBG] pgmap v2977: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:17:56.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:17:55 smithi132 bash[27079]: cluster 2020-07-16T15:17:54.824337+0000 mgr.x (mgr.34562) 4771 : cluster [DBG] pgmap v2977: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:17:58.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:17:57 smithi188 bash[23329]: cluster 2020-07-16T15:17:56.824670+0000 mgr.x (mgr.34562) 4772 : cluster [DBG] pgmap v2978: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:17:58.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:17:57 smithi132 bash[27079]: cluster 2020-07-16T15:17:56.824670+0000 mgr.x (mgr.34562) 4772 : cluster [DBG] pgmap v2978: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:17:59.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:17:58 smithi132 bash[27079]: cluster 2020-07-16T15:17:58.825076+0000 mgr.x (mgr.34562) 4773 : cluster [DBG] pgmap v2979: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:17:59.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:17:58 smithi188 bash[23329]: cluster 2020-07-16T15:17:58.825076+0000 mgr.x (mgr.34562) 4773 : cluster [DBG] pgmap v2979: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:18:01.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:18:01 smithi132 bash[27079]: cluster 2020-07-16T15:18:00.825600+0000 mgr.x (mgr.34562) 4774 : cluster [DBG] pgmap v2980: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:18:01.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:18:01 smithi188 bash[23329]: cluster 2020-07-16T15:18:00.825600+0000 mgr.x (mgr.34562) 4774 : cluster [DBG] pgmap v2980: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:18:02.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:18:02 smithi132 bash[27079]: audit 2020-07-16T15:18:01.300999+0000 mon.b (mon.2) 1074 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:18:02.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:18:02 smithi132 bash[27079]: audit 2020-07-16T15:18:01.301428+0000 mgr.x (mgr.34562) 4775 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:18:02.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:18:02 smithi132 bash[27079]: audit 2020-07-16T15:18:01.302453+0000 mon.b (mon.2) 1075 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:18:02.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:18:02 smithi132 bash[27079]: audit 2020-07-16T15:18:01.302766+0000 mgr.x (mgr.34562) 4776 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:18:02.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:18:02 smithi132 bash[27079]: audit 2020-07-16T15:18:01.303608+0000 mon.b (mon.2) 1076 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:18:02.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:18:02 smithi132 bash[27079]: audit 2020-07-16T15:18:01.303915+0000 mgr.x (mgr.34562) 4777 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:18:02.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:18:02 smithi132 bash[27079]: cephadm 2020-07-16T15:18:01.304701+0000 mgr.x (mgr.34562) 4778 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:18:02.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:18:02 smithi132 bash[27079]: audit 2020-07-16T15:18:01.305041+0000 mon.b (mon.2) 1077 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:18:02.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:18:02 smithi132 bash[27079]: cephadm 2020-07-16T15:18:01.305848+0000 mgr.x (mgr.34562) 4779 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:18:02.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:18:02 smithi132 bash[27079]: audit 2020-07-16T15:18:01.306351+0000 mon.b (mon.2) 1078 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:18:02.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:18:02 smithi132 bash[27079]: cephadm 2020-07-16T15:18:01.307160+0000 mgr.x (mgr.34562) 4780 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:18:02.532 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:18:02 smithi132 bash[27079]: cephadm 2020-07-16T15:18:01.307248+0000 mgr.x (mgr.34562) 4781 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:18:02.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:18:02 smithi188 bash[23329]: audit 2020-07-16T15:18:01.300999+0000 mon.b (mon.2) 1074 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:18:02.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:18:02 smithi188 bash[23329]: audit 2020-07-16T15:18:01.301428+0000 mgr.x (mgr.34562) 4775 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:18:02.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:18:02 smithi188 bash[23329]: audit 2020-07-16T15:18:01.302453+0000 mon.b (mon.2) 1075 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:18:02.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:18:02 smithi188 bash[23329]: audit 2020-07-16T15:18:01.302766+0000 mgr.x (mgr.34562) 4776 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:18:02.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:18:02 smithi188 bash[23329]: audit 2020-07-16T15:18:01.303608+0000 mon.b (mon.2) 1076 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:18:02.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:18:02 smithi188 bash[23329]: audit 2020-07-16T15:18:01.303915+0000 mgr.x (mgr.34562) 4777 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:18:02.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:18:02 smithi188 bash[23329]: cephadm 2020-07-16T15:18:01.304701+0000 mgr.x (mgr.34562) 4778 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:18:02.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:18:02 smithi188 bash[23329]: audit 2020-07-16T15:18:01.305041+0000 mon.b (mon.2) 1077 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:18:02.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:18:02 smithi188 bash[23329]: cephadm 2020-07-16T15:18:01.305848+0000 mgr.x (mgr.34562) 4779 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:18:02.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:18:02 smithi188 bash[23329]: audit 2020-07-16T15:18:01.306351+0000 mon.b (mon.2) 1078 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:18:02.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:18:02 smithi188 bash[23329]: cephadm 2020-07-16T15:18:01.307160+0000 mgr.x (mgr.34562) 4780 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:18:02.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:18:02 smithi188 bash[23329]: cephadm 2020-07-16T15:18:01.307248+0000 mgr.x (mgr.34562) 4781 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:18:03.076 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:18:03.352 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:18:03.352 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (100m) 4m ago 103m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:18:03.353 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (103m) 4m ago 103m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:18:03.353 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (101m) 4m ago 106m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:18:03.353 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (100m) 4m ago 108m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:18:03.353 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 4m ago 108m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:18:03.354 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (106m) 4m ago 106m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:18:03.354 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (107m) 4m ago 107m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:18:03.354 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (104m) 4m ago 104m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:18:03.354 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (104m) 4m ago 104m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:18:03.354 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (106m) 4m ago 106m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:18:03.355 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (106m) 4m ago 106m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:18:03.355 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (105m) 4m ago 105m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:18:03.355 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (105m) 4m ago 105m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:18:03.355 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (105m) 4m ago 105m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:18:03.355 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (104m) 4m ago 105m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:18:03.356 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (104m) 4m ago 104m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:18:03.356 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (104m) 4m ago 104m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:18:03.356 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (103m) 4m ago 104m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:18:03.611 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:18:03 smithi132 bash[27079]: cluster 2020-07-16T15:18:02.825982+0000 mgr.x (mgr.34562) 4782 : cluster [DBG] pgmap v2981: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:18:03.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:18:03 smithi188 bash[23329]: cluster 2020-07-16T15:18:02.825982+0000 mgr.x (mgr.34562) 4782 : cluster [DBG] pgmap v2981: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:18:03.680 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:18:03.680 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:18:03.680 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:18:03.680 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:18:03.681 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:18:03.681 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:18:03.681 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:18:03.681 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:18:03.681 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:18:03.682 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:18:03.682 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:18:03.682 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:18:03.682 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:18:03.683 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:18:03.683 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:18:03.684 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:18:03.684 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:18:04.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:18:04 smithi132 bash[27079]: audit 2020-07-16T15:18:03.062221+0000 mgr.x (mgr.34562) 4783 : audit [DBG] from='client.28114 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:18:04.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:18:04 smithi132 bash[27079]: audit 2020-07-16T15:18:03.348082+0000 mgr.x (mgr.34562) 4784 : audit [DBG] from='client.28120 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:18:04.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:18:04 smithi132 bash[27079]: audit 2020-07-16T15:18:03.679361+0000 mon.c (mon.1) 345 : audit [DBG] from='client.? 172.21.15.132:0/4213446538' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:18:04.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:18:04 smithi132 bash[27079]: audit 2020-07-16T15:18:04.256766+0000 mon.b (mon.2) 1079 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:18:04.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:18:04 smithi188 bash[23329]: audit 2020-07-16T15:18:03.062221+0000 mgr.x (mgr.34562) 4783 : audit [DBG] from='client.28114 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:18:04.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:18:04 smithi188 bash[23329]: audit 2020-07-16T15:18:03.348082+0000 mgr.x (mgr.34562) 4784 : audit [DBG] from='client.28120 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:18:04.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:18:04 smithi188 bash[23329]: audit 2020-07-16T15:18:03.679361+0000 mon.c (mon.1) 345 : audit [DBG] from='client.? 172.21.15.132:0/4213446538' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:18:04.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:18:04 smithi188 bash[23329]: audit 2020-07-16T15:18:04.256766+0000 mon.b (mon.2) 1079 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:18:05.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:18:05 smithi188 bash[23329]: cephadm 2020-07-16T15:18:04.257442+0000 mgr.x (mgr.34562) 4785 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:18:05.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:18:05 smithi188 bash[23329]: cephadm 2020-07-16T15:18:04.257633+0000 mgr.x (mgr.34562) 4786 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:18:05.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:18:05 smithi188 bash[23329]: cluster 2020-07-16T15:18:04.826463+0000 mgr.x (mgr.34562) 4787 : cluster [DBG] pgmap v2982: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:18:05.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:18:05 smithi132 bash[27079]: cephadm 2020-07-16T15:18:04.257442+0000 mgr.x (mgr.34562) 4785 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:18:05.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:18:05 smithi132 bash[27079]: cephadm 2020-07-16T15:18:04.257633+0000 mgr.x (mgr.34562) 4786 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:18:05.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:18:05 smithi132 bash[27079]: cluster 2020-07-16T15:18:04.826463+0000 mgr.x (mgr.34562) 4787 : cluster [DBG] pgmap v2982: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:18:08.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:18:07 smithi188 bash[23329]: cluster 2020-07-16T15:18:06.826934+0000 mgr.x (mgr.34562) 4788 : cluster [DBG] pgmap v2983: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:18:08.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:18:07 smithi132 bash[27079]: cluster 2020-07-16T15:18:06.826934+0000 mgr.x (mgr.34562) 4788 : cluster [DBG] pgmap v2983: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:18:10.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:18:09 smithi188 bash[23329]: cluster 2020-07-16T15:18:08.827356+0000 mgr.x (mgr.34562) 4789 : cluster [DBG] pgmap v2984: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:18:10.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:18:09 smithi132 bash[27079]: cluster 2020-07-16T15:18:08.827356+0000 mgr.x (mgr.34562) 4789 : cluster [DBG] pgmap v2984: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:18:11.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:18:11 smithi188 bash[23329]: cluster 2020-07-16T15:18:10.827829+0000 mgr.x (mgr.34562) 4790 : cluster [DBG] pgmap v2985: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:18:11.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:18:11 smithi132 bash[27079]: cluster 2020-07-16T15:18:10.827829+0000 mgr.x (mgr.34562) 4790 : cluster [DBG] pgmap v2985: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:18:14.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:18:13 smithi188 bash[23329]: cluster 2020-07-16T15:18:12.828353+0000 mgr.x (mgr.34562) 4791 : cluster [DBG] pgmap v2986: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:18:14.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:18:13 smithi132 bash[27079]: cluster 2020-07-16T15:18:12.828353+0000 mgr.x (mgr.34562) 4791 : cluster [DBG] pgmap v2986: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:18:16.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:18:15 smithi188 bash[23329]: cluster 2020-07-16T15:18:14.828784+0000 mgr.x (mgr.34562) 4792 : cluster [DBG] pgmap v2987: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:18:16.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:18:15 smithi132 bash[27079]: cluster 2020-07-16T15:18:14.828784+0000 mgr.x (mgr.34562) 4792 : cluster [DBG] pgmap v2987: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:18:18.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:18:17 smithi188 bash[23329]: cluster 2020-07-16T15:18:16.829290+0000 mgr.x (mgr.34562) 4793 : cluster [DBG] pgmap v2988: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:18:18.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:18:17 smithi132 bash[27079]: cluster 2020-07-16T15:18:16.829290+0000 mgr.x (mgr.34562) 4793 : cluster [DBG] pgmap v2988: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:18:19.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:18:18 smithi132 bash[27079]: cluster 2020-07-16T15:18:18.829756+0000 mgr.x (mgr.34562) 4794 : cluster [DBG] pgmap v2989: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:18:19.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:18:18 smithi188 bash[23329]: cluster 2020-07-16T15:18:18.829756+0000 mgr.x (mgr.34562) 4794 : cluster [DBG] pgmap v2989: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:18:20.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:18:19 smithi132 bash[27079]: audit 2020-07-16T15:18:19.273401+0000 mon.b (mon.2) 1080 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:18:20.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:18:19 smithi132 bash[27079]: cephadm 2020-07-16T15:18:19.274109+0000 mgr.x (mgr.34562) 4795 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:18:20.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:18:19 smithi132 bash[27079]: cephadm 2020-07-16T15:18:19.274363+0000 mgr.x (mgr.34562) 4796 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:18:20.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:18:19 smithi188 bash[23329]: audit 2020-07-16T15:18:19.273401+0000 mon.b (mon.2) 1080 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:18:20.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:18:19 smithi188 bash[23329]: cephadm 2020-07-16T15:18:19.274109+0000 mgr.x (mgr.34562) 4795 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:18:20.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:18:19 smithi188 bash[23329]: cephadm 2020-07-16T15:18:19.274363+0000 mgr.x (mgr.34562) 4796 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:18:21.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:18:21 smithi188 bash[23329]: cluster 2020-07-16T15:18:20.830204+0000 mgr.x (mgr.34562) 4797 : cluster [DBG] pgmap v2990: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:18:21.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:18:21 smithi132 bash[27079]: cluster 2020-07-16T15:18:20.830204+0000 mgr.x (mgr.34562) 4797 : cluster [DBG] pgmap v2990: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:18:24.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:18:23 smithi188 bash[23329]: cluster 2020-07-16T15:18:22.830730+0000 mgr.x (mgr.34562) 4798 : cluster [DBG] pgmap v2991: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:18:24.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:18:23 smithi132 bash[27079]: cluster 2020-07-16T15:18:22.830730+0000 mgr.x (mgr.34562) 4798 : cluster [DBG] pgmap v2991: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:18:26.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:18:25 smithi188 bash[23329]: cluster 2020-07-16T15:18:24.831114+0000 mgr.x (mgr.34562) 4799 : cluster [DBG] pgmap v2992: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:18:26.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:18:25 smithi132 bash[27079]: cluster 2020-07-16T15:18:24.831114+0000 mgr.x (mgr.34562) 4799 : cluster [DBG] pgmap v2992: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:18:28.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:18:27 smithi188 bash[23329]: cluster 2020-07-16T15:18:26.831648+0000 mgr.x (mgr.34562) 4800 : cluster [DBG] pgmap v2993: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:18:28.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:18:27 smithi132 bash[27079]: cluster 2020-07-16T15:18:26.831648+0000 mgr.x (mgr.34562) 4800 : cluster [DBG] pgmap v2993: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:18:29.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:18:28 smithi188 bash[23329]: cluster 2020-07-16T15:18:28.831979+0000 mgr.x (mgr.34562) 4801 : cluster [DBG] pgmap v2994: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:18:29.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:18:28 smithi132 bash[27079]: cluster 2020-07-16T15:18:28.831979+0000 mgr.x (mgr.34562) 4801 : cluster [DBG] pgmap v2994: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:18:31.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:18:31 smithi188 bash[23329]: cluster 2020-07-16T15:18:30.832402+0000 mgr.x (mgr.34562) 4802 : cluster [DBG] pgmap v2995: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:18:31.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:18:31 smithi132 bash[27079]: cluster 2020-07-16T15:18:30.832402+0000 mgr.x (mgr.34562) 4802 : cluster [DBG] pgmap v2995: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:18:33.979 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:18:34.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:18:33 smithi188 bash[23329]: cluster 2020-07-16T15:18:32.832852+0000 mgr.x (mgr.34562) 4803 : cluster [DBG] pgmap v2996: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:18:34.240 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:18:34.240 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (101m) 4m ago 104m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:18:34.240 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (104m) 4m ago 104m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:18:34.240 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (101m) 4m ago 107m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:18:34.241 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (101m) 4m ago 108m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:18:34.241 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 4m ago 109m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:18:34.241 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (107m) 4m ago 107m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:18:34.241 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (107m) 4m ago 107m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:18:34.241 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (104m) 4m ago 104m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:18:34.242 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (104m) 4m ago 104m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:18:34.242 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (106m) 4m ago 106m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:18:34.242 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (106m) 4m ago 106m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:18:34.242 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (106m) 4m ago 106m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:18:34.242 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (106m) 4m ago 106m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:18:34.243 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (105m) 4m ago 105m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:18:34.243 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (105m) 4m ago 105m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:18:34.243 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (105m) 4m ago 105m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:18:34.243 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (104m) 4m ago 104m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:18:34.243 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (103m) 4m ago 104m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:18:34.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:18:33 smithi132 bash[27079]: cluster 2020-07-16T15:18:32.832852+0000 mgr.x (mgr.34562) 4803 : cluster [DBG] pgmap v2996: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:18:34.537 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:18:34.538 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:18:34.538 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:18:34.539 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:18:34.539 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:18:34.539 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:18:34.540 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:18:34.540 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:18:34.540 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:18:34.541 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:18:34.541 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:18:34.541 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:18:34.542 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:18:34.542 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:18:34.542 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:18:34.542 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:18:34.542 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:18:35.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:18:34 smithi188 bash[23329]: audit 2020-07-16T15:18:34.290102+0000 mon.b (mon.2) 1081 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:18:35.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:18:34 smithi188 bash[23329]: audit 2020-07-16T15:18:34.536677+0000 mon.c (mon.1) 346 : audit [DBG] from='client.? 172.21.15.132:0/2307308331' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:18:35.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:18:34 smithi132 bash[27079]: audit 2020-07-16T15:18:34.290102+0000 mon.b (mon.2) 1081 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:18:35.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:18:34 smithi132 bash[27079]: audit 2020-07-16T15:18:34.536677+0000 mon.c (mon.1) 346 : audit [DBG] from='client.? 172.21.15.132:0/2307308331' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:18:36.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:18:35 smithi188 bash[23329]: audit 2020-07-16T15:18:33.967518+0000 mgr.x (mgr.34562) 4804 : audit [DBG] from='client.28132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:18:36.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:18:35 smithi188 bash[23329]: audit 2020-07-16T15:18:34.235933+0000 mgr.x (mgr.34562) 4805 : audit [DBG] from='client.28138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:18:36.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:18:35 smithi188 bash[23329]: cephadm 2020-07-16T15:18:34.290699+0000 mgr.x (mgr.34562) 4806 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:18:36.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:18:35 smithi188 bash[23329]: cephadm 2020-07-16T15:18:34.291106+0000 mgr.x (mgr.34562) 4807 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:18:36.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:18:35 smithi188 bash[23329]: cluster 2020-07-16T15:18:34.833357+0000 mgr.x (mgr.34562) 4808 : cluster [DBG] pgmap v2997: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:18:36.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:18:35 smithi132 bash[27079]: audit 2020-07-16T15:18:33.967518+0000 mgr.x (mgr.34562) 4804 : audit [DBG] from='client.28132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:18:36.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:18:35 smithi132 bash[27079]: audit 2020-07-16T15:18:34.235933+0000 mgr.x (mgr.34562) 4805 : audit [DBG] from='client.28138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:18:36.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:18:35 smithi132 bash[27079]: cephadm 2020-07-16T15:18:34.290699+0000 mgr.x (mgr.34562) 4806 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:18:36.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:18:35 smithi132 bash[27079]: cephadm 2020-07-16T15:18:34.291106+0000 mgr.x (mgr.34562) 4807 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:18:36.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:18:35 smithi132 bash[27079]: cluster 2020-07-16T15:18:34.833357+0000 mgr.x (mgr.34562) 4808 : cluster [DBG] pgmap v2997: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:18:37.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:18:36 smithi188 bash[23329]: cluster 2020-07-16T15:18:36.833855+0000 mgr.x (mgr.34562) 4809 : cluster [DBG] pgmap v2998: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:18:37.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:18:36 smithi132 bash[27079]: cluster 2020-07-16T15:18:36.833855+0000 mgr.x (mgr.34562) 4809 : cluster [DBG] pgmap v2998: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:18:40.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:18:39 smithi188 bash[23329]: cluster 2020-07-16T15:18:38.834257+0000 mgr.x (mgr.34562) 4810 : cluster [DBG] pgmap v2999: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:18:40.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:18:39 smithi132 bash[27079]: cluster 2020-07-16T15:18:38.834257+0000 mgr.x (mgr.34562) 4810 : cluster [DBG] pgmap v2999: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:18:41.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:18:41 smithi188 bash[23329]: cluster 2020-07-16T15:18:40.834677+0000 mgr.x (mgr.34562) 4811 : cluster [DBG] pgmap v3000: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:18:41.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:18:41 smithi132 bash[27079]: cluster 2020-07-16T15:18:40.834677+0000 mgr.x (mgr.34562) 4811 : cluster [DBG] pgmap v3000: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:18:44.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:18:43 smithi188 bash[23329]: cluster 2020-07-16T15:18:42.835109+0000 mgr.x (mgr.34562) 4812 : cluster [DBG] pgmap v3001: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:18:44.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:18:43 smithi132 bash[27079]: cluster 2020-07-16T15:18:42.835109+0000 mgr.x (mgr.34562) 4812 : cluster [DBG] pgmap v3001: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:18:46.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:18:45 smithi188 bash[23329]: cluster 2020-07-16T15:18:44.835490+0000 mgr.x (mgr.34562) 4813 : cluster [DBG] pgmap v3002: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:18:46.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:18:45 smithi132 bash[27079]: cluster 2020-07-16T15:18:44.835490+0000 mgr.x (mgr.34562) 4813 : cluster [DBG] pgmap v3002: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:18:47.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:18:46 smithi132 bash[27079]: cluster 2020-07-16T15:18:46.836003+0000 mgr.x (mgr.34562) 4814 : cluster [DBG] pgmap v3003: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:18:47.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:18:46 smithi188 bash[23329]: cluster 2020-07-16T15:18:46.836003+0000 mgr.x (mgr.34562) 4814 : cluster [DBG] pgmap v3003: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:18:50.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:18:49 smithi188 bash[23329]: cluster 2020-07-16T15:18:48.836452+0000 mgr.x (mgr.34562) 4815 : cluster [DBG] pgmap v3004: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:18:50.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:18:49 smithi188 bash[23329]: audit 2020-07-16T15:18:49.306606+0000 mon.b (mon.2) 1082 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:18:50.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:18:49 smithi132 bash[27079]: cluster 2020-07-16T15:18:48.836452+0000 mgr.x (mgr.34562) 4815 : cluster [DBG] pgmap v3004: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:18:50.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:18:49 smithi132 bash[27079]: audit 2020-07-16T15:18:49.306606+0000 mon.b (mon.2) 1082 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:18:51.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:18:50 smithi188 bash[23329]: cephadm 2020-07-16T15:18:49.307323+0000 mgr.x (mgr.34562) 4816 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:18:51.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:18:50 smithi188 bash[23329]: cephadm 2020-07-16T15:18:49.307424+0000 mgr.x (mgr.34562) 4817 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:18:51.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:18:50 smithi132 bash[27079]: cephadm 2020-07-16T15:18:49.307323+0000 mgr.x (mgr.34562) 4816 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:18:51.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:18:50 smithi132 bash[27079]: cephadm 2020-07-16T15:18:49.307424+0000 mgr.x (mgr.34562) 4817 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:18:52.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:18:51 smithi188 bash[23329]: cluster 2020-07-16T15:18:50.836810+0000 mgr.x (mgr.34562) 4818 : cluster [DBG] pgmap v3005: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:18:52.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:18:51 smithi132 bash[27079]: cluster 2020-07-16T15:18:50.836810+0000 mgr.x (mgr.34562) 4818 : cluster [DBG] pgmap v3005: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:18:53.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:18:52 smithi132 bash[27079]: cluster 2020-07-16T15:18:52.837298+0000 mgr.x (mgr.34562) 4819 : cluster [DBG] pgmap v3006: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:18:53.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:18:52 smithi188 bash[23329]: cluster 2020-07-16T15:18:52.837298+0000 mgr.x (mgr.34562) 4819 : cluster [DBG] pgmap v3006: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:18:56.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:18:55 smithi188 bash[23329]: cluster 2020-07-16T15:18:54.837659+0000 mgr.x (mgr.34562) 4820 : cluster [DBG] pgmap v3007: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:18:56.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:18:55 smithi132 bash[27079]: cluster 2020-07-16T15:18:54.837659+0000 mgr.x (mgr.34562) 4820 : cluster [DBG] pgmap v3007: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:18:58.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:18:57 smithi188 bash[23329]: cluster 2020-07-16T15:18:56.838153+0000 mgr.x (mgr.34562) 4821 : cluster [DBG] pgmap v3008: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:18:58.295 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:18:57 smithi132 bash[27079]: cluster 2020-07-16T15:18:56.838153+0000 mgr.x (mgr.34562) 4821 : cluster [DBG] pgmap v3008: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:18:59.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:18:58 smithi188 bash[23329]: cluster 2020-07-16T15:18:58.838633+0000 mgr.x (mgr.34562) 4822 : cluster [DBG] pgmap v3009: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:18:59.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:18:58 smithi132 bash[27079]: cluster 2020-07-16T15:18:58.838633+0000 mgr.x (mgr.34562) 4822 : cluster [DBG] pgmap v3009: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:19:01.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:19:01 smithi188 bash[23329]: cluster 2020-07-16T15:19:00.839042+0000 mgr.x (mgr.34562) 4823 : cluster [DBG] pgmap v3010: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:19:01.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:19:01 smithi132 bash[27079]: cluster 2020-07-16T15:19:00.839042+0000 mgr.x (mgr.34562) 4823 : cluster [DBG] pgmap v3010: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:19:04.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:19:03 smithi188 bash[23329]: cluster 2020-07-16T15:19:02.839476+0000 mgr.x (mgr.34562) 4824 : cluster [DBG] pgmap v3011: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:19:04.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:19:03 smithi132 bash[27079]: cluster 2020-07-16T15:19:02.839476+0000 mgr.x (mgr.34562) 4824 : cluster [DBG] pgmap v3011: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:19:04.858 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:19:05.148 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:19:05.148 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (101m) 5m ago 104m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:19:05.148 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (104m) 5m ago 104m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:19:05.148 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (102m) 5m ago 107m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:19:05.149 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (101m) 5m ago 109m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:19:05.149 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 5m ago 109m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:19:05.149 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (107m) 5m ago 107m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:19:05.149 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (108m) 5m ago 108m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:19:05.149 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (105m) 5m ago 105m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:19:05.150 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (105m) 5m ago 105m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:19:05.150 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (107m) 5m ago 107m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:19:05.150 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (107m) 5m ago 107m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:19:05.150 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (106m) 5m ago 106m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:19:05.150 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (106m) 5m ago 106m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:19:05.151 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (106m) 5m ago 106m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:19:05.151 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (106m) 5m ago 106m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:19:05.151 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (105m) 5m ago 105m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:19:05.151 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (105m) 5m ago 105m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:19:05.151 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (104m) 5m ago 105m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:19:05.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:19:04 smithi188 bash[23329]: audit 2020-07-16T15:19:04.326135+0000 mon.b (mon.2) 1083 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:19:05.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:19:04 smithi188 bash[23329]: audit 2020-07-16T15:19:04.327569+0000 mon.b (mon.2) 1084 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:19:05.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:19:04 smithi188 bash[23329]: audit 2020-07-16T15:19:04.328760+0000 mon.b (mon.2) 1085 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:19:05.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:19:04 smithi188 bash[23329]: audit 2020-07-16T15:19:04.330245+0000 mon.b (mon.2) 1086 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:19:05.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:19:04 smithi188 bash[23329]: audit 2020-07-16T15:19:04.331428+0000 mon.b (mon.2) 1087 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:19:05.234 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:19:04 smithi132 bash[27079]: audit 2020-07-16T15:19:04.326135+0000 mon.b (mon.2) 1083 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:19:05.235 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:19:04 smithi132 bash[27079]: audit 2020-07-16T15:19:04.327569+0000 mon.b (mon.2) 1084 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:19:05.235 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:19:04 smithi132 bash[27079]: audit 2020-07-16T15:19:04.328760+0000 mon.b (mon.2) 1085 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:19:05.235 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:19:04 smithi132 bash[27079]: audit 2020-07-16T15:19:04.330245+0000 mon.b (mon.2) 1086 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:19:05.236 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:19:04 smithi132 bash[27079]: audit 2020-07-16T15:19:04.331428+0000 mon.b (mon.2) 1087 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:19:05.475 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:19:05.476 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:19:05.476 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:19:05.476 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:19:05.476 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:19:05.476 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:19:05.477 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:19:05.477 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:19:05.477 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:19:05.477 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:19:05.477 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:19:05.478 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:19:05.478 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:19:05.478 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:19:05.478 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:19:05.478 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:19:05.479 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:19:06.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:19:05 smithi188 bash[23329]: audit 2020-07-16T15:19:04.326524+0000 mgr.x (mgr.34562) 4825 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:19:06.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:19:05 smithi188 bash[23329]: audit 2020-07-16T15:19:04.327878+0000 mgr.x (mgr.34562) 4826 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:19:06.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:19:05 smithi188 bash[23329]: audit 2020-07-16T15:19:04.329075+0000 mgr.x (mgr.34562) 4827 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:19:06.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:19:05 smithi188 bash[23329]: cephadm 2020-07-16T15:19:04.329802+0000 mgr.x (mgr.34562) 4828 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:19:06.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:19:05 smithi188 bash[23329]: cephadm 2020-07-16T15:19:04.331088+0000 mgr.x (mgr.34562) 4829 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:19:06.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:19:05 smithi188 bash[23329]: cephadm 2020-07-16T15:19:04.332122+0000 mgr.x (mgr.34562) 4830 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:19:06.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:19:05 smithi188 bash[23329]: cephadm 2020-07-16T15:19:04.332408+0000 mgr.x (mgr.34562) 4831 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:19:06.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:19:05 smithi188 bash[23329]: cluster 2020-07-16T15:19:04.839990+0000 mgr.x (mgr.34562) 4832 : cluster [DBG] pgmap v3012: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:19:06.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:19:05 smithi188 bash[23329]: audit 2020-07-16T15:19:04.845323+0000 mgr.x (mgr.34562) 4833 : audit [DBG] from='client.28150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:19:06.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:19:05 smithi188 bash[23329]: audit 2020-07-16T15:19:05.143786+0000 mgr.x (mgr.34562) 4834 : audit [DBG] from='client.28156 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:19:06.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:19:05 smithi188 bash[23329]: audit 2020-07-16T15:19:05.474293+0000 mon.c (mon.1) 347 : audit [DBG] from='client.? 172.21.15.132:0/1554241544' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:19:06.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:19:05 smithi132 bash[27079]: audit 2020-07-16T15:19:04.326524+0000 mgr.x (mgr.34562) 4825 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:19:06.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:19:05 smithi132 bash[27079]: audit 2020-07-16T15:19:04.327878+0000 mgr.x (mgr.34562) 4826 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:19:06.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:19:05 smithi132 bash[27079]: audit 2020-07-16T15:19:04.329075+0000 mgr.x (mgr.34562) 4827 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:19:06.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:19:05 smithi132 bash[27079]: cephadm 2020-07-16T15:19:04.329802+0000 mgr.x (mgr.34562) 4828 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:19:06.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:19:05 smithi132 bash[27079]: cephadm 2020-07-16T15:19:04.331088+0000 mgr.x (mgr.34562) 4829 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:19:06.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:19:05 smithi132 bash[27079]: cephadm 2020-07-16T15:19:04.332122+0000 mgr.x (mgr.34562) 4830 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:19:06.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:19:05 smithi132 bash[27079]: cephadm 2020-07-16T15:19:04.332408+0000 mgr.x (mgr.34562) 4831 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:19:06.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:19:05 smithi132 bash[27079]: cluster 2020-07-16T15:19:04.839990+0000 mgr.x (mgr.34562) 4832 : cluster [DBG] pgmap v3012: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:19:06.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:19:05 smithi132 bash[27079]: audit 2020-07-16T15:19:04.845323+0000 mgr.x (mgr.34562) 4833 : audit [DBG] from='client.28150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:19:06.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:19:05 smithi132 bash[27079]: audit 2020-07-16T15:19:05.143786+0000 mgr.x (mgr.34562) 4834 : audit [DBG] from='client.28156 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:19:06.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:19:05 smithi132 bash[27079]: audit 2020-07-16T15:19:05.474293+0000 mon.c (mon.1) 347 : audit [DBG] from='client.? 172.21.15.132:0/1554241544' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:19:07.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:19:06 smithi132 bash[27079]: cluster 2020-07-16T15:19:06.840372+0000 mgr.x (mgr.34562) 4835 : cluster [DBG] pgmap v3013: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:19:07.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:19:06 smithi188 bash[23329]: cluster 2020-07-16T15:19:06.840372+0000 mgr.x (mgr.34562) 4835 : cluster [DBG] pgmap v3013: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:19:08.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:19:07 smithi188 bash[23329]: audit 2020-07-16T15:19:07.400320+0000 mon.b (mon.2) 1088 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:19:08.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:19:07 smithi188 bash[23329]: cephadm 2020-07-16T15:19:07.400944+0000 mgr.x (mgr.34562) 4836 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:19:08.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:19:07 smithi188 bash[23329]: cephadm 2020-07-16T15:19:07.401360+0000 mgr.x (mgr.34562) 4837 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:19:08.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:19:07 smithi132 bash[27079]: audit 2020-07-16T15:19:07.400320+0000 mon.b (mon.2) 1088 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:19:08.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:19:07 smithi132 bash[27079]: cephadm 2020-07-16T15:19:07.400944+0000 mgr.x (mgr.34562) 4836 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:19:08.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:19:07 smithi132 bash[27079]: cephadm 2020-07-16T15:19:07.401360+0000 mgr.x (mgr.34562) 4837 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:19:09.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:19:08 smithi188 bash[23329]: cluster 2020-07-16T15:19:08.840712+0000 mgr.x (mgr.34562) 4838 : cluster [DBG] pgmap v3014: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:19:09.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:19:08 smithi132 bash[27079]: cluster 2020-07-16T15:19:08.840712+0000 mgr.x (mgr.34562) 4838 : cluster [DBG] pgmap v3014: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:19:11.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:19:11 smithi188 bash[23329]: cluster 2020-07-16T15:19:10.841080+0000 mgr.x (mgr.34562) 4839 : cluster [DBG] pgmap v3015: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:19:11.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:19:11 smithi132 bash[27079]: cluster 2020-07-16T15:19:10.841080+0000 mgr.x (mgr.34562) 4839 : cluster [DBG] pgmap v3015: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:19:14.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:19:13 smithi188 bash[23329]: cluster 2020-07-16T15:19:12.841566+0000 mgr.x (mgr.34562) 4840 : cluster [DBG] pgmap v3016: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:19:14.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:19:13 smithi132 bash[27079]: cluster 2020-07-16T15:19:12.841566+0000 mgr.x (mgr.34562) 4840 : cluster [DBG] pgmap v3016: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:19:16.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:19:15 smithi188 bash[23329]: cluster 2020-07-16T15:19:14.842090+0000 mgr.x (mgr.34562) 4841 : cluster [DBG] pgmap v3017: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:19:16.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:19:15 smithi132 bash[27079]: cluster 2020-07-16T15:19:14.842090+0000 mgr.x (mgr.34562) 4841 : cluster [DBG] pgmap v3017: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:19:17.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:19:16 smithi188 bash[23329]: cluster 2020-07-16T15:19:16.842561+0000 mgr.x (mgr.34562) 4842 : cluster [DBG] pgmap v3018: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:19:17.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:19:16 smithi132 bash[27079]: cluster 2020-07-16T15:19:16.842561+0000 mgr.x (mgr.34562) 4842 : cluster [DBG] pgmap v3018: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:19:20.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:19:19 smithi188 bash[23329]: cluster 2020-07-16T15:19:18.843061+0000 mgr.x (mgr.34562) 4843 : cluster [DBG] pgmap v3019: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:19:20.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:19:19 smithi132 bash[27079]: cluster 2020-07-16T15:19:18.843061+0000 mgr.x (mgr.34562) 4843 : cluster [DBG] pgmap v3019: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:19:21.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:19:21 smithi188 bash[23329]: cluster 2020-07-16T15:19:20.843615+0000 mgr.x (mgr.34562) 4844 : cluster [DBG] pgmap v3020: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:19:21.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:19:21 smithi132 bash[27079]: cluster 2020-07-16T15:19:20.843615+0000 mgr.x (mgr.34562) 4844 : cluster [DBG] pgmap v3020: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:19:22.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:19:22 smithi132 bash[27079]: audit 2020-07-16T15:19:22.416893+0000 mon.b (mon.2) 1089 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:19:22.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:19:22 smithi188 bash[23329]: audit 2020-07-16T15:19:22.416893+0000 mon.b (mon.2) 1089 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:19:23.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:19:23 smithi132 bash[27079]: cephadm 2020-07-16T15:19:22.417615+0000 mgr.x (mgr.34562) 4845 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:19:23.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:19:23 smithi132 bash[27079]: cephadm 2020-07-16T15:19:22.417735+0000 mgr.x (mgr.34562) 4846 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:19:23.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:19:23 smithi132 bash[27079]: cluster 2020-07-16T15:19:22.844140+0000 mgr.x (mgr.34562) 4847 : cluster [DBG] pgmap v3021: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:19:23.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:19:23 smithi188 bash[23329]: cephadm 2020-07-16T15:19:22.417615+0000 mgr.x (mgr.34562) 4845 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:19:23.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:19:23 smithi188 bash[23329]: cephadm 2020-07-16T15:19:22.417735+0000 mgr.x (mgr.34562) 4846 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:19:23.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:19:23 smithi188 bash[23329]: cluster 2020-07-16T15:19:22.844140+0000 mgr.x (mgr.34562) 4847 : cluster [DBG] pgmap v3021: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:19:26.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:19:25 smithi188 bash[23329]: cluster 2020-07-16T15:19:24.844566+0000 mgr.x (mgr.34562) 4848 : cluster [DBG] pgmap v3022: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:19:26.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:19:25 smithi132 bash[27079]: cluster 2020-07-16T15:19:24.844566+0000 mgr.x (mgr.34562) 4848 : cluster [DBG] pgmap v3022: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:19:27.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:19:26 smithi132 bash[27079]: cluster 2020-07-16T15:19:26.844940+0000 mgr.x (mgr.34562) 4849 : cluster [DBG] pgmap v3023: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:19:27.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:19:26 smithi188 bash[23329]: cluster 2020-07-16T15:19:26.844940+0000 mgr.x (mgr.34562) 4849 : cluster [DBG] pgmap v3023: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:19:30.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:19:29 smithi188 bash[23329]: cluster 2020-07-16T15:19:28.845450+0000 mgr.x (mgr.34562) 4850 : cluster [DBG] pgmap v3024: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:19:30.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:19:29 smithi132 bash[27079]: cluster 2020-07-16T15:19:28.845450+0000 mgr.x (mgr.34562) 4850 : cluster [DBG] pgmap v3024: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:19:31.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:19:31 smithi188 bash[23329]: cluster 2020-07-16T15:19:30.845827+0000 mgr.x (mgr.34562) 4851 : cluster [DBG] pgmap v3025: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:19:31.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:19:31 smithi132 bash[27079]: cluster 2020-07-16T15:19:30.845827+0000 mgr.x (mgr.34562) 4851 : cluster [DBG] pgmap v3025: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:19:34.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:19:33 smithi188 bash[23329]: cluster 2020-07-16T15:19:32.846218+0000 mgr.x (mgr.34562) 4852 : cluster [DBG] pgmap v3026: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:19:34.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:19:33 smithi132 bash[27079]: cluster 2020-07-16T15:19:32.846218+0000 mgr.x (mgr.34562) 4852 : cluster [DBG] pgmap v3026: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:19:35.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:19:34 smithi132 bash[27079]: cluster 2020-07-16T15:19:34.846607+0000 mgr.x (mgr.34562) 4853 : cluster [DBG] pgmap v3027: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:19:35.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:19:34 smithi188 bash[23329]: cluster 2020-07-16T15:19:34.846607+0000 mgr.x (mgr.34562) 4853 : cluster [DBG] pgmap v3027: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:19:35.771 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:19:36.033 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:19:36.034 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (102m) 5m ago 105m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:19:36.034 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (105m) 5m ago 105m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:19:36.034 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (102m) 5m ago 108m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:19:36.034 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (102m) 5m ago 109m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:19:36.034 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 5m ago 110m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:19:36.035 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (108m) 5m ago 108m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:19:36.035 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (108m) 5m ago 108m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:19:36.035 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (105m) 5m ago 105m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:19:36.035 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (105m) 5m ago 105m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:19:36.035 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (107m) 5m ago 107m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:19:36.036 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (107m) 5m ago 107m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:19:36.036 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (107m) 5m ago 107m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:19:36.036 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (107m) 5m ago 107m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:19:36.036 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (106m) 5m ago 106m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:19:36.036 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (106m) 5m ago 106m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:19:36.037 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (106m) 5m ago 106m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:19:36.037 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (105m) 5m ago 105m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:19:36.037 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (104m) 5m ago 105m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:19:36.332 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:19:36.332 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:19:36.332 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:19:36.332 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:19:36.333 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:19:36.333 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:19:36.333 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:19:36.333 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:19:36.333 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:19:36.334 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:19:36.334 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:19:36.334 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:19:36.334 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:19:36.334 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:19:36.334 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:19:36.335 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:19:36.335 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:19:36.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:19:36 smithi188 bash[23329]: audit 2020-07-16T15:19:35.759271+0000 mgr.x (mgr.34562) 4854 : audit [DBG] from='client.28168 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:19:36.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:19:36 smithi132 bash[27079]: audit 2020-07-16T15:19:35.759271+0000 mgr.x (mgr.34562) 4854 : audit [DBG] from='client.28168 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:19:37.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:19:37 smithi188 bash[23329]: audit 2020-07-16T15:19:36.029344+0000 mgr.x (mgr.34562) 4855 : audit [DBG] from='client.28174 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:19:37.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:19:37 smithi188 bash[23329]: audit 2020-07-16T15:19:36.331271+0000 mon.c (mon.1) 348 : audit [DBG] from='client.? 172.21.15.132:0/2887459557' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:19:37.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:19:37 smithi188 bash[23329]: cluster 2020-07-16T15:19:36.846980+0000 mgr.x (mgr.34562) 4856 : cluster [DBG] pgmap v3028: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:19:37.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:19:37 smithi132 bash[27079]: audit 2020-07-16T15:19:36.029344+0000 mgr.x (mgr.34562) 4855 : audit [DBG] from='client.28174 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:19:37.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:19:37 smithi132 bash[27079]: audit 2020-07-16T15:19:36.331271+0000 mon.c (mon.1) 348 : audit [DBG] from='client.? 172.21.15.132:0/2887459557' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:19:37.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:19:37 smithi132 bash[27079]: cluster 2020-07-16T15:19:36.846980+0000 mgr.x (mgr.34562) 4856 : cluster [DBG] pgmap v3028: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:19:38.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:19:38 smithi188 bash[23329]: audit 2020-07-16T15:19:37.433310+0000 mon.b (mon.2) 1090 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:19:38.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:19:38 smithi188 bash[23329]: cephadm 2020-07-16T15:19:37.434019+0000 mgr.x (mgr.34562) 4857 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:19:38.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:19:38 smithi188 bash[23329]: cephadm 2020-07-16T15:19:37.434411+0000 mgr.x (mgr.34562) 4858 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:19:38.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:19:38 smithi132 bash[27079]: audit 2020-07-16T15:19:37.433310+0000 mon.b (mon.2) 1090 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:19:38.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:19:38 smithi132 bash[27079]: cephadm 2020-07-16T15:19:37.434019+0000 mgr.x (mgr.34562) 4857 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:19:38.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:19:38 smithi132 bash[27079]: cephadm 2020-07-16T15:19:37.434411+0000 mgr.x (mgr.34562) 4858 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:19:39.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:19:39 smithi188 bash[23329]: cluster 2020-07-16T15:19:38.847402+0000 mgr.x (mgr.34562) 4859 : cluster [DBG] pgmap v3029: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:19:39.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:19:39 smithi132 bash[27079]: cluster 2020-07-16T15:19:38.847402+0000 mgr.x (mgr.34562) 4859 : cluster [DBG] pgmap v3029: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:19:41.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:19:41 smithi188 bash[23329]: cluster 2020-07-16T15:19:40.847909+0000 mgr.x (mgr.34562) 4860 : cluster [DBG] pgmap v3030: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:19:41.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:19:41 smithi132 bash[27079]: cluster 2020-07-16T15:19:40.847909+0000 mgr.x (mgr.34562) 4860 : cluster [DBG] pgmap v3030: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:19:44.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:19:43 smithi188 bash[23329]: cluster 2020-07-16T15:19:42.848459+0000 mgr.x (mgr.34562) 4861 : cluster [DBG] pgmap v3031: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:19:44.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:19:43 smithi132 bash[27079]: cluster 2020-07-16T15:19:42.848459+0000 mgr.x (mgr.34562) 4861 : cluster [DBG] pgmap v3031: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:19:45.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:19:44 smithi132 bash[27079]: cluster 2020-07-16T15:19:44.848836+0000 mgr.x (mgr.34562) 4862 : cluster [DBG] pgmap v3032: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:19:45.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:19:44 smithi188 bash[23329]: cluster 2020-07-16T15:19:44.848836+0000 mgr.x (mgr.34562) 4862 : cluster [DBG] pgmap v3032: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:19:48.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:19:47 smithi188 bash[23329]: cluster 2020-07-16T15:19:46.849389+0000 mgr.x (mgr.34562) 4863 : cluster [DBG] pgmap v3033: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:19:48.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:19:47 smithi132 bash[27079]: cluster 2020-07-16T15:19:46.849389+0000 mgr.x (mgr.34562) 4863 : cluster [DBG] pgmap v3033: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:19:49.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:19:48 smithi188 bash[23329]: cluster 2020-07-16T15:19:48.849753+0000 mgr.x (mgr.34562) 4864 : cluster [DBG] pgmap v3034: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:19:49.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:19:48 smithi132 bash[27079]: cluster 2020-07-16T15:19:48.849753+0000 mgr.x (mgr.34562) 4864 : cluster [DBG] pgmap v3034: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:19:51.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:19:51 smithi188 bash[23329]: cluster 2020-07-16T15:19:50.850300+0000 mgr.x (mgr.34562) 4865 : cluster [DBG] pgmap v3035: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:19:51.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:19:51 smithi132 bash[27079]: cluster 2020-07-16T15:19:50.850300+0000 mgr.x (mgr.34562) 4865 : cluster [DBG] pgmap v3035: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:19:52.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:19:52 smithi132 bash[27079]: audit 2020-07-16T15:19:52.450040+0000 mon.b (mon.2) 1091 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:19:52.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:19:52 smithi188 bash[23329]: audit 2020-07-16T15:19:52.450040+0000 mon.b (mon.2) 1091 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:19:53.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:19:53 smithi132 bash[27079]: cephadm 2020-07-16T15:19:52.450793+0000 mgr.x (mgr.34562) 4866 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:19:53.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:19:53 smithi132 bash[27079]: cephadm 2020-07-16T15:19:52.451198+0000 mgr.x (mgr.34562) 4867 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:19:53.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:19:53 smithi132 bash[27079]: cluster 2020-07-16T15:19:52.850743+0000 mgr.x (mgr.34562) 4868 : cluster [DBG] pgmap v3036: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:19:53.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:19:53 smithi188 bash[23329]: cephadm 2020-07-16T15:19:52.450793+0000 mgr.x (mgr.34562) 4866 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:19:53.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:19:53 smithi188 bash[23329]: cephadm 2020-07-16T15:19:52.451198+0000 mgr.x (mgr.34562) 4867 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:19:53.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:19:53 smithi188 bash[23329]: cluster 2020-07-16T15:19:52.850743+0000 mgr.x (mgr.34562) 4868 : cluster [DBG] pgmap v3036: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:19:56.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:19:55 smithi188 bash[23329]: cluster 2020-07-16T15:19:54.851126+0000 mgr.x (mgr.34562) 4869 : cluster [DBG] pgmap v3037: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:19:56.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:19:55 smithi132 bash[27079]: cluster 2020-07-16T15:19:54.851126+0000 mgr.x (mgr.34562) 4869 : cluster [DBG] pgmap v3037: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:19:57.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:19:56 smithi132 bash[27079]: cluster 2020-07-16T15:19:56.851522+0000 mgr.x (mgr.34562) 4870 : cluster [DBG] pgmap v3038: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:19:57.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:19:56 smithi188 bash[23329]: cluster 2020-07-16T15:19:56.851522+0000 mgr.x (mgr.34562) 4870 : cluster [DBG] pgmap v3038: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:20:00.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:19:59 smithi188 bash[23329]: cluster 2020-07-16T15:19:58.851918+0000 mgr.x (mgr.34562) 4871 : cluster [DBG] pgmap v3039: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:20:00.289 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:19:59 smithi132 bash[27079]: cluster 2020-07-16T15:19:58.851918+0000 mgr.x (mgr.34562) 4871 : cluster [DBG] pgmap v3039: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:20:01.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:20:01 smithi188 bash[23329]: cluster 2020-07-16T15:20:00.852379+0000 mgr.x (mgr.34562) 4872 : cluster [DBG] pgmap v3040: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:20:01.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:20:01 smithi132 bash[27079]: cluster 2020-07-16T15:20:00.852379+0000 mgr.x (mgr.34562) 4872 : cluster [DBG] pgmap v3040: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:20:04.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:20:03 smithi188 bash[23329]: cluster 2020-07-16T15:20:02.852748+0000 mgr.x (mgr.34562) 4873 : cluster [DBG] pgmap v3041: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:20:04.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:20:03 smithi132 bash[27079]: cluster 2020-07-16T15:20:02.852748+0000 mgr.x (mgr.34562) 4873 : cluster [DBG] pgmap v3041: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:20:05.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:20:04 smithi188 bash[23329]: cluster 2020-07-16T15:20:04.853072+0000 mgr.x (mgr.34562) 4874 : cluster [DBG] pgmap v3042: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:20:05.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:20:04 smithi132 bash[27079]: cluster 2020-07-16T15:20:04.853072+0000 mgr.x (mgr.34562) 4874 : cluster [DBG] pgmap v3042: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:20:06.629 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:20:06.893 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:20:06.893 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (102m) 6m ago 105m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:20:06.893 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (105m) 6m ago 105m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:20:06.894 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (103m) 6m ago 108m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:20:06.894 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (102m) 6m ago 110m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:20:06.894 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 6m ago 110m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:20:06.894 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (108m) 6m ago 108m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:20:06.894 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (109m) 6m ago 109m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:20:06.895 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (106m) 6m ago 106m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:20:06.895 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (106m) 6m ago 106m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:20:06.895 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (108m) 6m ago 108m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:20:06.895 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (108m) 6m ago 108m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:20:06.895 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (107m) 6m ago 107m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:20:06.896 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (107m) 6m ago 107m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:20:06.896 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (107m) 6m ago 107m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:20:06.896 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (107m) 6m ago 107m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:20:06.896 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (106m) 6m ago 106m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:20:06.896 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (106m) 6m ago 106m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:20:06.896 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (105m) 6m ago 106m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:20:07.194 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:20:07.195 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:20:07.195 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:20:07.195 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:20:07.195 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:20:07.196 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:20:07.196 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:20:07.196 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:20:07.196 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:20:07.196 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:20:07.196 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:20:07.197 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:20:07.197 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:20:07.197 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:20:07.197 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:20:07.197 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:20:07.198 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:20:08.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:20:07 smithi188 bash[23329]: audit 2020-07-16T15:20:06.617956+0000 mgr.x (mgr.34562) 4875 : audit [DBG] from='client.28186 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:20:08.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:20:07 smithi188 bash[23329]: cluster 2020-07-16T15:20:06.853560+0000 mgr.x (mgr.34562) 4876 : cluster [DBG] pgmap v3043: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:20:08.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:20:07 smithi188 bash[23329]: audit 2020-07-16T15:20:06.889015+0000 mgr.x (mgr.34562) 4877 : audit [DBG] from='client.28192 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:20:08.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:20:07 smithi188 bash[23329]: audit 2020-07-16T15:20:07.193998+0000 mon.c (mon.1) 349 : audit [DBG] from='client.? 172.21.15.132:0/1441929845' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:20:08.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:20:07 smithi188 bash[23329]: audit 2020-07-16T15:20:07.469776+0000 mon.b (mon.2) 1092 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:20:08.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:20:07 smithi188 bash[23329]: audit 2020-07-16T15:20:07.471151+0000 mon.b (mon.2) 1093 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:20:08.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:20:07 smithi188 bash[23329]: audit 2020-07-16T15:20:07.472262+0000 mon.b (mon.2) 1094 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:20:08.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:20:07 smithi188 bash[23329]: audit 2020-07-16T15:20:07.473785+0000 mon.b (mon.2) 1095 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:20:08.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:20:07 smithi188 bash[23329]: audit 2020-07-16T15:20:07.475112+0000 mon.b (mon.2) 1096 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:20:08.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:20:07 smithi132 bash[27079]: audit 2020-07-16T15:20:06.617956+0000 mgr.x (mgr.34562) 4875 : audit [DBG] from='client.28186 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:20:08.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:20:07 smithi132 bash[27079]: cluster 2020-07-16T15:20:06.853560+0000 mgr.x (mgr.34562) 4876 : cluster [DBG] pgmap v3043: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:20:08.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:20:07 smithi132 bash[27079]: audit 2020-07-16T15:20:06.889015+0000 mgr.x (mgr.34562) 4877 : audit [DBG] from='client.28192 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:20:08.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:20:07 smithi132 bash[27079]: audit 2020-07-16T15:20:07.193998+0000 mon.c (mon.1) 349 : audit [DBG] from='client.? 172.21.15.132:0/1441929845' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:20:08.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:20:07 smithi132 bash[27079]: audit 2020-07-16T15:20:07.469776+0000 mon.b (mon.2) 1092 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:20:08.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:20:07 smithi132 bash[27079]: audit 2020-07-16T15:20:07.471151+0000 mon.b (mon.2) 1093 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:20:08.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:20:07 smithi132 bash[27079]: audit 2020-07-16T15:20:07.472262+0000 mon.b (mon.2) 1094 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:20:08.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:20:07 smithi132 bash[27079]: audit 2020-07-16T15:20:07.473785+0000 mon.b (mon.2) 1095 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:20:08.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:20:07 smithi132 bash[27079]: audit 2020-07-16T15:20:07.475112+0000 mon.b (mon.2) 1096 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:20:09.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:20:08 smithi188 bash[23329]: audit 2020-07-16T15:20:07.470133+0000 mgr.x (mgr.34562) 4878 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:20:09.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:20:08 smithi188 bash[23329]: audit 2020-07-16T15:20:07.471455+0000 mgr.x (mgr.34562) 4879 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:20:09.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:20:08 smithi188 bash[23329]: audit 2020-07-16T15:20:07.472580+0000 mgr.x (mgr.34562) 4880 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:20:09.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:20:08 smithi188 bash[23329]: cephadm 2020-07-16T15:20:07.473325+0000 mgr.x (mgr.34562) 4881 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:20:09.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:20:08 smithi188 bash[23329]: cephadm 2020-07-16T15:20:07.474738+0000 mgr.x (mgr.34562) 4882 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:20:09.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:20:08 smithi188 bash[23329]: cephadm 2020-07-16T15:20:07.475811+0000 mgr.x (mgr.34562) 4883 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:20:09.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:20:08 smithi188 bash[23329]: cephadm 2020-07-16T15:20:07.475894+0000 mgr.x (mgr.34562) 4884 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:20:09.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:20:08 smithi188 bash[23329]: cluster 2020-07-16T15:20:08.854072+0000 mgr.x (mgr.34562) 4885 : cluster [DBG] pgmap v3044: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:20:09.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:20:08 smithi132 bash[27079]: audit 2020-07-16T15:20:07.470133+0000 mgr.x (mgr.34562) 4878 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:20:09.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:20:08 smithi132 bash[27079]: audit 2020-07-16T15:20:07.471455+0000 mgr.x (mgr.34562) 4879 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:20:09.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:20:08 smithi132 bash[27079]: audit 2020-07-16T15:20:07.472580+0000 mgr.x (mgr.34562) 4880 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:20:09.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:20:08 smithi132 bash[27079]: cephadm 2020-07-16T15:20:07.473325+0000 mgr.x (mgr.34562) 4881 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:20:09.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:20:08 smithi132 bash[27079]: cephadm 2020-07-16T15:20:07.474738+0000 mgr.x (mgr.34562) 4882 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:20:09.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:20:08 smithi132 bash[27079]: cephadm 2020-07-16T15:20:07.475811+0000 mgr.x (mgr.34562) 4883 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:20:09.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:20:08 smithi132 bash[27079]: cephadm 2020-07-16T15:20:07.475894+0000 mgr.x (mgr.34562) 4884 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:20:09.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:20:08 smithi132 bash[27079]: cluster 2020-07-16T15:20:08.854072+0000 mgr.x (mgr.34562) 4885 : cluster [DBG] pgmap v3044: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:20:11.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:20:11 smithi188 bash[23329]: audit 2020-07-16T15:20:10.469666+0000 mon.b (mon.2) 1097 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:20:11.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:20:11 smithi188 bash[23329]: cephadm 2020-07-16T15:20:10.470295+0000 mgr.x (mgr.34562) 4886 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:20:11.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:20:11 smithi188 bash[23329]: cephadm 2020-07-16T15:20:10.470704+0000 mgr.x (mgr.34562) 4887 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:20:11.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:20:11 smithi188 bash[23329]: cluster 2020-07-16T15:20:10.854442+0000 mgr.x (mgr.34562) 4888 : cluster [DBG] pgmap v3045: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:20:11.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:20:11 smithi132 bash[27079]: audit 2020-07-16T15:20:10.469666+0000 mon.b (mon.2) 1097 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:20:11.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:20:11 smithi132 bash[27079]: cephadm 2020-07-16T15:20:10.470295+0000 mgr.x (mgr.34562) 4886 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:20:11.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:20:11 smithi132 bash[27079]: cephadm 2020-07-16T15:20:10.470704+0000 mgr.x (mgr.34562) 4887 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:20:11.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:20:11 smithi132 bash[27079]: cluster 2020-07-16T15:20:10.854442+0000 mgr.x (mgr.34562) 4888 : cluster [DBG] pgmap v3045: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:20:14.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:20:13 smithi188 bash[23329]: cluster 2020-07-16T15:20:12.854967+0000 mgr.x (mgr.34562) 4889 : cluster [DBG] pgmap v3046: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:20:14.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:20:13 smithi132 bash[27079]: cluster 2020-07-16T15:20:12.854967+0000 mgr.x (mgr.34562) 4889 : cluster [DBG] pgmap v3046: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:20:15.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:20:14 smithi188 bash[23329]: cluster 2020-07-16T15:20:14.855562+0000 mgr.x (mgr.34562) 4890 : cluster [DBG] pgmap v3047: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:20:15.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:20:14 smithi132 bash[27079]: cluster 2020-07-16T15:20:14.855562+0000 mgr.x (mgr.34562) 4890 : cluster [DBG] pgmap v3047: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:20:17.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:20:16 smithi132 bash[27079]: cluster 2020-07-16T15:20:16.856074+0000 mgr.x (mgr.34562) 4891 : cluster [DBG] pgmap v3048: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:20:17.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:20:16 smithi188 bash[23329]: cluster 2020-07-16T15:20:16.856074+0000 mgr.x (mgr.34562) 4891 : cluster [DBG] pgmap v3048: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:20:19.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:20:18 smithi132 bash[27079]: cluster 2020-07-16T15:20:18.856680+0000 mgr.x (mgr.34562) 4892 : cluster [DBG] pgmap v3049: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:20:19.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:20:18 smithi188 bash[23329]: cluster 2020-07-16T15:20:18.856680+0000 mgr.x (mgr.34562) 4892 : cluster [DBG] pgmap v3049: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:20:21.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:20:21 smithi188 bash[23329]: cluster 2020-07-16T15:20:20.857213+0000 mgr.x (mgr.34562) 4893 : cluster [DBG] pgmap v3050: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:20:22.677 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:20:21 smithi132 bash[27079]: cluster 2020-07-16T15:20:20.857213+0000 mgr.x (mgr.34562) 4893 : cluster [DBG] pgmap v3050: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:20:23.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:20:22 smithi132 bash[27079]: cluster 2020-07-16T15:20:22.857552+0000 mgr.x (mgr.34562) 4894 : cluster [DBG] pgmap v3051: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:20:23.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:20:22 smithi188 bash[23329]: cluster 2020-07-16T15:20:22.857552+0000 mgr.x (mgr.34562) 4894 : cluster [DBG] pgmap v3051: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:20:25.289 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:20:24 smithi132 bash[27079]: cluster 2020-07-16T15:20:24.858041+0000 mgr.x (mgr.34562) 4895 : cluster [DBG] pgmap v3052: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:20:25.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:20:24 smithi188 bash[23329]: cluster 2020-07-16T15:20:24.858041+0000 mgr.x (mgr.34562) 4895 : cluster [DBG] pgmap v3052: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:20:26.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:20:26 smithi188 bash[23329]: audit 2020-07-16T15:20:25.478916+0000 mon.b (mon.2) 1098 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:20:26.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:20:26 smithi188 bash[23329]: cephadm 2020-07-16T15:20:25.479659+0000 mgr.x (mgr.34562) 4896 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:20:26.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:20:26 smithi188 bash[23329]: cephadm 2020-07-16T15:20:25.480067+0000 mgr.x (mgr.34562) 4897 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:20:26.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:20:26 smithi132 bash[27079]: audit 2020-07-16T15:20:25.478916+0000 mon.b (mon.2) 1098 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:20:26.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:20:26 smithi132 bash[27079]: cephadm 2020-07-16T15:20:25.479659+0000 mgr.x (mgr.34562) 4896 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:20:26.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:20:26 smithi132 bash[27079]: cephadm 2020-07-16T15:20:25.480067+0000 mgr.x (mgr.34562) 4897 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:20:27.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:20:27 smithi188 bash[23329]: cluster 2020-07-16T15:20:26.858520+0000 mgr.x (mgr.34562) 4898 : cluster [DBG] pgmap v3053: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:20:27.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:20:27 smithi132 bash[27079]: cluster 2020-07-16T15:20:26.858520+0000 mgr.x (mgr.34562) 4898 : cluster [DBG] pgmap v3053: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:20:29.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:20:28 smithi132 bash[27079]: cluster 2020-07-16T15:20:28.858849+0000 mgr.x (mgr.34562) 4899 : cluster [DBG] pgmap v3054: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:20:29.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:20:28 smithi188 bash[23329]: cluster 2020-07-16T15:20:28.858849+0000 mgr.x (mgr.34562) 4899 : cluster [DBG] pgmap v3054: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:20:31.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:20:31 smithi188 bash[23329]: cluster 2020-07-16T15:20:30.859360+0000 mgr.x (mgr.34562) 4900 : cluster [DBG] pgmap v3055: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:20:31.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:20:31 smithi132 bash[27079]: cluster 2020-07-16T15:20:30.859360+0000 mgr.x (mgr.34562) 4900 : cluster [DBG] pgmap v3055: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:20:33.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:20:32 smithi132 bash[27079]: cluster 2020-07-16T15:20:32.859845+0000 mgr.x (mgr.34562) 4901 : cluster [DBG] pgmap v3056: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:20:33.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:20:32 smithi188 bash[23329]: cluster 2020-07-16T15:20:32.859845+0000 mgr.x (mgr.34562) 4901 : cluster [DBG] pgmap v3056: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:20:35.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:20:34 smithi132 bash[27079]: cluster 2020-07-16T15:20:34.860354+0000 mgr.x (mgr.34562) 4902 : cluster [DBG] pgmap v3057: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:20:35.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:20:34 smithi188 bash[23329]: cluster 2020-07-16T15:20:34.860354+0000 mgr.x (mgr.34562) 4902 : cluster [DBG] pgmap v3057: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:20:37.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:20:36 smithi132 bash[27079]: cluster 2020-07-16T15:20:36.860701+0000 mgr.x (mgr.34562) 4903 : cluster [DBG] pgmap v3058: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:20:37.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:20:36 smithi188 bash[23329]: cluster 2020-07-16T15:20:36.860701+0000 mgr.x (mgr.34562) 4903 : cluster [DBG] pgmap v3058: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:20:37.493 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:20:37.753 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:20:37.753 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (103m) 6m ago 106m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:20:37.754 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (106m) 6m ago 106m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:20:37.754 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (103m) 6m ago 109m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:20:37.754 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (103m) 6m ago 110m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:20:37.754 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 6m ago 111m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:20:37.754 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (109m) 6m ago 109m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:20:37.755 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (109m) 6m ago 109m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:20:37.755 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (106m) 6m ago 106m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:20:37.755 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (106m) 6m ago 106m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:20:37.755 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (108m) 6m ago 109m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:20:37.755 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (108m) 6m ago 108m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:20:37.756 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (108m) 6m ago 108m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:20:37.756 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (108m) 6m ago 108m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:20:37.756 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (107m) 6m ago 107m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:20:37.756 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (107m) 6m ago 107m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:20:37.756 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (107m) 6m ago 107m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:20:37.757 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (106m) 6m ago 107m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:20:37.757 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (105m) 6m ago 106m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:20:38.054 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:20:38.055 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:20:38.055 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:20:38.055 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:20:38.055 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:20:38.055 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:20:38.056 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:20:38.056 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:20:38.056 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:20:38.056 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:20:38.056 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:20:38.057 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:20:38.057 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:20:38.057 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:20:38.057 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:20:38.057 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:20:38.058 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:20:38.285 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:20:37 smithi132 bash[27079]: audit 2020-07-16T15:20:37.481529+0000 mgr.x (mgr.34562) 4904 : audit [DBG] from='client.28204 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:20:38.286 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:20:37 smithi132 bash[27079]: audit 2020-07-16T15:20:37.748957+0000 mgr.x (mgr.34562) 4905 : audit [DBG] from='client.28210 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:20:38.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:20:37 smithi188 bash[23329]: audit 2020-07-16T15:20:37.481529+0000 mgr.x (mgr.34562) 4904 : audit [DBG] from='client.28204 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:20:38.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:20:37 smithi188 bash[23329]: audit 2020-07-16T15:20:37.748957+0000 mgr.x (mgr.34562) 4905 : audit [DBG] from='client.28210 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:20:39.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:20:38 smithi132 bash[27079]: audit 2020-07-16T15:20:38.053488+0000 mon.c (mon.1) 350 : audit [DBG] from='client.? 172.21.15.132:0/2265935145' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:20:39.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:20:38 smithi132 bash[27079]: cluster 2020-07-16T15:20:38.861128+0000 mgr.x (mgr.34562) 4906 : cluster [DBG] pgmap v3059: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:20:39.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:20:38 smithi188 bash[23329]: audit 2020-07-16T15:20:38.053488+0000 mon.c (mon.1) 350 : audit [DBG] from='client.? 172.21.15.132:0/2265935145' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:20:39.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:20:38 smithi188 bash[23329]: cluster 2020-07-16T15:20:38.861128+0000 mgr.x (mgr.34562) 4906 : cluster [DBG] pgmap v3059: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:20:41.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:20:41 smithi188 bash[23329]: audit 2020-07-16T15:20:40.495499+0000 mon.b (mon.2) 1099 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:20:41.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:20:41 smithi188 bash[23329]: cephadm 2020-07-16T15:20:40.496207+0000 mgr.x (mgr.34562) 4907 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:20:41.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:20:41 smithi188 bash[23329]: cephadm 2020-07-16T15:20:40.496577+0000 mgr.x (mgr.34562) 4908 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:20:41.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:20:41 smithi188 bash[23329]: cluster 2020-07-16T15:20:40.861568+0000 mgr.x (mgr.34562) 4909 : cluster [DBG] pgmap v3060: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:20:41.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:20:41 smithi132 bash[27079]: audit 2020-07-16T15:20:40.495499+0000 mon.b (mon.2) 1099 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:20:41.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:20:41 smithi132 bash[27079]: cephadm 2020-07-16T15:20:40.496207+0000 mgr.x (mgr.34562) 4907 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:20:41.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:20:41 smithi132 bash[27079]: cephadm 2020-07-16T15:20:40.496577+0000 mgr.x (mgr.34562) 4908 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:20:41.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:20:41 smithi132 bash[27079]: cluster 2020-07-16T15:20:40.861568+0000 mgr.x (mgr.34562) 4909 : cluster [DBG] pgmap v3060: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:20:43.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:20:42 smithi132 bash[27079]: cluster 2020-07-16T15:20:42.861975+0000 mgr.x (mgr.34562) 4910 : cluster [DBG] pgmap v3061: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:20:43.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:20:42 smithi188 bash[23329]: cluster 2020-07-16T15:20:42.861975+0000 mgr.x (mgr.34562) 4910 : cluster [DBG] pgmap v3061: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:20:45.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:20:44 smithi132 bash[27079]: cluster 2020-07-16T15:20:44.862325+0000 mgr.x (mgr.34562) 4911 : cluster [DBG] pgmap v3062: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:20:45.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:20:44 smithi188 bash[23329]: cluster 2020-07-16T15:20:44.862325+0000 mgr.x (mgr.34562) 4911 : cluster [DBG] pgmap v3062: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:20:47.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:20:46 smithi132 bash[27079]: cluster 2020-07-16T15:20:46.862859+0000 mgr.x (mgr.34562) 4912 : cluster [DBG] pgmap v3063: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:20:47.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:20:46 smithi188 bash[23329]: cluster 2020-07-16T15:20:46.862859+0000 mgr.x (mgr.34562) 4912 : cluster [DBG] pgmap v3063: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:20:49.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:20:48 smithi132 bash[27079]: cluster 2020-07-16T15:20:48.863235+0000 mgr.x (mgr.34562) 4913 : cluster [DBG] pgmap v3064: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:20:49.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:20:48 smithi188 bash[23329]: cluster 2020-07-16T15:20:48.863235+0000 mgr.x (mgr.34562) 4913 : cluster [DBG] pgmap v3064: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:20:51.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:20:51 smithi188 bash[23329]: cluster 2020-07-16T15:20:50.863557+0000 mgr.x (mgr.34562) 4914 : cluster [DBG] pgmap v3065: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:20:51.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:20:51 smithi132 bash[27079]: cluster 2020-07-16T15:20:50.863557+0000 mgr.x (mgr.34562) 4914 : cluster [DBG] pgmap v3065: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:20:53.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:20:52 smithi132 bash[27079]: cluster 2020-07-16T15:20:52.864123+0000 mgr.x (mgr.34562) 4915 : cluster [DBG] pgmap v3066: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:20:53.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:20:52 smithi188 bash[23329]: cluster 2020-07-16T15:20:52.864123+0000 mgr.x (mgr.34562) 4915 : cluster [DBG] pgmap v3066: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:20:55.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:20:54 smithi132 bash[27079]: cluster 2020-07-16T15:20:54.864600+0000 mgr.x (mgr.34562) 4916 : cluster [DBG] pgmap v3067: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:20:55.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:20:54 smithi188 bash[23329]: cluster 2020-07-16T15:20:54.864600+0000 mgr.x (mgr.34562) 4916 : cluster [DBG] pgmap v3067: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:20:56.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:20:56 smithi188 bash[23329]: audit 2020-07-16T15:20:55.501452+0000 mon.b (mon.2) 1100 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:20:56.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:20:56 smithi188 bash[23329]: cephadm 2020-07-16T15:20:55.502122+0000 mgr.x (mgr.34562) 4917 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:20:56.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:20:56 smithi188 bash[23329]: cephadm 2020-07-16T15:20:55.502309+0000 mgr.x (mgr.34562) 4918 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:20:56.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:20:56 smithi132 bash[27079]: audit 2020-07-16T15:20:55.501452+0000 mon.b (mon.2) 1100 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:20:56.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:20:56 smithi132 bash[27079]: cephadm 2020-07-16T15:20:55.502122+0000 mgr.x (mgr.34562) 4917 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:20:56.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:20:56 smithi132 bash[27079]: cephadm 2020-07-16T15:20:55.502309+0000 mgr.x (mgr.34562) 4918 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:20:57.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:20:57 smithi188 bash[23329]: cluster 2020-07-16T15:20:56.865035+0000 mgr.x (mgr.34562) 4919 : cluster [DBG] pgmap v3068: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:20:57.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:20:57 smithi132 bash[27079]: cluster 2020-07-16T15:20:56.865035+0000 mgr.x (mgr.34562) 4919 : cluster [DBG] pgmap v3068: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:20:59.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:20:58 smithi132 bash[27079]: cluster 2020-07-16T15:20:58.865462+0000 mgr.x (mgr.34562) 4920 : cluster [DBG] pgmap v3069: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:20:59.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:20:58 smithi188 bash[23329]: cluster 2020-07-16T15:20:58.865462+0000 mgr.x (mgr.34562) 4920 : cluster [DBG] pgmap v3069: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:21:01.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:21:01 smithi188 bash[23329]: cluster 2020-07-16T15:21:00.865876+0000 mgr.x (mgr.34562) 4921 : cluster [DBG] pgmap v3070: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:21:01.783 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:21:01 smithi132 bash[27079]: cluster 2020-07-16T15:21:00.865876+0000 mgr.x (mgr.34562) 4921 : cluster [DBG] pgmap v3070: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:21:03.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:21:02 smithi132 bash[27079]: cluster 2020-07-16T15:21:02.866413+0000 mgr.x (mgr.34562) 4922 : cluster [DBG] pgmap v3071: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:21:03.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:21:02 smithi188 bash[23329]: cluster 2020-07-16T15:21:02.866413+0000 mgr.x (mgr.34562) 4922 : cluster [DBG] pgmap v3071: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:21:05.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:21:04 smithi132 bash[27079]: cluster 2020-07-16T15:21:04.866875+0000 mgr.x (mgr.34562) 4923 : cluster [DBG] pgmap v3072: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:21:05.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:21:04 smithi188 bash[23329]: cluster 2020-07-16T15:21:04.866875+0000 mgr.x (mgr.34562) 4923 : cluster [DBG] pgmap v3072: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:21:07.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:21:06 smithi132 bash[27079]: cluster 2020-07-16T15:21:06.867333+0000 mgr.x (mgr.34562) 4924 : cluster [DBG] pgmap v3073: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:21:07.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:21:06 smithi188 bash[23329]: cluster 2020-07-16T15:21:06.867333+0000 mgr.x (mgr.34562) 4924 : cluster [DBG] pgmap v3073: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:21:08.350 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:21:08.612 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:21:08.612 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (103m) 7m ago 106m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:21:08.612 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (106m) 7m ago 106m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:21:08.613 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (104m) 7m ago 109m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:21:08.613 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (103m) 7m ago 111m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:21:08.613 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 7m ago 111m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:21:08.613 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (109m) 7m ago 109m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:21:08.613 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (110m) 7m ago 110m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:21:08.614 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (107m) 7m ago 107m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:21:08.614 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (107m) 7m ago 107m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:21:08.614 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (109m) 7m ago 109m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:21:08.614 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (109m) 7m ago 109m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:21:08.614 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (108m) 7m ago 108m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:21:08.615 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (108m) 7m ago 108m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:21:08.615 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (108m) 7m ago 108m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:21:08.615 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (108m) 7m ago 108m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:21:08.615 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (107m) 7m ago 107m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:21:08.615 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (107m) 7m ago 107m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:21:08.616 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (106m) 7m ago 107m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:21:08.912 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:21:08.912 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:21:08.913 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:21:08.913 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:21:08.913 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:21:08.913 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:21:08.913 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:21:08.914 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:21:08.914 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:21:08.914 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:21:08.914 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:21:08.914 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:21:08.915 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:21:08.915 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:21:08.915 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:21:08.915 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:21:08.915 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:21:09.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:21:08 smithi132 bash[27079]: audit 2020-07-16T15:21:08.338905+0000 mgr.x (mgr.34562) 4925 : audit [DBG] from='client.28222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:21:09.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:21:08 smithi132 bash[27079]: audit 2020-07-16T15:21:08.607479+0000 mgr.x (mgr.34562) 4926 : audit [DBG] from='client.28228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:21:09.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:21:08 smithi132 bash[27079]: cluster 2020-07-16T15:21:08.867674+0000 mgr.x (mgr.34562) 4927 : cluster [DBG] pgmap v3074: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:21:09.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:21:08 smithi132 bash[27079]: audit 2020-07-16T15:21:08.911468+0000 mon.c (mon.1) 351 : audit [DBG] from='client.? 172.21.15.132:0/415445535' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:21:09.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:21:08 smithi188 bash[23329]: audit 2020-07-16T15:21:08.338905+0000 mgr.x (mgr.34562) 4925 : audit [DBG] from='client.28222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:21:09.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:21:08 smithi188 bash[23329]: audit 2020-07-16T15:21:08.607479+0000 mgr.x (mgr.34562) 4926 : audit [DBG] from='client.28228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:21:09.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:21:08 smithi188 bash[23329]: cluster 2020-07-16T15:21:08.867674+0000 mgr.x (mgr.34562) 4927 : cluster [DBG] pgmap v3074: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:21:09.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:21:08 smithi188 bash[23329]: audit 2020-07-16T15:21:08.911468+0000 mon.c (mon.1) 351 : audit [DBG] from='client.? 172.21.15.132:0/415445535' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:21:11.423 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:21:11 smithi132 bash[27079]: audit 2020-07-16T15:21:10.521222+0000 mon.b (mon.2) 1101 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:21:11.424 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:21:11 smithi132 bash[27079]: audit 2020-07-16T15:21:10.521661+0000 mgr.x (mgr.34562) 4928 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:21:11.424 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:21:11 smithi132 bash[27079]: audit 2020-07-16T15:21:10.522749+0000 mon.b (mon.2) 1102 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:21:11.424 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:21:11 smithi132 bash[27079]: audit 2020-07-16T15:21:10.523072+0000 mgr.x (mgr.34562) 4929 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:21:11.424 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:21:11 smithi132 bash[27079]: audit 2020-07-16T15:21:10.524022+0000 mon.b (mon.2) 1103 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:21:11.425 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:21:11 smithi132 bash[27079]: audit 2020-07-16T15:21:10.524304+0000 mgr.x (mgr.34562) 4930 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:21:11.425 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:21:11 smithi132 bash[27079]: cephadm 2020-07-16T15:21:10.525060+0000 mgr.x (mgr.34562) 4931 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:21:11.425 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:21:11 smithi132 bash[27079]: audit 2020-07-16T15:21:10.525468+0000 mon.b (mon.2) 1104 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:21:11.425 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:21:11 smithi132 bash[27079]: cephadm 2020-07-16T15:21:10.526373+0000 mgr.x (mgr.34562) 4932 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:21:11.426 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:21:11 smithi132 bash[27079]: audit 2020-07-16T15:21:10.526846+0000 mon.b (mon.2) 1105 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:21:11.426 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:21:11 smithi132 bash[27079]: cephadm 2020-07-16T15:21:10.527593+0000 mgr.x (mgr.34562) 4933 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:21:11.426 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:21:11 smithi132 bash[27079]: cephadm 2020-07-16T15:21:10.527696+0000 mgr.x (mgr.34562) 4934 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:21:11.426 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:21:11 smithi132 bash[27079]: cluster 2020-07-16T15:21:10.868155+0000 mgr.x (mgr.34562) 4935 : cluster [DBG] pgmap v3075: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:21:11.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:21:11 smithi188 bash[23329]: audit 2020-07-16T15:21:10.521222+0000 mon.b (mon.2) 1101 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:21:11.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:21:11 smithi188 bash[23329]: audit 2020-07-16T15:21:10.521661+0000 mgr.x (mgr.34562) 4928 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:21:11.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:21:11 smithi188 bash[23329]: audit 2020-07-16T15:21:10.522749+0000 mon.b (mon.2) 1102 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:21:11.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:21:11 smithi188 bash[23329]: audit 2020-07-16T15:21:10.523072+0000 mgr.x (mgr.34562) 4929 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:21:11.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:21:11 smithi188 bash[23329]: audit 2020-07-16T15:21:10.524022+0000 mon.b (mon.2) 1103 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:21:11.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:21:11 smithi188 bash[23329]: audit 2020-07-16T15:21:10.524304+0000 mgr.x (mgr.34562) 4930 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:21:11.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:21:11 smithi188 bash[23329]: cephadm 2020-07-16T15:21:10.525060+0000 mgr.x (mgr.34562) 4931 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:21:11.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:21:11 smithi188 bash[23329]: audit 2020-07-16T15:21:10.525468+0000 mon.b (mon.2) 1104 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:21:11.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:21:11 smithi188 bash[23329]: cephadm 2020-07-16T15:21:10.526373+0000 mgr.x (mgr.34562) 4932 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:21:11.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:21:11 smithi188 bash[23329]: audit 2020-07-16T15:21:10.526846+0000 mon.b (mon.2) 1105 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:21:11.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:21:11 smithi188 bash[23329]: cephadm 2020-07-16T15:21:10.527593+0000 mgr.x (mgr.34562) 4933 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:21:11.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:21:11 smithi188 bash[23329]: cephadm 2020-07-16T15:21:10.527696+0000 mgr.x (mgr.34562) 4934 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:21:11.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:21:11 smithi188 bash[23329]: cluster 2020-07-16T15:21:10.868155+0000 mgr.x (mgr.34562) 4935 : cluster [DBG] pgmap v3075: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:21:13.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:21:12 smithi132 bash[27079]: cluster 2020-07-16T15:21:12.868640+0000 mgr.x (mgr.34562) 4936 : cluster [DBG] pgmap v3076: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:21:13.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:21:12 smithi188 bash[23329]: cluster 2020-07-16T15:21:12.868640+0000 mgr.x (mgr.34562) 4936 : cluster [DBG] pgmap v3076: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:21:14.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:21:13 smithi132 bash[27079]: audit 2020-07-16T15:21:13.405256+0000 mon.b (mon.2) 1106 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:21:14.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:21:13 smithi132 bash[27079]: cephadm 2020-07-16T15:21:13.405866+0000 mgr.x (mgr.34562) 4937 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:21:14.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:21:13 smithi132 bash[27079]: cephadm 2020-07-16T15:21:13.406179+0000 mgr.x (mgr.34562) 4938 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:21:14.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:21:13 smithi188 bash[23329]: audit 2020-07-16T15:21:13.405256+0000 mon.b (mon.2) 1106 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:21:14.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:21:13 smithi188 bash[23329]: cephadm 2020-07-16T15:21:13.405866+0000 mgr.x (mgr.34562) 4937 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:21:14.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:21:13 smithi188 bash[23329]: cephadm 2020-07-16T15:21:13.406179+0000 mgr.x (mgr.34562) 4938 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:21:15.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:21:14 smithi132 bash[27079]: cluster 2020-07-16T15:21:14.869034+0000 mgr.x (mgr.34562) 4939 : cluster [DBG] pgmap v3077: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:21:15.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:21:14 smithi188 bash[23329]: cluster 2020-07-16T15:21:14.869034+0000 mgr.x (mgr.34562) 4939 : cluster [DBG] pgmap v3077: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:21:17.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:21:16 smithi132 bash[27079]: cluster 2020-07-16T15:21:16.869481+0000 mgr.x (mgr.34562) 4940 : cluster [DBG] pgmap v3078: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:21:17.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:21:16 smithi188 bash[23329]: cluster 2020-07-16T15:21:16.869481+0000 mgr.x (mgr.34562) 4940 : cluster [DBG] pgmap v3078: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:21:19.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:21:18 smithi132 bash[27079]: cluster 2020-07-16T15:21:18.869835+0000 mgr.x (mgr.34562) 4941 : cluster [DBG] pgmap v3079: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:21:19.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:21:18 smithi188 bash[23329]: cluster 2020-07-16T15:21:18.869835+0000 mgr.x (mgr.34562) 4941 : cluster [DBG] pgmap v3079: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:21:21.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:21:21 smithi188 bash[23329]: cluster 2020-07-16T15:21:20.870266+0000 mgr.x (mgr.34562) 4942 : cluster [DBG] pgmap v3080: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:21:21.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:21:21 smithi132 bash[27079]: cluster 2020-07-16T15:21:20.870266+0000 mgr.x (mgr.34562) 4942 : cluster [DBG] pgmap v3080: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:21:23.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:21:22 smithi132 bash[27079]: cluster 2020-07-16T15:21:22.870762+0000 mgr.x (mgr.34562) 4943 : cluster [DBG] pgmap v3081: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:21:23.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:21:22 smithi188 bash[23329]: cluster 2020-07-16T15:21:22.870762+0000 mgr.x (mgr.34562) 4943 : cluster [DBG] pgmap v3081: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:21:25.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:21:24 smithi132 bash[27079]: cluster 2020-07-16T15:21:24.871270+0000 mgr.x (mgr.34562) 4944 : cluster [DBG] pgmap v3082: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:21:25.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:21:24 smithi188 bash[23329]: cluster 2020-07-16T15:21:24.871270+0000 mgr.x (mgr.34562) 4944 : cluster [DBG] pgmap v3082: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:21:27.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:21:26 smithi132 bash[27079]: cluster 2020-07-16T15:21:26.871671+0000 mgr.x (mgr.34562) 4945 : cluster [DBG] pgmap v3083: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:21:27.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:21:26 smithi188 bash[23329]: cluster 2020-07-16T15:21:26.871671+0000 mgr.x (mgr.34562) 4945 : cluster [DBG] pgmap v3083: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:21:28.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:21:28 smithi132 bash[27079]: audit 2020-07-16T15:21:28.416260+0000 mon.b (mon.2) 1107 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:21:28.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:21:28 smithi188 bash[23329]: audit 2020-07-16T15:21:28.416260+0000 mon.b (mon.2) 1107 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:21:29.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:21:29 smithi132 bash[27079]: cephadm 2020-07-16T15:21:28.416975+0000 mgr.x (mgr.34562) 4946 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:21:29.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:21:29 smithi132 bash[27079]: cephadm 2020-07-16T15:21:28.417178+0000 mgr.x (mgr.34562) 4947 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:21:29.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:21:29 smithi132 bash[27079]: cluster 2020-07-16T15:21:28.872142+0000 mgr.x (mgr.34562) 4948 : cluster [DBG] pgmap v3084: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:21:29.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:21:29 smithi188 bash[23329]: cephadm 2020-07-16T15:21:28.416975+0000 mgr.x (mgr.34562) 4946 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:21:29.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:21:29 smithi188 bash[23329]: cephadm 2020-07-16T15:21:28.417178+0000 mgr.x (mgr.34562) 4947 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:21:29.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:21:29 smithi188 bash[23329]: cluster 2020-07-16T15:21:28.872142+0000 mgr.x (mgr.34562) 4948 : cluster [DBG] pgmap v3084: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:21:31.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:21:31 smithi188 bash[23329]: cluster 2020-07-16T15:21:30.872650+0000 mgr.x (mgr.34562) 4949 : cluster [DBG] pgmap v3085: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:21:31.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:21:31 smithi132 bash[27079]: cluster 2020-07-16T15:21:30.872650+0000 mgr.x (mgr.34562) 4949 : cluster [DBG] pgmap v3085: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:21:33.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:21:32 smithi132 bash[27079]: cluster 2020-07-16T15:21:32.873022+0000 mgr.x (mgr.34562) 4950 : cluster [DBG] pgmap v3086: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:21:33.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:21:32 smithi188 bash[23329]: cluster 2020-07-16T15:21:32.873022+0000 mgr.x (mgr.34562) 4950 : cluster [DBG] pgmap v3086: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:21:35.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:21:34 smithi132 bash[27079]: cluster 2020-07-16T15:21:34.873502+0000 mgr.x (mgr.34562) 4951 : cluster [DBG] pgmap v3087: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:21:35.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:21:34 smithi188 bash[23329]: cluster 2020-07-16T15:21:34.873502+0000 mgr.x (mgr.34562) 4951 : cluster [DBG] pgmap v3087: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:21:37.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:21:36 smithi132 bash[27079]: cluster 2020-07-16T15:21:36.873952+0000 mgr.x (mgr.34562) 4952 : cluster [DBG] pgmap v3088: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:21:37.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:21:36 smithi188 bash[23329]: cluster 2020-07-16T15:21:36.873952+0000 mgr.x (mgr.34562) 4952 : cluster [DBG] pgmap v3088: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:21:39.210 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:21:39.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:21:38 smithi132 bash[27079]: cluster 2020-07-16T15:21:38.874346+0000 mgr.x (mgr.34562) 4953 : cluster [DBG] pgmap v3089: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:21:39.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:21:38 smithi188 bash[23329]: cluster 2020-07-16T15:21:38.874346+0000 mgr.x (mgr.34562) 4953 : cluster [DBG] pgmap v3089: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:21:39.471 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:21:39.471 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (104m) 7m ago 107m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:21:39.471 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (107m) 7m ago 107m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:21:39.471 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (104m) 7m ago 110m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:21:39.472 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (104m) 7m ago 111m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:21:39.472 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 7m ago 112m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:21:39.472 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (110m) 7m ago 110m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:21:39.472 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (110m) 7m ago 110m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:21:39.473 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (107m) 7m ago 107m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:21:39.473 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (107m) 7m ago 107m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:21:39.473 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (110m) 7m ago 110m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:21:39.473 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (109m) 7m ago 109m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:21:39.473 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (109m) 7m ago 109m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:21:39.474 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (109m) 7m ago 109m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:21:39.474 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (108m) 7m ago 108m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:21:39.474 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (108m) 7m ago 108m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:21:39.474 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (108m) 7m ago 108m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:21:39.474 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (108m) 7m ago 108m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:21:39.475 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (106m) 7m ago 107m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:21:39.771 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:21:39.772 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:21:39.772 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:21:39.772 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:21:39.772 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:21:39.773 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:21:39.773 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:21:39.773 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:21:39.773 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:21:39.774 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:21:39.774 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:21:39.775 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:21:39.775 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:21:39.775 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:21:39.775 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:21:39.775 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:21:39.776 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:21:40.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:21:39 smithi132 bash[27079]: audit 2020-07-16T15:21:39.198505+0000 mgr.x (mgr.34562) 4954 : audit [DBG] from='client.28240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:21:40.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:21:39 smithi132 bash[27079]: audit 2020-07-16T15:21:39.466602+0000 mgr.x (mgr.34562) 4955 : audit [DBG] from='client.28246 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:21:40.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:21:39 smithi132 bash[27079]: audit 2020-07-16T15:21:39.770815+0000 mon.c (mon.1) 352 : audit [DBG] from='client.? 172.21.15.132:0/715613538' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:21:40.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:21:39 smithi188 bash[23329]: audit 2020-07-16T15:21:39.198505+0000 mgr.x (mgr.34562) 4954 : audit [DBG] from='client.28240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:21:40.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:21:39 smithi188 bash[23329]: audit 2020-07-16T15:21:39.466602+0000 mgr.x (mgr.34562) 4955 : audit [DBG] from='client.28246 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:21:40.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:21:39 smithi188 bash[23329]: audit 2020-07-16T15:21:39.770815+0000 mon.c (mon.1) 352 : audit [DBG] from='client.? 172.21.15.132:0/715613538' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:21:41.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:21:41 smithi188 bash[23329]: cluster 2020-07-16T15:21:40.874751+0000 mgr.x (mgr.34562) 4956 : cluster [DBG] pgmap v3090: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:21:41.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:21:41 smithi132 bash[27079]: cluster 2020-07-16T15:21:40.874751+0000 mgr.x (mgr.34562) 4956 : cluster [DBG] pgmap v3090: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:21:43.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:21:42 smithi132 bash[27079]: cluster 2020-07-16T15:21:42.875256+0000 mgr.x (mgr.34562) 4957 : cluster [DBG] pgmap v3091: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:21:43.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:21:42 smithi188 bash[23329]: cluster 2020-07-16T15:21:42.875256+0000 mgr.x (mgr.34562) 4957 : cluster [DBG] pgmap v3091: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:21:44.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:21:43 smithi132 bash[27079]: audit 2020-07-16T15:21:43.433024+0000 mon.b (mon.2) 1108 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:21:44.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:21:43 smithi132 bash[27079]: cephadm 2020-07-16T15:21:43.434147+0000 mgr.x (mgr.34562) 4958 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:21:44.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:21:43 smithi132 bash[27079]: cephadm 2020-07-16T15:21:43.434220+0000 mgr.x (mgr.34562) 4959 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:21:44.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:21:43 smithi188 bash[23329]: audit 2020-07-16T15:21:43.433024+0000 mon.b (mon.2) 1108 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:21:44.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:21:43 smithi188 bash[23329]: cephadm 2020-07-16T15:21:43.434147+0000 mgr.x (mgr.34562) 4958 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:21:44.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:21:43 smithi188 bash[23329]: cephadm 2020-07-16T15:21:43.434220+0000 mgr.x (mgr.34562) 4959 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:21:45.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:21:44 smithi132 bash[27079]: cluster 2020-07-16T15:21:44.875742+0000 mgr.x (mgr.34562) 4960 : cluster [DBG] pgmap v3092: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:21:45.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:21:44 smithi188 bash[23329]: cluster 2020-07-16T15:21:44.875742+0000 mgr.x (mgr.34562) 4960 : cluster [DBG] pgmap v3092: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:21:47.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:21:46 smithi132 bash[27079]: cluster 2020-07-16T15:21:46.876314+0000 mgr.x (mgr.34562) 4961 : cluster [DBG] pgmap v3093: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:21:47.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:21:46 smithi188 bash[23329]: cluster 2020-07-16T15:21:46.876314+0000 mgr.x (mgr.34562) 4961 : cluster [DBG] pgmap v3093: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:21:49.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:21:48 smithi132 bash[27079]: cluster 2020-07-16T15:21:48.876671+0000 mgr.x (mgr.34562) 4962 : cluster [DBG] pgmap v3094: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:21:49.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:21:48 smithi188 bash[23329]: cluster 2020-07-16T15:21:48.876671+0000 mgr.x (mgr.34562) 4962 : cluster [DBG] pgmap v3094: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:21:51.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:21:51 smithi188 bash[23329]: cluster 2020-07-16T15:21:50.877056+0000 mgr.x (mgr.34562) 4963 : cluster [DBG] pgmap v3095: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:21:51.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:21:51 smithi132 bash[27079]: cluster 2020-07-16T15:21:50.877056+0000 mgr.x (mgr.34562) 4963 : cluster [DBG] pgmap v3095: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:21:53.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:21:52 smithi132 bash[27079]: cluster 2020-07-16T15:21:52.877429+0000 mgr.x (mgr.34562) 4964 : cluster [DBG] pgmap v3096: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:21:53.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:21:52 smithi188 bash[23329]: cluster 2020-07-16T15:21:52.877429+0000 mgr.x (mgr.34562) 4964 : cluster [DBG] pgmap v3096: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:21:55.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:21:54 smithi132 bash[27079]: cluster 2020-07-16T15:21:54.877788+0000 mgr.x (mgr.34562) 4965 : cluster [DBG] pgmap v3097: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:21:55.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:21:54 smithi188 bash[23329]: cluster 2020-07-16T15:21:54.877788+0000 mgr.x (mgr.34562) 4965 : cluster [DBG] pgmap v3097: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:21:57.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:21:56 smithi132 bash[27079]: cluster 2020-07-16T15:21:56.878162+0000 mgr.x (mgr.34562) 4966 : cluster [DBG] pgmap v3098: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:21:57.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:21:56 smithi188 bash[23329]: cluster 2020-07-16T15:21:56.878162+0000 mgr.x (mgr.34562) 4966 : cluster [DBG] pgmap v3098: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:21:58.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:21:58 smithi132 bash[27079]: audit 2020-07-16T15:21:58.449856+0000 mon.b (mon.2) 1109 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:21:58.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:21:58 smithi188 bash[23329]: audit 2020-07-16T15:21:58.449856+0000 mon.b (mon.2) 1109 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:21:59.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:21:59 smithi132 bash[27079]: cephadm 2020-07-16T15:21:58.450565+0000 mgr.x (mgr.34562) 4967 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:21:59.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:21:59 smithi132 bash[27079]: cephadm 2020-07-16T15:21:58.450653+0000 mgr.x (mgr.34562) 4968 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:21:59.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:21:59 smithi132 bash[27079]: cluster 2020-07-16T15:21:58.878459+0000 mgr.x (mgr.34562) 4969 : cluster [DBG] pgmap v3099: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:21:59.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:21:59 smithi188 bash[23329]: cephadm 2020-07-16T15:21:58.450565+0000 mgr.x (mgr.34562) 4967 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:21:59.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:21:59 smithi188 bash[23329]: cephadm 2020-07-16T15:21:58.450653+0000 mgr.x (mgr.34562) 4968 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:21:59.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:21:59 smithi188 bash[23329]: cluster 2020-07-16T15:21:58.878459+0000 mgr.x (mgr.34562) 4969 : cluster [DBG] pgmap v3099: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:22:01.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:22:01 smithi188 bash[23329]: cluster 2020-07-16T15:22:00.878777+0000 mgr.x (mgr.34562) 4970 : cluster [DBG] pgmap v3100: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:22:01.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:22:01 smithi132 bash[27079]: cluster 2020-07-16T15:22:00.878777+0000 mgr.x (mgr.34562) 4970 : cluster [DBG] pgmap v3100: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:22:03.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:22:02 smithi132 bash[27079]: cluster 2020-07-16T15:22:02.879352+0000 mgr.x (mgr.34562) 4971 : cluster [DBG] pgmap v3101: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:22:03.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:22:02 smithi188 bash[23329]: cluster 2020-07-16T15:22:02.879352+0000 mgr.x (mgr.34562) 4971 : cluster [DBG] pgmap v3101: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:22:05.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:22:04 smithi132 bash[27079]: cluster 2020-07-16T15:22:04.879859+0000 mgr.x (mgr.34562) 4972 : cluster [DBG] pgmap v3102: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:22:05.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:22:04 smithi188 bash[23329]: cluster 2020-07-16T15:22:04.879859+0000 mgr.x (mgr.34562) 4972 : cluster [DBG] pgmap v3102: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:22:07.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:22:06 smithi132 bash[27079]: cluster 2020-07-16T15:22:06.880275+0000 mgr.x (mgr.34562) 4973 : cluster [DBG] pgmap v3103: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:22:07.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:22:06 smithi188 bash[23329]: cluster 2020-07-16T15:22:06.880275+0000 mgr.x (mgr.34562) 4973 : cluster [DBG] pgmap v3103: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:22:09.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:22:08 smithi132 bash[27079]: cluster 2020-07-16T15:22:08.880637+0000 mgr.x (mgr.34562) 4974 : cluster [DBG] pgmap v3104: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:22:09.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:22:08 smithi188 bash[23329]: cluster 2020-07-16T15:22:08.880637+0000 mgr.x (mgr.34562) 4974 : cluster [DBG] pgmap v3104: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:22:10.074 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:22:10.335 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:22:10.335 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (104m) 8m ago 107m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:22:10.335 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (107m) 8m ago 107m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:22:10.336 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (105m) 8m ago 110m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:22:10.336 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (104m) 8m ago 112m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:22:10.336 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 8m ago 112m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:22:10.336 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (110m) 8m ago 110m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:22:10.337 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (111m) 8m ago 111m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:22:10.337 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (108m) 8m ago 108m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:22:10.337 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (108m) 8m ago 108m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:22:10.338 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (110m) 8m ago 110m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:22:10.338 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (110m) 8m ago 110m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:22:10.338 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (109m) 8m ago 109m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:22:10.338 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (109m) 8m ago 109m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:22:10.339 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (109m) 8m ago 109m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:22:10.339 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (109m) 8m ago 109m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:22:10.339 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (108m) 8m ago 108m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:22:10.339 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (108m) 8m ago 108m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:22:10.340 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (107m) 8m ago 108m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:22:10.633 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:22:10.634 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:22:10.634 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:22:10.634 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:22:10.634 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:22:10.635 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:22:10.635 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:22:10.635 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:22:10.635 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:22:10.635 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:22:10.636 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:22:10.636 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:22:10.636 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:22:10.636 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:22:10.636 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:22:10.637 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:22:10.637 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:22:11.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:22:11 smithi188 bash[23329]: audit 2020-07-16T15:22:10.062927+0000 mgr.x (mgr.34562) 4975 : audit [DBG] from='client.28258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:22:11.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:22:11 smithi188 bash[23329]: audit 2020-07-16T15:22:10.330913+0000 mgr.x (mgr.34562) 4976 : audit [DBG] from='client.28264 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:22:11.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:22:11 smithi188 bash[23329]: audit 2020-07-16T15:22:10.632890+0000 mon.c (mon.1) 353 : audit [DBG] from='client.? 172.21.15.132:0/2716681265' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:22:11.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:22:11 smithi188 bash[23329]: cluster 2020-07-16T15:22:10.881030+0000 mgr.x (mgr.34562) 4977 : cluster [DBG] pgmap v3105: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:22:11.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:22:11 smithi132 bash[27079]: audit 2020-07-16T15:22:10.062927+0000 mgr.x (mgr.34562) 4975 : audit [DBG] from='client.28258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:22:11.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:22:11 smithi132 bash[27079]: audit 2020-07-16T15:22:10.330913+0000 mgr.x (mgr.34562) 4976 : audit [DBG] from='client.28264 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:22:11.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:22:11 smithi132 bash[27079]: audit 2020-07-16T15:22:10.632890+0000 mon.c (mon.1) 353 : audit [DBG] from='client.? 172.21.15.132:0/2716681265' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:22:11.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:22:11 smithi132 bash[27079]: cluster 2020-07-16T15:22:10.881030+0000 mgr.x (mgr.34562) 4977 : cluster [DBG] pgmap v3105: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:22:13.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:22:12 smithi132 bash[27079]: cluster 2020-07-16T15:22:12.881636+0000 mgr.x (mgr.34562) 4978 : cluster [DBG] pgmap v3106: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:22:13.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:22:12 smithi188 bash[23329]: cluster 2020-07-16T15:22:12.881636+0000 mgr.x (mgr.34562) 4978 : cluster [DBG] pgmap v3106: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:22:14.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:22:13 smithi132 bash[27079]: audit 2020-07-16T15:22:13.469146+0000 mon.b (mon.2) 1110 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:22:14.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:22:13 smithi132 bash[27079]: audit 2020-07-16T15:22:13.469547+0000 mgr.x (mgr.34562) 4979 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:22:14.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:22:13 smithi132 bash[27079]: audit 2020-07-16T15:22:13.470580+0000 mon.b (mon.2) 1111 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:22:14.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:22:13 smithi132 bash[27079]: audit 2020-07-16T15:22:13.470943+0000 mgr.x (mgr.34562) 4980 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:22:14.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:22:13 smithi132 bash[27079]: audit 2020-07-16T15:22:13.471799+0000 mon.b (mon.2) 1112 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:22:14.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:22:13 smithi132 bash[27079]: audit 2020-07-16T15:22:13.472095+0000 mgr.x (mgr.34562) 4981 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:22:14.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:22:13 smithi132 bash[27079]: cephadm 2020-07-16T15:22:13.472851+0000 mgr.x (mgr.34562) 4982 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:22:14.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:22:13 smithi132 bash[27079]: audit 2020-07-16T15:22:13.473317+0000 mon.b (mon.2) 1113 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:22:14.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:22:13 smithi132 bash[27079]: cephadm 2020-07-16T15:22:13.474139+0000 mgr.x (mgr.34562) 4983 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:22:14.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:22:13 smithi132 bash[27079]: audit 2020-07-16T15:22:13.474516+0000 mon.b (mon.2) 1114 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:22:14.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:22:13 smithi132 bash[27079]: cephadm 2020-07-16T15:22:13.475233+0000 mgr.x (mgr.34562) 4984 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:22:14.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:22:13 smithi132 bash[27079]: cephadm 2020-07-16T15:22:13.475478+0000 mgr.x (mgr.34562) 4985 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:22:14.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:22:13 smithi188 bash[23329]: audit 2020-07-16T15:22:13.469146+0000 mon.b (mon.2) 1110 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:22:14.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:22:13 smithi188 bash[23329]: audit 2020-07-16T15:22:13.469547+0000 mgr.x (mgr.34562) 4979 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:22:14.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:22:13 smithi188 bash[23329]: audit 2020-07-16T15:22:13.470580+0000 mon.b (mon.2) 1111 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:22:14.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:22:13 smithi188 bash[23329]: audit 2020-07-16T15:22:13.470943+0000 mgr.x (mgr.34562) 4980 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:22:14.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:22:13 smithi188 bash[23329]: audit 2020-07-16T15:22:13.471799+0000 mon.b (mon.2) 1112 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:22:14.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:22:13 smithi188 bash[23329]: audit 2020-07-16T15:22:13.472095+0000 mgr.x (mgr.34562) 4981 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:22:14.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:22:13 smithi188 bash[23329]: cephadm 2020-07-16T15:22:13.472851+0000 mgr.x (mgr.34562) 4982 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:22:14.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:22:13 smithi188 bash[23329]: audit 2020-07-16T15:22:13.473317+0000 mon.b (mon.2) 1113 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:22:14.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:22:13 smithi188 bash[23329]: cephadm 2020-07-16T15:22:13.474139+0000 mgr.x (mgr.34562) 4983 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:22:14.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:22:13 smithi188 bash[23329]: audit 2020-07-16T15:22:13.474516+0000 mon.b (mon.2) 1114 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:22:14.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:22:13 smithi188 bash[23329]: cephadm 2020-07-16T15:22:13.475233+0000 mgr.x (mgr.34562) 4984 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:22:14.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:22:13 smithi188 bash[23329]: cephadm 2020-07-16T15:22:13.475478+0000 mgr.x (mgr.34562) 4985 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:22:15.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:22:14 smithi132 bash[27079]: cluster 2020-07-16T15:22:14.882149+0000 mgr.x (mgr.34562) 4986 : cluster [DBG] pgmap v3107: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:22:15.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:22:14 smithi188 bash[23329]: cluster 2020-07-16T15:22:14.882149+0000 mgr.x (mgr.34562) 4986 : cluster [DBG] pgmap v3107: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:22:16.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:22:16 smithi188 bash[23329]: audit 2020-07-16T15:22:16.350276+0000 mon.b (mon.2) 1115 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:22:16.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:22:16 smithi132 bash[27079]: audit 2020-07-16T15:22:16.350276+0000 mon.b (mon.2) 1115 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:22:17.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:22:17 smithi188 bash[23329]: cephadm 2020-07-16T15:22:16.350994+0000 mgr.x (mgr.34562) 4987 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:22:17.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:22:17 smithi188 bash[23329]: cephadm 2020-07-16T15:22:16.351350+0000 mgr.x (mgr.34562) 4988 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:22:17.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:22:17 smithi188 bash[23329]: cluster 2020-07-16T15:22:16.882579+0000 mgr.x (mgr.34562) 4989 : cluster [DBG] pgmap v3108: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:22:17.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:22:17 smithi132 bash[27079]: cephadm 2020-07-16T15:22:16.350994+0000 mgr.x (mgr.34562) 4987 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:22:17.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:22:17 smithi132 bash[27079]: cephadm 2020-07-16T15:22:16.351350+0000 mgr.x (mgr.34562) 4988 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:22:17.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:22:17 smithi132 bash[27079]: cluster 2020-07-16T15:22:16.882579+0000 mgr.x (mgr.34562) 4989 : cluster [DBG] pgmap v3108: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:22:19.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:22:18 smithi132 bash[27079]: cluster 2020-07-16T15:22:18.882973+0000 mgr.x (mgr.34562) 4990 : cluster [DBG] pgmap v3109: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:22:19.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:22:18 smithi188 bash[23329]: cluster 2020-07-16T15:22:18.882973+0000 mgr.x (mgr.34562) 4990 : cluster [DBG] pgmap v3109: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:22:21.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:22:21 smithi188 bash[23329]: cluster 2020-07-16T15:22:20.883421+0000 mgr.x (mgr.34562) 4991 : cluster [DBG] pgmap v3110: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:22:21.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:22:21 smithi132 bash[27079]: cluster 2020-07-16T15:22:20.883421+0000 mgr.x (mgr.34562) 4991 : cluster [DBG] pgmap v3110: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:22:23.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:22:22 smithi132 bash[27079]: cluster 2020-07-16T15:22:22.883888+0000 mgr.x (mgr.34562) 4992 : cluster [DBG] pgmap v3111: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:22:23.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:22:22 smithi188 bash[23329]: cluster 2020-07-16T15:22:22.883888+0000 mgr.x (mgr.34562) 4992 : cluster [DBG] pgmap v3111: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:22:25.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:22:24 smithi132 bash[27079]: cluster 2020-07-16T15:22:24.884304+0000 mgr.x (mgr.34562) 4993 : cluster [DBG] pgmap v3112: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:22:25.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:22:24 smithi188 bash[23329]: cluster 2020-07-16T15:22:24.884304+0000 mgr.x (mgr.34562) 4993 : cluster [DBG] pgmap v3112: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:22:27.286 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:22:26 smithi132 bash[27079]: cluster 2020-07-16T15:22:26.884686+0000 mgr.x (mgr.34562) 4994 : cluster [DBG] pgmap v3113: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:22:27.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:22:26 smithi188 bash[23329]: cluster 2020-07-16T15:22:26.884686+0000 mgr.x (mgr.34562) 4994 : cluster [DBG] pgmap v3113: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:22:29.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:22:28 smithi132 bash[27079]: cluster 2020-07-16T15:22:28.885168+0000 mgr.x (mgr.34562) 4995 : cluster [DBG] pgmap v3114: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:22:29.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:22:28 smithi188 bash[23329]: cluster 2020-07-16T15:22:28.885168+0000 mgr.x (mgr.34562) 4995 : cluster [DBG] pgmap v3114: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:22:31.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:22:31 smithi188 bash[23329]: cluster 2020-07-16T15:22:30.885539+0000 mgr.x (mgr.34562) 4996 : cluster [DBG] pgmap v3115: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:22:31.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:22:31 smithi132 bash[27079]: cluster 2020-07-16T15:22:30.885539+0000 mgr.x (mgr.34562) 4996 : cluster [DBG] pgmap v3115: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:22:32.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:22:32 smithi188 bash[23329]: audit 2020-07-16T15:22:31.366878+0000 mon.b (mon.2) 1116 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:22:32.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:22:32 smithi188 bash[23329]: cephadm 2020-07-16T15:22:31.367642+0000 mgr.x (mgr.34562) 4997 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:22:32.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:22:32 smithi188 bash[23329]: cephadm 2020-07-16T15:22:31.368122+0000 mgr.x (mgr.34562) 4998 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:22:32.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:22:32 smithi132 bash[27079]: audit 2020-07-16T15:22:31.366878+0000 mon.b (mon.2) 1116 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:22:32.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:22:32 smithi132 bash[27079]: cephadm 2020-07-16T15:22:31.367642+0000 mgr.x (mgr.34562) 4997 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:22:32.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:22:32 smithi132 bash[27079]: cephadm 2020-07-16T15:22:31.368122+0000 mgr.x (mgr.34562) 4998 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:22:33.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:22:33 smithi188 bash[23329]: cluster 2020-07-16T15:22:32.885983+0000 mgr.x (mgr.34562) 4999 : cluster [DBG] pgmap v3116: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:22:33.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:22:33 smithi132 bash[27079]: cluster 2020-07-16T15:22:32.885983+0000 mgr.x (mgr.34562) 4999 : cluster [DBG] pgmap v3116: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:22:35.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:22:34 smithi132 bash[27079]: cluster 2020-07-16T15:22:34.886358+0000 mgr.x (mgr.34562) 5000 : cluster [DBG] pgmap v3117: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:22:35.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:22:34 smithi188 bash[23329]: cluster 2020-07-16T15:22:34.886358+0000 mgr.x (mgr.34562) 5000 : cluster [DBG] pgmap v3117: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:22:37.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:22:36 smithi132 bash[27079]: cluster 2020-07-16T15:22:36.886752+0000 mgr.x (mgr.34562) 5001 : cluster [DBG] pgmap v3118: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:22:37.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:22:36 smithi188 bash[23329]: cluster 2020-07-16T15:22:36.886752+0000 mgr.x (mgr.34562) 5001 : cluster [DBG] pgmap v3118: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:22:39.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:22:38 smithi132 bash[27079]: cluster 2020-07-16T15:22:38.887273+0000 mgr.x (mgr.34562) 5002 : cluster [DBG] pgmap v3119: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:22:39.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:22:38 smithi188 bash[23329]: cluster 2020-07-16T15:22:38.887273+0000 mgr.x (mgr.34562) 5002 : cluster [DBG] pgmap v3119: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:22:40.930 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:22:41.188 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:22:41.188 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (105m) 8m ago 108m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:22:41.188 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (108m) 8m ago 108m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:22:41.188 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (105m) 8m ago 111m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:22:41.189 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (105m) 8m ago 113m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:22:41.189 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 8m ago 113m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:22:41.189 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (111m) 8m ago 111m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:22:41.189 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (111m) 8m ago 111m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:22:41.189 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (108m) 8m ago 108m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:22:41.190 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (108m) 8m ago 108m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:22:41.190 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (111m) 8m ago 111m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:22:41.190 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (110m) 8m ago 110m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:22:41.191 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (110m) 8m ago 110m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:22:41.191 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (110m) 8m ago 110m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:22:41.191 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (109m) 8m ago 109m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:22:41.191 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (109m) 8m ago 109m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:22:41.191 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (109m) 8m ago 109m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:22:41.192 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (109m) 8m ago 109m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:22:41.192 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (107m) 8m ago 108m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:22:41.490 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:22:41.491 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:22:41.491 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:22:41.491 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:22:41.492 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:22:41.492 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:22:41.492 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:22:41.493 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:22:41.493 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:22:41.493 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:22:41.494 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:22:41.494 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:22:41.494 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:22:41.495 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:22:41.495 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:22:41.495 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:22:41.495 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:22:41.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:22:41 smithi188 bash[23329]: cluster 2020-07-16T15:22:40.887745+0000 mgr.x (mgr.34562) 5003 : cluster [DBG] pgmap v3120: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:22:41.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:22:41 smithi188 bash[23329]: audit 2020-07-16T15:22:40.918916+0000 mgr.x (mgr.34562) 5004 : audit [DBG] from='client.28276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:22:41.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:22:41 smithi132 bash[27079]: cluster 2020-07-16T15:22:40.887745+0000 mgr.x (mgr.34562) 5003 : cluster [DBG] pgmap v3120: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:22:41.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:22:41 smithi132 bash[27079]: audit 2020-07-16T15:22:40.918916+0000 mgr.x (mgr.34562) 5004 : audit [DBG] from='client.28276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:22:42.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:22:42 smithi188 bash[23329]: audit 2020-07-16T15:22:41.183586+0000 mgr.x (mgr.34562) 5005 : audit [DBG] from='client.28282 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:22:42.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:22:42 smithi188 bash[23329]: audit 2020-07-16T15:22:41.488054+0000 mon.c (mon.1) 354 : audit [DBG] from='client.? 172.21.15.132:0/1819603967' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:22:42.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:22:42 smithi132 bash[27079]: audit 2020-07-16T15:22:41.183586+0000 mgr.x (mgr.34562) 5005 : audit [DBG] from='client.28282 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:22:42.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:22:42 smithi132 bash[27079]: audit 2020-07-16T15:22:41.488054+0000 mon.c (mon.1) 354 : audit [DBG] from='client.? 172.21.15.132:0/1819603967' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:22:43.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:22:43 smithi188 bash[23329]: cluster 2020-07-16T15:22:42.888355+0000 mgr.x (mgr.34562) 5006 : cluster [DBG] pgmap v3121: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:22:43.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:22:43 smithi132 bash[27079]: cluster 2020-07-16T15:22:42.888355+0000 mgr.x (mgr.34562) 5006 : cluster [DBG] pgmap v3121: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:22:45.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:22:44 smithi132 bash[27079]: cluster 2020-07-16T15:22:44.888727+0000 mgr.x (mgr.34562) 5007 : cluster [DBG] pgmap v3122: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:22:45.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:22:44 smithi188 bash[23329]: cluster 2020-07-16T15:22:44.888727+0000 mgr.x (mgr.34562) 5007 : cluster [DBG] pgmap v3122: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:22:46.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:22:46 smithi132 bash[27079]: audit 2020-07-16T15:22:46.383695+0000 mon.b (mon.2) 1117 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:22:46.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:22:46 smithi188 bash[23329]: audit 2020-07-16T15:22:46.383695+0000 mon.b (mon.2) 1117 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:22:47.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:22:47 smithi132 bash[27079]: cephadm 2020-07-16T15:22:46.384473+0000 mgr.x (mgr.34562) 5008 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:22:47.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:22:47 smithi132 bash[27079]: cephadm 2020-07-16T15:22:46.384813+0000 mgr.x (mgr.34562) 5009 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:22:47.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:22:47 smithi132 bash[27079]: cluster 2020-07-16T15:22:46.889323+0000 mgr.x (mgr.34562) 5010 : cluster [DBG] pgmap v3123: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:22:47.932 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:22:47 smithi188 bash[23329]: cephadm 2020-07-16T15:22:46.384473+0000 mgr.x (mgr.34562) 5008 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:22:47.933 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:22:47 smithi188 bash[23329]: cephadm 2020-07-16T15:22:46.384813+0000 mgr.x (mgr.34562) 5009 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:22:47.933 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:22:47 smithi188 bash[23329]: cluster 2020-07-16T15:22:46.889323+0000 mgr.x (mgr.34562) 5010 : cluster [DBG] pgmap v3123: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:22:49.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:22:48 smithi132 bash[27079]: cluster 2020-07-16T15:22:48.889682+0000 mgr.x (mgr.34562) 5011 : cluster [DBG] pgmap v3124: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:22:49.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:22:48 smithi188 bash[23329]: cluster 2020-07-16T15:22:48.889682+0000 mgr.x (mgr.34562) 5011 : cluster [DBG] pgmap v3124: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:22:51.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:22:51 smithi188 bash[23329]: cluster 2020-07-16T15:22:50.890129+0000 mgr.x (mgr.34562) 5012 : cluster [DBG] pgmap v3125: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:22:51.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:22:51 smithi132 bash[27079]: cluster 2020-07-16T15:22:50.890129+0000 mgr.x (mgr.34562) 5012 : cluster [DBG] pgmap v3125: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:22:53.286 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:22:52 smithi132 bash[27079]: cluster 2020-07-16T15:22:52.890517+0000 mgr.x (mgr.34562) 5013 : cluster [DBG] pgmap v3126: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:22:53.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:22:52 smithi188 bash[23329]: cluster 2020-07-16T15:22:52.890517+0000 mgr.x (mgr.34562) 5013 : cluster [DBG] pgmap v3126: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:22:55.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:22:54 smithi132 bash[27079]: cluster 2020-07-16T15:22:54.890987+0000 mgr.x (mgr.34562) 5014 : cluster [DBG] pgmap v3127: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:22:55.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:22:54 smithi188 bash[23329]: cluster 2020-07-16T15:22:54.890987+0000 mgr.x (mgr.34562) 5014 : cluster [DBG] pgmap v3127: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:22:57.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:22:56 smithi132 bash[27079]: cluster 2020-07-16T15:22:56.891385+0000 mgr.x (mgr.34562) 5015 : cluster [DBG] pgmap v3128: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:22:57.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:22:56 smithi188 bash[23329]: cluster 2020-07-16T15:22:56.891385+0000 mgr.x (mgr.34562) 5015 : cluster [DBG] pgmap v3128: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:22:59.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:22:58 smithi132 bash[27079]: cluster 2020-07-16T15:22:58.891819+0000 mgr.x (mgr.34562) 5016 : cluster [DBG] pgmap v3129: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:22:59.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:22:58 smithi188 bash[23329]: cluster 2020-07-16T15:22:58.891819+0000 mgr.x (mgr.34562) 5016 : cluster [DBG] pgmap v3129: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:23:01.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:23:01 smithi188 bash[23329]: cluster 2020-07-16T15:23:00.892279+0000 mgr.x (mgr.34562) 5017 : cluster [DBG] pgmap v3130: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:23:01.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:23:01 smithi132 bash[27079]: cluster 2020-07-16T15:23:00.892279+0000 mgr.x (mgr.34562) 5017 : cluster [DBG] pgmap v3130: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:23:02.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:23:02 smithi188 bash[23329]: audit 2020-07-16T15:23:01.400380+0000 mon.b (mon.2) 1118 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:23:02.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:23:02 smithi188 bash[23329]: cephadm 2020-07-16T15:23:01.401020+0000 mgr.x (mgr.34562) 5018 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:23:02.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:23:02 smithi188 bash[23329]: cephadm 2020-07-16T15:23:01.401411+0000 mgr.x (mgr.34562) 5019 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:23:02.783 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:23:02 smithi132 bash[27079]: audit 2020-07-16T15:23:01.400380+0000 mon.b (mon.2) 1118 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:23:02.784 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:23:02 smithi132 bash[27079]: cephadm 2020-07-16T15:23:01.401020+0000 mgr.x (mgr.34562) 5018 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:23:02.784 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:23:02 smithi132 bash[27079]: cephadm 2020-07-16T15:23:01.401411+0000 mgr.x (mgr.34562) 5019 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:23:03.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:23:03 smithi188 bash[23329]: cluster 2020-07-16T15:23:02.892710+0000 mgr.x (mgr.34562) 5020 : cluster [DBG] pgmap v3131: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:23:03.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:23:03 smithi132 bash[27079]: cluster 2020-07-16T15:23:02.892710+0000 mgr.x (mgr.34562) 5020 : cluster [DBG] pgmap v3131: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:23:05.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:23:04 smithi132 bash[27079]: cluster 2020-07-16T15:23:04.893082+0000 mgr.x (mgr.34562) 5021 : cluster [DBG] pgmap v3132: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:23:05.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:23:04 smithi188 bash[23329]: cluster 2020-07-16T15:23:04.893082+0000 mgr.x (mgr.34562) 5021 : cluster [DBG] pgmap v3132: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:23:07.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:23:06 smithi132 bash[27079]: cluster 2020-07-16T15:23:06.893653+0000 mgr.x (mgr.34562) 5022 : cluster [DBG] pgmap v3133: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:23:07.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:23:06 smithi188 bash[23329]: cluster 2020-07-16T15:23:06.893653+0000 mgr.x (mgr.34562) 5022 : cluster [DBG] pgmap v3133: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:23:09.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:23:08 smithi132 bash[27079]: cluster 2020-07-16T15:23:08.894180+0000 mgr.x (mgr.34562) 5023 : cluster [DBG] pgmap v3134: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:23:09.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:23:08 smithi188 bash[23329]: cluster 2020-07-16T15:23:08.894180+0000 mgr.x (mgr.34562) 5023 : cluster [DBG] pgmap v3134: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:23:11.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:23:11 smithi188 bash[23329]: cluster 2020-07-16T15:23:10.894704+0000 mgr.x (mgr.34562) 5024 : cluster [DBG] pgmap v3135: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:23:11.793 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:23:11 smithi132 bash[27079]: cluster 2020-07-16T15:23:10.894704+0000 mgr.x (mgr.34562) 5024 : cluster [DBG] pgmap v3135: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:23:11.794 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:23:12.054 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:23:12.055 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (105m) 9m ago 108m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:23:12.055 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (108m) 9m ago 108m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:23:12.055 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (106m) 9m ago 111m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:23:12.055 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (105m) 9m ago 113m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:23:12.056 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 9m ago 113m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:23:12.056 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (112m) 9m ago 112m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:23:12.056 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (112m) 9m ago 112m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:23:12.056 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (109m) 9m ago 109m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:23:12.057 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (109m) 9m ago 109m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:23:12.057 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (111m) 9m ago 111m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:23:12.057 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (111m) 9m ago 111m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:23:12.057 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (110m) 9m ago 111m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:23:12.058 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (110m) 9m ago 110m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:23:12.058 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (110m) 9m ago 110m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:23:12.058 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (110m) 9m ago 110m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:23:12.058 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (109m) 9m ago 109m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:23:12.059 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (109m) 9m ago 109m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:23:12.059 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (108m) 9m ago 109m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:23:12.347 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:23:12.348 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:23:12.348 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:23:12.348 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:23:12.348 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:23:12.349 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:23:12.349 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:23:12.349 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:23:12.350 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:23:12.350 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:23:12.350 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:23:12.350 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:23:12.350 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:23:12.351 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:23:12.351 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:23:12.351 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:23:12.351 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:23:12.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:23:12 smithi188 bash[23329]: audit 2020-07-16T15:23:11.773857+0000 mgr.x (mgr.34562) 5025 : audit [DBG] from='client.28294 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:23:12.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:23:12 smithi188 bash[23329]: audit 2020-07-16T15:23:12.346926+0000 mon.c (mon.1) 355 : audit [DBG] from='client.? 172.21.15.132:0/521750448' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:23:12.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:23:12 smithi132 bash[27079]: audit 2020-07-16T15:23:11.773857+0000 mgr.x (mgr.34562) 5025 : audit [DBG] from='client.28294 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:23:12.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:23:12 smithi132 bash[27079]: audit 2020-07-16T15:23:12.346926+0000 mon.c (mon.1) 355 : audit [DBG] from='client.? 172.21.15.132:0/521750448' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:23:13.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:23:13 smithi188 bash[23329]: audit 2020-07-16T15:23:12.044275+0000 mgr.x (mgr.34562) 5026 : audit [DBG] from='client.28300 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:23:13.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:23:13 smithi188 bash[23329]: cluster 2020-07-16T15:23:12.895148+0000 mgr.x (mgr.34562) 5027 : cluster [DBG] pgmap v3136: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:23:13.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:23:13 smithi132 bash[27079]: audit 2020-07-16T15:23:12.044275+0000 mgr.x (mgr.34562) 5026 : audit [DBG] from='client.28300 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:23:13.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:23:13 smithi132 bash[27079]: cluster 2020-07-16T15:23:12.895148+0000 mgr.x (mgr.34562) 5027 : cluster [DBG] pgmap v3136: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:23:15.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:23:14 smithi132 bash[27079]: cluster 2020-07-16T15:23:14.895510+0000 mgr.x (mgr.34562) 5028 : cluster [DBG] pgmap v3137: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:23:15.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:23:14 smithi188 bash[23329]: cluster 2020-07-16T15:23:14.895510+0000 mgr.x (mgr.34562) 5028 : cluster [DBG] pgmap v3137: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:23:16.783 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:23:16 smithi132 bash[27079]: audit 2020-07-16T15:23:16.414599+0000 mon.b (mon.2) 1119 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:23:16.784 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:23:16 smithi132 bash[27079]: audit 2020-07-16T15:23:16.415965+0000 mon.b (mon.2) 1120 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:23:16.784 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:23:16 smithi132 bash[27079]: audit 2020-07-16T15:23:16.417126+0000 mon.b (mon.2) 1121 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:23:16.784 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:23:16 smithi132 bash[27079]: audit 2020-07-16T15:23:16.418361+0000 mon.b (mon.2) 1122 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:23:16.784 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:23:16 smithi132 bash[27079]: audit 2020-07-16T15:23:16.419564+0000 mon.b (mon.2) 1123 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:23:16.926 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:23:16 smithi188 bash[23329]: audit 2020-07-16T15:23:16.414599+0000 mon.b (mon.2) 1119 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:23:16.927 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:23:16 smithi188 bash[23329]: audit 2020-07-16T15:23:16.415965+0000 mon.b (mon.2) 1120 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:23:16.927 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:23:16 smithi188 bash[23329]: audit 2020-07-16T15:23:16.417126+0000 mon.b (mon.2) 1121 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:23:16.927 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:23:16 smithi188 bash[23329]: audit 2020-07-16T15:23:16.418361+0000 mon.b (mon.2) 1122 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:23:16.928 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:23:16 smithi188 bash[23329]: audit 2020-07-16T15:23:16.419564+0000 mon.b (mon.2) 1123 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:23:17.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:23:17 smithi132 bash[27079]: audit 2020-07-16T15:23:16.415023+0000 mgr.x (mgr.34562) 5029 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:23:17.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:23:17 smithi132 bash[27079]: audit 2020-07-16T15:23:16.416300+0000 mgr.x (mgr.34562) 5030 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:23:17.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:23:17 smithi132 bash[27079]: audit 2020-07-16T15:23:16.417416+0000 mgr.x (mgr.34562) 5031 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:23:17.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:23:17 smithi132 bash[27079]: cephadm 2020-07-16T15:23:16.418096+0000 mgr.x (mgr.34562) 5032 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:23:17.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:23:17 smithi132 bash[27079]: cephadm 2020-07-16T15:23:16.419176+0000 mgr.x (mgr.34562) 5033 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:23:17.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:23:17 smithi132 bash[27079]: cephadm 2020-07-16T15:23:16.420293+0000 mgr.x (mgr.34562) 5034 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:23:17.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:23:17 smithi132 bash[27079]: cephadm 2020-07-16T15:23:16.420363+0000 mgr.x (mgr.34562) 5035 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:23:17.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:23:17 smithi132 bash[27079]: cluster 2020-07-16T15:23:16.896051+0000 mgr.x (mgr.34562) 5036 : cluster [DBG] pgmap v3138: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:23:17.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:23:17 smithi188 bash[23329]: audit 2020-07-16T15:23:16.415023+0000 mgr.x (mgr.34562) 5029 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:23:17.925 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:23:17 smithi188 bash[23329]: audit 2020-07-16T15:23:16.416300+0000 mgr.x (mgr.34562) 5030 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:23:17.925 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:23:17 smithi188 bash[23329]: audit 2020-07-16T15:23:16.417416+0000 mgr.x (mgr.34562) 5031 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:23:17.925 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:23:17 smithi188 bash[23329]: cephadm 2020-07-16T15:23:16.418096+0000 mgr.x (mgr.34562) 5032 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:23:17.926 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:23:17 smithi188 bash[23329]: cephadm 2020-07-16T15:23:16.419176+0000 mgr.x (mgr.34562) 5033 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:23:17.926 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:23:17 smithi188 bash[23329]: cephadm 2020-07-16T15:23:16.420293+0000 mgr.x (mgr.34562) 5034 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:23:17.926 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:23:17 smithi188 bash[23329]: cephadm 2020-07-16T15:23:16.420363+0000 mgr.x (mgr.34562) 5035 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:23:17.926 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:23:17 smithi188 bash[23329]: cluster 2020-07-16T15:23:16.896051+0000 mgr.x (mgr.34562) 5036 : cluster [DBG] pgmap v3138: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:23:19.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:23:18 smithi132 bash[27079]: cluster 2020-07-16T15:23:18.896409+0000 mgr.x (mgr.34562) 5037 : cluster [DBG] pgmap v3139: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:23:19.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:23:18 smithi188 bash[23329]: cluster 2020-07-16T15:23:18.896409+0000 mgr.x (mgr.34562) 5037 : cluster [DBG] pgmap v3139: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:23:20.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:23:19 smithi132 bash[27079]: audit 2020-07-16T15:23:19.344881+0000 mon.b (mon.2) 1124 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:23:20.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:23:19 smithi132 bash[27079]: cephadm 2020-07-16T15:23:19.345515+0000 mgr.x (mgr.34562) 5038 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:23:20.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:23:19 smithi132 bash[27079]: cephadm 2020-07-16T15:23:19.345923+0000 mgr.x (mgr.34562) 5039 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:23:20.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:23:19 smithi188 bash[23329]: audit 2020-07-16T15:23:19.344881+0000 mon.b (mon.2) 1124 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:23:20.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:23:19 smithi188 bash[23329]: cephadm 2020-07-16T15:23:19.345515+0000 mgr.x (mgr.34562) 5038 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:23:20.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:23:19 smithi188 bash[23329]: cephadm 2020-07-16T15:23:19.345923+0000 mgr.x (mgr.34562) 5039 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:23:21.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:23:21 smithi188 bash[23329]: cluster 2020-07-16T15:23:20.896779+0000 mgr.x (mgr.34562) 5040 : cluster [DBG] pgmap v3140: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:23:21.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:23:21 smithi132 bash[27079]: cluster 2020-07-16T15:23:20.896779+0000 mgr.x (mgr.34562) 5040 : cluster [DBG] pgmap v3140: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:23:23.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:23:22 smithi132 bash[27079]: cluster 2020-07-16T15:23:22.897275+0000 mgr.x (mgr.34562) 5041 : cluster [DBG] pgmap v3141: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:23:23.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:23:22 smithi188 bash[23329]: cluster 2020-07-16T15:23:22.897275+0000 mgr.x (mgr.34562) 5041 : cluster [DBG] pgmap v3141: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:23:25.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:23:24 smithi132 bash[27079]: cluster 2020-07-16T15:23:24.897666+0000 mgr.x (mgr.34562) 5042 : cluster [DBG] pgmap v3142: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:23:25.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:23:24 smithi188 bash[23329]: cluster 2020-07-16T15:23:24.897666+0000 mgr.x (mgr.34562) 5042 : cluster [DBG] pgmap v3142: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:23:27.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:23:26 smithi132 bash[27079]: cluster 2020-07-16T15:23:26.898178+0000 mgr.x (mgr.34562) 5043 : cluster [DBG] pgmap v3143: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:23:27.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:23:26 smithi188 bash[23329]: cluster 2020-07-16T15:23:26.898178+0000 mgr.x (mgr.34562) 5043 : cluster [DBG] pgmap v3143: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:23:29.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:23:28 smithi132 bash[27079]: cluster 2020-07-16T15:23:28.898605+0000 mgr.x (mgr.34562) 5044 : cluster [DBG] pgmap v3144: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:23:29.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:23:28 smithi188 bash[23329]: cluster 2020-07-16T15:23:28.898605+0000 mgr.x (mgr.34562) 5044 : cluster [DBG] pgmap v3144: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:23:31.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:23:31 smithi188 bash[23329]: cluster 2020-07-16T15:23:30.899012+0000 mgr.x (mgr.34562) 5045 : cluster [DBG] pgmap v3145: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:23:31.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:23:31 smithi132 bash[27079]: cluster 2020-07-16T15:23:30.899012+0000 mgr.x (mgr.34562) 5045 : cluster [DBG] pgmap v3145: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:23:33.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:23:32 smithi132 bash[27079]: cluster 2020-07-16T15:23:32.899521+0000 mgr.x (mgr.34562) 5046 : cluster [DBG] pgmap v3146: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:23:33.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:23:32 smithi188 bash[23329]: cluster 2020-07-16T15:23:32.899521+0000 mgr.x (mgr.34562) 5046 : cluster [DBG] pgmap v3146: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:23:34.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:23:34 smithi188 bash[23329]: audit 2020-07-16T15:23:34.361528+0000 mon.b (mon.2) 1125 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:23:34.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:23:34 smithi132 bash[27079]: audit 2020-07-16T15:23:34.361528+0000 mon.b (mon.2) 1125 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:23:35.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:23:35 smithi132 bash[27079]: cephadm 2020-07-16T15:23:34.362235+0000 mgr.x (mgr.34562) 5047 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:23:35.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:23:35 smithi132 bash[27079]: cephadm 2020-07-16T15:23:34.362670+0000 mgr.x (mgr.34562) 5048 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:23:35.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:23:35 smithi132 bash[27079]: cluster 2020-07-16T15:23:34.900028+0000 mgr.x (mgr.34562) 5049 : cluster [DBG] pgmap v3147: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:23:35.926 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:23:35 smithi188 bash[23329]: cephadm 2020-07-16T15:23:34.362235+0000 mgr.x (mgr.34562) 5047 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:23:35.927 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:23:35 smithi188 bash[23329]: cephadm 2020-07-16T15:23:34.362670+0000 mgr.x (mgr.34562) 5048 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:23:35.927 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:23:35 smithi188 bash[23329]: cluster 2020-07-16T15:23:34.900028+0000 mgr.x (mgr.34562) 5049 : cluster [DBG] pgmap v3147: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:23:37.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:23:36 smithi132 bash[27079]: cluster 2020-07-16T15:23:36.900489+0000 mgr.x (mgr.34562) 5050 : cluster [DBG] pgmap v3148: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:23:37.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:23:36 smithi188 bash[23329]: cluster 2020-07-16T15:23:36.900489+0000 mgr.x (mgr.34562) 5050 : cluster [DBG] pgmap v3148: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:23:39.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:23:38 smithi132 bash[27079]: cluster 2020-07-16T15:23:38.900849+0000 mgr.x (mgr.34562) 5051 : cluster [DBG] pgmap v3149: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:23:39.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:23:38 smithi188 bash[23329]: cluster 2020-07-16T15:23:38.900849+0000 mgr.x (mgr.34562) 5051 : cluster [DBG] pgmap v3149: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:23:41.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:23:41 smithi188 bash[23329]: cluster 2020-07-16T15:23:40.901190+0000 mgr.x (mgr.34562) 5052 : cluster [DBG] pgmap v3150: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:23:41.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:23:41 smithi132 bash[27079]: cluster 2020-07-16T15:23:40.901190+0000 mgr.x (mgr.34562) 5052 : cluster [DBG] pgmap v3150: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:23:42.647 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:23:42.912 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:23:42.912 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (106m) 9m ago 109m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:23:42.912 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (109m) 9m ago 109m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:23:42.913 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (106m) 9m ago 112m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:23:42.913 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (106m) 9m ago 114m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:23:42.913 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 9m ago 114m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:23:42.913 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (112m) 9m ago 112m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:23:42.914 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (112m) 9m ago 112m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:23:42.914 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (109m) 9m ago 109m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:23:42.914 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (109m) 9m ago 109m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:23:42.914 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (112m) 9m ago 112m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:23:42.914 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (111m) 9m ago 111m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:23:42.915 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (111m) 9m ago 111m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:23:42.915 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (111m) 9m ago 111m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:23:42.915 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (110m) 9m ago 111m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:23:42.915 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (110m) 9m ago 110m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:23:42.915 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (110m) 9m ago 110m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:23:42.916 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (110m) 9m ago 110m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:23:42.916 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (108m) 9m ago 109m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:23:43.212 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:23:43.213 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:23:43.213 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:23:43.213 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:23:43.213 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:23:43.214 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:23:43.214 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:23:43.214 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:23:43.214 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:23:43.214 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:23:43.215 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:23:43.215 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:23:43.215 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:23:43.215 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:23:43.215 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:23:43.216 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:23:43.216 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:23:43.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:23:42 smithi132 bash[27079]: audit 2020-07-16T15:23:42.636259+0000 mgr.x (mgr.34562) 5053 : audit [DBG] from='client.28312 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:23:43.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:23:42 smithi132 bash[27079]: cluster 2020-07-16T15:23:42.901720+0000 mgr.x (mgr.34562) 5054 : cluster [DBG] pgmap v3151: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:23:43.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:23:42 smithi132 bash[27079]: audit 2020-07-16T15:23:42.906295+0000 mgr.x (mgr.34562) 5055 : audit [DBG] from='client.28318 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:23:43.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:23:42 smithi188 bash[23329]: audit 2020-07-16T15:23:42.636259+0000 mgr.x (mgr.34562) 5053 : audit [DBG] from='client.28312 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:23:43.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:23:42 smithi188 bash[23329]: cluster 2020-07-16T15:23:42.901720+0000 mgr.x (mgr.34562) 5054 : cluster [DBG] pgmap v3151: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:23:43.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:23:42 smithi188 bash[23329]: audit 2020-07-16T15:23:42.906295+0000 mgr.x (mgr.34562) 5055 : audit [DBG] from='client.28318 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:23:44.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:23:43 smithi132 bash[27079]: audit 2020-07-16T15:23:43.211924+0000 mon.c (mon.1) 356 : audit [DBG] from='client.? 172.21.15.132:0/1586819311' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:23:44.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:23:43 smithi188 bash[23329]: audit 2020-07-16T15:23:43.211924+0000 mon.c (mon.1) 356 : audit [DBG] from='client.? 172.21.15.132:0/1586819311' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:23:45.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:23:45 smithi132 bash[27079]: cluster 2020-07-16T15:23:44.902127+0000 mgr.x (mgr.34562) 5056 : cluster [DBG] pgmap v3152: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:23:45.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:23:45 smithi188 bash[23329]: cluster 2020-07-16T15:23:44.902127+0000 mgr.x (mgr.34562) 5056 : cluster [DBG] pgmap v3152: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:23:47.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:23:46 smithi132 bash[27079]: cluster 2020-07-16T15:23:46.902562+0000 mgr.x (mgr.34562) 5057 : cluster [DBG] pgmap v3153: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:23:47.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:23:46 smithi188 bash[23329]: cluster 2020-07-16T15:23:46.902562+0000 mgr.x (mgr.34562) 5057 : cluster [DBG] pgmap v3153: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:23:49.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:23:48 smithi132 bash[27079]: cluster 2020-07-16T15:23:48.903135+0000 mgr.x (mgr.34562) 5058 : cluster [DBG] pgmap v3154: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:23:49.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:23:48 smithi188 bash[23329]: cluster 2020-07-16T15:23:48.903135+0000 mgr.x (mgr.34562) 5058 : cluster [DBG] pgmap v3154: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:23:50.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:23:49 smithi132 bash[27079]: audit 2020-07-16T15:23:49.378028+0000 mon.b (mon.2) 1126 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:23:50.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:23:49 smithi132 bash[27079]: cephadm 2020-07-16T15:23:49.378740+0000 mgr.x (mgr.34562) 5059 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:23:50.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:23:49 smithi132 bash[27079]: cephadm 2020-07-16T15:23:49.379176+0000 mgr.x (mgr.34562) 5060 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:23:50.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:23:50 smithi188 bash[23329]: audit 2020-07-16T15:23:49.378028+0000 mon.b (mon.2) 1126 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:23:50.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:23:50 smithi188 bash[23329]: cephadm 2020-07-16T15:23:49.378740+0000 mgr.x (mgr.34562) 5059 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:23:50.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:23:50 smithi188 bash[23329]: cephadm 2020-07-16T15:23:49.379176+0000 mgr.x (mgr.34562) 5060 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:23:51.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:23:51 smithi188 bash[23329]: cluster 2020-07-16T15:23:50.903583+0000 mgr.x (mgr.34562) 5061 : cluster [DBG] pgmap v3155: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:23:51.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:23:51 smithi132 bash[27079]: cluster 2020-07-16T15:23:50.903583+0000 mgr.x (mgr.34562) 5061 : cluster [DBG] pgmap v3155: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:23:53.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:23:52 smithi132 bash[27079]: cluster 2020-07-16T15:23:52.904020+0000 mgr.x (mgr.34562) 5062 : cluster [DBG] pgmap v3156: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:23:53.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:23:52 smithi188 bash[23329]: cluster 2020-07-16T15:23:52.904020+0000 mgr.x (mgr.34562) 5062 : cluster [DBG] pgmap v3156: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:23:55.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:23:54 smithi132 bash[27079]: cluster 2020-07-16T15:23:54.904540+0000 mgr.x (mgr.34562) 5063 : cluster [DBG] pgmap v3157: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:23:55.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:23:55 smithi188 bash[23329]: cluster 2020-07-16T15:23:54.904540+0000 mgr.x (mgr.34562) 5063 : cluster [DBG] pgmap v3157: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:23:57.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:23:56 smithi132 bash[27079]: cluster 2020-07-16T15:23:56.905035+0000 mgr.x (mgr.34562) 5064 : cluster [DBG] pgmap v3158: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:23:57.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:23:56 smithi188 bash[23329]: cluster 2020-07-16T15:23:56.905035+0000 mgr.x (mgr.34562) 5064 : cluster [DBG] pgmap v3158: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:23:59.284 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:23:58 smithi132 bash[27079]: cluster 2020-07-16T15:23:58.905593+0000 mgr.x (mgr.34562) 5065 : cluster [DBG] pgmap v3159: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:23:59.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:23:59 smithi188 bash[23329]: cluster 2020-07-16T15:23:58.905593+0000 mgr.x (mgr.34562) 5065 : cluster [DBG] pgmap v3159: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:24:01.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:01 smithi188 bash[23329]: cluster 2020-07-16T15:24:00.906118+0000 mgr.x (mgr.34562) 5066 : cluster [DBG] pgmap v3160: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:24:01.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:01 smithi132 bash[27079]: cluster 2020-07-16T15:24:00.906118+0000 mgr.x (mgr.34562) 5066 : cluster [DBG] pgmap v3160: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:24:03.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:02 smithi132 bash[27079]: cluster 2020-07-16T15:24:02.906510+0000 mgr.x (mgr.34562) 5067 : cluster [DBG] pgmap v3161: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:24:03.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:02 smithi188 bash[23329]: cluster 2020-07-16T15:24:02.906510+0000 mgr.x (mgr.34562) 5067 : cluster [DBG] pgmap v3161: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:24:04.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:04 smithi132 bash[27079]: audit 2020-07-16T15:24:04.394778+0000 mon.b (mon.2) 1127 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:24:04.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:04 smithi188 bash[23329]: audit 2020-07-16T15:24:04.394778+0000 mon.b (mon.2) 1127 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:24:05.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:05 smithi132 bash[27079]: cephadm 2020-07-16T15:24:04.395492+0000 mgr.x (mgr.34562) 5068 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:24:05.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:05 smithi132 bash[27079]: cephadm 2020-07-16T15:24:04.395655+0000 mgr.x (mgr.34562) 5069 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:24:05.782 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:05 smithi132 bash[27079]: cluster 2020-07-16T15:24:04.907036+0000 mgr.x (mgr.34562) 5070 : cluster [DBG] pgmap v3162: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:24:05.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:05 smithi188 bash[23329]: cephadm 2020-07-16T15:24:04.395492+0000 mgr.x (mgr.34562) 5068 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:24:05.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:05 smithi188 bash[23329]: cephadm 2020-07-16T15:24:04.395655+0000 mgr.x (mgr.34562) 5069 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:24:05.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:05 smithi188 bash[23329]: cluster 2020-07-16T15:24:04.907036+0000 mgr.x (mgr.34562) 5070 : cluster [DBG] pgmap v3162: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:24:07.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:06 smithi132 bash[27079]: cluster 2020-07-16T15:24:06.907480+0000 mgr.x (mgr.34562) 5071 : cluster [DBG] pgmap v3163: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:24:07.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:07 smithi188 bash[23329]: cluster 2020-07-16T15:24:06.907480+0000 mgr.x (mgr.34562) 5071 : cluster [DBG] pgmap v3163: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:24:09.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:09 smithi132 bash[27079]: cluster 2020-07-16T15:24:08.907890+0000 mgr.x (mgr.34562) 5072 : cluster [DBG] pgmap v3164: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:24:09.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:09 smithi188 bash[23329]: cluster 2020-07-16T15:24:08.907890+0000 mgr.x (mgr.34562) 5072 : cluster [DBG] pgmap v3164: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:24:11.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:11 smithi188 bash[23329]: cluster 2020-07-16T15:24:10.908376+0000 mgr.x (mgr.34562) 5073 : cluster [DBG] pgmap v3165: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:24:11.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:11 smithi132 bash[27079]: cluster 2020-07-16T15:24:10.908376+0000 mgr.x (mgr.34562) 5073 : cluster [DBG] pgmap v3165: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:24:13.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:13 smithi132 bash[27079]: cluster 2020-07-16T15:24:12.908687+0000 mgr.x (mgr.34562) 5074 : cluster [DBG] pgmap v3166: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:24:13.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:13 smithi188 bash[23329]: cluster 2020-07-16T15:24:12.908687+0000 mgr.x (mgr.34562) 5074 : cluster [DBG] pgmap v3166: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:24:13.508 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:24:13.768 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:24:13.768 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (106m) 10m ago 110m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:24:13.769 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (109m) 10m ago 109m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:24:13.769 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (107m) 10m ago 112m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:24:13.770 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (106m) 10m ago 114m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:24:13.770 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 10m ago 114m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:24:13.770 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (113m) 10m ago 113m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:24:13.771 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (113m) 10m ago 113m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:24:13.771 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (110m) 10m ago 110m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:24:13.771 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (110m) 10m ago 110m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:24:13.772 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (112m) 10m ago 112m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:24:13.772 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (112m) 10m ago 112m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:24:13.772 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (112m) 10m ago 112m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:24:13.773 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (111m) 10m ago 111m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:24:13.773 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (111m) 10m ago 111m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:24:13.773 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (111m) 10m ago 111m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:24:13.774 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (110m) 10m ago 110m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:24:13.774 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (110m) 10m ago 110m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:24:13.774 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (109m) 10m ago 110m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:24:14.065 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:24:14.066 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:24:14.066 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:24:14.066 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:24:14.066 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:24:14.067 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:24:14.067 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:24:14.067 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:24:14.067 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:24:14.068 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:24:14.068 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:24:14.068 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:24:14.068 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:24:14.068 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:24:14.069 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:24:14.069 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:24:14.069 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:24:14.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:14 smithi132 bash[27079]: audit 2020-07-16T15:24:13.496267+0000 mgr.x (mgr.34562) 5075 : audit [DBG] from='client.28330 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:24:14.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:14 smithi132 bash[27079]: audit 2020-07-16T15:24:13.763412+0000 mgr.x (mgr.34562) 5076 : audit [DBG] from='client.28336 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:24:14.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:14 smithi188 bash[23329]: audit 2020-07-16T15:24:13.496267+0000 mgr.x (mgr.34562) 5075 : audit [DBG] from='client.28330 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:24:14.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:14 smithi188 bash[23329]: audit 2020-07-16T15:24:13.763412+0000 mgr.x (mgr.34562) 5076 : audit [DBG] from='client.28336 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:24:15.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:15 smithi132 bash[27079]: audit 2020-07-16T15:24:14.064324+0000 mon.c (mon.1) 357 : audit [DBG] from='client.? 172.21.15.132:0/2684077835' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:24:15.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:15 smithi132 bash[27079]: cluster 2020-07-16T15:24:14.909105+0000 mgr.x (mgr.34562) 5077 : cluster [DBG] pgmap v3167: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:24:15.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:15 smithi188 bash[23329]: audit 2020-07-16T15:24:14.064324+0000 mon.c (mon.1) 357 : audit [DBG] from='client.? 172.21.15.132:0/2684077835' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:24:15.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:15 smithi188 bash[23329]: cluster 2020-07-16T15:24:14.909105+0000 mgr.x (mgr.34562) 5077 : cluster [DBG] pgmap v3167: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:24:17.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:17 smithi132 bash[27079]: cluster 2020-07-16T15:24:16.909636+0000 mgr.x (mgr.34562) 5078 : cluster [DBG] pgmap v3168: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:24:17.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:17 smithi188 bash[23329]: cluster 2020-07-16T15:24:16.909636+0000 mgr.x (mgr.34562) 5078 : cluster [DBG] pgmap v3168: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:24:19.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:19 smithi132 bash[27079]: cluster 2020-07-16T15:24:18.910034+0000 mgr.x (mgr.34562) 5079 : cluster [DBG] pgmap v3169: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:24:19.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:19 smithi188 bash[23329]: cluster 2020-07-16T15:24:18.910034+0000 mgr.x (mgr.34562) 5079 : cluster [DBG] pgmap v3169: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:24:20.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:20 smithi188 bash[23329]: audit 2020-07-16T15:24:19.411954+0000 mon.b (mon.2) 1128 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T15:24:20.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:20 smithi188 bash[23329]: audit 2020-07-16T15:24:19.412237+0000 mon.b (mon.2) 1129 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T15:24:20.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:20 smithi132 bash[27079]: audit 2020-07-16T15:24:19.411954+0000 mon.b (mon.2) 1128 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T15:24:20.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:20 smithi132 bash[27079]: audit 2020-07-16T15:24:19.412237+0000 mon.b (mon.2) 1129 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T15:24:21.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:21 smithi188 bash[23329]: cluster 2020-07-16T15:24:20.910397+0000 mgr.x (mgr.34562) 5080 : cluster [DBG] pgmap v3170: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:24:21.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:21 smithi132 bash[27079]: cluster 2020-07-16T15:24:20.910397+0000 mgr.x (mgr.34562) 5080 : cluster [DBG] pgmap v3170: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:24:22.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:22 smithi188 bash[23329]: audit 2020-07-16T15:24:21.601357+0000 mon.b (mon.2) 1130 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:24:21.599807\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.599866\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.599902\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.599933\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.600110\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.600212\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.600338\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.600441\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.600475\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:24:21.600546\", \"last_device_update\": \"2020-07-16T15:04:18.042470\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:15:55.434716\"}"}]: dispatch 2020-07-16T15:24:22.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:22 smithi188 bash[23329]: audit 2020-07-16T15:24:21.601801+0000 mon.c (mon.1) 358 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:24:21.599807\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.599866\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.599902\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.599933\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.600110\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.600212\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.600338\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.600441\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.600475\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:24:21.600546\", \"last_device_update\": \"2020-07-16T15:04:18.042470\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:15:55.434716\"}"}]: dispatch 2020-07-16T15:24:22.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:22 smithi188 bash[23329]: audit 2020-07-16T15:24:21.604450+0000 mon.c (mon.1) 359 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:24:21.599807\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.599866\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.599902\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.599933\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.600110\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.600212\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.600338\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.600441\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.600475\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:24:21.600546\", \"last_device_update\": \"2020-07-16T15:04:18.042470\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:15:55.434716\"}"}]': finished 2020-07-16T15:24:22.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:22 smithi188 bash[23329]: audit 2020-07-16T15:24:21.928525+0000 mon.b (mon.2) 1131 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.926983\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927054\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927086\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927263\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927394\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927497\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927614\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927646\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927674\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:24:21.927741\", \"last_device_update\": \"2020-07-16T15:05:23.895950\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:15:55.433337\"}"}]: dispatch 2020-07-16T15:24:22.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:22 smithi188 bash[23329]: audit 2020-07-16T15:24:21.929161+0000 mon.c (mon.1) 360 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.926983\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927054\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927086\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927263\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927394\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927497\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927614\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927646\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927674\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:24:21.927741\", \"last_device_update\": \"2020-07-16T15:05:23.895950\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:15:55.433337\"}"}]: dispatch 2020-07-16T15:24:22.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:22 smithi188 bash[23329]: audit 2020-07-16T15:24:21.931595+0000 mon.c (mon.1) 361 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.926983\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927054\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927086\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927263\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927394\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927497\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927614\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927646\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927674\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:24:21.927741\", \"last_device_update\": \"2020-07-16T15:05:23.895950\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:15:55.433337\"}"}]': finished 2020-07-16T15:24:22.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:22 smithi188 bash[23329]: audit 2020-07-16T15:24:21.934588+0000 mon.b (mon.2) 1132 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:24:22.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:22 smithi188 bash[23329]: audit 2020-07-16T15:24:21.934864+0000 mgr.x (mgr.34562) 5081 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:24:22.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:22 smithi188 bash[23329]: audit 2020-07-16T15:24:21.935547+0000 mon.b (mon.2) 1133 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:24:22.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:22 smithi188 bash[23329]: audit 2020-07-16T15:24:21.935801+0000 mgr.x (mgr.34562) 5082 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:24:22.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:22 smithi188 bash[23329]: audit 2020-07-16T15:24:21.936387+0000 mon.b (mon.2) 1134 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:24:22.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:22 smithi188 bash[23329]: audit 2020-07-16T15:24:21.936610+0000 mgr.x (mgr.34562) 5083 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:24:22.675 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:22 smithi188 bash[23329]: cephadm 2020-07-16T15:24:21.937139+0000 mgr.x (mgr.34562) 5084 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:24:22.675 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:22 smithi188 bash[23329]: audit 2020-07-16T15:24:21.937365+0000 mon.b (mon.2) 1135 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:24:22.675 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:22 smithi188 bash[23329]: cephadm 2020-07-16T15:24:21.937986+0000 mgr.x (mgr.34562) 5085 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:24:22.675 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:22 smithi188 bash[23329]: audit 2020-07-16T15:24:21.938286+0000 mon.b (mon.2) 1136 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:24:22.675 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:22 smithi188 bash[23329]: cephadm 2020-07-16T15:24:21.938772+0000 mgr.x (mgr.34562) 5086 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:24:22.676 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:22 smithi188 bash[23329]: cephadm 2020-07-16T15:24:21.938855+0000 mgr.x (mgr.34562) 5087 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:24:22.687 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:22 smithi132 bash[27079]: audit 2020-07-16T15:24:21.601357+0000 mon.b (mon.2) 1130 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:24:21.599807\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.599866\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.599902\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.599933\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.600110\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.600212\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.600338\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.600441\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.600475\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:24:21.600546\", \"last_device_update\": \"2020-07-16T15:04:18.042470\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:15:55.434716\"}"}]: dispatch 2020-07-16T15:24:22.687 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:22 smithi132 bash[27079]: audit 2020-07-16T15:24:21.601801+0000 mon.c (mon.1) 358 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:24:21.599807\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.599866\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.599902\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.599933\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.600110\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.600212\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.600338\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.600441\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.600475\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:24:21.600546\", \"last_device_update\": \"2020-07-16T15:04:18.042470\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:15:55.434716\"}"}]: dispatch 2020-07-16T15:24:22.688 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:22 smithi132 bash[27079]: audit 2020-07-16T15:24:21.604450+0000 mon.c (mon.1) 359 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:24:21.599807\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.599866\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.599902\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.599933\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.600110\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.600212\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.600338\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.600441\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.600475\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:24:21.600546\", \"last_device_update\": \"2020-07-16T15:04:18.042470\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:15:55.434716\"}"}]': finished 2020-07-16T15:24:22.688 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:22 smithi132 bash[27079]: audit 2020-07-16T15:24:21.928525+0000 mon.b (mon.2) 1131 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.926983\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927054\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927086\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927263\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927394\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927497\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927614\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927646\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927674\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:24:21.927741\", \"last_device_update\": \"2020-07-16T15:05:23.895950\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:15:55.433337\"}"}]: dispatch 2020-07-16T15:24:22.688 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:22 smithi132 bash[27079]: audit 2020-07-16T15:24:21.929161+0000 mon.c (mon.1) 360 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.926983\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927054\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927086\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927263\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927394\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927497\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927614\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927646\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927674\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:24:21.927741\", \"last_device_update\": \"2020-07-16T15:05:23.895950\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:15:55.433337\"}"}]: dispatch 2020-07-16T15:24:22.689 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:22 smithi132 bash[27079]: audit 2020-07-16T15:24:21.931595+0000 mon.c (mon.1) 361 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.926983\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927054\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927086\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927263\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927394\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927497\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927614\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927646\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927674\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:24:21.927741\", \"last_device_update\": \"2020-07-16T15:05:23.895950\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:15:55.433337\"}"}]': finished 2020-07-16T15:24:22.689 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:22 smithi132 bash[27079]: audit 2020-07-16T15:24:21.934588+0000 mon.b (mon.2) 1132 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:24:22.689 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:22 smithi132 bash[27079]: audit 2020-07-16T15:24:21.934864+0000 mgr.x (mgr.34562) 5081 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:24:22.689 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:22 smithi132 bash[27079]: audit 2020-07-16T15:24:21.935547+0000 mon.b (mon.2) 1133 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:24:22.690 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:22 smithi132 bash[27079]: audit 2020-07-16T15:24:21.935801+0000 mgr.x (mgr.34562) 5082 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:24:22.690 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:22 smithi132 bash[27079]: audit 2020-07-16T15:24:21.936387+0000 mon.b (mon.2) 1134 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:24:22.690 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:22 smithi132 bash[27079]: audit 2020-07-16T15:24:21.936610+0000 mgr.x (mgr.34562) 5083 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:24:22.690 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:22 smithi132 bash[27079]: cephadm 2020-07-16T15:24:21.937139+0000 mgr.x (mgr.34562) 5084 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:24:22.690 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:22 smithi132 bash[27079]: audit 2020-07-16T15:24:21.937365+0000 mon.b (mon.2) 1135 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:24:22.691 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:22 smithi132 bash[27079]: cephadm 2020-07-16T15:24:21.937986+0000 mgr.x (mgr.34562) 5085 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:24:22.691 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:22 smithi132 bash[27079]: audit 2020-07-16T15:24:21.938286+0000 mon.b (mon.2) 1136 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:24:22.691 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:22 smithi132 bash[27079]: cephadm 2020-07-16T15:24:21.938772+0000 mgr.x (mgr.34562) 5086 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:24:22.691 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:22 smithi132 bash[27079]: cephadm 2020-07-16T15:24:21.938855+0000 mgr.x (mgr.34562) 5087 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:24:23.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:23 smithi188 bash[23329]: cluster 2020-07-16T15:24:22.910821+0000 mgr.x (mgr.34562) 5088 : cluster [DBG] pgmap v3171: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:24:23.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:23 smithi132 bash[27079]: cluster 2020-07-16T15:24:22.910821+0000 mgr.x (mgr.34562) 5088 : cluster [DBG] pgmap v3171: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:24:25.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:24 smithi132 bash[27079]: audit 2020-07-16T15:24:24.775073+0000 mon.b (mon.2) 1137 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:24:25.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:24 smithi188 bash[23329]: audit 2020-07-16T15:24:24.775073+0000 mon.b (mon.2) 1137 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:24:26.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:25 smithi188 bash[23329]: cephadm 2020-07-16T15:24:24.775695+0000 mgr.x (mgr.34562) 5089 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:24:26.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:25 smithi188 bash[23329]: cephadm 2020-07-16T15:24:24.775920+0000 mgr.x (mgr.34562) 5090 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:24:26.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:25 smithi188 bash[23329]: cluster 2020-07-16T15:24:24.911349+0000 mgr.x (mgr.34562) 5091 : cluster [DBG] pgmap v3172: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:24:26.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:25 smithi132 bash[27079]: cephadm 2020-07-16T15:24:24.775695+0000 mgr.x (mgr.34562) 5089 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:24:26.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:25 smithi132 bash[27079]: cephadm 2020-07-16T15:24:24.775920+0000 mgr.x (mgr.34562) 5090 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:24:26.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:25 smithi132 bash[27079]: cluster 2020-07-16T15:24:24.911349+0000 mgr.x (mgr.34562) 5091 : cluster [DBG] pgmap v3172: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:24:27.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:27 smithi132 bash[27079]: cluster 2020-07-16T15:24:26.911723+0000 mgr.x (mgr.34562) 5092 : cluster [DBG] pgmap v3173: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:24:27.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:27 smithi188 bash[23329]: cluster 2020-07-16T15:24:26.911723+0000 mgr.x (mgr.34562) 5092 : cluster [DBG] pgmap v3173: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:24:29.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:29 smithi132 bash[27079]: cluster 2020-07-16T15:24:28.912056+0000 mgr.x (mgr.34562) 5093 : cluster [DBG] pgmap v3174: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:24:29.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:29 smithi188 bash[23329]: cluster 2020-07-16T15:24:28.912056+0000 mgr.x (mgr.34562) 5093 : cluster [DBG] pgmap v3174: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:24:31.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:31 smithi188 bash[23329]: cluster 2020-07-16T15:24:30.912365+0000 mgr.x (mgr.34562) 5094 : cluster [DBG] pgmap v3175: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:24:31.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:31 smithi132 bash[27079]: cluster 2020-07-16T15:24:30.912365+0000 mgr.x (mgr.34562) 5094 : cluster [DBG] pgmap v3175: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:24:33.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:33 smithi132 bash[27079]: cluster 2020-07-16T15:24:32.912875+0000 mgr.x (mgr.34562) 5095 : cluster [DBG] pgmap v3176: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:24:33.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:33 smithi188 bash[23329]: cluster 2020-07-16T15:24:32.912875+0000 mgr.x (mgr.34562) 5095 : cluster [DBG] pgmap v3176: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:24:35.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:35 smithi132 bash[27079]: cluster 2020-07-16T15:24:34.913241+0000 mgr.x (mgr.34562) 5096 : cluster [DBG] pgmap v3177: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:24:35.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:35 smithi188 bash[23329]: cluster 2020-07-16T15:24:34.913241+0000 mgr.x (mgr.34562) 5096 : cluster [DBG] pgmap v3177: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:24:37.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:37 smithi132 bash[27079]: cluster 2020-07-16T15:24:36.913833+0000 mgr.x (mgr.34562) 5097 : cluster [DBG] pgmap v3178: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:24:37.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:37 smithi188 bash[23329]: cluster 2020-07-16T15:24:36.913833+0000 mgr.x (mgr.34562) 5097 : cluster [DBG] pgmap v3178: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:24:39.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:39 smithi132 bash[27079]: cluster 2020-07-16T15:24:38.914313+0000 mgr.x (mgr.34562) 5098 : cluster [DBG] pgmap v3179: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:24:39.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:39 smithi188 bash[23329]: cluster 2020-07-16T15:24:38.914313+0000 mgr.x (mgr.34562) 5098 : cluster [DBG] pgmap v3179: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:24:40.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:40 smithi132 bash[27079]: audit 2020-07-16T15:24:39.781193+0000 mon.b (mon.2) 1138 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:24:40.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:40 smithi132 bash[27079]: cephadm 2020-07-16T15:24:39.781954+0000 mgr.x (mgr.34562) 5099 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:24:40.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:40 smithi132 bash[27079]: cephadm 2020-07-16T15:24:39.782419+0000 mgr.x (mgr.34562) 5100 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:24:40.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:40 smithi188 bash[23329]: audit 2020-07-16T15:24:39.781193+0000 mon.b (mon.2) 1138 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:24:40.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:40 smithi188 bash[23329]: cephadm 2020-07-16T15:24:39.781954+0000 mgr.x (mgr.34562) 5099 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:24:40.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:40 smithi188 bash[23329]: cephadm 2020-07-16T15:24:39.782419+0000 mgr.x (mgr.34562) 5100 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:24:41.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:41 smithi188 bash[23329]: cluster 2020-07-16T15:24:40.914680+0000 mgr.x (mgr.34562) 5101 : cluster [DBG] pgmap v3180: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:24:41.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:41 smithi132 bash[27079]: cluster 2020-07-16T15:24:40.914680+0000 mgr.x (mgr.34562) 5101 : cluster [DBG] pgmap v3180: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:24:43.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:43 smithi132 bash[27079]: cluster 2020-07-16T15:24:42.915249+0000 mgr.x (mgr.34562) 5102 : cluster [DBG] pgmap v3181: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:24:43.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:43 smithi188 bash[23329]: cluster 2020-07-16T15:24:42.915249+0000 mgr.x (mgr.34562) 5102 : cluster [DBG] pgmap v3181: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:24:44.364 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:24:44.627 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:24:44.628 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (107m) 23s ago 110m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:24:44.628 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (110m) 22s ago 110m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:24:44.628 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (107m) 22s ago 113m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:24:44.628 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (107m) 23s ago 115m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:24:44.628 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 23s ago 115m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:24:44.629 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (113m) 22s ago 113m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:24:44.629 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (113m) 23s ago 113m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:24:44.629 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (110m) 23s ago 110m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:24:44.629 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (110m) 22s ago 110m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:24:44.629 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (113m) 23s ago 113m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:24:44.630 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (112m) 23s ago 112m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:24:44.630 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (112m) 23s ago 112m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:24:44.630 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (112m) 23s ago 112m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:24:44.630 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (111m) 22s ago 112m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:24:44.630 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (111m) 22s ago 111m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:24:44.631 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (111m) 22s ago 111m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:24:44.631 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (111m) 22s ago 111m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:24:44.631 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (109m) 22s ago 110m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:24:44.927 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:24:44.927 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:24:44.928 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:24:44.928 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:24:44.928 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:24:44.928 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:24:44.929 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:24:44.929 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:24:44.929 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:24:44.929 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:24:44.929 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:24:44.930 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:24:44.930 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:24:44.930 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:24:44.930 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:24:44.930 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:24:44.930 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:24:45.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:44 smithi132 bash[27079]: audit 2020-07-16T15:24:44.353582+0000 mgr.x (mgr.34562) 5103 : audit [DBG] from='client.28348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:24:45.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:44 smithi132 bash[27079]: audit 2020-07-16T15:24:44.623250+0000 mgr.x (mgr.34562) 5104 : audit [DBG] from='client.28354 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:24:45.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:44 smithi132 bash[27079]: cluster 2020-07-16T15:24:44.915629+0000 mgr.x (mgr.34562) 5105 : cluster [DBG] pgmap v3182: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:24:45.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:44 smithi132 bash[27079]: audit 2020-07-16T15:24:44.926204+0000 mon.c (mon.1) 362 : audit [DBG] from='client.? 172.21.15.132:0/4173047643' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:24:45.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:44 smithi188 bash[23329]: audit 2020-07-16T15:24:44.353582+0000 mgr.x (mgr.34562) 5103 : audit [DBG] from='client.28348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:24:45.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:44 smithi188 bash[23329]: audit 2020-07-16T15:24:44.623250+0000 mgr.x (mgr.34562) 5104 : audit [DBG] from='client.28354 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:24:45.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:44 smithi188 bash[23329]: cluster 2020-07-16T15:24:44.915629+0000 mgr.x (mgr.34562) 5105 : cluster [DBG] pgmap v3182: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:24:45.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:44 smithi188 bash[23329]: audit 2020-07-16T15:24:44.926204+0000 mon.c (mon.1) 362 : audit [DBG] from='client.? 172.21.15.132:0/4173047643' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:24:47.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:47 smithi132 bash[27079]: cluster 2020-07-16T15:24:46.916079+0000 mgr.x (mgr.34562) 5106 : cluster [DBG] pgmap v3183: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:24:47.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:47 smithi188 bash[23329]: cluster 2020-07-16T15:24:46.916079+0000 mgr.x (mgr.34562) 5106 : cluster [DBG] pgmap v3183: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:24:49.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:49 smithi132 bash[27079]: cluster 2020-07-16T15:24:48.916442+0000 mgr.x (mgr.34562) 5107 : cluster [DBG] pgmap v3184: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:24:49.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:49 smithi188 bash[23329]: cluster 2020-07-16T15:24:48.916442+0000 mgr.x (mgr.34562) 5107 : cluster [DBG] pgmap v3184: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:24:51.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:51 smithi188 bash[23329]: cluster 2020-07-16T15:24:50.916740+0000 mgr.x (mgr.34562) 5108 : cluster [DBG] pgmap v3185: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:24:51.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:51 smithi132 bash[27079]: cluster 2020-07-16T15:24:50.916740+0000 mgr.x (mgr.34562) 5108 : cluster [DBG] pgmap v3185: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:24:53.284 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:53 smithi132 bash[27079]: cluster 2020-07-16T15:24:52.917303+0000 mgr.x (mgr.34562) 5109 : cluster [DBG] pgmap v3186: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:24:53.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:53 smithi188 bash[23329]: cluster 2020-07-16T15:24:52.917303+0000 mgr.x (mgr.34562) 5109 : cluster [DBG] pgmap v3186: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:24:55.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:54 smithi188 bash[23329]: audit 2020-07-16T15:24:54.797998+0000 mon.b (mon.2) 1139 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:24:55.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:54 smithi132 bash[27079]: audit 2020-07-16T15:24:54.797998+0000 mon.b (mon.2) 1139 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:24:56.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:55 smithi188 bash[23329]: cephadm 2020-07-16T15:24:54.798737+0000 mgr.x (mgr.34562) 5110 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:24:56.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:55 smithi188 bash[23329]: cephadm 2020-07-16T15:24:54.799174+0000 mgr.x (mgr.34562) 5111 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:24:56.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:55 smithi188 bash[23329]: cluster 2020-07-16T15:24:54.917892+0000 mgr.x (mgr.34562) 5112 : cluster [DBG] pgmap v3187: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:24:56.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:55 smithi132 bash[27079]: cephadm 2020-07-16T15:24:54.798737+0000 mgr.x (mgr.34562) 5110 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:24:56.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:55 smithi132 bash[27079]: cephadm 2020-07-16T15:24:54.799174+0000 mgr.x (mgr.34562) 5111 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:24:56.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:55 smithi132 bash[27079]: cluster 2020-07-16T15:24:54.917892+0000 mgr.x (mgr.34562) 5112 : cluster [DBG] pgmap v3187: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:24:57.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:57 smithi132 bash[27079]: cluster 2020-07-16T15:24:56.918516+0000 mgr.x (mgr.34562) 5113 : cluster [DBG] pgmap v3188: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:24:57.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:57 smithi188 bash[23329]: cluster 2020-07-16T15:24:56.918516+0000 mgr.x (mgr.34562) 5113 : cluster [DBG] pgmap v3188: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:24:59.290 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:24:59 smithi132 bash[27079]: cluster 2020-07-16T15:24:58.919070+0000 mgr.x (mgr.34562) 5114 : cluster [DBG] pgmap v3189: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:24:59.425 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:24:59 smithi188 bash[23329]: cluster 2020-07-16T15:24:58.919070+0000 mgr.x (mgr.34562) 5114 : cluster [DBG] pgmap v3189: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:25:01.681 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:25:01 smithi188 bash[23329]: cluster 2020-07-16T15:25:00.919645+0000 mgr.x (mgr.34562) 5115 : cluster [DBG] pgmap v3190: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:25:01.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:25:01 smithi132 bash[27079]: cluster 2020-07-16T15:25:00.919645+0000 mgr.x (mgr.34562) 5115 : cluster [DBG] pgmap v3190: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:25:03.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:25:03 smithi132 bash[27079]: cluster 2020-07-16T15:25:02.920073+0000 mgr.x (mgr.34562) 5116 : cluster [DBG] pgmap v3191: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:25:03.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:25:03 smithi188 bash[23329]: cluster 2020-07-16T15:25:02.920073+0000 mgr.x (mgr.34562) 5116 : cluster [DBG] pgmap v3191: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:25:05.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:25:05 smithi132 bash[27079]: cluster 2020-07-16T15:25:04.920398+0000 mgr.x (mgr.34562) 5117 : cluster [DBG] pgmap v3192: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:25:05.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:25:05 smithi188 bash[23329]: cluster 2020-07-16T15:25:04.920398+0000 mgr.x (mgr.34562) 5117 : cluster [DBG] pgmap v3192: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:25:07.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:25:07 smithi132 bash[27079]: cluster 2020-07-16T15:25:06.920961+0000 mgr.x (mgr.34562) 5118 : cluster [DBG] pgmap v3193: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:25:07.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:25:07 smithi188 bash[23329]: cluster 2020-07-16T15:25:06.920961+0000 mgr.x (mgr.34562) 5118 : cluster [DBG] pgmap v3193: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:25:09.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:25:09 smithi132 bash[27079]: cluster 2020-07-16T15:25:08.921441+0000 mgr.x (mgr.34562) 5119 : cluster [DBG] pgmap v3194: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:25:09.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:25:09 smithi188 bash[23329]: cluster 2020-07-16T15:25:08.921441+0000 mgr.x (mgr.34562) 5119 : cluster [DBG] pgmap v3194: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:25:10.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:25:10 smithi132 bash[27079]: audit 2020-07-16T15:25:09.814678+0000 mon.b (mon.2) 1140 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:25:10.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:25:10 smithi132 bash[27079]: cephadm 2020-07-16T15:25:09.815413+0000 mgr.x (mgr.34562) 5120 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:25:10.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:25:10 smithi132 bash[27079]: cephadm 2020-07-16T15:25:09.815653+0000 mgr.x (mgr.34562) 5121 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:25:10.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:25:10 smithi188 bash[23329]: audit 2020-07-16T15:25:09.814678+0000 mon.b (mon.2) 1140 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:25:10.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:25:10 smithi188 bash[23329]: cephadm 2020-07-16T15:25:09.815413+0000 mgr.x (mgr.34562) 5120 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:25:10.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:25:10 smithi188 bash[23329]: cephadm 2020-07-16T15:25:09.815653+0000 mgr.x (mgr.34562) 5121 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:25:11.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:25:11 smithi188 bash[23329]: cluster 2020-07-16T15:25:10.921981+0000 mgr.x (mgr.34562) 5122 : cluster [DBG] pgmap v3195: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:25:11.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:25:11 smithi132 bash[27079]: cluster 2020-07-16T15:25:10.921981+0000 mgr.x (mgr.34562) 5122 : cluster [DBG] pgmap v3195: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:25:13.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:25:13 smithi132 bash[27079]: cluster 2020-07-16T15:25:12.922420+0000 mgr.x (mgr.34562) 5123 : cluster [DBG] pgmap v3196: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:25:13.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:25:13 smithi188 bash[23329]: cluster 2020-07-16T15:25:12.922420+0000 mgr.x (mgr.34562) 5123 : cluster [DBG] pgmap v3196: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:25:15.236 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:25:15.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:25:15 smithi132 bash[27079]: cluster 2020-07-16T15:25:14.922819+0000 mgr.x (mgr.34562) 5124 : cluster [DBG] pgmap v3197: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:25:15.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:25:15 smithi188 bash[23329]: cluster 2020-07-16T15:25:14.922819+0000 mgr.x (mgr.34562) 5124 : cluster [DBG] pgmap v3197: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:25:15.499 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:25:15.500 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (108m) 53s ago 111m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:25:15.500 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (110m) 53s ago 110m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:25:15.500 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (108m) 53s ago 113m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:25:15.501 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (107m) 53s ago 115m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:25:15.501 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 53s ago 115m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:25:15.501 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (114m) 53s ago 114m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:25:15.501 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (114m) 53s ago 114m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:25:15.502 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (111m) 53s ago 111m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:25:15.502 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (111m) 53s ago 111m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:25:15.502 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (113m) 53s ago 113m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:25:15.502 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (113m) 53s ago 113m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:25:15.503 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (113m) 53s ago 113m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:25:15.503 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (112m) 53s ago 112m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:25:15.503 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (112m) 53s ago 112m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:25:15.503 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (112m) 53s ago 112m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:25:15.504 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (111m) 53s ago 111m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:25:15.504 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (111m) 53s ago 111m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:25:15.504 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (110m) 53s ago 111m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:25:15.794 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:25:15.794 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:25:15.794 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:25:15.794 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:25:15.795 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:25:15.795 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:25:15.795 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:25:15.795 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:25:15.795 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:25:15.796 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:25:15.796 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:25:15.796 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:25:15.796 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:25:15.796 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:25:15.797 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:25:15.797 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:25:15.797 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:25:16.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:25:16 smithi188 bash[23329]: audit 2020-07-16T15:25:15.224917+0000 mgr.x (mgr.34562) 5125 : audit [DBG] from='client.28366 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:25:16.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:25:16 smithi188 bash[23329]: audit 2020-07-16T15:25:15.495172+0000 mgr.x (mgr.34562) 5126 : audit [DBG] from='client.28372 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:25:16.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:25:16 smithi188 bash[23329]: audit 2020-07-16T15:25:15.792996+0000 mon.c (mon.1) 363 : audit [DBG] from='client.? 172.21.15.132:0/3472871325' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:25:16.782 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:25:16 smithi132 bash[27079]: audit 2020-07-16T15:25:15.224917+0000 mgr.x (mgr.34562) 5125 : audit [DBG] from='client.28366 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:25:16.782 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:25:16 smithi132 bash[27079]: audit 2020-07-16T15:25:15.495172+0000 mgr.x (mgr.34562) 5126 : audit [DBG] from='client.28372 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:25:16.783 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:25:16 smithi132 bash[27079]: audit 2020-07-16T15:25:15.792996+0000 mon.c (mon.1) 363 : audit [DBG] from='client.? 172.21.15.132:0/3472871325' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:25:17.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:25:17 smithi188 bash[23329]: cluster 2020-07-16T15:25:16.923218+0000 mgr.x (mgr.34562) 5127 : cluster [DBG] pgmap v3198: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:25:17.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:25:17 smithi132 bash[27079]: cluster 2020-07-16T15:25:16.923218+0000 mgr.x (mgr.34562) 5127 : cluster [DBG] pgmap v3198: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:25:19.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:25:19 smithi132 bash[27079]: cluster 2020-07-16T15:25:18.923717+0000 mgr.x (mgr.34562) 5128 : cluster [DBG] pgmap v3199: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:25:19.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:25:19 smithi188 bash[23329]: cluster 2020-07-16T15:25:18.923717+0000 mgr.x (mgr.34562) 5128 : cluster [DBG] pgmap v3199: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:25:21.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:25:21 smithi188 bash[23329]: cluster 2020-07-16T15:25:20.924234+0000 mgr.x (mgr.34562) 5129 : cluster [DBG] pgmap v3200: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:25:21.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:25:21 smithi132 bash[27079]: cluster 2020-07-16T15:25:20.924234+0000 mgr.x (mgr.34562) 5129 : cluster [DBG] pgmap v3200: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:25:23.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:25:23 smithi132 bash[27079]: cluster 2020-07-16T15:25:22.924680+0000 mgr.x (mgr.34562) 5130 : cluster [DBG] pgmap v3201: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:25:23.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:25:23 smithi188 bash[23329]: cluster 2020-07-16T15:25:22.924680+0000 mgr.x (mgr.34562) 5130 : cluster [DBG] pgmap v3201: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:25:25.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:25:24 smithi188 bash[23329]: audit 2020-07-16T15:25:24.820231+0000 mon.b (mon.2) 1141 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:25:25.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:25:24 smithi188 bash[23329]: audit 2020-07-16T15:25:24.821590+0000 mon.b (mon.2) 1142 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:25:25.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:25:24 smithi188 bash[23329]: audit 2020-07-16T15:25:24.822753+0000 mon.b (mon.2) 1143 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:25:25.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:25:24 smithi188 bash[23329]: audit 2020-07-16T15:25:24.824154+0000 mon.b (mon.2) 1144 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:25:25.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:25:24 smithi188 bash[23329]: audit 2020-07-16T15:25:24.825423+0000 mon.b (mon.2) 1145 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:25:25.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:25:24 smithi132 bash[27079]: audit 2020-07-16T15:25:24.820231+0000 mon.b (mon.2) 1141 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:25:25.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:25:24 smithi132 bash[27079]: audit 2020-07-16T15:25:24.821590+0000 mon.b (mon.2) 1142 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:25:25.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:25:24 smithi132 bash[27079]: audit 2020-07-16T15:25:24.822753+0000 mon.b (mon.2) 1143 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:25:25.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:25:24 smithi132 bash[27079]: audit 2020-07-16T15:25:24.824154+0000 mon.b (mon.2) 1144 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:25:25.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:25:24 smithi132 bash[27079]: audit 2020-07-16T15:25:24.825423+0000 mon.b (mon.2) 1145 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:25:26.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:25:25 smithi132 bash[27079]: audit 2020-07-16T15:25:24.820602+0000 mgr.x (mgr.34562) 5131 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:25:26.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:25:25 smithi132 bash[27079]: audit 2020-07-16T15:25:24.821912+0000 mgr.x (mgr.34562) 5132 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:25:26.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:25:25 smithi132 bash[27079]: audit 2020-07-16T15:25:24.823060+0000 mgr.x (mgr.34562) 5133 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:25:26.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:25:25 smithi132 bash[27079]: cephadm 2020-07-16T15:25:24.823813+0000 mgr.x (mgr.34562) 5134 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:25:26.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:25:25 smithi132 bash[27079]: cephadm 2020-07-16T15:25:24.825009+0000 mgr.x (mgr.34562) 5135 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:25:26.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:25:25 smithi132 bash[27079]: cephadm 2020-07-16T15:25:24.826145+0000 mgr.x (mgr.34562) 5136 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:25:26.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:25:25 smithi132 bash[27079]: cephadm 2020-07-16T15:25:24.826354+0000 mgr.x (mgr.34562) 5137 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:25:26.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:25:25 smithi132 bash[27079]: cluster 2020-07-16T15:25:24.925188+0000 mgr.x (mgr.34562) 5138 : cluster [DBG] pgmap v3202: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:25:26.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:25:25 smithi188 bash[23329]: audit 2020-07-16T15:25:24.820602+0000 mgr.x (mgr.34562) 5131 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:25:26.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:25:25 smithi188 bash[23329]: audit 2020-07-16T15:25:24.821912+0000 mgr.x (mgr.34562) 5132 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:25:26.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:25:25 smithi188 bash[23329]: audit 2020-07-16T15:25:24.823060+0000 mgr.x (mgr.34562) 5133 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:25:26.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:25:25 smithi188 bash[23329]: cephadm 2020-07-16T15:25:24.823813+0000 mgr.x (mgr.34562) 5134 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:25:26.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:25:25 smithi188 bash[23329]: cephadm 2020-07-16T15:25:24.825009+0000 mgr.x (mgr.34562) 5135 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:25:26.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:25:25 smithi188 bash[23329]: cephadm 2020-07-16T15:25:24.826145+0000 mgr.x (mgr.34562) 5136 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:25:26.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:25:25 smithi188 bash[23329]: cephadm 2020-07-16T15:25:24.826354+0000 mgr.x (mgr.34562) 5137 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:25:26.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:25:25 smithi188 bash[23329]: cluster 2020-07-16T15:25:24.925188+0000 mgr.x (mgr.34562) 5138 : cluster [DBG] pgmap v3202: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:25:27.117 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:25:27 smithi132 bash[27079]: cluster 2020-07-16T15:25:26.925725+0000 mgr.x (mgr.34562) 5139 : cluster [DBG] pgmap v3203: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:25:27.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:25:27 smithi188 bash[23329]: cluster 2020-07-16T15:25:26.925725+0000 mgr.x (mgr.34562) 5139 : cluster [DBG] pgmap v3203: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:25:28.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:25:28 smithi132 bash[27079]: audit 2020-07-16T15:25:27.703078+0000 mon.b (mon.2) 1146 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:25:28.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:25:28 smithi132 bash[27079]: cephadm 2020-07-16T15:25:27.703739+0000 mgr.x (mgr.34562) 5140 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:25:28.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:25:28 smithi132 bash[27079]: cephadm 2020-07-16T15:25:27.704132+0000 mgr.x (mgr.34562) 5141 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:25:28.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:25:28 smithi188 bash[23329]: audit 2020-07-16T15:25:27.703078+0000 mon.b (mon.2) 1146 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:25:28.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:25:28 smithi188 bash[23329]: cephadm 2020-07-16T15:25:27.703739+0000 mgr.x (mgr.34562) 5140 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:25:28.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:25:28 smithi188 bash[23329]: cephadm 2020-07-16T15:25:27.704132+0000 mgr.x (mgr.34562) 5141 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:25:29.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:25:29 smithi132 bash[27079]: cluster 2020-07-16T15:25:28.926076+0000 mgr.x (mgr.34562) 5142 : cluster [DBG] pgmap v3204: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:25:29.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:25:29 smithi188 bash[23329]: cluster 2020-07-16T15:25:28.926076+0000 mgr.x (mgr.34562) 5142 : cluster [DBG] pgmap v3204: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:25:31.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:25:31 smithi188 bash[23329]: cluster 2020-07-16T15:25:30.926594+0000 mgr.x (mgr.34562) 5143 : cluster [DBG] pgmap v3205: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:25:31.785 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:25:31 smithi132 bash[27079]: cluster 2020-07-16T15:25:30.926594+0000 mgr.x (mgr.34562) 5143 : cluster [DBG] pgmap v3205: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:25:33.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:25:33 smithi132 bash[27079]: cluster 2020-07-16T15:25:32.927115+0000 mgr.x (mgr.34562) 5144 : cluster [DBG] pgmap v3206: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:25:33.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:25:33 smithi188 bash[23329]: cluster 2020-07-16T15:25:32.927115+0000 mgr.x (mgr.34562) 5144 : cluster [DBG] pgmap v3206: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:25:35.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:25:35 smithi132 bash[27079]: cluster 2020-07-16T15:25:34.927660+0000 mgr.x (mgr.34562) 5145 : cluster [DBG] pgmap v3207: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:25:35.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:25:35 smithi188 bash[23329]: cluster 2020-07-16T15:25:34.927660+0000 mgr.x (mgr.34562) 5145 : cluster [DBG] pgmap v3207: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:25:37.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:25:37 smithi132 bash[27079]: cluster 2020-07-16T15:25:36.928135+0000 mgr.x (mgr.34562) 5146 : cluster [DBG] pgmap v3208: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:25:37.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:25:37 smithi188 bash[23329]: cluster 2020-07-16T15:25:36.928135+0000 mgr.x (mgr.34562) 5146 : cluster [DBG] pgmap v3208: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:25:39.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:25:39 smithi132 bash[27079]: cluster 2020-07-16T15:25:38.928621+0000 mgr.x (mgr.34562) 5147 : cluster [DBG] pgmap v3209: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:25:39.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:25:39 smithi188 bash[23329]: cluster 2020-07-16T15:25:38.928621+0000 mgr.x (mgr.34562) 5147 : cluster [DBG] pgmap v3209: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:25:41.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:25:41 smithi188 bash[23329]: cluster 2020-07-16T15:25:40.929084+0000 mgr.x (mgr.34562) 5148 : cluster [DBG] pgmap v3210: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:25:41.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:25:41 smithi132 bash[27079]: cluster 2020-07-16T15:25:40.929084+0000 mgr.x (mgr.34562) 5148 : cluster [DBG] pgmap v3210: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:25:43.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:25:42 smithi132 bash[27079]: audit 2020-07-16T15:25:42.710679+0000 mon.b (mon.2) 1147 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:25:43.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:25:42 smithi188 bash[23329]: audit 2020-07-16T15:25:42.710679+0000 mon.b (mon.2) 1147 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:25:44.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:25:43 smithi132 bash[27079]: cephadm 2020-07-16T15:25:42.711463+0000 mgr.x (mgr.34562) 5149 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:25:44.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:25:43 smithi132 bash[27079]: cephadm 2020-07-16T15:25:42.711616+0000 mgr.x (mgr.34562) 5150 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:25:44.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:25:43 smithi132 bash[27079]: cluster 2020-07-16T15:25:42.929492+0000 mgr.x (mgr.34562) 5151 : cluster [DBG] pgmap v3211: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:25:44.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:25:43 smithi188 bash[23329]: cephadm 2020-07-16T15:25:42.711463+0000 mgr.x (mgr.34562) 5149 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:25:44.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:25:43 smithi188 bash[23329]: cephadm 2020-07-16T15:25:42.711616+0000 mgr.x (mgr.34562) 5150 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:25:44.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:25:43 smithi188 bash[23329]: cluster 2020-07-16T15:25:42.929492+0000 mgr.x (mgr.34562) 5151 : cluster [DBG] pgmap v3211: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:25:45.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:25:45 smithi132 bash[27079]: cluster 2020-07-16T15:25:44.929817+0000 mgr.x (mgr.34562) 5152 : cluster [DBG] pgmap v3212: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:25:45.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:25:45 smithi188 bash[23329]: cluster 2020-07-16T15:25:44.929817+0000 mgr.x (mgr.34562) 5152 : cluster [DBG] pgmap v3212: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:25:46.090 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:25:46.353 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:25:46.353 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (108m) 84s ago 111m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:25:46.354 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (111m) 84s ago 111m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:25:46.354 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (108m) 84s ago 114m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:25:46.354 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (108m) 84s ago 116m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:25:46.354 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 84s ago 116m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:25:46.354 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (114m) 84s ago 114m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:25:46.355 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (114m) 84s ago 114m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:25:46.355 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (111m) 84s ago 111m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:25:46.355 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (111m) 84s ago 111m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:25:46.355 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (114m) 84s ago 114m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:25:46.355 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (113m) 84s ago 113m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:25:46.356 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (113m) 84s ago 113m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:25:46.356 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (113m) 84s ago 113m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:25:46.356 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (112m) 84s ago 113m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:25:46.356 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (112m) 84s ago 112m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:25:46.356 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (112m) 84s ago 112m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:25:46.357 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (112m) 84s ago 112m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:25:46.357 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (110m) 84s ago 111m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:25:46.647 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:25:46.647 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:25:46.647 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:25:46.648 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:25:46.648 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:25:46.648 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:25:46.648 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:25:46.648 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:25:46.649 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:25:46.649 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:25:46.649 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:25:46.649 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:25:46.649 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:25:46.649 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:25:46.650 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:25:46.650 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:25:46.650 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:25:47.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:25:46 smithi132 bash[27079]: audit 2020-07-16T15:25:46.646304+0000 mon.c (mon.1) 364 : audit [DBG] from='client.? 172.21.15.132:0/94855789' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:25:47.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:25:46 smithi188 bash[23329]: audit 2020-07-16T15:25:46.646304+0000 mon.c (mon.1) 364 : audit [DBG] from='client.? 172.21.15.132:0/94855789' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:25:48.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:25:47 smithi132 bash[27079]: audit 2020-07-16T15:25:46.078934+0000 mgr.x (mgr.34562) 5153 : audit [DBG] from='client.28384 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:25:48.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:25:47 smithi132 bash[27079]: audit 2020-07-16T15:25:46.346922+0000 mgr.x (mgr.34562) 5154 : audit [DBG] from='client.28390 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:25:48.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:25:47 smithi132 bash[27079]: cluster 2020-07-16T15:25:46.930212+0000 mgr.x (mgr.34562) 5155 : cluster [DBG] pgmap v3213: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:25:48.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:25:47 smithi188 bash[23329]: audit 2020-07-16T15:25:46.078934+0000 mgr.x (mgr.34562) 5153 : audit [DBG] from='client.28384 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:25:48.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:25:47 smithi188 bash[23329]: audit 2020-07-16T15:25:46.346922+0000 mgr.x (mgr.34562) 5154 : audit [DBG] from='client.28390 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:25:48.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:25:47 smithi188 bash[23329]: cluster 2020-07-16T15:25:46.930212+0000 mgr.x (mgr.34562) 5155 : cluster [DBG] pgmap v3213: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:25:49.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:25:49 smithi132 bash[27079]: cluster 2020-07-16T15:25:48.930596+0000 mgr.x (mgr.34562) 5156 : cluster [DBG] pgmap v3214: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:25:49.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:25:49 smithi188 bash[23329]: cluster 2020-07-16T15:25:48.930596+0000 mgr.x (mgr.34562) 5156 : cluster [DBG] pgmap v3214: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:25:51.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:25:51 smithi188 bash[23329]: cluster 2020-07-16T15:25:50.931067+0000 mgr.x (mgr.34562) 5157 : cluster [DBG] pgmap v3215: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:25:51.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:25:51 smithi132 bash[27079]: cluster 2020-07-16T15:25:50.931067+0000 mgr.x (mgr.34562) 5157 : cluster [DBG] pgmap v3215: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:25:53.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:25:53 smithi132 bash[27079]: cluster 2020-07-16T15:25:52.931563+0000 mgr.x (mgr.34562) 5158 : cluster [DBG] pgmap v3216: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:25:53.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:25:53 smithi188 bash[23329]: cluster 2020-07-16T15:25:52.931563+0000 mgr.x (mgr.34562) 5158 : cluster [DBG] pgmap v3216: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:25:55.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:25:55 smithi132 bash[27079]: cluster 2020-07-16T15:25:54.932064+0000 mgr.x (mgr.34562) 5159 : cluster [DBG] pgmap v3217: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:25:55.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:25:55 smithi188 bash[23329]: cluster 2020-07-16T15:25:54.932064+0000 mgr.x (mgr.34562) 5159 : cluster [DBG] pgmap v3217: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:25:57.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:25:57 smithi132 bash[27079]: cluster 2020-07-16T15:25:56.932634+0000 mgr.x (mgr.34562) 5160 : cluster [DBG] pgmap v3218: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:25:57.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:25:57 smithi188 bash[23329]: cluster 2020-07-16T15:25:56.932634+0000 mgr.x (mgr.34562) 5160 : cluster [DBG] pgmap v3218: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:25:58.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:25:58 smithi132 bash[27079]: audit 2020-07-16T15:25:57.717062+0000 mon.b (mon.2) 1148 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:25:58.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:25:58 smithi132 bash[27079]: cephadm 2020-07-16T15:25:57.717810+0000 mgr.x (mgr.34562) 5161 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:25:58.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:25:58 smithi132 bash[27079]: cephadm 2020-07-16T15:25:57.718200+0000 mgr.x (mgr.34562) 5162 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:25:58.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:25:58 smithi188 bash[23329]: audit 2020-07-16T15:25:57.717062+0000 mon.b (mon.2) 1148 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:25:58.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:25:58 smithi188 bash[23329]: cephadm 2020-07-16T15:25:57.717810+0000 mgr.x (mgr.34562) 5161 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:25:58.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:25:58 smithi188 bash[23329]: cephadm 2020-07-16T15:25:57.718200+0000 mgr.x (mgr.34562) 5162 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:25:59.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:25:59 smithi132 bash[27079]: cluster 2020-07-16T15:25:58.932985+0000 mgr.x (mgr.34562) 5163 : cluster [DBG] pgmap v3219: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:25:59.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:25:59 smithi188 bash[23329]: cluster 2020-07-16T15:25:58.932985+0000 mgr.x (mgr.34562) 5163 : cluster [DBG] pgmap v3219: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:26:01.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:26:01 smithi188 bash[23329]: cluster 2020-07-16T15:26:00.933428+0000 mgr.x (mgr.34562) 5164 : cluster [DBG] pgmap v3220: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:26:01.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:26:01 smithi132 bash[27079]: cluster 2020-07-16T15:26:00.933428+0000 mgr.x (mgr.34562) 5164 : cluster [DBG] pgmap v3220: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:26:03.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:26:03 smithi132 bash[27079]: cluster 2020-07-16T15:26:02.933911+0000 mgr.x (mgr.34562) 5165 : cluster [DBG] pgmap v3221: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:26:03.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:26:03 smithi188 bash[23329]: cluster 2020-07-16T15:26:02.933911+0000 mgr.x (mgr.34562) 5165 : cluster [DBG] pgmap v3221: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:26:05.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:26:05 smithi132 bash[27079]: cluster 2020-07-16T15:26:04.934253+0000 mgr.x (mgr.34562) 5166 : cluster [DBG] pgmap v3222: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:26:05.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:26:05 smithi188 bash[23329]: cluster 2020-07-16T15:26:04.934253+0000 mgr.x (mgr.34562) 5166 : cluster [DBG] pgmap v3222: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:26:07.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:26:07 smithi132 bash[27079]: cluster 2020-07-16T15:26:06.934648+0000 mgr.x (mgr.34562) 5167 : cluster [DBG] pgmap v3223: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:26:07.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:26:07 smithi188 bash[23329]: cluster 2020-07-16T15:26:06.934648+0000 mgr.x (mgr.34562) 5167 : cluster [DBG] pgmap v3223: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:26:09.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:26:09 smithi132 bash[27079]: cluster 2020-07-16T15:26:08.935088+0000 mgr.x (mgr.34562) 5168 : cluster [DBG] pgmap v3224: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:26:09.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:26:09 smithi188 bash[23329]: cluster 2020-07-16T15:26:08.935088+0000 mgr.x (mgr.34562) 5168 : cluster [DBG] pgmap v3224: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:26:11.677 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:26:11 smithi188 bash[23329]: cluster 2020-07-16T15:26:10.935583+0000 mgr.x (mgr.34562) 5169 : cluster [DBG] pgmap v3225: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:26:11.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:26:11 smithi132 bash[27079]: cluster 2020-07-16T15:26:10.935583+0000 mgr.x (mgr.34562) 5169 : cluster [DBG] pgmap v3225: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:26:13.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:26:12 smithi188 bash[23329]: audit 2020-07-16T15:26:12.733784+0000 mon.b (mon.2) 1149 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:26:13.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:26:12 smithi132 bash[27079]: audit 2020-07-16T15:26:12.733784+0000 mon.b (mon.2) 1149 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:26:14.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:26:13 smithi188 bash[23329]: cephadm 2020-07-16T15:26:12.734527+0000 mgr.x (mgr.34562) 5170 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:26:14.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:26:13 smithi188 bash[23329]: cephadm 2020-07-16T15:26:12.734977+0000 mgr.x (mgr.34562) 5171 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:26:14.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:26:13 smithi188 bash[23329]: cluster 2020-07-16T15:26:12.936127+0000 mgr.x (mgr.34562) 5172 : cluster [DBG] pgmap v3226: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:26:14.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:26:13 smithi132 bash[27079]: cephadm 2020-07-16T15:26:12.734527+0000 mgr.x (mgr.34562) 5170 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:26:14.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:26:13 smithi132 bash[27079]: cephadm 2020-07-16T15:26:12.734977+0000 mgr.x (mgr.34562) 5171 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:26:14.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:26:13 smithi132 bash[27079]: cluster 2020-07-16T15:26:12.936127+0000 mgr.x (mgr.34562) 5172 : cluster [DBG] pgmap v3226: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:26:15.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:26:15 smithi132 bash[27079]: cluster 2020-07-16T15:26:14.936543+0000 mgr.x (mgr.34562) 5173 : cluster [DBG] pgmap v3227: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:26:15.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:26:15 smithi188 bash[23329]: cluster 2020-07-16T15:26:14.936543+0000 mgr.x (mgr.34562) 5173 : cluster [DBG] pgmap v3227: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:26:16.946 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:26:17.208 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:26:17.209 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (109m) 115s ago 112m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:26:17.209 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (111m) 115s ago 111m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:26:17.209 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (109m) 115s ago 114m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:26:17.210 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (108m) 115s ago 116m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:26:17.210 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 115s ago 116m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:26:17.210 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (115m) 115s ago 115m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:26:17.210 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (115m) 115s ago 115m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:26:17.210 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (112m) 115s ago 112m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:26:17.211 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (112m) 115s ago 112m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:26:17.211 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (114m) 115s ago 114m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:26:17.211 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (114m) 115s ago 114m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:26:17.211 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (114m) 115s ago 114m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:26:17.211 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (113m) 115s ago 113m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:26:17.212 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (113m) 115s ago 113m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:26:17.212 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (113m) 115s ago 113m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:26:17.212 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (112m) 115s ago 112m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:26:17.212 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (112m) 115s ago 112m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:26:17.212 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (111m) 115s ago 112m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:26:17.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:26:17 smithi132 bash[27079]: audit 2020-07-16T15:26:16.935400+0000 mgr.x (mgr.34562) 5174 : audit [DBG] from='client.28402 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:26:17.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:26:17 smithi132 bash[27079]: cluster 2020-07-16T15:26:16.936880+0000 mgr.x (mgr.34562) 5175 : cluster [DBG] pgmap v3228: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:26:17.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:26:17 smithi188 bash[23329]: audit 2020-07-16T15:26:16.935400+0000 mgr.x (mgr.34562) 5174 : audit [DBG] from='client.28402 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:26:17.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:26:17 smithi188 bash[23329]: cluster 2020-07-16T15:26:16.936880+0000 mgr.x (mgr.34562) 5175 : cluster [DBG] pgmap v3228: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:26:17.507 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:26:17.507 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:26:17.508 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:26:17.508 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:26:17.508 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:26:17.508 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:26:17.508 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:26:17.509 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:26:17.509 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:26:17.509 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:26:17.509 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:26:17.509 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:26:17.510 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:26:17.510 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:26:17.510 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:26:17.510 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:26:17.510 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:26:18.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:26:18 smithi132 bash[27079]: audit 2020-07-16T15:26:17.204562+0000 mgr.x (mgr.34562) 5176 : audit [DBG] from='client.28408 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:26:18.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:26:18 smithi132 bash[27079]: audit 2020-07-16T15:26:17.506496+0000 mon.c (mon.1) 365 : audit [DBG] from='client.? 172.21.15.132:0/1293342086' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:26:18.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:26:18 smithi188 bash[23329]: audit 2020-07-16T15:26:17.204562+0000 mgr.x (mgr.34562) 5176 : audit [DBG] from='client.28408 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:26:18.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:26:18 smithi188 bash[23329]: audit 2020-07-16T15:26:17.506496+0000 mon.c (mon.1) 365 : audit [DBG] from='client.? 172.21.15.132:0/1293342086' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:26:19.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:26:19 smithi188 bash[23329]: cluster 2020-07-16T15:26:18.937302+0000 mgr.x (mgr.34562) 5177 : cluster [DBG] pgmap v3229: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:26:19.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:26:19 smithi132 bash[27079]: cluster 2020-07-16T15:26:18.937302+0000 mgr.x (mgr.34562) 5177 : cluster [DBG] pgmap v3229: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:26:21.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:26:21 smithi188 bash[23329]: cluster 2020-07-16T15:26:20.937768+0000 mgr.x (mgr.34562) 5178 : cluster [DBG] pgmap v3230: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:26:21.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:26:21 smithi132 bash[27079]: cluster 2020-07-16T15:26:20.937768+0000 mgr.x (mgr.34562) 5178 : cluster [DBG] pgmap v3230: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:26:23.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:26:23 smithi132 bash[27079]: cluster 2020-07-16T15:26:22.938356+0000 mgr.x (mgr.34562) 5179 : cluster [DBG] pgmap v3231: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:26:23.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:26:23 smithi188 bash[23329]: cluster 2020-07-16T15:26:22.938356+0000 mgr.x (mgr.34562) 5179 : cluster [DBG] pgmap v3231: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:26:25.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:26:25 smithi132 bash[27079]: cluster 2020-07-16T15:26:24.938848+0000 mgr.x (mgr.34562) 5180 : cluster [DBG] pgmap v3232: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:26:25.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:26:25 smithi188 bash[23329]: cluster 2020-07-16T15:26:24.938848+0000 mgr.x (mgr.34562) 5180 : cluster [DBG] pgmap v3232: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:26:27.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:26:27 smithi132 bash[27079]: cluster 2020-07-16T15:26:26.939272+0000 mgr.x (mgr.34562) 5181 : cluster [DBG] pgmap v3233: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:26:27.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:26:27 smithi188 bash[23329]: cluster 2020-07-16T15:26:26.939272+0000 mgr.x (mgr.34562) 5181 : cluster [DBG] pgmap v3233: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:26:28.323 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:26:28 smithi188 bash[23329]: audit 2020-07-16T15:26:27.975663+0000 mon.b (mon.2) 1150 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:24:21.599807\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.599866\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.599902\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.599933\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.600110\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.600212\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.600338\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.600441\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.600475\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:24:21.600546\", \"last_device_update\": \"2020-07-16T15:04:18.042470\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:26:27.974828\"}"}]: dispatch 2020-07-16T15:26:28.323 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:26:28 smithi188 bash[23329]: audit 2020-07-16T15:26:27.976064+0000 mon.c (mon.1) 366 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:24:21.599807\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.599866\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.599902\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.599933\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.600110\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.600212\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.600338\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.600441\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.600475\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:24:21.600546\", \"last_device_update\": \"2020-07-16T15:04:18.042470\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:26:27.974828\"}"}]: dispatch 2020-07-16T15:26:28.324 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:26:28 smithi188 bash[23329]: audit 2020-07-16T15:26:27.978696+0000 mon.c (mon.1) 367 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:24:21.599807\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.599866\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.599902\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.599933\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.600110\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.600212\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.600338\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.600441\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.600475\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:24:21.600546\", \"last_device_update\": \"2020-07-16T15:04:18.042470\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:26:27.974828\"}"}]': finished 2020-07-16T15:26:28.324 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:26:28 smithi188 bash[23329]: audit 2020-07-16T15:26:27.979657+0000 mon.b (mon.2) 1151 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.926983\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927054\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927086\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927263\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927394\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927497\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927614\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927646\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927674\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:24:21.927741\", \"last_device_update\": \"2020-07-16T15:05:23.895950\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:26:27.978565\"}"}]: dispatch 2020-07-16T15:26:28.324 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:26:28 smithi188 bash[23329]: audit 2020-07-16T15:26:27.980192+0000 mon.c (mon.1) 368 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.926983\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927054\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927086\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927263\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927394\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927497\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927614\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927646\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927674\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:24:21.927741\", \"last_device_update\": \"2020-07-16T15:05:23.895950\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:26:27.978565\"}"}]: dispatch 2020-07-16T15:26:28.325 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:26:28 smithi188 bash[23329]: audit 2020-07-16T15:26:27.982130+0000 mon.c (mon.1) 369 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.926983\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927054\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927086\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927263\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927394\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927497\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927614\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927646\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927674\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:24:21.927741\", \"last_device_update\": \"2020-07-16T15:05:23.895950\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:26:27.978565\"}"}]': finished 2020-07-16T15:26:28.325 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:26:28 smithi188 bash[23329]: audit 2020-07-16T15:26:27.986806+0000 mon.b (mon.2) 1152 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:26:28.325 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:26:28 smithi188 bash[23329]: audit 2020-07-16T15:26:27.987763+0000 mon.b (mon.2) 1153 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:26:28.325 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:26:28 smithi188 bash[23329]: audit 2020-07-16T15:26:27.988605+0000 mon.b (mon.2) 1154 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:26:28.330 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:26:28 smithi188 bash[23329]: audit 2020-07-16T15:26:27.989569+0000 mon.b (mon.2) 1155 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:26:28.331 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:26:28 smithi188 bash[23329]: audit 2020-07-16T15:26:27.990550+0000 mon.b (mon.2) 1156 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:26:28.468 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:26:28 smithi132 bash[27079]: audit 2020-07-16T15:26:27.975663+0000 mon.b (mon.2) 1150 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:24:21.599807\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.599866\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.599902\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.599933\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.600110\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.600212\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.600338\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.600441\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.600475\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:24:21.600546\", \"last_device_update\": \"2020-07-16T15:04:18.042470\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:26:27.974828\"}"}]: dispatch 2020-07-16T15:26:28.468 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:26:28 smithi132 bash[27079]: audit 2020-07-16T15:26:27.976064+0000 mon.c (mon.1) 366 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:24:21.599807\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.599866\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.599902\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.599933\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.600110\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.600212\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.600338\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.600441\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.600475\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:24:21.600546\", \"last_device_update\": \"2020-07-16T15:04:18.042470\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:26:27.974828\"}"}]: dispatch 2020-07-16T15:26:28.469 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:26:28 smithi132 bash[27079]: audit 2020-07-16T15:26:27.978696+0000 mon.c (mon.1) 367 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:24:21.599807\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.599866\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.599902\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.599933\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.600110\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.600212\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.600338\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.600441\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.600475\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:24:21.600546\", \"last_device_update\": \"2020-07-16T15:04:18.042470\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:26:27.974828\"}"}]': finished 2020-07-16T15:26:28.469 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:26:28 smithi132 bash[27079]: audit 2020-07-16T15:26:27.979657+0000 mon.b (mon.2) 1151 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.926983\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927054\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927086\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927263\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927394\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927497\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927614\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927646\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927674\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:24:21.927741\", \"last_device_update\": \"2020-07-16T15:05:23.895950\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:26:27.978565\"}"}]: dispatch 2020-07-16T15:26:28.469 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:26:28 smithi132 bash[27079]: audit 2020-07-16T15:26:27.980192+0000 mon.c (mon.1) 368 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.926983\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927054\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927086\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927263\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927394\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927497\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927614\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927646\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927674\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:24:21.927741\", \"last_device_update\": \"2020-07-16T15:05:23.895950\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:26:27.978565\"}"}]: dispatch 2020-07-16T15:26:28.470 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:26:28 smithi132 bash[27079]: audit 2020-07-16T15:26:27.982130+0000 mon.c (mon.1) 369 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.926983\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927054\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927086\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927263\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927394\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927497\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927614\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927646\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:24:21.927674\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:24:21.927741\", \"last_device_update\": \"2020-07-16T15:05:23.895950\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:26:27.978565\"}"}]': finished 2020-07-16T15:26:28.470 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:26:28 smithi132 bash[27079]: audit 2020-07-16T15:26:27.986806+0000 mon.b (mon.2) 1152 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:26:28.470 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:26:28 smithi132 bash[27079]: audit 2020-07-16T15:26:27.987763+0000 mon.b (mon.2) 1153 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:26:28.470 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:26:28 smithi132 bash[27079]: audit 2020-07-16T15:26:27.988605+0000 mon.b (mon.2) 1154 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:26:28.471 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:26:28 smithi132 bash[27079]: audit 2020-07-16T15:26:27.989569+0000 mon.b (mon.2) 1155 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:26:28.471 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:26:28 smithi132 bash[27079]: audit 2020-07-16T15:26:27.990550+0000 mon.b (mon.2) 1156 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:26:29.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:26:29 smithi132 bash[27079]: audit 2020-07-16T15:26:27.987074+0000 mgr.x (mgr.34562) 5182 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:26:29.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:26:29 smithi132 bash[27079]: audit 2020-07-16T15:26:27.988002+0000 mgr.x (mgr.34562) 5183 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:26:29.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:26:29 smithi132 bash[27079]: audit 2020-07-16T15:26:27.988818+0000 mgr.x (mgr.34562) 5184 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:26:29.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:26:29 smithi132 bash[27079]: cephadm 2020-07-16T15:26:27.989349+0000 mgr.x (mgr.34562) 5185 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:26:29.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:26:29 smithi132 bash[27079]: cephadm 2020-07-16T15:26:27.990207+0000 mgr.x (mgr.34562) 5186 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:26:29.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:26:29 smithi132 bash[27079]: cephadm 2020-07-16T15:26:27.991011+0000 mgr.x (mgr.34562) 5187 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:26:29.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:26:29 smithi132 bash[27079]: cephadm 2020-07-16T15:26:27.991120+0000 mgr.x (mgr.34562) 5188 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:26:29.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:26:29 smithi132 bash[27079]: cluster 2020-07-16T15:26:28.939610+0000 mgr.x (mgr.34562) 5189 : cluster [DBG] pgmap v3234: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:26:29.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:26:29 smithi188 bash[23329]: audit 2020-07-16T15:26:27.987074+0000 mgr.x (mgr.34562) 5182 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:26:29.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:26:29 smithi188 bash[23329]: audit 2020-07-16T15:26:27.988002+0000 mgr.x (mgr.34562) 5183 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:26:29.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:26:29 smithi188 bash[23329]: audit 2020-07-16T15:26:27.988818+0000 mgr.x (mgr.34562) 5184 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:26:29.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:26:29 smithi188 bash[23329]: cephadm 2020-07-16T15:26:27.989349+0000 mgr.x (mgr.34562) 5185 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:26:29.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:26:29 smithi188 bash[23329]: cephadm 2020-07-16T15:26:27.990207+0000 mgr.x (mgr.34562) 5186 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:26:29.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:26:29 smithi188 bash[23329]: cephadm 2020-07-16T15:26:27.991011+0000 mgr.x (mgr.34562) 5187 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:26:29.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:26:29 smithi188 bash[23329]: cephadm 2020-07-16T15:26:27.991120+0000 mgr.x (mgr.34562) 5188 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:26:29.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:26:29 smithi188 bash[23329]: cluster 2020-07-16T15:26:28.939610+0000 mgr.x (mgr.34562) 5189 : cluster [DBG] pgmap v3234: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:26:31.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:26:31 smithi188 bash[23329]: audit 2020-07-16T15:26:30.855380+0000 mon.b (mon.2) 1157 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:26:31.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:26:31 smithi188 bash[23329]: cephadm 2020-07-16T15:26:30.856039+0000 mgr.x (mgr.34562) 5190 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:26:31.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:26:31 smithi188 bash[23329]: cephadm 2020-07-16T15:26:30.856516+0000 mgr.x (mgr.34562) 5191 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:26:31.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:26:31 smithi188 bash[23329]: cluster 2020-07-16T15:26:30.940118+0000 mgr.x (mgr.34562) 5192 : cluster [DBG] pgmap v3235: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:26:31.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:26:31 smithi132 bash[27079]: audit 2020-07-16T15:26:30.855380+0000 mon.b (mon.2) 1157 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:26:31.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:26:31 smithi132 bash[27079]: cephadm 2020-07-16T15:26:30.856039+0000 mgr.x (mgr.34562) 5190 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:26:31.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:26:31 smithi132 bash[27079]: cephadm 2020-07-16T15:26:30.856516+0000 mgr.x (mgr.34562) 5191 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:26:31.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:26:31 smithi132 bash[27079]: cluster 2020-07-16T15:26:30.940118+0000 mgr.x (mgr.34562) 5192 : cluster [DBG] pgmap v3235: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:26:33.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:26:33 smithi132 bash[27079]: cluster 2020-07-16T15:26:32.940526+0000 mgr.x (mgr.34562) 5193 : cluster [DBG] pgmap v3236: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:26:33.425 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:26:33 smithi188 bash[23329]: cluster 2020-07-16T15:26:32.940526+0000 mgr.x (mgr.34562) 5193 : cluster [DBG] pgmap v3236: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:26:35.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:26:35 smithi132 bash[27079]: cluster 2020-07-16T15:26:34.941010+0000 mgr.x (mgr.34562) 5194 : cluster [DBG] pgmap v3237: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:26:35.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:26:35 smithi188 bash[23329]: cluster 2020-07-16T15:26:34.941010+0000 mgr.x (mgr.34562) 5194 : cluster [DBG] pgmap v3237: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:26:37.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:26:37 smithi132 bash[27079]: cluster 2020-07-16T15:26:36.941474+0000 mgr.x (mgr.34562) 5195 : cluster [DBG] pgmap v3238: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:26:37.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:26:37 smithi188 bash[23329]: cluster 2020-07-16T15:26:36.941474+0000 mgr.x (mgr.34562) 5195 : cluster [DBG] pgmap v3238: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:26:39.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:26:39 smithi132 bash[27079]: cluster 2020-07-16T15:26:38.941845+0000 mgr.x (mgr.34562) 5196 : cluster [DBG] pgmap v3239: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:26:39.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:26:39 smithi188 bash[23329]: cluster 2020-07-16T15:26:38.941845+0000 mgr.x (mgr.34562) 5196 : cluster [DBG] pgmap v3239: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:26:41.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:26:41 smithi188 bash[23329]: cluster 2020-07-16T15:26:40.942221+0000 mgr.x (mgr.34562) 5197 : cluster [DBG] pgmap v3240: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:26:41.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:26:41 smithi132 bash[27079]: cluster 2020-07-16T15:26:40.942221+0000 mgr.x (mgr.34562) 5197 : cluster [DBG] pgmap v3240: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:26:43.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:26:43 smithi132 bash[27079]: cluster 2020-07-16T15:26:42.942669+0000 mgr.x (mgr.34562) 5198 : cluster [DBG] pgmap v3241: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:26:43.425 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:26:43 smithi188 bash[23329]: cluster 2020-07-16T15:26:42.942669+0000 mgr.x (mgr.34562) 5198 : cluster [DBG] pgmap v3241: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:26:45.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:26:45 smithi132 bash[27079]: cluster 2020-07-16T15:26:44.943027+0000 mgr.x (mgr.34562) 5199 : cluster [DBG] pgmap v3242: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:26:45.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:26:45 smithi188 bash[23329]: cluster 2020-07-16T15:26:44.943027+0000 mgr.x (mgr.34562) 5199 : cluster [DBG] pgmap v3242: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:26:46.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:26:46 smithi188 bash[23329]: audit 2020-07-16T15:26:45.871715+0000 mon.b (mon.2) 1158 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:26:46.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:26:46 smithi188 bash[23329]: cephadm 2020-07-16T15:26:45.872366+0000 mgr.x (mgr.34562) 5200 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:26:46.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:26:46 smithi188 bash[23329]: cephadm 2020-07-16T15:26:45.872528+0000 mgr.x (mgr.34562) 5201 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:26:46.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:26:46 smithi132 bash[27079]: audit 2020-07-16T15:26:45.871715+0000 mon.b (mon.2) 1158 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:26:46.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:26:46 smithi132 bash[27079]: cephadm 2020-07-16T15:26:45.872366+0000 mgr.x (mgr.34562) 5200 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:26:46.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:26:46 smithi132 bash[27079]: cephadm 2020-07-16T15:26:45.872528+0000 mgr.x (mgr.34562) 5201 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:26:47.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:26:47 smithi188 bash[23329]: cluster 2020-07-16T15:26:46.943498+0000 mgr.x (mgr.34562) 5202 : cluster [DBG] pgmap v3243: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:26:47.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:26:47 smithi132 bash[27079]: cluster 2020-07-16T15:26:46.943498+0000 mgr.x (mgr.34562) 5202 : cluster [DBG] pgmap v3243: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:26:47.807 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:26:48.067 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:26:48.067 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (109m) 2m ago 112m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:26:48.068 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (112m) 2m ago 112m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:26:48.068 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (109m) 2m ago 115m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:26:48.068 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (109m) 2m ago 117m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:26:48.068 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 2m ago 117m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:26:48.068 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (115m) 2m ago 115m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:26:48.069 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (115m) 2m ago 115m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:26:48.069 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (112m) 2m ago 112m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:26:48.069 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (112m) 2m ago 112m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:26:48.069 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (115m) 2m ago 115m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:26:48.069 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (114m) 2m ago 114m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:26:48.070 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (114m) 2m ago 114m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:26:48.070 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (114m) 2m ago 114m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:26:48.070 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (113m) 2m ago 114m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:26:48.070 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (113m) 2m ago 113m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:26:48.070 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (113m) 2m ago 113m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:26:48.071 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (113m) 2m ago 113m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:26:48.071 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (112m) 2m ago 112m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:26:48.367 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:26:48.367 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:26:48.368 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:26:48.368 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:26:48.368 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:26:48.368 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:26:48.369 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:26:48.369 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:26:48.369 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:26:48.369 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:26:48.370 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:26:48.370 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:26:48.370 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:26:48.370 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:26:48.370 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:26:48.371 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:26:48.371 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:26:48.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:26:48 smithi188 bash[23329]: audit 2020-07-16T15:26:47.795549+0000 mgr.x (mgr.34562) 5203 : audit [DBG] from='client.28420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:26:48.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:26:48 smithi188 bash[23329]: audit 2020-07-16T15:26:48.366488+0000 mon.c (mon.1) 370 : audit [DBG] from='client.? 172.21.15.132:0/1769396115' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:26:48.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:26:48 smithi132 bash[27079]: audit 2020-07-16T15:26:47.795549+0000 mgr.x (mgr.34562) 5203 : audit [DBG] from='client.28420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:26:48.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:26:48 smithi132 bash[27079]: audit 2020-07-16T15:26:48.366488+0000 mon.c (mon.1) 370 : audit [DBG] from='client.? 172.21.15.132:0/1769396115' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:26:49.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:26:49 smithi188 bash[23329]: audit 2020-07-16T15:26:48.063253+0000 mgr.x (mgr.34562) 5204 : audit [DBG] from='client.28426 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:26:49.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:26:49 smithi188 bash[23329]: cluster 2020-07-16T15:26:48.943977+0000 mgr.x (mgr.34562) 5205 : cluster [DBG] pgmap v3244: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:26:49.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:26:49 smithi132 bash[27079]: audit 2020-07-16T15:26:48.063253+0000 mgr.x (mgr.34562) 5204 : audit [DBG] from='client.28426 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:26:49.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:26:49 smithi132 bash[27079]: cluster 2020-07-16T15:26:48.943977+0000 mgr.x (mgr.34562) 5205 : cluster [DBG] pgmap v3244: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:26:51.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:26:51 smithi188 bash[23329]: cluster 2020-07-16T15:26:50.944425+0000 mgr.x (mgr.34562) 5206 : cluster [DBG] pgmap v3245: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:26:51.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:26:51 smithi132 bash[27079]: cluster 2020-07-16T15:26:50.944425+0000 mgr.x (mgr.34562) 5206 : cluster [DBG] pgmap v3245: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:26:53.425 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:26:53 smithi188 bash[23329]: cluster 2020-07-16T15:26:52.944833+0000 mgr.x (mgr.34562) 5207 : cluster [DBG] pgmap v3246: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:26:53.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:26:53 smithi132 bash[27079]: cluster 2020-07-16T15:26:52.944833+0000 mgr.x (mgr.34562) 5207 : cluster [DBG] pgmap v3246: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:26:55.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:26:55 smithi188 bash[23329]: cluster 2020-07-16T15:26:54.945267+0000 mgr.x (mgr.34562) 5208 : cluster [DBG] pgmap v3247: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:26:55.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:26:55 smithi132 bash[27079]: cluster 2020-07-16T15:26:54.945267+0000 mgr.x (mgr.34562) 5208 : cluster [DBG] pgmap v3247: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:26:57.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:26:57 smithi188 bash[23329]: cluster 2020-07-16T15:26:56.945841+0000 mgr.x (mgr.34562) 5209 : cluster [DBG] pgmap v3248: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:26:57.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:26:57 smithi132 bash[27079]: cluster 2020-07-16T15:26:56.945841+0000 mgr.x (mgr.34562) 5209 : cluster [DBG] pgmap v3248: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:26:59.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:26:59 smithi188 bash[23329]: cluster 2020-07-16T15:26:58.946324+0000 mgr.x (mgr.34562) 5210 : cluster [DBG] pgmap v3249: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:26:59.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:26:59 smithi132 bash[27079]: cluster 2020-07-16T15:26:58.946324+0000 mgr.x (mgr.34562) 5210 : cluster [DBG] pgmap v3249: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:27:01.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:27:01 smithi188 bash[23329]: audit 2020-07-16T15:27:00.883150+0000 mon.b (mon.2) 1159 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:27:01.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:27:01 smithi188 bash[23329]: cephadm 2020-07-16T15:27:00.883887+0000 mgr.x (mgr.34562) 5211 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:27:01.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:27:01 smithi188 bash[23329]: cephadm 2020-07-16T15:27:00.884311+0000 mgr.x (mgr.34562) 5212 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:27:01.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:27:01 smithi188 bash[23329]: cluster 2020-07-16T15:27:00.946700+0000 mgr.x (mgr.34562) 5213 : cluster [DBG] pgmap v3250: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:27:01.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:27:01 smithi132 bash[27079]: audit 2020-07-16T15:27:00.883150+0000 mon.b (mon.2) 1159 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:27:01.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:27:01 smithi132 bash[27079]: cephadm 2020-07-16T15:27:00.883887+0000 mgr.x (mgr.34562) 5211 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:27:01.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:27:01 smithi132 bash[27079]: cephadm 2020-07-16T15:27:00.884311+0000 mgr.x (mgr.34562) 5212 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:27:01.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:27:01 smithi132 bash[27079]: cluster 2020-07-16T15:27:00.946700+0000 mgr.x (mgr.34562) 5213 : cluster [DBG] pgmap v3250: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:27:03.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:27:03 smithi188 bash[23329]: cluster 2020-07-16T15:27:02.947118+0000 mgr.x (mgr.34562) 5214 : cluster [DBG] pgmap v3251: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:27:03.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:27:03 smithi132 bash[27079]: cluster 2020-07-16T15:27:02.947118+0000 mgr.x (mgr.34562) 5214 : cluster [DBG] pgmap v3251: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:27:05.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:27:05 smithi188 bash[23329]: cluster 2020-07-16T15:27:04.947605+0000 mgr.x (mgr.34562) 5215 : cluster [DBG] pgmap v3252: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:27:05.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:27:05 smithi132 bash[27079]: cluster 2020-07-16T15:27:04.947605+0000 mgr.x (mgr.34562) 5215 : cluster [DBG] pgmap v3252: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:27:07.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:27:07 smithi188 bash[23329]: cluster 2020-07-16T15:27:06.948085+0000 mgr.x (mgr.34562) 5216 : cluster [DBG] pgmap v3253: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:27:07.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:27:07 smithi132 bash[27079]: cluster 2020-07-16T15:27:06.948085+0000 mgr.x (mgr.34562) 5216 : cluster [DBG] pgmap v3253: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:27:09.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:27:09 smithi188 bash[23329]: cluster 2020-07-16T15:27:08.948586+0000 mgr.x (mgr.34562) 5217 : cluster [DBG] pgmap v3254: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:27:09.533 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:27:09 smithi132 bash[27079]: cluster 2020-07-16T15:27:08.948586+0000 mgr.x (mgr.34562) 5217 : cluster [DBG] pgmap v3254: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:27:11.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:27:11 smithi188 bash[23329]: cluster 2020-07-16T15:27:10.948999+0000 mgr.x (mgr.34562) 5218 : cluster [DBG] pgmap v3255: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:27:11.786 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:27:11 smithi132 bash[27079]: cluster 2020-07-16T15:27:10.948999+0000 mgr.x (mgr.34562) 5218 : cluster [DBG] pgmap v3255: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:27:13.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:27:13 smithi188 bash[23329]: cluster 2020-07-16T15:27:12.949485+0000 mgr.x (mgr.34562) 5219 : cluster [DBG] pgmap v3256: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:27:13.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:27:13 smithi132 bash[27079]: cluster 2020-07-16T15:27:12.949485+0000 mgr.x (mgr.34562) 5219 : cluster [DBG] pgmap v3256: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:27:15.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:27:15 smithi188 bash[23329]: cluster 2020-07-16T15:27:14.949920+0000 mgr.x (mgr.34562) 5220 : cluster [DBG] pgmap v3257: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:27:15.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:27:15 smithi132 bash[27079]: cluster 2020-07-16T15:27:14.949920+0000 mgr.x (mgr.34562) 5220 : cluster [DBG] pgmap v3257: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:27:16.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:27:16 smithi188 bash[23329]: audit 2020-07-16T15:27:15.899813+0000 mon.b (mon.2) 1160 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:27:16.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:27:16 smithi188 bash[23329]: cephadm 2020-07-16T15:27:15.900485+0000 mgr.x (mgr.34562) 5221 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:27:16.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:27:16 smithi188 bash[23329]: cephadm 2020-07-16T15:27:15.900718+0000 mgr.x (mgr.34562) 5222 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:27:16.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:27:16 smithi132 bash[27079]: audit 2020-07-16T15:27:15.899813+0000 mon.b (mon.2) 1160 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:27:16.782 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:27:16 smithi132 bash[27079]: cephadm 2020-07-16T15:27:15.900485+0000 mgr.x (mgr.34562) 5221 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:27:16.782 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:27:16 smithi132 bash[27079]: cephadm 2020-07-16T15:27:15.900718+0000 mgr.x (mgr.34562) 5222 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:27:17.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:27:17 smithi188 bash[23329]: cluster 2020-07-16T15:27:16.950379+0000 mgr.x (mgr.34562) 5223 : cluster [DBG] pgmap v3258: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:27:17.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:27:17 smithi132 bash[27079]: cluster 2020-07-16T15:27:16.950379+0000 mgr.x (mgr.34562) 5223 : cluster [DBG] pgmap v3258: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:27:18.667 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:27:18.926 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:27:18.926 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (110m) 2m ago 113m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:27:18.926 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (112m) 2m ago 112m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:27:18.927 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (110m) 2m ago 115m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:27:18.927 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (109m) 2m ago 117m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:27:18.927 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 2m ago 117m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:27:18.928 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (116m) 2m ago 116m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:27:18.928 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (116m) 2m ago 116m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:27:18.928 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (113m) 2m ago 113m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:27:18.929 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (113m) 2m ago 113m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:27:18.929 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (115m) 2m ago 115m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:27:18.929 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (115m) 2m ago 115m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:27:18.930 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (115m) 2m ago 115m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:27:18.930 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (114m) 2m ago 114m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:27:18.930 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (114m) 2m ago 114m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:27:18.934 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (114m) 2m ago 114m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:27:18.934 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (113m) 2m ago 113m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:27:18.934 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (113m) 2m ago 113m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:27:18.935 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (112m) 2m ago 113m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:27:19.228 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:27:19.228 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:27:19.229 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:27:19.229 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:27:19.229 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:27:19.229 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:27:19.230 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:27:19.230 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:27:19.230 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:27:19.230 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:27:19.230 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:27:19.231 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:27:19.231 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:27:19.231 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:27:19.231 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:27:19.231 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:27:19.232 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:27:19.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:27:19 smithi188 bash[23329]: audit 2020-07-16T15:27:18.652722+0000 mgr.x (mgr.34562) 5224 : audit [DBG] from='client.28438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:27:19.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:27:19 smithi188 bash[23329]: audit 2020-07-16T15:27:18.921549+0000 mgr.x (mgr.34562) 5225 : audit [DBG] from='client.28444 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:27:19.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:27:19 smithi188 bash[23329]: cluster 2020-07-16T15:27:18.950826+0000 mgr.x (mgr.34562) 5226 : cluster [DBG] pgmap v3259: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:27:19.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:27:19 smithi132 bash[27079]: audit 2020-07-16T15:27:18.652722+0000 mgr.x (mgr.34562) 5224 : audit [DBG] from='client.28438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:27:19.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:27:19 smithi132 bash[27079]: audit 2020-07-16T15:27:18.921549+0000 mgr.x (mgr.34562) 5225 : audit [DBG] from='client.28444 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:27:19.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:27:19 smithi132 bash[27079]: cluster 2020-07-16T15:27:18.950826+0000 mgr.x (mgr.34562) 5226 : cluster [DBG] pgmap v3259: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:27:20.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:27:20 smithi188 bash[23329]: audit 2020-07-16T15:27:19.227495+0000 mon.c (mon.1) 371 : audit [DBG] from='client.? 172.21.15.132:0/396798658' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:27:20.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:27:20 smithi132 bash[27079]: audit 2020-07-16T15:27:19.227495+0000 mon.c (mon.1) 371 : audit [DBG] from='client.? 172.21.15.132:0/396798658' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:27:21.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:27:21 smithi188 bash[23329]: cluster 2020-07-16T15:27:20.951198+0000 mgr.x (mgr.34562) 5227 : cluster [DBG] pgmap v3260: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:27:21.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:27:21 smithi132 bash[27079]: cluster 2020-07-16T15:27:20.951198+0000 mgr.x (mgr.34562) 5227 : cluster [DBG] pgmap v3260: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:27:23.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:27:23 smithi188 bash[23329]: cluster 2020-07-16T15:27:22.951775+0000 mgr.x (mgr.34562) 5228 : cluster [DBG] pgmap v3261: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:27:23.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:27:23 smithi132 bash[27079]: cluster 2020-07-16T15:27:22.951775+0000 mgr.x (mgr.34562) 5228 : cluster [DBG] pgmap v3261: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:27:25.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:27:25 smithi188 bash[23329]: cluster 2020-07-16T15:27:24.952199+0000 mgr.x (mgr.34562) 5229 : cluster [DBG] pgmap v3262: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:27:25.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:27:25 smithi132 bash[27079]: cluster 2020-07-16T15:27:24.952199+0000 mgr.x (mgr.34562) 5229 : cluster [DBG] pgmap v3262: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:27:27.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:27:27 smithi188 bash[23329]: cluster 2020-07-16T15:27:26.952592+0000 mgr.x (mgr.34562) 5230 : cluster [DBG] pgmap v3263: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:27:27.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:27:27 smithi132 bash[27079]: cluster 2020-07-16T15:27:26.952592+0000 mgr.x (mgr.34562) 5230 : cluster [DBG] pgmap v3263: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:27:29.430 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:27:29 smithi188 bash[23329]: cluster 2020-07-16T15:27:28.953058+0000 mgr.x (mgr.34562) 5231 : cluster [DBG] pgmap v3264: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:27:29.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:27:29 smithi132 bash[27079]: cluster 2020-07-16T15:27:28.953058+0000 mgr.x (mgr.34562) 5231 : cluster [DBG] pgmap v3264: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:27:31.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:27:31 smithi188 bash[23329]: audit 2020-07-16T15:27:30.916389+0000 mon.b (mon.2) 1161 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:27:31.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:27:31 smithi188 bash[23329]: audit 2020-07-16T15:27:30.916763+0000 mgr.x (mgr.34562) 5232 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:27:31.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:27:31 smithi188 bash[23329]: audit 2020-07-16T15:27:30.917778+0000 mon.b (mon.2) 1162 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:27:31.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:27:31 smithi188 bash[23329]: audit 2020-07-16T15:27:30.918087+0000 mgr.x (mgr.34562) 5233 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:27:31.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:27:31 smithi188 bash[23329]: audit 2020-07-16T15:27:30.918985+0000 mon.b (mon.2) 1163 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:27:31.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:27:31 smithi188 bash[23329]: audit 2020-07-16T15:27:30.919303+0000 mgr.x (mgr.34562) 5234 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:27:31.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:27:31 smithi188 bash[23329]: cephadm 2020-07-16T15:27:30.920041+0000 mgr.x (mgr.34562) 5235 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:27:31.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:27:31 smithi188 bash[23329]: audit 2020-07-16T15:27:30.920428+0000 mon.b (mon.2) 1164 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:27:31.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:27:31 smithi188 bash[23329]: cephadm 2020-07-16T15:27:30.921293+0000 mgr.x (mgr.34562) 5236 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:27:31.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:27:31 smithi188 bash[23329]: audit 2020-07-16T15:27:30.921887+0000 mon.b (mon.2) 1165 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:27:31.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:27:31 smithi188 bash[23329]: cephadm 2020-07-16T15:27:30.922678+0000 mgr.x (mgr.34562) 5237 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:27:31.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:27:31 smithi188 bash[23329]: cephadm 2020-07-16T15:27:30.922931+0000 mgr.x (mgr.34562) 5238 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:27:31.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:27:31 smithi188 bash[23329]: cluster 2020-07-16T15:27:30.953590+0000 mgr.x (mgr.34562) 5239 : cluster [DBG] pgmap v3265: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:27:31.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:27:31 smithi132 bash[27079]: audit 2020-07-16T15:27:30.916389+0000 mon.b (mon.2) 1161 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:27:31.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:27:31 smithi132 bash[27079]: audit 2020-07-16T15:27:30.916763+0000 mgr.x (mgr.34562) 5232 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:27:31.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:27:31 smithi132 bash[27079]: audit 2020-07-16T15:27:30.917778+0000 mon.b (mon.2) 1162 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:27:31.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:27:31 smithi132 bash[27079]: audit 2020-07-16T15:27:30.918087+0000 mgr.x (mgr.34562) 5233 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:27:31.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:27:31 smithi132 bash[27079]: audit 2020-07-16T15:27:30.918985+0000 mon.b (mon.2) 1163 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:27:31.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:27:31 smithi132 bash[27079]: audit 2020-07-16T15:27:30.919303+0000 mgr.x (mgr.34562) 5234 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:27:31.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:27:31 smithi132 bash[27079]: cephadm 2020-07-16T15:27:30.920041+0000 mgr.x (mgr.34562) 5235 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:27:31.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:27:31 smithi132 bash[27079]: audit 2020-07-16T15:27:30.920428+0000 mon.b (mon.2) 1164 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:27:31.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:27:31 smithi132 bash[27079]: cephadm 2020-07-16T15:27:30.921293+0000 mgr.x (mgr.34562) 5236 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:27:31.782 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:27:31 smithi132 bash[27079]: audit 2020-07-16T15:27:30.921887+0000 mon.b (mon.2) 1165 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:27:31.782 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:27:31 smithi132 bash[27079]: cephadm 2020-07-16T15:27:30.922678+0000 mgr.x (mgr.34562) 5237 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:27:31.782 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:27:31 smithi132 bash[27079]: cephadm 2020-07-16T15:27:30.922931+0000 mgr.x (mgr.34562) 5238 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:27:31.782 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:27:31 smithi132 bash[27079]: cluster 2020-07-16T15:27:30.953590+0000 mgr.x (mgr.34562) 5239 : cluster [DBG] pgmap v3265: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:27:33.272 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:27:33 smithi132 bash[27079]: cluster 2020-07-16T15:27:32.954046+0000 mgr.x (mgr.34562) 5240 : cluster [DBG] pgmap v3266: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:27:33.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:27:33 smithi188 bash[23329]: cluster 2020-07-16T15:27:32.954046+0000 mgr.x (mgr.34562) 5240 : cluster [DBG] pgmap v3266: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:27:34.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:27:34 smithi132 bash[27079]: audit 2020-07-16T15:27:33.816484+0000 mon.b (mon.2) 1166 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:27:34.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:27:34 smithi132 bash[27079]: cephadm 2020-07-16T15:27:33.817120+0000 mgr.x (mgr.34562) 5241 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:27:34.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:27:34 smithi132 bash[27079]: cephadm 2020-07-16T15:27:33.817543+0000 mgr.x (mgr.34562) 5242 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:27:34.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:27:34 smithi188 bash[23329]: audit 2020-07-16T15:27:33.816484+0000 mon.b (mon.2) 1166 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:27:34.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:27:34 smithi188 bash[23329]: cephadm 2020-07-16T15:27:33.817120+0000 mgr.x (mgr.34562) 5241 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:27:34.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:27:34 smithi188 bash[23329]: cephadm 2020-07-16T15:27:33.817543+0000 mgr.x (mgr.34562) 5242 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:27:35.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:27:35 smithi188 bash[23329]: cluster 2020-07-16T15:27:34.954415+0000 mgr.x (mgr.34562) 5243 : cluster [DBG] pgmap v3267: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:27:35.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:27:35 smithi132 bash[27079]: cluster 2020-07-16T15:27:34.954415+0000 mgr.x (mgr.34562) 5243 : cluster [DBG] pgmap v3267: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:27:37.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:27:37 smithi188 bash[23329]: cluster 2020-07-16T15:27:36.954890+0000 mgr.x (mgr.34562) 5244 : cluster [DBG] pgmap v3268: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:27:37.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:27:37 smithi132 bash[27079]: cluster 2020-07-16T15:27:36.954890+0000 mgr.x (mgr.34562) 5244 : cluster [DBG] pgmap v3268: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:27:39.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:27:39 smithi188 bash[23329]: cluster 2020-07-16T15:27:38.955446+0000 mgr.x (mgr.34562) 5245 : cluster [DBG] pgmap v3269: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:27:39.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:27:39 smithi132 bash[27079]: cluster 2020-07-16T15:27:38.955446+0000 mgr.x (mgr.34562) 5245 : cluster [DBG] pgmap v3269: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:27:41.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:27:41 smithi188 bash[23329]: cluster 2020-07-16T15:27:40.955898+0000 mgr.x (mgr.34562) 5246 : cluster [DBG] pgmap v3270: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:27:41.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:27:41 smithi132 bash[27079]: cluster 2020-07-16T15:27:40.955898+0000 mgr.x (mgr.34562) 5246 : cluster [DBG] pgmap v3270: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:27:43.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:27:43 smithi188 bash[23329]: cluster 2020-07-16T15:27:42.956274+0000 mgr.x (mgr.34562) 5247 : cluster [DBG] pgmap v3271: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:27:43.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:27:43 smithi132 bash[27079]: cluster 2020-07-16T15:27:42.956274+0000 mgr.x (mgr.34562) 5247 : cluster [DBG] pgmap v3271: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:27:45.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:27:45 smithi188 bash[23329]: cluster 2020-07-16T15:27:44.956779+0000 mgr.x (mgr.34562) 5248 : cluster [DBG] pgmap v3272: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:27:45.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:27:45 smithi132 bash[27079]: cluster 2020-07-16T15:27:44.956779+0000 mgr.x (mgr.34562) 5248 : cluster [DBG] pgmap v3272: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:27:47.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:27:47 smithi188 bash[23329]: cluster 2020-07-16T15:27:46.957125+0000 mgr.x (mgr.34562) 5249 : cluster [DBG] pgmap v3273: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:27:47.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:27:47 smithi132 bash[27079]: cluster 2020-07-16T15:27:46.957125+0000 mgr.x (mgr.34562) 5249 : cluster [DBG] pgmap v3273: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:27:49.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:27:48 smithi188 bash[23329]: audit 2020-07-16T15:27:48.819769+0000 mon.b (mon.2) 1167 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:27:49.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:27:48 smithi132 bash[27079]: audit 2020-07-16T15:27:48.819769+0000 mon.b (mon.2) 1167 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:27:49.528 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:27:49.802 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:27:49.802 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (110m) 3m ago 113m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:27:49.803 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (113m) 3m ago 113m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:27:49.803 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (110m) 3m ago 116m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:27:49.803 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (110m) 3m ago 118m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:27:49.803 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 3m ago 118m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:27:49.803 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (116m) 3m ago 116m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:27:49.804 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (116m) 3m ago 116m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:27:49.804 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (113m) 3m ago 113m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:27:49.804 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (113m) 3m ago 113m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:27:49.804 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (116m) 3m ago 116m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:27:49.804 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (115m) 3m ago 115m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:27:49.804 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (115m) 3m ago 115m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:27:49.805 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (115m) 3m ago 115m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:27:49.805 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (114m) 3m ago 115m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:27:49.805 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (114m) 3m ago 114m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:27:49.805 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (114m) 3m ago 114m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:27:49.806 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (114m) 3m ago 114m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:27:49.806 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (113m) 3m ago 113m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:27:50.106 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:27:50.107 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:27:50.107 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:27:50.107 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:27:50.108 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:27:50.108 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:27:50.108 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:27:50.108 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:27:50.108 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:27:50.109 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:27:50.109 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:27:50.109 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:27:50.109 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:27:50.109 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:27:50.109 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:27:50.110 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:27:50.110 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:27:50.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:27:49 smithi188 bash[23329]: cephadm 2020-07-16T15:27:48.820470+0000 mgr.x (mgr.34562) 5250 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:27:50.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:27:49 smithi188 bash[23329]: cephadm 2020-07-16T15:27:48.820921+0000 mgr.x (mgr.34562) 5251 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:27:50.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:27:49 smithi188 bash[23329]: cluster 2020-07-16T15:27:48.957456+0000 mgr.x (mgr.34562) 5252 : cluster [DBG] pgmap v3274: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:27:50.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:27:49 smithi132 bash[27079]: cephadm 2020-07-16T15:27:48.820470+0000 mgr.x (mgr.34562) 5250 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:27:50.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:27:49 smithi132 bash[27079]: cephadm 2020-07-16T15:27:48.820921+0000 mgr.x (mgr.34562) 5251 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:27:50.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:27:49 smithi132 bash[27079]: cluster 2020-07-16T15:27:48.957456+0000 mgr.x (mgr.34562) 5252 : cluster [DBG] pgmap v3274: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:27:51.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:27:50 smithi188 bash[23329]: audit 2020-07-16T15:27:49.516828+0000 mgr.x (mgr.34562) 5253 : audit [DBG] from='client.28456 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:27:51.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:27:50 smithi188 bash[23329]: audit 2020-07-16T15:27:49.798134+0000 mgr.x (mgr.34562) 5254 : audit [DBG] from='client.28462 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:27:51.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:27:50 smithi188 bash[23329]: audit 2020-07-16T15:27:50.106135+0000 mon.c (mon.1) 372 : audit [DBG] from='client.? 172.21.15.132:0/2318831395' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:27:51.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:27:50 smithi132 bash[27079]: audit 2020-07-16T15:27:49.516828+0000 mgr.x (mgr.34562) 5253 : audit [DBG] from='client.28456 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:27:51.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:27:50 smithi132 bash[27079]: audit 2020-07-16T15:27:49.798134+0000 mgr.x (mgr.34562) 5254 : audit [DBG] from='client.28462 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:27:51.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:27:50 smithi132 bash[27079]: audit 2020-07-16T15:27:50.106135+0000 mon.c (mon.1) 372 : audit [DBG] from='client.? 172.21.15.132:0/2318831395' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:27:52.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:27:51 smithi188 bash[23329]: cluster 2020-07-16T15:27:50.957916+0000 mgr.x (mgr.34562) 5255 : cluster [DBG] pgmap v3275: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:27:52.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:27:51 smithi132 bash[27079]: cluster 2020-07-16T15:27:50.957916+0000 mgr.x (mgr.34562) 5255 : cluster [DBG] pgmap v3275: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:27:53.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:27:53 smithi188 bash[23329]: cluster 2020-07-16T15:27:52.958360+0000 mgr.x (mgr.34562) 5256 : cluster [DBG] pgmap v3276: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:27:53.535 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:27:53 smithi132 bash[27079]: cluster 2020-07-16T15:27:52.958360+0000 mgr.x (mgr.34562) 5256 : cluster [DBG] pgmap v3276: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:27:55.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:27:55 smithi188 bash[23329]: cluster 2020-07-16T15:27:54.958682+0000 mgr.x (mgr.34562) 5257 : cluster [DBG] pgmap v3277: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:27:55.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:27:55 smithi132 bash[27079]: cluster 2020-07-16T15:27:54.958682+0000 mgr.x (mgr.34562) 5257 : cluster [DBG] pgmap v3277: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:27:57.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:27:57 smithi188 bash[23329]: cluster 2020-07-16T15:27:56.959217+0000 mgr.x (mgr.34562) 5258 : cluster [DBG] pgmap v3278: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:27:57.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:27:57 smithi132 bash[27079]: cluster 2020-07-16T15:27:56.959217+0000 mgr.x (mgr.34562) 5258 : cluster [DBG] pgmap v3278: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:27:59.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:27:59 smithi188 bash[23329]: cluster 2020-07-16T15:27:58.959596+0000 mgr.x (mgr.34562) 5259 : cluster [DBG] pgmap v3279: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:27:59.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:27:59 smithi132 bash[27079]: cluster 2020-07-16T15:27:58.959596+0000 mgr.x (mgr.34562) 5259 : cluster [DBG] pgmap v3279: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:28:01.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:28:01 smithi188 bash[23329]: cluster 2020-07-16T15:28:00.959994+0000 mgr.x (mgr.34562) 5260 : cluster [DBG] pgmap v3280: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:28:01.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:28:01 smithi132 bash[27079]: cluster 2020-07-16T15:28:00.959994+0000 mgr.x (mgr.34562) 5260 : cluster [DBG] pgmap v3280: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:28:03.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:28:03 smithi188 bash[23329]: cluster 2020-07-16T15:28:02.960402+0000 mgr.x (mgr.34562) 5261 : cluster [DBG] pgmap v3281: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:28:03.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:28:03 smithi132 bash[27079]: cluster 2020-07-16T15:28:02.960402+0000 mgr.x (mgr.34562) 5261 : cluster [DBG] pgmap v3281: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:28:04.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:28:04 smithi188 bash[23329]: audit 2020-07-16T15:28:03.828499+0000 mon.b (mon.2) 1168 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:28:04.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:28:04 smithi188 bash[23329]: cephadm 2020-07-16T15:28:03.829222+0000 mgr.x (mgr.34562) 5262 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:28:04.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:28:04 smithi188 bash[23329]: cephadm 2020-07-16T15:28:03.829394+0000 mgr.x (mgr.34562) 5263 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:28:04.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:28:04 smithi132 bash[27079]: audit 2020-07-16T15:28:03.828499+0000 mon.b (mon.2) 1168 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:28:04.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:28:04 smithi132 bash[27079]: cephadm 2020-07-16T15:28:03.829222+0000 mgr.x (mgr.34562) 5262 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:28:04.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:28:04 smithi132 bash[27079]: cephadm 2020-07-16T15:28:03.829394+0000 mgr.x (mgr.34562) 5263 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:28:05.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:28:05 smithi188 bash[23329]: cluster 2020-07-16T15:28:04.960731+0000 mgr.x (mgr.34562) 5264 : cluster [DBG] pgmap v3282: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:28:05.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:28:05 smithi132 bash[27079]: cluster 2020-07-16T15:28:04.960731+0000 mgr.x (mgr.34562) 5264 : cluster [DBG] pgmap v3282: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:28:07.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:28:07 smithi188 bash[23329]: cluster 2020-07-16T15:28:06.961211+0000 mgr.x (mgr.34562) 5265 : cluster [DBG] pgmap v3283: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:28:07.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:28:07 smithi132 bash[27079]: cluster 2020-07-16T15:28:06.961211+0000 mgr.x (mgr.34562) 5265 : cluster [DBG] pgmap v3283: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:28:09.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:28:09 smithi188 bash[23329]: cluster 2020-07-16T15:28:08.961674+0000 mgr.x (mgr.34562) 5266 : cluster [DBG] pgmap v3284: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:28:09.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:28:09 smithi132 bash[27079]: cluster 2020-07-16T15:28:08.961674+0000 mgr.x (mgr.34562) 5266 : cluster [DBG] pgmap v3284: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:28:11.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:28:11 smithi188 bash[23329]: cluster 2020-07-16T15:28:10.962036+0000 mgr.x (mgr.34562) 5267 : cluster [DBG] pgmap v3285: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:28:11.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:28:11 smithi132 bash[27079]: cluster 2020-07-16T15:28:10.962036+0000 mgr.x (mgr.34562) 5267 : cluster [DBG] pgmap v3285: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:28:13.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:28:13 smithi188 bash[23329]: cluster 2020-07-16T15:28:12.962437+0000 mgr.x (mgr.34562) 5268 : cluster [DBG] pgmap v3286: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:28:13.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:28:13 smithi132 bash[27079]: cluster 2020-07-16T15:28:12.962437+0000 mgr.x (mgr.34562) 5268 : cluster [DBG] pgmap v3286: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:28:15.425 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:28:15 smithi188 bash[23329]: cluster 2020-07-16T15:28:14.962802+0000 mgr.x (mgr.34562) 5269 : cluster [DBG] pgmap v3287: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:28:15.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:28:15 smithi132 bash[27079]: cluster 2020-07-16T15:28:14.962802+0000 mgr.x (mgr.34562) 5269 : cluster [DBG] pgmap v3287: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:28:17.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:28:17 smithi188 bash[23329]: cluster 2020-07-16T15:28:16.963340+0000 mgr.x (mgr.34562) 5270 : cluster [DBG] pgmap v3288: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:28:17.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:28:17 smithi132 bash[27079]: cluster 2020-07-16T15:28:16.963340+0000 mgr.x (mgr.34562) 5270 : cluster [DBG] pgmap v3288: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:28:19.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:28:18 smithi188 bash[23329]: audit 2020-07-16T15:28:18.844132+0000 mon.b (mon.2) 1169 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:28:19.286 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:28:18 smithi132 bash[27079]: audit 2020-07-16T15:28:18.844132+0000 mon.b (mon.2) 1169 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:28:20.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:28:19 smithi188 bash[23329]: cephadm 2020-07-16T15:28:18.844902+0000 mgr.x (mgr.34562) 5271 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:28:20.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:28:19 smithi188 bash[23329]: cephadm 2020-07-16T15:28:18.845244+0000 mgr.x (mgr.34562) 5272 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:28:20.175 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:28:19 smithi188 bash[23329]: cluster 2020-07-16T15:28:18.963673+0000 mgr.x (mgr.34562) 5273 : cluster [DBG] pgmap v3289: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:28:20.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:28:19 smithi132 bash[27079]: cephadm 2020-07-16T15:28:18.844902+0000 mgr.x (mgr.34562) 5271 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:28:20.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:28:19 smithi132 bash[27079]: cephadm 2020-07-16T15:28:18.845244+0000 mgr.x (mgr.34562) 5272 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:28:20.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:28:19 smithi132 bash[27079]: cluster 2020-07-16T15:28:18.963673+0000 mgr.x (mgr.34562) 5273 : cluster [DBG] pgmap v3289: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:28:20.405 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:28:20.665 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:28:20.665 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (111m) 3m ago 114m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:28:20.665 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (113m) 3m ago 113m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:28:20.666 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (111m) 3m ago 116m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:28:20.666 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (110m) 3m ago 118m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:28:20.666 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 3m ago 118m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:28:20.666 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (117m) 3m ago 117m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:28:20.666 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (117m) 3m ago 117m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:28:20.667 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (114m) 3m ago 114m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:28:20.667 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (114m) 3m ago 114m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:28:20.667 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (116m) 3m ago 116m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:28:20.667 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (116m) 3m ago 116m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:28:20.667 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (116m) 3m ago 116m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:28:20.668 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (115m) 3m ago 115m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:28:20.668 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (115m) 3m ago 115m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:28:20.668 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (115m) 3m ago 115m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:28:20.668 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (114m) 3m ago 115m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:28:20.668 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (114m) 3m ago 114m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:28:20.669 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (113m) 3m ago 114m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:28:20.962 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:28:20.963 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:28:20.963 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:28:20.963 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:28:20.963 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:28:20.964 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:28:20.964 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:28:20.964 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:28:20.964 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:28:20.964 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:28:20.965 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:28:20.965 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:28:20.965 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:28:20.965 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:28:20.965 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:28:20.966 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:28:20.966 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:28:21.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:28:21 smithi188 bash[23329]: audit 2020-07-16T15:28:20.394166+0000 mgr.x (mgr.34562) 5274 : audit [DBG] from='client.28474 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:28:21.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:28:21 smithi188 bash[23329]: audit 2020-07-16T15:28:20.660839+0000 mgr.x (mgr.34562) 5275 : audit [DBG] from='client.28480 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:28:21.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:28:21 smithi188 bash[23329]: audit 2020-07-16T15:28:20.961959+0000 mon.c (mon.1) 373 : audit [DBG] from='client.? 172.21.15.132:0/857527017' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:28:21.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:28:21 smithi188 bash[23329]: cluster 2020-07-16T15:28:20.964219+0000 mgr.x (mgr.34562) 5276 : cluster [DBG] pgmap v3290: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:28:21.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:28:21 smithi132 bash[27079]: audit 2020-07-16T15:28:20.394166+0000 mgr.x (mgr.34562) 5274 : audit [DBG] from='client.28474 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:28:21.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:28:21 smithi132 bash[27079]: audit 2020-07-16T15:28:20.660839+0000 mgr.x (mgr.34562) 5275 : audit [DBG] from='client.28480 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:28:21.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:28:21 smithi132 bash[27079]: audit 2020-07-16T15:28:20.961959+0000 mon.c (mon.1) 373 : audit [DBG] from='client.? 172.21.15.132:0/857527017' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:28:21.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:28:21 smithi132 bash[27079]: cluster 2020-07-16T15:28:20.964219+0000 mgr.x (mgr.34562) 5276 : cluster [DBG] pgmap v3290: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:28:23.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:28:23 smithi188 bash[23329]: cluster 2020-07-16T15:28:22.964571+0000 mgr.x (mgr.34562) 5277 : cluster [DBG] pgmap v3291: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:28:23.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:28:23 smithi132 bash[27079]: cluster 2020-07-16T15:28:22.964571+0000 mgr.x (mgr.34562) 5277 : cluster [DBG] pgmap v3291: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:28:25.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:28:25 smithi188 bash[23329]: cluster 2020-07-16T15:28:24.964952+0000 mgr.x (mgr.34562) 5278 : cluster [DBG] pgmap v3292: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:28:25.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:28:25 smithi132 bash[27079]: cluster 2020-07-16T15:28:24.964952+0000 mgr.x (mgr.34562) 5278 : cluster [DBG] pgmap v3292: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:28:27.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:28:27 smithi188 bash[23329]: cluster 2020-07-16T15:28:26.965402+0000 mgr.x (mgr.34562) 5279 : cluster [DBG] pgmap v3293: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:28:27.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:28:27 smithi132 bash[27079]: cluster 2020-07-16T15:28:26.965402+0000 mgr.x (mgr.34562) 5279 : cluster [DBG] pgmap v3293: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:28:29.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:28:29 smithi188 bash[23329]: cluster 2020-07-16T15:28:28.965845+0000 mgr.x (mgr.34562) 5280 : cluster [DBG] pgmap v3294: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:28:29.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:28:29 smithi132 bash[27079]: cluster 2020-07-16T15:28:28.965845+0000 mgr.x (mgr.34562) 5280 : cluster [DBG] pgmap v3294: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:28:31.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:28:31 smithi188 bash[23329]: cluster 2020-07-16T15:28:30.966293+0000 mgr.x (mgr.34562) 5281 : cluster [DBG] pgmap v3295: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:28:31.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:28:31 smithi132 bash[27079]: cluster 2020-07-16T15:28:30.966293+0000 mgr.x (mgr.34562) 5281 : cluster [DBG] pgmap v3295: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:28:33.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:28:33 smithi188 bash[23329]: cluster 2020-07-16T15:28:32.966802+0000 mgr.x (mgr.34562) 5282 : cluster [DBG] pgmap v3296: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:28:33.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:28:33 smithi132 bash[27079]: cluster 2020-07-16T15:28:32.966802+0000 mgr.x (mgr.34562) 5282 : cluster [DBG] pgmap v3296: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:28:34.408 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:28:34 smithi132 bash[27079]: audit 2020-07-16T15:28:33.863373+0000 mon.b (mon.2) 1170 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:28:34.408 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:28:34 smithi132 bash[27079]: audit 2020-07-16T15:28:33.863745+0000 mgr.x (mgr.34562) 5283 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:28:34.409 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:28:34 smithi132 bash[27079]: audit 2020-07-16T15:28:33.864776+0000 mon.b (mon.2) 1171 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:28:34.409 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:28:34 smithi132 bash[27079]: audit 2020-07-16T15:28:33.865109+0000 mgr.x (mgr.34562) 5284 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:28:34.409 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:28:34 smithi132 bash[27079]: audit 2020-07-16T15:28:33.866013+0000 mon.b (mon.2) 1172 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:28:34.409 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:28:34 smithi132 bash[27079]: audit 2020-07-16T15:28:33.866350+0000 mgr.x (mgr.34562) 5285 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:28:34.410 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:28:34 smithi132 bash[27079]: cephadm 2020-07-16T15:28:33.867039+0000 mgr.x (mgr.34562) 5286 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:28:34.410 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:28:34 smithi132 bash[27079]: audit 2020-07-16T15:28:33.867356+0000 mon.b (mon.2) 1173 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:28:34.410 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:28:34 smithi132 bash[27079]: cephadm 2020-07-16T15:28:33.868249+0000 mgr.x (mgr.34562) 5287 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:28:34.410 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:28:34 smithi132 bash[27079]: audit 2020-07-16T15:28:33.868609+0000 mon.b (mon.2) 1174 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:28:34.410 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:28:34 smithi132 bash[27079]: cephadm 2020-07-16T15:28:33.869336+0000 mgr.x (mgr.34562) 5288 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:28:34.411 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:28:34 smithi132 bash[27079]: cephadm 2020-07-16T15:28:33.869553+0000 mgr.x (mgr.34562) 5289 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:28:34.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:28:34 smithi188 bash[23329]: audit 2020-07-16T15:28:33.863373+0000 mon.b (mon.2) 1170 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:28:34.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:28:34 smithi188 bash[23329]: audit 2020-07-16T15:28:33.863745+0000 mgr.x (mgr.34562) 5283 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:28:34.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:28:34 smithi188 bash[23329]: audit 2020-07-16T15:28:33.864776+0000 mon.b (mon.2) 1171 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:28:34.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:28:34 smithi188 bash[23329]: audit 2020-07-16T15:28:33.865109+0000 mgr.x (mgr.34562) 5284 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:28:34.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:28:34 smithi188 bash[23329]: audit 2020-07-16T15:28:33.866013+0000 mon.b (mon.2) 1172 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:28:34.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:28:34 smithi188 bash[23329]: audit 2020-07-16T15:28:33.866350+0000 mgr.x (mgr.34562) 5285 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:28:34.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:28:34 smithi188 bash[23329]: cephadm 2020-07-16T15:28:33.867039+0000 mgr.x (mgr.34562) 5286 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:28:34.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:28:34 smithi188 bash[23329]: audit 2020-07-16T15:28:33.867356+0000 mon.b (mon.2) 1173 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:28:34.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:28:34 smithi188 bash[23329]: cephadm 2020-07-16T15:28:33.868249+0000 mgr.x (mgr.34562) 5287 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:28:34.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:28:34 smithi188 bash[23329]: audit 2020-07-16T15:28:33.868609+0000 mon.b (mon.2) 1174 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:28:34.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:28:34 smithi188 bash[23329]: cephadm 2020-07-16T15:28:33.869336+0000 mgr.x (mgr.34562) 5288 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:28:34.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:28:34 smithi188 bash[23329]: cephadm 2020-07-16T15:28:33.869553+0000 mgr.x (mgr.34562) 5289 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:28:35.418 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:28:35 smithi132 bash[27079]: cluster 2020-07-16T15:28:34.967216+0000 mgr.x (mgr.34562) 5290 : cluster [DBG] pgmap v3297: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:28:35.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:28:35 smithi188 bash[23329]: cluster 2020-07-16T15:28:34.967216+0000 mgr.x (mgr.34562) 5290 : cluster [DBG] pgmap v3297: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:28:37.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:28:36 smithi132 bash[27079]: audit 2020-07-16T15:28:36.776532+0000 mon.b (mon.2) 1175 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:28:37.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:28:36 smithi188 bash[23329]: audit 2020-07-16T15:28:36.776532+0000 mon.b (mon.2) 1175 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:28:38.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:28:37 smithi188 bash[23329]: cephadm 2020-07-16T15:28:36.777158+0000 mgr.x (mgr.34562) 5291 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:28:38.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:28:37 smithi188 bash[23329]: cephadm 2020-07-16T15:28:36.777573+0000 mgr.x (mgr.34562) 5292 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:28:38.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:28:37 smithi188 bash[23329]: cluster 2020-07-16T15:28:36.967716+0000 mgr.x (mgr.34562) 5293 : cluster [DBG] pgmap v3298: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:28:38.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:28:37 smithi132 bash[27079]: cephadm 2020-07-16T15:28:36.777158+0000 mgr.x (mgr.34562) 5291 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:28:38.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:28:37 smithi132 bash[27079]: cephadm 2020-07-16T15:28:36.777573+0000 mgr.x (mgr.34562) 5292 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:28:38.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:28:37 smithi132 bash[27079]: cluster 2020-07-16T15:28:36.967716+0000 mgr.x (mgr.34562) 5293 : cluster [DBG] pgmap v3298: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:28:39.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:28:39 smithi188 bash[23329]: cluster 2020-07-16T15:28:38.968165+0000 mgr.x (mgr.34562) 5294 : cluster [DBG] pgmap v3299: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:28:39.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:28:39 smithi132 bash[27079]: cluster 2020-07-16T15:28:38.968165+0000 mgr.x (mgr.34562) 5294 : cluster [DBG] pgmap v3299: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:28:41.785 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:28:41 smithi132 bash[27079]: cluster 2020-07-16T15:28:40.968669+0000 mgr.x (mgr.34562) 5295 : cluster [DBG] pgmap v3300: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:28:41.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:28:41 smithi188 bash[23329]: cluster 2020-07-16T15:28:40.968669+0000 mgr.x (mgr.34562) 5295 : cluster [DBG] pgmap v3300: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:28:43.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:28:43 smithi188 bash[23329]: cluster 2020-07-16T15:28:42.969065+0000 mgr.x (mgr.34562) 5296 : cluster [DBG] pgmap v3301: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:28:43.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:28:43 smithi132 bash[27079]: cluster 2020-07-16T15:28:42.969065+0000 mgr.x (mgr.34562) 5296 : cluster [DBG] pgmap v3301: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:28:45.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:28:45 smithi188 bash[23329]: cluster 2020-07-16T15:28:44.969747+0000 mgr.x (mgr.34562) 5297 : cluster [DBG] pgmap v3302: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:28:45.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:28:45 smithi132 bash[27079]: cluster 2020-07-16T15:28:44.969747+0000 mgr.x (mgr.34562) 5297 : cluster [DBG] pgmap v3302: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:28:47.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:28:47 smithi188 bash[23329]: cluster 2020-07-16T15:28:46.970274+0000 mgr.x (mgr.34562) 5298 : cluster [DBG] pgmap v3303: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:28:47.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:28:47 smithi132 bash[27079]: cluster 2020-07-16T15:28:46.970274+0000 mgr.x (mgr.34562) 5298 : cluster [DBG] pgmap v3303: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:28:49.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:28:49 smithi188 bash[23329]: cluster 2020-07-16T15:28:48.970725+0000 mgr.x (mgr.34562) 5299 : cluster [DBG] pgmap v3304: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:28:49.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:28:49 smithi132 bash[27079]: cluster 2020-07-16T15:28:48.970725+0000 mgr.x (mgr.34562) 5299 : cluster [DBG] pgmap v3304: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:28:51.259 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:28:51.521 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:28:51.521 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (111m) 4m ago 114m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:28:51.521 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (114m) 4m ago 114m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:28:51.521 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (111m) 4m ago 117m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:28:51.522 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (111m) 4m ago 119m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:28:51.522 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 4m ago 119m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:28:51.522 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (117m) 4m ago 117m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:28:51.522 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (117m) 4m ago 117m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:28:51.523 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (114m) 4m ago 114m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:28:51.523 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (114m) 4m ago 114m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:28:51.523 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (117m) 4m ago 117m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:28:51.523 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (116m) 4m ago 116m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:28:51.523 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (116m) 4m ago 116m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:28:51.524 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (116m) 4m ago 116m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:28:51.524 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (115m) 4m ago 116m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:28:51.524 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (115m) 4m ago 115m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:28:51.524 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (115m) 4m ago 115m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:28:51.525 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (115m) 4m ago 115m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:28:51.525 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (114m) 4m ago 114m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:28:51.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:28:51 smithi132 bash[27079]: cluster 2020-07-16T15:28:50.971217+0000 mgr.x (mgr.34562) 5300 : cluster [DBG] pgmap v3305: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:28:51.822 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:28:51.823 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:28:51.823 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:28:51.823 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:28:51.823 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:28:51.824 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:28:51.824 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:28:51.824 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:28:51.824 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:28:51.824 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:28:51.825 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:28:51.825 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:28:51.825 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:28:51.825 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:28:51.825 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:28:51.826 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:28:51.826 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:28:51.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:28:51 smithi188 bash[23329]: cluster 2020-07-16T15:28:50.971217+0000 mgr.x (mgr.34562) 5300 : cluster [DBG] pgmap v3305: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:28:52.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:28:52 smithi132 bash[27079]: audit 2020-07-16T15:28:51.247839+0000 mgr.x (mgr.34562) 5301 : audit [DBG] from='client.28492 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:28:52.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:28:52 smithi132 bash[27079]: audit 2020-07-16T15:28:51.516220+0000 mgr.x (mgr.34562) 5302 : audit [DBG] from='client.28498 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:28:52.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:28:52 smithi132 bash[27079]: audit 2020-07-16T15:28:51.789633+0000 mon.b (mon.2) 1176 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:28:52.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:28:52 smithi132 bash[27079]: cephadm 2020-07-16T15:28:51.790317+0000 mgr.x (mgr.34562) 5303 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:28:52.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:28:52 smithi132 bash[27079]: cephadm 2020-07-16T15:28:51.790457+0000 mgr.x (mgr.34562) 5304 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:28:52.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:28:52 smithi132 bash[27079]: audit 2020-07-16T15:28:51.818349+0000 mon.c (mon.1) 374 : audit [DBG] from='client.? 172.21.15.132:0/3607641186' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:28:52.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:28:52 smithi188 bash[23329]: audit 2020-07-16T15:28:51.247839+0000 mgr.x (mgr.34562) 5301 : audit [DBG] from='client.28492 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:28:52.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:28:52 smithi188 bash[23329]: audit 2020-07-16T15:28:51.516220+0000 mgr.x (mgr.34562) 5302 : audit [DBG] from='client.28498 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:28:52.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:28:52 smithi188 bash[23329]: audit 2020-07-16T15:28:51.789633+0000 mon.b (mon.2) 1176 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:28:52.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:28:52 smithi188 bash[23329]: cephadm 2020-07-16T15:28:51.790317+0000 mgr.x (mgr.34562) 5303 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:28:52.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:28:52 smithi188 bash[23329]: cephadm 2020-07-16T15:28:51.790457+0000 mgr.x (mgr.34562) 5304 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:28:52.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:28:52 smithi188 bash[23329]: audit 2020-07-16T15:28:51.818349+0000 mon.c (mon.1) 374 : audit [DBG] from='client.? 172.21.15.132:0/3607641186' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:28:53.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:28:53 smithi132 bash[27079]: cluster 2020-07-16T15:28:52.971703+0000 mgr.x (mgr.34562) 5305 : cluster [DBG] pgmap v3306: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:28:53.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:28:53 smithi188 bash[23329]: cluster 2020-07-16T15:28:52.971703+0000 mgr.x (mgr.34562) 5305 : cluster [DBG] pgmap v3306: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:28:55.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:28:55 smithi188 bash[23329]: cluster 2020-07-16T15:28:54.972078+0000 mgr.x (mgr.34562) 5306 : cluster [DBG] pgmap v3307: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:28:55.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:28:55 smithi132 bash[27079]: cluster 2020-07-16T15:28:54.972078+0000 mgr.x (mgr.34562) 5306 : cluster [DBG] pgmap v3307: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:28:57.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:28:57 smithi188 bash[23329]: cluster 2020-07-16T15:28:56.972511+0000 mgr.x (mgr.34562) 5307 : cluster [DBG] pgmap v3308: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:28:57.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:28:57 smithi132 bash[27079]: cluster 2020-07-16T15:28:56.972511+0000 mgr.x (mgr.34562) 5307 : cluster [DBG] pgmap v3308: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:28:59.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:28:59 smithi188 bash[23329]: cluster 2020-07-16T15:28:58.972946+0000 mgr.x (mgr.34562) 5308 : cluster [DBG] pgmap v3309: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:28:59.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:28:59 smithi132 bash[27079]: cluster 2020-07-16T15:28:58.972946+0000 mgr.x (mgr.34562) 5308 : cluster [DBG] pgmap v3309: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:29:01.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:29:01 smithi132 bash[27079]: cluster 2020-07-16T15:29:00.973429+0000 mgr.x (mgr.34562) 5309 : cluster [DBG] pgmap v3310: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:29:01.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:29:01 smithi188 bash[23329]: cluster 2020-07-16T15:29:00.973429+0000 mgr.x (mgr.34562) 5309 : cluster [DBG] pgmap v3310: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:29:03.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:29:03 smithi188 bash[23329]: cluster 2020-07-16T15:29:02.973945+0000 mgr.x (mgr.34562) 5310 : cluster [DBG] pgmap v3311: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:29:03.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:29:03 smithi132 bash[27079]: cluster 2020-07-16T15:29:02.973945+0000 mgr.x (mgr.34562) 5310 : cluster [DBG] pgmap v3311: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:29:05.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:29:05 smithi188 bash[23329]: cluster 2020-07-16T15:29:04.974514+0000 mgr.x (mgr.34562) 5311 : cluster [DBG] pgmap v3312: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:29:05.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:29:05 smithi132 bash[27079]: cluster 2020-07-16T15:29:04.974514+0000 mgr.x (mgr.34562) 5311 : cluster [DBG] pgmap v3312: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:29:07.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:29:06 smithi188 bash[23329]: audit 2020-07-16T15:29:06.805540+0000 mon.b (mon.2) 1177 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:29:07.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:29:06 smithi132 bash[27079]: audit 2020-07-16T15:29:06.805540+0000 mon.b (mon.2) 1177 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:29:08.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:29:07 smithi188 bash[23329]: cephadm 2020-07-16T15:29:06.806358+0000 mgr.x (mgr.34562) 5312 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:29:08.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:29:07 smithi188 bash[23329]: cephadm 2020-07-16T15:29:06.806506+0000 mgr.x (mgr.34562) 5313 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:29:08.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:29:07 smithi188 bash[23329]: cluster 2020-07-16T15:29:06.974954+0000 mgr.x (mgr.34562) 5314 : cluster [DBG] pgmap v3313: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:29:08.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:29:07 smithi132 bash[27079]: cephadm 2020-07-16T15:29:06.806358+0000 mgr.x (mgr.34562) 5312 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:29:08.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:29:07 smithi132 bash[27079]: cephadm 2020-07-16T15:29:06.806506+0000 mgr.x (mgr.34562) 5313 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:29:08.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:29:07 smithi132 bash[27079]: cluster 2020-07-16T15:29:06.974954+0000 mgr.x (mgr.34562) 5314 : cluster [DBG] pgmap v3313: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:29:09.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:29:09 smithi188 bash[23329]: cluster 2020-07-16T15:29:08.975368+0000 mgr.x (mgr.34562) 5315 : cluster [DBG] pgmap v3314: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:29:09.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:29:09 smithi132 bash[27079]: cluster 2020-07-16T15:29:08.975368+0000 mgr.x (mgr.34562) 5315 : cluster [DBG] pgmap v3314: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:29:11.782 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:29:11 smithi132 bash[27079]: cluster 2020-07-16T15:29:10.975731+0000 mgr.x (mgr.34562) 5316 : cluster [DBG] pgmap v3315: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:29:11.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:29:11 smithi188 bash[23329]: cluster 2020-07-16T15:29:10.975731+0000 mgr.x (mgr.34562) 5316 : cluster [DBG] pgmap v3315: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:29:13.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:29:13 smithi188 bash[23329]: cluster 2020-07-16T15:29:12.976190+0000 mgr.x (mgr.34562) 5317 : cluster [DBG] pgmap v3316: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:29:13.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:29:13 smithi132 bash[27079]: cluster 2020-07-16T15:29:12.976190+0000 mgr.x (mgr.34562) 5317 : cluster [DBG] pgmap v3316: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:29:15.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:29:15 smithi188 bash[23329]: cluster 2020-07-16T15:29:14.976616+0000 mgr.x (mgr.34562) 5318 : cluster [DBG] pgmap v3317: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:29:15.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:29:15 smithi132 bash[27079]: cluster 2020-07-16T15:29:14.976616+0000 mgr.x (mgr.34562) 5318 : cluster [DBG] pgmap v3317: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:29:17.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:29:17 smithi188 bash[23329]: cluster 2020-07-16T15:29:16.977139+0000 mgr.x (mgr.34562) 5319 : cluster [DBG] pgmap v3318: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:29:17.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:29:17 smithi132 bash[27079]: cluster 2020-07-16T15:29:16.977139+0000 mgr.x (mgr.34562) 5319 : cluster [DBG] pgmap v3318: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:29:19.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:29:19 smithi188 bash[23329]: cluster 2020-07-16T15:29:18.977638+0000 mgr.x (mgr.34562) 5320 : cluster [DBG] pgmap v3319: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:29:19.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:29:19 smithi132 bash[27079]: cluster 2020-07-16T15:29:18.977638+0000 mgr.x (mgr.34562) 5320 : cluster [DBG] pgmap v3319: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:29:21.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:29:21 smithi132 bash[27079]: cluster 2020-07-16T15:29:20.977968+0000 mgr.x (mgr.34562) 5321 : cluster [DBG] pgmap v3320: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:29:21.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:29:21 smithi188 bash[23329]: cluster 2020-07-16T15:29:20.977968+0000 mgr.x (mgr.34562) 5321 : cluster [DBG] pgmap v3320: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:29:22.117 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:29:22.377 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:29:22.378 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (112m) 5m ago 115m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:29:22.378 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (114m) 5m ago 114m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:29:22.378 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (112m) 5m ago 117m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:29:22.378 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (111m) 5m ago 119m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:29:22.379 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 5m ago 119m quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:29:22.379 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (118m) 5m ago 118m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:29:22.379 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (118m) 5m ago 118m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:29:22.379 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (115m) 5m ago 115m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:29:22.379 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (115m) 5m ago 115m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:29:22.380 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (117m) 5m ago 117m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:29:22.380 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (117m) 5m ago 117m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:29:22.380 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (117m) 5m ago 117m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:29:22.380 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (116m) 5m ago 116m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:29:22.380 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (116m) 5m ago 116m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:29:22.381 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (116m) 5m ago 116m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:29:22.381 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (116m) 5m ago 116m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:29:22.381 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (115m) 5m ago 115m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:29:22.381 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (114m) 5m ago 115m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:29:22.679 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:29:22.679 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:29:22.680 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:29:22.680 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:29:22.680 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:29:22.680 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:29:22.681 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:29:22.681 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:29:22.681 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:29:22.681 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:29:22.681 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:29:22.682 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:29:22.685 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:29:22.685 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:29:22.687 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:29:22.687 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:29:22.687 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:29:22.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:29:22 smithi132 bash[27079]: audit 2020-07-16T15:29:21.822221+0000 mon.b (mon.2) 1178 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:29:22.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:29:22 smithi132 bash[27079]: cephadm 2020-07-16T15:29:21.822920+0000 mgr.x (mgr.34562) 5322 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:29:22.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:29:22 smithi132 bash[27079]: cephadm 2020-07-16T15:29:21.823371+0000 mgr.x (mgr.34562) 5323 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:29:22.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:29:22 smithi188 bash[23329]: audit 2020-07-16T15:29:21.822221+0000 mon.b (mon.2) 1178 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:29:22.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:29:22 smithi188 bash[23329]: cephadm 2020-07-16T15:29:21.822920+0000 mgr.x (mgr.34562) 5322 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:29:22.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:29:22 smithi188 bash[23329]: cephadm 2020-07-16T15:29:21.823371+0000 mgr.x (mgr.34562) 5323 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:29:23.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:29:23 smithi132 bash[27079]: audit 2020-07-16T15:29:22.106042+0000 mgr.x (mgr.34562) 5324 : audit [DBG] from='client.28510 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:29:23.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:29:23 smithi132 bash[27079]: audit 2020-07-16T15:29:22.373532+0000 mgr.x (mgr.34562) 5325 : audit [DBG] from='client.28516 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:29:23.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:29:23 smithi132 bash[27079]: audit 2020-07-16T15:29:22.678444+0000 mon.c (mon.1) 375 : audit [DBG] from='client.? 172.21.15.132:0/2248635852' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:29:23.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:29:23 smithi132 bash[27079]: cluster 2020-07-16T15:29:22.978369+0000 mgr.x (mgr.34562) 5326 : cluster [DBG] pgmap v3321: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:29:23.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:29:23 smithi188 bash[23329]: audit 2020-07-16T15:29:22.106042+0000 mgr.x (mgr.34562) 5324 : audit [DBG] from='client.28510 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:29:23.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:29:23 smithi188 bash[23329]: audit 2020-07-16T15:29:22.373532+0000 mgr.x (mgr.34562) 5325 : audit [DBG] from='client.28516 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:29:23.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:29:23 smithi188 bash[23329]: audit 2020-07-16T15:29:22.678444+0000 mon.c (mon.1) 375 : audit [DBG] from='client.? 172.21.15.132:0/2248635852' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:29:23.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:29:23 smithi188 bash[23329]: cluster 2020-07-16T15:29:22.978369+0000 mgr.x (mgr.34562) 5326 : cluster [DBG] pgmap v3321: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:29:25.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:29:25 smithi188 bash[23329]: cluster 2020-07-16T15:29:24.978836+0000 mgr.x (mgr.34562) 5327 : cluster [DBG] pgmap v3322: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:29:25.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:29:25 smithi132 bash[27079]: cluster 2020-07-16T15:29:24.978836+0000 mgr.x (mgr.34562) 5327 : cluster [DBG] pgmap v3322: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:29:27.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:29:27 smithi188 bash[23329]: cluster 2020-07-16T15:29:26.979214+0000 mgr.x (mgr.34562) 5328 : cluster [DBG] pgmap v3323: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:29:27.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:29:27 smithi132 bash[27079]: cluster 2020-07-16T15:29:26.979214+0000 mgr.x (mgr.34562) 5328 : cluster [DBG] pgmap v3323: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:29:29.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:29:29 smithi188 bash[23329]: cluster 2020-07-16T15:29:28.979743+0000 mgr.x (mgr.34562) 5329 : cluster [DBG] pgmap v3324: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:29:29.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:29:29 smithi132 bash[27079]: cluster 2020-07-16T15:29:28.979743+0000 mgr.x (mgr.34562) 5329 : cluster [DBG] pgmap v3324: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:29:31.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:29:31 smithi132 bash[27079]: cluster 2020-07-16T15:29:30.980199+0000 mgr.x (mgr.34562) 5330 : cluster [DBG] pgmap v3325: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:29:31.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:29:31 smithi188 bash[23329]: cluster 2020-07-16T15:29:30.980199+0000 mgr.x (mgr.34562) 5330 : cluster [DBG] pgmap v3325: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:29:33.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:29:33 smithi188 bash[23329]: cluster 2020-07-16T15:29:32.980814+0000 mgr.x (mgr.34562) 5331 : cluster [DBG] pgmap v3326: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:29:33.534 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:29:33 smithi132 bash[27079]: cluster 2020-07-16T15:29:32.980814+0000 mgr.x (mgr.34562) 5331 : cluster [DBG] pgmap v3326: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:29:35.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:29:35 smithi188 bash[23329]: cluster 2020-07-16T15:29:34.981163+0000 mgr.x (mgr.34562) 5332 : cluster [DBG] pgmap v3327: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:29:35.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:29:35 smithi132 bash[27079]: cluster 2020-07-16T15:29:34.981163+0000 mgr.x (mgr.34562) 5332 : cluster [DBG] pgmap v3327: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:29:37.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:29:36 smithi188 bash[23329]: audit 2020-07-16T15:29:36.830907+0000 mon.b (mon.2) 1179 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:29:37.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:29:36 smithi188 bash[23329]: audit 2020-07-16T15:29:36.832336+0000 mon.b (mon.2) 1180 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:29:37.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:29:36 smithi188 bash[23329]: audit 2020-07-16T15:29:36.833492+0000 mon.b (mon.2) 1181 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:29:37.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:29:36 smithi188 bash[23329]: audit 2020-07-16T15:29:36.834902+0000 mon.b (mon.2) 1182 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:29:37.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:29:36 smithi188 bash[23329]: audit 2020-07-16T15:29:36.836207+0000 mon.b (mon.2) 1183 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:29:37.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:29:36 smithi132 bash[27079]: audit 2020-07-16T15:29:36.830907+0000 mon.b (mon.2) 1179 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:29:37.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:29:36 smithi132 bash[27079]: audit 2020-07-16T15:29:36.832336+0000 mon.b (mon.2) 1180 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:29:37.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:29:36 smithi132 bash[27079]: audit 2020-07-16T15:29:36.833492+0000 mon.b (mon.2) 1181 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:29:37.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:29:36 smithi132 bash[27079]: audit 2020-07-16T15:29:36.834902+0000 mon.b (mon.2) 1182 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:29:37.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:29:36 smithi132 bash[27079]: audit 2020-07-16T15:29:36.836207+0000 mon.b (mon.2) 1183 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:29:38.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:29:37 smithi132 bash[27079]: audit 2020-07-16T15:29:36.831270+0000 mgr.x (mgr.34562) 5333 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:29:38.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:29:37 smithi132 bash[27079]: audit 2020-07-16T15:29:36.832649+0000 mgr.x (mgr.34562) 5334 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:29:38.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:29:37 smithi132 bash[27079]: audit 2020-07-16T15:29:36.833785+0000 mgr.x (mgr.34562) 5335 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:29:38.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:29:37 smithi132 bash[27079]: cephadm 2020-07-16T15:29:36.834515+0000 mgr.x (mgr.34562) 5336 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:29:38.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:29:37 smithi132 bash[27079]: cephadm 2020-07-16T15:29:36.835789+0000 mgr.x (mgr.34562) 5337 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:29:38.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:29:37 smithi132 bash[27079]: cephadm 2020-07-16T15:29:36.836946+0000 mgr.x (mgr.34562) 5338 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:29:38.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:29:37 smithi132 bash[27079]: cephadm 2020-07-16T15:29:36.837074+0000 mgr.x (mgr.34562) 5339 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:29:38.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:29:37 smithi132 bash[27079]: cluster 2020-07-16T15:29:36.981620+0000 mgr.x (mgr.34562) 5340 : cluster [DBG] pgmap v3328: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:29:38.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:29:37 smithi188 bash[23329]: audit 2020-07-16T15:29:36.831270+0000 mgr.x (mgr.34562) 5333 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:29:38.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:29:37 smithi188 bash[23329]: audit 2020-07-16T15:29:36.832649+0000 mgr.x (mgr.34562) 5334 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:29:38.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:29:37 smithi188 bash[23329]: audit 2020-07-16T15:29:36.833785+0000 mgr.x (mgr.34562) 5335 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:29:38.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:29:37 smithi188 bash[23329]: cephadm 2020-07-16T15:29:36.834515+0000 mgr.x (mgr.34562) 5336 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:29:38.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:29:37 smithi188 bash[23329]: cephadm 2020-07-16T15:29:36.835789+0000 mgr.x (mgr.34562) 5337 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:29:38.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:29:37 smithi188 bash[23329]: cephadm 2020-07-16T15:29:36.836946+0000 mgr.x (mgr.34562) 5338 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:29:38.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:29:37 smithi188 bash[23329]: cephadm 2020-07-16T15:29:36.837074+0000 mgr.x (mgr.34562) 5339 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:29:38.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:29:37 smithi188 bash[23329]: cluster 2020-07-16T15:29:36.981620+0000 mgr.x (mgr.34562) 5340 : cluster [DBG] pgmap v3328: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:29:39.169 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:29:39 smithi132 bash[27079]: cluster 2020-07-16T15:29:38.982023+0000 mgr.x (mgr.34562) 5341 : cluster [DBG] pgmap v3329: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:29:39.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:29:39 smithi188 bash[23329]: cluster 2020-07-16T15:29:38.982023+0000 mgr.x (mgr.34562) 5341 : cluster [DBG] pgmap v3329: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:29:40.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:29:40 smithi188 bash[23329]: audit 2020-07-16T15:29:39.805464+0000 mon.b (mon.2) 1184 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:29:40.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:29:40 smithi188 bash[23329]: cephadm 2020-07-16T15:29:39.806151+0000 mgr.x (mgr.34562) 5342 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:29:40.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:29:40 smithi188 bash[23329]: cephadm 2020-07-16T15:29:39.806576+0000 mgr.x (mgr.34562) 5343 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:29:40.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:29:40 smithi132 bash[27079]: audit 2020-07-16T15:29:39.805464+0000 mon.b (mon.2) 1184 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:29:40.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:29:40 smithi132 bash[27079]: cephadm 2020-07-16T15:29:39.806151+0000 mgr.x (mgr.34562) 5342 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:29:40.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:29:40 smithi132 bash[27079]: cephadm 2020-07-16T15:29:39.806576+0000 mgr.x (mgr.34562) 5343 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:29:41.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:29:41 smithi132 bash[27079]: cluster 2020-07-16T15:29:40.982513+0000 mgr.x (mgr.34562) 5344 : cluster [DBG] pgmap v3330: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:29:41.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:29:41 smithi188 bash[23329]: cluster 2020-07-16T15:29:40.982513+0000 mgr.x (mgr.34562) 5344 : cluster [DBG] pgmap v3330: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:29:43.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:29:43 smithi188 bash[23329]: cluster 2020-07-16T15:29:42.983050+0000 mgr.x (mgr.34562) 5345 : cluster [DBG] pgmap v3331: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:29:43.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:29:43 smithi132 bash[27079]: cluster 2020-07-16T15:29:42.983050+0000 mgr.x (mgr.34562) 5345 : cluster [DBG] pgmap v3331: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:29:45.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:29:45 smithi188 bash[23329]: cluster 2020-07-16T15:29:44.983496+0000 mgr.x (mgr.34562) 5346 : cluster [DBG] pgmap v3332: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:29:45.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:29:45 smithi132 bash[27079]: cluster 2020-07-16T15:29:44.983496+0000 mgr.x (mgr.34562) 5346 : cluster [DBG] pgmap v3332: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:29:47.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:29:47 smithi188 bash[23329]: cluster 2020-07-16T15:29:46.984052+0000 mgr.x (mgr.34562) 5347 : cluster [DBG] pgmap v3333: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:29:47.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:29:47 smithi132 bash[27079]: cluster 2020-07-16T15:29:46.984052+0000 mgr.x (mgr.34562) 5347 : cluster [DBG] pgmap v3333: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:29:49.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:29:49 smithi188 bash[23329]: cluster 2020-07-16T15:29:48.984547+0000 mgr.x (mgr.34562) 5348 : cluster [DBG] pgmap v3334: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:29:49.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:29:49 smithi132 bash[27079]: cluster 2020-07-16T15:29:48.984547+0000 mgr.x (mgr.34562) 5348 : cluster [DBG] pgmap v3334: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:29:51.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:29:51 smithi132 bash[27079]: cluster 2020-07-16T15:29:50.985022+0000 mgr.x (mgr.34562) 5349 : cluster [DBG] pgmap v3335: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:29:51.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:29:51 smithi188 bash[23329]: cluster 2020-07-16T15:29:50.985022+0000 mgr.x (mgr.34562) 5349 : cluster [DBG] pgmap v3335: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:29:52.980 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:29:53.246 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:29:53.246 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (112m) 5m ago 115m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:29:53.246 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (115m) 5m ago 115m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:29:53.246 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (112m) 5m ago 118m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:29:53.247 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (112m) 5m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:29:53.247 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 5m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:29:53.247 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (118m) 5m ago 118m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:29:53.247 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (118m) 5m ago 118m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:29:53.247 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (115m) 5m ago 115m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:29:53.248 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (115m) 5m ago 115m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:29:53.248 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (118m) 5m ago 118m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:29:53.248 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (117m) 5m ago 117m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:29:53.248 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (117m) 5m ago 117m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:29:53.248 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (117m) 5m ago 117m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:29:53.249 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (116m) 5m ago 117m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:29:53.249 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (116m) 5m ago 116m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:29:53.249 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (116m) 5m ago 116m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:29:53.249 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (116m) 5m ago 116m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:29:53.249 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (115m) 5m ago 115m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:29:53.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:29:53 smithi188 bash[23329]: audit 2020-07-16T15:29:52.969406+0000 mgr.x (mgr.34562) 5350 : audit [DBG] from='client.28528 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:29:53.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:29:53 smithi188 bash[23329]: cluster 2020-07-16T15:29:52.985517+0000 mgr.x (mgr.34562) 5351 : cluster [DBG] pgmap v3336: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:29:53.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:29:53 smithi132 bash[27079]: audit 2020-07-16T15:29:52.969406+0000 mgr.x (mgr.34562) 5350 : audit [DBG] from='client.28528 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:29:53.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:29:53 smithi132 bash[27079]: cluster 2020-07-16T15:29:52.985517+0000 mgr.x (mgr.34562) 5351 : cluster [DBG] pgmap v3336: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:29:53.542 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:29:53.542 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:29:53.542 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:29:53.543 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:29:53.543 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:29:53.543 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:29:53.543 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:29:53.543 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:29:53.544 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:29:53.544 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:29:53.544 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:29:53.544 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:29:53.544 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:29:53.545 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:29:53.545 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:29:53.545 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:29:53.545 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:29:54.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:29:54 smithi188 bash[23329]: audit 2020-07-16T15:29:53.241513+0000 mgr.x (mgr.34562) 5352 : audit [DBG] from='client.28534 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:29:54.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:29:54 smithi188 bash[23329]: audit 2020-07-16T15:29:53.541460+0000 mon.c (mon.1) 376 : audit [DBG] from='client.? 172.21.15.132:0/1743398168' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:29:54.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:29:54 smithi132 bash[27079]: audit 2020-07-16T15:29:53.241513+0000 mgr.x (mgr.34562) 5352 : audit [DBG] from='client.28534 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:29:54.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:29:54 smithi132 bash[27079]: audit 2020-07-16T15:29:53.541460+0000 mon.c (mon.1) 376 : audit [DBG] from='client.? 172.21.15.132:0/1743398168' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:29:55.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:29:55 smithi188 bash[23329]: audit 2020-07-16T15:29:54.809002+0000 mon.b (mon.2) 1185 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:29:55.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:29:55 smithi188 bash[23329]: cephadm 2020-07-16T15:29:54.809881+0000 mgr.x (mgr.34562) 5353 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:29:55.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:29:55 smithi188 bash[23329]: cephadm 2020-07-16T15:29:54.810387+0000 mgr.x (mgr.34562) 5354 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:29:55.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:29:55 smithi188 bash[23329]: cluster 2020-07-16T15:29:54.985935+0000 mgr.x (mgr.34562) 5355 : cluster [DBG] pgmap v3337: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:29:55.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:29:55 smithi132 bash[27079]: audit 2020-07-16T15:29:54.809002+0000 mon.b (mon.2) 1185 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:29:55.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:29:55 smithi132 bash[27079]: cephadm 2020-07-16T15:29:54.809881+0000 mgr.x (mgr.34562) 5353 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:29:55.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:29:55 smithi132 bash[27079]: cephadm 2020-07-16T15:29:54.810387+0000 mgr.x (mgr.34562) 5354 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:29:55.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:29:55 smithi132 bash[27079]: cluster 2020-07-16T15:29:54.985935+0000 mgr.x (mgr.34562) 5355 : cluster [DBG] pgmap v3337: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:29:57.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:29:57 smithi188 bash[23329]: cluster 2020-07-16T15:29:56.986514+0000 mgr.x (mgr.34562) 5356 : cluster [DBG] pgmap v3338: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:29:57.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:29:57 smithi132 bash[27079]: cluster 2020-07-16T15:29:56.986514+0000 mgr.x (mgr.34562) 5356 : cluster [DBG] pgmap v3338: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:29:59.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:29:59 smithi188 bash[23329]: cluster 2020-07-16T15:29:58.986975+0000 mgr.x (mgr.34562) 5357 : cluster [DBG] pgmap v3339: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:29:59.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:29:59 smithi132 bash[27079]: cluster 2020-07-16T15:29:58.986975+0000 mgr.x (mgr.34562) 5357 : cluster [DBG] pgmap v3339: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:30:01.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:30:01 smithi132 bash[27079]: cluster 2020-07-16T15:30:00.987432+0000 mgr.x (mgr.34562) 5358 : cluster [DBG] pgmap v3340: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:30:01.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:30:01 smithi188 bash[23329]: cluster 2020-07-16T15:30:00.987432+0000 mgr.x (mgr.34562) 5358 : cluster [DBG] pgmap v3340: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:30:03.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:30:03 smithi188 bash[23329]: cluster 2020-07-16T15:30:02.987943+0000 mgr.x (mgr.34562) 5359 : cluster [DBG] pgmap v3341: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:30:03.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:30:03 smithi132 bash[27079]: cluster 2020-07-16T15:30:02.987943+0000 mgr.x (mgr.34562) 5359 : cluster [DBG] pgmap v3341: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:30:05.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:30:05 smithi188 bash[23329]: cluster 2020-07-16T15:30:04.988440+0000 mgr.x (mgr.34562) 5360 : cluster [DBG] pgmap v3342: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:30:05.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:30:05 smithi132 bash[27079]: cluster 2020-07-16T15:30:04.988440+0000 mgr.x (mgr.34562) 5360 : cluster [DBG] pgmap v3342: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:30:07.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:30:07 smithi188 bash[23329]: cluster 2020-07-16T15:30:06.988821+0000 mgr.x (mgr.34562) 5361 : cluster [DBG] pgmap v3343: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:30:07.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:30:07 smithi132 bash[27079]: cluster 2020-07-16T15:30:06.988821+0000 mgr.x (mgr.34562) 5361 : cluster [DBG] pgmap v3343: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:30:09.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:30:09 smithi188 bash[23329]: cluster 2020-07-16T15:30:08.989189+0000 mgr.x (mgr.34562) 5362 : cluster [DBG] pgmap v3344: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:30:09.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:30:09 smithi132 bash[27079]: cluster 2020-07-16T15:30:08.989189+0000 mgr.x (mgr.34562) 5362 : cluster [DBG] pgmap v3344: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:30:10.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:30:10 smithi188 bash[23329]: audit 2020-07-16T15:30:09.821692+0000 mon.b (mon.2) 1186 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:30:10.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:30:10 smithi188 bash[23329]: cephadm 2020-07-16T15:30:09.822838+0000 mgr.x (mgr.34562) 5363 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:30:10.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:30:10 smithi188 bash[23329]: cephadm 2020-07-16T15:30:09.822912+0000 mgr.x (mgr.34562) 5364 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:30:10.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:30:10 smithi132 bash[27079]: audit 2020-07-16T15:30:09.821692+0000 mon.b (mon.2) 1186 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:30:10.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:30:10 smithi132 bash[27079]: cephadm 2020-07-16T15:30:09.822838+0000 mgr.x (mgr.34562) 5363 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:30:10.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:30:10 smithi132 bash[27079]: cephadm 2020-07-16T15:30:09.822912+0000 mgr.x (mgr.34562) 5364 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:30:11.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:30:11 smithi132 bash[27079]: cluster 2020-07-16T15:30:10.989595+0000 mgr.x (mgr.34562) 5365 : cluster [DBG] pgmap v3345: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:30:11.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:30:11 smithi188 bash[23329]: cluster 2020-07-16T15:30:10.989595+0000 mgr.x (mgr.34562) 5365 : cluster [DBG] pgmap v3345: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:30:13.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:30:13 smithi188 bash[23329]: cluster 2020-07-16T15:30:12.990006+0000 mgr.x (mgr.34562) 5366 : cluster [DBG] pgmap v3346: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:30:13.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:30:13 smithi132 bash[27079]: cluster 2020-07-16T15:30:12.990006+0000 mgr.x (mgr.34562) 5366 : cluster [DBG] pgmap v3346: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:30:15.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:30:15 smithi188 bash[23329]: cluster 2020-07-16T15:30:14.990483+0000 mgr.x (mgr.34562) 5367 : cluster [DBG] pgmap v3347: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:30:15.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:30:15 smithi132 bash[27079]: cluster 2020-07-16T15:30:14.990483+0000 mgr.x (mgr.34562) 5367 : cluster [DBG] pgmap v3347: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:30:17.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:30:17 smithi188 bash[23329]: cluster 2020-07-16T15:30:16.990926+0000 mgr.x (mgr.34562) 5368 : cluster [DBG] pgmap v3348: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:30:17.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:30:17 smithi132 bash[27079]: cluster 2020-07-16T15:30:16.990926+0000 mgr.x (mgr.34562) 5368 : cluster [DBG] pgmap v3348: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:30:19.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:30:19 smithi188 bash[23329]: cluster 2020-07-16T15:30:18.991267+0000 mgr.x (mgr.34562) 5369 : cluster [DBG] pgmap v3349: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:30:19.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:30:19 smithi132 bash[27079]: cluster 2020-07-16T15:30:18.991267+0000 mgr.x (mgr.34562) 5369 : cluster [DBG] pgmap v3349: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:30:21.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:30:21 smithi132 bash[27079]: cluster 2020-07-16T15:30:20.991727+0000 mgr.x (mgr.34562) 5370 : cluster [DBG] pgmap v3350: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:30:21.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:30:21 smithi188 bash[23329]: cluster 2020-07-16T15:30:20.991727+0000 mgr.x (mgr.34562) 5370 : cluster [DBG] pgmap v3350: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:30:23.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:30:23 smithi188 bash[23329]: cluster 2020-07-16T15:30:22.992260+0000 mgr.x (mgr.34562) 5371 : cluster [DBG] pgmap v3351: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:30:23.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:30:23 smithi132 bash[27079]: cluster 2020-07-16T15:30:22.992260+0000 mgr.x (mgr.34562) 5371 : cluster [DBG] pgmap v3351: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:30:23.840 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:30:24.100 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:30:24.100 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (113m) 6m ago 116m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:30:24.101 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (115m) 6m ago 115m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:30:24.101 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (113m) 6m ago 119m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:30:24.101 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (112m) 6m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:30:24.101 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 6m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:30:24.102 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (119m) 6m ago 119m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:30:24.102 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (119m) 6m ago 119m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:30:24.102 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (116m) 6m ago 116m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:30:24.102 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (116m) 6m ago 116m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:30:24.102 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (118m) 6m ago 118m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:30:24.102 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (118m) 6m ago 118m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:30:24.103 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (118m) 6m ago 118m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:30:24.103 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (117m) 6m ago 117m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:30:24.103 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (117m) 6m ago 117m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:30:24.103 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (117m) 6m ago 117m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:30:24.103 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (117m) 6m ago 117m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:30:24.104 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (116m) 6m ago 116m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:30:24.104 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (115m) 6m ago 116m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:30:24.398 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:30:24.399 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:30:24.399 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:30:24.399 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:30:24.399 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:30:24.399 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:30:24.400 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:30:24.400 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:30:24.400 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:30:24.400 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:30:24.400 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:30:24.401 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:30:24.401 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:30:24.401 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:30:24.401 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:30:24.401 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:30:24.402 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:30:24.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:30:24 smithi188 bash[23329]: audit 2020-07-16T15:30:23.829247+0000 mgr.x (mgr.34562) 5372 : audit [DBG] from='client.28546 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:30:24.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:30:24 smithi132 bash[27079]: audit 2020-07-16T15:30:23.829247+0000 mgr.x (mgr.34562) 5372 : audit [DBG] from='client.28546 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:30:25.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:30:25 smithi188 bash[23329]: audit 2020-07-16T15:30:24.096147+0000 mgr.x (mgr.34562) 5373 : audit [DBG] from='client.28552 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:30:25.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:30:25 smithi188 bash[23329]: audit 2020-07-16T15:30:24.397753+0000 mon.c (mon.1) 377 : audit [DBG] from='client.? 172.21.15.132:0/72038509' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:30:25.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:30:25 smithi188 bash[23329]: audit 2020-07-16T15:30:24.829918+0000 mon.b (mon.2) 1187 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:30:25.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:30:25 smithi188 bash[23329]: cephadm 2020-07-16T15:30:24.830774+0000 mgr.x (mgr.34562) 5374 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:30:25.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:30:25 smithi188 bash[23329]: cephadm 2020-07-16T15:30:24.831129+0000 mgr.x (mgr.34562) 5375 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:30:25.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:30:25 smithi188 bash[23329]: cluster 2020-07-16T15:30:24.992764+0000 mgr.x (mgr.34562) 5376 : cluster [DBG] pgmap v3352: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:30:25.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:30:25 smithi132 bash[27079]: audit 2020-07-16T15:30:24.096147+0000 mgr.x (mgr.34562) 5373 : audit [DBG] from='client.28552 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:30:25.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:30:25 smithi132 bash[27079]: audit 2020-07-16T15:30:24.397753+0000 mon.c (mon.1) 377 : audit [DBG] from='client.? 172.21.15.132:0/72038509' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:30:25.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:30:25 smithi132 bash[27079]: audit 2020-07-16T15:30:24.829918+0000 mon.b (mon.2) 1187 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:30:25.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:30:25 smithi132 bash[27079]: cephadm 2020-07-16T15:30:24.830774+0000 mgr.x (mgr.34562) 5374 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:30:25.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:30:25 smithi132 bash[27079]: cephadm 2020-07-16T15:30:24.831129+0000 mgr.x (mgr.34562) 5375 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:30:25.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:30:25 smithi132 bash[27079]: cluster 2020-07-16T15:30:24.992764+0000 mgr.x (mgr.34562) 5376 : cluster [DBG] pgmap v3352: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:30:27.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:30:27 smithi188 bash[23329]: cluster 2020-07-16T15:30:26.993238+0000 mgr.x (mgr.34562) 5377 : cluster [DBG] pgmap v3353: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:30:27.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:30:27 smithi132 bash[27079]: cluster 2020-07-16T15:30:26.993238+0000 mgr.x (mgr.34562) 5377 : cluster [DBG] pgmap v3353: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:30:29.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:30:29 smithi188 bash[23329]: cluster 2020-07-16T15:30:28.993741+0000 mgr.x (mgr.34562) 5378 : cluster [DBG] pgmap v3354: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:30:29.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:30:29 smithi132 bash[27079]: cluster 2020-07-16T15:30:28.993741+0000 mgr.x (mgr.34562) 5378 : cluster [DBG] pgmap v3354: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:30:31.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:30:31 smithi132 bash[27079]: cluster 2020-07-16T15:30:30.994066+0000 mgr.x (mgr.34562) 5379 : cluster [DBG] pgmap v3355: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:30:31.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:30:31 smithi188 bash[23329]: cluster 2020-07-16T15:30:30.994066+0000 mgr.x (mgr.34562) 5379 : cluster [DBG] pgmap v3355: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:30:33.427 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:30:33 smithi188 bash[23329]: cluster 2020-07-16T15:30:32.994567+0000 mgr.x (mgr.34562) 5380 : cluster [DBG] pgmap v3356: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:30:33.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:30:33 smithi132 bash[27079]: cluster 2020-07-16T15:30:32.994567+0000 mgr.x (mgr.34562) 5380 : cluster [DBG] pgmap v3356: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:30:35.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:30:35 smithi188 bash[23329]: cluster 2020-07-16T15:30:34.994990+0000 mgr.x (mgr.34562) 5381 : cluster [DBG] pgmap v3357: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:30:35.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:30:35 smithi132 bash[27079]: cluster 2020-07-16T15:30:34.994990+0000 mgr.x (mgr.34562) 5381 : cluster [DBG] pgmap v3357: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:30:37.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:30:37 smithi188 bash[23329]: cluster 2020-07-16T15:30:36.995454+0000 mgr.x (mgr.34562) 5382 : cluster [DBG] pgmap v3358: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:30:37.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:30:37 smithi132 bash[27079]: cluster 2020-07-16T15:30:36.995454+0000 mgr.x (mgr.34562) 5382 : cluster [DBG] pgmap v3358: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:30:39.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:30:39 smithi188 bash[23329]: cluster 2020-07-16T15:30:38.995798+0000 mgr.x (mgr.34562) 5383 : cluster [DBG] pgmap v3359: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:30:39.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:30:39 smithi132 bash[27079]: cluster 2020-07-16T15:30:38.995798+0000 mgr.x (mgr.34562) 5383 : cluster [DBG] pgmap v3359: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:30:40.410 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:30:40 smithi132 bash[27079]: audit 2020-07-16T15:30:39.849141+0000 mon.b (mon.2) 1188 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:30:40.410 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:30:40 smithi132 bash[27079]: audit 2020-07-16T15:30:39.849563+0000 mgr.x (mgr.34562) 5384 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:30:40.411 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:30:40 smithi132 bash[27079]: audit 2020-07-16T15:30:39.850552+0000 mon.b (mon.2) 1189 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:30:40.411 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:30:40 smithi132 bash[27079]: audit 2020-07-16T15:30:39.850873+0000 mgr.x (mgr.34562) 5385 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:30:40.411 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:30:40 smithi132 bash[27079]: audit 2020-07-16T15:30:39.851770+0000 mon.b (mon.2) 1190 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:30:40.411 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:30:40 smithi132 bash[27079]: audit 2020-07-16T15:30:39.852057+0000 mgr.x (mgr.34562) 5386 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:30:40.411 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:30:40 smithi132 bash[27079]: cephadm 2020-07-16T15:30:39.852784+0000 mgr.x (mgr.34562) 5387 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:30:40.412 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:30:40 smithi132 bash[27079]: audit 2020-07-16T15:30:39.853170+0000 mon.b (mon.2) 1191 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:30:40.412 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:30:40 smithi132 bash[27079]: cephadm 2020-07-16T15:30:39.853997+0000 mgr.x (mgr.34562) 5388 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:30:40.412 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:30:40 smithi132 bash[27079]: audit 2020-07-16T15:30:39.854526+0000 mon.b (mon.2) 1192 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:30:40.412 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:30:40 smithi132 bash[27079]: cephadm 2020-07-16T15:30:39.855265+0000 mgr.x (mgr.34562) 5389 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:30:40.412 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:30:40 smithi132 bash[27079]: cephadm 2020-07-16T15:30:39.855380+0000 mgr.x (mgr.34562) 5390 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:30:40.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:30:40 smithi188 bash[23329]: audit 2020-07-16T15:30:39.849141+0000 mon.b (mon.2) 1188 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:30:40.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:30:40 smithi188 bash[23329]: audit 2020-07-16T15:30:39.849563+0000 mgr.x (mgr.34562) 5384 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:30:40.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:30:40 smithi188 bash[23329]: audit 2020-07-16T15:30:39.850552+0000 mon.b (mon.2) 1189 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:30:40.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:30:40 smithi188 bash[23329]: audit 2020-07-16T15:30:39.850873+0000 mgr.x (mgr.34562) 5385 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:30:40.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:30:40 smithi188 bash[23329]: audit 2020-07-16T15:30:39.851770+0000 mon.b (mon.2) 1190 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:30:40.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:30:40 smithi188 bash[23329]: audit 2020-07-16T15:30:39.852057+0000 mgr.x (mgr.34562) 5386 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:30:40.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:30:40 smithi188 bash[23329]: cephadm 2020-07-16T15:30:39.852784+0000 mgr.x (mgr.34562) 5387 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:30:40.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:30:40 smithi188 bash[23329]: audit 2020-07-16T15:30:39.853170+0000 mon.b (mon.2) 1191 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:30:40.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:30:40 smithi188 bash[23329]: cephadm 2020-07-16T15:30:39.853997+0000 mgr.x (mgr.34562) 5388 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:30:40.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:30:40 smithi188 bash[23329]: audit 2020-07-16T15:30:39.854526+0000 mon.b (mon.2) 1192 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:30:40.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:30:40 smithi188 bash[23329]: cephadm 2020-07-16T15:30:39.855265+0000 mgr.x (mgr.34562) 5389 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:30:40.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:30:40 smithi188 bash[23329]: cephadm 2020-07-16T15:30:39.855380+0000 mgr.x (mgr.34562) 5390 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:30:41.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:30:41 smithi132 bash[27079]: cluster 2020-07-16T15:30:40.996343+0000 mgr.x (mgr.34562) 5391 : cluster [DBG] pgmap v3360: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:30:41.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:30:41 smithi188 bash[23329]: cluster 2020-07-16T15:30:40.996343+0000 mgr.x (mgr.34562) 5391 : cluster [DBG] pgmap v3360: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:30:43.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:30:42 smithi132 bash[27079]: audit 2020-07-16T15:30:42.758349+0000 mon.b (mon.2) 1193 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:30:43.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:30:42 smithi188 bash[23329]: audit 2020-07-16T15:30:42.758349+0000 mon.b (mon.2) 1193 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:30:44.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:30:43 smithi188 bash[23329]: cephadm 2020-07-16T15:30:42.758942+0000 mgr.x (mgr.34562) 5392 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:30:44.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:30:43 smithi188 bash[23329]: cephadm 2020-07-16T15:30:42.759097+0000 mgr.x (mgr.34562) 5393 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:30:44.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:30:43 smithi188 bash[23329]: cluster 2020-07-16T15:30:42.996733+0000 mgr.x (mgr.34562) 5394 : cluster [DBG] pgmap v3361: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:30:44.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:30:43 smithi132 bash[27079]: cephadm 2020-07-16T15:30:42.758942+0000 mgr.x (mgr.34562) 5392 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:30:44.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:30:43 smithi132 bash[27079]: cephadm 2020-07-16T15:30:42.759097+0000 mgr.x (mgr.34562) 5393 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:30:44.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:30:43 smithi132 bash[27079]: cluster 2020-07-16T15:30:42.996733+0000 mgr.x (mgr.34562) 5394 : cluster [DBG] pgmap v3361: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:30:45.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:30:45 smithi188 bash[23329]: cluster 2020-07-16T15:30:44.997150+0000 mgr.x (mgr.34562) 5395 : cluster [DBG] pgmap v3362: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:30:45.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:30:45 smithi132 bash[27079]: cluster 2020-07-16T15:30:44.997150+0000 mgr.x (mgr.34562) 5395 : cluster [DBG] pgmap v3362: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:30:47.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:30:47 smithi188 bash[23329]: cluster 2020-07-16T15:30:46.997656+0000 mgr.x (mgr.34562) 5396 : cluster [DBG] pgmap v3363: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:30:47.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:30:47 smithi132 bash[27079]: cluster 2020-07-16T15:30:46.997656+0000 mgr.x (mgr.34562) 5396 : cluster [DBG] pgmap v3363: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:30:49.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:30:49 smithi188 bash[23329]: cluster 2020-07-16T15:30:48.998025+0000 mgr.x (mgr.34562) 5397 : cluster [DBG] pgmap v3364: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:30:49.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:30:49 smithi132 bash[27079]: cluster 2020-07-16T15:30:48.998025+0000 mgr.x (mgr.34562) 5397 : cluster [DBG] pgmap v3364: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:30:51.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:30:51 smithi132 bash[27079]: cluster 2020-07-16T15:30:50.998543+0000 mgr.x (mgr.34562) 5398 : cluster [DBG] pgmap v3365: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:30:51.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:30:51 smithi188 bash[23329]: cluster 2020-07-16T15:30:50.998543+0000 mgr.x (mgr.34562) 5398 : cluster [DBG] pgmap v3365: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:30:53.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:30:53 smithi188 bash[23329]: cluster 2020-07-16T15:30:52.999019+0000 mgr.x (mgr.34562) 5399 : cluster [DBG] pgmap v3366: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:30:53.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:30:53 smithi132 bash[27079]: cluster 2020-07-16T15:30:52.999019+0000 mgr.x (mgr.34562) 5399 : cluster [DBG] pgmap v3366: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:30:54.701 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:30:54.973 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:30:54.974 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (113m) 6m ago 116m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:30:54.974 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (116m) 6m ago 116m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:30:54.974 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (113m) 6m ago 119m 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:30:54.975 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (113m) 6m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:30:54.975 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 6m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:30:54.975 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (119m) 6m ago 119m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:30:54.975 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (119m) 6m ago 119m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:30:54.975 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (116m) 6m ago 116m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:30:54.976 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (116m) 6m ago 116m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:30:54.976 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (119m) 6m ago 119m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:30:54.976 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (118m) 6m ago 119m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:30:54.976 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (118m) 6m ago 118m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:30:54.976 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (118m) 6m ago 118m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:30:54.977 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (117m) 6m ago 118m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:30:54.977 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (117m) 6m ago 117m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:30:54.977 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (117m) 6m ago 117m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:30:54.977 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (117m) 6m ago 117m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:30:54.977 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (116m) 6m ago 116m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:30:55.270 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:30:55.271 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:30:55.271 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:30:55.271 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:30:55.271 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:30:55.271 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:30:55.272 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:30:55.272 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:30:55.272 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:30:55.272 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:30:55.272 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:30:55.273 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:30:55.273 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:30:55.273 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:30:55.273 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:30:55.273 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:30:55.274 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:30:55.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:30:55 smithi188 bash[23329]: audit 2020-07-16T15:30:54.689577+0000 mgr.x (mgr.34562) 5400 : audit [DBG] from='client.28564 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:30:55.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:30:55 smithi188 bash[23329]: audit 2020-07-16T15:30:54.968563+0000 mgr.x (mgr.34562) 5401 : audit [DBG] from='client.28570 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:30:55.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:30:55 smithi188 bash[23329]: cluster 2020-07-16T15:30:54.999530+0000 mgr.x (mgr.34562) 5402 : cluster [DBG] pgmap v3367: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:30:55.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:30:55 smithi132 bash[27079]: audit 2020-07-16T15:30:54.689577+0000 mgr.x (mgr.34562) 5400 : audit [DBG] from='client.28564 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:30:55.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:30:55 smithi132 bash[27079]: audit 2020-07-16T15:30:54.968563+0000 mgr.x (mgr.34562) 5401 : audit [DBG] from='client.28570 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:30:55.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:30:55 smithi132 bash[27079]: cluster 2020-07-16T15:30:54.999530+0000 mgr.x (mgr.34562) 5402 : cluster [DBG] pgmap v3367: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:30:56.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:30:56 smithi188 bash[23329]: audit 2020-07-16T15:30:55.269622+0000 mon.c (mon.1) 378 : audit [DBG] from='client.? 172.21.15.132:0/1610675340' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:30:56.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:30:56 smithi132 bash[27079]: audit 2020-07-16T15:30:55.269622+0000 mon.c (mon.1) 378 : audit [DBG] from='client.? 172.21.15.132:0/1610675340' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:30:57.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:30:57 smithi188 bash[23329]: cluster 2020-07-16T15:30:57.000012+0000 mgr.x (mgr.34562) 5403 : cluster [DBG] pgmap v3368: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:30:57.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:30:57 smithi132 bash[27079]: cluster 2020-07-16T15:30:57.000012+0000 mgr.x (mgr.34562) 5403 : cluster [DBG] pgmap v3368: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:30:58.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:30:58 smithi188 bash[23329]: audit 2020-07-16T15:30:57.774779+0000 mon.b (mon.2) 1194 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:30:58.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:30:58 smithi188 bash[23329]: cephadm 2020-07-16T15:30:57.775474+0000 mgr.x (mgr.34562) 5404 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:30:58.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:30:58 smithi188 bash[23329]: cephadm 2020-07-16T15:30:57.775914+0000 mgr.x (mgr.34562) 5405 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:30:58.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:30:58 smithi132 bash[27079]: audit 2020-07-16T15:30:57.774779+0000 mon.b (mon.2) 1194 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:30:58.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:30:58 smithi132 bash[27079]: cephadm 2020-07-16T15:30:57.775474+0000 mgr.x (mgr.34562) 5404 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:30:58.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:30:58 smithi132 bash[27079]: cephadm 2020-07-16T15:30:57.775914+0000 mgr.x (mgr.34562) 5405 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:30:59.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:30:59 smithi188 bash[23329]: cluster 2020-07-16T15:30:59.000439+0000 mgr.x (mgr.34562) 5406 : cluster [DBG] pgmap v3369: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:30:59.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:30:59 smithi132 bash[27079]: cluster 2020-07-16T15:30:59.000439+0000 mgr.x (mgr.34562) 5406 : cluster [DBG] pgmap v3369: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:31:01.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:31:01 smithi132 bash[27079]: cluster 2020-07-16T15:31:01.000788+0000 mgr.x (mgr.34562) 5407 : cluster [DBG] pgmap v3370: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:31:01.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:31:01 smithi188 bash[23329]: cluster 2020-07-16T15:31:01.000788+0000 mgr.x (mgr.34562) 5407 : cluster [DBG] pgmap v3370: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:31:03.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:31:03 smithi188 bash[23329]: cluster 2020-07-16T15:31:03.001246+0000 mgr.x (mgr.34562) 5408 : cluster [DBG] pgmap v3371: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:31:03.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:31:03 smithi132 bash[27079]: cluster 2020-07-16T15:31:03.001246+0000 mgr.x (mgr.34562) 5408 : cluster [DBG] pgmap v3371: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:31:05.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:31:05 smithi188 bash[23329]: cluster 2020-07-16T15:31:05.001665+0000 mgr.x (mgr.34562) 5409 : cluster [DBG] pgmap v3372: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:31:05.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:31:05 smithi132 bash[27079]: cluster 2020-07-16T15:31:05.001665+0000 mgr.x (mgr.34562) 5409 : cluster [DBG] pgmap v3372: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:31:07.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:31:07 smithi188 bash[23329]: cluster 2020-07-16T15:31:07.002108+0000 mgr.x (mgr.34562) 5410 : cluster [DBG] pgmap v3373: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:31:07.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:31:07 smithi132 bash[27079]: cluster 2020-07-16T15:31:07.002108+0000 mgr.x (mgr.34562) 5410 : cluster [DBG] pgmap v3373: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:31:09.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:31:09 smithi188 bash[23329]: cluster 2020-07-16T15:31:09.002474+0000 mgr.x (mgr.34562) 5411 : cluster [DBG] pgmap v3374: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:31:09.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:31:09 smithi132 bash[27079]: cluster 2020-07-16T15:31:09.002474+0000 mgr.x (mgr.34562) 5411 : cluster [DBG] pgmap v3374: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:31:11.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:31:11 smithi132 bash[27079]: cluster 2020-07-16T15:31:11.002814+0000 mgr.x (mgr.34562) 5412 : cluster [DBG] pgmap v3375: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:31:11.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:31:11 smithi188 bash[23329]: cluster 2020-07-16T15:31:11.002814+0000 mgr.x (mgr.34562) 5412 : cluster [DBG] pgmap v3375: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:31:13.175 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:31:12 smithi188 bash[23329]: audit 2020-07-16T15:31:12.784061+0000 mon.b (mon.2) 1195 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:31:13.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:31:12 smithi132 bash[27079]: audit 2020-07-16T15:31:12.784061+0000 mon.b (mon.2) 1195 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:31:14.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:31:13 smithi188 bash[23329]: cephadm 2020-07-16T15:31:12.784732+0000 mgr.x (mgr.34562) 5413 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:31:14.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:31:13 smithi188 bash[23329]: cephadm 2020-07-16T15:31:12.785145+0000 mgr.x (mgr.34562) 5414 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:31:14.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:31:13 smithi188 bash[23329]: cluster 2020-07-16T15:31:13.003249+0000 mgr.x (mgr.34562) 5415 : cluster [DBG] pgmap v3376: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:31:14.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:31:13 smithi132 bash[27079]: cephadm 2020-07-16T15:31:12.784732+0000 mgr.x (mgr.34562) 5413 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:31:14.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:31:13 smithi132 bash[27079]: cephadm 2020-07-16T15:31:12.785145+0000 mgr.x (mgr.34562) 5414 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:31:14.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:31:13 smithi132 bash[27079]: cluster 2020-07-16T15:31:13.003249+0000 mgr.x (mgr.34562) 5415 : cluster [DBG] pgmap v3376: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:31:15.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:31:15 smithi188 bash[23329]: cluster 2020-07-16T15:31:15.003596+0000 mgr.x (mgr.34562) 5416 : cluster [DBG] pgmap v3377: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:31:15.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:31:15 smithi132 bash[27079]: cluster 2020-07-16T15:31:15.003596+0000 mgr.x (mgr.34562) 5416 : cluster [DBG] pgmap v3377: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:31:17.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:31:17 smithi188 bash[23329]: cluster 2020-07-16T15:31:17.004040+0000 mgr.x (mgr.34562) 5417 : cluster [DBG] pgmap v3378: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:31:17.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:31:17 smithi132 bash[27079]: cluster 2020-07-16T15:31:17.004040+0000 mgr.x (mgr.34562) 5417 : cluster [DBG] pgmap v3378: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:31:19.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:31:19 smithi188 bash[23329]: cluster 2020-07-16T15:31:19.004517+0000 mgr.x (mgr.34562) 5418 : cluster [DBG] pgmap v3379: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:31:19.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:31:19 smithi132 bash[27079]: cluster 2020-07-16T15:31:19.004517+0000 mgr.x (mgr.34562) 5418 : cluster [DBG] pgmap v3379: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:31:21.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:31:21 smithi132 bash[27079]: cluster 2020-07-16T15:31:21.004869+0000 mgr.x (mgr.34562) 5419 : cluster [DBG] pgmap v3380: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:31:21.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:31:21 smithi188 bash[23329]: cluster 2020-07-16T15:31:21.004869+0000 mgr.x (mgr.34562) 5419 : cluster [DBG] pgmap v3380: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:31:23.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:31:23 smithi188 bash[23329]: cluster 2020-07-16T15:31:23.005371+0000 mgr.x (mgr.34562) 5420 : cluster [DBG] pgmap v3381: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:31:23.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:31:23 smithi132 bash[27079]: cluster 2020-07-16T15:31:23.005371+0000 mgr.x (mgr.34562) 5420 : cluster [DBG] pgmap v3381: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:31:25.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:31:25 smithi188 bash[23329]: cluster 2020-07-16T15:31:25.005806+0000 mgr.x (mgr.34562) 5421 : cluster [DBG] pgmap v3382: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:31:25.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:31:25 smithi132 bash[27079]: cluster 2020-07-16T15:31:25.005806+0000 mgr.x (mgr.34562) 5421 : cluster [DBG] pgmap v3382: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:31:25.567 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:31:25.827 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:31:25.828 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (114m) 7m ago 117m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:31:25.828 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (116m) 7m ago 116m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:31:25.828 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (114m) 7m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:31:25.829 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (113m) 7m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:31:25.829 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 7m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:31:25.829 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:31:25.829 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:31:25.829 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (117m) 7m ago 117m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:31:25.830 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (117m) 7m ago 117m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:31:25.830 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (119m) 7m ago 119m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:31:25.830 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (119m) 7m ago 119m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:31:25.830 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (119m) 7m ago 119m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:31:25.831 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (118m) 7m ago 118m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:31:25.831 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (118m) 7m ago 118m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:31:25.832 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (118m) 7m ago 118m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:31:25.832 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (118m) 7m ago 118m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:31:25.833 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (117m) 7m ago 117m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:31:25.833 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (116m) 7m ago 117m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:31:26.129 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:31:26.129 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:31:26.129 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:31:26.130 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:31:26.130 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:31:26.130 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:31:26.130 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:31:26.131 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:31:26.131 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:31:26.131 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:31:26.131 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:31:26.131 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:31:26.131 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:31:26.132 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:31:26.133 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:31:26.134 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:31:26.135 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:31:26.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:31:26 smithi132 bash[27079]: audit 2020-07-16T15:31:25.556165+0000 mgr.x (mgr.34562) 5422 : audit [DBG] from='client.28582 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:31:26.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:31:26 smithi132 bash[27079]: audit 2020-07-16T15:31:25.823566+0000 mgr.x (mgr.34562) 5423 : audit [DBG] from='client.28588 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:31:26.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:31:26 smithi132 bash[27079]: audit 2020-07-16T15:31:26.128374+0000 mon.c (mon.1) 379 : audit [DBG] from='client.? 172.21.15.132:0/1866401547' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:31:26.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:31:26 smithi188 bash[23329]: audit 2020-07-16T15:31:25.556165+0000 mgr.x (mgr.34562) 5422 : audit [DBG] from='client.28582 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:31:26.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:31:26 smithi188 bash[23329]: audit 2020-07-16T15:31:25.823566+0000 mgr.x (mgr.34562) 5423 : audit [DBG] from='client.28588 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:31:26.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:31:26 smithi188 bash[23329]: audit 2020-07-16T15:31:26.128374+0000 mon.c (mon.1) 379 : audit [DBG] from='client.? 172.21.15.132:0/1866401547' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:31:27.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:31:27 smithi132 bash[27079]: cluster 2020-07-16T15:31:27.006279+0000 mgr.x (mgr.34562) 5424 : cluster [DBG] pgmap v3383: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:31:27.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:31:27 smithi188 bash[23329]: cluster 2020-07-16T15:31:27.006279+0000 mgr.x (mgr.34562) 5424 : cluster [DBG] pgmap v3383: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:31:28.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:31:28 smithi132 bash[27079]: audit 2020-07-16T15:31:27.800683+0000 mon.b (mon.2) 1196 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:31:28.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:31:28 smithi132 bash[27079]: cephadm 2020-07-16T15:31:27.801443+0000 mgr.x (mgr.34562) 5425 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:31:28.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:31:28 smithi132 bash[27079]: cephadm 2020-07-16T15:31:27.801770+0000 mgr.x (mgr.34562) 5426 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:31:28.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:31:28 smithi188 bash[23329]: audit 2020-07-16T15:31:27.800683+0000 mon.b (mon.2) 1196 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:31:28.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:31:28 smithi188 bash[23329]: cephadm 2020-07-16T15:31:27.801443+0000 mgr.x (mgr.34562) 5425 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:31:28.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:31:28 smithi188 bash[23329]: cephadm 2020-07-16T15:31:27.801770+0000 mgr.x (mgr.34562) 5426 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:31:29.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:31:29 smithi132 bash[27079]: cluster 2020-07-16T15:31:29.006765+0000 mgr.x (mgr.34562) 5427 : cluster [DBG] pgmap v3384: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:31:29.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:31:29 smithi188 bash[23329]: cluster 2020-07-16T15:31:29.006765+0000 mgr.x (mgr.34562) 5427 : cluster [DBG] pgmap v3384: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:31:31.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:31:31 smithi132 bash[27079]: cluster 2020-07-16T15:31:31.007289+0000 mgr.x (mgr.34562) 5428 : cluster [DBG] pgmap v3385: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:31:31.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:31:31 smithi188 bash[23329]: cluster 2020-07-16T15:31:31.007289+0000 mgr.x (mgr.34562) 5428 : cluster [DBG] pgmap v3385: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:31:33.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:31:33 smithi188 bash[23329]: cluster 2020-07-16T15:31:33.007678+0000 mgr.x (mgr.34562) 5429 : cluster [DBG] pgmap v3386: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:31:33.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:31:33 smithi132 bash[27079]: cluster 2020-07-16T15:31:33.007678+0000 mgr.x (mgr.34562) 5429 : cluster [DBG] pgmap v3386: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:31:35.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:31:35 smithi188 bash[23329]: cluster 2020-07-16T15:31:35.008078+0000 mgr.x (mgr.34562) 5430 : cluster [DBG] pgmap v3387: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:31:35.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:31:35 smithi132 bash[27079]: cluster 2020-07-16T15:31:35.008078+0000 mgr.x (mgr.34562) 5430 : cluster [DBG] pgmap v3387: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:31:37.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:31:37 smithi188 bash[23329]: cluster 2020-07-16T15:31:37.008555+0000 mgr.x (mgr.34562) 5431 : cluster [DBG] pgmap v3388: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:31:37.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:31:37 smithi132 bash[27079]: cluster 2020-07-16T15:31:37.008555+0000 mgr.x (mgr.34562) 5431 : cluster [DBG] pgmap v3388: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:31:39.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:31:39 smithi188 bash[23329]: cluster 2020-07-16T15:31:39.008929+0000 mgr.x (mgr.34562) 5432 : cluster [DBG] pgmap v3389: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:31:39.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:31:39 smithi132 bash[27079]: cluster 2020-07-16T15:31:39.008929+0000 mgr.x (mgr.34562) 5432 : cluster [DBG] pgmap v3389: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:31:41.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:31:41 smithi132 bash[27079]: cluster 2020-07-16T15:31:41.009385+0000 mgr.x (mgr.34562) 5433 : cluster [DBG] pgmap v3390: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:31:41.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:31:41 smithi188 bash[23329]: cluster 2020-07-16T15:31:41.009385+0000 mgr.x (mgr.34562) 5433 : cluster [DBG] pgmap v3390: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:31:43.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:31:42 smithi188 bash[23329]: audit 2020-07-16T15:31:42.819304+0000 mon.b (mon.2) 1197 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:31:43.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:31:42 smithi188 bash[23329]: audit 2020-07-16T15:31:42.820682+0000 mon.b (mon.2) 1198 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:31:43.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:31:42 smithi188 bash[23329]: audit 2020-07-16T15:31:42.821923+0000 mon.b (mon.2) 1199 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:31:43.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:31:42 smithi188 bash[23329]: audit 2020-07-16T15:31:42.823322+0000 mon.b (mon.2) 1200 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:31:43.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:31:42 smithi188 bash[23329]: audit 2020-07-16T15:31:42.824532+0000 mon.b (mon.2) 1201 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:31:43.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:31:42 smithi132 bash[27079]: audit 2020-07-16T15:31:42.819304+0000 mon.b (mon.2) 1197 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:31:43.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:31:42 smithi132 bash[27079]: audit 2020-07-16T15:31:42.820682+0000 mon.b (mon.2) 1198 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:31:43.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:31:42 smithi132 bash[27079]: audit 2020-07-16T15:31:42.821923+0000 mon.b (mon.2) 1199 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:31:43.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:31:42 smithi132 bash[27079]: audit 2020-07-16T15:31:42.823322+0000 mon.b (mon.2) 1200 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:31:43.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:31:42 smithi132 bash[27079]: audit 2020-07-16T15:31:42.824532+0000 mon.b (mon.2) 1201 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:31:44.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:31:43 smithi132 bash[27079]: audit 2020-07-16T15:31:42.819658+0000 mgr.x (mgr.34562) 5434 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:31:44.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:31:43 smithi132 bash[27079]: audit 2020-07-16T15:31:42.820996+0000 mgr.x (mgr.34562) 5435 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:31:44.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:31:43 smithi132 bash[27079]: audit 2020-07-16T15:31:42.822246+0000 mgr.x (mgr.34562) 5436 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:31:44.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:31:43 smithi132 bash[27079]: cephadm 2020-07-16T15:31:42.822950+0000 mgr.x (mgr.34562) 5437 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:31:44.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:31:43 smithi132 bash[27079]: cephadm 2020-07-16T15:31:42.824186+0000 mgr.x (mgr.34562) 5438 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:31:44.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:31:43 smithi132 bash[27079]: cephadm 2020-07-16T15:31:42.825258+0000 mgr.x (mgr.34562) 5439 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:31:44.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:31:43 smithi132 bash[27079]: cephadm 2020-07-16T15:31:42.825547+0000 mgr.x (mgr.34562) 5440 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:31:44.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:31:43 smithi132 bash[27079]: cluster 2020-07-16T15:31:43.009803+0000 mgr.x (mgr.34562) 5441 : cluster [DBG] pgmap v3391: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:31:44.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:31:43 smithi188 bash[23329]: audit 2020-07-16T15:31:42.819658+0000 mgr.x (mgr.34562) 5434 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:31:44.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:31:43 smithi188 bash[23329]: audit 2020-07-16T15:31:42.820996+0000 mgr.x (mgr.34562) 5435 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:31:44.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:31:43 smithi188 bash[23329]: audit 2020-07-16T15:31:42.822246+0000 mgr.x (mgr.34562) 5436 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:31:44.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:31:43 smithi188 bash[23329]: cephadm 2020-07-16T15:31:42.822950+0000 mgr.x (mgr.34562) 5437 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:31:44.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:31:43 smithi188 bash[23329]: cephadm 2020-07-16T15:31:42.824186+0000 mgr.x (mgr.34562) 5438 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:31:44.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:31:43 smithi188 bash[23329]: cephadm 2020-07-16T15:31:42.825258+0000 mgr.x (mgr.34562) 5439 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:31:44.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:31:43 smithi188 bash[23329]: cephadm 2020-07-16T15:31:42.825547+0000 mgr.x (mgr.34562) 5440 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:31:44.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:31:43 smithi188 bash[23329]: cluster 2020-07-16T15:31:43.009803+0000 mgr.x (mgr.34562) 5441 : cluster [DBG] pgmap v3391: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:31:45.199 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:31:45 smithi132 bash[27079]: cluster 2020-07-16T15:31:45.010254+0000 mgr.x (mgr.34562) 5442 : cluster [DBG] pgmap v3392: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:31:45.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:31:45 smithi188 bash[23329]: cluster 2020-07-16T15:31:45.010254+0000 mgr.x (mgr.34562) 5442 : cluster [DBG] pgmap v3392: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:31:46.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:31:46 smithi132 bash[27079]: audit 2020-07-16T15:31:45.760668+0000 mon.b (mon.2) 1202 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:31:46.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:31:46 smithi132 bash[27079]: cephadm 2020-07-16T15:31:45.761329+0000 mgr.x (mgr.34562) 5443 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:31:46.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:31:46 smithi132 bash[27079]: cephadm 2020-07-16T15:31:45.761409+0000 mgr.x (mgr.34562) 5444 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:31:46.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:31:46 smithi188 bash[23329]: audit 2020-07-16T15:31:45.760668+0000 mon.b (mon.2) 1202 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:31:46.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:31:46 smithi188 bash[23329]: cephadm 2020-07-16T15:31:45.761329+0000 mgr.x (mgr.34562) 5443 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:31:46.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:31:46 smithi188 bash[23329]: cephadm 2020-07-16T15:31:45.761409+0000 mgr.x (mgr.34562) 5444 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:31:47.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:31:47 smithi132 bash[27079]: cluster 2020-07-16T15:31:47.010664+0000 mgr.x (mgr.34562) 5445 : cluster [DBG] pgmap v3393: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:31:47.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:31:47 smithi188 bash[23329]: cluster 2020-07-16T15:31:47.010664+0000 mgr.x (mgr.34562) 5445 : cluster [DBG] pgmap v3393: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:31:49.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:31:49 smithi188 bash[23329]: cluster 2020-07-16T15:31:49.011068+0000 mgr.x (mgr.34562) 5446 : cluster [DBG] pgmap v3394: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:31:49.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:31:49 smithi132 bash[27079]: cluster 2020-07-16T15:31:49.011068+0000 mgr.x (mgr.34562) 5446 : cluster [DBG] pgmap v3394: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:31:51.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:31:51 smithi188 bash[23329]: cluster 2020-07-16T15:31:51.011492+0000 mgr.x (mgr.34562) 5447 : cluster [DBG] pgmap v3395: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:31:51.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:31:51 smithi132 bash[27079]: cluster 2020-07-16T15:31:51.011492+0000 mgr.x (mgr.34562) 5447 : cluster [DBG] pgmap v3395: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:31:53.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:31:53 smithi188 bash[23329]: cluster 2020-07-16T15:31:53.011994+0000 mgr.x (mgr.34562) 5448 : cluster [DBG] pgmap v3396: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:31:53.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:31:53 smithi132 bash[27079]: cluster 2020-07-16T15:31:53.011994+0000 mgr.x (mgr.34562) 5448 : cluster [DBG] pgmap v3396: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:31:55.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:31:55 smithi188 bash[23329]: cluster 2020-07-16T15:31:55.012340+0000 mgr.x (mgr.34562) 5449 : cluster [DBG] pgmap v3397: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:31:55.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:31:55 smithi132 bash[27079]: cluster 2020-07-16T15:31:55.012340+0000 mgr.x (mgr.34562) 5449 : cluster [DBG] pgmap v3397: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:31:56.426 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:31:56.688 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:31:56.688 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (114m) 7m ago 117m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:31:56.688 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (117m) 7m ago 117m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:31:56.689 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (115m) 7m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:31:56.689 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (114m) 7m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:31:56.689 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 7m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:31:56.689 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:31:56.689 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:31:56.690 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (117m) 7m ago 117m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:31:56.690 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (117m) 7m ago 117m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:31:56.691 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:31:56.691 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:31:56.691 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (119m) 7m ago 119m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:31:56.692 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (119m) 7m ago 119m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:31:56.692 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (118m) 7m ago 119m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:31:56.692 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (118m) 7m ago 118m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:31:56.692 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (118m) 7m ago 118m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:31:56.692 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (118m) 7m ago 118m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:31:56.693 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (117m) 7m ago 117m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:31:56.985 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:31:56.986 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:31:56.986 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:31:56.986 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:31:56.987 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:31:56.987 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:31:56.987 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:31:56.987 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:31:56.987 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:31:56.987 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:31:56.988 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:31:56.988 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:31:56.988 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:31:56.989 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:31:56.989 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:31:56.989 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:31:56.989 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:31:57.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:31:57 smithi188 bash[23329]: audit 2020-07-16T15:31:56.414357+0000 mgr.x (mgr.34562) 5450 : audit [DBG] from='client.28600 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:31:57.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:31:57 smithi188 bash[23329]: audit 2020-07-16T15:31:56.683830+0000 mgr.x (mgr.34562) 5451 : audit [DBG] from='client.28606 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:31:57.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:31:57 smithi188 bash[23329]: audit 2020-07-16T15:31:56.984916+0000 mon.c (mon.1) 380 : audit [DBG] from='client.? 172.21.15.132:0/2164672232' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:31:57.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:31:57 smithi188 bash[23329]: cluster 2020-07-16T15:31:57.012864+0000 mgr.x (mgr.34562) 5452 : cluster [DBG] pgmap v3398: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:31:57.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:31:57 smithi132 bash[27079]: audit 2020-07-16T15:31:56.414357+0000 mgr.x (mgr.34562) 5450 : audit [DBG] from='client.28600 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:31:57.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:31:57 smithi132 bash[27079]: audit 2020-07-16T15:31:56.683830+0000 mgr.x (mgr.34562) 5451 : audit [DBG] from='client.28606 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:31:57.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:31:57 smithi132 bash[27079]: audit 2020-07-16T15:31:56.984916+0000 mon.c (mon.1) 380 : audit [DBG] from='client.? 172.21.15.132:0/2164672232' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:31:57.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:31:57 smithi132 bash[27079]: cluster 2020-07-16T15:31:57.012864+0000 mgr.x (mgr.34562) 5452 : cluster [DBG] pgmap v3398: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:31:59.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:31:59 smithi188 bash[23329]: cluster 2020-07-16T15:31:59.013409+0000 mgr.x (mgr.34562) 5453 : cluster [DBG] pgmap v3399: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:31:59.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:31:59 smithi132 bash[27079]: cluster 2020-07-16T15:31:59.013409+0000 mgr.x (mgr.34562) 5453 : cluster [DBG] pgmap v3399: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:32:01.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:32:01 smithi132 bash[27079]: audit 2020-07-16T15:32:00.765772+0000 mon.b (mon.2) 1203 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:32:01.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:32:01 smithi132 bash[27079]: cephadm 2020-07-16T15:32:00.766501+0000 mgr.x (mgr.34562) 5454 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:32:01.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:32:01 smithi132 bash[27079]: cephadm 2020-07-16T15:32:00.766947+0000 mgr.x (mgr.34562) 5455 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:32:01.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:32:01 smithi132 bash[27079]: cluster 2020-07-16T15:32:01.013800+0000 mgr.x (mgr.34562) 5456 : cluster [DBG] pgmap v3400: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:32:01.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:32:01 smithi188 bash[23329]: audit 2020-07-16T15:32:00.765772+0000 mon.b (mon.2) 1203 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:32:01.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:32:01 smithi188 bash[23329]: cephadm 2020-07-16T15:32:00.766501+0000 mgr.x (mgr.34562) 5454 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:32:01.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:32:01 smithi188 bash[23329]: cephadm 2020-07-16T15:32:00.766947+0000 mgr.x (mgr.34562) 5455 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:32:01.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:32:01 smithi188 bash[23329]: cluster 2020-07-16T15:32:01.013800+0000 mgr.x (mgr.34562) 5456 : cluster [DBG] pgmap v3400: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:32:03.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:32:03 smithi188 bash[23329]: cluster 2020-07-16T15:32:03.014216+0000 mgr.x (mgr.34562) 5457 : cluster [DBG] pgmap v3401: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:32:03.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:32:03 smithi132 bash[27079]: cluster 2020-07-16T15:32:03.014216+0000 mgr.x (mgr.34562) 5457 : cluster [DBG] pgmap v3401: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:32:05.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:32:05 smithi188 bash[23329]: cluster 2020-07-16T15:32:05.014611+0000 mgr.x (mgr.34562) 5458 : cluster [DBG] pgmap v3402: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:32:06.454 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:32:05 smithi132 bash[27079]: cluster 2020-07-16T15:32:05.014611+0000 mgr.x (mgr.34562) 5458 : cluster [DBG] pgmap v3402: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:32:07.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:32:07 smithi188 bash[23329]: cluster 2020-07-16T15:32:07.015097+0000 mgr.x (mgr.34562) 5459 : cluster [DBG] pgmap v3403: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:32:07.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:32:07 smithi132 bash[27079]: cluster 2020-07-16T15:32:07.015097+0000 mgr.x (mgr.34562) 5459 : cluster [DBG] pgmap v3403: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:32:09.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:32:09 smithi188 bash[23329]: cluster 2020-07-16T15:32:09.015483+0000 mgr.x (mgr.34562) 5460 : cluster [DBG] pgmap v3404: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:32:09.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:32:09 smithi132 bash[27079]: cluster 2020-07-16T15:32:09.015483+0000 mgr.x (mgr.34562) 5460 : cluster [DBG] pgmap v3404: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:32:11.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:32:11 smithi132 bash[27079]: cluster 2020-07-16T15:32:11.015954+0000 mgr.x (mgr.34562) 5461 : cluster [DBG] pgmap v3405: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:32:11.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:32:11 smithi188 bash[23329]: cluster 2020-07-16T15:32:11.015954+0000 mgr.x (mgr.34562) 5461 : cluster [DBG] pgmap v3405: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:32:13.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:32:13 smithi188 bash[23329]: cluster 2020-07-16T15:32:13.016519+0000 mgr.x (mgr.34562) 5462 : cluster [DBG] pgmap v3406: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:32:13.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:32:13 smithi132 bash[27079]: cluster 2020-07-16T15:32:13.016519+0000 mgr.x (mgr.34562) 5462 : cluster [DBG] pgmap v3406: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:32:15.428 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:32:15 smithi188 bash[23329]: cluster 2020-07-16T15:32:15.016976+0000 mgr.x (mgr.34562) 5463 : cluster [DBG] pgmap v3407: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:32:15.535 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:32:15 smithi132 bash[27079]: cluster 2020-07-16T15:32:15.016976+0000 mgr.x (mgr.34562) 5463 : cluster [DBG] pgmap v3407: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:32:16.783 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:32:16 smithi132 bash[27079]: audit 2020-07-16T15:32:15.778967+0000 mon.b (mon.2) 1204 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:32:16.783 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:32:16 smithi132 bash[27079]: cephadm 2020-07-16T15:32:15.779706+0000 mgr.x (mgr.34562) 5464 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:32:16.784 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:32:16 smithi132 bash[27079]: cephadm 2020-07-16T15:32:15.780101+0000 mgr.x (mgr.34562) 5465 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:32:16.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:32:16 smithi188 bash[23329]: audit 2020-07-16T15:32:15.778967+0000 mon.b (mon.2) 1204 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:32:16.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:32:16 smithi188 bash[23329]: cephadm 2020-07-16T15:32:15.779706+0000 mgr.x (mgr.34562) 5464 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:32:16.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:32:16 smithi188 bash[23329]: cephadm 2020-07-16T15:32:15.780101+0000 mgr.x (mgr.34562) 5465 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:32:17.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:32:17 smithi132 bash[27079]: cluster 2020-07-16T15:32:17.017506+0000 mgr.x (mgr.34562) 5466 : cluster [DBG] pgmap v3408: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:32:17.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:32:17 smithi188 bash[23329]: cluster 2020-07-16T15:32:17.017506+0000 mgr.x (mgr.34562) 5466 : cluster [DBG] pgmap v3408: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:32:19.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:32:19 smithi188 bash[23329]: cluster 2020-07-16T15:32:19.017786+0000 mgr.x (mgr.34562) 5467 : cluster [DBG] pgmap v3409: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:32:19.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:32:19 smithi132 bash[27079]: cluster 2020-07-16T15:32:19.017786+0000 mgr.x (mgr.34562) 5467 : cluster [DBG] pgmap v3409: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:32:21.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:32:21 smithi132 bash[27079]: cluster 2020-07-16T15:32:21.018270+0000 mgr.x (mgr.34562) 5468 : cluster [DBG] pgmap v3410: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:32:21.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:32:21 smithi188 bash[23329]: cluster 2020-07-16T15:32:21.018270+0000 mgr.x (mgr.34562) 5468 : cluster [DBG] pgmap v3410: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:32:23.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:32:23 smithi188 bash[23329]: cluster 2020-07-16T15:32:23.018755+0000 mgr.x (mgr.34562) 5469 : cluster [DBG] pgmap v3411: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:32:23.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:32:23 smithi132 bash[27079]: cluster 2020-07-16T15:32:23.018755+0000 mgr.x (mgr.34562) 5469 : cluster [DBG] pgmap v3411: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:32:25.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:32:25 smithi188 bash[23329]: cluster 2020-07-16T15:32:25.019249+0000 mgr.x (mgr.34562) 5470 : cluster [DBG] pgmap v3412: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:32:25.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:32:25 smithi132 bash[27079]: cluster 2020-07-16T15:32:25.019249+0000 mgr.x (mgr.34562) 5470 : cluster [DBG] pgmap v3412: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:32:27.287 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:32:27.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:32:27 smithi188 bash[23329]: cluster 2020-07-16T15:32:27.019778+0000 mgr.x (mgr.34562) 5471 : cluster [DBG] pgmap v3413: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:32:27.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:32:27 smithi132 bash[27079]: cluster 2020-07-16T15:32:27.019778+0000 mgr.x (mgr.34562) 5471 : cluster [DBG] pgmap v3413: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:32:27.558 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:32:27.563 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (115m) 8m ago 118m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:32:27.563 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (117m) 8m ago 117m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:32:27.563 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (115m) 8m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:32:27.564 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (114m) 8m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:32:27.564 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 8m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:32:27.575 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:32:27.576 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:32:27.576 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (118m) 8m ago 118m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:32:27.576 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (118m) 8m ago 118m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:32:27.577 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:32:27.578 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:32:27.578 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:32:27.578 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (119m) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:32:27.579 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (119m) 8m ago 119m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:32:27.580 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (119m) 8m ago 119m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:32:27.581 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (119m) 8m ago 119m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:32:27.582 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (118m) 8m ago 118m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:32:27.582 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (117m) 8m ago 118m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:32:27.849 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:32:27.849 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:32:27.849 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:32:27.850 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:32:27.850 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:32:27.850 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:32:27.850 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:32:27.850 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:32:27.851 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:32:27.851 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:32:27.851 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:32:27.852 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:32:27.852 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:32:27.852 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:32:27.852 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:32:27.853 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:32:27.853 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:32:28.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:32:28 smithi188 bash[23329]: audit 2020-07-16T15:32:27.275958+0000 mgr.x (mgr.34562) 5472 : audit [DBG] from='client.28618 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:32:28.425 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:32:28 smithi188 bash[23329]: audit 2020-07-16T15:32:27.544929+0000 mgr.x (mgr.34562) 5473 : audit [DBG] from='client.28624 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:32:28.425 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:32:28 smithi188 bash[23329]: audit 2020-07-16T15:32:27.848138+0000 mon.c (mon.1) 381 : audit [DBG] from='client.? 172.21.15.132:0/3231381816' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:32:28.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:32:28 smithi132 bash[27079]: audit 2020-07-16T15:32:27.275958+0000 mgr.x (mgr.34562) 5472 : audit [DBG] from='client.28618 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:32:28.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:32:28 smithi132 bash[27079]: audit 2020-07-16T15:32:27.544929+0000 mgr.x (mgr.34562) 5473 : audit [DBG] from='client.28624 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:32:28.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:32:28 smithi132 bash[27079]: audit 2020-07-16T15:32:27.848138+0000 mon.c (mon.1) 381 : audit [DBG] from='client.? 172.21.15.132:0/3231381816' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:32:29.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:32:29 smithi188 bash[23329]: cluster 2020-07-16T15:32:29.020268+0000 mgr.x (mgr.34562) 5474 : cluster [DBG] pgmap v3414: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:32:29.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:32:29 smithi132 bash[27079]: cluster 2020-07-16T15:32:29.020268+0000 mgr.x (mgr.34562) 5474 : cluster [DBG] pgmap v3414: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:32:31.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:32:31 smithi132 bash[27079]: audit 2020-07-16T15:32:30.795710+0000 mon.b (mon.2) 1205 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:32:31.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:32:31 smithi132 bash[27079]: cephadm 2020-07-16T15:32:30.796513+0000 mgr.x (mgr.34562) 5475 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:32:31.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:32:31 smithi132 bash[27079]: cephadm 2020-07-16T15:32:30.796615+0000 mgr.x (mgr.34562) 5476 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:32:31.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:32:31 smithi132 bash[27079]: cluster 2020-07-16T15:32:31.020677+0000 mgr.x (mgr.34562) 5477 : cluster [DBG] pgmap v3415: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:32:31.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:32:31 smithi188 bash[23329]: audit 2020-07-16T15:32:30.795710+0000 mon.b (mon.2) 1205 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:32:31.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:32:31 smithi188 bash[23329]: cephadm 2020-07-16T15:32:30.796513+0000 mgr.x (mgr.34562) 5475 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:32:31.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:32:31 smithi188 bash[23329]: cephadm 2020-07-16T15:32:30.796615+0000 mgr.x (mgr.34562) 5476 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:32:31.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:32:31 smithi188 bash[23329]: cluster 2020-07-16T15:32:31.020677+0000 mgr.x (mgr.34562) 5477 : cluster [DBG] pgmap v3415: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:32:33.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:32:33 smithi188 bash[23329]: cluster 2020-07-16T15:32:33.021127+0000 mgr.x (mgr.34562) 5478 : cluster [DBG] pgmap v3416: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:32:33.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:32:33 smithi132 bash[27079]: cluster 2020-07-16T15:32:33.021127+0000 mgr.x (mgr.34562) 5478 : cluster [DBG] pgmap v3416: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:32:35.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:32:35 smithi188 bash[23329]: cluster 2020-07-16T15:32:35.021607+0000 mgr.x (mgr.34562) 5479 : cluster [DBG] pgmap v3417: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:32:35.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:32:35 smithi132 bash[27079]: cluster 2020-07-16T15:32:35.021607+0000 mgr.x (mgr.34562) 5479 : cluster [DBG] pgmap v3417: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:32:37.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:32:37 smithi188 bash[23329]: cluster 2020-07-16T15:32:37.022189+0000 mgr.x (mgr.34562) 5480 : cluster [DBG] pgmap v3418: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:32:37.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:32:37 smithi132 bash[27079]: cluster 2020-07-16T15:32:37.022189+0000 mgr.x (mgr.34562) 5480 : cluster [DBG] pgmap v3418: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:32:39.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:32:39 smithi188 bash[23329]: cluster 2020-07-16T15:32:39.022614+0000 mgr.x (mgr.34562) 5481 : cluster [DBG] pgmap v3419: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:32:39.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:32:39 smithi132 bash[27079]: cluster 2020-07-16T15:32:39.022614+0000 mgr.x (mgr.34562) 5481 : cluster [DBG] pgmap v3419: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:32:41.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:32:41 smithi132 bash[27079]: cluster 2020-07-16T15:32:41.022984+0000 mgr.x (mgr.34562) 5482 : cluster [DBG] pgmap v3420: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:32:41.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:32:41 smithi188 bash[23329]: cluster 2020-07-16T15:32:41.022984+0000 mgr.x (mgr.34562) 5482 : cluster [DBG] pgmap v3420: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:32:43.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:32:43 smithi188 bash[23329]: cluster 2020-07-16T15:32:43.023442+0000 mgr.x (mgr.34562) 5483 : cluster [DBG] pgmap v3421: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:32:43.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:32:43 smithi132 bash[27079]: cluster 2020-07-16T15:32:43.023442+0000 mgr.x (mgr.34562) 5483 : cluster [DBG] pgmap v3421: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:32:45.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:32:45 smithi188 bash[23329]: cluster 2020-07-16T15:32:45.023908+0000 mgr.x (mgr.34562) 5484 : cluster [DBG] pgmap v3422: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:32:45.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:32:45 smithi132 bash[27079]: cluster 2020-07-16T15:32:45.023908+0000 mgr.x (mgr.34562) 5484 : cluster [DBG] pgmap v3422: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:32:46.690 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:32:46 smithi132 bash[27079]: audit 2020-07-16T15:32:45.815457+0000 mon.b (mon.2) 1206 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:32:46.690 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:32:46 smithi132 bash[27079]: audit 2020-07-16T15:32:45.815826+0000 mgr.x (mgr.34562) 5485 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:32:46.690 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:32:46 smithi132 bash[27079]: audit 2020-07-16T15:32:45.816908+0000 mon.b (mon.2) 1207 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:32:46.691 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:32:46 smithi132 bash[27079]: audit 2020-07-16T15:32:45.817212+0000 mgr.x (mgr.34562) 5486 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:32:46.691 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:32:46 smithi132 bash[27079]: audit 2020-07-16T15:32:45.818055+0000 mon.b (mon.2) 1208 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:32:46.691 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:32:46 smithi132 bash[27079]: audit 2020-07-16T15:32:45.818360+0000 mgr.x (mgr.34562) 5487 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:32:46.691 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:32:46 smithi132 bash[27079]: cephadm 2020-07-16T15:32:45.819106+0000 mgr.x (mgr.34562) 5488 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:32:46.691 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:32:46 smithi132 bash[27079]: audit 2020-07-16T15:32:45.819548+0000 mon.b (mon.2) 1209 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:32:46.692 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:32:46 smithi132 bash[27079]: cephadm 2020-07-16T15:32:45.820390+0000 mgr.x (mgr.34562) 5489 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:32:46.692 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:32:46 smithi132 bash[27079]: audit 2020-07-16T15:32:45.820810+0000 mon.b (mon.2) 1210 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:32:46.692 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:32:46 smithi132 bash[27079]: cephadm 2020-07-16T15:32:45.821582+0000 mgr.x (mgr.34562) 5490 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:32:46.692 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:32:46 smithi132 bash[27079]: cephadm 2020-07-16T15:32:45.821873+0000 mgr.x (mgr.34562) 5491 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:32:46.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:32:46 smithi188 bash[23329]: audit 2020-07-16T15:32:45.815457+0000 mon.b (mon.2) 1206 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:32:46.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:32:46 smithi188 bash[23329]: audit 2020-07-16T15:32:45.815826+0000 mgr.x (mgr.34562) 5485 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:32:46.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:32:46 smithi188 bash[23329]: audit 2020-07-16T15:32:45.816908+0000 mon.b (mon.2) 1207 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:32:46.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:32:46 smithi188 bash[23329]: audit 2020-07-16T15:32:45.817212+0000 mgr.x (mgr.34562) 5486 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:32:46.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:32:46 smithi188 bash[23329]: audit 2020-07-16T15:32:45.818055+0000 mon.b (mon.2) 1208 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:32:46.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:32:46 smithi188 bash[23329]: audit 2020-07-16T15:32:45.818360+0000 mgr.x (mgr.34562) 5487 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:32:46.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:32:46 smithi188 bash[23329]: cephadm 2020-07-16T15:32:45.819106+0000 mgr.x (mgr.34562) 5488 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:32:46.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:32:46 smithi188 bash[23329]: audit 2020-07-16T15:32:45.819548+0000 mon.b (mon.2) 1209 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:32:46.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:32:46 smithi188 bash[23329]: cephadm 2020-07-16T15:32:45.820390+0000 mgr.x (mgr.34562) 5489 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:32:46.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:32:46 smithi188 bash[23329]: audit 2020-07-16T15:32:45.820810+0000 mon.b (mon.2) 1210 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:32:46.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:32:46 smithi188 bash[23329]: cephadm 2020-07-16T15:32:45.821582+0000 mgr.x (mgr.34562) 5490 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:32:46.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:32:46 smithi188 bash[23329]: cephadm 2020-07-16T15:32:45.821873+0000 mgr.x (mgr.34562) 5491 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:32:47.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:32:47 smithi132 bash[27079]: cluster 2020-07-16T15:32:47.024350+0000 mgr.x (mgr.34562) 5492 : cluster [DBG] pgmap v3423: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:32:47.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:32:47 smithi188 bash[23329]: cluster 2020-07-16T15:32:47.024350+0000 mgr.x (mgr.34562) 5492 : cluster [DBG] pgmap v3423: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:32:49.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:32:48 smithi132 bash[27079]: audit 2020-07-16T15:32:48.688805+0000 mon.b (mon.2) 1211 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:32:49.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:32:48 smithi188 bash[23329]: audit 2020-07-16T15:32:48.688805+0000 mon.b (mon.2) 1211 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:32:50.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:32:49 smithi132 bash[27079]: cephadm 2020-07-16T15:32:48.689519+0000 mgr.x (mgr.34562) 5493 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:32:50.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:32:49 smithi132 bash[27079]: cephadm 2020-07-16T15:32:48.689908+0000 mgr.x (mgr.34562) 5494 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:32:50.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:32:49 smithi132 bash[27079]: cluster 2020-07-16T15:32:49.024804+0000 mgr.x (mgr.34562) 5495 : cluster [DBG] pgmap v3424: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:32:50.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:32:49 smithi188 bash[23329]: cephadm 2020-07-16T15:32:48.689519+0000 mgr.x (mgr.34562) 5493 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:32:50.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:32:49 smithi188 bash[23329]: cephadm 2020-07-16T15:32:48.689908+0000 mgr.x (mgr.34562) 5494 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:32:50.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:32:49 smithi188 bash[23329]: cluster 2020-07-16T15:32:49.024804+0000 mgr.x (mgr.34562) 5495 : cluster [DBG] pgmap v3424: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:32:51.785 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:32:51 smithi132 bash[27079]: cluster 2020-07-16T15:32:51.025183+0000 mgr.x (mgr.34562) 5496 : cluster [DBG] pgmap v3425: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:32:51.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:32:51 smithi188 bash[23329]: cluster 2020-07-16T15:32:51.025183+0000 mgr.x (mgr.34562) 5496 : cluster [DBG] pgmap v3425: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:32:53.426 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:32:53 smithi188 bash[23329]: cluster 2020-07-16T15:32:53.025652+0000 mgr.x (mgr.34562) 5497 : cluster [DBG] pgmap v3426: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:32:53.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:32:53 smithi132 bash[27079]: cluster 2020-07-16T15:32:53.025652+0000 mgr.x (mgr.34562) 5497 : cluster [DBG] pgmap v3426: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:32:55.426 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:32:55 smithi188 bash[23329]: cluster 2020-07-16T15:32:55.026123+0000 mgr.x (mgr.34562) 5498 : cluster [DBG] pgmap v3427: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:32:55.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:32:55 smithi132 bash[27079]: cluster 2020-07-16T15:32:55.026123+0000 mgr.x (mgr.34562) 5498 : cluster [DBG] pgmap v3427: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:32:57.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:32:57 smithi188 bash[23329]: cluster 2020-07-16T15:32:57.026588+0000 mgr.x (mgr.34562) 5499 : cluster [DBG] pgmap v3428: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:32:57.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:32:57 smithi132 bash[27079]: cluster 2020-07-16T15:32:57.026588+0000 mgr.x (mgr.34562) 5499 : cluster [DBG] pgmap v3428: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:32:58.158 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:32:58.408 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:32:58.408 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (115m) 8m ago 118m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:32:58.408 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (118m) 8m ago 118m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:32:58.409 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (116m) 8m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:32:58.409 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (115m) 8m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:32:58.409 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 8m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:32:58.409 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:32:58.410 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:32:58.410 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (118m) 8m ago 119m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:32:58.410 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (118m) 8m ago 119m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:32:58.410 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:32:58.410 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:32:58.410 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:32:58.411 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:32:58.411 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (119m) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:32:58.411 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (119m) 8m ago 119m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:32:58.411 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (119m) 8m ago 119m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:32:58.411 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (119m) 8m ago 119m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:32:58.412 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (118m) 8m ago 119m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:32:58.705 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:32:58.706 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:32:58.706 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:32:58.707 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:32:58.707 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:32:58.707 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:32:58.708 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:32:58.708 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:32:58.708 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:32:58.709 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:32:58.709 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:32:58.709 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:32:58.710 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:32:58.710 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:32:58.710 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:32:58.711 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:32:58.711 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:32:59.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:32:58 smithi132 bash[27079]: audit 2020-07-16T15:32:58.704847+0000 mon.c (mon.1) 382 : audit [DBG] from='client.? 172.21.15.132:0/3783731686' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:32:59.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:32:58 smithi188 bash[23329]: audit 2020-07-16T15:32:58.704847+0000 mon.c (mon.1) 382 : audit [DBG] from='client.? 172.21.15.132:0/3783731686' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:33:00.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:32:59 smithi132 bash[27079]: audit 2020-07-16T15:32:58.136005+0000 mgr.x (mgr.34562) 5500 : audit [DBG] from='client.28636 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:33:00.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:32:59 smithi132 bash[27079]: audit 2020-07-16T15:32:58.403970+0000 mgr.x (mgr.34562) 5501 : audit [DBG] from='client.28642 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:33:00.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:32:59 smithi132 bash[27079]: cluster 2020-07-16T15:32:59.026940+0000 mgr.x (mgr.34562) 5502 : cluster [DBG] pgmap v3429: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:33:00.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:32:59 smithi188 bash[23329]: audit 2020-07-16T15:32:58.136005+0000 mgr.x (mgr.34562) 5500 : audit [DBG] from='client.28636 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:33:00.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:32:59 smithi188 bash[23329]: audit 2020-07-16T15:32:58.403970+0000 mgr.x (mgr.34562) 5501 : audit [DBG] from='client.28642 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:33:00.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:32:59 smithi188 bash[23329]: cluster 2020-07-16T15:32:59.026940+0000 mgr.x (mgr.34562) 5502 : cluster [DBG] pgmap v3429: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:33:01.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:33:01 smithi132 bash[27079]: cluster 2020-07-16T15:33:01.027475+0000 mgr.x (mgr.34562) 5503 : cluster [DBG] pgmap v3430: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:33:01.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:33:01 smithi188 bash[23329]: cluster 2020-07-16T15:33:01.027475+0000 mgr.x (mgr.34562) 5503 : cluster [DBG] pgmap v3430: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:33:03.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:33:03 smithi188 bash[23329]: cluster 2020-07-16T15:33:03.027836+0000 mgr.x (mgr.34562) 5504 : cluster [DBG] pgmap v3431: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:33:03.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:33:03 smithi132 bash[27079]: cluster 2020-07-16T15:33:03.027836+0000 mgr.x (mgr.34562) 5504 : cluster [DBG] pgmap v3431: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:33:04.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:33:04 smithi188 bash[23329]: audit 2020-07-16T15:33:03.703736+0000 mon.b (mon.2) 1212 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:33:04.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:33:04 smithi188 bash[23329]: cephadm 2020-07-16T15:33:03.704444+0000 mgr.x (mgr.34562) 5505 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:33:04.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:33:04 smithi188 bash[23329]: cephadm 2020-07-16T15:33:03.704831+0000 mgr.x (mgr.34562) 5506 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:33:04.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:33:04 smithi132 bash[27079]: audit 2020-07-16T15:33:03.703736+0000 mon.b (mon.2) 1212 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:33:04.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:33:04 smithi132 bash[27079]: cephadm 2020-07-16T15:33:03.704444+0000 mgr.x (mgr.34562) 5505 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:33:04.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:33:04 smithi132 bash[27079]: cephadm 2020-07-16T15:33:03.704831+0000 mgr.x (mgr.34562) 5506 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:33:05.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:33:05 smithi188 bash[23329]: cluster 2020-07-16T15:33:05.028334+0000 mgr.x (mgr.34562) 5507 : cluster [DBG] pgmap v3432: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:33:05.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:33:05 smithi132 bash[27079]: cluster 2020-07-16T15:33:05.028334+0000 mgr.x (mgr.34562) 5507 : cluster [DBG] pgmap v3432: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:33:07.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:33:07 smithi188 bash[23329]: cluster 2020-07-16T15:33:07.028865+0000 mgr.x (mgr.34562) 5508 : cluster [DBG] pgmap v3433: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:33:07.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:33:07 smithi132 bash[27079]: cluster 2020-07-16T15:33:07.028865+0000 mgr.x (mgr.34562) 5508 : cluster [DBG] pgmap v3433: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:33:09.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:33:09 smithi188 bash[23329]: cluster 2020-07-16T15:33:09.029378+0000 mgr.x (mgr.34562) 5509 : cluster [DBG] pgmap v3434: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:33:09.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:33:09 smithi132 bash[27079]: cluster 2020-07-16T15:33:09.029378+0000 mgr.x (mgr.34562) 5509 : cluster [DBG] pgmap v3434: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:33:11.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:33:11 smithi132 bash[27079]: cluster 2020-07-16T15:33:11.029702+0000 mgr.x (mgr.34562) 5510 : cluster [DBG] pgmap v3435: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:33:11.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:33:11 smithi188 bash[23329]: cluster 2020-07-16T15:33:11.029702+0000 mgr.x (mgr.34562) 5510 : cluster [DBG] pgmap v3435: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:33:13.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:33:13 smithi188 bash[23329]: cluster 2020-07-16T15:33:13.030192+0000 mgr.x (mgr.34562) 5511 : cluster [DBG] pgmap v3436: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:33:13.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:33:13 smithi132 bash[27079]: cluster 2020-07-16T15:33:13.030192+0000 mgr.x (mgr.34562) 5511 : cluster [DBG] pgmap v3436: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:33:15.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:33:15 smithi188 bash[23329]: cluster 2020-07-16T15:33:15.030582+0000 mgr.x (mgr.34562) 5512 : cluster [DBG] pgmap v3437: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:33:15.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:33:15 smithi132 bash[27079]: cluster 2020-07-16T15:33:15.030582+0000 mgr.x (mgr.34562) 5512 : cluster [DBG] pgmap v3437: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:33:17.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:33:17 smithi188 bash[23329]: cluster 2020-07-16T15:33:17.031017+0000 mgr.x (mgr.34562) 5513 : cluster [DBG] pgmap v3438: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:33:17.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:33:17 smithi132 bash[27079]: cluster 2020-07-16T15:33:17.031017+0000 mgr.x (mgr.34562) 5513 : cluster [DBG] pgmap v3438: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:33:19.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:33:18 smithi132 bash[27079]: audit 2020-07-16T15:33:18.720480+0000 mon.b (mon.2) 1213 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:33:19.178 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:33:18 smithi188 bash[23329]: audit 2020-07-16T15:33:18.720480+0000 mon.b (mon.2) 1213 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:33:20.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:33:19 smithi132 bash[27079]: cephadm 2020-07-16T15:33:18.721226+0000 mgr.x (mgr.34562) 5514 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:33:20.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:33:19 smithi132 bash[27079]: cephadm 2020-07-16T15:33:18.721564+0000 mgr.x (mgr.34562) 5515 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:33:20.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:33:19 smithi132 bash[27079]: cluster 2020-07-16T15:33:19.031520+0000 mgr.x (mgr.34562) 5516 : cluster [DBG] pgmap v3439: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:33:20.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:33:19 smithi188 bash[23329]: cephadm 2020-07-16T15:33:18.721226+0000 mgr.x (mgr.34562) 5514 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:33:20.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:33:19 smithi188 bash[23329]: cephadm 2020-07-16T15:33:18.721564+0000 mgr.x (mgr.34562) 5515 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:33:20.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:33:19 smithi188 bash[23329]: cluster 2020-07-16T15:33:19.031520+0000 mgr.x (mgr.34562) 5516 : cluster [DBG] pgmap v3439: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:33:21.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:33:21 smithi132 bash[27079]: cluster 2020-07-16T15:33:21.031853+0000 mgr.x (mgr.34562) 5517 : cluster [DBG] pgmap v3440: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:33:21.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:33:21 smithi188 bash[23329]: cluster 2020-07-16T15:33:21.031853+0000 mgr.x (mgr.34562) 5517 : cluster [DBG] pgmap v3440: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:33:23.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:33:23 smithi188 bash[23329]: cluster 2020-07-16T15:33:23.032452+0000 mgr.x (mgr.34562) 5518 : cluster [DBG] pgmap v3441: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:33:23.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:33:23 smithi132 bash[27079]: cluster 2020-07-16T15:33:23.032452+0000 mgr.x (mgr.34562) 5518 : cluster [DBG] pgmap v3441: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:33:25.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:33:25 smithi188 bash[23329]: cluster 2020-07-16T15:33:25.032880+0000 mgr.x (mgr.34562) 5519 : cluster [DBG] pgmap v3442: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:33:25.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:33:25 smithi132 bash[27079]: cluster 2020-07-16T15:33:25.032880+0000 mgr.x (mgr.34562) 5519 : cluster [DBG] pgmap v3442: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:33:27.429 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:33:27 smithi188 bash[23329]: cluster 2020-07-16T15:33:27.033430+0000 mgr.x (mgr.34562) 5520 : cluster [DBG] pgmap v3443: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:33:27.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:33:27 smithi132 bash[27079]: cluster 2020-07-16T15:33:27.033430+0000 mgr.x (mgr.34562) 5520 : cluster [DBG] pgmap v3443: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:33:29.004 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:33:29.268 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:33:29.269 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (116m) 9m ago 119m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:33:29.269 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (118m) 9m ago 118m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:33:29.269 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (116m) 9m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:33:29.269 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (115m) 9m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:33:29.269 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 9m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:33:29.270 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:33:29.270 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:33:29.270 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (119m) 9m ago 119m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:33:29.270 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (119m) 9m ago 119m 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:33:29.270 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:33:29.271 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:33:29.271 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:33:29.271 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:33:29.272 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:33:29.272 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:33:29.272 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:33:29.273 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (119m) 9m ago 119m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:33:29.273 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (118m) 9m ago 119m 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:33:29.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:33:29 smithi188 bash[23329]: audit 2020-07-16T15:33:28.992263+0000 mgr.x (mgr.34562) 5521 : audit [DBG] from='client.28654 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:33:29.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:33:29 smithi188 bash[23329]: cluster 2020-07-16T15:33:29.033848+0000 mgr.x (mgr.34562) 5522 : cluster [DBG] pgmap v3444: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:33:29.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:33:29 smithi132 bash[27079]: audit 2020-07-16T15:33:28.992263+0000 mgr.x (mgr.34562) 5521 : audit [DBG] from='client.28654 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:33:29.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:33:29 smithi132 bash[27079]: cluster 2020-07-16T15:33:29.033848+0000 mgr.x (mgr.34562) 5522 : cluster [DBG] pgmap v3444: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:33:29.565 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:33:29.566 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:33:29.566 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:33:29.566 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:33:29.566 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:33:29.566 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:33:29.567 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:33:29.567 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:33:29.567 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:33:29.567 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:33:29.567 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:33:29.568 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:33:29.568 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:33:29.568 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:33:29.568 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:33:29.568 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:33:29.569 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:33:30.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:33:30 smithi188 bash[23329]: audit 2020-07-16T15:33:29.264193+0000 mgr.x (mgr.34562) 5523 : audit [DBG] from='client.28660 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:33:30.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:33:30 smithi188 bash[23329]: audit 2020-07-16T15:33:29.564737+0000 mon.c (mon.1) 383 : audit [DBG] from='client.? 172.21.15.132:0/2002704613' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:33:30.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:33:30 smithi132 bash[27079]: audit 2020-07-16T15:33:29.264193+0000 mgr.x (mgr.34562) 5523 : audit [DBG] from='client.28660 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:33:30.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:33:30 smithi132 bash[27079]: audit 2020-07-16T15:33:29.564737+0000 mon.c (mon.1) 383 : audit [DBG] from='client.? 172.21.15.132:0/2002704613' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:33:31.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:33:31 smithi132 bash[27079]: cluster 2020-07-16T15:33:31.034339+0000 mgr.x (mgr.34562) 5524 : cluster [DBG] pgmap v3445: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:33:31.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:33:31 smithi188 bash[23329]: cluster 2020-07-16T15:33:31.034339+0000 mgr.x (mgr.34562) 5524 : cluster [DBG] pgmap v3445: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:33:33.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:33:33 smithi188 bash[23329]: cluster 2020-07-16T15:33:33.034762+0000 mgr.x (mgr.34562) 5525 : cluster [DBG] pgmap v3446: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:33:33.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:33:33 smithi132 bash[27079]: cluster 2020-07-16T15:33:33.034762+0000 mgr.x (mgr.34562) 5525 : cluster [DBG] pgmap v3446: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:33:34.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:33:34 smithi188 bash[23329]: audit 2020-07-16T15:33:33.735002+0000 mon.b (mon.2) 1214 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:33:34.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:33:34 smithi188 bash[23329]: cephadm 2020-07-16T15:33:33.735726+0000 mgr.x (mgr.34562) 5526 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:33:34.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:33:34 smithi188 bash[23329]: cephadm 2020-07-16T15:33:33.736151+0000 mgr.x (mgr.34562) 5527 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:33:34.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:33:34 smithi132 bash[27079]: audit 2020-07-16T15:33:33.735002+0000 mon.b (mon.2) 1214 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:33:34.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:33:34 smithi132 bash[27079]: cephadm 2020-07-16T15:33:33.735726+0000 mgr.x (mgr.34562) 5526 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:33:34.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:33:34 smithi132 bash[27079]: cephadm 2020-07-16T15:33:33.736151+0000 mgr.x (mgr.34562) 5527 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:33:35.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:33:35 smithi188 bash[23329]: cluster 2020-07-16T15:33:35.035327+0000 mgr.x (mgr.34562) 5528 : cluster [DBG] pgmap v3447: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:33:35.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:33:35 smithi132 bash[27079]: cluster 2020-07-16T15:33:35.035327+0000 mgr.x (mgr.34562) 5528 : cluster [DBG] pgmap v3447: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:33:37.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:33:37 smithi188 bash[23329]: cluster 2020-07-16T15:33:37.035781+0000 mgr.x (mgr.34562) 5529 : cluster [DBG] pgmap v3448: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:33:37.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:33:37 smithi132 bash[27079]: cluster 2020-07-16T15:33:37.035781+0000 mgr.x (mgr.34562) 5529 : cluster [DBG] pgmap v3448: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:33:39.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:33:39 smithi188 bash[23329]: cluster 2020-07-16T15:33:39.036274+0000 mgr.x (mgr.34562) 5530 : cluster [DBG] pgmap v3449: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:33:39.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:33:39 smithi132 bash[27079]: cluster 2020-07-16T15:33:39.036274+0000 mgr.x (mgr.34562) 5530 : cluster [DBG] pgmap v3449: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:33:41.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:33:41 smithi132 bash[27079]: cluster 2020-07-16T15:33:41.036752+0000 mgr.x (mgr.34562) 5531 : cluster [DBG] pgmap v3450: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:33:41.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:33:41 smithi188 bash[23329]: cluster 2020-07-16T15:33:41.036752+0000 mgr.x (mgr.34562) 5531 : cluster [DBG] pgmap v3450: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:33:43.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:33:43 smithi188 bash[23329]: cluster 2020-07-16T15:33:43.037275+0000 mgr.x (mgr.34562) 5532 : cluster [DBG] pgmap v3451: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:33:43.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:33:43 smithi132 bash[27079]: cluster 2020-07-16T15:33:43.037275+0000 mgr.x (mgr.34562) 5532 : cluster [DBG] pgmap v3451: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:33:45.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:33:45 smithi188 bash[23329]: cluster 2020-07-16T15:33:45.037743+0000 mgr.x (mgr.34562) 5533 : cluster [DBG] pgmap v3452: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:33:45.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:33:45 smithi132 bash[27079]: cluster 2020-07-16T15:33:45.037743+0000 mgr.x (mgr.34562) 5533 : cluster [DBG] pgmap v3452: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:33:47.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:33:47 smithi188 bash[23329]: cluster 2020-07-16T15:33:47.038114+0000 mgr.x (mgr.34562) 5534 : cluster [DBG] pgmap v3453: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:33:47.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:33:47 smithi132 bash[27079]: cluster 2020-07-16T15:33:47.038114+0000 mgr.x (mgr.34562) 5534 : cluster [DBG] pgmap v3453: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:33:49.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:33:48 smithi188 bash[23329]: audit 2020-07-16T15:33:48.754142+0000 mon.b (mon.2) 1215 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:33:49.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:33:48 smithi188 bash[23329]: audit 2020-07-16T15:33:48.755541+0000 mon.b (mon.2) 1216 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:33:49.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:33:48 smithi188 bash[23329]: audit 2020-07-16T15:33:48.756659+0000 mon.b (mon.2) 1217 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:33:49.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:33:48 smithi188 bash[23329]: audit 2020-07-16T15:33:48.757912+0000 mon.b (mon.2) 1218 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:33:49.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:33:48 smithi188 bash[23329]: audit 2020-07-16T15:33:48.759106+0000 mon.b (mon.2) 1219 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:33:49.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:33:48 smithi132 bash[27079]: audit 2020-07-16T15:33:48.754142+0000 mon.b (mon.2) 1215 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:33:49.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:33:48 smithi132 bash[27079]: audit 2020-07-16T15:33:48.755541+0000 mon.b (mon.2) 1216 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:33:49.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:33:48 smithi132 bash[27079]: audit 2020-07-16T15:33:48.756659+0000 mon.b (mon.2) 1217 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:33:49.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:33:48 smithi132 bash[27079]: audit 2020-07-16T15:33:48.757912+0000 mon.b (mon.2) 1218 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:33:49.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:33:48 smithi132 bash[27079]: audit 2020-07-16T15:33:48.759106+0000 mon.b (mon.2) 1219 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:33:50.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:33:49 smithi132 bash[27079]: audit 2020-07-16T15:33:48.754558+0000 mgr.x (mgr.34562) 5535 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:33:50.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:33:49 smithi132 bash[27079]: audit 2020-07-16T15:33:48.755819+0000 mgr.x (mgr.34562) 5536 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:33:50.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:33:49 smithi132 bash[27079]: audit 2020-07-16T15:33:48.756934+0000 mgr.x (mgr.34562) 5537 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:33:50.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:33:49 smithi132 bash[27079]: cephadm 2020-07-16T15:33:48.757643+0000 mgr.x (mgr.34562) 5538 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:33:50.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:33:49 smithi132 bash[27079]: cephadm 2020-07-16T15:33:48.758732+0000 mgr.x (mgr.34562) 5539 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:33:50.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:33:49 smithi132 bash[27079]: cephadm 2020-07-16T15:33:48.759887+0000 mgr.x (mgr.34562) 5540 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:33:50.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:33:49 smithi132 bash[27079]: cephadm 2020-07-16T15:33:48.760013+0000 mgr.x (mgr.34562) 5541 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:33:50.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:33:49 smithi132 bash[27079]: cluster 2020-07-16T15:33:49.038517+0000 mgr.x (mgr.34562) 5542 : cluster [DBG] pgmap v3454: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:33:50.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:33:49 smithi188 bash[23329]: audit 2020-07-16T15:33:48.754558+0000 mgr.x (mgr.34562) 5535 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:33:50.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:33:49 smithi188 bash[23329]: audit 2020-07-16T15:33:48.755819+0000 mgr.x (mgr.34562) 5536 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:33:50.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:33:49 smithi188 bash[23329]: audit 2020-07-16T15:33:48.756934+0000 mgr.x (mgr.34562) 5537 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:33:50.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:33:49 smithi188 bash[23329]: cephadm 2020-07-16T15:33:48.757643+0000 mgr.x (mgr.34562) 5538 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:33:50.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:33:49 smithi188 bash[23329]: cephadm 2020-07-16T15:33:48.758732+0000 mgr.x (mgr.34562) 5539 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:33:50.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:33:49 smithi188 bash[23329]: cephadm 2020-07-16T15:33:48.759887+0000 mgr.x (mgr.34562) 5540 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:33:50.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:33:49 smithi188 bash[23329]: cephadm 2020-07-16T15:33:48.760013+0000 mgr.x (mgr.34562) 5541 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:33:50.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:33:49 smithi188 bash[23329]: cluster 2020-07-16T15:33:49.038517+0000 mgr.x (mgr.34562) 5542 : cluster [DBG] pgmap v3454: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:33:51.788 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:33:51 smithi132 bash[27079]: cluster 2020-07-16T15:33:51.038893+0000 mgr.x (mgr.34562) 5543 : cluster [DBG] pgmap v3455: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:33:51.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:33:51 smithi188 bash[23329]: cluster 2020-07-16T15:33:51.038893+0000 mgr.x (mgr.34562) 5543 : cluster [DBG] pgmap v3455: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:33:52.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:33:52 smithi132 bash[27079]: audit 2020-07-16T15:33:51.644414+0000 mon.b (mon.2) 1220 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:33:52.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:33:52 smithi132 bash[27079]: cephadm 2020-07-16T15:33:51.645056+0000 mgr.x (mgr.34562) 5544 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:33:52.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:33:52 smithi132 bash[27079]: cephadm 2020-07-16T15:33:51.645359+0000 mgr.x (mgr.34562) 5545 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:33:52.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:33:52 smithi188 bash[23329]: audit 2020-07-16T15:33:51.644414+0000 mon.b (mon.2) 1220 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:33:52.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:33:52 smithi188 bash[23329]: cephadm 2020-07-16T15:33:51.645056+0000 mgr.x (mgr.34562) 5544 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:33:52.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:33:52 smithi188 bash[23329]: cephadm 2020-07-16T15:33:51.645359+0000 mgr.x (mgr.34562) 5545 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:33:53.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:33:53 smithi132 bash[27079]: cluster 2020-07-16T15:33:53.039453+0000 mgr.x (mgr.34562) 5546 : cluster [DBG] pgmap v3456: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:33:53.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:33:53 smithi188 bash[23329]: cluster 2020-07-16T15:33:53.039453+0000 mgr.x (mgr.34562) 5546 : cluster [DBG] pgmap v3456: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:33:55.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:33:55 smithi188 bash[23329]: cluster 2020-07-16T15:33:55.039968+0000 mgr.x (mgr.34562) 5547 : cluster [DBG] pgmap v3457: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:33:55.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:33:55 smithi132 bash[27079]: cluster 2020-07-16T15:33:55.039968+0000 mgr.x (mgr.34562) 5547 : cluster [DBG] pgmap v3457: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:33:57.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:33:57 smithi188 bash[23329]: cluster 2020-07-16T15:33:57.040379+0000 mgr.x (mgr.34562) 5548 : cluster [DBG] pgmap v3458: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:33:57.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:33:57 smithi132 bash[27079]: cluster 2020-07-16T15:33:57.040379+0000 mgr.x (mgr.34562) 5548 : cluster [DBG] pgmap v3458: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:33:59.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:33:59 smithi188 bash[23329]: cluster 2020-07-16T15:33:59.040741+0000 mgr.x (mgr.34562) 5549 : cluster [DBG] pgmap v3459: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:33:59.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:33:59 smithi132 bash[27079]: cluster 2020-07-16T15:33:59.040741+0000 mgr.x (mgr.34562) 5549 : cluster [DBG] pgmap v3459: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:33:59.879 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:34:00.146 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:34:00.147 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (116m) 9m ago 119m 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:34:00.147 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (119m) 9m ago 119m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:34:00.147 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (117m) 9m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:34:00.147 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (116m) 9m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:34:00.147 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 9m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:34:00.148 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:34:00.148 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:34:00.148 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (119m) 9m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:34:00.148 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (119m) 9m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:34:00.149 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:34:00.149 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:34:00.149 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:34:00.149 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:34:00.150 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:34:00.150 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:34:00.150 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:34:00.150 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:34:00.150 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (119m) 9m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:34:00.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:00 smithi188 bash[23329]: audit 2020-07-16T15:33:59.867752+0000 mgr.x (mgr.34562) 5550 : audit [DBG] from='client.28672 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:34:00.448 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:34:00.448 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:34:00.448 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:34:00.448 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:34:00.449 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:34:00.449 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:34:00.449 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:34:00.458 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:34:00.458 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:34:00.458 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:34:00.458 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:34:00.459 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:34:00.459 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:34:00.459 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:34:00.459 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:34:00.459 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:34:00.459 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:34:00.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:00 smithi132 bash[27079]: audit 2020-07-16T15:33:59.867752+0000 mgr.x (mgr.34562) 5550 : audit [DBG] from='client.28672 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:34:01.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:01 smithi188 bash[23329]: audit 2020-07-16T15:34:00.142320+0000 mgr.x (mgr.34562) 5551 : audit [DBG] from='client.28678 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:34:01.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:01 smithi188 bash[23329]: audit 2020-07-16T15:34:00.446507+0000 mon.c (mon.1) 384 : audit [DBG] from='client.? 172.21.15.132:0/4184364348' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:34:01.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:01 smithi188 bash[23329]: cluster 2020-07-16T15:34:01.041242+0000 mgr.x (mgr.34562) 5552 : cluster [DBG] pgmap v3460: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:34:01.535 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:01 smithi132 bash[27079]: audit 2020-07-16T15:34:00.142320+0000 mgr.x (mgr.34562) 5551 : audit [DBG] from='client.28678 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:34:01.536 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:01 smithi132 bash[27079]: audit 2020-07-16T15:34:00.446507+0000 mon.c (mon.1) 384 : audit [DBG] from='client.? 172.21.15.132:0/4184364348' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:34:01.536 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:01 smithi132 bash[27079]: cluster 2020-07-16T15:34:01.041242+0000 mgr.x (mgr.34562) 5552 : cluster [DBG] pgmap v3460: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:34:03.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:03 smithi188 bash[23329]: cluster 2020-07-16T15:34:03.041755+0000 mgr.x (mgr.34562) 5553 : cluster [DBG] pgmap v3461: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:34:03.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:03 smithi132 bash[27079]: cluster 2020-07-16T15:34:03.041755+0000 mgr.x (mgr.34562) 5553 : cluster [DBG] pgmap v3461: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:34:05.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:05 smithi188 bash[23329]: cluster 2020-07-16T15:34:05.042201+0000 mgr.x (mgr.34562) 5554 : cluster [DBG] pgmap v3462: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:34:05.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:05 smithi132 bash[27079]: cluster 2020-07-16T15:34:05.042201+0000 mgr.x (mgr.34562) 5554 : cluster [DBG] pgmap v3462: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:34:07.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:06 smithi132 bash[27079]: audit 2020-07-16T15:34:06.647898+0000 mon.b (mon.2) 1221 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:34:07.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:06 smithi188 bash[23329]: audit 2020-07-16T15:34:06.647898+0000 mon.b (mon.2) 1221 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:34:08.033 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:07 smithi132 bash[27079]: cephadm 2020-07-16T15:34:06.648577+0000 mgr.x (mgr.34562) 5555 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:34:08.033 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:07 smithi132 bash[27079]: cephadm 2020-07-16T15:34:06.648978+0000 mgr.x (mgr.34562) 5556 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:34:08.033 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:07 smithi132 bash[27079]: cluster 2020-07-16T15:34:07.042605+0000 mgr.x (mgr.34562) 5557 : cluster [DBG] pgmap v3463: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:34:08.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:07 smithi188 bash[23329]: cephadm 2020-07-16T15:34:06.648577+0000 mgr.x (mgr.34562) 5555 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:34:08.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:07 smithi188 bash[23329]: cephadm 2020-07-16T15:34:06.648978+0000 mgr.x (mgr.34562) 5556 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:34:08.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:07 smithi188 bash[23329]: cluster 2020-07-16T15:34:07.042605+0000 mgr.x (mgr.34562) 5557 : cluster [DBG] pgmap v3463: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:34:09.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:09 smithi188 bash[23329]: cluster 2020-07-16T15:34:09.043027+0000 mgr.x (mgr.34562) 5558 : cluster [DBG] pgmap v3464: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:34:09.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:09 smithi132 bash[27079]: cluster 2020-07-16T15:34:09.043027+0000 mgr.x (mgr.34562) 5558 : cluster [DBG] pgmap v3464: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:34:11.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:11 smithi132 bash[27079]: cluster 2020-07-16T15:34:11.043625+0000 mgr.x (mgr.34562) 5559 : cluster [DBG] pgmap v3465: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:34:11.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:11 smithi188 bash[23329]: cluster 2020-07-16T15:34:11.043625+0000 mgr.x (mgr.34562) 5559 : cluster [DBG] pgmap v3465: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:34:13.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:13 smithi188 bash[23329]: cluster 2020-07-16T15:34:13.044117+0000 mgr.x (mgr.34562) 5560 : cluster [DBG] pgmap v3466: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:34:13.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:13 smithi132 bash[27079]: cluster 2020-07-16T15:34:13.044117+0000 mgr.x (mgr.34562) 5560 : cluster [DBG] pgmap v3466: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:34:15.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:15 smithi188 bash[23329]: cluster 2020-07-16T15:34:15.044729+0000 mgr.x (mgr.34562) 5561 : cluster [DBG] pgmap v3467: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:34:15.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:15 smithi132 bash[27079]: cluster 2020-07-16T15:34:15.044729+0000 mgr.x (mgr.34562) 5561 : cluster [DBG] pgmap v3467: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:34:17.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:17 smithi188 bash[23329]: cluster 2020-07-16T15:34:17.045334+0000 mgr.x (mgr.34562) 5562 : cluster [DBG] pgmap v3468: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:34:17.538 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:17 smithi132 bash[27079]: cluster 2020-07-16T15:34:17.045334+0000 mgr.x (mgr.34562) 5562 : cluster [DBG] pgmap v3468: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:34:19.441 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:19 smithi188 bash[23329]: cluster 2020-07-16T15:34:19.045755+0000 mgr.x (mgr.34562) 5563 : cluster [DBG] pgmap v3469: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:34:19.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:19 smithi132 bash[27079]: cluster 2020-07-16T15:34:19.045755+0000 mgr.x (mgr.34562) 5563 : cluster [DBG] pgmap v3469: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:34:21.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:21 smithi132 bash[27079]: cluster 2020-07-16T15:34:21.046241+0000 mgr.x (mgr.34562) 5564 : cluster [DBG] pgmap v3470: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:34:21.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:21 smithi188 bash[23329]: cluster 2020-07-16T15:34:21.046241+0000 mgr.x (mgr.34562) 5564 : cluster [DBG] pgmap v3470: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:34:22.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:22 smithi132 bash[27079]: audit 2020-07-16T15:34:21.657915+0000 mon.b (mon.2) 1222 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:34:22.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:22 smithi132 bash[27079]: cephadm 2020-07-16T15:34:21.658609+0000 mgr.x (mgr.34562) 5565 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:34:22.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:22 smithi132 bash[27079]: cephadm 2020-07-16T15:34:21.658974+0000 mgr.x (mgr.34562) 5566 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:34:22.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:22 smithi188 bash[23329]: audit 2020-07-16T15:34:21.657915+0000 mon.b (mon.2) 1222 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:34:22.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:22 smithi188 bash[23329]: cephadm 2020-07-16T15:34:21.658609+0000 mgr.x (mgr.34562) 5565 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:34:22.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:22 smithi188 bash[23329]: cephadm 2020-07-16T15:34:21.658974+0000 mgr.x (mgr.34562) 5566 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:34:23.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:23 smithi132 bash[27079]: cluster 2020-07-16T15:34:23.046807+0000 mgr.x (mgr.34562) 5567 : cluster [DBG] pgmap v3471: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:34:23.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:23 smithi188 bash[23329]: cluster 2020-07-16T15:34:23.046807+0000 mgr.x (mgr.34562) 5567 : cluster [DBG] pgmap v3471: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:34:25.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:25 smithi188 bash[23329]: cluster 2020-07-16T15:34:25.047167+0000 mgr.x (mgr.34562) 5568 : cluster [DBG] pgmap v3472: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:34:25.767 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:25 smithi132 bash[27079]: cluster 2020-07-16T15:34:25.047167+0000 mgr.x (mgr.34562) 5568 : cluster [DBG] pgmap v3472: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:34:27.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:27 smithi188 bash[23329]: cluster 2020-07-16T15:34:27.047553+0000 mgr.x (mgr.34562) 5569 : cluster [DBG] pgmap v3473: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:34:27.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:27 smithi132 bash[27079]: cluster 2020-07-16T15:34:27.047553+0000 mgr.x (mgr.34562) 5569 : cluster [DBG] pgmap v3473: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:34:29.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:29 smithi188 bash[23329]: cluster 2020-07-16T15:34:29.048044+0000 mgr.x (mgr.34562) 5570 : cluster [DBG] pgmap v3474: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:34:29.544 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:29 smithi132 bash[27079]: cluster 2020-07-16T15:34:29.048044+0000 mgr.x (mgr.34562) 5570 : cluster [DBG] pgmap v3474: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:34:30.746 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:34:31.005 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:34:31.006 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (117m) 10m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:34:31.006 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (119m) 10m ago 119m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:34:31.006 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (117m) 10m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:34:31.006 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (117m) 10m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:34:31.007 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 10m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:34:31.007 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:34:31.007 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:34:31.007 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 10m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:34:31.007 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 10m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:34:31.008 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:34:31.008 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:34:31.008 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:34:31.008 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:34:31.008 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:34:31.009 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:34:31.009 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:34:31.009 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:34:31.009 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (119m) 10m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:34:31.302 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:34:31.307 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:34:31.307 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:34:31.307 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:34:31.307 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:34:31.307 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:34:31.308 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:34:31.308 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:34:31.308 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:34:31.312 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:34:31.312 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:34:31.312 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:34:31.313 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:34:31.313 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:34:31.313 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:34:31.314 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:34:31.314 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:34:31.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:31 smithi132 bash[27079]: audit 2020-07-16T15:34:30.734787+0000 mgr.x (mgr.34562) 5571 : audit [DBG] from='client.28690 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:34:31.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:31 smithi132 bash[27079]: audit 2020-07-16T15:34:31.001495+0000 mgr.x (mgr.34562) 5572 : audit [DBG] from='client.28696 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:34:31.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:31 smithi132 bash[27079]: cluster 2020-07-16T15:34:31.048542+0000 mgr.x (mgr.34562) 5573 : cluster [DBG] pgmap v3475: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:34:31.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:31 smithi132 bash[27079]: audit 2020-07-16T15:34:31.301370+0000 mon.c (mon.1) 385 : audit [DBG] from='client.? 172.21.15.132:0/3055617283' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:34:31.925 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:31 smithi188 bash[23329]: audit 2020-07-16T15:34:30.734787+0000 mgr.x (mgr.34562) 5571 : audit [DBG] from='client.28690 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:34:31.926 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:31 smithi188 bash[23329]: audit 2020-07-16T15:34:31.001495+0000 mgr.x (mgr.34562) 5572 : audit [DBG] from='client.28696 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:34:31.926 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:31 smithi188 bash[23329]: cluster 2020-07-16T15:34:31.048542+0000 mgr.x (mgr.34562) 5573 : cluster [DBG] pgmap v3475: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:34:31.926 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:31 smithi188 bash[23329]: audit 2020-07-16T15:34:31.301370+0000 mon.c (mon.1) 385 : audit [DBG] from='client.? 172.21.15.132:0/3055617283' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:34:33.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:33 smithi188 bash[23329]: cluster 2020-07-16T15:34:33.048941+0000 mgr.x (mgr.34562) 5574 : cluster [DBG] pgmap v3476: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:34:33.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:33 smithi132 bash[27079]: cluster 2020-07-16T15:34:33.048941+0000 mgr.x (mgr.34562) 5574 : cluster [DBG] pgmap v3476: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:34:35.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:35 smithi188 bash[23329]: cluster 2020-07-16T15:34:35.049464+0000 mgr.x (mgr.34562) 5575 : cluster [DBG] pgmap v3477: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:34:35.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:35 smithi132 bash[27079]: cluster 2020-07-16T15:34:35.049464+0000 mgr.x (mgr.34562) 5575 : cluster [DBG] pgmap v3477: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:34:37.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:36 smithi132 bash[27079]: audit 2020-07-16T15:34:36.661717+0000 mon.b (mon.2) 1223 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:34:37.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:36 smithi188 bash[23329]: audit 2020-07-16T15:34:36.661717+0000 mon.b (mon.2) 1223 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:34:38.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:37 smithi132 bash[27079]: cephadm 2020-07-16T15:34:36.662510+0000 mgr.x (mgr.34562) 5576 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:34:38.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:37 smithi132 bash[27079]: cephadm 2020-07-16T15:34:36.662919+0000 mgr.x (mgr.34562) 5577 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:34:38.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:37 smithi132 bash[27079]: cluster 2020-07-16T15:34:37.049859+0000 mgr.x (mgr.34562) 5578 : cluster [DBG] pgmap v3478: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:34:38.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:37 smithi188 bash[23329]: cephadm 2020-07-16T15:34:36.662510+0000 mgr.x (mgr.34562) 5576 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:34:38.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:37 smithi188 bash[23329]: cephadm 2020-07-16T15:34:36.662919+0000 mgr.x (mgr.34562) 5577 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:34:38.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:37 smithi188 bash[23329]: cluster 2020-07-16T15:34:37.049859+0000 mgr.x (mgr.34562) 5578 : cluster [DBG] pgmap v3478: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:34:39.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:39 smithi188 bash[23329]: cluster 2020-07-16T15:34:39.050269+0000 mgr.x (mgr.34562) 5579 : cluster [DBG] pgmap v3479: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:34:39.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:39 smithi132 bash[27079]: cluster 2020-07-16T15:34:39.050269+0000 mgr.x (mgr.34562) 5579 : cluster [DBG] pgmap v3479: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:34:41.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:41 smithi132 bash[27079]: cluster 2020-07-16T15:34:41.050652+0000 mgr.x (mgr.34562) 5580 : cluster [DBG] pgmap v3480: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:34:41.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:41 smithi188 bash[23329]: cluster 2020-07-16T15:34:41.050652+0000 mgr.x (mgr.34562) 5580 : cluster [DBG] pgmap v3480: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:34:43.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:43 smithi188 bash[23329]: cluster 2020-07-16T15:34:43.051049+0000 mgr.x (mgr.34562) 5581 : cluster [DBG] pgmap v3481: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:34:43.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:43 smithi132 bash[27079]: cluster 2020-07-16T15:34:43.051049+0000 mgr.x (mgr.34562) 5581 : cluster [DBG] pgmap v3481: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:34:45.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:45 smithi188 bash[23329]: cluster 2020-07-16T15:34:45.051491+0000 mgr.x (mgr.34562) 5582 : cluster [DBG] pgmap v3482: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:34:45.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:45 smithi132 bash[27079]: cluster 2020-07-16T15:34:45.051491+0000 mgr.x (mgr.34562) 5582 : cluster [DBG] pgmap v3482: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:34:47.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:47 smithi188 bash[23329]: cluster 2020-07-16T15:34:47.052071+0000 mgr.x (mgr.34562) 5583 : cluster [DBG] pgmap v3483: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:34:47.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:47 smithi132 bash[27079]: cluster 2020-07-16T15:34:47.052071+0000 mgr.x (mgr.34562) 5583 : cluster [DBG] pgmap v3483: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:34:49.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:49 smithi188 bash[23329]: cluster 2020-07-16T15:34:49.052663+0000 mgr.x (mgr.34562) 5584 : cluster [DBG] pgmap v3484: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:34:49.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:49 smithi132 bash[27079]: cluster 2020-07-16T15:34:49.052663+0000 mgr.x (mgr.34562) 5584 : cluster [DBG] pgmap v3484: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:34:51.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:51 smithi132 bash[27079]: cluster 2020-07-16T15:34:51.053078+0000 mgr.x (mgr.34562) 5585 : cluster [DBG] pgmap v3485: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:34:51.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:51 smithi188 bash[23329]: cluster 2020-07-16T15:34:51.053078+0000 mgr.x (mgr.34562) 5585 : cluster [DBG] pgmap v3485: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:34:52.617 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:52 smithi132 bash[27079]: audit 2020-07-16T15:34:51.668988+0000 mon.b (mon.2) 1224 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T15:34:52.617 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:52 smithi132 bash[27079]: audit 2020-07-16T15:34:51.669277+0000 mon.b (mon.2) 1225 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T15:34:52.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:52 smithi188 bash[23329]: audit 2020-07-16T15:34:51.668988+0000 mon.b (mon.2) 1224 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T15:34:52.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:52 smithi188 bash[23329]: audit 2020-07-16T15:34:51.669277+0000 mon.b (mon.2) 1225 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T15:34:53.769 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:53 smithi132 bash[27079]: cluster 2020-07-16T15:34:53.053460+0000 mgr.x (mgr.34562) 5586 : cluster [DBG] pgmap v3486: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:34:53.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:53 smithi188 bash[23329]: cluster 2020-07-16T15:34:53.053460+0000 mgr.x (mgr.34562) 5586 : cluster [DBG] pgmap v3486: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:34:54.518 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:54 smithi132 bash[27079]: audit 2020-07-16T15:34:53.843088+0000 mon.b (mon.2) 1226 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:34:53.841534\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841594\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841629\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841658\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841844\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841946\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.842045\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.842144\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.842177\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:34:53.842246\", \"last_device_update\": \"2020-07-16T15:04:18.042470\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:26:27.974828\"}"}]: dispatch 2020-07-16T15:34:54.519 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:54 smithi132 bash[27079]: audit 2020-07-16T15:34:53.843746+0000 mon.c (mon.1) 386 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:34:53.841534\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841594\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841629\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841658\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841844\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841946\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.842045\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.842144\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.842177\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:34:53.842246\", \"last_device_update\": \"2020-07-16T15:04:18.042470\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:26:27.974828\"}"}]: dispatch 2020-07-16T15:34:54.519 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:54 smithi132 bash[27079]: audit 2020-07-16T15:34:53.848622+0000 mon.c (mon.1) 387 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:34:53.841534\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841594\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841629\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841658\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841844\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841946\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.842045\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.842144\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.842177\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:34:53.842246\", \"last_device_update\": \"2020-07-16T15:04:18.042470\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:26:27.974828\"}"}]': finished 2020-07-16T15:34:54.519 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:54 smithi132 bash[27079]: audit 2020-07-16T15:34:53.849642+0000 mon.b (mon.2) 1227 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T15:34:54.520 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:54 smithi132 bash[27079]: audit 2020-07-16T15:34:54.465427+0000 mon.b (mon.2) 1228 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.463891\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.463961\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.463992\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464150\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464250\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464376\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464480\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464519\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464553\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:34:54.464656\", \"last_device_update\": \"2020-07-16T15:05:23.895950\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:26:27.978565\"}"}]: dispatch 2020-07-16T15:34:54.520 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:54 smithi132 bash[27079]: audit 2020-07-16T15:34:54.465913+0000 mon.c (mon.1) 388 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.463891\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.463961\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.463992\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464150\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464250\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464376\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464480\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464519\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464553\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:34:54.464656\", \"last_device_update\": \"2020-07-16T15:05:23.895950\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:26:27.978565\"}"}]: dispatch 2020-07-16T15:34:54.520 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:54 smithi132 bash[27079]: audit 2020-07-16T15:34:54.468588+0000 mon.c (mon.1) 389 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.463891\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.463961\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.463992\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464150\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464250\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464376\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464480\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464519\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464553\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:34:54.464656\", \"last_device_update\": \"2020-07-16T15:05:23.895950\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:26:27.978565\"}"}]': finished 2020-07-16T15:34:54.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:54 smithi188 bash[23329]: audit 2020-07-16T15:34:53.843088+0000 mon.b (mon.2) 1226 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:34:53.841534\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841594\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841629\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841658\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841844\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841946\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.842045\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.842144\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.842177\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:34:53.842246\", \"last_device_update\": \"2020-07-16T15:04:18.042470\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:26:27.974828\"}"}]: dispatch 2020-07-16T15:34:54.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:54 smithi188 bash[23329]: audit 2020-07-16T15:34:53.843746+0000 mon.c (mon.1) 386 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:34:53.841534\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841594\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841629\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841658\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841844\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841946\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.842045\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.842144\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.842177\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:34:53.842246\", \"last_device_update\": \"2020-07-16T15:04:18.042470\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:26:27.974828\"}"}]: dispatch 2020-07-16T15:34:54.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:54 smithi188 bash[23329]: audit 2020-07-16T15:34:53.848622+0000 mon.c (mon.1) 387 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:34:53.841534\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841594\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841629\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841658\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841844\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841946\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.842045\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.842144\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.842177\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:34:53.842246\", \"last_device_update\": \"2020-07-16T15:04:18.042470\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:26:27.974828\"}"}]': finished 2020-07-16T15:34:54.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:54 smithi188 bash[23329]: audit 2020-07-16T15:34:53.849642+0000 mon.b (mon.2) 1227 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T15:34:54.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:54 smithi188 bash[23329]: audit 2020-07-16T15:34:54.465427+0000 mon.b (mon.2) 1228 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.463891\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.463961\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.463992\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464150\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464250\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464376\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464480\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464519\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464553\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:34:54.464656\", \"last_device_update\": \"2020-07-16T15:05:23.895950\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:26:27.978565\"}"}]: dispatch 2020-07-16T15:34:54.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:54 smithi188 bash[23329]: audit 2020-07-16T15:34:54.465913+0000 mon.c (mon.1) 388 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.463891\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.463961\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.463992\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464150\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464250\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464376\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464480\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464519\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464553\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:34:54.464656\", \"last_device_update\": \"2020-07-16T15:05:23.895950\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:26:27.978565\"}"}]: dispatch 2020-07-16T15:34:54.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:54 smithi188 bash[23329]: audit 2020-07-16T15:34:54.468588+0000 mon.c (mon.1) 389 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.463891\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.463961\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.463992\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464150\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464250\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464376\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464480\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464519\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464553\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:34:54.464656\", \"last_device_update\": \"2020-07-16T15:05:23.895950\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:26:27.978565\"}"}]': finished 2020-07-16T15:34:55.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:55 smithi132 bash[27079]: cluster 2020-07-16T15:34:55.053978+0000 mgr.x (mgr.34562) 5587 : cluster [DBG] pgmap v3487: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:34:55.926 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:55 smithi188 bash[23329]: cluster 2020-07-16T15:34:55.053978+0000 mgr.x (mgr.34562) 5587 : cluster [DBG] pgmap v3487: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:34:57.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:56 smithi132 bash[27079]: audit 2020-07-16T15:34:56.635172+0000 mon.b (mon.2) 1229 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T15:34:57.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:56 smithi188 bash[23329]: audit 2020-07-16T15:34:56.635172+0000 mon.b (mon.2) 1229 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T15:34:58.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:57 smithi132 bash[27079]: audit 2020-07-16T15:34:56.841834+0000 mon.b (mon.2) 1230 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:34:53.841534\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841594\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841629\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841658\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841844\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841946\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.842045\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.842144\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.842177\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:34:53.842246\", \"last_device_update\": \"2020-07-16T15:34:56.840832\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:26:27.974828\"}"}]: dispatch 2020-07-16T15:34:58.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:57 smithi132 bash[27079]: audit 2020-07-16T15:34:56.842376+0000 mon.c (mon.1) 390 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:34:53.841534\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841594\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841629\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841658\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841844\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841946\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.842045\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.842144\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.842177\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:34:53.842246\", \"last_device_update\": \"2020-07-16T15:34:56.840832\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:26:27.974828\"}"}]: dispatch 2020-07-16T15:34:58.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:57 smithi132 bash[27079]: audit 2020-07-16T15:34:56.845197+0000 mon.c (mon.1) 391 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:34:53.841534\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841594\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841629\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841658\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841844\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841946\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.842045\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.842144\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.842177\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:34:53.842246\", \"last_device_update\": \"2020-07-16T15:34:56.840832\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:26:27.974828\"}"}]': finished 2020-07-16T15:34:58.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:57 smithi132 bash[27079]: audit 2020-07-16T15:34:56.850856+0000 mon.b (mon.2) 1231 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:34:58.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:57 smithi132 bash[27079]: audit 2020-07-16T15:34:56.851199+0000 mgr.x (mgr.34562) 5588 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:34:58.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:57 smithi132 bash[27079]: audit 2020-07-16T15:34:56.852224+0000 mon.b (mon.2) 1232 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:34:58.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:57 smithi132 bash[27079]: audit 2020-07-16T15:34:56.852553+0000 mgr.x (mgr.34562) 5589 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:34:58.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:57 smithi132 bash[27079]: audit 2020-07-16T15:34:56.853395+0000 mon.b (mon.2) 1233 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:34:58.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:57 smithi132 bash[27079]: audit 2020-07-16T15:34:56.853650+0000 mgr.x (mgr.34562) 5590 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:34:58.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:57 smithi132 bash[27079]: cephadm 2020-07-16T15:34:56.854305+0000 mgr.x (mgr.34562) 5591 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:34:58.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:57 smithi132 bash[27079]: audit 2020-07-16T15:34:56.854794+0000 mon.b (mon.2) 1234 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:34:58.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:57 smithi132 bash[27079]: cephadm 2020-07-16T15:34:56.855726+0000 mgr.x (mgr.34562) 5592 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:34:58.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:57 smithi132 bash[27079]: audit 2020-07-16T15:34:56.856183+0000 mon.b (mon.2) 1235 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:34:58.033 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:57 smithi132 bash[27079]: cephadm 2020-07-16T15:34:56.856858+0000 mgr.x (mgr.34562) 5593 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:34:58.033 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:57 smithi132 bash[27079]: cephadm 2020-07-16T15:34:56.857109+0000 mgr.x (mgr.34562) 5594 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:34:58.033 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:57 smithi132 bash[27079]: cluster 2020-07-16T15:34:57.054418+0000 mgr.x (mgr.34562) 5595 : cluster [DBG] pgmap v3488: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:34:58.072 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:57 smithi188 bash[23329]: audit 2020-07-16T15:34:56.841834+0000 mon.b (mon.2) 1230 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:34:53.841534\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841594\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841629\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841658\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841844\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841946\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.842045\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.842144\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.842177\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:34:53.842246\", \"last_device_update\": \"2020-07-16T15:34:56.840832\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:26:27.974828\"}"}]: dispatch 2020-07-16T15:34:58.073 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:57 smithi188 bash[23329]: audit 2020-07-16T15:34:56.842376+0000 mon.c (mon.1) 390 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:34:53.841534\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841594\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841629\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841658\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841844\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841946\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.842045\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.842144\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.842177\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:34:53.842246\", \"last_device_update\": \"2020-07-16T15:34:56.840832\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:26:27.974828\"}"}]: dispatch 2020-07-16T15:34:58.073 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:57 smithi188 bash[23329]: audit 2020-07-16T15:34:56.845197+0000 mon.c (mon.1) 391 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:34:53.841534\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841594\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841629\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841658\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841844\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841946\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.842045\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.842144\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.842177\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:34:53.842246\", \"last_device_update\": \"2020-07-16T15:34:56.840832\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:26:27.974828\"}"}]': finished 2020-07-16T15:34:58.073 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:57 smithi188 bash[23329]: audit 2020-07-16T15:34:56.850856+0000 mon.b (mon.2) 1231 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:34:58.074 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:57 smithi188 bash[23329]: audit 2020-07-16T15:34:56.851199+0000 mgr.x (mgr.34562) 5588 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:34:58.074 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:57 smithi188 bash[23329]: audit 2020-07-16T15:34:56.852224+0000 mon.b (mon.2) 1232 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:34:58.074 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:57 smithi188 bash[23329]: audit 2020-07-16T15:34:56.852553+0000 mgr.x (mgr.34562) 5589 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:34:58.074 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:57 smithi188 bash[23329]: audit 2020-07-16T15:34:56.853395+0000 mon.b (mon.2) 1233 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:34:58.074 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:57 smithi188 bash[23329]: audit 2020-07-16T15:34:56.853650+0000 mgr.x (mgr.34562) 5590 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:34:58.075 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:57 smithi188 bash[23329]: cephadm 2020-07-16T15:34:56.854305+0000 mgr.x (mgr.34562) 5591 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:34:58.075 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:57 smithi188 bash[23329]: audit 2020-07-16T15:34:56.854794+0000 mon.b (mon.2) 1234 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:34:58.075 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:57 smithi188 bash[23329]: cephadm 2020-07-16T15:34:56.855726+0000 mgr.x (mgr.34562) 5592 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:34:58.075 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:57 smithi188 bash[23329]: audit 2020-07-16T15:34:56.856183+0000 mon.b (mon.2) 1235 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:34:58.075 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:57 smithi188 bash[23329]: cephadm 2020-07-16T15:34:56.856858+0000 mgr.x (mgr.34562) 5593 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:34:58.076 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:57 smithi188 bash[23329]: cephadm 2020-07-16T15:34:56.857109+0000 mgr.x (mgr.34562) 5594 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:34:58.076 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:57 smithi188 bash[23329]: cluster 2020-07-16T15:34:57.054418+0000 mgr.x (mgr.34562) 5595 : cluster [DBG] pgmap v3488: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:34:59.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:34:59 smithi132 bash[27079]: cluster 2020-07-16T15:34:59.054898+0000 mgr.x (mgr.34562) 5596 : cluster [DBG] pgmap v3489: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:34:59.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:34:59 smithi188 bash[23329]: cluster 2020-07-16T15:34:59.054898+0000 mgr.x (mgr.34562) 5596 : cluster [DBG] pgmap v3489: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:35:00.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:35:00 smithi188 bash[23329]: audit 2020-07-16T15:34:59.602464+0000 mon.b (mon.2) 1236 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:35:00.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:35:00 smithi188 bash[23329]: cephadm 2020-07-16T15:34:59.603182+0000 mgr.x (mgr.34562) 5597 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:35:00.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:35:00 smithi188 bash[23329]: cephadm 2020-07-16T15:34:59.603599+0000 mgr.x (mgr.34562) 5598 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:35:00.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:35:00 smithi132 bash[27079]: audit 2020-07-16T15:34:59.602464+0000 mon.b (mon.2) 1236 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:35:00.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:35:00 smithi132 bash[27079]: cephadm 2020-07-16T15:34:59.603182+0000 mgr.x (mgr.34562) 5597 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:35:00.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:35:00 smithi132 bash[27079]: cephadm 2020-07-16T15:34:59.603599+0000 mgr.x (mgr.34562) 5598 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:35:01.604 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:35:01.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:35:01 smithi132 bash[27079]: cluster 2020-07-16T15:35:01.055410+0000 mgr.x (mgr.34562) 5599 : cluster [DBG] pgmap v3490: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:35:01.867 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:35:01.867 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (117m) 8s ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:35:01.868 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 7s ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:35:01.868 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (118m) 7s ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:35:01.868 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (117m) 8s ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:35:01.868 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 8s ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:35:01.868 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 7s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:35:01.869 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 8s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:35:01.869 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 8s ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:35:01.869 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 7s ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:35:01.869 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 8s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:35:01.869 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 8s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:35:01.870 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 8s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:35:01.870 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 8s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:35:01.870 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 7s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:35:01.870 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 7s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:35:01.871 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 7s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:35:01.871 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 7s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:35:01.871 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 7s ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:35:01.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:35:01 smithi188 bash[23329]: cluster 2020-07-16T15:35:01.055410+0000 mgr.x (mgr.34562) 5599 : cluster [DBG] pgmap v3490: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:35:02.163 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:35:02.164 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:35:02.164 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:35:02.165 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:35:02.166 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:35:02.168 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:35:02.168 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:35:02.168 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:35:02.169 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:35:02.169 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:35:02.169 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:35:02.169 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:35:02.170 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:35:02.170 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:35:02.171 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:35:02.173 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:35:02.173 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:35:02.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:35:02 smithi132 bash[27079]: audit 2020-07-16T15:35:01.592678+0000 mgr.x (mgr.34562) 5600 : audit [DBG] from='client.28708 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:35:02.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:35:02 smithi132 bash[27079]: audit 2020-07-16T15:35:01.863219+0000 mgr.x (mgr.34562) 5601 : audit [DBG] from='client.28714 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:35:02.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:35:02 smithi132 bash[27079]: audit 2020-07-16T15:35:02.162444+0000 mon.c (mon.1) 392 : audit [DBG] from='client.? 172.21.15.132:0/2668932183' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:35:02.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:35:02 smithi188 bash[23329]: audit 2020-07-16T15:35:01.592678+0000 mgr.x (mgr.34562) 5600 : audit [DBG] from='client.28708 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:35:02.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:35:02 smithi188 bash[23329]: audit 2020-07-16T15:35:01.863219+0000 mgr.x (mgr.34562) 5601 : audit [DBG] from='client.28714 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:35:02.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:35:02 smithi188 bash[23329]: audit 2020-07-16T15:35:02.162444+0000 mon.c (mon.1) 392 : audit [DBG] from='client.? 172.21.15.132:0/2668932183' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:35:03.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:35:03 smithi132 bash[27079]: cluster 2020-07-16T15:35:03.055939+0000 mgr.x (mgr.34562) 5602 : cluster [DBG] pgmap v3491: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:35:03.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:35:03 smithi188 bash[23329]: cluster 2020-07-16T15:35:03.055939+0000 mgr.x (mgr.34562) 5602 : cluster [DBG] pgmap v3491: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:35:05.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:35:05 smithi188 bash[23329]: cluster 2020-07-16T15:35:05.056503+0000 mgr.x (mgr.34562) 5603 : cluster [DBG] pgmap v3492: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:35:05.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:35:05 smithi132 bash[27079]: cluster 2020-07-16T15:35:05.056503+0000 mgr.x (mgr.34562) 5603 : cluster [DBG] pgmap v3492: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:35:07.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:35:07 smithi188 bash[23329]: cluster 2020-07-16T15:35:07.057039+0000 mgr.x (mgr.34562) 5604 : cluster [DBG] pgmap v3493: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:35:07.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:35:07 smithi132 bash[27079]: cluster 2020-07-16T15:35:07.057039+0000 mgr.x (mgr.34562) 5604 : cluster [DBG] pgmap v3493: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:35:09.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:35:09 smithi188 bash[23329]: cluster 2020-07-16T15:35:09.057563+0000 mgr.x (mgr.34562) 5605 : cluster [DBG] pgmap v3494: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:35:09.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:35:09 smithi132 bash[27079]: cluster 2020-07-16T15:35:09.057563+0000 mgr.x (mgr.34562) 5605 : cluster [DBG] pgmap v3494: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:35:11.786 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:35:11 smithi132 bash[27079]: cluster 2020-07-16T15:35:11.058065+0000 mgr.x (mgr.34562) 5606 : cluster [DBG] pgmap v3495: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:35:11.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:35:11 smithi188 bash[23329]: cluster 2020-07-16T15:35:11.058065+0000 mgr.x (mgr.34562) 5606 : cluster [DBG] pgmap v3495: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:35:13.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:35:13 smithi188 bash[23329]: cluster 2020-07-16T15:35:13.058480+0000 mgr.x (mgr.34562) 5607 : cluster [DBG] pgmap v3496: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:35:13.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:35:13 smithi132 bash[27079]: cluster 2020-07-16T15:35:13.058480+0000 mgr.x (mgr.34562) 5607 : cluster [DBG] pgmap v3496: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:35:15.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:35:14 smithi132 bash[27079]: audit 2020-07-16T15:35:14.619085+0000 mon.b (mon.2) 1237 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:35:15.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:35:14 smithi188 bash[23329]: audit 2020-07-16T15:35:14.619085+0000 mon.b (mon.2) 1237 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:35:16.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:35:15 smithi132 bash[27079]: cephadm 2020-07-16T15:35:14.619858+0000 mgr.x (mgr.34562) 5608 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:35:16.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:35:15 smithi132 bash[27079]: cephadm 2020-07-16T15:35:14.619965+0000 mgr.x (mgr.34562) 5609 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:35:16.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:35:15 smithi132 bash[27079]: cluster 2020-07-16T15:35:15.058993+0000 mgr.x (mgr.34562) 5610 : cluster [DBG] pgmap v3497: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:35:16.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:35:15 smithi188 bash[23329]: cephadm 2020-07-16T15:35:14.619858+0000 mgr.x (mgr.34562) 5608 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:35:16.175 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:35:15 smithi188 bash[23329]: cephadm 2020-07-16T15:35:14.619965+0000 mgr.x (mgr.34562) 5609 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:35:16.175 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:35:15 smithi188 bash[23329]: cluster 2020-07-16T15:35:15.058993+0000 mgr.x (mgr.34562) 5610 : cluster [DBG] pgmap v3497: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:35:17.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:35:17 smithi188 bash[23329]: cluster 2020-07-16T15:35:17.059468+0000 mgr.x (mgr.34562) 5611 : cluster [DBG] pgmap v3498: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:35:17.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:35:17 smithi132 bash[27079]: cluster 2020-07-16T15:35:17.059468+0000 mgr.x (mgr.34562) 5611 : cluster [DBG] pgmap v3498: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:35:19.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:35:19 smithi188 bash[23329]: cluster 2020-07-16T15:35:19.059950+0000 mgr.x (mgr.34562) 5612 : cluster [DBG] pgmap v3499: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:35:19.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:35:19 smithi132 bash[27079]: cluster 2020-07-16T15:35:19.059950+0000 mgr.x (mgr.34562) 5612 : cluster [DBG] pgmap v3499: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:35:21.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:35:21 smithi132 bash[27079]: cluster 2020-07-16T15:35:21.060461+0000 mgr.x (mgr.34562) 5613 : cluster [DBG] pgmap v3500: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:35:21.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:35:21 smithi188 bash[23329]: cluster 2020-07-16T15:35:21.060461+0000 mgr.x (mgr.34562) 5613 : cluster [DBG] pgmap v3500: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:35:23.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:35:23 smithi188 bash[23329]: cluster 2020-07-16T15:35:23.060996+0000 mgr.x (mgr.34562) 5614 : cluster [DBG] pgmap v3501: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:35:23.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:35:23 smithi132 bash[27079]: cluster 2020-07-16T15:35:23.060996+0000 mgr.x (mgr.34562) 5614 : cluster [DBG] pgmap v3501: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:35:25.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:35:25 smithi188 bash[23329]: cluster 2020-07-16T15:35:25.061465+0000 mgr.x (mgr.34562) 5615 : cluster [DBG] pgmap v3502: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:35:25.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:35:25 smithi132 bash[27079]: cluster 2020-07-16T15:35:25.061465+0000 mgr.x (mgr.34562) 5615 : cluster [DBG] pgmap v3502: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:35:27.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:35:27 smithi188 bash[23329]: cluster 2020-07-16T15:35:27.061982+0000 mgr.x (mgr.34562) 5616 : cluster [DBG] pgmap v3503: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:35:27.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:35:27 smithi132 bash[27079]: cluster 2020-07-16T15:35:27.061982+0000 mgr.x (mgr.34562) 5616 : cluster [DBG] pgmap v3503: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:35:29.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:35:29 smithi188 bash[23329]: cluster 2020-07-16T15:35:29.062393+0000 mgr.x (mgr.34562) 5617 : cluster [DBG] pgmap v3504: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:35:29.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:35:29 smithi132 bash[27079]: cluster 2020-07-16T15:35:29.062393+0000 mgr.x (mgr.34562) 5617 : cluster [DBG] pgmap v3504: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:35:30.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:35:30 smithi188 bash[23329]: audit 2020-07-16T15:35:29.635647+0000 mon.b (mon.2) 1238 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:35:30.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:35:30 smithi188 bash[23329]: cephadm 2020-07-16T15:35:29.636356+0000 mgr.x (mgr.34562) 5618 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:35:30.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:35:30 smithi188 bash[23329]: cephadm 2020-07-16T15:35:29.636752+0000 mgr.x (mgr.34562) 5619 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:35:30.534 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:35:30 smithi132 bash[27079]: audit 2020-07-16T15:35:29.635647+0000 mon.b (mon.2) 1238 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:35:30.535 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:35:30 smithi132 bash[27079]: cephadm 2020-07-16T15:35:29.636356+0000 mgr.x (mgr.34562) 5618 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:35:30.535 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:35:30 smithi132 bash[27079]: cephadm 2020-07-16T15:35:29.636752+0000 mgr.x (mgr.34562) 5619 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:35:31.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:35:31 smithi132 bash[27079]: cluster 2020-07-16T15:35:31.062824+0000 mgr.x (mgr.34562) 5620 : cluster [DBG] pgmap v3505: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:35:31.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:35:31 smithi188 bash[23329]: cluster 2020-07-16T15:35:31.062824+0000 mgr.x (mgr.34562) 5620 : cluster [DBG] pgmap v3505: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:35:32.462 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:35:32.724 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:35:32.724 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (118m) 38s ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:35:32.725 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 38s ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:35:32.725 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (118m) 38s ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:35:32.725 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (118m) 38s ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:35:32.725 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 38s ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:35:32.725 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 38s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:35:32.726 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 38s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:35:32.726 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 38s ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:35:32.726 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 38s ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:35:32.726 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 38s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:35:32.726 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 38s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:35:32.727 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 38s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:35:32.727 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 38s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:35:32.727 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 38s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:35:32.727 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 38s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:35:32.727 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 38s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:35:32.727 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 38s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:35:32.728 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 38s ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:35:33.017 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:35:33.017 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:35:33.018 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:35:33.018 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:35:33.018 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:35:33.018 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:35:33.018 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:35:33.019 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:35:33.019 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:35:33.019 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:35:33.019 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:35:33.019 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:35:33.020 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:35:33.020 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:35:33.020 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:35:33.020 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:35:33.020 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:35:33.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:35:33 smithi188 bash[23329]: audit 2020-07-16T15:35:33.016525+0000 mon.c (mon.1) 393 : audit [DBG] from='client.? 172.21.15.132:0/1327933589' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:35:33.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:35:33 smithi132 bash[27079]: audit 2020-07-16T15:35:33.016525+0000 mon.c (mon.1) 393 : audit [DBG] from='client.? 172.21.15.132:0/1327933589' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:35:34.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:35:34 smithi188 bash[23329]: audit 2020-07-16T15:35:32.450516+0000 mgr.x (mgr.34562) 5621 : audit [DBG] from='client.28726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:35:34.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:35:34 smithi188 bash[23329]: audit 2020-07-16T15:35:32.719273+0000 mgr.x (mgr.34562) 5622 : audit [DBG] from='client.28732 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:35:34.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:35:34 smithi188 bash[23329]: cluster 2020-07-16T15:35:33.063360+0000 mgr.x (mgr.34562) 5623 : cluster [DBG] pgmap v3506: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:35:34.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:35:34 smithi132 bash[27079]: audit 2020-07-16T15:35:32.450516+0000 mgr.x (mgr.34562) 5621 : audit [DBG] from='client.28726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:35:34.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:35:34 smithi132 bash[27079]: audit 2020-07-16T15:35:32.719273+0000 mgr.x (mgr.34562) 5622 : audit [DBG] from='client.28732 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:35:34.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:35:34 smithi132 bash[27079]: cluster 2020-07-16T15:35:33.063360+0000 mgr.x (mgr.34562) 5623 : cluster [DBG] pgmap v3506: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:35:35.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:35:35 smithi188 bash[23329]: cluster 2020-07-16T15:35:35.063739+0000 mgr.x (mgr.34562) 5624 : cluster [DBG] pgmap v3507: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:35:35.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:35:35 smithi132 bash[27079]: cluster 2020-07-16T15:35:35.063739+0000 mgr.x (mgr.34562) 5624 : cluster [DBG] pgmap v3507: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:35:37.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:35:37 smithi188 bash[23329]: cluster 2020-07-16T15:35:37.064162+0000 mgr.x (mgr.34562) 5625 : cluster [DBG] pgmap v3508: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:35:37.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:35:37 smithi132 bash[27079]: cluster 2020-07-16T15:35:37.064162+0000 mgr.x (mgr.34562) 5625 : cluster [DBG] pgmap v3508: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:35:39.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:35:39 smithi188 bash[23329]: cluster 2020-07-16T15:35:39.064525+0000 mgr.x (mgr.34562) 5626 : cluster [DBG] pgmap v3509: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:35:39.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:35:39 smithi132 bash[27079]: cluster 2020-07-16T15:35:39.064525+0000 mgr.x (mgr.34562) 5626 : cluster [DBG] pgmap v3509: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:35:41.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:35:41 smithi132 bash[27079]: cluster 2020-07-16T15:35:41.064912+0000 mgr.x (mgr.34562) 5627 : cluster [DBG] pgmap v3510: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:35:41.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:35:41 smithi188 bash[23329]: cluster 2020-07-16T15:35:41.064912+0000 mgr.x (mgr.34562) 5627 : cluster [DBG] pgmap v3510: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:35:43.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:35:43 smithi188 bash[23329]: cluster 2020-07-16T15:35:43.065466+0000 mgr.x (mgr.34562) 5628 : cluster [DBG] pgmap v3511: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:35:43.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:35:43 smithi132 bash[27079]: cluster 2020-07-16T15:35:43.065466+0000 mgr.x (mgr.34562) 5628 : cluster [DBG] pgmap v3511: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:35:45.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:35:44 smithi132 bash[27079]: audit 2020-07-16T15:35:44.652334+0000 mon.b (mon.2) 1239 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:35:45.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:35:44 smithi188 bash[23329]: audit 2020-07-16T15:35:44.652334+0000 mon.b (mon.2) 1239 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:35:46.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:35:45 smithi132 bash[27079]: cephadm 2020-07-16T15:35:44.653067+0000 mgr.x (mgr.34562) 5629 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:35:46.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:35:45 smithi132 bash[27079]: cephadm 2020-07-16T15:35:44.653475+0000 mgr.x (mgr.34562) 5630 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:35:46.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:35:45 smithi132 bash[27079]: cluster 2020-07-16T15:35:45.065963+0000 mgr.x (mgr.34562) 5631 : cluster [DBG] pgmap v3512: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:35:46.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:35:45 smithi188 bash[23329]: cephadm 2020-07-16T15:35:44.653067+0000 mgr.x (mgr.34562) 5629 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:35:46.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:35:45 smithi188 bash[23329]: cephadm 2020-07-16T15:35:44.653475+0000 mgr.x (mgr.34562) 5630 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:35:46.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:35:45 smithi188 bash[23329]: cluster 2020-07-16T15:35:45.065963+0000 mgr.x (mgr.34562) 5631 : cluster [DBG] pgmap v3512: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:35:47.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:35:47 smithi188 bash[23329]: cluster 2020-07-16T15:35:47.066571+0000 mgr.x (mgr.34562) 5632 : cluster [DBG] pgmap v3513: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:35:47.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:35:47 smithi132 bash[27079]: cluster 2020-07-16T15:35:47.066571+0000 mgr.x (mgr.34562) 5632 : cluster [DBG] pgmap v3513: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:35:49.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:35:49 smithi188 bash[23329]: cluster 2020-07-16T15:35:49.067046+0000 mgr.x (mgr.34562) 5633 : cluster [DBG] pgmap v3514: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:35:49.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:35:49 smithi132 bash[27079]: cluster 2020-07-16T15:35:49.067046+0000 mgr.x (mgr.34562) 5633 : cluster [DBG] pgmap v3514: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:35:51.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:35:51 smithi132 bash[27079]: cluster 2020-07-16T15:35:51.067560+0000 mgr.x (mgr.34562) 5634 : cluster [DBG] pgmap v3515: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:35:51.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:35:51 smithi188 bash[23329]: cluster 2020-07-16T15:35:51.067560+0000 mgr.x (mgr.34562) 5634 : cluster [DBG] pgmap v3515: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:35:53.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:35:53 smithi188 bash[23329]: cluster 2020-07-16T15:35:53.068101+0000 mgr.x (mgr.34562) 5635 : cluster [DBG] pgmap v3516: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:35:53.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:35:53 smithi132 bash[27079]: cluster 2020-07-16T15:35:53.068101+0000 mgr.x (mgr.34562) 5635 : cluster [DBG] pgmap v3516: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:35:55.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:35:55 smithi188 bash[23329]: cluster 2020-07-16T15:35:55.068560+0000 mgr.x (mgr.34562) 5636 : cluster [DBG] pgmap v3517: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:35:55.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:35:55 smithi132 bash[27079]: cluster 2020-07-16T15:35:55.068560+0000 mgr.x (mgr.34562) 5636 : cluster [DBG] pgmap v3517: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:35:57.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:35:57 smithi188 bash[23329]: cluster 2020-07-16T15:35:57.068925+0000 mgr.x (mgr.34562) 5637 : cluster [DBG] pgmap v3518: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:35:57.534 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:35:57 smithi132 bash[27079]: cluster 2020-07-16T15:35:57.068925+0000 mgr.x (mgr.34562) 5637 : cluster [DBG] pgmap v3518: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:35:59.425 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:35:59 smithi188 bash[23329]: cluster 2020-07-16T15:35:59.069317+0000 mgr.x (mgr.34562) 5638 : cluster [DBG] pgmap v3519: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:35:59.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:35:59 smithi132 bash[27079]: cluster 2020-07-16T15:35:59.069317+0000 mgr.x (mgr.34562) 5638 : cluster [DBG] pgmap v3519: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:36:00.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:00 smithi188 bash[23329]: audit 2020-07-16T15:35:59.669737+0000 mon.b (mon.2) 1240 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T15:36:00.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:00 smithi132 bash[27079]: audit 2020-07-16T15:35:59.669737+0000 mon.b (mon.2) 1240 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T15:36:01.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:01 smithi132 bash[27079]: cluster 2020-07-16T15:36:01.069612+0000 mgr.x (mgr.34562) 5639 : cluster [DBG] pgmap v3520: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:36:01.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:01 smithi188 bash[23329]: cluster 2020-07-16T15:36:01.069612+0000 mgr.x (mgr.34562) 5639 : cluster [DBG] pgmap v3520: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:36:02.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:02 smithi188 bash[23329]: audit 2020-07-16T15:36:02.405000+0000 mon.b (mon.2) 1241 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T15:36:02.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:02 smithi132 bash[27079]: audit 2020-07-16T15:36:02.405000+0000 mon.b (mon.2) 1241 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T15:36:03.313 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:36:03.599 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:36:03.599 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (118m) 69s ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:36:03.599 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 69s ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:36:03.600 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (119m) 69s ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:36:03.600 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (118m) 69s ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:36:03.600 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 69s ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:36:03.600 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 69s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:36:03.600 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 69s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:36:03.600 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 69s ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:36:03.601 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 69s ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:36:03.601 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 69s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:36:03.601 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 69s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:36:03.601 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 69s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:36:03.601 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 69s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:36:03.602 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 69s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:36:03.602 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 69s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:36:03.602 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 69s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:36:03.602 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 69s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:36:03.602 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 69s ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:36:03.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:03 smithi132 bash[27079]: audit 2020-07-16T15:36:02.607563+0000 mon.b (mon.2) 1242 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.463891\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.463961\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.463992\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464150\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464250\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464376\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464480\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464519\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464553\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:34:54.464656\", \"last_device_update\": \"2020-07-16T15:36:02.606623\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:26:27.978565\"}"}]: dispatch 2020-07-16T15:36:03.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:03 smithi132 bash[27079]: audit 2020-07-16T15:36:02.608265+0000 mon.c (mon.1) 394 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.463891\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.463961\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.463992\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464150\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464250\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464376\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464480\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464519\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464553\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:34:54.464656\", \"last_device_update\": \"2020-07-16T15:36:02.606623\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:26:27.978565\"}"}]: dispatch 2020-07-16T15:36:03.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:03 smithi132 bash[27079]: audit 2020-07-16T15:36:02.610942+0000 mon.c (mon.1) 395 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.463891\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.463961\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.463992\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464150\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464250\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464376\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464480\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464519\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464553\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:34:54.464656\", \"last_device_update\": \"2020-07-16T15:36:02.606623\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:26:27.978565\"}"}]': finished 2020-07-16T15:36:03.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:03 smithi132 bash[27079]: audit 2020-07-16T15:36:02.613930+0000 mon.b (mon.2) 1243 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:36:03.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:03 smithi132 bash[27079]: audit 2020-07-16T15:36:02.614268+0000 mgr.x (mgr.34562) 5640 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:36:03.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:03 smithi132 bash[27079]: audit 2020-07-16T15:36:02.614955+0000 mon.b (mon.2) 1244 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:36:03.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:03 smithi132 bash[27079]: audit 2020-07-16T15:36:02.615185+0000 mgr.x (mgr.34562) 5641 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:36:03.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:03 smithi132 bash[27079]: audit 2020-07-16T15:36:02.615793+0000 mon.b (mon.2) 1245 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:36:03.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:03 smithi132 bash[27079]: audit 2020-07-16T15:36:02.616006+0000 mgr.x (mgr.34562) 5642 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:36:03.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:03 smithi132 bash[27079]: cephadm 2020-07-16T15:36:02.616533+0000 mgr.x (mgr.34562) 5643 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:36:03.783 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:03 smithi132 bash[27079]: audit 2020-07-16T15:36:02.616712+0000 mon.b (mon.2) 1246 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:36:03.783 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:03 smithi132 bash[27079]: cephadm 2020-07-16T15:36:02.617343+0000 mgr.x (mgr.34562) 5644 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:36:03.783 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:03 smithi132 bash[27079]: audit 2020-07-16T15:36:02.617685+0000 mon.b (mon.2) 1247 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:36:03.784 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:03 smithi132 bash[27079]: cephadm 2020-07-16T15:36:02.618180+0000 mgr.x (mgr.34562) 5645 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:36:03.784 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:03 smithi132 bash[27079]: cephadm 2020-07-16T15:36:02.618341+0000 mgr.x (mgr.34562) 5646 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:36:03.784 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:03 smithi132 bash[27079]: cluster 2020-07-16T15:36:03.070176+0000 mgr.x (mgr.34562) 5647 : cluster [DBG] pgmap v3521: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:36:03.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:03 smithi188 bash[23329]: audit 2020-07-16T15:36:02.607563+0000 mon.b (mon.2) 1242 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.463891\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.463961\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.463992\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464150\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464250\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464376\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464480\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464519\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464553\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:34:54.464656\", \"last_device_update\": \"2020-07-16T15:36:02.606623\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:26:27.978565\"}"}]: dispatch 2020-07-16T15:36:03.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:03 smithi188 bash[23329]: audit 2020-07-16T15:36:02.608265+0000 mon.c (mon.1) 394 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.463891\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.463961\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.463992\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464150\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464250\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464376\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464480\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464519\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464553\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:34:54.464656\", \"last_device_update\": \"2020-07-16T15:36:02.606623\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:26:27.978565\"}"}]: dispatch 2020-07-16T15:36:03.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:03 smithi188 bash[23329]: audit 2020-07-16T15:36:02.610942+0000 mon.c (mon.1) 395 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.463891\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.463961\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.463992\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464150\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464250\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464376\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464480\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464519\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464553\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:34:54.464656\", \"last_device_update\": \"2020-07-16T15:36:02.606623\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:26:27.978565\"}"}]': finished 2020-07-16T15:36:03.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:03 smithi188 bash[23329]: audit 2020-07-16T15:36:02.613930+0000 mon.b (mon.2) 1243 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:36:03.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:03 smithi188 bash[23329]: audit 2020-07-16T15:36:02.614268+0000 mgr.x (mgr.34562) 5640 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:36:03.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:03 smithi188 bash[23329]: audit 2020-07-16T15:36:02.614955+0000 mon.b (mon.2) 1244 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:36:03.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:03 smithi188 bash[23329]: audit 2020-07-16T15:36:02.615185+0000 mgr.x (mgr.34562) 5641 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:36:03.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:03 smithi188 bash[23329]: audit 2020-07-16T15:36:02.615793+0000 mon.b (mon.2) 1245 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:36:03.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:03 smithi188 bash[23329]: audit 2020-07-16T15:36:02.616006+0000 mgr.x (mgr.34562) 5642 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:36:03.925 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:03 smithi188 bash[23329]: cephadm 2020-07-16T15:36:02.616533+0000 mgr.x (mgr.34562) 5643 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:36:03.925 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:03 smithi188 bash[23329]: audit 2020-07-16T15:36:02.616712+0000 mon.b (mon.2) 1246 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:36:03.925 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:03 smithi188 bash[23329]: cephadm 2020-07-16T15:36:02.617343+0000 mgr.x (mgr.34562) 5644 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:36:03.925 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:03 smithi188 bash[23329]: audit 2020-07-16T15:36:02.617685+0000 mon.b (mon.2) 1247 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:36:03.925 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:03 smithi188 bash[23329]: cephadm 2020-07-16T15:36:02.618180+0000 mgr.x (mgr.34562) 5645 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:36:03.926 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:03 smithi188 bash[23329]: cephadm 2020-07-16T15:36:02.618341+0000 mgr.x (mgr.34562) 5646 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:36:03.926 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:03 smithi188 bash[23329]: cluster 2020-07-16T15:36:03.070176+0000 mgr.x (mgr.34562) 5647 : cluster [DBG] pgmap v3521: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:36:03.926 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:36:03.927 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:36:03.927 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:36:03.927 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:36:03.928 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:36:03.928 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:36:03.928 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:36:03.928 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:36:03.928 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:36:03.929 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:36:03.929 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:36:03.929 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:36:03.929 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:36:03.929 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:36:03.930 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:36:03.930 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:36:03.930 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:36:04.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:04 smithi188 bash[23329]: audit 2020-07-16T15:36:03.299125+0000 mgr.x (mgr.34562) 5648 : audit [DBG] from='client.28744 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:36:04.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:04 smithi188 bash[23329]: audit 2020-07-16T15:36:03.593659+0000 mgr.x (mgr.34562) 5649 : audit [DBG] from='client.28750 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:36:04.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:04 smithi188 bash[23329]: audit 2020-07-16T15:36:03.925528+0000 mon.c (mon.1) 396 : audit [DBG] from='client.? 172.21.15.132:0/1852250048' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:36:05.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:04 smithi132 bash[27079]: audit 2020-07-16T15:36:03.299125+0000 mgr.x (mgr.34562) 5648 : audit [DBG] from='client.28744 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:36:05.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:04 smithi132 bash[27079]: audit 2020-07-16T15:36:03.593659+0000 mgr.x (mgr.34562) 5649 : audit [DBG] from='client.28750 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:36:05.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:04 smithi132 bash[27079]: audit 2020-07-16T15:36:03.925528+0000 mon.c (mon.1) 396 : audit [DBG] from='client.? 172.21.15.132:0/1852250048' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:36:05.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:05 smithi188 bash[23329]: cluster 2020-07-16T15:36:05.070649+0000 mgr.x (mgr.34562) 5650 : cluster [DBG] pgmap v3522: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:36:06.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:05 smithi132 bash[27079]: cluster 2020-07-16T15:36:05.070649+0000 mgr.x (mgr.34562) 5650 : cluster [DBG] pgmap v3522: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:36:06.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:06 smithi188 bash[23329]: audit 2020-07-16T15:36:05.613538+0000 mon.b (mon.2) 1248 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:36:06.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:06 smithi188 bash[23329]: cephadm 2020-07-16T15:36:05.614205+0000 mgr.x (mgr.34562) 5651 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:36:06.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:06 smithi188 bash[23329]: cephadm 2020-07-16T15:36:05.614645+0000 mgr.x (mgr.34562) 5652 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:36:07.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:06 smithi132 bash[27079]: audit 2020-07-16T15:36:05.613538+0000 mon.b (mon.2) 1248 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:36:07.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:06 smithi132 bash[27079]: cephadm 2020-07-16T15:36:05.614205+0000 mgr.x (mgr.34562) 5651 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:36:07.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:06 smithi132 bash[27079]: cephadm 2020-07-16T15:36:05.614645+0000 mgr.x (mgr.34562) 5652 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:36:07.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:07 smithi188 bash[23329]: cluster 2020-07-16T15:36:07.071093+0000 mgr.x (mgr.34562) 5653 : cluster [DBG] pgmap v3523: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:36:08.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:07 smithi132 bash[27079]: cluster 2020-07-16T15:36:07.071093+0000 mgr.x (mgr.34562) 5653 : cluster [DBG] pgmap v3523: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:36:09.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:09 smithi188 bash[23329]: cluster 2020-07-16T15:36:09.071581+0000 mgr.x (mgr.34562) 5654 : cluster [DBG] pgmap v3524: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:36:09.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:09 smithi132 bash[27079]: cluster 2020-07-16T15:36:09.071581+0000 mgr.x (mgr.34562) 5654 : cluster [DBG] pgmap v3524: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:36:11.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:11 smithi132 bash[27079]: cluster 2020-07-16T15:36:11.072072+0000 mgr.x (mgr.34562) 5655 : cluster [DBG] pgmap v3525: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:36:11.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:11 smithi188 bash[23329]: cluster 2020-07-16T15:36:11.072072+0000 mgr.x (mgr.34562) 5655 : cluster [DBG] pgmap v3525: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:36:13.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:13 smithi188 bash[23329]: cluster 2020-07-16T15:36:13.072540+0000 mgr.x (mgr.34562) 5656 : cluster [DBG] pgmap v3526: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:36:13.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:13 smithi132 bash[27079]: cluster 2020-07-16T15:36:13.072540+0000 mgr.x (mgr.34562) 5656 : cluster [DBG] pgmap v3526: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:36:15.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:15 smithi188 bash[23329]: cluster 2020-07-16T15:36:15.073052+0000 mgr.x (mgr.34562) 5657 : cluster [DBG] pgmap v3527: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:36:15.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:15 smithi132 bash[27079]: cluster 2020-07-16T15:36:15.073052+0000 mgr.x (mgr.34562) 5657 : cluster [DBG] pgmap v3527: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:36:17.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:17 smithi188 bash[23329]: cluster 2020-07-16T15:36:17.073640+0000 mgr.x (mgr.34562) 5658 : cluster [DBG] pgmap v3528: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:36:17.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:17 smithi132 bash[27079]: cluster 2020-07-16T15:36:17.073640+0000 mgr.x (mgr.34562) 5658 : cluster [DBG] pgmap v3528: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:36:19.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:19 smithi188 bash[23329]: cluster 2020-07-16T15:36:19.074148+0000 mgr.x (mgr.34562) 5659 : cluster [DBG] pgmap v3529: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:36:19.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:19 smithi132 bash[27079]: cluster 2020-07-16T15:36:19.074148+0000 mgr.x (mgr.34562) 5659 : cluster [DBG] pgmap v3529: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:36:21.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:21 smithi132 bash[27079]: audit 2020-07-16T15:36:20.616690+0000 mon.b (mon.2) 1249 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:36:21.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:21 smithi132 bash[27079]: cephadm 2020-07-16T15:36:20.617415+0000 mgr.x (mgr.34562) 5660 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:36:21.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:21 smithi132 bash[27079]: cephadm 2020-07-16T15:36:20.617850+0000 mgr.x (mgr.34562) 5661 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:36:21.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:21 smithi132 bash[27079]: cluster 2020-07-16T15:36:21.074611+0000 mgr.x (mgr.34562) 5662 : cluster [DBG] pgmap v3530: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:36:21.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:21 smithi188 bash[23329]: audit 2020-07-16T15:36:20.616690+0000 mon.b (mon.2) 1249 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:36:21.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:21 smithi188 bash[23329]: cephadm 2020-07-16T15:36:20.617415+0000 mgr.x (mgr.34562) 5660 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:36:21.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:21 smithi188 bash[23329]: cephadm 2020-07-16T15:36:20.617850+0000 mgr.x (mgr.34562) 5661 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:36:21.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:21 smithi188 bash[23329]: cluster 2020-07-16T15:36:21.074611+0000 mgr.x (mgr.34562) 5662 : cluster [DBG] pgmap v3530: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:36:24.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:24 smithi188 bash[23329]: cluster 2020-07-16T15:36:23.075137+0000 mgr.x (mgr.34562) 5663 : cluster [DBG] pgmap v3531: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:36:24.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:24 smithi132 bash[27079]: cluster 2020-07-16T15:36:23.075137+0000 mgr.x (mgr.34562) 5663 : cluster [DBG] pgmap v3531: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:36:26.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:26 smithi132 bash[27079]: cluster 2020-07-16T15:36:25.075586+0000 mgr.x (mgr.34562) 5664 : cluster [DBG] pgmap v3532: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:36:26.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:26 smithi188 bash[23329]: cluster 2020-07-16T15:36:25.075586+0000 mgr.x (mgr.34562) 5664 : cluster [DBG] pgmap v3532: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:36:28.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:28 smithi132 bash[27079]: cluster 2020-07-16T15:36:27.075938+0000 mgr.x (mgr.34562) 5665 : cluster [DBG] pgmap v3533: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:36:28.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:28 smithi188 bash[23329]: cluster 2020-07-16T15:36:27.075938+0000 mgr.x (mgr.34562) 5665 : cluster [DBG] pgmap v3533: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:36:30.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:30 smithi188 bash[23329]: cluster 2020-07-16T15:36:29.076388+0000 mgr.x (mgr.34562) 5666 : cluster [DBG] pgmap v3534: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:36:31.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:30 smithi132 bash[27079]: cluster 2020-07-16T15:36:29.076388+0000 mgr.x (mgr.34562) 5666 : cluster [DBG] pgmap v3534: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:36:32.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:32 smithi188 bash[23329]: cluster 2020-07-16T15:36:31.076825+0000 mgr.x (mgr.34562) 5667 : cluster [DBG] pgmap v3535: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:36:33.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:32 smithi132 bash[27079]: cluster 2020-07-16T15:36:31.076825+0000 mgr.x (mgr.34562) 5667 : cluster [DBG] pgmap v3535: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:36:34.224 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:36:34.485 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:36:34.486 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (119m) 100s ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:36:34.486 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 100s ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:36:34.486 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (119m) 100s ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:36:34.486 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (119m) 100s ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:36:34.486 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 100s ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:36:34.487 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 100s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:36:34.487 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 100s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:36:34.487 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 100s ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:36:34.487 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 100s ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:36:34.487 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 100s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:36:34.488 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 100s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:36:34.488 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 100s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:36:34.488 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 100s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:36:34.488 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 100s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:36:34.488 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 100s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:36:34.489 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 100s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:36:34.489 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 100s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:36:34.489 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 100s ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:36:34.800 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:36:34.800 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:36:34.800 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:36:34.801 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:36:34.801 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:36:34.801 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:36:34.801 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:36:34.801 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:36:34.802 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:36:34.802 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:36:34.802 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:36:34.802 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:36:34.802 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:36:34.802 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:36:34.803 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:36:34.803 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:36:34.803 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:36:34.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:34 smithi188 bash[23329]: cluster 2020-07-16T15:36:33.077211+0000 mgr.x (mgr.34562) 5668 : cluster [DBG] pgmap v3536: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:36:35.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:34 smithi132 bash[27079]: cluster 2020-07-16T15:36:33.077211+0000 mgr.x (mgr.34562) 5668 : cluster [DBG] pgmap v3536: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:36:35.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:35 smithi188 bash[23329]: audit 2020-07-16T15:36:34.212674+0000 mgr.x (mgr.34562) 5669 : audit [DBG] from='client.28762 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:36:35.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:35 smithi188 bash[23329]: audit 2020-07-16T15:36:34.479958+0000 mgr.x (mgr.34562) 5670 : audit [DBG] from='client.28768 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:36:35.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:35 smithi188 bash[23329]: audit 2020-07-16T15:36:34.798986+0000 mon.c (mon.1) 397 : audit [DBG] from='client.? 172.21.15.132:0/811728733' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:36:36.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:35 smithi132 bash[27079]: audit 2020-07-16T15:36:34.212674+0000 mgr.x (mgr.34562) 5669 : audit [DBG] from='client.28762 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:36:36.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:35 smithi132 bash[27079]: audit 2020-07-16T15:36:34.479958+0000 mgr.x (mgr.34562) 5670 : audit [DBG] from='client.28768 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:36:36.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:35 smithi132 bash[27079]: audit 2020-07-16T15:36:34.798986+0000 mon.c (mon.1) 397 : audit [DBG] from='client.? 172.21.15.132:0/811728733' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:36:36.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:36 smithi188 bash[23329]: cluster 2020-07-16T15:36:35.077583+0000 mgr.x (mgr.34562) 5671 : cluster [DBG] pgmap v3537: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:36:36.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:36 smithi188 bash[23329]: audit 2020-07-16T15:36:35.633453+0000 mon.b (mon.2) 1250 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:36:36.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:36 smithi188 bash[23329]: cephadm 2020-07-16T15:36:35.634152+0000 mgr.x (mgr.34562) 5672 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:36:36.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:36 smithi188 bash[23329]: cephadm 2020-07-16T15:36:35.634588+0000 mgr.x (mgr.34562) 5673 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:36:37.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:36 smithi132 bash[27079]: cluster 2020-07-16T15:36:35.077583+0000 mgr.x (mgr.34562) 5671 : cluster [DBG] pgmap v3537: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:36:37.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:36 smithi132 bash[27079]: audit 2020-07-16T15:36:35.633453+0000 mon.b (mon.2) 1250 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:36:37.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:36 smithi132 bash[27079]: cephadm 2020-07-16T15:36:35.634152+0000 mgr.x (mgr.34562) 5672 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:36:37.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:36 smithi132 bash[27079]: cephadm 2020-07-16T15:36:35.634588+0000 mgr.x (mgr.34562) 5673 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:36:38.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:38 smithi188 bash[23329]: cluster 2020-07-16T15:36:37.078136+0000 mgr.x (mgr.34562) 5674 : cluster [DBG] pgmap v3538: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:36:39.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:38 smithi132 bash[27079]: cluster 2020-07-16T15:36:37.078136+0000 mgr.x (mgr.34562) 5674 : cluster [DBG] pgmap v3538: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:36:40.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:40 smithi188 bash[23329]: cluster 2020-07-16T15:36:39.078545+0000 mgr.x (mgr.34562) 5675 : cluster [DBG] pgmap v3539: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:36:41.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:40 smithi132 bash[27079]: cluster 2020-07-16T15:36:39.078545+0000 mgr.x (mgr.34562) 5675 : cluster [DBG] pgmap v3539: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:36:42.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:42 smithi188 bash[23329]: cluster 2020-07-16T15:36:41.078908+0000 mgr.x (mgr.34562) 5676 : cluster [DBG] pgmap v3540: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:36:43.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:42 smithi132 bash[27079]: cluster 2020-07-16T15:36:41.078908+0000 mgr.x (mgr.34562) 5676 : cluster [DBG] pgmap v3540: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:36:44.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:44 smithi188 bash[23329]: cluster 2020-07-16T15:36:43.079509+0000 mgr.x (mgr.34562) 5677 : cluster [DBG] pgmap v3541: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:36:45.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:44 smithi132 bash[27079]: cluster 2020-07-16T15:36:43.079509+0000 mgr.x (mgr.34562) 5677 : cluster [DBG] pgmap v3541: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:36:46.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:46 smithi188 bash[23329]: cluster 2020-07-16T15:36:45.080027+0000 mgr.x (mgr.34562) 5678 : cluster [DBG] pgmap v3542: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:36:47.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:46 smithi132 bash[27079]: cluster 2020-07-16T15:36:45.080027+0000 mgr.x (mgr.34562) 5678 : cluster [DBG] pgmap v3542: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:36:48.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:48 smithi188 bash[23329]: cluster 2020-07-16T15:36:47.080524+0000 mgr.x (mgr.34562) 5679 : cluster [DBG] pgmap v3543: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:36:49.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:48 smithi132 bash[27079]: cluster 2020-07-16T15:36:47.080524+0000 mgr.x (mgr.34562) 5679 : cluster [DBG] pgmap v3543: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:36:50.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:50 smithi188 bash[23329]: cluster 2020-07-16T15:36:49.081027+0000 mgr.x (mgr.34562) 5680 : cluster [DBG] pgmap v3544: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:36:51.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:50 smithi132 bash[27079]: cluster 2020-07-16T15:36:49.081027+0000 mgr.x (mgr.34562) 5680 : cluster [DBG] pgmap v3544: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:36:51.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:51 smithi188 bash[23329]: audit 2020-07-16T15:36:50.649980+0000 mon.b (mon.2) 1251 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:36:51.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:51 smithi188 bash[23329]: cephadm 2020-07-16T15:36:50.650660+0000 mgr.x (mgr.34562) 5681 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:36:51.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:51 smithi188 bash[23329]: cephadm 2020-07-16T15:36:50.651002+0000 mgr.x (mgr.34562) 5682 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:36:52.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:51 smithi132 bash[27079]: audit 2020-07-16T15:36:50.649980+0000 mon.b (mon.2) 1251 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:36:52.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:51 smithi132 bash[27079]: cephadm 2020-07-16T15:36:50.650660+0000 mgr.x (mgr.34562) 5681 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:36:52.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:51 smithi132 bash[27079]: cephadm 2020-07-16T15:36:50.651002+0000 mgr.x (mgr.34562) 5682 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:36:52.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:52 smithi188 bash[23329]: cluster 2020-07-16T15:36:51.081407+0000 mgr.x (mgr.34562) 5683 : cluster [DBG] pgmap v3545: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:36:53.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:52 smithi132 bash[27079]: cluster 2020-07-16T15:36:51.081407+0000 mgr.x (mgr.34562) 5683 : cluster [DBG] pgmap v3545: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:36:54.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:54 smithi188 bash[23329]: cluster 2020-07-16T15:36:53.081789+0000 mgr.x (mgr.34562) 5684 : cluster [DBG] pgmap v3546: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:36:55.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:54 smithi132 bash[27079]: cluster 2020-07-16T15:36:53.081789+0000 mgr.x (mgr.34562) 5684 : cluster [DBG] pgmap v3546: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:36:56.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:56 smithi188 bash[23329]: cluster 2020-07-16T15:36:55.082160+0000 mgr.x (mgr.34562) 5685 : cluster [DBG] pgmap v3547: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:36:57.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:56 smithi132 bash[27079]: cluster 2020-07-16T15:36:55.082160+0000 mgr.x (mgr.34562) 5685 : cluster [DBG] pgmap v3547: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:36:58.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:36:58 smithi188 bash[23329]: cluster 2020-07-16T15:36:57.082638+0000 mgr.x (mgr.34562) 5686 : cluster [DBG] pgmap v3548: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:36:59.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:36:58 smithi132 bash[27079]: cluster 2020-07-16T15:36:57.082638+0000 mgr.x (mgr.34562) 5686 : cluster [DBG] pgmap v3548: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:37:00.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:00 smithi188 bash[23329]: cluster 2020-07-16T15:36:59.083067+0000 mgr.x (mgr.34562) 5687 : cluster [DBG] pgmap v3549: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:37:01.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:00 smithi132 bash[27079]: cluster 2020-07-16T15:36:59.083067+0000 mgr.x (mgr.34562) 5687 : cluster [DBG] pgmap v3549: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:37:02.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:02 smithi188 bash[23329]: cluster 2020-07-16T15:37:01.083592+0000 mgr.x (mgr.34562) 5688 : cluster [DBG] pgmap v3550: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:37:03.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:02 smithi132 bash[27079]: cluster 2020-07-16T15:37:01.083592+0000 mgr.x (mgr.34562) 5688 : cluster [DBG] pgmap v3550: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:37:04.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:04 smithi188 bash[23329]: cluster 2020-07-16T15:37:03.084229+0000 mgr.x (mgr.34562) 5689 : cluster [DBG] pgmap v3551: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:37:05.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:04 smithi132 bash[27079]: cluster 2020-07-16T15:37:03.084229+0000 mgr.x (mgr.34562) 5689 : cluster [DBG] pgmap v3551: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:37:05.106 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:37:05.370 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:37:05.371 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (119m) 2m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:37:05.371 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 2m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:37:05.371 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 2m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:37:05.371 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (119m) 2m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:37:05.372 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 2m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:37:05.372 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:37:05.372 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:37:05.372 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 2m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:37:05.372 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 2m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:37:05.373 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:37:05.373 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:37:05.373 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:37:05.373 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:37:05.373 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:37:05.375 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:37:05.375 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:37:05.375 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:37:05.376 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 2m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:37:05.665 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:37:05.665 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:37:05.666 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:37:05.666 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:37:05.666 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:37:05.666 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:37:05.666 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:37:05.667 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:37:05.667 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:37:05.667 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:37:05.667 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:37:05.667 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:37:05.668 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:37:05.668 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:37:05.668 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:37:05.668 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:37:05.668 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:37:06.717 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:06 smithi132 bash[27079]: cluster 2020-07-16T15:37:05.084667+0000 mgr.x (mgr.34562) 5690 : cluster [DBG] pgmap v3552: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:37:06.718 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:06 smithi132 bash[27079]: audit 2020-07-16T15:37:05.095254+0000 mgr.x (mgr.34562) 5691 : audit [DBG] from='client.28780 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:37:06.718 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:06 smithi132 bash[27079]: audit 2020-07-16T15:37:05.363693+0000 mgr.x (mgr.34562) 5692 : audit [DBG] from='client.28786 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:37:06.718 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:06 smithi132 bash[27079]: audit 2020-07-16T15:37:05.663959+0000 mon.c (mon.1) 398 : audit [DBG] from='client.? 172.21.15.132:0/1805278567' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:37:06.718 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:06 smithi132 bash[27079]: audit 2020-07-16T15:37:05.891753+0000 mon.b (mon.2) 1252 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:34:53.841534\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841594\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841629\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841658\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841844\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841946\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.842045\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.842144\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.842177\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:34:53.842246\", \"last_device_update\": \"2020-07-16T15:34:56.840832\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:37:05.890601\"}"}]: dispatch 2020-07-16T15:37:06.719 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:06 smithi132 bash[27079]: audit 2020-07-16T15:37:05.892266+0000 mon.c (mon.1) 399 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:34:53.841534\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841594\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841629\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841658\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841844\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841946\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.842045\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.842144\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.842177\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:34:53.842246\", \"last_device_update\": \"2020-07-16T15:34:56.840832\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:37:05.890601\"}"}]: dispatch 2020-07-16T15:37:06.719 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:06 smithi132 bash[27079]: audit 2020-07-16T15:37:05.896984+0000 mon.c (mon.1) 400 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:34:53.841534\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841594\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841629\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841658\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841844\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841946\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.842045\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.842144\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.842177\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:34:53.842246\", \"last_device_update\": \"2020-07-16T15:34:56.840832\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:37:05.890601\"}"}]': finished 2020-07-16T15:37:06.719 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:06 smithi132 bash[27079]: audit 2020-07-16T15:37:05.897687+0000 mon.b (mon.2) 1253 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.463891\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.463961\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.463992\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464150\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464250\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464376\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464480\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464519\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464553\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:34:54.464656\", \"last_device_update\": \"2020-07-16T15:36:02.606623\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:37:05.896872\"}"}]: dispatch 2020-07-16T15:37:06.720 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:06 smithi132 bash[27079]: audit 2020-07-16T15:37:05.897861+0000 mon.c (mon.1) 401 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.463891\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.463961\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.463992\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464150\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464250\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464376\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464480\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464519\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464553\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:34:54.464656\", \"last_device_update\": \"2020-07-16T15:36:02.606623\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:37:05.896872\"}"}]: dispatch 2020-07-16T15:37:06.720 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:06 smithi132 bash[27079]: audit 2020-07-16T15:37:05.899751+0000 mon.c (mon.1) 402 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.463891\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.463961\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.463992\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464150\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464250\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464376\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464480\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464519\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464553\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:34:54.464656\", \"last_device_update\": \"2020-07-16T15:36:02.606623\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:37:05.896872\"}"}]': finished 2020-07-16T15:37:06.720 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:06 smithi132 bash[27079]: audit 2020-07-16T15:37:05.904439+0000 mon.b (mon.2) 1254 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:37:06.720 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:06 smithi132 bash[27079]: audit 2020-07-16T15:37:05.904692+0000 mgr.x (mgr.34562) 5693 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:37:06.721 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:06 smithi132 bash[27079]: audit 2020-07-16T15:37:05.905386+0000 mon.b (mon.2) 1255 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:37:06.721 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:06 smithi132 bash[27079]: audit 2020-07-16T15:37:05.905629+0000 mgr.x (mgr.34562) 5694 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:37:06.721 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:06 smithi132 bash[27079]: audit 2020-07-16T15:37:05.906223+0000 mon.b (mon.2) 1256 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:37:06.721 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:06 smithi132 bash[27079]: audit 2020-07-16T15:37:05.906433+0000 mgr.x (mgr.34562) 5695 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:37:06.722 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:06 smithi132 bash[27079]: cephadm 2020-07-16T15:37:05.906953+0000 mgr.x (mgr.34562) 5696 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:37:06.722 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:06 smithi132 bash[27079]: audit 2020-07-16T15:37:05.907172+0000 mon.b (mon.2) 1257 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:37:06.723 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:06 smithi132 bash[27079]: cephadm 2020-07-16T15:37:05.907765+0000 mgr.x (mgr.34562) 5697 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:37:06.723 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:06 smithi132 bash[27079]: audit 2020-07-16T15:37:05.908014+0000 mon.b (mon.2) 1258 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:37:06.723 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:06 smithi132 bash[27079]: cephadm 2020-07-16T15:37:05.908510+0000 mgr.x (mgr.34562) 5698 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:37:06.724 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:06 smithi132 bash[27079]: cephadm 2020-07-16T15:37:05.908642+0000 mgr.x (mgr.34562) 5699 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:37:06.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:06 smithi188 bash[23329]: cluster 2020-07-16T15:37:05.084667+0000 mgr.x (mgr.34562) 5690 : cluster [DBG] pgmap v3552: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:37:06.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:06 smithi188 bash[23329]: audit 2020-07-16T15:37:05.095254+0000 mgr.x (mgr.34562) 5691 : audit [DBG] from='client.28780 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:37:06.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:06 smithi188 bash[23329]: audit 2020-07-16T15:37:05.363693+0000 mgr.x (mgr.34562) 5692 : audit [DBG] from='client.28786 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:37:06.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:06 smithi188 bash[23329]: audit 2020-07-16T15:37:05.663959+0000 mon.c (mon.1) 398 : audit [DBG] from='client.? 172.21.15.132:0/1805278567' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:37:06.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:06 smithi188 bash[23329]: audit 2020-07-16T15:37:05.891753+0000 mon.b (mon.2) 1252 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:34:53.841534\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841594\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841629\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841658\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841844\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841946\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.842045\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.842144\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.842177\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:34:53.842246\", \"last_device_update\": \"2020-07-16T15:34:56.840832\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:37:05.890601\"}"}]: dispatch 2020-07-16T15:37:06.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:06 smithi188 bash[23329]: audit 2020-07-16T15:37:05.892266+0000 mon.c (mon.1) 399 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:34:53.841534\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841594\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841629\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841658\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841844\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841946\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.842045\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.842144\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.842177\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:34:53.842246\", \"last_device_update\": \"2020-07-16T15:34:56.840832\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:37:05.890601\"}"}]: dispatch 2020-07-16T15:37:06.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:06 smithi188 bash[23329]: audit 2020-07-16T15:37:05.896984+0000 mon.c (mon.1) 400 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:34:53.841534\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841594\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841629\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841658\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841844\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.841946\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.842045\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.842144\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:53.842177\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:34:53.842246\", \"last_device_update\": \"2020-07-16T15:34:56.840832\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:37:05.890601\"}"}]': finished 2020-07-16T15:37:06.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:06 smithi188 bash[23329]: audit 2020-07-16T15:37:05.897687+0000 mon.b (mon.2) 1253 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.463891\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.463961\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.463992\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464150\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464250\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464376\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464480\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464519\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464553\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:34:54.464656\", \"last_device_update\": \"2020-07-16T15:36:02.606623\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:37:05.896872\"}"}]: dispatch 2020-07-16T15:37:06.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:06 smithi188 bash[23329]: audit 2020-07-16T15:37:05.897861+0000 mon.c (mon.1) 401 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.463891\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.463961\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.463992\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464150\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464250\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464376\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464480\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464519\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464553\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:34:54.464656\", \"last_device_update\": \"2020-07-16T15:36:02.606623\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:37:05.896872\"}"}]: dispatch 2020-07-16T15:37:06.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:06 smithi188 bash[23329]: audit 2020-07-16T15:37:05.899751+0000 mon.c (mon.1) 402 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.463891\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.463961\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.463992\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464150\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464250\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464376\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464480\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464519\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:34:54.464553\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:34:54.464656\", \"last_device_update\": \"2020-07-16T15:36:02.606623\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:37:05.896872\"}"}]': finished 2020-07-16T15:37:06.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:06 smithi188 bash[23329]: audit 2020-07-16T15:37:05.904439+0000 mon.b (mon.2) 1254 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:37:06.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:06 smithi188 bash[23329]: audit 2020-07-16T15:37:05.904692+0000 mgr.x (mgr.34562) 5693 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:37:06.925 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:06 smithi188 bash[23329]: audit 2020-07-16T15:37:05.905386+0000 mon.b (mon.2) 1255 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:37:06.925 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:06 smithi188 bash[23329]: audit 2020-07-16T15:37:05.905629+0000 mgr.x (mgr.34562) 5694 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:37:06.925 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:06 smithi188 bash[23329]: audit 2020-07-16T15:37:05.906223+0000 mon.b (mon.2) 1256 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:37:06.925 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:06 smithi188 bash[23329]: audit 2020-07-16T15:37:05.906433+0000 mgr.x (mgr.34562) 5695 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:37:06.925 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:06 smithi188 bash[23329]: cephadm 2020-07-16T15:37:05.906953+0000 mgr.x (mgr.34562) 5696 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:37:06.926 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:06 smithi188 bash[23329]: audit 2020-07-16T15:37:05.907172+0000 mon.b (mon.2) 1257 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:37:06.926 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:06 smithi188 bash[23329]: cephadm 2020-07-16T15:37:05.907765+0000 mgr.x (mgr.34562) 5697 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:37:06.926 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:06 smithi188 bash[23329]: audit 2020-07-16T15:37:05.908014+0000 mon.b (mon.2) 1258 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:37:06.926 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:06 smithi188 bash[23329]: cephadm 2020-07-16T15:37:05.908510+0000 mgr.x (mgr.34562) 5698 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:37:06.926 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:06 smithi188 bash[23329]: cephadm 2020-07-16T15:37:05.908642+0000 mgr.x (mgr.34562) 5699 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:37:08.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:08 smithi188 bash[23329]: cluster 2020-07-16T15:37:07.085200+0000 mgr.x (mgr.34562) 5700 : cluster [DBG] pgmap v3553: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:37:09.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:08 smithi132 bash[27079]: cluster 2020-07-16T15:37:07.085200+0000 mgr.x (mgr.34562) 5700 : cluster [DBG] pgmap v3553: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:37:09.925 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:09 smithi188 bash[23329]: audit 2020-07-16T15:37:08.641992+0000 mon.b (mon.2) 1259 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:37:09.925 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:09 smithi188 bash[23329]: cephadm 2020-07-16T15:37:08.642680+0000 mgr.x (mgr.34562) 5701 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:37:09.925 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:09 smithi188 bash[23329]: cephadm 2020-07-16T15:37:08.643084+0000 mgr.x (mgr.34562) 5702 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:37:10.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:09 smithi132 bash[27079]: audit 2020-07-16T15:37:08.641992+0000 mon.b (mon.2) 1259 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:37:10.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:09 smithi132 bash[27079]: cephadm 2020-07-16T15:37:08.642680+0000 mgr.x (mgr.34562) 5701 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:37:10.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:09 smithi132 bash[27079]: cephadm 2020-07-16T15:37:08.643084+0000 mgr.x (mgr.34562) 5702 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:37:10.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:10 smithi188 bash[23329]: cluster 2020-07-16T15:37:09.085670+0000 mgr.x (mgr.34562) 5703 : cluster [DBG] pgmap v3554: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:37:11.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:10 smithi132 bash[27079]: cluster 2020-07-16T15:37:09.085670+0000 mgr.x (mgr.34562) 5703 : cluster [DBG] pgmap v3554: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:37:12.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:12 smithi188 bash[23329]: cluster 2020-07-16T15:37:11.086072+0000 mgr.x (mgr.34562) 5704 : cluster [DBG] pgmap v3555: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:37:13.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:12 smithi132 bash[27079]: cluster 2020-07-16T15:37:11.086072+0000 mgr.x (mgr.34562) 5704 : cluster [DBG] pgmap v3555: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:37:14.926 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:14 smithi188 bash[23329]: cluster 2020-07-16T15:37:13.086616+0000 mgr.x (mgr.34562) 5705 : cluster [DBG] pgmap v3556: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:37:15.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:14 smithi132 bash[27079]: cluster 2020-07-16T15:37:13.086616+0000 mgr.x (mgr.34562) 5705 : cluster [DBG] pgmap v3556: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:37:16.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:16 smithi188 bash[23329]: cluster 2020-07-16T15:37:15.087122+0000 mgr.x (mgr.34562) 5706 : cluster [DBG] pgmap v3557: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:37:17.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:16 smithi132 bash[27079]: cluster 2020-07-16T15:37:15.087122+0000 mgr.x (mgr.34562) 5706 : cluster [DBG] pgmap v3557: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:37:18.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:18 smithi188 bash[23329]: cluster 2020-07-16T15:37:17.087619+0000 mgr.x (mgr.34562) 5707 : cluster [DBG] pgmap v3558: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:37:19.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:18 smithi132 bash[27079]: cluster 2020-07-16T15:37:17.087619+0000 mgr.x (mgr.34562) 5707 : cluster [DBG] pgmap v3558: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:37:20.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:20 smithi188 bash[23329]: cluster 2020-07-16T15:37:19.088068+0000 mgr.x (mgr.34562) 5708 : cluster [DBG] pgmap v3559: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:37:21.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:20 smithi132 bash[27079]: cluster 2020-07-16T15:37:19.088068+0000 mgr.x (mgr.34562) 5708 : cluster [DBG] pgmap v3559: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:37:22.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:22 smithi188 bash[23329]: cluster 2020-07-16T15:37:21.088596+0000 mgr.x (mgr.34562) 5709 : cluster [DBG] pgmap v3560: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:37:23.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:22 smithi132 bash[27079]: cluster 2020-07-16T15:37:21.088596+0000 mgr.x (mgr.34562) 5709 : cluster [DBG] pgmap v3560: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:37:24.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:23 smithi132 bash[27079]: audit 2020-07-16T15:37:23.658710+0000 mon.b (mon.2) 1260 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:37:24.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:23 smithi188 bash[23329]: audit 2020-07-16T15:37:23.658710+0000 mon.b (mon.2) 1260 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:37:25.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:24 smithi132 bash[27079]: cluster 2020-07-16T15:37:23.089085+0000 mgr.x (mgr.34562) 5710 : cluster [DBG] pgmap v3561: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:37:25.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:24 smithi132 bash[27079]: cephadm 2020-07-16T15:37:23.659474+0000 mgr.x (mgr.34562) 5711 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:37:25.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:24 smithi132 bash[27079]: cephadm 2020-07-16T15:37:23.659553+0000 mgr.x (mgr.34562) 5712 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:37:25.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:24 smithi188 bash[23329]: cluster 2020-07-16T15:37:23.089085+0000 mgr.x (mgr.34562) 5710 : cluster [DBG] pgmap v3561: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:37:25.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:24 smithi188 bash[23329]: cephadm 2020-07-16T15:37:23.659474+0000 mgr.x (mgr.34562) 5711 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:37:25.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:24 smithi188 bash[23329]: cephadm 2020-07-16T15:37:23.659553+0000 mgr.x (mgr.34562) 5712 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:37:27.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:26 smithi132 bash[27079]: cluster 2020-07-16T15:37:25.089499+0000 mgr.x (mgr.34562) 5713 : cluster [DBG] pgmap v3562: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:37:27.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:26 smithi188 bash[23329]: cluster 2020-07-16T15:37:25.089499+0000 mgr.x (mgr.34562) 5713 : cluster [DBG] pgmap v3562: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:37:29.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:28 smithi132 bash[27079]: cluster 2020-07-16T15:37:27.090035+0000 mgr.x (mgr.34562) 5714 : cluster [DBG] pgmap v3563: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:37:29.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:28 smithi188 bash[23329]: cluster 2020-07-16T15:37:27.090035+0000 mgr.x (mgr.34562) 5714 : cluster [DBG] pgmap v3563: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:37:31.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:30 smithi132 bash[27079]: cluster 2020-07-16T15:37:29.090599+0000 mgr.x (mgr.34562) 5715 : cluster [DBG] pgmap v3564: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:37:31.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:30 smithi188 bash[23329]: cluster 2020-07-16T15:37:29.090599+0000 mgr.x (mgr.34562) 5715 : cluster [DBG] pgmap v3564: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:37:33.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:32 smithi132 bash[27079]: cluster 2020-07-16T15:37:31.091041+0000 mgr.x (mgr.34562) 5716 : cluster [DBG] pgmap v3565: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:37:33.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:32 smithi188 bash[23329]: cluster 2020-07-16T15:37:31.091041+0000 mgr.x (mgr.34562) 5716 : cluster [DBG] pgmap v3565: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:37:35.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:34 smithi132 bash[27079]: cluster 2020-07-16T15:37:33.091489+0000 mgr.x (mgr.34562) 5717 : cluster [DBG] pgmap v3566: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:37:35.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:34 smithi188 bash[23329]: cluster 2020-07-16T15:37:33.091489+0000 mgr.x (mgr.34562) 5717 : cluster [DBG] pgmap v3566: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:37:35.963 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:37:36.228 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:37:36.229 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 2m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:37:36.229 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 2m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:37:36.229 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 2m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:37:36.230 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 2m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:37:36.230 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 2m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:37:36.230 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:37:36.230 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:37:36.230 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 2m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:37:36.231 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 2m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:37:36.231 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:37:36.231 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:37:36.231 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:37:36.231 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:37:36.232 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:37:36.232 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:37:36.232 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:37:36.232 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:37:36.232 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 2m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:37:36.535 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:37:36.535 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:37:36.535 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:37:36.535 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:37:36.536 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:37:36.536 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:37:36.536 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:37:36.536 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:37:36.537 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:37:36.537 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:37:36.537 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:37:36.538 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:37:36.538 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:37:36.538 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:37:36.538 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:37:36.539 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:37:36.539 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:37:37.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:36 smithi132 bash[27079]: cluster 2020-07-16T15:37:35.091990+0000 mgr.x (mgr.34562) 5718 : cluster [DBG] pgmap v3567: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:37:37.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:36 smithi132 bash[27079]: audit 2020-07-16T15:37:35.952121+0000 mgr.x (mgr.34562) 5719 : audit [DBG] from='client.28798 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:37:37.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:36 smithi132 bash[27079]: audit 2020-07-16T15:37:36.530714+0000 mon.c (mon.1) 403 : audit [DBG] from='client.? 172.21.15.132:0/1335748653' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:37:37.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:36 smithi188 bash[23329]: cluster 2020-07-16T15:37:35.091990+0000 mgr.x (mgr.34562) 5718 : cluster [DBG] pgmap v3567: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:37:37.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:36 smithi188 bash[23329]: audit 2020-07-16T15:37:35.952121+0000 mgr.x (mgr.34562) 5719 : audit [DBG] from='client.28798 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:37:37.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:36 smithi188 bash[23329]: audit 2020-07-16T15:37:36.530714+0000 mon.c (mon.1) 403 : audit [DBG] from='client.? 172.21.15.132:0/1335748653' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:37:38.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:37 smithi132 bash[27079]: audit 2020-07-16T15:37:36.224478+0000 mgr.x (mgr.34562) 5720 : audit [DBG] from='client.28804 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:37:38.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:37 smithi188 bash[23329]: audit 2020-07-16T15:37:36.224478+0000 mgr.x (mgr.34562) 5720 : audit [DBG] from='client.28804 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:37:39.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:38 smithi132 bash[27079]: cluster 2020-07-16T15:37:37.092521+0000 mgr.x (mgr.34562) 5721 : cluster [DBG] pgmap v3568: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:37:39.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:38 smithi132 bash[27079]: audit 2020-07-16T15:37:38.670913+0000 mon.b (mon.2) 1261 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:37:39.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:38 smithi188 bash[23329]: cluster 2020-07-16T15:37:37.092521+0000 mgr.x (mgr.34562) 5721 : cluster [DBG] pgmap v3568: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:37:39.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:38 smithi188 bash[23329]: audit 2020-07-16T15:37:38.670913+0000 mon.b (mon.2) 1261 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:37:40.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:39 smithi132 bash[27079]: cephadm 2020-07-16T15:37:38.671672+0000 mgr.x (mgr.34562) 5722 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:37:40.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:39 smithi132 bash[27079]: cephadm 2020-07-16T15:37:38.672116+0000 mgr.x (mgr.34562) 5723 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:37:40.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:39 smithi188 bash[23329]: cephadm 2020-07-16T15:37:38.671672+0000 mgr.x (mgr.34562) 5722 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:37:40.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:39 smithi188 bash[23329]: cephadm 2020-07-16T15:37:38.672116+0000 mgr.x (mgr.34562) 5723 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:37:41.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:40 smithi132 bash[27079]: cluster 2020-07-16T15:37:39.093016+0000 mgr.x (mgr.34562) 5724 : cluster [DBG] pgmap v3569: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:37:41.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:40 smithi188 bash[23329]: cluster 2020-07-16T15:37:39.093016+0000 mgr.x (mgr.34562) 5724 : cluster [DBG] pgmap v3569: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:37:43.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:42 smithi132 bash[27079]: cluster 2020-07-16T15:37:41.093474+0000 mgr.x (mgr.34562) 5725 : cluster [DBG] pgmap v3570: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:37:43.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:42 smithi188 bash[23329]: cluster 2020-07-16T15:37:41.093474+0000 mgr.x (mgr.34562) 5725 : cluster [DBG] pgmap v3570: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:37:45.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:44 smithi132 bash[27079]: cluster 2020-07-16T15:37:43.093828+0000 mgr.x (mgr.34562) 5726 : cluster [DBG] pgmap v3571: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:37:45.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:44 smithi188 bash[23329]: cluster 2020-07-16T15:37:43.093828+0000 mgr.x (mgr.34562) 5726 : cluster [DBG] pgmap v3571: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:37:47.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:46 smithi132 bash[27079]: cluster 2020-07-16T15:37:45.094321+0000 mgr.x (mgr.34562) 5727 : cluster [DBG] pgmap v3572: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:37:47.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:46 smithi188 bash[23329]: cluster 2020-07-16T15:37:45.094321+0000 mgr.x (mgr.34562) 5727 : cluster [DBG] pgmap v3572: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:37:49.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:48 smithi132 bash[27079]: cluster 2020-07-16T15:37:47.094760+0000 mgr.x (mgr.34562) 5728 : cluster [DBG] pgmap v3573: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:37:49.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:48 smithi188 bash[23329]: cluster 2020-07-16T15:37:47.094760+0000 mgr.x (mgr.34562) 5728 : cluster [DBG] pgmap v3573: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:37:51.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:50 smithi132 bash[27079]: cluster 2020-07-16T15:37:49.095258+0000 mgr.x (mgr.34562) 5729 : cluster [DBG] pgmap v3574: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:37:51.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:50 smithi188 bash[23329]: cluster 2020-07-16T15:37:49.095258+0000 mgr.x (mgr.34562) 5729 : cluster [DBG] pgmap v3574: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:37:53.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:52 smithi132 bash[27079]: cluster 2020-07-16T15:37:51.095658+0000 mgr.x (mgr.34562) 5730 : cluster [DBG] pgmap v3575: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:37:53.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:52 smithi188 bash[23329]: cluster 2020-07-16T15:37:51.095658+0000 mgr.x (mgr.34562) 5730 : cluster [DBG] pgmap v3575: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:37:54.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:53 smithi132 bash[27079]: audit 2020-07-16T15:37:53.673834+0000 mon.b (mon.2) 1262 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:37:54.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:53 smithi188 bash[23329]: audit 2020-07-16T15:37:53.673834+0000 mon.b (mon.2) 1262 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:37:55.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:54 smithi132 bash[27079]: cluster 2020-07-16T15:37:53.096146+0000 mgr.x (mgr.34562) 5731 : cluster [DBG] pgmap v3576: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:37:55.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:54 smithi132 bash[27079]: cephadm 2020-07-16T15:37:53.674618+0000 mgr.x (mgr.34562) 5732 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:37:55.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:54 smithi132 bash[27079]: cephadm 2020-07-16T15:37:53.674815+0000 mgr.x (mgr.34562) 5733 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:37:55.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:54 smithi188 bash[23329]: cluster 2020-07-16T15:37:53.096146+0000 mgr.x (mgr.34562) 5731 : cluster [DBG] pgmap v3576: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:37:55.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:54 smithi188 bash[23329]: cephadm 2020-07-16T15:37:53.674618+0000 mgr.x (mgr.34562) 5732 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:37:55.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:54 smithi188 bash[23329]: cephadm 2020-07-16T15:37:53.674815+0000 mgr.x (mgr.34562) 5733 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:37:57.033 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:56 smithi132 bash[27079]: cluster 2020-07-16T15:37:55.096657+0000 mgr.x (mgr.34562) 5734 : cluster [DBG] pgmap v3577: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:37:57.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:56 smithi188 bash[23329]: cluster 2020-07-16T15:37:55.096657+0000 mgr.x (mgr.34562) 5734 : cluster [DBG] pgmap v3577: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:37:59.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:37:58 smithi132 bash[27079]: cluster 2020-07-16T15:37:57.097078+0000 mgr.x (mgr.34562) 5735 : cluster [DBG] pgmap v3578: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:37:59.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:37:58 smithi188 bash[23329]: cluster 2020-07-16T15:37:57.097078+0000 mgr.x (mgr.34562) 5735 : cluster [DBG] pgmap v3578: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:38:01.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:38:00 smithi132 bash[27079]: cluster 2020-07-16T15:37:59.097619+0000 mgr.x (mgr.34562) 5736 : cluster [DBG] pgmap v3579: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:38:01.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:38:00 smithi188 bash[23329]: cluster 2020-07-16T15:37:59.097619+0000 mgr.x (mgr.34562) 5736 : cluster [DBG] pgmap v3579: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:38:03.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:38:02 smithi132 bash[27079]: cluster 2020-07-16T15:38:01.098019+0000 mgr.x (mgr.34562) 5737 : cluster [DBG] pgmap v3580: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:38:03.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:38:02 smithi188 bash[23329]: cluster 2020-07-16T15:38:01.098019+0000 mgr.x (mgr.34562) 5737 : cluster [DBG] pgmap v3580: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:38:05.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:38:04 smithi132 bash[27079]: cluster 2020-07-16T15:38:03.098602+0000 mgr.x (mgr.34562) 5738 : cluster [DBG] pgmap v3581: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:38:05.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:38:04 smithi188 bash[23329]: cluster 2020-07-16T15:38:03.098602+0000 mgr.x (mgr.34562) 5738 : cluster [DBG] pgmap v3581: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:38:06.830 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:38:07.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:38:06 smithi132 bash[27079]: cluster 2020-07-16T15:38:05.099056+0000 mgr.x (mgr.34562) 5739 : cluster [DBG] pgmap v3582: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:38:07.094 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:38:07.094 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 3m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:38:07.094 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 3m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:38:07.095 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 3m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:38:07.095 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 3m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:38:07.095 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 3m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:38:07.095 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:38:07.095 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:38:07.096 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 3m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:38:07.096 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 3m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:38:07.096 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:38:07.096 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:38:07.096 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:38:07.097 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:38:07.097 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:38:07.097 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:38:07.097 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:38:07.097 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:38:07.098 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 3m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:38:07.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:38:06 smithi188 bash[23329]: cluster 2020-07-16T15:38:05.099056+0000 mgr.x (mgr.34562) 5739 : cluster [DBG] pgmap v3582: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:38:07.392 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:38:07.392 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:38:07.393 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:38:07.393 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:38:07.393 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:38:07.393 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:38:07.393 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:38:07.394 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:38:07.394 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:38:07.394 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:38:07.394 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:38:07.394 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:38:07.395 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:38:07.395 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:38:07.395 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:38:07.395 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:38:07.395 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:38:08.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:38:07 smithi132 bash[27079]: audit 2020-07-16T15:38:06.818799+0000 mgr.x (mgr.34562) 5740 : audit [DBG] from='client.28816 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:38:08.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:38:07 smithi132 bash[27079]: audit 2020-07-16T15:38:07.090249+0000 mgr.x (mgr.34562) 5741 : audit [DBG] from='client.28822 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:38:08.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:38:07 smithi132 bash[27079]: audit 2020-07-16T15:38:07.391552+0000 mon.c (mon.1) 404 : audit [DBG] from='client.? 172.21.15.132:0/939947613' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:38:08.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:38:07 smithi188 bash[23329]: audit 2020-07-16T15:38:06.818799+0000 mgr.x (mgr.34562) 5740 : audit [DBG] from='client.28816 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:38:08.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:38:07 smithi188 bash[23329]: audit 2020-07-16T15:38:07.090249+0000 mgr.x (mgr.34562) 5741 : audit [DBG] from='client.28822 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:38:08.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:38:07 smithi188 bash[23329]: audit 2020-07-16T15:38:07.391552+0000 mon.c (mon.1) 404 : audit [DBG] from='client.? 172.21.15.132:0/939947613' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:38:09.164 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:38:08 smithi132 bash[27079]: cluster 2020-07-16T15:38:07.099487+0000 mgr.x (mgr.34562) 5742 : cluster [DBG] pgmap v3583: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:38:09.164 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:38:08 smithi132 bash[27079]: audit 2020-07-16T15:38:08.693160+0000 mon.b (mon.2) 1263 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:38:09.165 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:38:08 smithi132 bash[27079]: audit 2020-07-16T15:38:08.694522+0000 mon.b (mon.2) 1264 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:38:09.165 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:38:08 smithi132 bash[27079]: audit 2020-07-16T15:38:08.695689+0000 mon.b (mon.2) 1265 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:38:09.165 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:38:08 smithi132 bash[27079]: audit 2020-07-16T15:38:08.697056+0000 mon.b (mon.2) 1266 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:38:09.165 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:38:08 smithi132 bash[27079]: audit 2020-07-16T15:38:08.698238+0000 mon.b (mon.2) 1267 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:38:09.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:38:08 smithi188 bash[23329]: cluster 2020-07-16T15:38:07.099487+0000 mgr.x (mgr.34562) 5742 : cluster [DBG] pgmap v3583: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:38:09.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:38:08 smithi188 bash[23329]: audit 2020-07-16T15:38:08.693160+0000 mon.b (mon.2) 1263 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:38:09.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:38:08 smithi188 bash[23329]: audit 2020-07-16T15:38:08.694522+0000 mon.b (mon.2) 1264 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:38:09.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:38:08 smithi188 bash[23329]: audit 2020-07-16T15:38:08.695689+0000 mon.b (mon.2) 1265 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:38:09.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:38:08 smithi188 bash[23329]: audit 2020-07-16T15:38:08.697056+0000 mon.b (mon.2) 1266 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:38:09.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:38:08 smithi188 bash[23329]: audit 2020-07-16T15:38:08.698238+0000 mon.b (mon.2) 1267 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:38:10.086 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:38:09 smithi132 bash[27079]: audit 2020-07-16T15:38:08.693528+0000 mgr.x (mgr.34562) 5743 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:38:10.087 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:38:09 smithi132 bash[27079]: audit 2020-07-16T15:38:08.694853+0000 mgr.x (mgr.34562) 5744 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:38:10.087 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:38:09 smithi132 bash[27079]: audit 2020-07-16T15:38:08.695957+0000 mgr.x (mgr.34562) 5745 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:38:10.087 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:38:09 smithi132 bash[27079]: cephadm 2020-07-16T15:38:08.696698+0000 mgr.x (mgr.34562) 5746 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:38:10.087 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:38:09 smithi132 bash[27079]: cephadm 2020-07-16T15:38:08.697917+0000 mgr.x (mgr.34562) 5747 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:38:10.088 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:38:09 smithi132 bash[27079]: cephadm 2020-07-16T15:38:08.699007+0000 mgr.x (mgr.34562) 5748 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:38:10.088 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:38:09 smithi132 bash[27079]: cephadm 2020-07-16T15:38:08.699224+0000 mgr.x (mgr.34562) 5749 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:38:10.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:38:09 smithi188 bash[23329]: audit 2020-07-16T15:38:08.693528+0000 mgr.x (mgr.34562) 5743 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:38:10.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:38:09 smithi188 bash[23329]: audit 2020-07-16T15:38:08.694853+0000 mgr.x (mgr.34562) 5744 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:38:10.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:38:09 smithi188 bash[23329]: audit 2020-07-16T15:38:08.695957+0000 mgr.x (mgr.34562) 5745 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:38:10.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:38:09 smithi188 bash[23329]: cephadm 2020-07-16T15:38:08.696698+0000 mgr.x (mgr.34562) 5746 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:38:10.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:38:09 smithi188 bash[23329]: cephadm 2020-07-16T15:38:08.697917+0000 mgr.x (mgr.34562) 5747 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:38:10.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:38:09 smithi188 bash[23329]: cephadm 2020-07-16T15:38:08.699007+0000 mgr.x (mgr.34562) 5748 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:38:10.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:38:09 smithi188 bash[23329]: cephadm 2020-07-16T15:38:08.699224+0000 mgr.x (mgr.34562) 5749 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:38:10.872 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:38:10 smithi132 bash[27079]: cluster 2020-07-16T15:38:09.099992+0000 mgr.x (mgr.34562) 5750 : cluster [DBG] pgmap v3584: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:38:11.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:38:10 smithi188 bash[23329]: cluster 2020-07-16T15:38:09.099992+0000 mgr.x (mgr.34562) 5750 : cluster [DBG] pgmap v3584: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:38:12.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:38:11 smithi188 bash[23329]: audit 2020-07-16T15:38:11.461787+0000 mon.b (mon.2) 1268 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:38:12.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:38:11 smithi132 bash[27079]: audit 2020-07-16T15:38:11.461787+0000 mon.b (mon.2) 1268 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:38:13.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:38:12 smithi188 bash[23329]: cluster 2020-07-16T15:38:11.100430+0000 mgr.x (mgr.34562) 5751 : cluster [DBG] pgmap v3585: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:38:13.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:38:12 smithi188 bash[23329]: cephadm 2020-07-16T15:38:11.462400+0000 mgr.x (mgr.34562) 5752 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:38:13.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:38:12 smithi188 bash[23329]: cephadm 2020-07-16T15:38:11.462727+0000 mgr.x (mgr.34562) 5753 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:38:13.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:38:12 smithi132 bash[27079]: cluster 2020-07-16T15:38:11.100430+0000 mgr.x (mgr.34562) 5751 : cluster [DBG] pgmap v3585: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:38:13.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:38:12 smithi132 bash[27079]: cephadm 2020-07-16T15:38:11.462400+0000 mgr.x (mgr.34562) 5752 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:38:13.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:38:12 smithi132 bash[27079]: cephadm 2020-07-16T15:38:11.462727+0000 mgr.x (mgr.34562) 5753 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:38:15.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:38:14 smithi188 bash[23329]: cluster 2020-07-16T15:38:13.100792+0000 mgr.x (mgr.34562) 5754 : cluster [DBG] pgmap v3586: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:38:15.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:38:14 smithi132 bash[27079]: cluster 2020-07-16T15:38:13.100792+0000 mgr.x (mgr.34562) 5754 : cluster [DBG] pgmap v3586: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:38:17.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:38:16 smithi188 bash[23329]: cluster 2020-07-16T15:38:15.101305+0000 mgr.x (mgr.34562) 5755 : cluster [DBG] pgmap v3587: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:38:17.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:38:16 smithi132 bash[27079]: cluster 2020-07-16T15:38:15.101305+0000 mgr.x (mgr.34562) 5755 : cluster [DBG] pgmap v3587: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:38:19.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:38:18 smithi188 bash[23329]: cluster 2020-07-16T15:38:17.101699+0000 mgr.x (mgr.34562) 5756 : cluster [DBG] pgmap v3588: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:38:19.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:38:18 smithi132 bash[27079]: cluster 2020-07-16T15:38:17.101699+0000 mgr.x (mgr.34562) 5756 : cluster [DBG] pgmap v3588: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:38:21.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:38:20 smithi188 bash[23329]: cluster 2020-07-16T15:38:19.102088+0000 mgr.x (mgr.34562) 5757 : cluster [DBG] pgmap v3589: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:38:21.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:38:20 smithi132 bash[27079]: cluster 2020-07-16T15:38:19.102088+0000 mgr.x (mgr.34562) 5757 : cluster [DBG] pgmap v3589: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:38:23.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:38:22 smithi188 bash[23329]: cluster 2020-07-16T15:38:21.102470+0000 mgr.x (mgr.34562) 5758 : cluster [DBG] pgmap v3590: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:38:23.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:38:22 smithi132 bash[27079]: cluster 2020-07-16T15:38:21.102470+0000 mgr.x (mgr.34562) 5758 : cluster [DBG] pgmap v3590: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:38:25.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:38:24 smithi188 bash[23329]: cluster 2020-07-16T15:38:23.102984+0000 mgr.x (mgr.34562) 5759 : cluster [DBG] pgmap v3591: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:38:25.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:38:24 smithi132 bash[27079]: cluster 2020-07-16T15:38:23.102984+0000 mgr.x (mgr.34562) 5759 : cluster [DBG] pgmap v3591: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:38:27.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:38:26 smithi188 bash[23329]: cluster 2020-07-16T15:38:25.103399+0000 mgr.x (mgr.34562) 5760 : cluster [DBG] pgmap v3592: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:38:27.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:38:26 smithi188 bash[23329]: audit 2020-07-16T15:38:26.478357+0000 mon.b (mon.2) 1269 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:38:27.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:38:26 smithi132 bash[27079]: cluster 2020-07-16T15:38:25.103399+0000 mgr.x (mgr.34562) 5760 : cluster [DBG] pgmap v3592: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:38:27.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:38:26 smithi132 bash[27079]: audit 2020-07-16T15:38:26.478357+0000 mon.b (mon.2) 1269 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:38:28.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:38:27 smithi188 bash[23329]: cephadm 2020-07-16T15:38:26.479054+0000 mgr.x (mgr.34562) 5761 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:38:28.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:38:27 smithi188 bash[23329]: cephadm 2020-07-16T15:38:26.479134+0000 mgr.x (mgr.34562) 5762 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:38:28.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:38:27 smithi132 bash[27079]: cephadm 2020-07-16T15:38:26.479054+0000 mgr.x (mgr.34562) 5761 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:38:28.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:38:27 smithi132 bash[27079]: cephadm 2020-07-16T15:38:26.479134+0000 mgr.x (mgr.34562) 5762 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:38:29.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:38:28 smithi188 bash[23329]: cluster 2020-07-16T15:38:27.103868+0000 mgr.x (mgr.34562) 5763 : cluster [DBG] pgmap v3593: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:38:29.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:38:28 smithi132 bash[27079]: cluster 2020-07-16T15:38:27.103868+0000 mgr.x (mgr.34562) 5763 : cluster [DBG] pgmap v3593: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:38:31.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:38:30 smithi188 bash[23329]: cluster 2020-07-16T15:38:29.104216+0000 mgr.x (mgr.34562) 5764 : cluster [DBG] pgmap v3594: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:38:31.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:38:30 smithi132 bash[27079]: cluster 2020-07-16T15:38:29.104216+0000 mgr.x (mgr.34562) 5764 : cluster [DBG] pgmap v3594: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:38:33.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:38:32 smithi188 bash[23329]: cluster 2020-07-16T15:38:31.104596+0000 mgr.x (mgr.34562) 5765 : cluster [DBG] pgmap v3595: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:38:33.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:38:32 smithi132 bash[27079]: cluster 2020-07-16T15:38:31.104596+0000 mgr.x (mgr.34562) 5765 : cluster [DBG] pgmap v3595: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:38:35.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:38:34 smithi188 bash[23329]: cluster 2020-07-16T15:38:33.105064+0000 mgr.x (mgr.34562) 5766 : cluster [DBG] pgmap v3596: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:38:35.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:38:34 smithi132 bash[27079]: cluster 2020-07-16T15:38:33.105064+0000 mgr.x (mgr.34562) 5766 : cluster [DBG] pgmap v3596: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:38:37.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:38:36 smithi188 bash[23329]: cluster 2020-07-16T15:38:35.105450+0000 mgr.x (mgr.34562) 5767 : cluster [DBG] pgmap v3597: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:38:37.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:38:36 smithi132 bash[27079]: cluster 2020-07-16T15:38:35.105450+0000 mgr.x (mgr.34562) 5767 : cluster [DBG] pgmap v3597: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:38:37.693 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:38:37.957 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:38:37.957 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 3m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:38:37.957 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 3m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:38:37.958 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 3m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:38:37.958 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 3m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:38:37.958 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 3m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:38:37.958 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:38:37.958 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:38:37.959 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 3m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:38:37.959 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 3m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:38:37.959 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:38:37.959 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:38:37.959 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:38:37.960 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:38:37.960 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:38:37.960 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:38:37.960 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:38:37.960 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:38:37.960 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 3m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:38:38.255 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:38:38.255 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:38:38.256 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:38:38.256 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:38:38.256 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:38:38.256 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:38:38.256 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:38:38.257 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:38:38.257 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:38:38.257 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:38:38.257 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:38:38.257 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:38:38.258 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:38:38.258 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:38:38.258 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:38:38.258 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:38:38.258 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:38:39.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:38:38 smithi188 bash[23329]: cluster 2020-07-16T15:38:37.105977+0000 mgr.x (mgr.34562) 5768 : cluster [DBG] pgmap v3598: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:38:39.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:38:38 smithi188 bash[23329]: audit 2020-07-16T15:38:37.681160+0000 mgr.x (mgr.34562) 5769 : audit [DBG] from='client.28834 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:38:39.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:38:38 smithi188 bash[23329]: audit 2020-07-16T15:38:37.952988+0000 mgr.x (mgr.34562) 5770 : audit [DBG] from='client.28840 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:38:39.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:38:38 smithi188 bash[23329]: audit 2020-07-16T15:38:38.254656+0000 mon.c (mon.1) 405 : audit [DBG] from='client.? 172.21.15.132:0/2667180926' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:38:39.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:38:38 smithi132 bash[27079]: cluster 2020-07-16T15:38:37.105977+0000 mgr.x (mgr.34562) 5768 : cluster [DBG] pgmap v3598: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:38:39.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:38:38 smithi132 bash[27079]: audit 2020-07-16T15:38:37.681160+0000 mgr.x (mgr.34562) 5769 : audit [DBG] from='client.28834 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:38:39.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:38:38 smithi132 bash[27079]: audit 2020-07-16T15:38:37.952988+0000 mgr.x (mgr.34562) 5770 : audit [DBG] from='client.28840 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:38:39.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:38:38 smithi132 bash[27079]: audit 2020-07-16T15:38:38.254656+0000 mon.c (mon.1) 405 : audit [DBG] from='client.? 172.21.15.132:0/2667180926' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:38:41.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:38:40 smithi188 bash[23329]: cluster 2020-07-16T15:38:39.106367+0000 mgr.x (mgr.34562) 5771 : cluster [DBG] pgmap v3599: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:38:41.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:38:40 smithi132 bash[27079]: cluster 2020-07-16T15:38:39.106367+0000 mgr.x (mgr.34562) 5771 : cluster [DBG] pgmap v3599: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:38:42.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:38:41 smithi188 bash[23329]: audit 2020-07-16T15:38:41.493947+0000 mon.b (mon.2) 1270 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:38:42.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:38:41 smithi132 bash[27079]: audit 2020-07-16T15:38:41.493947+0000 mon.b (mon.2) 1270 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:38:43.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:38:42 smithi188 bash[23329]: cluster 2020-07-16T15:38:41.106704+0000 mgr.x (mgr.34562) 5772 : cluster [DBG] pgmap v3600: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:38:43.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:38:42 smithi188 bash[23329]: cephadm 2020-07-16T15:38:41.494714+0000 mgr.x (mgr.34562) 5773 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:38:43.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:38:42 smithi188 bash[23329]: cephadm 2020-07-16T15:38:41.495092+0000 mgr.x (mgr.34562) 5774 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:38:43.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:38:42 smithi132 bash[27079]: cluster 2020-07-16T15:38:41.106704+0000 mgr.x (mgr.34562) 5772 : cluster [DBG] pgmap v3600: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:38:43.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:38:42 smithi132 bash[27079]: cephadm 2020-07-16T15:38:41.494714+0000 mgr.x (mgr.34562) 5773 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:38:43.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:38:42 smithi132 bash[27079]: cephadm 2020-07-16T15:38:41.495092+0000 mgr.x (mgr.34562) 5774 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:38:45.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:38:44 smithi188 bash[23329]: cluster 2020-07-16T15:38:43.107095+0000 mgr.x (mgr.34562) 5775 : cluster [DBG] pgmap v3601: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:38:45.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:38:44 smithi132 bash[27079]: cluster 2020-07-16T15:38:43.107095+0000 mgr.x (mgr.34562) 5775 : cluster [DBG] pgmap v3601: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:38:47.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:38:46 smithi188 bash[23329]: cluster 2020-07-16T15:38:45.107562+0000 mgr.x (mgr.34562) 5776 : cluster [DBG] pgmap v3602: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:38:47.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:38:46 smithi132 bash[27079]: cluster 2020-07-16T15:38:45.107562+0000 mgr.x (mgr.34562) 5776 : cluster [DBG] pgmap v3602: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:38:49.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:38:48 smithi188 bash[23329]: cluster 2020-07-16T15:38:47.108046+0000 mgr.x (mgr.34562) 5777 : cluster [DBG] pgmap v3603: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:38:49.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:38:48 smithi132 bash[27079]: cluster 2020-07-16T15:38:47.108046+0000 mgr.x (mgr.34562) 5777 : cluster [DBG] pgmap v3603: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:38:51.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:38:50 smithi188 bash[23329]: cluster 2020-07-16T15:38:49.108478+0000 mgr.x (mgr.34562) 5778 : cluster [DBG] pgmap v3604: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:38:51.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:38:50 smithi132 bash[27079]: cluster 2020-07-16T15:38:49.108478+0000 mgr.x (mgr.34562) 5778 : cluster [DBG] pgmap v3604: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:38:53.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:38:52 smithi188 bash[23329]: cluster 2020-07-16T15:38:51.108895+0000 mgr.x (mgr.34562) 5779 : cluster [DBG] pgmap v3605: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:38:53.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:38:52 smithi132 bash[27079]: cluster 2020-07-16T15:38:51.108895+0000 mgr.x (mgr.34562) 5779 : cluster [DBG] pgmap v3605: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:38:55.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:38:54 smithi188 bash[23329]: cluster 2020-07-16T15:38:53.109426+0000 mgr.x (mgr.34562) 5780 : cluster [DBG] pgmap v3606: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:38:55.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:38:54 smithi132 bash[27079]: cluster 2020-07-16T15:38:53.109426+0000 mgr.x (mgr.34562) 5780 : cluster [DBG] pgmap v3606: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:38:57.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:38:56 smithi188 bash[23329]: cluster 2020-07-16T15:38:55.109781+0000 mgr.x (mgr.34562) 5781 : cluster [DBG] pgmap v3607: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:38:57.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:38:56 smithi188 bash[23329]: audit 2020-07-16T15:38:56.505800+0000 mon.b (mon.2) 1271 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:38:57.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:38:56 smithi132 bash[27079]: cluster 2020-07-16T15:38:55.109781+0000 mgr.x (mgr.34562) 5781 : cluster [DBG] pgmap v3607: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:38:57.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:38:56 smithi132 bash[27079]: audit 2020-07-16T15:38:56.505800+0000 mon.b (mon.2) 1271 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:38:58.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:38:57 smithi188 bash[23329]: cephadm 2020-07-16T15:38:56.506550+0000 mgr.x (mgr.34562) 5782 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:38:58.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:38:57 smithi188 bash[23329]: cephadm 2020-07-16T15:38:56.506766+0000 mgr.x (mgr.34562) 5783 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:38:58.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:38:57 smithi132 bash[27079]: cephadm 2020-07-16T15:38:56.506550+0000 mgr.x (mgr.34562) 5782 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:38:58.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:38:57 smithi132 bash[27079]: cephadm 2020-07-16T15:38:56.506766+0000 mgr.x (mgr.34562) 5783 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:38:59.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:38:58 smithi188 bash[23329]: cluster 2020-07-16T15:38:57.110169+0000 mgr.x (mgr.34562) 5784 : cluster [DBG] pgmap v3608: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:38:59.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:38:58 smithi132 bash[27079]: cluster 2020-07-16T15:38:57.110169+0000 mgr.x (mgr.34562) 5784 : cluster [DBG] pgmap v3608: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:39:01.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:39:00 smithi188 bash[23329]: cluster 2020-07-16T15:38:59.110583+0000 mgr.x (mgr.34562) 5785 : cluster [DBG] pgmap v3609: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:39:01.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:39:00 smithi132 bash[27079]: cluster 2020-07-16T15:38:59.110583+0000 mgr.x (mgr.34562) 5785 : cluster [DBG] pgmap v3609: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:39:03.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:39:02 smithi188 bash[23329]: cluster 2020-07-16T15:39:01.111071+0000 mgr.x (mgr.34562) 5786 : cluster [DBG] pgmap v3610: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:39:03.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:39:02 smithi132 bash[27079]: cluster 2020-07-16T15:39:01.111071+0000 mgr.x (mgr.34562) 5786 : cluster [DBG] pgmap v3610: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:39:05.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:39:04 smithi188 bash[23329]: cluster 2020-07-16T15:39:03.111672+0000 mgr.x (mgr.34562) 5787 : cluster [DBG] pgmap v3611: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:39:05.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:39:04 smithi132 bash[27079]: cluster 2020-07-16T15:39:03.111672+0000 mgr.x (mgr.34562) 5787 : cluster [DBG] pgmap v3611: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:39:07.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:39:06 smithi188 bash[23329]: cluster 2020-07-16T15:39:05.112168+0000 mgr.x (mgr.34562) 5788 : cluster [DBG] pgmap v3612: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:39:07.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:39:06 smithi132 bash[27079]: cluster 2020-07-16T15:39:05.112168+0000 mgr.x (mgr.34562) 5788 : cluster [DBG] pgmap v3612: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:39:08.557 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:39:08.819 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:39:08.820 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 4m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:39:08.820 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 4m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:39:08.820 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 4m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:39:08.820 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 4m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:39:08.820 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 4m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:39:08.821 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:39:08.821 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:39:08.821 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 4m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:39:08.821 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 4m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:39:08.821 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:39:08.822 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:39:08.822 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:39:08.822 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:39:08.822 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:39:08.822 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:39:08.823 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:39:08.823 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:39:08.823 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 4m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:39:09.117 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:39:09.117 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:39:09.117 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:39:09.118 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:39:09.118 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:39:09.118 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:39:09.118 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:39:09.118 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:39:09.119 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:39:09.119 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:39:09.119 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:39:09.119 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:39:09.119 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:39:09.119 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:39:09.120 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:39:09.120 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:39:09.120 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:39:09.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:39:08 smithi188 bash[23329]: cluster 2020-07-16T15:39:07.112691+0000 mgr.x (mgr.34562) 5789 : cluster [DBG] pgmap v3613: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:39:09.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:39:08 smithi132 bash[27079]: cluster 2020-07-16T15:39:07.112691+0000 mgr.x (mgr.34562) 5789 : cluster [DBG] pgmap v3613: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:39:10.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:39:09 smithi188 bash[23329]: audit 2020-07-16T15:39:08.546010+0000 mgr.x (mgr.34562) 5790 : audit [DBG] from='client.28852 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:39:10.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:39:09 smithi188 bash[23329]: audit 2020-07-16T15:39:08.815566+0000 mgr.x (mgr.34562) 5791 : audit [DBG] from='client.28858 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:39:10.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:39:09 smithi188 bash[23329]: audit 2020-07-16T15:39:09.116408+0000 mon.c (mon.1) 406 : audit [DBG] from='client.? 172.21.15.132:0/1189594850' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:39:10.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:39:09 smithi132 bash[27079]: audit 2020-07-16T15:39:08.546010+0000 mgr.x (mgr.34562) 5790 : audit [DBG] from='client.28852 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:39:10.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:39:09 smithi132 bash[27079]: audit 2020-07-16T15:39:08.815566+0000 mgr.x (mgr.34562) 5791 : audit [DBG] from='client.28858 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:39:10.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:39:09 smithi132 bash[27079]: audit 2020-07-16T15:39:09.116408+0000 mon.c (mon.1) 406 : audit [DBG] from='client.? 172.21.15.132:0/1189594850' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:39:11.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:39:10 smithi132 bash[27079]: cluster 2020-07-16T15:39:09.113057+0000 mgr.x (mgr.34562) 5792 : cluster [DBG] pgmap v3614: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:39:11.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:39:10 smithi188 bash[23329]: cluster 2020-07-16T15:39:09.113057+0000 mgr.x (mgr.34562) 5792 : cluster [DBG] pgmap v3614: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:39:12.270 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:39:11 smithi132 bash[27079]: audit 2020-07-16T15:39:11.524208+0000 mon.b (mon.2) 1272 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:39:12.271 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:39:11 smithi132 bash[27079]: audit 2020-07-16T15:39:11.525474+0000 mon.b (mon.2) 1273 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:39:12.271 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:39:11 smithi132 bash[27079]: audit 2020-07-16T15:39:11.526613+0000 mon.b (mon.2) 1274 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:39:12.271 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:39:11 smithi132 bash[27079]: audit 2020-07-16T15:39:11.528008+0000 mon.b (mon.2) 1275 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:39:12.271 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:39:11 smithi132 bash[27079]: audit 2020-07-16T15:39:11.529248+0000 mon.b (mon.2) 1276 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:39:12.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:39:11 smithi188 bash[23329]: audit 2020-07-16T15:39:11.524208+0000 mon.b (mon.2) 1272 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:39:12.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:39:11 smithi188 bash[23329]: audit 2020-07-16T15:39:11.525474+0000 mon.b (mon.2) 1273 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:39:12.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:39:11 smithi188 bash[23329]: audit 2020-07-16T15:39:11.526613+0000 mon.b (mon.2) 1274 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:39:12.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:39:11 smithi188 bash[23329]: audit 2020-07-16T15:39:11.528008+0000 mon.b (mon.2) 1275 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:39:12.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:39:11 smithi188 bash[23329]: audit 2020-07-16T15:39:11.529248+0000 mon.b (mon.2) 1276 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:39:13.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:39:12 smithi132 bash[27079]: cluster 2020-07-16T15:39:11.113469+0000 mgr.x (mgr.34562) 5793 : cluster [DBG] pgmap v3615: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:39:13.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:39:12 smithi132 bash[27079]: audit 2020-07-16T15:39:11.524566+0000 mgr.x (mgr.34562) 5794 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:39:13.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:39:12 smithi132 bash[27079]: audit 2020-07-16T15:39:11.525767+0000 mgr.x (mgr.34562) 5795 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:39:13.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:39:12 smithi132 bash[27079]: audit 2020-07-16T15:39:11.526910+0000 mgr.x (mgr.34562) 5796 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:39:13.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:39:12 smithi132 bash[27079]: cephadm 2020-07-16T15:39:11.527613+0000 mgr.x (mgr.34562) 5797 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:39:13.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:39:12 smithi132 bash[27079]: cephadm 2020-07-16T15:39:11.528796+0000 mgr.x (mgr.34562) 5798 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:39:13.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:39:12 smithi132 bash[27079]: cephadm 2020-07-16T15:39:11.529934+0000 mgr.x (mgr.34562) 5799 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:39:13.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:39:12 smithi132 bash[27079]: cephadm 2020-07-16T15:39:11.530234+0000 mgr.x (mgr.34562) 5800 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:39:13.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:39:12 smithi188 bash[23329]: cluster 2020-07-16T15:39:11.113469+0000 mgr.x (mgr.34562) 5793 : cluster [DBG] pgmap v3615: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:39:13.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:39:12 smithi188 bash[23329]: audit 2020-07-16T15:39:11.524566+0000 mgr.x (mgr.34562) 5794 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:39:13.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:39:12 smithi188 bash[23329]: audit 2020-07-16T15:39:11.525767+0000 mgr.x (mgr.34562) 5795 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:39:13.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:39:12 smithi188 bash[23329]: audit 2020-07-16T15:39:11.526910+0000 mgr.x (mgr.34562) 5796 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:39:13.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:39:12 smithi188 bash[23329]: cephadm 2020-07-16T15:39:11.527613+0000 mgr.x (mgr.34562) 5797 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:39:13.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:39:12 smithi188 bash[23329]: cephadm 2020-07-16T15:39:11.528796+0000 mgr.x (mgr.34562) 5798 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:39:13.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:39:12 smithi188 bash[23329]: cephadm 2020-07-16T15:39:11.529934+0000 mgr.x (mgr.34562) 5799 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:39:13.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:39:12 smithi188 bash[23329]: cephadm 2020-07-16T15:39:11.530234+0000 mgr.x (mgr.34562) 5800 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:39:15.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:39:14 smithi132 bash[27079]: cluster 2020-07-16T15:39:13.113898+0000 mgr.x (mgr.34562) 5801 : cluster [DBG] pgmap v3616: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:39:15.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:39:14 smithi132 bash[27079]: audit 2020-07-16T15:39:14.315540+0000 mon.b (mon.2) 1277 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:39:15.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:39:14 smithi188 bash[23329]: cluster 2020-07-16T15:39:13.113898+0000 mgr.x (mgr.34562) 5801 : cluster [DBG] pgmap v3616: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:39:15.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:39:14 smithi188 bash[23329]: audit 2020-07-16T15:39:14.315540+0000 mon.b (mon.2) 1277 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:39:16.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:39:15 smithi132 bash[27079]: cephadm 2020-07-16T15:39:14.316122+0000 mgr.x (mgr.34562) 5802 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:39:16.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:39:15 smithi132 bash[27079]: cephadm 2020-07-16T15:39:14.316551+0000 mgr.x (mgr.34562) 5803 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:39:16.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:39:15 smithi188 bash[23329]: cephadm 2020-07-16T15:39:14.316122+0000 mgr.x (mgr.34562) 5802 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:39:16.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:39:15 smithi188 bash[23329]: cephadm 2020-07-16T15:39:14.316551+0000 mgr.x (mgr.34562) 5803 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:39:17.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:39:16 smithi132 bash[27079]: cluster 2020-07-16T15:39:15.114395+0000 mgr.x (mgr.34562) 5804 : cluster [DBG] pgmap v3617: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:39:17.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:39:16 smithi188 bash[23329]: cluster 2020-07-16T15:39:15.114395+0000 mgr.x (mgr.34562) 5804 : cluster [DBG] pgmap v3617: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:39:19.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:39:18 smithi132 bash[27079]: cluster 2020-07-16T15:39:17.114964+0000 mgr.x (mgr.34562) 5805 : cluster [DBG] pgmap v3618: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:39:19.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:39:18 smithi188 bash[23329]: cluster 2020-07-16T15:39:17.114964+0000 mgr.x (mgr.34562) 5805 : cluster [DBG] pgmap v3618: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:39:21.284 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:39:20 smithi132 bash[27079]: cluster 2020-07-16T15:39:19.115507+0000 mgr.x (mgr.34562) 5806 : cluster [DBG] pgmap v3619: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:39:21.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:39:20 smithi188 bash[23329]: cluster 2020-07-16T15:39:19.115507+0000 mgr.x (mgr.34562) 5806 : cluster [DBG] pgmap v3619: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:39:23.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:39:22 smithi132 bash[27079]: cluster 2020-07-16T15:39:21.115990+0000 mgr.x (mgr.34562) 5807 : cluster [DBG] pgmap v3620: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:39:23.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:39:22 smithi188 bash[23329]: cluster 2020-07-16T15:39:21.115990+0000 mgr.x (mgr.34562) 5807 : cluster [DBG] pgmap v3620: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:39:25.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:39:24 smithi132 bash[27079]: cluster 2020-07-16T15:39:23.116398+0000 mgr.x (mgr.34562) 5808 : cluster [DBG] pgmap v3621: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:39:25.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:39:24 smithi188 bash[23329]: cluster 2020-07-16T15:39:23.116398+0000 mgr.x (mgr.34562) 5808 : cluster [DBG] pgmap v3621: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:39:27.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:39:26 smithi132 bash[27079]: cluster 2020-07-16T15:39:25.116796+0000 mgr.x (mgr.34562) 5809 : cluster [DBG] pgmap v3622: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:39:27.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:39:26 smithi188 bash[23329]: cluster 2020-07-16T15:39:25.116796+0000 mgr.x (mgr.34562) 5809 : cluster [DBG] pgmap v3622: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:39:29.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:39:28 smithi132 bash[27079]: cluster 2020-07-16T15:39:27.117404+0000 mgr.x (mgr.34562) 5810 : cluster [DBG] pgmap v3623: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:39:29.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:39:28 smithi188 bash[23329]: cluster 2020-07-16T15:39:27.117404+0000 mgr.x (mgr.34562) 5810 : cluster [DBG] pgmap v3623: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:39:30.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:39:29 smithi132 bash[27079]: audit 2020-07-16T15:39:29.330655+0000 mon.b (mon.2) 1278 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:39:30.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:39:29 smithi188 bash[23329]: audit 2020-07-16T15:39:29.330655+0000 mon.b (mon.2) 1278 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:39:31.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:39:30 smithi132 bash[27079]: cluster 2020-07-16T15:39:29.117793+0000 mgr.x (mgr.34562) 5811 : cluster [DBG] pgmap v3624: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:39:31.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:39:30 smithi132 bash[27079]: cephadm 2020-07-16T15:39:29.331341+0000 mgr.x (mgr.34562) 5812 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:39:31.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:39:30 smithi132 bash[27079]: cephadm 2020-07-16T15:39:29.331420+0000 mgr.x (mgr.34562) 5813 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:39:31.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:39:30 smithi188 bash[23329]: cluster 2020-07-16T15:39:29.117793+0000 mgr.x (mgr.34562) 5811 : cluster [DBG] pgmap v3624: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:39:31.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:39:30 smithi188 bash[23329]: cephadm 2020-07-16T15:39:29.331341+0000 mgr.x (mgr.34562) 5812 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:39:31.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:39:30 smithi188 bash[23329]: cephadm 2020-07-16T15:39:29.331420+0000 mgr.x (mgr.34562) 5813 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:39:33.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:39:32 smithi132 bash[27079]: cluster 2020-07-16T15:39:31.118257+0000 mgr.x (mgr.34562) 5814 : cluster [DBG] pgmap v3625: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:39:33.460 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:39:32 smithi188 bash[23329]: cluster 2020-07-16T15:39:31.118257+0000 mgr.x (mgr.34562) 5814 : cluster [DBG] pgmap v3625: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:39:35.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:39:34 smithi132 bash[27079]: cluster 2020-07-16T15:39:33.118701+0000 mgr.x (mgr.34562) 5815 : cluster [DBG] pgmap v3626: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:39:35.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:39:34 smithi188 bash[23329]: cluster 2020-07-16T15:39:33.118701+0000 mgr.x (mgr.34562) 5815 : cluster [DBG] pgmap v3626: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:39:37.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:39:36 smithi132 bash[27079]: cluster 2020-07-16T15:39:35.119070+0000 mgr.x (mgr.34562) 5816 : cluster [DBG] pgmap v3627: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:39:37.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:39:36 smithi188 bash[23329]: cluster 2020-07-16T15:39:35.119070+0000 mgr.x (mgr.34562) 5816 : cluster [DBG] pgmap v3627: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:39:39.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:39:38 smithi132 bash[27079]: cluster 2020-07-16T15:39:37.119608+0000 mgr.x (mgr.34562) 5817 : cluster [DBG] pgmap v3628: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:39:39.418 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:39:39.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:39:38 smithi188 bash[23329]: cluster 2020-07-16T15:39:37.119608+0000 mgr.x (mgr.34562) 5817 : cluster [DBG] pgmap v3628: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:39:39.679 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:39:39.679 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 4m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:39:39.680 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 4m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:39:39.680 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 4m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:39:39.680 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 4m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:39:39.680 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 4m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:39:39.680 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:39:39.681 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:39:39.681 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 4m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:39:39.681 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 4m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:39:39.681 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:39:39.681 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:39:39.682 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:39:39.682 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:39:39.682 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:39:39.682 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:39:39.683 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:39:39.683 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:39:39.683 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 4m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:39:39.974 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:39:39.974 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:39:39.975 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:39:39.975 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:39:39.975 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:39:39.975 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:39:39.975 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:39:39.976 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:39:39.976 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:39:39.976 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:39:39.976 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:39:39.976 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:39:39.976 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:39:39.977 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:39:39.977 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:39:39.977 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:39:39.977 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:39:40.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:39:39 smithi132 bash[27079]: audit 2020-07-16T15:39:39.973539+0000 mon.c (mon.1) 407 : audit [DBG] from='client.? 172.21.15.132:0/2145913464' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:39:40.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:39:39 smithi188 bash[23329]: audit 2020-07-16T15:39:39.973539+0000 mon.c (mon.1) 407 : audit [DBG] from='client.? 172.21.15.132:0/2145913464' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:39:41.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:39:40 smithi132 bash[27079]: cluster 2020-07-16T15:39:39.120058+0000 mgr.x (mgr.34562) 5818 : cluster [DBG] pgmap v3629: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:39:41.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:39:40 smithi132 bash[27079]: audit 2020-07-16T15:39:39.405938+0000 mgr.x (mgr.34562) 5819 : audit [DBG] from='client.28870 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:39:41.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:39:40 smithi132 bash[27079]: audit 2020-07-16T15:39:39.675033+0000 mgr.x (mgr.34562) 5820 : audit [DBG] from='client.28876 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:39:41.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:39:40 smithi188 bash[23329]: cluster 2020-07-16T15:39:39.120058+0000 mgr.x (mgr.34562) 5818 : cluster [DBG] pgmap v3629: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:39:41.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:39:40 smithi188 bash[23329]: audit 2020-07-16T15:39:39.405938+0000 mgr.x (mgr.34562) 5819 : audit [DBG] from='client.28870 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:39:41.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:39:40 smithi188 bash[23329]: audit 2020-07-16T15:39:39.675033+0000 mgr.x (mgr.34562) 5820 : audit [DBG] from='client.28876 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:39:43.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:39:42 smithi132 bash[27079]: cluster 2020-07-16T15:39:41.120570+0000 mgr.x (mgr.34562) 5821 : cluster [DBG] pgmap v3630: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:39:43.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:39:42 smithi188 bash[23329]: cluster 2020-07-16T15:39:41.120570+0000 mgr.x (mgr.34562) 5821 : cluster [DBG] pgmap v3630: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:39:45.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:39:45 smithi132 bash[27079]: cluster 2020-07-16T15:39:43.120983+0000 mgr.x (mgr.34562) 5822 : cluster [DBG] pgmap v3631: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:39:45.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:39:45 smithi132 bash[27079]: audit 2020-07-16T15:39:44.347190+0000 mon.b (mon.2) 1279 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:39:45.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:39:45 smithi188 bash[23329]: cluster 2020-07-16T15:39:43.120983+0000 mgr.x (mgr.34562) 5822 : cluster [DBG] pgmap v3631: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:39:45.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:39:45 smithi188 bash[23329]: audit 2020-07-16T15:39:44.347190+0000 mon.b (mon.2) 1279 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:39:46.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:39:46 smithi132 bash[27079]: cephadm 2020-07-16T15:39:44.347889+0000 mgr.x (mgr.34562) 5823 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:39:46.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:39:46 smithi132 bash[27079]: cephadm 2020-07-16T15:39:44.348029+0000 mgr.x (mgr.34562) 5824 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:39:46.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:39:46 smithi188 bash[23329]: cephadm 2020-07-16T15:39:44.347889+0000 mgr.x (mgr.34562) 5823 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:39:46.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:39:46 smithi188 bash[23329]: cephadm 2020-07-16T15:39:44.348029+0000 mgr.x (mgr.34562) 5824 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:39:47.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:39:47 smithi132 bash[27079]: cluster 2020-07-16T15:39:45.121486+0000 mgr.x (mgr.34562) 5825 : cluster [DBG] pgmap v3632: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:39:47.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:39:47 smithi188 bash[23329]: cluster 2020-07-16T15:39:45.121486+0000 mgr.x (mgr.34562) 5825 : cluster [DBG] pgmap v3632: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:39:49.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:39:49 smithi132 bash[27079]: cluster 2020-07-16T15:39:47.121883+0000 mgr.x (mgr.34562) 5826 : cluster [DBG] pgmap v3633: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:39:49.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:39:49 smithi188 bash[23329]: cluster 2020-07-16T15:39:47.121883+0000 mgr.x (mgr.34562) 5826 : cluster [DBG] pgmap v3633: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:39:51.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:39:51 smithi132 bash[27079]: cluster 2020-07-16T15:39:49.122338+0000 mgr.x (mgr.34562) 5827 : cluster [DBG] pgmap v3634: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:39:51.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:39:51 smithi188 bash[23329]: cluster 2020-07-16T15:39:49.122338+0000 mgr.x (mgr.34562) 5827 : cluster [DBG] pgmap v3634: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:39:53.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:39:53 smithi132 bash[27079]: cluster 2020-07-16T15:39:51.122745+0000 mgr.x (mgr.34562) 5828 : cluster [DBG] pgmap v3635: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:39:53.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:39:53 smithi188 bash[23329]: cluster 2020-07-16T15:39:51.122745+0000 mgr.x (mgr.34562) 5828 : cluster [DBG] pgmap v3635: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:39:55.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:39:55 smithi132 bash[27079]: cluster 2020-07-16T15:39:53.123156+0000 mgr.x (mgr.34562) 5829 : cluster [DBG] pgmap v3636: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:39:55.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:39:55 smithi188 bash[23329]: cluster 2020-07-16T15:39:53.123156+0000 mgr.x (mgr.34562) 5829 : cluster [DBG] pgmap v3636: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:39:57.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:39:57 smithi132 bash[27079]: cluster 2020-07-16T15:39:55.123645+0000 mgr.x (mgr.34562) 5830 : cluster [DBG] pgmap v3637: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:39:57.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:39:57 smithi188 bash[23329]: cluster 2020-07-16T15:39:55.123645+0000 mgr.x (mgr.34562) 5830 : cluster [DBG] pgmap v3637: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:39:59.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:39:59 smithi188 bash[23329]: cluster 2020-07-16T15:39:57.124199+0000 mgr.x (mgr.34562) 5831 : cluster [DBG] pgmap v3638: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:39:59.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:39:59 smithi132 bash[27079]: cluster 2020-07-16T15:39:57.124199+0000 mgr.x (mgr.34562) 5831 : cluster [DBG] pgmap v3638: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:40:00.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:40:00 smithi188 bash[23329]: audit 2020-07-16T15:39:59.363892+0000 mon.b (mon.2) 1280 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:40:00.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:40:00 smithi132 bash[27079]: audit 2020-07-16T15:39:59.363892+0000 mon.b (mon.2) 1280 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:40:01.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:40:01 smithi188 bash[23329]: cluster 2020-07-16T15:39:59.124623+0000 mgr.x (mgr.34562) 5832 : cluster [DBG] pgmap v3639: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:40:01.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:40:01 smithi188 bash[23329]: cephadm 2020-07-16T15:39:59.364594+0000 mgr.x (mgr.34562) 5833 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:40:01.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:40:01 smithi188 bash[23329]: cephadm 2020-07-16T15:39:59.364834+0000 mgr.x (mgr.34562) 5834 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:40:01.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:40:01 smithi132 bash[27079]: cluster 2020-07-16T15:39:59.124623+0000 mgr.x (mgr.34562) 5832 : cluster [DBG] pgmap v3639: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:40:01.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:40:01 smithi132 bash[27079]: cephadm 2020-07-16T15:39:59.364594+0000 mgr.x (mgr.34562) 5833 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:40:01.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:40:01 smithi132 bash[27079]: cephadm 2020-07-16T15:39:59.364834+0000 mgr.x (mgr.34562) 5834 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:40:03.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:40:03 smithi188 bash[23329]: cluster 2020-07-16T15:40:01.124943+0000 mgr.x (mgr.34562) 5835 : cluster [DBG] pgmap v3640: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:40:03.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:40:03 smithi132 bash[27079]: cluster 2020-07-16T15:40:01.124943+0000 mgr.x (mgr.34562) 5835 : cluster [DBG] pgmap v3640: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:40:05.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:40:05 smithi188 bash[23329]: cluster 2020-07-16T15:40:03.125318+0000 mgr.x (mgr.34562) 5836 : cluster [DBG] pgmap v3641: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:40:05.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:40:05 smithi132 bash[27079]: cluster 2020-07-16T15:40:03.125318+0000 mgr.x (mgr.34562) 5836 : cluster [DBG] pgmap v3641: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:40:07.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:40:07 smithi188 bash[23329]: cluster 2020-07-16T15:40:05.125655+0000 mgr.x (mgr.34562) 5837 : cluster [DBG] pgmap v3642: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:40:07.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:40:07 smithi132 bash[27079]: cluster 2020-07-16T15:40:05.125655+0000 mgr.x (mgr.34562) 5837 : cluster [DBG] pgmap v3642: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:40:09.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:40:09 smithi188 bash[23329]: cluster 2020-07-16T15:40:07.126019+0000 mgr.x (mgr.34562) 5838 : cluster [DBG] pgmap v3643: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:40:09.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:40:09 smithi132 bash[27079]: cluster 2020-07-16T15:40:07.126019+0000 mgr.x (mgr.34562) 5838 : cluster [DBG] pgmap v3643: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:40:10.274 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:40:10.533 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:40:10.534 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 5m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:40:10.534 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 5m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:40:10.534 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 5m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:40:10.534 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 5m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:40:10.534 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 5m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:40:10.535 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:40:10.535 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:40:10.535 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 5m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:40:10.535 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 5m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:40:10.535 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:40:10.536 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:40:10.536 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:40:10.536 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:40:10.536 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:40:10.536 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:40:10.537 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:40:10.537 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:40:10.537 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 5m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:40:10.833 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:40:10.833 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:40:10.833 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:40:10.834 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:40:10.834 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:40:10.834 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:40:10.834 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:40:10.834 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:40:10.835 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:40:10.835 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:40:10.835 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:40:10.835 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:40:10.835 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:40:10.836 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:40:10.836 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:40:10.836 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:40:10.836 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:40:11.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:40:11 smithi188 bash[23329]: cluster 2020-07-16T15:40:09.126402+0000 mgr.x (mgr.34562) 5839 : cluster [DBG] pgmap v3644: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:40:11.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:40:11 smithi188 bash[23329]: audit 2020-07-16T15:40:10.832283+0000 mon.c (mon.1) 408 : audit [DBG] from='client.? 172.21.15.132:0/1311906816' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:40:11.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:40:11 smithi132 bash[27079]: cluster 2020-07-16T15:40:09.126402+0000 mgr.x (mgr.34562) 5839 : cluster [DBG] pgmap v3644: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:40:11.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:40:11 smithi132 bash[27079]: audit 2020-07-16T15:40:10.832283+0000 mon.c (mon.1) 408 : audit [DBG] from='client.? 172.21.15.132:0/1311906816' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:40:12.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:40:12 smithi188 bash[23329]: audit 2020-07-16T15:40:10.261327+0000 mgr.x (mgr.34562) 5840 : audit [DBG] from='client.28888 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:40:12.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:40:12 smithi188 bash[23329]: audit 2020-07-16T15:40:10.529168+0000 mgr.x (mgr.34562) 5841 : audit [DBG] from='client.28894 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:40:12.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:40:12 smithi132 bash[27079]: audit 2020-07-16T15:40:10.261327+0000 mgr.x (mgr.34562) 5840 : audit [DBG] from='client.28888 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:40:12.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:40:12 smithi132 bash[27079]: audit 2020-07-16T15:40:10.529168+0000 mgr.x (mgr.34562) 5841 : audit [DBG] from='client.28894 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:40:13.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:40:13 smithi188 bash[23329]: cluster 2020-07-16T15:40:11.126866+0000 mgr.x (mgr.34562) 5842 : cluster [DBG] pgmap v3645: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:40:13.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:40:13 smithi132 bash[27079]: cluster 2020-07-16T15:40:11.126866+0000 mgr.x (mgr.34562) 5842 : cluster [DBG] pgmap v3645: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:40:15.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:40:15 smithi132 bash[27079]: cluster 2020-07-16T15:40:13.127323+0000 mgr.x (mgr.34562) 5843 : cluster [DBG] pgmap v3646: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:40:15.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:40:15 smithi132 bash[27079]: audit 2020-07-16T15:40:14.383031+0000 mon.b (mon.2) 1281 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:40:15.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:40:15 smithi132 bash[27079]: audit 2020-07-16T15:40:14.384505+0000 mon.b (mon.2) 1282 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:40:15.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:40:15 smithi132 bash[27079]: audit 2020-07-16T15:40:14.385742+0000 mon.b (mon.2) 1283 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:40:15.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:40:15 smithi132 bash[27079]: audit 2020-07-16T15:40:14.387247+0000 mon.b (mon.2) 1284 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:40:15.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:40:15 smithi132 bash[27079]: audit 2020-07-16T15:40:14.388430+0000 mon.b (mon.2) 1285 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:40:15.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:40:15 smithi188 bash[23329]: cluster 2020-07-16T15:40:13.127323+0000 mgr.x (mgr.34562) 5843 : cluster [DBG] pgmap v3646: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:40:15.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:40:15 smithi188 bash[23329]: audit 2020-07-16T15:40:14.383031+0000 mon.b (mon.2) 1281 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:40:15.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:40:15 smithi188 bash[23329]: audit 2020-07-16T15:40:14.384505+0000 mon.b (mon.2) 1282 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:40:15.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:40:15 smithi188 bash[23329]: audit 2020-07-16T15:40:14.385742+0000 mon.b (mon.2) 1283 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:40:15.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:40:15 smithi188 bash[23329]: audit 2020-07-16T15:40:14.387247+0000 mon.b (mon.2) 1284 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:40:15.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:40:15 smithi188 bash[23329]: audit 2020-07-16T15:40:14.388430+0000 mon.b (mon.2) 1285 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:40:16.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:40:16 smithi132 bash[27079]: audit 2020-07-16T15:40:14.383396+0000 mgr.x (mgr.34562) 5844 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:40:16.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:40:16 smithi132 bash[27079]: audit 2020-07-16T15:40:14.384803+0000 mgr.x (mgr.34562) 5845 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:40:16.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:40:16 smithi132 bash[27079]: audit 2020-07-16T15:40:14.386050+0000 mgr.x (mgr.34562) 5846 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:40:16.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:40:16 smithi132 bash[27079]: cephadm 2020-07-16T15:40:14.386768+0000 mgr.x (mgr.34562) 5847 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:40:16.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:40:16 smithi132 bash[27079]: cephadm 2020-07-16T15:40:14.388079+0000 mgr.x (mgr.34562) 5848 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:40:16.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:40:16 smithi132 bash[27079]: cephadm 2020-07-16T15:40:14.389169+0000 mgr.x (mgr.34562) 5849 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:40:16.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:40:16 smithi132 bash[27079]: cephadm 2020-07-16T15:40:14.389296+0000 mgr.x (mgr.34562) 5850 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:40:16.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:40:16 smithi188 bash[23329]: audit 2020-07-16T15:40:14.383396+0000 mgr.x (mgr.34562) 5844 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:40:16.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:40:16 smithi188 bash[23329]: audit 2020-07-16T15:40:14.384803+0000 mgr.x (mgr.34562) 5845 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:40:16.425 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:40:16 smithi188 bash[23329]: audit 2020-07-16T15:40:14.386050+0000 mgr.x (mgr.34562) 5846 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:40:16.425 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:40:16 smithi188 bash[23329]: cephadm 2020-07-16T15:40:14.386768+0000 mgr.x (mgr.34562) 5847 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:40:16.425 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:40:16 smithi188 bash[23329]: cephadm 2020-07-16T15:40:14.388079+0000 mgr.x (mgr.34562) 5848 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:40:16.426 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:40:16 smithi188 bash[23329]: cephadm 2020-07-16T15:40:14.389169+0000 mgr.x (mgr.34562) 5849 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:40:16.426 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:40:16 smithi188 bash[23329]: cephadm 2020-07-16T15:40:14.389296+0000 mgr.x (mgr.34562) 5850 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:40:17.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:40:17 smithi188 bash[23329]: cluster 2020-07-16T15:40:15.127748+0000 mgr.x (mgr.34562) 5851 : cluster [DBG] pgmap v3647: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:40:17.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:40:17 smithi132 bash[27079]: cluster 2020-07-16T15:40:15.127748+0000 mgr.x (mgr.34562) 5851 : cluster [DBG] pgmap v3647: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:40:18.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:40:18 smithi188 bash[23329]: audit 2020-07-16T15:40:17.303000+0000 mon.b (mon.2) 1286 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:40:18.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:40:18 smithi132 bash[27079]: audit 2020-07-16T15:40:17.303000+0000 mon.b (mon.2) 1286 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:40:19.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:40:19 smithi188 bash[23329]: cluster 2020-07-16T15:40:17.128132+0000 mgr.x (mgr.34562) 5852 : cluster [DBG] pgmap v3648: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:40:19.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:40:19 smithi188 bash[23329]: cephadm 2020-07-16T15:40:17.303591+0000 mgr.x (mgr.34562) 5853 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:40:19.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:40:19 smithi188 bash[23329]: cephadm 2020-07-16T15:40:17.303667+0000 mgr.x (mgr.34562) 5854 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:40:19.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:40:19 smithi132 bash[27079]: cluster 2020-07-16T15:40:17.128132+0000 mgr.x (mgr.34562) 5852 : cluster [DBG] pgmap v3648: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:40:19.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:40:19 smithi132 bash[27079]: cephadm 2020-07-16T15:40:17.303591+0000 mgr.x (mgr.34562) 5853 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:40:19.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:40:19 smithi132 bash[27079]: cephadm 2020-07-16T15:40:17.303667+0000 mgr.x (mgr.34562) 5854 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:40:21.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:40:21 smithi188 bash[23329]: cluster 2020-07-16T15:40:19.128485+0000 mgr.x (mgr.34562) 5855 : cluster [DBG] pgmap v3649: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:40:21.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:40:21 smithi132 bash[27079]: cluster 2020-07-16T15:40:19.128485+0000 mgr.x (mgr.34562) 5855 : cluster [DBG] pgmap v3649: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:40:23.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:40:23 smithi188 bash[23329]: cluster 2020-07-16T15:40:21.128930+0000 mgr.x (mgr.34562) 5856 : cluster [DBG] pgmap v3650: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:40:23.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:40:23 smithi132 bash[27079]: cluster 2020-07-16T15:40:21.128930+0000 mgr.x (mgr.34562) 5856 : cluster [DBG] pgmap v3650: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:40:25.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:40:25 smithi188 bash[23329]: cluster 2020-07-16T15:40:23.129500+0000 mgr.x (mgr.34562) 5857 : cluster [DBG] pgmap v3651: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:40:25.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:40:25 smithi132 bash[27079]: cluster 2020-07-16T15:40:23.129500+0000 mgr.x (mgr.34562) 5857 : cluster [DBG] pgmap v3651: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:40:27.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:40:27 smithi188 bash[23329]: cluster 2020-07-16T15:40:25.130064+0000 mgr.x (mgr.34562) 5858 : cluster [DBG] pgmap v3652: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:40:27.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:40:27 smithi132 bash[27079]: cluster 2020-07-16T15:40:25.130064+0000 mgr.x (mgr.34562) 5858 : cluster [DBG] pgmap v3652: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:40:29.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:40:29 smithi188 bash[23329]: cluster 2020-07-16T15:40:27.130613+0000 mgr.x (mgr.34562) 5859 : cluster [DBG] pgmap v3653: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:40:29.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:40:29 smithi132 bash[27079]: cluster 2020-07-16T15:40:27.130613+0000 mgr.x (mgr.34562) 5859 : cluster [DBG] pgmap v3653: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:40:31.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:40:31 smithi188 bash[23329]: cluster 2020-07-16T15:40:29.130968+0000 mgr.x (mgr.34562) 5860 : cluster [DBG] pgmap v3654: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:40:31.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:40:31 smithi132 bash[27079]: cluster 2020-07-16T15:40:29.130968+0000 mgr.x (mgr.34562) 5860 : cluster [DBG] pgmap v3654: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:40:33.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:40:33 smithi188 bash[23329]: cluster 2020-07-16T15:40:31.131478+0000 mgr.x (mgr.34562) 5861 : cluster [DBG] pgmap v3655: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:40:33.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:40:33 smithi188 bash[23329]: audit 2020-07-16T15:40:32.319416+0000 mon.b (mon.2) 1287 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:40:33.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:40:33 smithi132 bash[27079]: cluster 2020-07-16T15:40:31.131478+0000 mgr.x (mgr.34562) 5861 : cluster [DBG] pgmap v3655: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:40:33.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:40:33 smithi132 bash[27079]: audit 2020-07-16T15:40:32.319416+0000 mon.b (mon.2) 1287 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:40:34.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:40:34 smithi188 bash[23329]: cephadm 2020-07-16T15:40:32.320120+0000 mgr.x (mgr.34562) 5862 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:40:34.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:40:34 smithi188 bash[23329]: cephadm 2020-07-16T15:40:32.320314+0000 mgr.x (mgr.34562) 5863 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:40:34.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:40:34 smithi132 bash[27079]: cephadm 2020-07-16T15:40:32.320120+0000 mgr.x (mgr.34562) 5862 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:40:34.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:40:34 smithi132 bash[27079]: cephadm 2020-07-16T15:40:32.320314+0000 mgr.x (mgr.34562) 5863 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:40:35.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:40:35 smithi188 bash[23329]: cluster 2020-07-16T15:40:33.131978+0000 mgr.x (mgr.34562) 5864 : cluster [DBG] pgmap v3656: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:40:35.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:40:35 smithi132 bash[27079]: cluster 2020-07-16T15:40:33.131978+0000 mgr.x (mgr.34562) 5864 : cluster [DBG] pgmap v3656: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:40:37.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:40:37 smithi188 bash[23329]: cluster 2020-07-16T15:40:35.132398+0000 mgr.x (mgr.34562) 5865 : cluster [DBG] pgmap v3657: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:40:37.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:40:37 smithi132 bash[27079]: cluster 2020-07-16T15:40:35.132398+0000 mgr.x (mgr.34562) 5865 : cluster [DBG] pgmap v3657: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:40:39.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:40:39 smithi188 bash[23329]: cluster 2020-07-16T15:40:37.132835+0000 mgr.x (mgr.34562) 5866 : cluster [DBG] pgmap v3658: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:40:39.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:40:39 smithi132 bash[27079]: cluster 2020-07-16T15:40:37.132835+0000 mgr.x (mgr.34562) 5866 : cluster [DBG] pgmap v3658: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:40:41.132 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:40:41.392 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:40:41.393 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 5m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:40:41.393 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 5m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:40:41.393 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 5m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:40:41.393 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 5m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:40:41.393 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 5m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:40:41.394 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:40:41.394 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:40:41.394 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 5m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:40:41.394 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 5m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:40:41.394 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:40:41.395 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:40:41.395 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:40:41.395 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:40:41.395 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:40:41.395 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:40:41.395 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:40:41.396 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:40:41.396 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 5m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:40:41.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:40:41 smithi188 bash[23329]: cluster 2020-07-16T15:40:39.133299+0000 mgr.x (mgr.34562) 5867 : cluster [DBG] pgmap v3659: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:40:41.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:40:41 smithi132 bash[27079]: cluster 2020-07-16T15:40:39.133299+0000 mgr.x (mgr.34562) 5867 : cluster [DBG] pgmap v3659: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:40:41.698 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:40:41.699 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:40:41.699 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:40:41.699 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:40:41.700 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:40:41.700 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:40:41.700 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:40:41.700 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:40:41.700 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:40:41.701 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:40:41.701 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:40:41.701 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:40:41.701 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:40:41.701 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:40:41.702 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:40:41.702 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:40:41.702 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:40:42.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:40:42 smithi188 bash[23329]: audit 2020-07-16T15:40:41.119732+0000 mgr.x (mgr.34562) 5868 : audit [DBG] from='client.28906 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:40:42.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:40:42 smithi188 bash[23329]: audit 2020-07-16T15:40:41.698065+0000 mon.c (mon.1) 409 : audit [DBG] from='client.? 172.21.15.132:0/2966401571' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:40:42.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:40:42 smithi132 bash[27079]: audit 2020-07-16T15:40:41.119732+0000 mgr.x (mgr.34562) 5868 : audit [DBG] from='client.28906 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:40:42.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:40:42 smithi132 bash[27079]: audit 2020-07-16T15:40:41.698065+0000 mon.c (mon.1) 409 : audit [DBG] from='client.? 172.21.15.132:0/2966401571' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:40:43.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:40:43 smithi188 bash[23329]: cluster 2020-07-16T15:40:41.133784+0000 mgr.x (mgr.34562) 5869 : cluster [DBG] pgmap v3660: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:40:43.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:40:43 smithi188 bash[23329]: audit 2020-07-16T15:40:41.388001+0000 mgr.x (mgr.34562) 5870 : audit [DBG] from='client.28912 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:40:43.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:40:43 smithi132 bash[27079]: cluster 2020-07-16T15:40:41.133784+0000 mgr.x (mgr.34562) 5869 : cluster [DBG] pgmap v3660: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:40:43.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:40:43 smithi132 bash[27079]: audit 2020-07-16T15:40:41.388001+0000 mgr.x (mgr.34562) 5870 : audit [DBG] from='client.28912 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:40:44.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:40:44 smithi188 bash[23329]: cluster 2020-07-16T15:40:43.134393+0000 mgr.x (mgr.34562) 5871 : cluster [DBG] pgmap v3661: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:40:44.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:40:44 smithi132 bash[27079]: cluster 2020-07-16T15:40:43.134393+0000 mgr.x (mgr.34562) 5871 : cluster [DBG] pgmap v3661: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:40:46.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:40:46 smithi188 bash[23329]: cluster 2020-07-16T15:40:45.134841+0000 mgr.x (mgr.34562) 5872 : cluster [DBG] pgmap v3662: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:40:47.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:40:46 smithi132 bash[27079]: cluster 2020-07-16T15:40:45.134841+0000 mgr.x (mgr.34562) 5872 : cluster [DBG] pgmap v3662: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:40:47.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:40:47 smithi188 bash[23329]: audit 2020-07-16T15:40:47.324700+0000 mon.b (mon.2) 1288 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:40:48.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:40:47 smithi132 bash[27079]: audit 2020-07-16T15:40:47.324700+0000 mon.b (mon.2) 1288 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:40:48.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:40:48 smithi188 bash[23329]: cluster 2020-07-16T15:40:47.135224+0000 mgr.x (mgr.34562) 5873 : cluster [DBG] pgmap v3663: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:40:48.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:40:48 smithi188 bash[23329]: cephadm 2020-07-16T15:40:47.325426+0000 mgr.x (mgr.34562) 5874 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:40:48.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:40:48 smithi188 bash[23329]: cephadm 2020-07-16T15:40:47.325858+0000 mgr.x (mgr.34562) 5875 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:40:49.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:40:48 smithi132 bash[27079]: cluster 2020-07-16T15:40:47.135224+0000 mgr.x (mgr.34562) 5873 : cluster [DBG] pgmap v3663: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:40:49.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:40:48 smithi132 bash[27079]: cephadm 2020-07-16T15:40:47.325426+0000 mgr.x (mgr.34562) 5874 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:40:49.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:40:48 smithi132 bash[27079]: cephadm 2020-07-16T15:40:47.325858+0000 mgr.x (mgr.34562) 5875 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:40:50.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:40:50 smithi188 bash[23329]: cluster 2020-07-16T15:40:49.135623+0000 mgr.x (mgr.34562) 5876 : cluster [DBG] pgmap v3664: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:40:51.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:40:50 smithi132 bash[27079]: cluster 2020-07-16T15:40:49.135623+0000 mgr.x (mgr.34562) 5876 : cluster [DBG] pgmap v3664: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:40:52.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:40:52 smithi188 bash[23329]: cluster 2020-07-16T15:40:51.136071+0000 mgr.x (mgr.34562) 5877 : cluster [DBG] pgmap v3665: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:40:53.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:40:52 smithi132 bash[27079]: cluster 2020-07-16T15:40:51.136071+0000 mgr.x (mgr.34562) 5877 : cluster [DBG] pgmap v3665: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:40:54.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:40:54 smithi188 bash[23329]: cluster 2020-07-16T15:40:53.136497+0000 mgr.x (mgr.34562) 5878 : cluster [DBG] pgmap v3666: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:40:55.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:40:54 smithi132 bash[27079]: cluster 2020-07-16T15:40:53.136497+0000 mgr.x (mgr.34562) 5878 : cluster [DBG] pgmap v3666: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:40:56.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:40:56 smithi188 bash[23329]: cluster 2020-07-16T15:40:55.137099+0000 mgr.x (mgr.34562) 5879 : cluster [DBG] pgmap v3667: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:40:57.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:40:56 smithi132 bash[27079]: cluster 2020-07-16T15:40:55.137099+0000 mgr.x (mgr.34562) 5879 : cluster [DBG] pgmap v3667: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:40:58.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:40:58 smithi188 bash[23329]: cluster 2020-07-16T15:40:57.137471+0000 mgr.x (mgr.34562) 5880 : cluster [DBG] pgmap v3668: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:40:59.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:40:58 smithi132 bash[27079]: cluster 2020-07-16T15:40:57.137471+0000 mgr.x (mgr.34562) 5880 : cluster [DBG] pgmap v3668: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:41:00.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:41:00 smithi188 bash[23329]: cluster 2020-07-16T15:40:59.137927+0000 mgr.x (mgr.34562) 5881 : cluster [DBG] pgmap v3669: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:41:01.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:41:00 smithi132 bash[27079]: cluster 2020-07-16T15:40:59.137927+0000 mgr.x (mgr.34562) 5881 : cluster [DBG] pgmap v3669: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:41:02.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:41:02 smithi188 bash[23329]: cluster 2020-07-16T15:41:01.138372+0000 mgr.x (mgr.34562) 5882 : cluster [DBG] pgmap v3670: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:41:02.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:41:02 smithi188 bash[23329]: audit 2020-07-16T15:41:02.341460+0000 mon.b (mon.2) 1289 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:41:03.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:41:02 smithi132 bash[27079]: cluster 2020-07-16T15:41:01.138372+0000 mgr.x (mgr.34562) 5882 : cluster [DBG] pgmap v3670: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:41:03.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:41:02 smithi132 bash[27079]: audit 2020-07-16T15:41:02.341460+0000 mon.b (mon.2) 1289 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:41:03.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:41:03 smithi188 bash[23329]: cephadm 2020-07-16T15:41:02.342234+0000 mgr.x (mgr.34562) 5883 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:41:03.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:41:03 smithi188 bash[23329]: cephadm 2020-07-16T15:41:02.342672+0000 mgr.x (mgr.34562) 5884 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:41:04.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:41:03 smithi132 bash[27079]: cephadm 2020-07-16T15:41:02.342234+0000 mgr.x (mgr.34562) 5883 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:41:04.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:41:03 smithi132 bash[27079]: cephadm 2020-07-16T15:41:02.342672+0000 mgr.x (mgr.34562) 5884 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:41:04.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:41:04 smithi188 bash[23329]: cluster 2020-07-16T15:41:03.138839+0000 mgr.x (mgr.34562) 5885 : cluster [DBG] pgmap v3671: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:41:05.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:41:04 smithi132 bash[27079]: cluster 2020-07-16T15:41:03.138839+0000 mgr.x (mgr.34562) 5885 : cluster [DBG] pgmap v3671: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:41:06.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:41:06 smithi188 bash[23329]: cluster 2020-07-16T15:41:05.139368+0000 mgr.x (mgr.34562) 5886 : cluster [DBG] pgmap v3672: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:41:07.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:41:06 smithi132 bash[27079]: cluster 2020-07-16T15:41:05.139368+0000 mgr.x (mgr.34562) 5886 : cluster [DBG] pgmap v3672: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:41:08.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:41:08 smithi188 bash[23329]: cluster 2020-07-16T15:41:07.139766+0000 mgr.x (mgr.34562) 5887 : cluster [DBG] pgmap v3673: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:41:09.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:41:08 smithi132 bash[27079]: cluster 2020-07-16T15:41:07.139766+0000 mgr.x (mgr.34562) 5887 : cluster [DBG] pgmap v3673: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:41:10.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:41:10 smithi188 bash[23329]: cluster 2020-07-16T15:41:09.140162+0000 mgr.x (mgr.34562) 5888 : cluster [DBG] pgmap v3674: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:41:11.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:41:10 smithi132 bash[27079]: cluster 2020-07-16T15:41:09.140162+0000 mgr.x (mgr.34562) 5888 : cluster [DBG] pgmap v3674: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:41:11.998 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:41:12.257 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:41:12.258 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 6m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:41:12.258 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 6m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:41:12.259 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 6m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:41:12.259 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 6m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:41:12.259 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 6m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:41:12.259 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:41:12.259 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:41:12.260 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 6m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:41:12.260 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 6m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:41:12.260 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:41:12.260 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:41:12.260 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:41:12.260 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:41:12.261 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:41:12.261 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:41:12.261 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:41:12.261 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:41:12.262 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 6m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:41:12.556 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:41:12.556 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:41:12.557 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:41:12.557 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:41:12.557 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:41:12.561 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:41:12.561 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:41:12.562 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:41:12.562 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:41:12.562 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:41:12.562 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:41:12.562 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:41:12.563 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:41:12.563 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:41:12.563 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:41:12.563 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:41:12.563 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:41:12.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:41:12 smithi188 bash[23329]: cluster 2020-07-16T15:41:11.140669+0000 mgr.x (mgr.34562) 5889 : cluster [DBG] pgmap v3675: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:41:12.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:41:12 smithi188 bash[23329]: audit 2020-07-16T15:41:11.985530+0000 mgr.x (mgr.34562) 5890 : audit [DBG] from='client.28924 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:41:12.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:41:12 smithi188 bash[23329]: audit 2020-07-16T15:41:12.553489+0000 mon.c (mon.1) 410 : audit [DBG] from='client.? 172.21.15.132:0/719420482' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:41:13.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:41:12 smithi132 bash[27079]: cluster 2020-07-16T15:41:11.140669+0000 mgr.x (mgr.34562) 5889 : cluster [DBG] pgmap v3675: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:41:13.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:41:12 smithi132 bash[27079]: audit 2020-07-16T15:41:11.985530+0000 mgr.x (mgr.34562) 5890 : audit [DBG] from='client.28924 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:41:13.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:41:12 smithi132 bash[27079]: audit 2020-07-16T15:41:12.553489+0000 mon.c (mon.1) 410 : audit [DBG] from='client.? 172.21.15.132:0/719420482' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:41:13.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:41:13 smithi188 bash[23329]: audit 2020-07-16T15:41:12.253583+0000 mgr.x (mgr.34562) 5891 : audit [DBG] from='client.28930 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:41:14.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:41:13 smithi132 bash[27079]: audit 2020-07-16T15:41:12.253583+0000 mgr.x (mgr.34562) 5891 : audit [DBG] from='client.28930 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:41:14.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:41:14 smithi188 bash[23329]: cluster 2020-07-16T15:41:13.141172+0000 mgr.x (mgr.34562) 5892 : cluster [DBG] pgmap v3676: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:41:15.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:41:14 smithi132 bash[27079]: cluster 2020-07-16T15:41:13.141172+0000 mgr.x (mgr.34562) 5892 : cluster [DBG] pgmap v3676: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:41:16.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:41:16 smithi188 bash[23329]: cluster 2020-07-16T15:41:15.141642+0000 mgr.x (mgr.34562) 5893 : cluster [DBG] pgmap v3677: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:41:17.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:41:16 smithi132 bash[27079]: cluster 2020-07-16T15:41:15.141642+0000 mgr.x (mgr.34562) 5893 : cluster [DBG] pgmap v3677: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:41:17.916 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:41:17 smithi132 bash[27079]: audit 2020-07-16T15:41:17.360736+0000 mon.b (mon.2) 1290 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:41:17.917 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:41:17 smithi132 bash[27079]: audit 2020-07-16T15:41:17.362175+0000 mon.b (mon.2) 1291 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:41:17.917 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:41:17 smithi132 bash[27079]: audit 2020-07-16T15:41:17.364163+0000 mon.b (mon.2) 1292 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:41:17.917 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:41:17 smithi132 bash[27079]: audit 2020-07-16T15:41:17.365601+0000 mon.b (mon.2) 1293 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:41:17.918 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:41:17 smithi132 bash[27079]: audit 2020-07-16T15:41:17.366925+0000 mon.b (mon.2) 1294 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:41:17.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:41:17 smithi188 bash[23329]: audit 2020-07-16T15:41:17.360736+0000 mon.b (mon.2) 1290 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:41:17.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:41:17 smithi188 bash[23329]: audit 2020-07-16T15:41:17.362175+0000 mon.b (mon.2) 1291 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:41:17.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:41:17 smithi188 bash[23329]: audit 2020-07-16T15:41:17.364163+0000 mon.b (mon.2) 1292 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:41:17.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:41:17 smithi188 bash[23329]: audit 2020-07-16T15:41:17.365601+0000 mon.b (mon.2) 1293 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:41:17.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:41:17 smithi188 bash[23329]: audit 2020-07-16T15:41:17.366925+0000 mon.b (mon.2) 1294 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:41:18.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:41:18 smithi188 bash[23329]: cluster 2020-07-16T15:41:17.142085+0000 mgr.x (mgr.34562) 5894 : cluster [DBG] pgmap v3678: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:41:18.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:41:18 smithi188 bash[23329]: audit 2020-07-16T15:41:17.361104+0000 mgr.x (mgr.34562) 5895 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:41:18.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:41:18 smithi188 bash[23329]: audit 2020-07-16T15:41:17.363154+0000 mgr.x (mgr.34562) 5896 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:41:18.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:41:18 smithi188 bash[23329]: audit 2020-07-16T15:41:17.364467+0000 mgr.x (mgr.34562) 5897 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:41:18.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:41:18 smithi188 bash[23329]: cephadm 2020-07-16T15:41:17.365266+0000 mgr.x (mgr.34562) 5898 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:41:18.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:41:18 smithi188 bash[23329]: cephadm 2020-07-16T15:41:17.366500+0000 mgr.x (mgr.34562) 5899 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:41:18.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:41:18 smithi188 bash[23329]: cephadm 2020-07-16T15:41:17.367632+0000 mgr.x (mgr.34562) 5900 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:41:18.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:41:18 smithi188 bash[23329]: cephadm 2020-07-16T15:41:17.367860+0000 mgr.x (mgr.34562) 5901 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:41:19.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:41:18 smithi132 bash[27079]: cluster 2020-07-16T15:41:17.142085+0000 mgr.x (mgr.34562) 5894 : cluster [DBG] pgmap v3678: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:41:19.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:41:18 smithi132 bash[27079]: audit 2020-07-16T15:41:17.361104+0000 mgr.x (mgr.34562) 5895 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:41:19.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:41:18 smithi132 bash[27079]: audit 2020-07-16T15:41:17.363154+0000 mgr.x (mgr.34562) 5896 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:41:19.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:41:18 smithi132 bash[27079]: audit 2020-07-16T15:41:17.364467+0000 mgr.x (mgr.34562) 5897 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:41:19.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:41:18 smithi132 bash[27079]: cephadm 2020-07-16T15:41:17.365266+0000 mgr.x (mgr.34562) 5898 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:41:19.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:41:18 smithi132 bash[27079]: cephadm 2020-07-16T15:41:17.366500+0000 mgr.x (mgr.34562) 5899 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:41:19.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:41:18 smithi132 bash[27079]: cephadm 2020-07-16T15:41:17.367632+0000 mgr.x (mgr.34562) 5900 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:41:19.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:41:18 smithi132 bash[27079]: cephadm 2020-07-16T15:41:17.367860+0000 mgr.x (mgr.34562) 5901 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:41:20.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:41:20 smithi188 bash[23329]: cluster 2020-07-16T15:41:19.142502+0000 mgr.x (mgr.34562) 5902 : cluster [DBG] pgmap v3679: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:41:20.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:41:20 smithi188 bash[23329]: audit 2020-07-16T15:41:20.198102+0000 mon.b (mon.2) 1295 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:41:21.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:41:20 smithi132 bash[27079]: cluster 2020-07-16T15:41:19.142502+0000 mgr.x (mgr.34562) 5902 : cluster [DBG] pgmap v3679: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:41:21.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:41:20 smithi132 bash[27079]: audit 2020-07-16T15:41:20.198102+0000 mon.b (mon.2) 1295 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:41:21.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:41:21 smithi188 bash[23329]: cephadm 2020-07-16T15:41:20.198751+0000 mgr.x (mgr.34562) 5903 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:41:21.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:41:21 smithi188 bash[23329]: cephadm 2020-07-16T15:41:20.199154+0000 mgr.x (mgr.34562) 5904 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:41:22.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:41:21 smithi132 bash[27079]: cephadm 2020-07-16T15:41:20.198751+0000 mgr.x (mgr.34562) 5903 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:41:22.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:41:21 smithi132 bash[27079]: cephadm 2020-07-16T15:41:20.199154+0000 mgr.x (mgr.34562) 5904 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:41:22.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:41:22 smithi188 bash[23329]: cluster 2020-07-16T15:41:21.142920+0000 mgr.x (mgr.34562) 5905 : cluster [DBG] pgmap v3680: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:41:23.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:41:22 smithi132 bash[27079]: cluster 2020-07-16T15:41:21.142920+0000 mgr.x (mgr.34562) 5905 : cluster [DBG] pgmap v3680: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:41:25.034 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:41:24 smithi132 bash[27079]: cluster 2020-07-16T15:41:23.143320+0000 mgr.x (mgr.34562) 5906 : cluster [DBG] pgmap v3681: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:41:25.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:41:24 smithi188 bash[23329]: cluster 2020-07-16T15:41:23.143320+0000 mgr.x (mgr.34562) 5906 : cluster [DBG] pgmap v3681: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:41:27.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:41:26 smithi132 bash[27079]: cluster 2020-07-16T15:41:25.143829+0000 mgr.x (mgr.34562) 5907 : cluster [DBG] pgmap v3682: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:41:27.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:41:26 smithi188 bash[23329]: cluster 2020-07-16T15:41:25.143829+0000 mgr.x (mgr.34562) 5907 : cluster [DBG] pgmap v3682: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:41:29.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:41:28 smithi132 bash[27079]: cluster 2020-07-16T15:41:27.144414+0000 mgr.x (mgr.34562) 5908 : cluster [DBG] pgmap v3683: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:41:29.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:41:28 smithi188 bash[23329]: cluster 2020-07-16T15:41:27.144414+0000 mgr.x (mgr.34562) 5908 : cluster [DBG] pgmap v3683: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:41:31.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:41:30 smithi132 bash[27079]: cluster 2020-07-16T15:41:29.144788+0000 mgr.x (mgr.34562) 5909 : cluster [DBG] pgmap v3684: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:41:31.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:41:30 smithi188 bash[23329]: cluster 2020-07-16T15:41:29.144788+0000 mgr.x (mgr.34562) 5909 : cluster [DBG] pgmap v3684: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:41:33.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:41:32 smithi132 bash[27079]: cluster 2020-07-16T15:41:31.145271+0000 mgr.x (mgr.34562) 5910 : cluster [DBG] pgmap v3685: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:41:33.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:41:32 smithi188 bash[23329]: cluster 2020-07-16T15:41:31.145271+0000 mgr.x (mgr.34562) 5910 : cluster [DBG] pgmap v3685: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:41:35.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:41:34 smithi132 bash[27079]: cluster 2020-07-16T15:41:33.145827+0000 mgr.x (mgr.34562) 5911 : cluster [DBG] pgmap v3686: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:41:35.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:41:34 smithi188 bash[23329]: cluster 2020-07-16T15:41:33.145827+0000 mgr.x (mgr.34562) 5911 : cluster [DBG] pgmap v3686: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:41:36.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:41:35 smithi132 bash[27079]: audit 2020-07-16T15:41:35.214608+0000 mon.b (mon.2) 1296 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:41:36.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:41:35 smithi188 bash[23329]: audit 2020-07-16T15:41:35.214608+0000 mon.b (mon.2) 1296 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:41:37.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:41:36 smithi132 bash[27079]: cluster 2020-07-16T15:41:35.146308+0000 mgr.x (mgr.34562) 5912 : cluster [DBG] pgmap v3687: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:41:37.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:41:36 smithi132 bash[27079]: cephadm 2020-07-16T15:41:35.215322+0000 mgr.x (mgr.34562) 5913 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:41:37.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:41:36 smithi132 bash[27079]: cephadm 2020-07-16T15:41:35.215671+0000 mgr.x (mgr.34562) 5914 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:41:37.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:41:36 smithi188 bash[23329]: cluster 2020-07-16T15:41:35.146308+0000 mgr.x (mgr.34562) 5912 : cluster [DBG] pgmap v3687: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:41:37.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:41:36 smithi188 bash[23329]: cephadm 2020-07-16T15:41:35.215322+0000 mgr.x (mgr.34562) 5913 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:41:37.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:41:36 smithi188 bash[23329]: cephadm 2020-07-16T15:41:35.215671+0000 mgr.x (mgr.34562) 5914 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:41:39.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:41:38 smithi132 bash[27079]: cluster 2020-07-16T15:41:37.146799+0000 mgr.x (mgr.34562) 5915 : cluster [DBG] pgmap v3688: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:41:39.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:41:38 smithi188 bash[23329]: cluster 2020-07-16T15:41:37.146799+0000 mgr.x (mgr.34562) 5915 : cluster [DBG] pgmap v3688: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:41:41.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:41:40 smithi132 bash[27079]: cluster 2020-07-16T15:41:39.147193+0000 mgr.x (mgr.34562) 5916 : cluster [DBG] pgmap v3689: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:41:41.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:41:40 smithi188 bash[23329]: cluster 2020-07-16T15:41:39.147193+0000 mgr.x (mgr.34562) 5916 : cluster [DBG] pgmap v3689: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:41:42.851 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:41:43.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:41:42 smithi132 bash[27079]: cluster 2020-07-16T15:41:41.147706+0000 mgr.x (mgr.34562) 5917 : cluster [DBG] pgmap v3690: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:41:43.113 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:41:43.113 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 6m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:41:43.113 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 6m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:41:43.113 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 6m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:41:43.114 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 6m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:41:43.114 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 6m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:41:43.114 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:41:43.114 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:41:43.114 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 6m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:41:43.115 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 6m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:41:43.115 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:41:43.115 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:41:43.115 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:41:43.115 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:41:43.116 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:41:43.116 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:41:43.116 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:41:43.116 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:41:43.116 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 6m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:41:43.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:41:42 smithi188 bash[23329]: cluster 2020-07-16T15:41:41.147706+0000 mgr.x (mgr.34562) 5917 : cluster [DBG] pgmap v3690: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:41:43.409 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:41:43.409 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:41:43.410 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:41:43.410 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:41:43.410 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:41:43.410 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:41:43.410 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:41:43.411 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:41:43.411 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:41:43.411 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:41:43.411 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:41:43.411 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:41:43.412 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:41:43.412 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:41:43.412 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:41:43.412 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:41:43.412 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:41:44.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:41:43 smithi132 bash[27079]: audit 2020-07-16T15:41:42.840475+0000 mgr.x (mgr.34562) 5918 : audit [DBG] from='client.28942 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:41:44.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:41:43 smithi132 bash[27079]: audit 2020-07-16T15:41:43.108694+0000 mgr.x (mgr.34562) 5919 : audit [DBG] from='client.28948 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:41:44.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:41:43 smithi132 bash[27079]: audit 2020-07-16T15:41:43.408282+0000 mon.c (mon.1) 411 : audit [DBG] from='client.? 172.21.15.132:0/1482887956' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:41:44.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:41:43 smithi188 bash[23329]: audit 2020-07-16T15:41:42.840475+0000 mgr.x (mgr.34562) 5918 : audit [DBG] from='client.28942 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:41:44.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:41:43 smithi188 bash[23329]: audit 2020-07-16T15:41:43.108694+0000 mgr.x (mgr.34562) 5919 : audit [DBG] from='client.28948 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:41:44.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:41:43 smithi188 bash[23329]: audit 2020-07-16T15:41:43.408282+0000 mon.c (mon.1) 411 : audit [DBG] from='client.? 172.21.15.132:0/1482887956' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:41:45.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:41:44 smithi132 bash[27079]: cluster 2020-07-16T15:41:43.148120+0000 mgr.x (mgr.34562) 5920 : cluster [DBG] pgmap v3691: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:41:45.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:41:44 smithi188 bash[23329]: cluster 2020-07-16T15:41:43.148120+0000 mgr.x (mgr.34562) 5920 : cluster [DBG] pgmap v3691: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:41:47.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:41:46 smithi132 bash[27079]: cluster 2020-07-16T15:41:45.148537+0000 mgr.x (mgr.34562) 5921 : cluster [DBG] pgmap v3692: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:41:47.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:41:46 smithi188 bash[23329]: cluster 2020-07-16T15:41:45.148537+0000 mgr.x (mgr.34562) 5921 : cluster [DBG] pgmap v3692: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:41:49.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:41:48 smithi132 bash[27079]: cluster 2020-07-16T15:41:47.149005+0000 mgr.x (mgr.34562) 5922 : cluster [DBG] pgmap v3693: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:41:49.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:41:48 smithi188 bash[23329]: cluster 2020-07-16T15:41:47.149005+0000 mgr.x (mgr.34562) 5922 : cluster [DBG] pgmap v3693: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:41:51.033 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:41:50 smithi132 bash[27079]: cluster 2020-07-16T15:41:49.149463+0000 mgr.x (mgr.34562) 5923 : cluster [DBG] pgmap v3694: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:41:51.034 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:41:50 smithi132 bash[27079]: audit 2020-07-16T15:41:50.230988+0000 mon.b (mon.2) 1297 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:41:51.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:41:50 smithi188 bash[23329]: cluster 2020-07-16T15:41:49.149463+0000 mgr.x (mgr.34562) 5923 : cluster [DBG] pgmap v3694: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:41:51.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:41:50 smithi188 bash[23329]: audit 2020-07-16T15:41:50.230988+0000 mon.b (mon.2) 1297 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:41:52.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:41:51 smithi132 bash[27079]: cephadm 2020-07-16T15:41:50.231783+0000 mgr.x (mgr.34562) 5924 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:41:52.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:41:51 smithi132 bash[27079]: cephadm 2020-07-16T15:41:50.231860+0000 mgr.x (mgr.34562) 5925 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:41:52.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:41:51 smithi188 bash[23329]: cephadm 2020-07-16T15:41:50.231783+0000 mgr.x (mgr.34562) 5924 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:41:52.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:41:51 smithi188 bash[23329]: cephadm 2020-07-16T15:41:50.231860+0000 mgr.x (mgr.34562) 5925 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:41:53.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:41:52 smithi132 bash[27079]: cluster 2020-07-16T15:41:51.149795+0000 mgr.x (mgr.34562) 5926 : cluster [DBG] pgmap v3695: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:41:53.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:41:52 smithi188 bash[23329]: cluster 2020-07-16T15:41:51.149795+0000 mgr.x (mgr.34562) 5926 : cluster [DBG] pgmap v3695: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:41:55.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:41:54 smithi132 bash[27079]: cluster 2020-07-16T15:41:53.150245+0000 mgr.x (mgr.34562) 5927 : cluster [DBG] pgmap v3696: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:41:55.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:41:54 smithi188 bash[23329]: cluster 2020-07-16T15:41:53.150245+0000 mgr.x (mgr.34562) 5927 : cluster [DBG] pgmap v3696: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:41:57.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:41:56 smithi132 bash[27079]: cluster 2020-07-16T15:41:55.150667+0000 mgr.x (mgr.34562) 5928 : cluster [DBG] pgmap v3697: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:41:57.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:41:56 smithi188 bash[23329]: cluster 2020-07-16T15:41:55.150667+0000 mgr.x (mgr.34562) 5928 : cluster [DBG] pgmap v3697: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:41:59.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:41:58 smithi132 bash[27079]: cluster 2020-07-16T15:41:57.151159+0000 mgr.x (mgr.34562) 5929 : cluster [DBG] pgmap v3698: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:41:59.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:41:58 smithi188 bash[23329]: cluster 2020-07-16T15:41:57.151159+0000 mgr.x (mgr.34562) 5929 : cluster [DBG] pgmap v3698: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:42:01.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:42:00 smithi132 bash[27079]: cluster 2020-07-16T15:41:59.151601+0000 mgr.x (mgr.34562) 5930 : cluster [DBG] pgmap v3699: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:42:01.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:42:00 smithi188 bash[23329]: cluster 2020-07-16T15:41:59.151601+0000 mgr.x (mgr.34562) 5930 : cluster [DBG] pgmap v3699: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:42:03.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:42:02 smithi132 bash[27079]: cluster 2020-07-16T15:42:01.152086+0000 mgr.x (mgr.34562) 5931 : cluster [DBG] pgmap v3700: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:42:03.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:42:02 smithi188 bash[23329]: cluster 2020-07-16T15:42:01.152086+0000 mgr.x (mgr.34562) 5931 : cluster [DBG] pgmap v3700: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:42:05.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:42:04 smithi132 bash[27079]: cluster 2020-07-16T15:42:03.152534+0000 mgr.x (mgr.34562) 5932 : cluster [DBG] pgmap v3701: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:42:05.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:42:04 smithi188 bash[23329]: cluster 2020-07-16T15:42:03.152534+0000 mgr.x (mgr.34562) 5932 : cluster [DBG] pgmap v3701: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:42:06.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:42:05 smithi132 bash[27079]: audit 2020-07-16T15:42:05.247646+0000 mon.b (mon.2) 1298 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:42:06.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:42:05 smithi188 bash[23329]: audit 2020-07-16T15:42:05.247646+0000 mon.b (mon.2) 1298 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:42:07.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:42:06 smithi132 bash[27079]: cluster 2020-07-16T15:42:05.152918+0000 mgr.x (mgr.34562) 5933 : cluster [DBG] pgmap v3702: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:42:07.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:42:06 smithi132 bash[27079]: cephadm 2020-07-16T15:42:05.248307+0000 mgr.x (mgr.34562) 5934 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:42:07.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:42:06 smithi132 bash[27079]: cephadm 2020-07-16T15:42:05.248723+0000 mgr.x (mgr.34562) 5935 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:42:07.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:42:06 smithi188 bash[23329]: cluster 2020-07-16T15:42:05.152918+0000 mgr.x (mgr.34562) 5933 : cluster [DBG] pgmap v3702: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:42:07.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:42:06 smithi188 bash[23329]: cephadm 2020-07-16T15:42:05.248307+0000 mgr.x (mgr.34562) 5934 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:42:07.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:42:06 smithi188 bash[23329]: cephadm 2020-07-16T15:42:05.248723+0000 mgr.x (mgr.34562) 5935 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:42:09.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:42:08 smithi132 bash[27079]: cluster 2020-07-16T15:42:07.153370+0000 mgr.x (mgr.34562) 5936 : cluster [DBG] pgmap v3703: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:42:09.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:42:08 smithi188 bash[23329]: cluster 2020-07-16T15:42:07.153370+0000 mgr.x (mgr.34562) 5936 : cluster [DBG] pgmap v3703: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:42:11.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:42:10 smithi132 bash[27079]: cluster 2020-07-16T15:42:09.153769+0000 mgr.x (mgr.34562) 5937 : cluster [DBG] pgmap v3704: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:42:11.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:42:10 smithi188 bash[23329]: cluster 2020-07-16T15:42:09.153769+0000 mgr.x (mgr.34562) 5937 : cluster [DBG] pgmap v3704: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:42:13.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:42:12 smithi132 bash[27079]: cluster 2020-07-16T15:42:11.154166+0000 mgr.x (mgr.34562) 5938 : cluster [DBG] pgmap v3705: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:42:13.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:42:12 smithi188 bash[23329]: cluster 2020-07-16T15:42:11.154166+0000 mgr.x (mgr.34562) 5938 : cluster [DBG] pgmap v3705: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:42:13.707 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:42:13.966 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:42:13.967 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 7m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:42:13.967 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 7m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:42:13.967 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 7m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:42:13.967 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 7m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:42:13.967 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 7m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:42:13.968 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:42:13.968 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:42:13.968 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 7m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:42:13.968 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 7m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:42:13.968 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:42:13.969 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:42:13.969 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:42:13.969 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:42:13.969 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:42:13.969 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:42:13.970 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:42:13.970 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:42:13.970 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 7m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:42:14.265 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:42:14.265 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:42:14.266 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:42:14.266 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:42:14.266 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:42:14.266 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:42:14.266 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:42:14.267 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:42:14.267 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:42:14.267 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:42:14.268 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:42:14.268 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:42:14.268 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:42:14.268 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:42:14.269 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:42:14.269 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:42:14.269 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:42:15.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:42:14 smithi132 bash[27079]: cluster 2020-07-16T15:42:13.154583+0000 mgr.x (mgr.34562) 5939 : cluster [DBG] pgmap v3706: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:42:15.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:42:14 smithi132 bash[27079]: audit 2020-07-16T15:42:13.696093+0000 mgr.x (mgr.34562) 5940 : audit [DBG] from='client.28960 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:42:15.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:42:14 smithi132 bash[27079]: audit 2020-07-16T15:42:13.962480+0000 mgr.x (mgr.34562) 5941 : audit [DBG] from='client.28966 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:42:15.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:42:14 smithi132 bash[27079]: audit 2020-07-16T15:42:14.264513+0000 mon.c (mon.1) 412 : audit [DBG] from='client.? 172.21.15.132:0/1805850408' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:42:15.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:42:14 smithi188 bash[23329]: cluster 2020-07-16T15:42:13.154583+0000 mgr.x (mgr.34562) 5939 : cluster [DBG] pgmap v3706: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:42:15.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:42:14 smithi188 bash[23329]: audit 2020-07-16T15:42:13.696093+0000 mgr.x (mgr.34562) 5940 : audit [DBG] from='client.28960 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:42:15.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:42:14 smithi188 bash[23329]: audit 2020-07-16T15:42:13.962480+0000 mgr.x (mgr.34562) 5941 : audit [DBG] from='client.28966 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:42:15.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:42:14 smithi188 bash[23329]: audit 2020-07-16T15:42:14.264513+0000 mon.c (mon.1) 412 : audit [DBG] from='client.? 172.21.15.132:0/1805850408' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:42:17.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:42:16 smithi188 bash[23329]: cluster 2020-07-16T15:42:15.155094+0000 mgr.x (mgr.34562) 5942 : cluster [DBG] pgmap v3707: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:42:17.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:42:16 smithi132 bash[27079]: cluster 2020-07-16T15:42:15.155094+0000 mgr.x (mgr.34562) 5942 : cluster [DBG] pgmap v3707: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:42:19.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:42:18 smithi188 bash[23329]: cluster 2020-07-16T15:42:17.155532+0000 mgr.x (mgr.34562) 5943 : cluster [DBG] pgmap v3708: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:42:19.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:42:18 smithi132 bash[27079]: cluster 2020-07-16T15:42:17.155532+0000 mgr.x (mgr.34562) 5943 : cluster [DBG] pgmap v3708: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:42:21.116 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:42:20 smithi132 bash[27079]: cluster 2020-07-16T15:42:19.155912+0000 mgr.x (mgr.34562) 5944 : cluster [DBG] pgmap v3709: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:42:21.117 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:42:20 smithi132 bash[27079]: audit 2020-07-16T15:42:20.266732+0000 mon.b (mon.2) 1299 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:42:21.117 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:42:20 smithi132 bash[27079]: audit 2020-07-16T15:42:20.268080+0000 mon.b (mon.2) 1300 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:42:21.117 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:42:20 smithi132 bash[27079]: audit 2020-07-16T15:42:20.269611+0000 mon.b (mon.2) 1301 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:42:21.117 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:42:20 smithi132 bash[27079]: audit 2020-07-16T15:42:20.270989+0000 mon.b (mon.2) 1302 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:42:21.117 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:42:20 smithi132 bash[27079]: audit 2020-07-16T15:42:20.272180+0000 mon.b (mon.2) 1303 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:42:21.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:42:20 smithi188 bash[23329]: cluster 2020-07-16T15:42:19.155912+0000 mgr.x (mgr.34562) 5944 : cluster [DBG] pgmap v3709: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:42:21.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:42:20 smithi188 bash[23329]: audit 2020-07-16T15:42:20.266732+0000 mon.b (mon.2) 1299 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:42:21.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:42:20 smithi188 bash[23329]: audit 2020-07-16T15:42:20.268080+0000 mon.b (mon.2) 1300 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:42:21.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:42:20 smithi188 bash[23329]: audit 2020-07-16T15:42:20.269611+0000 mon.b (mon.2) 1301 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:42:21.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:42:20 smithi188 bash[23329]: audit 2020-07-16T15:42:20.270989+0000 mon.b (mon.2) 1302 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:42:21.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:42:20 smithi188 bash[23329]: audit 2020-07-16T15:42:20.272180+0000 mon.b (mon.2) 1303 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:42:22.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:42:21 smithi132 bash[27079]: audit 2020-07-16T15:42:20.267097+0000 mgr.x (mgr.34562) 5945 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:42:22.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:42:21 smithi132 bash[27079]: audit 2020-07-16T15:42:20.268496+0000 mgr.x (mgr.34562) 5946 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:42:22.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:42:21 smithi132 bash[27079]: audit 2020-07-16T15:42:20.269900+0000 mgr.x (mgr.34562) 5947 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:42:22.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:42:21 smithi132 bash[27079]: cephadm 2020-07-16T15:42:20.270629+0000 mgr.x (mgr.34562) 5948 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:42:22.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:42:21 smithi132 bash[27079]: cephadm 2020-07-16T15:42:20.271785+0000 mgr.x (mgr.34562) 5949 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:42:22.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:42:21 smithi132 bash[27079]: cephadm 2020-07-16T15:42:20.272899+0000 mgr.x (mgr.34562) 5950 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:42:22.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:42:21 smithi132 bash[27079]: cephadm 2020-07-16T15:42:20.273073+0000 mgr.x (mgr.34562) 5951 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:42:22.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:42:21 smithi188 bash[23329]: audit 2020-07-16T15:42:20.267097+0000 mgr.x (mgr.34562) 5945 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:42:22.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:42:21 smithi188 bash[23329]: audit 2020-07-16T15:42:20.268496+0000 mgr.x (mgr.34562) 5946 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:42:22.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:42:21 smithi188 bash[23329]: audit 2020-07-16T15:42:20.269900+0000 mgr.x (mgr.34562) 5947 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:42:22.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:42:21 smithi188 bash[23329]: cephadm 2020-07-16T15:42:20.270629+0000 mgr.x (mgr.34562) 5948 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:42:22.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:42:21 smithi188 bash[23329]: cephadm 2020-07-16T15:42:20.271785+0000 mgr.x (mgr.34562) 5949 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:42:22.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:42:21 smithi188 bash[23329]: cephadm 2020-07-16T15:42:20.272899+0000 mgr.x (mgr.34562) 5950 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:42:22.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:42:21 smithi188 bash[23329]: cephadm 2020-07-16T15:42:20.273073+0000 mgr.x (mgr.34562) 5951 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:42:23.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:42:22 smithi132 bash[27079]: cluster 2020-07-16T15:42:21.156448+0000 mgr.x (mgr.34562) 5952 : cluster [DBG] pgmap v3710: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:42:23.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:42:22 smithi188 bash[23329]: cluster 2020-07-16T15:42:21.156448+0000 mgr.x (mgr.34562) 5952 : cluster [DBG] pgmap v3710: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:42:24.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:42:23 smithi188 bash[23329]: audit 2020-07-16T15:42:23.161130+0000 mon.b (mon.2) 1304 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:42:24.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:42:23 smithi132 bash[27079]: audit 2020-07-16T15:42:23.161130+0000 mon.b (mon.2) 1304 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:42:25.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:42:24 smithi188 bash[23329]: cluster 2020-07-16T15:42:23.156920+0000 mgr.x (mgr.34562) 5953 : cluster [DBG] pgmap v3711: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:42:25.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:42:24 smithi188 bash[23329]: cephadm 2020-07-16T15:42:23.161722+0000 mgr.x (mgr.34562) 5954 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:42:25.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:42:24 smithi188 bash[23329]: cephadm 2020-07-16T15:42:23.161808+0000 mgr.x (mgr.34562) 5955 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:42:25.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:42:24 smithi132 bash[27079]: cluster 2020-07-16T15:42:23.156920+0000 mgr.x (mgr.34562) 5953 : cluster [DBG] pgmap v3711: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:42:25.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:42:24 smithi132 bash[27079]: cephadm 2020-07-16T15:42:23.161722+0000 mgr.x (mgr.34562) 5954 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:42:25.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:42:24 smithi132 bash[27079]: cephadm 2020-07-16T15:42:23.161808+0000 mgr.x (mgr.34562) 5955 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:42:27.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:42:26 smithi188 bash[23329]: cluster 2020-07-16T15:42:25.157453+0000 mgr.x (mgr.34562) 5956 : cluster [DBG] pgmap v3712: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:42:27.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:42:26 smithi132 bash[27079]: cluster 2020-07-16T15:42:25.157453+0000 mgr.x (mgr.34562) 5956 : cluster [DBG] pgmap v3712: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:42:29.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:42:28 smithi188 bash[23329]: cluster 2020-07-16T15:42:27.157960+0000 mgr.x (mgr.34562) 5957 : cluster [DBG] pgmap v3713: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:42:29.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:42:28 smithi132 bash[27079]: cluster 2020-07-16T15:42:27.157960+0000 mgr.x (mgr.34562) 5957 : cluster [DBG] pgmap v3713: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:42:31.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:42:30 smithi188 bash[23329]: cluster 2020-07-16T15:42:29.158324+0000 mgr.x (mgr.34562) 5958 : cluster [DBG] pgmap v3714: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:42:31.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:42:30 smithi132 bash[27079]: cluster 2020-07-16T15:42:29.158324+0000 mgr.x (mgr.34562) 5958 : cluster [DBG] pgmap v3714: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:42:33.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:42:32 smithi188 bash[23329]: cluster 2020-07-16T15:42:31.158699+0000 mgr.x (mgr.34562) 5959 : cluster [DBG] pgmap v3715: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:42:33.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:42:32 smithi132 bash[27079]: cluster 2020-07-16T15:42:31.158699+0000 mgr.x (mgr.34562) 5959 : cluster [DBG] pgmap v3715: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:42:35.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:42:34 smithi188 bash[23329]: cluster 2020-07-16T15:42:33.159240+0000 mgr.x (mgr.34562) 5960 : cluster [DBG] pgmap v3716: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:42:35.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:42:34 smithi132 bash[27079]: cluster 2020-07-16T15:42:33.159240+0000 mgr.x (mgr.34562) 5960 : cluster [DBG] pgmap v3716: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:42:37.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:42:36 smithi188 bash[23329]: cluster 2020-07-16T15:42:35.159753+0000 mgr.x (mgr.34562) 5961 : cluster [DBG] pgmap v3717: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:42:37.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:42:36 smithi132 bash[27079]: cluster 2020-07-16T15:42:35.159753+0000 mgr.x (mgr.34562) 5961 : cluster [DBG] pgmap v3717: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:42:39.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:42:38 smithi188 bash[23329]: cluster 2020-07-16T15:42:37.160196+0000 mgr.x (mgr.34562) 5962 : cluster [DBG] pgmap v3718: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:42:39.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:42:38 smithi188 bash[23329]: audit 2020-07-16T15:42:38.167619+0000 mon.b (mon.2) 1305 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:42:39.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:42:38 smithi132 bash[27079]: cluster 2020-07-16T15:42:37.160196+0000 mgr.x (mgr.34562) 5962 : cluster [DBG] pgmap v3718: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:42:39.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:42:38 smithi132 bash[27079]: audit 2020-07-16T15:42:38.167619+0000 mon.b (mon.2) 1305 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:42:40.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:42:39 smithi188 bash[23329]: cephadm 2020-07-16T15:42:38.168369+0000 mgr.x (mgr.34562) 5963 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:42:40.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:42:39 smithi188 bash[23329]: cephadm 2020-07-16T15:42:38.168621+0000 mgr.x (mgr.34562) 5964 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:42:40.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:42:39 smithi132 bash[27079]: cephadm 2020-07-16T15:42:38.168369+0000 mgr.x (mgr.34562) 5963 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:42:40.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:42:39 smithi132 bash[27079]: cephadm 2020-07-16T15:42:38.168621+0000 mgr.x (mgr.34562) 5964 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:42:41.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:42:40 smithi188 bash[23329]: cluster 2020-07-16T15:42:39.160698+0000 mgr.x (mgr.34562) 5965 : cluster [DBG] pgmap v3719: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:42:41.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:42:40 smithi132 bash[27079]: cluster 2020-07-16T15:42:39.160698+0000 mgr.x (mgr.34562) 5965 : cluster [DBG] pgmap v3719: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:42:43.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:42:42 smithi188 bash[23329]: cluster 2020-07-16T15:42:41.161026+0000 mgr.x (mgr.34562) 5966 : cluster [DBG] pgmap v3720: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:42:43.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:42:42 smithi132 bash[27079]: cluster 2020-07-16T15:42:41.161026+0000 mgr.x (mgr.34562) 5966 : cluster [DBG] pgmap v3720: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:42:44.562 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:42:44.825 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:42:44.825 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 7m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:42:44.825 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 7m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:42:44.825 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 7m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:42:44.826 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 7m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:42:44.826 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 7m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:42:44.826 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:42:44.826 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:42:44.826 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 7m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:42:44.827 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 7m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:42:44.827 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:42:44.827 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:42:44.827 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:42:44.827 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:42:44.828 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:42:44.828 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:42:44.828 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:42:44.828 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:42:44.828 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 7m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:42:45.119 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:42:45.120 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:42:45.120 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:42:45.120 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:42:45.120 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:42:45.121 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:42:45.121 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:42:45.121 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:42:45.121 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:42:45.121 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:42:45.122 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:42:45.122 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:42:45.122 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:42:45.122 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:42:45.122 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:42:45.123 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:42:45.123 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:42:45.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:42:44 smithi188 bash[23329]: cluster 2020-07-16T15:42:43.161452+0000 mgr.x (mgr.34562) 5967 : cluster [DBG] pgmap v3721: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:42:45.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:42:44 smithi132 bash[27079]: cluster 2020-07-16T15:42:43.161452+0000 mgr.x (mgr.34562) 5967 : cluster [DBG] pgmap v3721: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:42:46.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:42:45 smithi188 bash[23329]: audit 2020-07-16T15:42:44.551252+0000 mgr.x (mgr.34562) 5968 : audit [DBG] from='client.28978 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:42:46.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:42:45 smithi188 bash[23329]: audit 2020-07-16T15:42:44.820950+0000 mgr.x (mgr.34562) 5969 : audit [DBG] from='client.28984 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:42:46.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:42:45 smithi188 bash[23329]: audit 2020-07-16T15:42:45.119016+0000 mon.c (mon.1) 413 : audit [DBG] from='client.? 172.21.15.132:0/3787335618' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:42:46.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:42:45 smithi132 bash[27079]: audit 2020-07-16T15:42:44.551252+0000 mgr.x (mgr.34562) 5968 : audit [DBG] from='client.28978 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:42:46.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:42:45 smithi132 bash[27079]: audit 2020-07-16T15:42:44.820950+0000 mgr.x (mgr.34562) 5969 : audit [DBG] from='client.28984 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:42:46.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:42:45 smithi132 bash[27079]: audit 2020-07-16T15:42:45.119016+0000 mon.c (mon.1) 413 : audit [DBG] from='client.? 172.21.15.132:0/3787335618' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:42:47.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:42:46 smithi188 bash[23329]: cluster 2020-07-16T15:42:45.161835+0000 mgr.x (mgr.34562) 5970 : cluster [DBG] pgmap v3722: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:42:47.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:42:46 smithi132 bash[27079]: cluster 2020-07-16T15:42:45.161835+0000 mgr.x (mgr.34562) 5970 : cluster [DBG] pgmap v3722: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:42:49.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:42:48 smithi188 bash[23329]: cluster 2020-07-16T15:42:47.162349+0000 mgr.x (mgr.34562) 5971 : cluster [DBG] pgmap v3723: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:42:49.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:42:48 smithi132 bash[27079]: cluster 2020-07-16T15:42:47.162349+0000 mgr.x (mgr.34562) 5971 : cluster [DBG] pgmap v3723: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:42:51.177 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:42:50 smithi188 bash[23329]: cluster 2020-07-16T15:42:49.162805+0000 mgr.x (mgr.34562) 5972 : cluster [DBG] pgmap v3724: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:42:51.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:42:50 smithi132 bash[27079]: cluster 2020-07-16T15:42:49.162805+0000 mgr.x (mgr.34562) 5972 : cluster [DBG] pgmap v3724: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:42:53.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:42:52 smithi188 bash[23329]: cluster 2020-07-16T15:42:51.163342+0000 mgr.x (mgr.34562) 5973 : cluster [DBG] pgmap v3725: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:42:53.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:42:52 smithi132 bash[27079]: cluster 2020-07-16T15:42:51.163342+0000 mgr.x (mgr.34562) 5973 : cluster [DBG] pgmap v3725: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:42:54.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:42:53 smithi188 bash[23329]: audit 2020-07-16T15:42:53.170431+0000 mon.b (mon.2) 1306 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:42:54.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:42:53 smithi132 bash[27079]: audit 2020-07-16T15:42:53.170431+0000 mon.b (mon.2) 1306 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:42:55.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:42:54 smithi188 bash[23329]: cluster 2020-07-16T15:42:53.163738+0000 mgr.x (mgr.34562) 5974 : cluster [DBG] pgmap v3726: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:42:55.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:42:54 smithi188 bash[23329]: cephadm 2020-07-16T15:42:53.171106+0000 mgr.x (mgr.34562) 5975 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:42:55.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:42:54 smithi188 bash[23329]: cephadm 2020-07-16T15:42:53.171524+0000 mgr.x (mgr.34562) 5976 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:42:55.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:42:54 smithi132 bash[27079]: cluster 2020-07-16T15:42:53.163738+0000 mgr.x (mgr.34562) 5974 : cluster [DBG] pgmap v3726: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:42:55.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:42:54 smithi132 bash[27079]: cephadm 2020-07-16T15:42:53.171106+0000 mgr.x (mgr.34562) 5975 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:42:55.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:42:54 smithi132 bash[27079]: cephadm 2020-07-16T15:42:53.171524+0000 mgr.x (mgr.34562) 5976 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:42:57.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:42:56 smithi188 bash[23329]: cluster 2020-07-16T15:42:55.164170+0000 mgr.x (mgr.34562) 5977 : cluster [DBG] pgmap v3727: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:42:57.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:42:56 smithi132 bash[27079]: cluster 2020-07-16T15:42:55.164170+0000 mgr.x (mgr.34562) 5977 : cluster [DBG] pgmap v3727: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:42:59.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:42:58 smithi188 bash[23329]: cluster 2020-07-16T15:42:57.164673+0000 mgr.x (mgr.34562) 5978 : cluster [DBG] pgmap v3728: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:42:59.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:42:58 smithi132 bash[27079]: cluster 2020-07-16T15:42:57.164673+0000 mgr.x (mgr.34562) 5978 : cluster [DBG] pgmap v3728: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:43:01.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:43:00 smithi188 bash[23329]: cluster 2020-07-16T15:42:59.165158+0000 mgr.x (mgr.34562) 5979 : cluster [DBG] pgmap v3729: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:43:01.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:43:00 smithi132 bash[27079]: cluster 2020-07-16T15:42:59.165158+0000 mgr.x (mgr.34562) 5979 : cluster [DBG] pgmap v3729: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:43:03.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:43:02 smithi188 bash[23329]: cluster 2020-07-16T15:43:01.165519+0000 mgr.x (mgr.34562) 5980 : cluster [DBG] pgmap v3730: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:43:03.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:43:02 smithi132 bash[27079]: cluster 2020-07-16T15:43:01.165519+0000 mgr.x (mgr.34562) 5980 : cluster [DBG] pgmap v3730: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:43:05.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:43:04 smithi188 bash[23329]: cluster 2020-07-16T15:43:03.166074+0000 mgr.x (mgr.34562) 5981 : cluster [DBG] pgmap v3731: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:43:05.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:43:04 smithi132 bash[27079]: cluster 2020-07-16T15:43:03.166074+0000 mgr.x (mgr.34562) 5981 : cluster [DBG] pgmap v3731: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:43:07.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:43:06 smithi188 bash[23329]: cluster 2020-07-16T15:43:05.166611+0000 mgr.x (mgr.34562) 5982 : cluster [DBG] pgmap v3732: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:43:07.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:43:06 smithi132 bash[27079]: cluster 2020-07-16T15:43:05.166611+0000 mgr.x (mgr.34562) 5982 : cluster [DBG] pgmap v3732: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:43:09.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:43:08 smithi188 bash[23329]: cluster 2020-07-16T15:43:07.167005+0000 mgr.x (mgr.34562) 5983 : cluster [DBG] pgmap v3733: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:43:09.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:43:08 smithi188 bash[23329]: audit 2020-07-16T15:43:08.186948+0000 mon.b (mon.2) 1307 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:43:09.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:43:08 smithi132 bash[27079]: cluster 2020-07-16T15:43:07.167005+0000 mgr.x (mgr.34562) 5983 : cluster [DBG] pgmap v3733: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:43:09.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:43:08 smithi132 bash[27079]: audit 2020-07-16T15:43:08.186948+0000 mon.b (mon.2) 1307 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:43:10.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:43:09 smithi188 bash[23329]: cephadm 2020-07-16T15:43:08.187674+0000 mgr.x (mgr.34562) 5984 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:43:10.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:43:09 smithi188 bash[23329]: cephadm 2020-07-16T15:43:08.188039+0000 mgr.x (mgr.34562) 5985 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:43:10.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:43:09 smithi132 bash[27079]: cephadm 2020-07-16T15:43:08.187674+0000 mgr.x (mgr.34562) 5984 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:43:10.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:43:09 smithi132 bash[27079]: cephadm 2020-07-16T15:43:08.188039+0000 mgr.x (mgr.34562) 5985 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:43:11.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:43:10 smithi188 bash[23329]: cluster 2020-07-16T15:43:09.167541+0000 mgr.x (mgr.34562) 5986 : cluster [DBG] pgmap v3734: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:43:11.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:43:10 smithi132 bash[27079]: cluster 2020-07-16T15:43:09.167541+0000 mgr.x (mgr.34562) 5986 : cluster [DBG] pgmap v3734: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:43:13.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:43:12 smithi188 bash[23329]: cluster 2020-07-16T15:43:11.167984+0000 mgr.x (mgr.34562) 5987 : cluster [DBG] pgmap v3735: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:43:13.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:43:12 smithi132 bash[27079]: cluster 2020-07-16T15:43:11.167984+0000 mgr.x (mgr.34562) 5987 : cluster [DBG] pgmap v3735: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:43:15.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:43:14 smithi188 bash[23329]: cluster 2020-07-16T15:43:13.168384+0000 mgr.x (mgr.34562) 5988 : cluster [DBG] pgmap v3736: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:43:15.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:43:14 smithi132 bash[27079]: cluster 2020-07-16T15:43:13.168384+0000 mgr.x (mgr.34562) 5988 : cluster [DBG] pgmap v3736: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:43:15.418 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:43:15.678 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:43:15.679 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 8m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:43:15.679 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 8m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:43:15.679 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 8m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:43:15.679 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 8m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:43:15.680 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 8m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:43:15.680 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:43:15.680 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:43:15.680 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 8m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:43:15.680 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 8m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:43:15.681 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:43:15.681 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:43:15.681 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:43:15.681 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:43:15.681 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:43:15.682 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:43:15.682 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:43:15.682 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:43:15.682 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 8m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:43:15.980 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:43:15.980 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:43:15.980 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:43:15.981 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:43:15.981 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:43:15.981 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:43:15.981 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:43:15.982 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:43:15.982 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:43:15.982 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:43:15.982 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:43:15.982 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:43:15.983 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:43:15.983 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:43:15.983 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:43:15.983 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:43:15.983 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:43:17.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:43:16 smithi188 bash[23329]: cluster 2020-07-16T15:43:15.168766+0000 mgr.x (mgr.34562) 5989 : cluster [DBG] pgmap v3737: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:43:17.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:43:16 smithi188 bash[23329]: audit 2020-07-16T15:43:15.406535+0000 mgr.x (mgr.34562) 5990 : audit [DBG] from='client.28996 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:43:17.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:43:16 smithi188 bash[23329]: audit 2020-07-16T15:43:15.674829+0000 mgr.x (mgr.34562) 5991 : audit [DBG] from='client.29002 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:43:17.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:43:16 smithi188 bash[23329]: audit 2020-07-16T15:43:15.979463+0000 mon.c (mon.1) 414 : audit [DBG] from='client.? 172.21.15.132:0/912697094' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:43:17.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:43:16 smithi132 bash[27079]: cluster 2020-07-16T15:43:15.168766+0000 mgr.x (mgr.34562) 5989 : cluster [DBG] pgmap v3737: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:43:17.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:43:16 smithi132 bash[27079]: audit 2020-07-16T15:43:15.406535+0000 mgr.x (mgr.34562) 5990 : audit [DBG] from='client.28996 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:43:17.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:43:16 smithi132 bash[27079]: audit 2020-07-16T15:43:15.674829+0000 mgr.x (mgr.34562) 5991 : audit [DBG] from='client.29002 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:43:17.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:43:16 smithi132 bash[27079]: audit 2020-07-16T15:43:15.979463+0000 mon.c (mon.1) 414 : audit [DBG] from='client.? 172.21.15.132:0/912697094' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:43:19.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:43:18 smithi188 bash[23329]: cluster 2020-07-16T15:43:17.169159+0000 mgr.x (mgr.34562) 5992 : cluster [DBG] pgmap v3738: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:43:19.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:43:18 smithi132 bash[27079]: cluster 2020-07-16T15:43:17.169159+0000 mgr.x (mgr.34562) 5992 : cluster [DBG] pgmap v3738: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:43:21.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:43:20 smithi188 bash[23329]: cluster 2020-07-16T15:43:19.169539+0000 mgr.x (mgr.34562) 5993 : cluster [DBG] pgmap v3739: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:43:21.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:43:20 smithi132 bash[27079]: cluster 2020-07-16T15:43:19.169539+0000 mgr.x (mgr.34562) 5993 : cluster [DBG] pgmap v3739: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:43:23.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:43:22 smithi132 bash[27079]: cluster 2020-07-16T15:43:21.170054+0000 mgr.x (mgr.34562) 5994 : cluster [DBG] pgmap v3740: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:43:23.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:43:22 smithi188 bash[23329]: cluster 2020-07-16T15:43:21.170054+0000 mgr.x (mgr.34562) 5994 : cluster [DBG] pgmap v3740: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:43:24.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:43:23 smithi132 bash[27079]: audit 2020-07-16T15:43:23.206253+0000 mon.b (mon.2) 1308 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:43:24.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:43:23 smithi132 bash[27079]: audit 2020-07-16T15:43:23.207638+0000 mon.b (mon.2) 1309 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:43:24.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:43:23 smithi132 bash[27079]: audit 2020-07-16T15:43:23.208870+0000 mon.b (mon.2) 1310 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:43:24.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:43:23 smithi132 bash[27079]: audit 2020-07-16T15:43:23.210203+0000 mon.b (mon.2) 1311 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:43:24.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:43:23 smithi132 bash[27079]: audit 2020-07-16T15:43:23.211588+0000 mon.b (mon.2) 1312 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:43:24.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:43:23 smithi188 bash[23329]: audit 2020-07-16T15:43:23.206253+0000 mon.b (mon.2) 1308 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:43:24.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:43:23 smithi188 bash[23329]: audit 2020-07-16T15:43:23.207638+0000 mon.b (mon.2) 1309 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:43:24.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:43:23 smithi188 bash[23329]: audit 2020-07-16T15:43:23.208870+0000 mon.b (mon.2) 1310 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:43:24.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:43:23 smithi188 bash[23329]: audit 2020-07-16T15:43:23.210203+0000 mon.b (mon.2) 1311 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:43:24.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:43:23 smithi188 bash[23329]: audit 2020-07-16T15:43:23.211588+0000 mon.b (mon.2) 1312 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:43:25.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:43:24 smithi132 bash[27079]: cluster 2020-07-16T15:43:23.170513+0000 mgr.x (mgr.34562) 5995 : cluster [DBG] pgmap v3741: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:43:25.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:43:24 smithi132 bash[27079]: audit 2020-07-16T15:43:23.206609+0000 mgr.x (mgr.34562) 5996 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:43:25.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:43:24 smithi132 bash[27079]: audit 2020-07-16T15:43:23.207949+0000 mgr.x (mgr.34562) 5997 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:43:25.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:43:24 smithi132 bash[27079]: audit 2020-07-16T15:43:23.209165+0000 mgr.x (mgr.34562) 5998 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:43:25.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:43:24 smithi132 bash[27079]: cephadm 2020-07-16T15:43:23.209929+0000 mgr.x (mgr.34562) 5999 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:43:25.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:43:24 smithi132 bash[27079]: cephadm 2020-07-16T15:43:23.211040+0000 mgr.x (mgr.34562) 6000 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:43:25.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:43:24 smithi132 bash[27079]: cephadm 2020-07-16T15:43:23.212254+0000 mgr.x (mgr.34562) 6001 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:43:25.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:43:24 smithi132 bash[27079]: cephadm 2020-07-16T15:43:23.212338+0000 mgr.x (mgr.34562) 6002 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:43:25.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:43:24 smithi188 bash[23329]: cluster 2020-07-16T15:43:23.170513+0000 mgr.x (mgr.34562) 5995 : cluster [DBG] pgmap v3741: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:43:25.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:43:24 smithi188 bash[23329]: audit 2020-07-16T15:43:23.206609+0000 mgr.x (mgr.34562) 5996 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:43:25.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:43:24 smithi188 bash[23329]: audit 2020-07-16T15:43:23.207949+0000 mgr.x (mgr.34562) 5997 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:43:25.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:43:24 smithi188 bash[23329]: audit 2020-07-16T15:43:23.209165+0000 mgr.x (mgr.34562) 5998 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:43:25.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:43:24 smithi188 bash[23329]: cephadm 2020-07-16T15:43:23.209929+0000 mgr.x (mgr.34562) 5999 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:43:25.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:43:24 smithi188 bash[23329]: cephadm 2020-07-16T15:43:23.211040+0000 mgr.x (mgr.34562) 6000 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:43:25.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:43:24 smithi188 bash[23329]: cephadm 2020-07-16T15:43:23.212254+0000 mgr.x (mgr.34562) 6001 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:43:25.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:43:24 smithi188 bash[23329]: cephadm 2020-07-16T15:43:23.212338+0000 mgr.x (mgr.34562) 6002 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:43:27.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:43:26 smithi132 bash[27079]: cluster 2020-07-16T15:43:25.171016+0000 mgr.x (mgr.34562) 6003 : cluster [DBG] pgmap v3742: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:43:27.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:43:26 smithi132 bash[27079]: audit 2020-07-16T15:43:26.096974+0000 mon.b (mon.2) 1313 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:43:27.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:43:26 smithi132 bash[27079]: cephadm 2020-07-16T15:43:26.097604+0000 mgr.x (mgr.34562) 6004 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:43:27.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:43:26 smithi132 bash[27079]: cephadm 2020-07-16T15:43:26.097936+0000 mgr.x (mgr.34562) 6005 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:43:27.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:43:26 smithi188 bash[23329]: cluster 2020-07-16T15:43:25.171016+0000 mgr.x (mgr.34562) 6003 : cluster [DBG] pgmap v3742: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:43:27.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:43:26 smithi188 bash[23329]: audit 2020-07-16T15:43:26.096974+0000 mon.b (mon.2) 1313 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:43:27.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:43:26 smithi188 bash[23329]: cephadm 2020-07-16T15:43:26.097604+0000 mgr.x (mgr.34562) 6004 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:43:27.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:43:26 smithi188 bash[23329]: cephadm 2020-07-16T15:43:26.097936+0000 mgr.x (mgr.34562) 6005 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:43:29.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:43:28 smithi132 bash[27079]: cluster 2020-07-16T15:43:27.171447+0000 mgr.x (mgr.34562) 6006 : cluster [DBG] pgmap v3743: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:43:29.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:43:28 smithi188 bash[23329]: cluster 2020-07-16T15:43:27.171447+0000 mgr.x (mgr.34562) 6006 : cluster [DBG] pgmap v3743: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:43:31.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:43:30 smithi132 bash[27079]: cluster 2020-07-16T15:43:29.171836+0000 mgr.x (mgr.34562) 6007 : cluster [DBG] pgmap v3744: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:43:31.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:43:30 smithi188 bash[23329]: cluster 2020-07-16T15:43:29.171836+0000 mgr.x (mgr.34562) 6007 : cluster [DBG] pgmap v3744: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:43:33.291 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:43:32 smithi132 bash[27079]: cluster 2020-07-16T15:43:31.172383+0000 mgr.x (mgr.34562) 6008 : cluster [DBG] pgmap v3745: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:43:33.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:43:32 smithi188 bash[23329]: cluster 2020-07-16T15:43:31.172383+0000 mgr.x (mgr.34562) 6008 : cluster [DBG] pgmap v3745: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:43:35.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:43:34 smithi132 bash[27079]: cluster 2020-07-16T15:43:33.172773+0000 mgr.x (mgr.34562) 6009 : cluster [DBG] pgmap v3746: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:43:35.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:43:34 smithi188 bash[23329]: cluster 2020-07-16T15:43:33.172773+0000 mgr.x (mgr.34562) 6009 : cluster [DBG] pgmap v3746: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:43:37.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:43:36 smithi132 bash[27079]: cluster 2020-07-16T15:43:35.173234+0000 mgr.x (mgr.34562) 6010 : cluster [DBG] pgmap v3747: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:43:37.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:43:36 smithi188 bash[23329]: cluster 2020-07-16T15:43:35.173234+0000 mgr.x (mgr.34562) 6010 : cluster [DBG] pgmap v3747: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:43:39.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:43:38 smithi132 bash[27079]: cluster 2020-07-16T15:43:37.173699+0000 mgr.x (mgr.34562) 6011 : cluster [DBG] pgmap v3748: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:43:39.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:43:38 smithi188 bash[23329]: cluster 2020-07-16T15:43:37.173699+0000 mgr.x (mgr.34562) 6011 : cluster [DBG] pgmap v3748: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:43:41.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:43:40 smithi132 bash[27079]: cluster 2020-07-16T15:43:39.174151+0000 mgr.x (mgr.34562) 6012 : cluster [DBG] pgmap v3749: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:43:41.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:43:40 smithi188 bash[23329]: cluster 2020-07-16T15:43:39.174151+0000 mgr.x (mgr.34562) 6012 : cluster [DBG] pgmap v3749: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:43:42.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:43:41 smithi132 bash[27079]: audit 2020-07-16T15:43:41.113377+0000 mon.b (mon.2) 1314 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:43:42.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:43:41 smithi132 bash[27079]: cephadm 2020-07-16T15:43:41.114055+0000 mgr.x (mgr.34562) 6013 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:43:42.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:43:41 smithi132 bash[27079]: cephadm 2020-07-16T15:43:41.114269+0000 mgr.x (mgr.34562) 6014 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:43:42.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:43:41 smithi188 bash[23329]: audit 2020-07-16T15:43:41.113377+0000 mon.b (mon.2) 1314 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:43:42.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:43:41 smithi188 bash[23329]: cephadm 2020-07-16T15:43:41.114055+0000 mgr.x (mgr.34562) 6013 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:43:42.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:43:41 smithi188 bash[23329]: cephadm 2020-07-16T15:43:41.114269+0000 mgr.x (mgr.34562) 6014 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:43:43.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:43:42 smithi132 bash[27079]: cluster 2020-07-16T15:43:41.174561+0000 mgr.x (mgr.34562) 6015 : cluster [DBG] pgmap v3750: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:43:43.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:43:42 smithi188 bash[23329]: cluster 2020-07-16T15:43:41.174561+0000 mgr.x (mgr.34562) 6015 : cluster [DBG] pgmap v3750: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:43:45.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:43:44 smithi132 bash[27079]: cluster 2020-07-16T15:43:43.175064+0000 mgr.x (mgr.34562) 6016 : cluster [DBG] pgmap v3751: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:43:45.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:43:44 smithi188 bash[23329]: cluster 2020-07-16T15:43:43.175064+0000 mgr.x (mgr.34562) 6016 : cluster [DBG] pgmap v3751: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:43:46.275 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:43:46.536 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:43:46.536 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 8m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:43:46.537 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 8m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:43:46.537 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 8m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:43:46.537 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 8m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:43:46.537 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 8m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:43:46.537 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:43:46.538 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:43:46.538 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 8m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:43:46.538 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 8m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:43:46.538 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:43:46.538 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:43:46.539 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:43:46.539 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:43:46.539 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:43:46.539 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:43:46.539 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:43:46.540 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:43:46.540 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 8m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:43:46.837 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:43:46.838 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:43:46.838 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:43:46.838 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:43:46.839 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:43:46.839 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:43:46.839 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:43:46.839 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:43:46.839 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:43:46.840 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:43:46.840 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:43:46.840 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:43:46.840 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:43:46.840 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:43:46.840 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:43:46.841 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:43:46.841 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:43:47.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:43:46 smithi132 bash[27079]: cluster 2020-07-16T15:43:45.175440+0000 mgr.x (mgr.34562) 6017 : cluster [DBG] pgmap v3752: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:43:47.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:43:46 smithi132 bash[27079]: audit 2020-07-16T15:43:46.836958+0000 mon.c (mon.1) 415 : audit [DBG] from='client.? 172.21.15.132:0/4194664139' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:43:47.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:43:46 smithi188 bash[23329]: cluster 2020-07-16T15:43:45.175440+0000 mgr.x (mgr.34562) 6017 : cluster [DBG] pgmap v3752: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:43:47.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:43:46 smithi188 bash[23329]: audit 2020-07-16T15:43:46.836958+0000 mon.c (mon.1) 415 : audit [DBG] from='client.? 172.21.15.132:0/4194664139' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:43:48.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:43:47 smithi132 bash[27079]: audit 2020-07-16T15:43:46.263806+0000 mgr.x (mgr.34562) 6018 : audit [DBG] from='client.29014 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:43:48.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:43:47 smithi132 bash[27079]: audit 2020-07-16T15:43:46.531988+0000 mgr.x (mgr.34562) 6019 : audit [DBG] from='client.29020 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:43:48.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:43:47 smithi188 bash[23329]: audit 2020-07-16T15:43:46.263806+0000 mgr.x (mgr.34562) 6018 : audit [DBG] from='client.29014 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:43:48.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:43:47 smithi188 bash[23329]: audit 2020-07-16T15:43:46.531988+0000 mgr.x (mgr.34562) 6019 : audit [DBG] from='client.29020 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:43:49.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:43:48 smithi132 bash[27079]: cluster 2020-07-16T15:43:47.175834+0000 mgr.x (mgr.34562) 6020 : cluster [DBG] pgmap v3753: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:43:49.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:43:48 smithi188 bash[23329]: cluster 2020-07-16T15:43:47.175834+0000 mgr.x (mgr.34562) 6020 : cluster [DBG] pgmap v3753: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:43:51.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:43:50 smithi132 bash[27079]: cluster 2020-07-16T15:43:49.176354+0000 mgr.x (mgr.34562) 6021 : cluster [DBG] pgmap v3754: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:43:51.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:43:50 smithi188 bash[23329]: cluster 2020-07-16T15:43:49.176354+0000 mgr.x (mgr.34562) 6021 : cluster [DBG] pgmap v3754: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:43:53.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:43:52 smithi132 bash[27079]: cluster 2020-07-16T15:43:51.176843+0000 mgr.x (mgr.34562) 6022 : cluster [DBG] pgmap v3755: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:43:53.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:43:52 smithi188 bash[23329]: cluster 2020-07-16T15:43:51.176843+0000 mgr.x (mgr.34562) 6022 : cluster [DBG] pgmap v3755: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:43:55.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:43:54 smithi132 bash[27079]: cluster 2020-07-16T15:43:53.177384+0000 mgr.x (mgr.34562) 6023 : cluster [DBG] pgmap v3756: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:43:55.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:43:54 smithi188 bash[23329]: cluster 2020-07-16T15:43:53.177384+0000 mgr.x (mgr.34562) 6023 : cluster [DBG] pgmap v3756: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:43:57.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:43:56 smithi132 bash[27079]: cluster 2020-07-16T15:43:55.177748+0000 mgr.x (mgr.34562) 6024 : cluster [DBG] pgmap v3757: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:43:57.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:43:56 smithi132 bash[27079]: audit 2020-07-16T15:43:56.129794+0000 mon.b (mon.2) 1315 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:43:57.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:43:56 smithi132 bash[27079]: cephadm 2020-07-16T15:43:56.130487+0000 mgr.x (mgr.34562) 6025 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:43:57.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:43:56 smithi132 bash[27079]: cephadm 2020-07-16T15:43:56.130613+0000 mgr.x (mgr.34562) 6026 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:43:57.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:43:56 smithi188 bash[23329]: cluster 2020-07-16T15:43:55.177748+0000 mgr.x (mgr.34562) 6024 : cluster [DBG] pgmap v3757: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:43:57.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:43:56 smithi188 bash[23329]: audit 2020-07-16T15:43:56.129794+0000 mon.b (mon.2) 1315 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:43:57.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:43:56 smithi188 bash[23329]: cephadm 2020-07-16T15:43:56.130487+0000 mgr.x (mgr.34562) 6025 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:43:57.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:43:56 smithi188 bash[23329]: cephadm 2020-07-16T15:43:56.130613+0000 mgr.x (mgr.34562) 6026 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:43:59.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:43:58 smithi132 bash[27079]: cluster 2020-07-16T15:43:57.178306+0000 mgr.x (mgr.34562) 6027 : cluster [DBG] pgmap v3758: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:43:59.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:43:58 smithi188 bash[23329]: cluster 2020-07-16T15:43:57.178306+0000 mgr.x (mgr.34562) 6027 : cluster [DBG] pgmap v3758: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:44:01.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:44:00 smithi132 bash[27079]: cluster 2020-07-16T15:43:59.178812+0000 mgr.x (mgr.34562) 6028 : cluster [DBG] pgmap v3759: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:44:01.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:44:00 smithi188 bash[23329]: cluster 2020-07-16T15:43:59.178812+0000 mgr.x (mgr.34562) 6028 : cluster [DBG] pgmap v3759: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:44:03.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:44:02 smithi132 bash[27079]: cluster 2020-07-16T15:44:01.179157+0000 mgr.x (mgr.34562) 6029 : cluster [DBG] pgmap v3760: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:44:03.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:44:03 smithi188 bash[23329]: cluster 2020-07-16T15:44:01.179157+0000 mgr.x (mgr.34562) 6029 : cluster [DBG] pgmap v3760: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:44:05.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:44:05 smithi132 bash[27079]: cluster 2020-07-16T15:44:03.179599+0000 mgr.x (mgr.34562) 6030 : cluster [DBG] pgmap v3761: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:44:05.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:44:05 smithi188 bash[23329]: cluster 2020-07-16T15:44:03.179599+0000 mgr.x (mgr.34562) 6030 : cluster [DBG] pgmap v3761: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:44:07.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:44:07 smithi132 bash[27079]: cluster 2020-07-16T15:44:05.180111+0000 mgr.x (mgr.34562) 6031 : cluster [DBG] pgmap v3762: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:44:07.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:44:07 smithi188 bash[23329]: cluster 2020-07-16T15:44:05.180111+0000 mgr.x (mgr.34562) 6031 : cluster [DBG] pgmap v3762: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:44:09.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:44:09 smithi132 bash[27079]: cluster 2020-07-16T15:44:07.180682+0000 mgr.x (mgr.34562) 6032 : cluster [DBG] pgmap v3763: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:44:09.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:44:09 smithi188 bash[23329]: cluster 2020-07-16T15:44:07.180682+0000 mgr.x (mgr.34562) 6032 : cluster [DBG] pgmap v3763: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:44:11.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:44:11 smithi132 bash[27079]: cluster 2020-07-16T15:44:09.181208+0000 mgr.x (mgr.34562) 6033 : cluster [DBG] pgmap v3764: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:44:11.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:44:11 smithi188 bash[23329]: cluster 2020-07-16T15:44:09.181208+0000 mgr.x (mgr.34562) 6033 : cluster [DBG] pgmap v3764: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:44:12.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:44:12 smithi132 bash[27079]: audit 2020-07-16T15:44:11.136800+0000 mon.b (mon.2) 1316 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:44:12.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:44:12 smithi132 bash[27079]: cephadm 2020-07-16T15:44:11.137497+0000 mgr.x (mgr.34562) 6034 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:44:12.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:44:12 smithi132 bash[27079]: cephadm 2020-07-16T15:44:11.137843+0000 mgr.x (mgr.34562) 6035 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:44:12.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:44:12 smithi188 bash[23329]: audit 2020-07-16T15:44:11.136800+0000 mon.b (mon.2) 1316 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:44:12.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:44:12 smithi188 bash[23329]: cephadm 2020-07-16T15:44:11.137497+0000 mgr.x (mgr.34562) 6034 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:44:12.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:44:12 smithi188 bash[23329]: cephadm 2020-07-16T15:44:11.137843+0000 mgr.x (mgr.34562) 6035 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:44:13.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:44:13 smithi132 bash[27079]: cluster 2020-07-16T15:44:11.181653+0000 mgr.x (mgr.34562) 6036 : cluster [DBG] pgmap v3765: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:44:13.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:44:13 smithi188 bash[23329]: cluster 2020-07-16T15:44:11.181653+0000 mgr.x (mgr.34562) 6036 : cluster [DBG] pgmap v3765: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:44:15.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:44:15 smithi132 bash[27079]: cluster 2020-07-16T15:44:13.182127+0000 mgr.x (mgr.34562) 6037 : cluster [DBG] pgmap v3766: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:44:15.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:44:15 smithi188 bash[23329]: cluster 2020-07-16T15:44:13.182127+0000 mgr.x (mgr.34562) 6037 : cluster [DBG] pgmap v3766: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:44:17.136 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:44:17.397 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:44:17.398 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 9m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:44:17.398 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 9m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:44:17.398 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 9m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:44:17.399 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 9m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:44:17.399 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 9m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:44:17.399 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:44:17.399 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:44:17.399 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 9m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:44:17.400 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 9m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:44:17.400 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:44:17.400 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:44:17.400 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:44:17.400 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:44:17.401 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:44:17.401 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:44:17.401 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:44:17.401 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:44:17.401 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 9m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:44:17.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:44:17 smithi188 bash[23329]: cluster 2020-07-16T15:44:15.182631+0000 mgr.x (mgr.34562) 6038 : cluster [DBG] pgmap v3767: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:44:17.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:44:17 smithi132 bash[27079]: cluster 2020-07-16T15:44:15.182631+0000 mgr.x (mgr.34562) 6038 : cluster [DBG] pgmap v3767: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:44:17.702 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:44:17.703 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:44:17.703 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:44:17.703 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:44:17.703 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:44:17.703 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:44:17.704 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:44:17.704 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:44:17.704 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:44:17.704 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:44:17.704 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:44:17.705 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:44:17.705 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:44:17.705 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:44:17.705 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:44:17.705 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:44:17.706 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:44:18.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:44:18 smithi188 bash[23329]: audit 2020-07-16T15:44:17.124688+0000 mgr.x (mgr.34562) 6039 : audit [DBG] from='client.29032 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:44:18.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:44:18 smithi188 bash[23329]: audit 2020-07-16T15:44:17.696269+0000 mon.c (mon.1) 416 : audit [DBG] from='client.? 172.21.15.132:0/3516363099' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:44:18.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:44:18 smithi132 bash[27079]: audit 2020-07-16T15:44:17.124688+0000 mgr.x (mgr.34562) 6039 : audit [DBG] from='client.29032 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:44:18.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:44:18 smithi132 bash[27079]: audit 2020-07-16T15:44:17.696269+0000 mon.c (mon.1) 416 : audit [DBG] from='client.? 172.21.15.132:0/3516363099' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:44:19.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:44:19 smithi188 bash[23329]: cluster 2020-07-16T15:44:17.183015+0000 mgr.x (mgr.34562) 6040 : cluster [DBG] pgmap v3768: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:44:19.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:44:19 smithi188 bash[23329]: audit 2020-07-16T15:44:17.393604+0000 mgr.x (mgr.34562) 6041 : audit [DBG] from='client.29038 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:44:19.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:44:19 smithi132 bash[27079]: cluster 2020-07-16T15:44:17.183015+0000 mgr.x (mgr.34562) 6040 : cluster [DBG] pgmap v3768: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:44:19.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:44:19 smithi132 bash[27079]: audit 2020-07-16T15:44:17.393604+0000 mgr.x (mgr.34562) 6041 : audit [DBG] from='client.29038 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:44:21.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:44:21 smithi188 bash[23329]: cluster 2020-07-16T15:44:19.183560+0000 mgr.x (mgr.34562) 6042 : cluster [DBG] pgmap v3769: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:44:21.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:44:21 smithi132 bash[27079]: cluster 2020-07-16T15:44:19.183560+0000 mgr.x (mgr.34562) 6042 : cluster [DBG] pgmap v3769: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:44:23.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:44:23 smithi188 bash[23329]: cluster 2020-07-16T15:44:21.183961+0000 mgr.x (mgr.34562) 6043 : cluster [DBG] pgmap v3770: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:44:23.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:44:23 smithi132 bash[27079]: cluster 2020-07-16T15:44:21.183961+0000 mgr.x (mgr.34562) 6043 : cluster [DBG] pgmap v3770: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:44:25.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:44:25 smithi188 bash[23329]: cluster 2020-07-16T15:44:23.184478+0000 mgr.x (mgr.34562) 6044 : cluster [DBG] pgmap v3771: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:44:25.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:44:25 smithi132 bash[27079]: cluster 2020-07-16T15:44:23.184478+0000 mgr.x (mgr.34562) 6044 : cluster [DBG] pgmap v3771: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:44:27.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:44:27 smithi188 bash[23329]: cluster 2020-07-16T15:44:25.184901+0000 mgr.x (mgr.34562) 6045 : cluster [DBG] pgmap v3772: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:44:27.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:44:27 smithi188 bash[23329]: audit 2020-07-16T15:44:26.155931+0000 mon.b (mon.2) 1317 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:44:27.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:44:27 smithi188 bash[23329]: audit 2020-07-16T15:44:26.156350+0000 mgr.x (mgr.34562) 6046 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:44:27.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:44:27 smithi188 bash[23329]: audit 2020-07-16T15:44:26.157405+0000 mon.b (mon.2) 1318 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:44:27.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:44:27 smithi188 bash[23329]: audit 2020-07-16T15:44:26.157700+0000 mgr.x (mgr.34562) 6047 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:44:27.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:44:27 smithi188 bash[23329]: audit 2020-07-16T15:44:26.158618+0000 mon.b (mon.2) 1319 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:44:27.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:44:27 smithi188 bash[23329]: audit 2020-07-16T15:44:26.158926+0000 mgr.x (mgr.34562) 6048 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:44:27.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:44:27 smithi188 bash[23329]: cephadm 2020-07-16T15:44:26.159723+0000 mgr.x (mgr.34562) 6049 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:44:27.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:44:27 smithi188 bash[23329]: audit 2020-07-16T15:44:26.159993+0000 mon.b (mon.2) 1320 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:44:27.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:44:27 smithi188 bash[23329]: cephadm 2020-07-16T15:44:26.160807+0000 mgr.x (mgr.34562) 6050 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:44:27.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:44:27 smithi188 bash[23329]: audit 2020-07-16T15:44:26.161144+0000 mon.b (mon.2) 1321 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:44:27.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:44:27 smithi188 bash[23329]: cephadm 2020-07-16T15:44:26.161863+0000 mgr.x (mgr.34562) 6051 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:44:27.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:44:27 smithi188 bash[23329]: cephadm 2020-07-16T15:44:26.162157+0000 mgr.x (mgr.34562) 6052 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:44:27.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:44:27 smithi132 bash[27079]: cluster 2020-07-16T15:44:25.184901+0000 mgr.x (mgr.34562) 6045 : cluster [DBG] pgmap v3772: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:44:27.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:44:27 smithi132 bash[27079]: audit 2020-07-16T15:44:26.155931+0000 mon.b (mon.2) 1317 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:44:27.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:44:27 smithi132 bash[27079]: audit 2020-07-16T15:44:26.156350+0000 mgr.x (mgr.34562) 6046 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:44:27.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:44:27 smithi132 bash[27079]: audit 2020-07-16T15:44:26.157405+0000 mon.b (mon.2) 1318 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:44:27.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:44:27 smithi132 bash[27079]: audit 2020-07-16T15:44:26.157700+0000 mgr.x (mgr.34562) 6047 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:44:27.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:44:27 smithi132 bash[27079]: audit 2020-07-16T15:44:26.158618+0000 mon.b (mon.2) 1319 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:44:27.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:44:27 smithi132 bash[27079]: audit 2020-07-16T15:44:26.158926+0000 mgr.x (mgr.34562) 6048 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:44:27.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:44:27 smithi132 bash[27079]: cephadm 2020-07-16T15:44:26.159723+0000 mgr.x (mgr.34562) 6049 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:44:27.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:44:27 smithi132 bash[27079]: audit 2020-07-16T15:44:26.159993+0000 mon.b (mon.2) 1320 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:44:27.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:44:27 smithi132 bash[27079]: cephadm 2020-07-16T15:44:26.160807+0000 mgr.x (mgr.34562) 6050 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:44:27.532 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:44:27 smithi132 bash[27079]: audit 2020-07-16T15:44:26.161144+0000 mon.b (mon.2) 1321 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:44:27.532 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:44:27 smithi132 bash[27079]: cephadm 2020-07-16T15:44:26.161863+0000 mgr.x (mgr.34562) 6051 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:44:27.532 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:44:27 smithi132 bash[27079]: cephadm 2020-07-16T15:44:26.162157+0000 mgr.x (mgr.34562) 6052 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:44:29.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:44:29 smithi132 bash[27079]: cluster 2020-07-16T15:44:27.185419+0000 mgr.x (mgr.34562) 6053 : cluster [DBG] pgmap v3773: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:44:29.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:44:29 smithi132 bash[27079]: audit 2020-07-16T15:44:29.025462+0000 mon.b (mon.2) 1322 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:44:29.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:44:29 smithi188 bash[23329]: cluster 2020-07-16T15:44:27.185419+0000 mgr.x (mgr.34562) 6053 : cluster [DBG] pgmap v3773: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:44:29.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:44:29 smithi188 bash[23329]: audit 2020-07-16T15:44:29.025462+0000 mon.b (mon.2) 1322 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:44:30.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:44:30 smithi188 bash[23329]: cephadm 2020-07-16T15:44:29.026148+0000 mgr.x (mgr.34562) 6054 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:44:30.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:44:30 smithi188 bash[23329]: cephadm 2020-07-16T15:44:29.026591+0000 mgr.x (mgr.34562) 6055 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:44:30.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:44:30 smithi132 bash[27079]: cephadm 2020-07-16T15:44:29.026148+0000 mgr.x (mgr.34562) 6054 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:44:30.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:44:30 smithi132 bash[27079]: cephadm 2020-07-16T15:44:29.026591+0000 mgr.x (mgr.34562) 6055 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:44:31.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:44:31 smithi188 bash[23329]: cluster 2020-07-16T15:44:29.185916+0000 mgr.x (mgr.34562) 6056 : cluster [DBG] pgmap v3774: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:44:31.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:44:31 smithi132 bash[27079]: cluster 2020-07-16T15:44:29.185916+0000 mgr.x (mgr.34562) 6056 : cluster [DBG] pgmap v3774: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:44:33.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:44:33 smithi188 bash[23329]: cluster 2020-07-16T15:44:31.186448+0000 mgr.x (mgr.34562) 6057 : cluster [DBG] pgmap v3775: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:44:33.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:44:33 smithi132 bash[27079]: cluster 2020-07-16T15:44:31.186448+0000 mgr.x (mgr.34562) 6057 : cluster [DBG] pgmap v3775: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:44:35.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:44:35 smithi188 bash[23329]: cluster 2020-07-16T15:44:33.187029+0000 mgr.x (mgr.34562) 6058 : cluster [DBG] pgmap v3776: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:44:35.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:44:35 smithi132 bash[27079]: cluster 2020-07-16T15:44:33.187029+0000 mgr.x (mgr.34562) 6058 : cluster [DBG] pgmap v3776: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:44:37.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:44:37 smithi188 bash[23329]: cluster 2020-07-16T15:44:35.187452+0000 mgr.x (mgr.34562) 6059 : cluster [DBG] pgmap v3777: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:44:37.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:44:37 smithi132 bash[27079]: cluster 2020-07-16T15:44:35.187452+0000 mgr.x (mgr.34562) 6059 : cluster [DBG] pgmap v3777: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:44:39.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:44:39 smithi188 bash[23329]: cluster 2020-07-16T15:44:37.187820+0000 mgr.x (mgr.34562) 6060 : cluster [DBG] pgmap v3778: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:44:39.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:44:39 smithi132 bash[27079]: cluster 2020-07-16T15:44:37.187820+0000 mgr.x (mgr.34562) 6060 : cluster [DBG] pgmap v3778: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:44:41.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:44:41 smithi188 bash[23329]: cluster 2020-07-16T15:44:39.188211+0000 mgr.x (mgr.34562) 6061 : cluster [DBG] pgmap v3779: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:44:41.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:44:41 smithi132 bash[27079]: cluster 2020-07-16T15:44:39.188211+0000 mgr.x (mgr.34562) 6061 : cluster [DBG] pgmap v3779: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:44:43.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:44:43 smithi188 bash[23329]: cluster 2020-07-16T15:44:41.188602+0000 mgr.x (mgr.34562) 6062 : cluster [DBG] pgmap v3780: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:44:43.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:44:43 smithi132 bash[27079]: cluster 2020-07-16T15:44:41.188602+0000 mgr.x (mgr.34562) 6062 : cluster [DBG] pgmap v3780: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:44:44.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:44:44 smithi188 bash[23329]: audit 2020-07-16T15:44:44.042077+0000 mon.b (mon.2) 1323 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:44:44.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:44:44 smithi132 bash[27079]: audit 2020-07-16T15:44:44.042077+0000 mon.b (mon.2) 1323 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:44:45.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:44:45 smithi188 bash[23329]: cluster 2020-07-16T15:44:43.189072+0000 mgr.x (mgr.34562) 6063 : cluster [DBG] pgmap v3781: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:44:45.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:44:45 smithi188 bash[23329]: cephadm 2020-07-16T15:44:44.042878+0000 mgr.x (mgr.34562) 6064 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:44:45.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:44:45 smithi188 bash[23329]: cephadm 2020-07-16T15:44:44.043026+0000 mgr.x (mgr.34562) 6065 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:44:45.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:44:45 smithi132 bash[27079]: cluster 2020-07-16T15:44:43.189072+0000 mgr.x (mgr.34562) 6063 : cluster [DBG] pgmap v3781: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:44:45.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:44:45 smithi132 bash[27079]: cephadm 2020-07-16T15:44:44.042878+0000 mgr.x (mgr.34562) 6064 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:44:45.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:44:45 smithi132 bash[27079]: cephadm 2020-07-16T15:44:44.043026+0000 mgr.x (mgr.34562) 6065 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:44:47.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:44:47 smithi188 bash[23329]: cluster 2020-07-16T15:44:45.189569+0000 mgr.x (mgr.34562) 6066 : cluster [DBG] pgmap v3782: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:44:47.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:44:47 smithi132 bash[27079]: cluster 2020-07-16T15:44:45.189569+0000 mgr.x (mgr.34562) 6066 : cluster [DBG] pgmap v3782: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:44:47.994 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:44:48.253 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:44:48.253 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 9m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:44:48.254 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 9m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:44:48.254 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 9m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:44:48.254 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 9m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:44:48.254 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 9m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:44:48.254 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:44:48.255 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:44:48.255 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 9m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:44:48.255 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 9m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:44:48.255 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:44:48.255 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:44:48.256 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:44:48.256 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:44:48.256 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:44:48.256 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:44:48.256 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:44:48.257 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:44:48.257 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 9m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:44:48.551 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:44:48.551 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:44:48.552 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:44:48.552 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:44:48.552 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:44:48.552 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:44:48.552 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:44:48.553 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:44:48.553 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:44:48.553 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:44:48.553 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:44:48.553 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:44:48.554 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:44:48.554 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:44:48.554 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:44:48.554 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:44:48.554 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:44:49.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:44:49 smithi188 bash[23329]: cluster 2020-07-16T15:44:47.190138+0000 mgr.x (mgr.34562) 6067 : cluster [DBG] pgmap v3783: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:44:49.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:44:49 smithi188 bash[23329]: audit 2020-07-16T15:44:47.982451+0000 mgr.x (mgr.34562) 6068 : audit [DBG] from='client.29050 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:44:49.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:44:49 smithi188 bash[23329]: audit 2020-07-16T15:44:48.550296+0000 mon.c (mon.1) 417 : audit [DBG] from='client.? 172.21.15.132:0/3860495979' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:44:49.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:44:49 smithi132 bash[27079]: cluster 2020-07-16T15:44:47.190138+0000 mgr.x (mgr.34562) 6067 : cluster [DBG] pgmap v3783: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:44:49.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:44:49 smithi132 bash[27079]: audit 2020-07-16T15:44:47.982451+0000 mgr.x (mgr.34562) 6068 : audit [DBG] from='client.29050 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:44:49.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:44:49 smithi132 bash[27079]: audit 2020-07-16T15:44:48.550296+0000 mon.c (mon.1) 417 : audit [DBG] from='client.? 172.21.15.132:0/3860495979' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:44:50.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:44:50 smithi188 bash[23329]: audit 2020-07-16T15:44:48.248855+0000 mgr.x (mgr.34562) 6069 : audit [DBG] from='client.29056 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:44:50.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:44:50 smithi132 bash[27079]: audit 2020-07-16T15:44:48.248855+0000 mgr.x (mgr.34562) 6069 : audit [DBG] from='client.29056 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:44:51.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:44:51 smithi188 bash[23329]: cluster 2020-07-16T15:44:49.190522+0000 mgr.x (mgr.34562) 6070 : cluster [DBG] pgmap v3784: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:44:51.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:44:51 smithi132 bash[27079]: cluster 2020-07-16T15:44:49.190522+0000 mgr.x (mgr.34562) 6070 : cluster [DBG] pgmap v3784: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:44:53.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:44:53 smithi188 bash[23329]: cluster 2020-07-16T15:44:51.190896+0000 mgr.x (mgr.34562) 6071 : cluster [DBG] pgmap v3785: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:44:53.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:44:53 smithi132 bash[27079]: cluster 2020-07-16T15:44:51.190896+0000 mgr.x (mgr.34562) 6071 : cluster [DBG] pgmap v3785: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:44:55.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:44:55 smithi188 bash[23329]: cluster 2020-07-16T15:44:53.191377+0000 mgr.x (mgr.34562) 6072 : cluster [DBG] pgmap v3786: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:44:55.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:44:55 smithi132 bash[27079]: cluster 2020-07-16T15:44:53.191377+0000 mgr.x (mgr.34562) 6072 : cluster [DBG] pgmap v3786: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:44:57.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:44:57 smithi188 bash[23329]: cluster 2020-07-16T15:44:55.191884+0000 mgr.x (mgr.34562) 6073 : cluster [DBG] pgmap v3787: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:44:57.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:44:57 smithi132 bash[27079]: cluster 2020-07-16T15:44:55.191884+0000 mgr.x (mgr.34562) 6073 : cluster [DBG] pgmap v3787: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:44:59.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:44:59 smithi188 bash[23329]: cluster 2020-07-16T15:44:57.192265+0000 mgr.x (mgr.34562) 6074 : cluster [DBG] pgmap v3788: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:44:59.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:44:59 smithi188 bash[23329]: audit 2020-07-16T15:44:59.058955+0000 mon.b (mon.2) 1324 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:44:59.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:44:59 smithi132 bash[27079]: cluster 2020-07-16T15:44:57.192265+0000 mgr.x (mgr.34562) 6074 : cluster [DBG] pgmap v3788: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:44:59.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:44:59 smithi132 bash[27079]: audit 2020-07-16T15:44:59.058955+0000 mon.b (mon.2) 1324 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:45:00.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:00 smithi188 bash[23329]: cephadm 2020-07-16T15:44:59.059692+0000 mgr.x (mgr.34562) 6075 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:45:00.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:00 smithi188 bash[23329]: cephadm 2020-07-16T15:44:59.059920+0000 mgr.x (mgr.34562) 6076 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:45:00.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:00 smithi132 bash[27079]: cephadm 2020-07-16T15:44:59.059692+0000 mgr.x (mgr.34562) 6075 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:45:00.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:00 smithi132 bash[27079]: cephadm 2020-07-16T15:44:59.059920+0000 mgr.x (mgr.34562) 6076 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:45:01.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:01 smithi188 bash[23329]: cluster 2020-07-16T15:44:59.192713+0000 mgr.x (mgr.34562) 6077 : cluster [DBG] pgmap v3789: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:45:01.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:01 smithi132 bash[27079]: cluster 2020-07-16T15:44:59.192713+0000 mgr.x (mgr.34562) 6077 : cluster [DBG] pgmap v3789: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:45:03.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:03 smithi188 bash[23329]: cluster 2020-07-16T15:45:01.193128+0000 mgr.x (mgr.34562) 6078 : cluster [DBG] pgmap v3790: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:45:03.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:03 smithi132 bash[27079]: cluster 2020-07-16T15:45:01.193128+0000 mgr.x (mgr.34562) 6078 : cluster [DBG] pgmap v3790: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:45:05.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:05 smithi188 bash[23329]: cluster 2020-07-16T15:45:03.193671+0000 mgr.x (mgr.34562) 6079 : cluster [DBG] pgmap v3791: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:45:05.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:05 smithi132 bash[27079]: cluster 2020-07-16T15:45:03.193671+0000 mgr.x (mgr.34562) 6079 : cluster [DBG] pgmap v3791: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:45:07.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:07 smithi188 bash[23329]: cluster 2020-07-16T15:45:05.194186+0000 mgr.x (mgr.34562) 6080 : cluster [DBG] pgmap v3792: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:45:07.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:07 smithi132 bash[27079]: cluster 2020-07-16T15:45:05.194186+0000 mgr.x (mgr.34562) 6080 : cluster [DBG] pgmap v3792: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:45:09.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:09 smithi188 bash[23329]: cluster 2020-07-16T15:45:07.194705+0000 mgr.x (mgr.34562) 6081 : cluster [DBG] pgmap v3793: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:45:09.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:09 smithi132 bash[27079]: cluster 2020-07-16T15:45:07.194705+0000 mgr.x (mgr.34562) 6081 : cluster [DBG] pgmap v3793: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:45:11.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:11 smithi188 bash[23329]: cluster 2020-07-16T15:45:09.195091+0000 mgr.x (mgr.34562) 6082 : cluster [DBG] pgmap v3794: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:45:11.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:11 smithi132 bash[27079]: cluster 2020-07-16T15:45:09.195091+0000 mgr.x (mgr.34562) 6082 : cluster [DBG] pgmap v3794: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:45:13.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:13 smithi188 bash[23329]: cluster 2020-07-16T15:45:11.195581+0000 mgr.x (mgr.34562) 6083 : cluster [DBG] pgmap v3795: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:45:13.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:13 smithi132 bash[27079]: cluster 2020-07-16T15:45:11.195581+0000 mgr.x (mgr.34562) 6083 : cluster [DBG] pgmap v3795: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:45:14.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:14 smithi188 bash[23329]: audit 2020-07-16T15:45:14.075580+0000 mon.b (mon.2) 1325 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:45:14.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:14 smithi132 bash[27079]: audit 2020-07-16T15:45:14.075580+0000 mon.b (mon.2) 1325 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:45:15.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:15 smithi188 bash[23329]: cluster 2020-07-16T15:45:13.196104+0000 mgr.x (mgr.34562) 6084 : cluster [DBG] pgmap v3796: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:45:15.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:15 smithi188 bash[23329]: cephadm 2020-07-16T15:45:14.076303+0000 mgr.x (mgr.34562) 6085 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:45:15.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:15 smithi188 bash[23329]: cephadm 2020-07-16T15:45:14.076638+0000 mgr.x (mgr.34562) 6086 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:45:15.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:15 smithi132 bash[27079]: cluster 2020-07-16T15:45:13.196104+0000 mgr.x (mgr.34562) 6084 : cluster [DBG] pgmap v3796: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:45:15.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:15 smithi132 bash[27079]: cephadm 2020-07-16T15:45:14.076303+0000 mgr.x (mgr.34562) 6085 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:45:15.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:15 smithi132 bash[27079]: cephadm 2020-07-16T15:45:14.076638+0000 mgr.x (mgr.34562) 6086 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:45:17.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:17 smithi188 bash[23329]: cluster 2020-07-16T15:45:15.196547+0000 mgr.x (mgr.34562) 6087 : cluster [DBG] pgmap v3797: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:45:17.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:17 smithi132 bash[27079]: cluster 2020-07-16T15:45:15.196547+0000 mgr.x (mgr.34562) 6087 : cluster [DBG] pgmap v3797: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:45:18.847 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:45:19.110 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:45:19.111 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 10m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:45:19.111 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 10m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:45:19.111 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 10m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:45:19.111 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 10m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:45:19.112 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 10m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:45:19.112 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:45:19.112 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:45:19.112 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 10m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:45:19.112 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 10m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:45:19.113 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:45:19.113 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:45:19.113 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:45:19.113 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:45:19.113 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:45:19.114 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:45:19.114 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:45:19.114 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:45:19.114 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 10m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:45:19.407 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:45:19.408 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:45:19.408 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:45:19.408 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:45:19.408 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:45:19.408 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:45:19.409 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:45:19.409 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:45:19.409 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:45:19.409 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:45:19.410 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:45:19.410 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:45:19.410 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:45:19.410 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:45:19.410 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:45:19.411 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:45:19.411 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:45:19.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:19 smithi188 bash[23329]: cluster 2020-07-16T15:45:17.197009+0000 mgr.x (mgr.34562) 6088 : cluster [DBG] pgmap v3798: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:45:19.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:19 smithi132 bash[27079]: cluster 2020-07-16T15:45:17.197009+0000 mgr.x (mgr.34562) 6088 : cluster [DBG] pgmap v3798: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:45:20.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:20 smithi188 bash[23329]: audit 2020-07-16T15:45:18.836035+0000 mgr.x (mgr.34562) 6089 : audit [DBG] from='client.29068 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:45:20.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:20 smithi188 bash[23329]: audit 2020-07-16T15:45:19.106675+0000 mgr.x (mgr.34562) 6090 : audit [DBG] from='client.29074 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:45:20.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:20 smithi188 bash[23329]: audit 2020-07-16T15:45:19.406884+0000 mon.c (mon.1) 418 : audit [DBG] from='client.? 172.21.15.132:0/1906184728' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:45:20.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:20 smithi132 bash[27079]: audit 2020-07-16T15:45:18.836035+0000 mgr.x (mgr.34562) 6089 : audit [DBG] from='client.29068 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:45:20.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:20 smithi132 bash[27079]: audit 2020-07-16T15:45:19.106675+0000 mgr.x (mgr.34562) 6090 : audit [DBG] from='client.29074 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:45:20.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:20 smithi132 bash[27079]: audit 2020-07-16T15:45:19.406884+0000 mon.c (mon.1) 418 : audit [DBG] from='client.? 172.21.15.132:0/1906184728' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:45:21.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:21 smithi188 bash[23329]: cluster 2020-07-16T15:45:19.197364+0000 mgr.x (mgr.34562) 6091 : cluster [DBG] pgmap v3799: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:45:21.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:21 smithi132 bash[27079]: cluster 2020-07-16T15:45:19.197364+0000 mgr.x (mgr.34562) 6091 : cluster [DBG] pgmap v3799: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:45:23.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:23 smithi188 bash[23329]: cluster 2020-07-16T15:45:21.197777+0000 mgr.x (mgr.34562) 6092 : cluster [DBG] pgmap v3800: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:45:23.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:23 smithi132 bash[27079]: cluster 2020-07-16T15:45:21.197777+0000 mgr.x (mgr.34562) 6092 : cluster [DBG] pgmap v3800: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:45:25.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:25 smithi188 bash[23329]: cluster 2020-07-16T15:45:23.198168+0000 mgr.x (mgr.34562) 6093 : cluster [DBG] pgmap v3801: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:45:25.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:25 smithi132 bash[27079]: cluster 2020-07-16T15:45:23.198168+0000 mgr.x (mgr.34562) 6093 : cluster [DBG] pgmap v3801: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:45:27.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:27 smithi132 bash[27079]: cluster 2020-07-16T15:45:25.198623+0000 mgr.x (mgr.34562) 6094 : cluster [DBG] pgmap v3802: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:45:27.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:27 smithi188 bash[23329]: cluster 2020-07-16T15:45:25.198623+0000 mgr.x (mgr.34562) 6094 : cluster [DBG] pgmap v3802: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:45:29.494 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:29 smithi188 bash[23329]: cluster 2020-07-16T15:45:27.199127+0000 mgr.x (mgr.34562) 6095 : cluster [DBG] pgmap v3803: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:45:29.495 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:29 smithi188 bash[23329]: audit 2020-07-16T15:45:29.092885+0000 mon.b (mon.2) 1326 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T15:45:29.495 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:29 smithi188 bash[23329]: audit 2020-07-16T15:45:29.093144+0000 mon.b (mon.2) 1327 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T15:45:29.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:29 smithi132 bash[27079]: cluster 2020-07-16T15:45:27.199127+0000 mgr.x (mgr.34562) 6095 : cluster [DBG] pgmap v3803: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:45:29.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:29 smithi132 bash[27079]: audit 2020-07-16T15:45:29.092885+0000 mon.b (mon.2) 1326 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T15:45:29.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:29 smithi132 bash[27079]: audit 2020-07-16T15:45:29.093144+0000 mon.b (mon.2) 1327 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T15:45:31.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:31 smithi188 bash[23329]: cluster 2020-07-16T15:45:29.199461+0000 mgr.x (mgr.34562) 6096 : cluster [DBG] pgmap v3804: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:45:31.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:31 smithi132 bash[27079]: cluster 2020-07-16T15:45:29.199461+0000 mgr.x (mgr.34562) 6096 : cluster [DBG] pgmap v3804: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:45:32.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:32 smithi132 bash[27079]: cluster 2020-07-16T15:45:31.199749+0000 mgr.x (mgr.34562) 6097 : cluster [DBG] pgmap v3805: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:45:32.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:32 smithi132 bash[27079]: audit 2020-07-16T15:45:31.302072+0000 mon.b (mon.2) 1328 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:45:31.300468\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300526\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300562\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300593\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300769\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300877\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300985\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.301091\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.301125\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:45:31.301198\", \"last_device_update\": \"2020-07-16T15:34:56.840832\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:37:05.890601\"}"}]: dispatch 2020-07-16T15:45:32.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:32 smithi132 bash[27079]: audit 2020-07-16T15:45:31.302626+0000 mon.c (mon.1) 419 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:45:31.300468\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300526\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300562\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300593\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300769\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300877\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300985\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.301091\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.301125\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:45:31.301198\", \"last_device_update\": \"2020-07-16T15:34:56.840832\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:37:05.890601\"}"}]: dispatch 2020-07-16T15:45:32.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:32 smithi132 bash[27079]: audit 2020-07-16T15:45:31.307113+0000 mon.c (mon.1) 420 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:45:31.300468\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300526\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300562\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300593\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300769\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300877\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300985\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.301091\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.301125\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:45:31.301198\", \"last_device_update\": \"2020-07-16T15:34:56.840832\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:37:05.890601\"}"}]': finished 2020-07-16T15:45:32.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:32 smithi132 bash[27079]: audit 2020-07-16T15:45:31.567830+0000 mon.b (mon.2) 1329 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566331\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566403\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566435\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566617\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566718\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566816\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566912\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566944\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566972\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:45:31.567038\", \"last_device_update\": \"2020-07-16T15:36:02.606623\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:37:05.896872\"}"}]: dispatch 2020-07-16T15:45:32.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:32 smithi132 bash[27079]: audit 2020-07-16T15:45:31.568264+0000 mon.c (mon.1) 421 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566331\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566403\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566435\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566617\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566718\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566816\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566912\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566944\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566972\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:45:31.567038\", \"last_device_update\": \"2020-07-16T15:36:02.606623\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:37:05.896872\"}"}]: dispatch 2020-07-16T15:45:32.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:32 smithi132 bash[27079]: audit 2020-07-16T15:45:31.570678+0000 mon.c (mon.1) 422 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566331\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566403\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566435\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566617\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566718\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566816\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566912\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566944\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566972\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:45:31.567038\", \"last_device_update\": \"2020-07-16T15:36:02.606623\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:37:05.896872\"}"}]': finished 2020-07-16T15:45:32.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:32 smithi132 bash[27079]: audit 2020-07-16T15:45:31.575751+0000 mon.b (mon.2) 1330 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:45:32.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:32 smithi132 bash[27079]: audit 2020-07-16T15:45:31.576086+0000 mgr.x (mgr.34562) 6098 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:45:32.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:32 smithi132 bash[27079]: audit 2020-07-16T15:45:31.576796+0000 mon.b (mon.2) 1331 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:45:32.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:32 smithi132 bash[27079]: audit 2020-07-16T15:45:31.577043+0000 mgr.x (mgr.34562) 6099 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:45:32.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:32 smithi132 bash[27079]: audit 2020-07-16T15:45:31.577655+0000 mon.b (mon.2) 1332 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:45:32.284 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:32 smithi132 bash[27079]: audit 2020-07-16T15:45:31.577862+0000 mgr.x (mgr.34562) 6100 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:45:32.284 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:32 smithi132 bash[27079]: cephadm 2020-07-16T15:45:31.578409+0000 mgr.x (mgr.34562) 6101 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:45:32.284 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:32 smithi132 bash[27079]: audit 2020-07-16T15:45:31.578706+0000 mon.b (mon.2) 1333 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:45:32.284 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:32 smithi132 bash[27079]: cephadm 2020-07-16T15:45:31.579336+0000 mgr.x (mgr.34562) 6102 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:45:32.285 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:32 smithi132 bash[27079]: audit 2020-07-16T15:45:31.579730+0000 mon.b (mon.2) 1334 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:45:32.285 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:32 smithi132 bash[27079]: cephadm 2020-07-16T15:45:31.580292+0000 mgr.x (mgr.34562) 6103 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:45:32.285 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:32 smithi132 bash[27079]: cephadm 2020-07-16T15:45:31.580494+0000 mgr.x (mgr.34562) 6104 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:45:32.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:32 smithi188 bash[23329]: cluster 2020-07-16T15:45:31.199749+0000 mgr.x (mgr.34562) 6097 : cluster [DBG] pgmap v3805: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:45:32.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:32 smithi188 bash[23329]: audit 2020-07-16T15:45:31.302072+0000 mon.b (mon.2) 1328 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:45:31.300468\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300526\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300562\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300593\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300769\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300877\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300985\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.301091\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.301125\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:45:31.301198\", \"last_device_update\": \"2020-07-16T15:34:56.840832\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:37:05.890601\"}"}]: dispatch 2020-07-16T15:45:32.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:32 smithi188 bash[23329]: audit 2020-07-16T15:45:31.302626+0000 mon.c (mon.1) 419 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:45:31.300468\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300526\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300562\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300593\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300769\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300877\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300985\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.301091\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.301125\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:45:31.301198\", \"last_device_update\": \"2020-07-16T15:34:56.840832\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:37:05.890601\"}"}]: dispatch 2020-07-16T15:45:32.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:32 smithi188 bash[23329]: audit 2020-07-16T15:45:31.307113+0000 mon.c (mon.1) 420 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:45:31.300468\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300526\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300562\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300593\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300769\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300877\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300985\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.301091\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.301125\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:45:31.301198\", \"last_device_update\": \"2020-07-16T15:34:56.840832\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:37:05.890601\"}"}]': finished 2020-07-16T15:45:32.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:32 smithi188 bash[23329]: audit 2020-07-16T15:45:31.567830+0000 mon.b (mon.2) 1329 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566331\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566403\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566435\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566617\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566718\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566816\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566912\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566944\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566972\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:45:31.567038\", \"last_device_update\": \"2020-07-16T15:36:02.606623\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:37:05.896872\"}"}]: dispatch 2020-07-16T15:45:32.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:32 smithi188 bash[23329]: audit 2020-07-16T15:45:31.568264+0000 mon.c (mon.1) 421 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566331\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566403\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566435\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566617\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566718\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566816\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566912\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566944\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566972\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:45:31.567038\", \"last_device_update\": \"2020-07-16T15:36:02.606623\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:37:05.896872\"}"}]: dispatch 2020-07-16T15:45:32.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:32 smithi188 bash[23329]: audit 2020-07-16T15:45:31.570678+0000 mon.c (mon.1) 422 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566331\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566403\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566435\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566617\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566718\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566816\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566912\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566944\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566972\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:45:31.567038\", \"last_device_update\": \"2020-07-16T15:36:02.606623\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:37:05.896872\"}"}]': finished 2020-07-16T15:45:32.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:32 smithi188 bash[23329]: audit 2020-07-16T15:45:31.575751+0000 mon.b (mon.2) 1330 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:45:32.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:32 smithi188 bash[23329]: audit 2020-07-16T15:45:31.576086+0000 mgr.x (mgr.34562) 6098 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:45:32.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:32 smithi188 bash[23329]: audit 2020-07-16T15:45:31.576796+0000 mon.b (mon.2) 1331 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:45:32.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:32 smithi188 bash[23329]: audit 2020-07-16T15:45:31.577043+0000 mgr.x (mgr.34562) 6099 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:45:32.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:32 smithi188 bash[23329]: audit 2020-07-16T15:45:31.577655+0000 mon.b (mon.2) 1332 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:45:32.675 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:32 smithi188 bash[23329]: audit 2020-07-16T15:45:31.577862+0000 mgr.x (mgr.34562) 6100 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:45:32.675 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:32 smithi188 bash[23329]: cephadm 2020-07-16T15:45:31.578409+0000 mgr.x (mgr.34562) 6101 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:45:32.675 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:32 smithi188 bash[23329]: audit 2020-07-16T15:45:31.578706+0000 mon.b (mon.2) 1333 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:45:32.675 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:32 smithi188 bash[23329]: cephadm 2020-07-16T15:45:31.579336+0000 mgr.x (mgr.34562) 6102 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:45:32.675 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:32 smithi188 bash[23329]: audit 2020-07-16T15:45:31.579730+0000 mon.b (mon.2) 1334 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:45:32.676 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:32 smithi188 bash[23329]: cephadm 2020-07-16T15:45:31.580292+0000 mgr.x (mgr.34562) 6103 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:45:32.676 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:32 smithi188 bash[23329]: cephadm 2020-07-16T15:45:31.580494+0000 mgr.x (mgr.34562) 6104 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:45:34.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:34 smithi132 bash[27079]: cluster 2020-07-16T15:45:33.200179+0000 mgr.x (mgr.34562) 6105 : cluster [DBG] pgmap v3806: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:45:34.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:34 smithi188 bash[23329]: cluster 2020-07-16T15:45:33.200179+0000 mgr.x (mgr.34562) 6105 : cluster [DBG] pgmap v3806: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:45:35.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:35 smithi132 bash[27079]: audit 2020-07-16T15:45:34.374489+0000 mon.b (mon.2) 1335 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:45:35.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:35 smithi132 bash[27079]: cephadm 2020-07-16T15:45:34.375091+0000 mgr.x (mgr.34562) 6106 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:45:35.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:35 smithi132 bash[27079]: cephadm 2020-07-16T15:45:34.375356+0000 mgr.x (mgr.34562) 6107 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:45:35.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:35 smithi188 bash[23329]: audit 2020-07-16T15:45:34.374489+0000 mon.b (mon.2) 1335 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:45:35.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:35 smithi188 bash[23329]: cephadm 2020-07-16T15:45:34.375091+0000 mgr.x (mgr.34562) 6106 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:45:35.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:35 smithi188 bash[23329]: cephadm 2020-07-16T15:45:34.375356+0000 mgr.x (mgr.34562) 6107 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:45:36.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:36 smithi188 bash[23329]: cluster 2020-07-16T15:45:35.200676+0000 mgr.x (mgr.34562) 6108 : cluster [DBG] pgmap v3807: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:45:37.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:36 smithi132 bash[27079]: cluster 2020-07-16T15:45:35.200676+0000 mgr.x (mgr.34562) 6108 : cluster [DBG] pgmap v3807: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:45:38.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:38 smithi188 bash[23329]: cluster 2020-07-16T15:45:37.201131+0000 mgr.x (mgr.34562) 6109 : cluster [DBG] pgmap v3808: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:45:39.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:38 smithi132 bash[27079]: cluster 2020-07-16T15:45:37.201131+0000 mgr.x (mgr.34562) 6109 : cluster [DBG] pgmap v3808: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:45:40.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:40 smithi188 bash[23329]: cluster 2020-07-16T15:45:39.201554+0000 mgr.x (mgr.34562) 6110 : cluster [DBG] pgmap v3809: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:45:41.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:40 smithi132 bash[27079]: cluster 2020-07-16T15:45:39.201554+0000 mgr.x (mgr.34562) 6110 : cluster [DBG] pgmap v3809: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:45:43.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:42 smithi132 bash[27079]: cluster 2020-07-16T15:45:41.201991+0000 mgr.x (mgr.34562) 6111 : cluster [DBG] pgmap v3810: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:45:43.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:42 smithi188 bash[23329]: cluster 2020-07-16T15:45:41.201991+0000 mgr.x (mgr.34562) 6111 : cluster [DBG] pgmap v3810: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:45:45.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:44 smithi132 bash[27079]: cluster 2020-07-16T15:45:43.202406+0000 mgr.x (mgr.34562) 6112 : cluster [DBG] pgmap v3811: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:45:45.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:44 smithi188 bash[23329]: cluster 2020-07-16T15:45:43.202406+0000 mgr.x (mgr.34562) 6112 : cluster [DBG] pgmap v3811: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:45:47.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:46 smithi132 bash[27079]: cluster 2020-07-16T15:45:45.202883+0000 mgr.x (mgr.34562) 6113 : cluster [DBG] pgmap v3812: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:45:47.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:46 smithi188 bash[23329]: cluster 2020-07-16T15:45:45.202883+0000 mgr.x (mgr.34562) 6113 : cluster [DBG] pgmap v3812: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:45:49.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:48 smithi132 bash[27079]: cluster 2020-07-16T15:45:47.203469+0000 mgr.x (mgr.34562) 6114 : cluster [DBG] pgmap v3813: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:45:49.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:48 smithi188 bash[23329]: cluster 2020-07-16T15:45:47.203469+0000 mgr.x (mgr.34562) 6114 : cluster [DBG] pgmap v3813: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:45:49.710 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:45:49.973 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:45:49.974 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 18s ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:45:49.974 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 18s ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:45:49.974 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 18s ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:45:49.974 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 18s ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:45:49.974 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 18s ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:45:49.975 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 18s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:45:49.975 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 18s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:45:49.975 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 18s ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:45:49.975 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 18s ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:45:49.975 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 18s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:45:49.976 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 18s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:45:49.976 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 18s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:45:49.976 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 18s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:45:49.976 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 18s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:45:49.976 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 18s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:45:49.977 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 18s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:45:49.977 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 18s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:45:49.977 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 18s ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:45:50.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:49 smithi132 bash[27079]: audit 2020-07-16T15:45:49.377773+0000 mon.b (mon.2) 1336 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:45:50.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:49 smithi188 bash[23329]: audit 2020-07-16T15:45:49.377773+0000 mon.b (mon.2) 1336 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:45:50.267 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:45:50.267 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:45:50.267 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:45:50.267 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:45:50.268 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:45:50.268 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:45:50.268 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:45:50.268 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:45:50.268 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:45:50.269 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:45:50.269 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:45:50.269 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:45:50.269 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:45:50.269 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:45:50.270 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:45:50.270 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:45:50.270 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:45:51.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:50 smithi132 bash[27079]: cluster 2020-07-16T15:45:49.203877+0000 mgr.x (mgr.34562) 6115 : cluster [DBG] pgmap v3814: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:45:51.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:50 smithi132 bash[27079]: cephadm 2020-07-16T15:45:49.378443+0000 mgr.x (mgr.34562) 6116 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:45:51.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:50 smithi132 bash[27079]: cephadm 2020-07-16T15:45:49.378866+0000 mgr.x (mgr.34562) 6117 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:45:51.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:50 smithi132 bash[27079]: audit 2020-07-16T15:45:49.698493+0000 mgr.x (mgr.34562) 6118 : audit [DBG] from='client.29086 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:45:51.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:50 smithi132 bash[27079]: audit 2020-07-16T15:45:49.966444+0000 mgr.x (mgr.34562) 6119 : audit [DBG] from='client.29092 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:45:51.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:50 smithi132 bash[27079]: audit 2020-07-16T15:45:50.266297+0000 mon.c (mon.1) 423 : audit [DBG] from='client.? 172.21.15.132:0/4123909235' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:45:51.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:50 smithi188 bash[23329]: cluster 2020-07-16T15:45:49.203877+0000 mgr.x (mgr.34562) 6115 : cluster [DBG] pgmap v3814: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:45:51.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:50 smithi188 bash[23329]: cephadm 2020-07-16T15:45:49.378443+0000 mgr.x (mgr.34562) 6116 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:45:51.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:50 smithi188 bash[23329]: cephadm 2020-07-16T15:45:49.378866+0000 mgr.x (mgr.34562) 6117 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:45:51.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:50 smithi188 bash[23329]: audit 2020-07-16T15:45:49.698493+0000 mgr.x (mgr.34562) 6118 : audit [DBG] from='client.29086 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:45:51.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:50 smithi188 bash[23329]: audit 2020-07-16T15:45:49.966444+0000 mgr.x (mgr.34562) 6119 : audit [DBG] from='client.29092 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:45:51.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:50 smithi188 bash[23329]: audit 2020-07-16T15:45:50.266297+0000 mon.c (mon.1) 423 : audit [DBG] from='client.? 172.21.15.132:0/4123909235' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:45:53.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:52 smithi132 bash[27079]: cluster 2020-07-16T15:45:51.204204+0000 mgr.x (mgr.34562) 6120 : cluster [DBG] pgmap v3815: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:45:53.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:52 smithi188 bash[23329]: cluster 2020-07-16T15:45:51.204204+0000 mgr.x (mgr.34562) 6120 : cluster [DBG] pgmap v3815: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:45:55.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:54 smithi132 bash[27079]: cluster 2020-07-16T15:45:53.204744+0000 mgr.x (mgr.34562) 6121 : cluster [DBG] pgmap v3816: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:45:55.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:54 smithi188 bash[23329]: cluster 2020-07-16T15:45:53.204744+0000 mgr.x (mgr.34562) 6121 : cluster [DBG] pgmap v3816: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:45:57.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:56 smithi132 bash[27079]: cluster 2020-07-16T15:45:55.205078+0000 mgr.x (mgr.34562) 6122 : cluster [DBG] pgmap v3817: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:45:57.175 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:56 smithi188 bash[23329]: cluster 2020-07-16T15:45:55.205078+0000 mgr.x (mgr.34562) 6122 : cluster [DBG] pgmap v3817: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:45:59.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:45:58 smithi132 bash[27079]: cluster 2020-07-16T15:45:57.205456+0000 mgr.x (mgr.34562) 6123 : cluster [DBG] pgmap v3818: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:45:59.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:45:58 smithi188 bash[23329]: cluster 2020-07-16T15:45:57.205456+0000 mgr.x (mgr.34562) 6123 : cluster [DBG] pgmap v3818: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:46:01.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:46:00 smithi132 bash[27079]: cluster 2020-07-16T15:45:59.205891+0000 mgr.x (mgr.34562) 6124 : cluster [DBG] pgmap v3819: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:46:01.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:46:00 smithi188 bash[23329]: cluster 2020-07-16T15:45:59.205891+0000 mgr.x (mgr.34562) 6124 : cluster [DBG] pgmap v3819: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:46:03.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:46:02 smithi132 bash[27079]: cluster 2020-07-16T15:46:01.206225+0000 mgr.x (mgr.34562) 6125 : cluster [DBG] pgmap v3820: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:46:03.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:46:02 smithi188 bash[23329]: cluster 2020-07-16T15:46:01.206225+0000 mgr.x (mgr.34562) 6125 : cluster [DBG] pgmap v3820: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:46:05.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:46:04 smithi132 bash[27079]: cluster 2020-07-16T15:46:03.206572+0000 mgr.x (mgr.34562) 6126 : cluster [DBG] pgmap v3821: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:46:05.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:46:04 smithi132 bash[27079]: audit 2020-07-16T15:46:04.394510+0000 mon.b (mon.2) 1337 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:46:05.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:46:04 smithi188 bash[23329]: cluster 2020-07-16T15:46:03.206572+0000 mgr.x (mgr.34562) 6126 : cluster [DBG] pgmap v3821: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:46:05.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:46:04 smithi188 bash[23329]: audit 2020-07-16T15:46:04.394510+0000 mon.b (mon.2) 1337 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:46:06.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:46:05 smithi132 bash[27079]: cephadm 2020-07-16T15:46:04.395255+0000 mgr.x (mgr.34562) 6127 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:46:06.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:46:05 smithi132 bash[27079]: cephadm 2020-07-16T15:46:04.395705+0000 mgr.x (mgr.34562) 6128 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:46:06.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:46:05 smithi188 bash[23329]: cephadm 2020-07-16T15:46:04.395255+0000 mgr.x (mgr.34562) 6127 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:46:06.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:46:05 smithi188 bash[23329]: cephadm 2020-07-16T15:46:04.395705+0000 mgr.x (mgr.34562) 6128 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:46:07.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:46:06 smithi132 bash[27079]: cluster 2020-07-16T15:46:05.207055+0000 mgr.x (mgr.34562) 6129 : cluster [DBG] pgmap v3822: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:46:07.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:46:06 smithi188 bash[23329]: cluster 2020-07-16T15:46:05.207055+0000 mgr.x (mgr.34562) 6129 : cluster [DBG] pgmap v3822: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:46:09.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:46:08 smithi132 bash[27079]: cluster 2020-07-16T15:46:07.207595+0000 mgr.x (mgr.34562) 6130 : cluster [DBG] pgmap v3823: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:46:09.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:46:08 smithi188 bash[23329]: cluster 2020-07-16T15:46:07.207595+0000 mgr.x (mgr.34562) 6130 : cluster [DBG] pgmap v3823: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:46:11.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:46:10 smithi132 bash[27079]: cluster 2020-07-16T15:46:09.208154+0000 mgr.x (mgr.34562) 6131 : cluster [DBG] pgmap v3824: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:46:11.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:46:10 smithi188 bash[23329]: cluster 2020-07-16T15:46:09.208154+0000 mgr.x (mgr.34562) 6131 : cluster [DBG] pgmap v3824: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:46:13.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:46:12 smithi132 bash[27079]: cluster 2020-07-16T15:46:11.208616+0000 mgr.x (mgr.34562) 6132 : cluster [DBG] pgmap v3825: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:46:13.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:46:12 smithi188 bash[23329]: cluster 2020-07-16T15:46:11.208616+0000 mgr.x (mgr.34562) 6132 : cluster [DBG] pgmap v3825: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:46:15.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:46:14 smithi132 bash[27079]: cluster 2020-07-16T15:46:13.208975+0000 mgr.x (mgr.34562) 6133 : cluster [DBG] pgmap v3826: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:46:15.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:46:14 smithi188 bash[23329]: cluster 2020-07-16T15:46:13.208975+0000 mgr.x (mgr.34562) 6133 : cluster [DBG] pgmap v3826: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:46:17.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:46:16 smithi132 bash[27079]: cluster 2020-07-16T15:46:15.209352+0000 mgr.x (mgr.34562) 6134 : cluster [DBG] pgmap v3827: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:46:17.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:46:16 smithi188 bash[23329]: cluster 2020-07-16T15:46:15.209352+0000 mgr.x (mgr.34562) 6134 : cluster [DBG] pgmap v3827: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:46:19.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:46:18 smithi132 bash[27079]: cluster 2020-07-16T15:46:17.209905+0000 mgr.x (mgr.34562) 6135 : cluster [DBG] pgmap v3828: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:46:19.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:46:18 smithi188 bash[23329]: cluster 2020-07-16T15:46:17.209905+0000 mgr.x (mgr.34562) 6135 : cluster [DBG] pgmap v3828: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:46:20.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:46:19 smithi132 bash[27079]: audit 2020-07-16T15:46:19.405749+0000 mon.b (mon.2) 1338 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:46:20.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:46:19 smithi188 bash[23329]: audit 2020-07-16T15:46:19.405749+0000 mon.b (mon.2) 1338 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:46:20.563 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:46:20.828 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:46:20.829 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 49s ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:46:20.829 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 49s ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:46:20.829 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 49s ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:46:20.829 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 49s ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:46:20.830 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 49s ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:46:20.830 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 49s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:46:20.830 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 49s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:46:20.830 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 49s ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:46:20.830 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 49s ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:46:20.831 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 49s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:46:20.831 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 49s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:46:20.831 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 49s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:46:20.831 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 49s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:46:20.831 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 49s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:46:20.832 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 49s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:46:20.832 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 49s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:46:20.832 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 49s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:46:20.832 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 49s ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:46:21.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:46:20 smithi132 bash[27079]: cluster 2020-07-16T15:46:19.210364+0000 mgr.x (mgr.34562) 6136 : cluster [DBG] pgmap v3829: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:46:21.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:46:20 smithi132 bash[27079]: cephadm 2020-07-16T15:46:19.406550+0000 mgr.x (mgr.34562) 6137 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:46:21.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:46:20 smithi132 bash[27079]: cephadm 2020-07-16T15:46:19.406760+0000 mgr.x (mgr.34562) 6138 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:46:21.128 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:46:21.129 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:46:21.129 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:46:21.129 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:46:21.129 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:46:21.129 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:46:21.130 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:46:21.130 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:46:21.130 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:46:21.130 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:46:21.130 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:46:21.131 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:46:21.131 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:46:21.131 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:46:21.131 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:46:21.131 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:46:21.131 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:46:21.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:46:20 smithi188 bash[23329]: cluster 2020-07-16T15:46:19.210364+0000 mgr.x (mgr.34562) 6136 : cluster [DBG] pgmap v3829: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:46:21.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:46:20 smithi188 bash[23329]: cephadm 2020-07-16T15:46:19.406550+0000 mgr.x (mgr.34562) 6137 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:46:21.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:46:20 smithi188 bash[23329]: cephadm 2020-07-16T15:46:19.406760+0000 mgr.x (mgr.34562) 6138 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:46:22.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:46:21 smithi132 bash[27079]: audit 2020-07-16T15:46:20.551898+0000 mgr.x (mgr.34562) 6139 : audit [DBG] from='client.29104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:46:22.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:46:21 smithi132 bash[27079]: audit 2020-07-16T15:46:20.824667+0000 mgr.x (mgr.34562) 6140 : audit [DBG] from='client.29110 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:46:22.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:46:21 smithi132 bash[27079]: audit 2020-07-16T15:46:21.127879+0000 mon.c (mon.1) 424 : audit [DBG] from='client.? 172.21.15.132:0/2824884211' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:46:22.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:46:21 smithi188 bash[23329]: audit 2020-07-16T15:46:20.551898+0000 mgr.x (mgr.34562) 6139 : audit [DBG] from='client.29104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:46:22.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:46:21 smithi188 bash[23329]: audit 2020-07-16T15:46:20.824667+0000 mgr.x (mgr.34562) 6140 : audit [DBG] from='client.29110 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:46:22.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:46:21 smithi188 bash[23329]: audit 2020-07-16T15:46:21.127879+0000 mon.c (mon.1) 424 : audit [DBG] from='client.? 172.21.15.132:0/2824884211' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:46:23.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:46:22 smithi132 bash[27079]: cluster 2020-07-16T15:46:21.210844+0000 mgr.x (mgr.34562) 6141 : cluster [DBG] pgmap v3830: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:46:23.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:46:22 smithi188 bash[23329]: cluster 2020-07-16T15:46:21.210844+0000 mgr.x (mgr.34562) 6141 : cluster [DBG] pgmap v3830: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:46:25.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:46:24 smithi132 bash[27079]: cluster 2020-07-16T15:46:23.211376+0000 mgr.x (mgr.34562) 6142 : cluster [DBG] pgmap v3831: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:46:25.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:46:24 smithi188 bash[23329]: cluster 2020-07-16T15:46:23.211376+0000 mgr.x (mgr.34562) 6142 : cluster [DBG] pgmap v3831: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:46:27.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:46:26 smithi132 bash[27079]: cluster 2020-07-16T15:46:25.211773+0000 mgr.x (mgr.34562) 6143 : cluster [DBG] pgmap v3832: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:46:27.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:46:26 smithi188 bash[23329]: cluster 2020-07-16T15:46:25.211773+0000 mgr.x (mgr.34562) 6143 : cluster [DBG] pgmap v3832: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:46:29.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:46:28 smithi132 bash[27079]: cluster 2020-07-16T15:46:27.212301+0000 mgr.x (mgr.34562) 6144 : cluster [DBG] pgmap v3833: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:46:29.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:46:28 smithi188 bash[23329]: cluster 2020-07-16T15:46:27.212301+0000 mgr.x (mgr.34562) 6144 : cluster [DBG] pgmap v3833: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:46:31.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:46:30 smithi132 bash[27079]: cluster 2020-07-16T15:46:29.212698+0000 mgr.x (mgr.34562) 6145 : cluster [DBG] pgmap v3834: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:46:31.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:46:30 smithi188 bash[23329]: cluster 2020-07-16T15:46:29.212698+0000 mgr.x (mgr.34562) 6145 : cluster [DBG] pgmap v3834: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:46:33.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:46:32 smithi132 bash[27079]: cluster 2020-07-16T15:46:31.213044+0000 mgr.x (mgr.34562) 6146 : cluster [DBG] pgmap v3835: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:46:33.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:46:32 smithi188 bash[23329]: cluster 2020-07-16T15:46:31.213044+0000 mgr.x (mgr.34562) 6146 : cluster [DBG] pgmap v3835: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:46:35.042 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:46:34 smithi132 bash[27079]: cluster 2020-07-16T15:46:33.213601+0000 mgr.x (mgr.34562) 6147 : cluster [DBG] pgmap v3836: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:46:35.043 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:46:34 smithi132 bash[27079]: audit 2020-07-16T15:46:34.425163+0000 mon.b (mon.2) 1339 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:46:35.043 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:46:34 smithi132 bash[27079]: audit 2020-07-16T15:46:34.426527+0000 mon.b (mon.2) 1340 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:46:35.043 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:46:34 smithi132 bash[27079]: audit 2020-07-16T15:46:34.427753+0000 mon.b (mon.2) 1341 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:46:35.043 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:46:34 smithi132 bash[27079]: audit 2020-07-16T15:46:34.429133+0000 mon.b (mon.2) 1342 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:46:35.044 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:46:34 smithi132 bash[27079]: audit 2020-07-16T15:46:34.430275+0000 mon.b (mon.2) 1343 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:46:35.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:46:34 smithi188 bash[23329]: cluster 2020-07-16T15:46:33.213601+0000 mgr.x (mgr.34562) 6147 : cluster [DBG] pgmap v3836: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:46:35.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:46:34 smithi188 bash[23329]: audit 2020-07-16T15:46:34.425163+0000 mon.b (mon.2) 1339 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:46:35.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:46:34 smithi188 bash[23329]: audit 2020-07-16T15:46:34.426527+0000 mon.b (mon.2) 1340 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:46:35.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:46:34 smithi188 bash[23329]: audit 2020-07-16T15:46:34.427753+0000 mon.b (mon.2) 1341 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:46:35.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:46:34 smithi188 bash[23329]: audit 2020-07-16T15:46:34.429133+0000 mon.b (mon.2) 1342 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:46:35.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:46:34 smithi188 bash[23329]: audit 2020-07-16T15:46:34.430275+0000 mon.b (mon.2) 1343 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:46:36.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:46:35 smithi188 bash[23329]: audit 2020-07-16T15:46:34.425527+0000 mgr.x (mgr.34562) 6148 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:46:36.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:46:35 smithi188 bash[23329]: audit 2020-07-16T15:46:34.426859+0000 mgr.x (mgr.34562) 6149 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:46:36.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:46:35 smithi188 bash[23329]: audit 2020-07-16T15:46:34.428061+0000 mgr.x (mgr.34562) 6150 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:46:36.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:46:35 smithi188 bash[23329]: cephadm 2020-07-16T15:46:34.428779+0000 mgr.x (mgr.34562) 6151 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:46:36.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:46:35 smithi188 bash[23329]: cephadm 2020-07-16T15:46:34.429959+0000 mgr.x (mgr.34562) 6152 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:46:36.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:46:35 smithi188 bash[23329]: cephadm 2020-07-16T15:46:34.431051+0000 mgr.x (mgr.34562) 6153 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:46:36.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:46:35 smithi188 bash[23329]: cephadm 2020-07-16T15:46:34.431326+0000 mgr.x (mgr.34562) 6154 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:46:36.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:46:35 smithi132 bash[27079]: audit 2020-07-16T15:46:34.425527+0000 mgr.x (mgr.34562) 6148 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:46:36.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:46:35 smithi132 bash[27079]: audit 2020-07-16T15:46:34.426859+0000 mgr.x (mgr.34562) 6149 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:46:36.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:46:35 smithi132 bash[27079]: audit 2020-07-16T15:46:34.428061+0000 mgr.x (mgr.34562) 6150 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:46:36.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:46:35 smithi132 bash[27079]: cephadm 2020-07-16T15:46:34.428779+0000 mgr.x (mgr.34562) 6151 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:46:36.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:46:35 smithi132 bash[27079]: cephadm 2020-07-16T15:46:34.429959+0000 mgr.x (mgr.34562) 6152 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:46:36.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:46:35 smithi132 bash[27079]: cephadm 2020-07-16T15:46:34.431051+0000 mgr.x (mgr.34562) 6153 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:46:36.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:46:35 smithi132 bash[27079]: cephadm 2020-07-16T15:46:34.431326+0000 mgr.x (mgr.34562) 6154 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:46:37.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:46:36 smithi188 bash[23329]: cluster 2020-07-16T15:46:35.213992+0000 mgr.x (mgr.34562) 6155 : cluster [DBG] pgmap v3837: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:46:37.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:46:36 smithi132 bash[27079]: cluster 2020-07-16T15:46:35.213992+0000 mgr.x (mgr.34562) 6155 : cluster [DBG] pgmap v3837: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:46:38.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:46:37 smithi188 bash[23329]: audit 2020-07-16T15:46:37.443468+0000 mon.b (mon.2) 1344 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:46:38.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:46:37 smithi132 bash[27079]: audit 2020-07-16T15:46:37.443468+0000 mon.b (mon.2) 1344 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:46:39.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:46:38 smithi188 bash[23329]: cluster 2020-07-16T15:46:37.214359+0000 mgr.x (mgr.34562) 6156 : cluster [DBG] pgmap v3838: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:46:39.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:46:38 smithi188 bash[23329]: cephadm 2020-07-16T15:46:37.444090+0000 mgr.x (mgr.34562) 6157 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:46:39.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:46:38 smithi188 bash[23329]: cephadm 2020-07-16T15:46:37.444510+0000 mgr.x (mgr.34562) 6158 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:46:39.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:46:38 smithi132 bash[27079]: cluster 2020-07-16T15:46:37.214359+0000 mgr.x (mgr.34562) 6156 : cluster [DBG] pgmap v3838: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:46:39.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:46:38 smithi132 bash[27079]: cephadm 2020-07-16T15:46:37.444090+0000 mgr.x (mgr.34562) 6157 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:46:39.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:46:38 smithi132 bash[27079]: cephadm 2020-07-16T15:46:37.444510+0000 mgr.x (mgr.34562) 6158 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:46:41.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:46:40 smithi188 bash[23329]: cluster 2020-07-16T15:46:39.214682+0000 mgr.x (mgr.34562) 6159 : cluster [DBG] pgmap v3839: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:46:41.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:46:40 smithi132 bash[27079]: cluster 2020-07-16T15:46:39.214682+0000 mgr.x (mgr.34562) 6159 : cluster [DBG] pgmap v3839: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:46:43.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:46:42 smithi188 bash[23329]: cluster 2020-07-16T15:46:41.215172+0000 mgr.x (mgr.34562) 6160 : cluster [DBG] pgmap v3840: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:46:43.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:46:42 smithi132 bash[27079]: cluster 2020-07-16T15:46:41.215172+0000 mgr.x (mgr.34562) 6160 : cluster [DBG] pgmap v3840: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:46:45.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:46:44 smithi188 bash[23329]: cluster 2020-07-16T15:46:43.215642+0000 mgr.x (mgr.34562) 6161 : cluster [DBG] pgmap v3841: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:46:45.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:46:44 smithi132 bash[27079]: cluster 2020-07-16T15:46:43.215642+0000 mgr.x (mgr.34562) 6161 : cluster [DBG] pgmap v3841: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:46:47.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:46:46 smithi188 bash[23329]: cluster 2020-07-16T15:46:45.216044+0000 mgr.x (mgr.34562) 6162 : cluster [DBG] pgmap v3842: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:46:47.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:46:46 smithi132 bash[27079]: cluster 2020-07-16T15:46:45.216044+0000 mgr.x (mgr.34562) 6162 : cluster [DBG] pgmap v3842: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:46:49.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:46:48 smithi188 bash[23329]: cluster 2020-07-16T15:46:47.216446+0000 mgr.x (mgr.34562) 6163 : cluster [DBG] pgmap v3843: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:46:49.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:46:48 smithi132 bash[27079]: cluster 2020-07-16T15:46:47.216446+0000 mgr.x (mgr.34562) 6163 : cluster [DBG] pgmap v3843: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:46:51.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:46:50 smithi188 bash[23329]: cluster 2020-07-16T15:46:49.216925+0000 mgr.x (mgr.34562) 6164 : cluster [DBG] pgmap v3844: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:46:51.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:46:50 smithi132 bash[27079]: cluster 2020-07-16T15:46:49.216925+0000 mgr.x (mgr.34562) 6164 : cluster [DBG] pgmap v3844: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:46:51.426 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:46:51.688 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:46:51.689 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 80s ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:46:51.689 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 80s ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:46:51.689 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 80s ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:46:51.690 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 80s ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:46:51.690 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 80s ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:46:51.690 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 80s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:46:51.690 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 80s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:46:51.690 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 80s ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:46:51.691 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 80s ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:46:51.691 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 80s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:46:51.691 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 80s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:46:51.691 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 80s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:46:51.691 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 80s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:46:51.692 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 80s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:46:51.692 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 80s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:46:51.692 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 80s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:46:51.692 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 80s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:46:51.692 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 80s ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:46:51.985 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:46:51.985 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:46:51.985 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:46:51.986 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:46:51.986 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:46:51.986 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:46:51.986 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:46:51.986 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:46:51.987 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:46:51.987 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:46:51.987 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:46:51.987 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:46:51.987 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:46:51.987 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:46:51.988 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:46:51.988 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:46:51.988 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:46:53.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:46:52 smithi188 bash[23329]: cluster 2020-07-16T15:46:51.217464+0000 mgr.x (mgr.34562) 6165 : cluster [DBG] pgmap v3845: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:46:53.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:46:52 smithi188 bash[23329]: audit 2020-07-16T15:46:51.414916+0000 mgr.x (mgr.34562) 6166 : audit [DBG] from='client.29122 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:46:53.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:46:52 smithi188 bash[23329]: audit 2020-07-16T15:46:51.684651+0000 mgr.x (mgr.34562) 6167 : audit [DBG] from='client.29128 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:46:53.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:46:52 smithi188 bash[23329]: audit 2020-07-16T15:46:51.984413+0000 mon.c (mon.1) 425 : audit [DBG] from='client.? 172.21.15.132:0/3603220153' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:46:53.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:46:52 smithi188 bash[23329]: audit 2020-07-16T15:46:52.451673+0000 mon.b (mon.2) 1345 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:46:53.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:46:52 smithi132 bash[27079]: cluster 2020-07-16T15:46:51.217464+0000 mgr.x (mgr.34562) 6165 : cluster [DBG] pgmap v3845: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:46:53.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:46:52 smithi132 bash[27079]: audit 2020-07-16T15:46:51.414916+0000 mgr.x (mgr.34562) 6166 : audit [DBG] from='client.29122 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:46:53.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:46:52 smithi132 bash[27079]: audit 2020-07-16T15:46:51.684651+0000 mgr.x (mgr.34562) 6167 : audit [DBG] from='client.29128 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:46:53.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:46:52 smithi132 bash[27079]: audit 2020-07-16T15:46:51.984413+0000 mon.c (mon.1) 425 : audit [DBG] from='client.? 172.21.15.132:0/3603220153' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:46:53.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:46:52 smithi132 bash[27079]: audit 2020-07-16T15:46:52.451673+0000 mon.b (mon.2) 1345 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:46:54.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:46:53 smithi188 bash[23329]: cephadm 2020-07-16T15:46:52.452333+0000 mgr.x (mgr.34562) 6168 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:46:54.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:46:53 smithi188 bash[23329]: cephadm 2020-07-16T15:46:52.452503+0000 mgr.x (mgr.34562) 6169 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:46:54.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:46:53 smithi132 bash[27079]: cephadm 2020-07-16T15:46:52.452333+0000 mgr.x (mgr.34562) 6168 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:46:54.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:46:53 smithi132 bash[27079]: cephadm 2020-07-16T15:46:52.452503+0000 mgr.x (mgr.34562) 6169 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:46:55.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:46:54 smithi188 bash[23329]: cluster 2020-07-16T15:46:53.217910+0000 mgr.x (mgr.34562) 6170 : cluster [DBG] pgmap v3846: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:46:55.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:46:54 smithi132 bash[27079]: cluster 2020-07-16T15:46:53.217910+0000 mgr.x (mgr.34562) 6170 : cluster [DBG] pgmap v3846: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:46:57.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:46:56 smithi188 bash[23329]: cluster 2020-07-16T15:46:55.218313+0000 mgr.x (mgr.34562) 6171 : cluster [DBG] pgmap v3847: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:46:57.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:46:56 smithi132 bash[27079]: cluster 2020-07-16T15:46:55.218313+0000 mgr.x (mgr.34562) 6171 : cluster [DBG] pgmap v3847: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:46:59.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:46:58 smithi188 bash[23329]: cluster 2020-07-16T15:46:57.218894+0000 mgr.x (mgr.34562) 6172 : cluster [DBG] pgmap v3848: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:46:59.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:46:58 smithi132 bash[27079]: cluster 2020-07-16T15:46:57.218894+0000 mgr.x (mgr.34562) 6172 : cluster [DBG] pgmap v3848: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:47:01.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:00 smithi188 bash[23329]: cluster 2020-07-16T15:46:59.219471+0000 mgr.x (mgr.34562) 6173 : cluster [DBG] pgmap v3849: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:47:01.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:00 smithi132 bash[27079]: cluster 2020-07-16T15:46:59.219471+0000 mgr.x (mgr.34562) 6173 : cluster [DBG] pgmap v3849: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:47:03.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:02 smithi188 bash[23329]: cluster 2020-07-16T15:47:01.220029+0000 mgr.x (mgr.34562) 6174 : cluster [DBG] pgmap v3850: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:47:03.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:02 smithi132 bash[27079]: cluster 2020-07-16T15:47:01.220029+0000 mgr.x (mgr.34562) 6174 : cluster [DBG] pgmap v3850: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:47:05.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:04 smithi188 bash[23329]: cluster 2020-07-16T15:47:03.220517+0000 mgr.x (mgr.34562) 6175 : cluster [DBG] pgmap v3851: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:47:05.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:04 smithi132 bash[27079]: cluster 2020-07-16T15:47:03.220517+0000 mgr.x (mgr.34562) 6175 : cluster [DBG] pgmap v3851: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:47:07.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:06 smithi188 bash[23329]: cluster 2020-07-16T15:47:05.220851+0000 mgr.x (mgr.34562) 6176 : cluster [DBG] pgmap v3852: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:47:07.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:06 smithi132 bash[27079]: cluster 2020-07-16T15:47:05.220851+0000 mgr.x (mgr.34562) 6176 : cluster [DBG] pgmap v3852: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:47:08.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:07 smithi188 bash[23329]: audit 2020-07-16T15:47:07.468251+0000 mon.b (mon.2) 1346 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:47:08.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:07 smithi132 bash[27079]: audit 2020-07-16T15:47:07.468251+0000 mon.b (mon.2) 1346 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:47:09.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:08 smithi188 bash[23329]: cluster 2020-07-16T15:47:07.221396+0000 mgr.x (mgr.34562) 6177 : cluster [DBG] pgmap v3853: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:47:09.378 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:08 smithi188 bash[23329]: cephadm 2020-07-16T15:47:07.468949+0000 mgr.x (mgr.34562) 6178 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:47:09.379 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:08 smithi188 bash[23329]: cephadm 2020-07-16T15:47:07.469264+0000 mgr.x (mgr.34562) 6179 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:47:09.380 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:08 smithi132 bash[27079]: cluster 2020-07-16T15:47:07.221396+0000 mgr.x (mgr.34562) 6177 : cluster [DBG] pgmap v3853: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:47:09.380 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:08 smithi132 bash[27079]: cephadm 2020-07-16T15:47:07.468949+0000 mgr.x (mgr.34562) 6178 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:47:09.380 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:08 smithi132 bash[27079]: cephadm 2020-07-16T15:47:07.469264+0000 mgr.x (mgr.34562) 6179 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:47:11.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:10 smithi188 bash[23329]: cluster 2020-07-16T15:47:09.221914+0000 mgr.x (mgr.34562) 6180 : cluster [DBG] pgmap v3854: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:47:11.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:10 smithi132 bash[27079]: cluster 2020-07-16T15:47:09.221914+0000 mgr.x (mgr.34562) 6180 : cluster [DBG] pgmap v3854: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:47:13.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:12 smithi188 bash[23329]: cluster 2020-07-16T15:47:11.222245+0000 mgr.x (mgr.34562) 6181 : cluster [DBG] pgmap v3855: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:47:13.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:12 smithi132 bash[27079]: cluster 2020-07-16T15:47:11.222245+0000 mgr.x (mgr.34562) 6181 : cluster [DBG] pgmap v3855: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:47:15.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:14 smithi188 bash[23329]: cluster 2020-07-16T15:47:13.222764+0000 mgr.x (mgr.34562) 6182 : cluster [DBG] pgmap v3856: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:47:15.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:14 smithi132 bash[27079]: cluster 2020-07-16T15:47:13.222764+0000 mgr.x (mgr.34562) 6182 : cluster [DBG] pgmap v3856: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:47:17.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:16 smithi188 bash[23329]: cluster 2020-07-16T15:47:15.223246+0000 mgr.x (mgr.34562) 6183 : cluster [DBG] pgmap v3857: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:47:17.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:16 smithi132 bash[27079]: cluster 2020-07-16T15:47:15.223246+0000 mgr.x (mgr.34562) 6183 : cluster [DBG] pgmap v3857: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:47:19.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:18 smithi188 bash[23329]: cluster 2020-07-16T15:47:17.223799+0000 mgr.x (mgr.34562) 6184 : cluster [DBG] pgmap v3858: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:47:19.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:18 smithi132 bash[27079]: cluster 2020-07-16T15:47:17.223799+0000 mgr.x (mgr.34562) 6184 : cluster [DBG] pgmap v3858: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:47:21.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:20 smithi188 bash[23329]: cluster 2020-07-16T15:47:19.224345+0000 mgr.x (mgr.34562) 6185 : cluster [DBG] pgmap v3859: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:47:21.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:20 smithi132 bash[27079]: cluster 2020-07-16T15:47:19.224345+0000 mgr.x (mgr.34562) 6185 : cluster [DBG] pgmap v3859: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:47:22.282 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:47:22.541 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:47:22.542 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 111s ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:47:22.542 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 110s ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:47:22.542 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 110s ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:47:22.542 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 111s ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:47:22.543 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 111s ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:47:22.543 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 110s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:47:22.543 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 111s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:47:22.543 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 111s ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:47:22.544 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 110s ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:47:22.544 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 111s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:47:22.544 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 111s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:47:22.544 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 111s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:47:22.544 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 111s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:47:22.545 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 110s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:47:22.545 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 110s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:47:22.545 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 110s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:47:22.545 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 110s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:47:22.546 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 110s ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:47:22.836 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:47:22.836 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:47:22.837 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:47:22.837 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:47:22.837 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:47:22.838 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:47:22.838 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:47:22.838 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:47:22.839 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:47:22.839 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:47:22.840 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:47:22.840 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:47:22.840 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:47:22.841 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:47:22.841 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:47:22.841 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:47:22.841 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:47:23.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:22 smithi188 bash[23329]: cluster 2020-07-16T15:47:21.224811+0000 mgr.x (mgr.34562) 6186 : cluster [DBG] pgmap v3860: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:47:23.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:22 smithi188 bash[23329]: audit 2020-07-16T15:47:22.475662+0000 mon.b (mon.2) 1347 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:47:23.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:22 smithi188 bash[23329]: audit 2020-07-16T15:47:22.835494+0000 mon.c (mon.1) 426 : audit [DBG] from='client.? 172.21.15.132:0/838708567' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:47:23.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:22 smithi132 bash[27079]: cluster 2020-07-16T15:47:21.224811+0000 mgr.x (mgr.34562) 6186 : cluster [DBG] pgmap v3860: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:47:23.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:22 smithi132 bash[27079]: audit 2020-07-16T15:47:22.475662+0000 mon.b (mon.2) 1347 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:47:23.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:22 smithi132 bash[27079]: audit 2020-07-16T15:47:22.835494+0000 mon.c (mon.1) 426 : audit [DBG] from='client.? 172.21.15.132:0/838708567' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:47:24.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:23 smithi188 bash[23329]: audit 2020-07-16T15:47:22.270336+0000 mgr.x (mgr.34562) 6187 : audit [DBG] from='client.29140 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:47:24.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:23 smithi188 bash[23329]: cephadm 2020-07-16T15:47:22.476365+0000 mgr.x (mgr.34562) 6188 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:47:24.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:23 smithi188 bash[23329]: cephadm 2020-07-16T15:47:22.476760+0000 mgr.x (mgr.34562) 6189 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:47:24.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:23 smithi188 bash[23329]: audit 2020-07-16T15:47:22.537040+0000 mgr.x (mgr.34562) 6190 : audit [DBG] from='client.29146 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:47:24.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:23 smithi132 bash[27079]: audit 2020-07-16T15:47:22.270336+0000 mgr.x (mgr.34562) 6187 : audit [DBG] from='client.29140 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:47:24.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:23 smithi132 bash[27079]: cephadm 2020-07-16T15:47:22.476365+0000 mgr.x (mgr.34562) 6188 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:47:24.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:23 smithi132 bash[27079]: cephadm 2020-07-16T15:47:22.476760+0000 mgr.x (mgr.34562) 6189 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:47:24.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:23 smithi132 bash[27079]: audit 2020-07-16T15:47:22.537040+0000 mgr.x (mgr.34562) 6190 : audit [DBG] from='client.29146 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:47:25.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:24 smithi188 bash[23329]: cluster 2020-07-16T15:47:23.225273+0000 mgr.x (mgr.34562) 6191 : cluster [DBG] pgmap v3861: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:47:25.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:24 smithi132 bash[27079]: cluster 2020-07-16T15:47:23.225273+0000 mgr.x (mgr.34562) 6191 : cluster [DBG] pgmap v3861: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:47:27.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:26 smithi188 bash[23329]: cluster 2020-07-16T15:47:25.225653+0000 mgr.x (mgr.34562) 6192 : cluster [DBG] pgmap v3862: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:47:27.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:26 smithi132 bash[27079]: cluster 2020-07-16T15:47:25.225653+0000 mgr.x (mgr.34562) 6192 : cluster [DBG] pgmap v3862: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:47:29.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:28 smithi188 bash[23329]: cluster 2020-07-16T15:47:27.226035+0000 mgr.x (mgr.34562) 6193 : cluster [DBG] pgmap v3863: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:47:29.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:28 smithi132 bash[27079]: cluster 2020-07-16T15:47:27.226035+0000 mgr.x (mgr.34562) 6193 : cluster [DBG] pgmap v3863: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:47:31.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:30 smithi188 bash[23329]: cluster 2020-07-16T15:47:29.226531+0000 mgr.x (mgr.34562) 6194 : cluster [DBG] pgmap v3864: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:47:31.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:30 smithi132 bash[27079]: cluster 2020-07-16T15:47:29.226531+0000 mgr.x (mgr.34562) 6194 : cluster [DBG] pgmap v3864: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:47:33.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:32 smithi188 bash[23329]: cluster 2020-07-16T15:47:31.227000+0000 mgr.x (mgr.34562) 6195 : cluster [DBG] pgmap v3865: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:47:33.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:32 smithi132 bash[27079]: cluster 2020-07-16T15:47:31.227000+0000 mgr.x (mgr.34562) 6195 : cluster [DBG] pgmap v3865: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:47:35.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:34 smithi188 bash[23329]: cluster 2020-07-16T15:47:33.227525+0000 mgr.x (mgr.34562) 6196 : cluster [DBG] pgmap v3866: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:47:35.360 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:34 smithi132 bash[27079]: cluster 2020-07-16T15:47:33.227525+0000 mgr.x (mgr.34562) 6196 : cluster [DBG] pgmap v3866: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:47:37.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:36 smithi188 bash[23329]: cluster 2020-07-16T15:47:35.227903+0000 mgr.x (mgr.34562) 6197 : cluster [DBG] pgmap v3867: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:47:37.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:36 smithi132 bash[27079]: cluster 2020-07-16T15:47:35.227903+0000 mgr.x (mgr.34562) 6197 : cluster [DBG] pgmap v3867: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:47:38.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:37 smithi188 bash[23329]: audit 2020-07-16T15:47:37.719631+0000 mon.b (mon.2) 1348 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566331\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566403\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566435\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566617\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566718\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566816\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566912\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566944\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566972\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:45:31.567038\", \"last_device_update\": \"2020-07-16T15:36:02.606623\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:47:37.718791\"}"}]: dispatch 2020-07-16T15:47:38.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:37 smithi188 bash[23329]: audit 2020-07-16T15:47:37.720244+0000 mon.c (mon.1) 427 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566331\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566403\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566435\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566617\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566718\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566816\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566912\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566944\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566972\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:45:31.567038\", \"last_device_update\": \"2020-07-16T15:36:02.606623\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:47:37.718791\"}"}]: dispatch 2020-07-16T15:47:38.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:37 smithi188 bash[23329]: audit 2020-07-16T15:47:37.721222+0000 mon.b (mon.2) 1349 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:45:31.300468\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300526\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300562\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300593\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300769\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300877\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300985\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.301091\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.301125\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:45:31.301198\", \"last_device_update\": \"2020-07-16T15:34:56.840832\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:47:37.720588\"}"}]: dispatch 2020-07-16T15:47:38.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:37 smithi188 bash[23329]: audit 2020-07-16T15:47:37.723005+0000 mon.c (mon.1) 428 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566331\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566403\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566435\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566617\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566718\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566816\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566912\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566944\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566972\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:45:31.567038\", \"last_device_update\": \"2020-07-16T15:36:02.606623\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:47:37.718791\"}"}]': finished 2020-07-16T15:47:38.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:37 smithi188 bash[23329]: audit 2020-07-16T15:47:37.723232+0000 mon.c (mon.1) 429 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:45:31.300468\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300526\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300562\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300593\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300769\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300877\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300985\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.301091\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.301125\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:45:31.301198\", \"last_device_update\": \"2020-07-16T15:34:56.840832\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:47:37.720588\"}"}]: dispatch 2020-07-16T15:47:38.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:37 smithi188 bash[23329]: audit 2020-07-16T15:47:37.725118+0000 mon.c (mon.1) 430 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:45:31.300468\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300526\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300562\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300593\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300769\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300877\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300985\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.301091\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.301125\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:45:31.301198\", \"last_device_update\": \"2020-07-16T15:34:56.840832\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:47:37.720588\"}"}]': finished 2020-07-16T15:47:38.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:37 smithi188 bash[23329]: audit 2020-07-16T15:47:37.728162+0000 mon.b (mon.2) 1350 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:47:38.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:37 smithi188 bash[23329]: audit 2020-07-16T15:47:37.729086+0000 mon.b (mon.2) 1351 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:47:38.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:37 smithi188 bash[23329]: audit 2020-07-16T15:47:37.729934+0000 mon.b (mon.2) 1352 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:47:38.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:37 smithi188 bash[23329]: audit 2020-07-16T15:47:37.730931+0000 mon.b (mon.2) 1353 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:47:38.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:37 smithi188 bash[23329]: audit 2020-07-16T15:47:37.731808+0000 mon.b (mon.2) 1354 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:47:38.180 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:37 smithi132 bash[27079]: audit 2020-07-16T15:47:37.719631+0000 mon.b (mon.2) 1348 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566331\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566403\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566435\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566617\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566718\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566816\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566912\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566944\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566972\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:45:31.567038\", \"last_device_update\": \"2020-07-16T15:36:02.606623\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:47:37.718791\"}"}]: dispatch 2020-07-16T15:47:38.181 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:37 smithi132 bash[27079]: audit 2020-07-16T15:47:37.720244+0000 mon.c (mon.1) 427 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566331\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566403\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566435\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566617\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566718\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566816\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566912\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566944\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566972\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:45:31.567038\", \"last_device_update\": \"2020-07-16T15:36:02.606623\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:47:37.718791\"}"}]: dispatch 2020-07-16T15:47:38.181 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:37 smithi132 bash[27079]: audit 2020-07-16T15:47:37.721222+0000 mon.b (mon.2) 1349 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:45:31.300468\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300526\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300562\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300593\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300769\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300877\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300985\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.301091\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.301125\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:45:31.301198\", \"last_device_update\": \"2020-07-16T15:34:56.840832\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:47:37.720588\"}"}]: dispatch 2020-07-16T15:47:38.182 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:37 smithi132 bash[27079]: audit 2020-07-16T15:47:37.723005+0000 mon.c (mon.1) 428 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566331\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566403\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566435\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566617\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566718\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566816\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566912\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566944\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.566972\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:45:31.567038\", \"last_device_update\": \"2020-07-16T15:36:02.606623\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:47:37.718791\"}"}]': finished 2020-07-16T15:47:38.182 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:37 smithi132 bash[27079]: audit 2020-07-16T15:47:37.723232+0000 mon.c (mon.1) 429 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:45:31.300468\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300526\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300562\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300593\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300769\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300877\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300985\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.301091\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.301125\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:45:31.301198\", \"last_device_update\": \"2020-07-16T15:34:56.840832\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:47:37.720588\"}"}]: dispatch 2020-07-16T15:47:38.182 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:37 smithi132 bash[27079]: audit 2020-07-16T15:47:37.725118+0000 mon.c (mon.1) 430 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:45:31.300468\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300526\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300562\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300593\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300769\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300877\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.300985\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.301091\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:45:31.301125\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:45:31.301198\", \"last_device_update\": \"2020-07-16T15:34:56.840832\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:47:37.720588\"}"}]': finished 2020-07-16T15:47:38.183 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:37 smithi132 bash[27079]: audit 2020-07-16T15:47:37.728162+0000 mon.b (mon.2) 1350 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:47:38.183 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:37 smithi132 bash[27079]: audit 2020-07-16T15:47:37.729086+0000 mon.b (mon.2) 1351 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:47:38.183 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:37 smithi132 bash[27079]: audit 2020-07-16T15:47:37.729934+0000 mon.b (mon.2) 1352 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:47:38.183 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:37 smithi132 bash[27079]: audit 2020-07-16T15:47:37.730931+0000 mon.b (mon.2) 1353 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:47:38.183 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:37 smithi132 bash[27079]: audit 2020-07-16T15:47:37.731808+0000 mon.b (mon.2) 1354 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:47:39.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:38 smithi188 bash[23329]: cluster 2020-07-16T15:47:37.228331+0000 mgr.x (mgr.34562) 6198 : cluster [DBG] pgmap v3868: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:47:39.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:38 smithi188 bash[23329]: audit 2020-07-16T15:47:37.728452+0000 mgr.x (mgr.34562) 6199 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:47:39.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:38 smithi188 bash[23329]: audit 2020-07-16T15:47:37.729347+0000 mgr.x (mgr.34562) 6200 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:47:39.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:38 smithi188 bash[23329]: audit 2020-07-16T15:47:37.730143+0000 mgr.x (mgr.34562) 6201 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:47:39.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:38 smithi188 bash[23329]: cephadm 2020-07-16T15:47:37.730690+0000 mgr.x (mgr.34562) 6202 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:47:39.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:38 smithi188 bash[23329]: cephadm 2020-07-16T15:47:37.731592+0000 mgr.x (mgr.34562) 6203 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:47:39.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:38 smithi188 bash[23329]: cephadm 2020-07-16T15:47:37.732349+0000 mgr.x (mgr.34562) 6204 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:47:39.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:38 smithi188 bash[23329]: cephadm 2020-07-16T15:47:37.732428+0000 mgr.x (mgr.34562) 6205 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:47:39.237 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:38 smithi132 bash[27079]: cluster 2020-07-16T15:47:37.228331+0000 mgr.x (mgr.34562) 6198 : cluster [DBG] pgmap v3868: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:47:39.237 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:38 smithi132 bash[27079]: audit 2020-07-16T15:47:37.728452+0000 mgr.x (mgr.34562) 6199 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:47:39.238 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:38 smithi132 bash[27079]: audit 2020-07-16T15:47:37.729347+0000 mgr.x (mgr.34562) 6200 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:47:39.238 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:38 smithi132 bash[27079]: audit 2020-07-16T15:47:37.730143+0000 mgr.x (mgr.34562) 6201 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:47:39.238 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:38 smithi132 bash[27079]: cephadm 2020-07-16T15:47:37.730690+0000 mgr.x (mgr.34562) 6202 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:47:39.239 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:38 smithi132 bash[27079]: cephadm 2020-07-16T15:47:37.731592+0000 mgr.x (mgr.34562) 6203 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:47:39.239 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:38 smithi132 bash[27079]: cephadm 2020-07-16T15:47:37.732349+0000 mgr.x (mgr.34562) 6204 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:47:39.239 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:38 smithi132 bash[27079]: cephadm 2020-07-16T15:47:37.732428+0000 mgr.x (mgr.34562) 6205 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:47:41.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:40 smithi132 bash[27079]: cluster 2020-07-16T15:47:39.228672+0000 mgr.x (mgr.34562) 6206 : cluster [DBG] pgmap v3869: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:47:41.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:40 smithi132 bash[27079]: audit 2020-07-16T15:47:40.538257+0000 mon.b (mon.2) 1355 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:47:41.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:40 smithi188 bash[23329]: cluster 2020-07-16T15:47:39.228672+0000 mgr.x (mgr.34562) 6206 : cluster [DBG] pgmap v3869: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:47:41.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:40 smithi188 bash[23329]: audit 2020-07-16T15:47:40.538257+0000 mon.b (mon.2) 1355 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:47:42.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:41 smithi132 bash[27079]: cephadm 2020-07-16T15:47:40.538860+0000 mgr.x (mgr.34562) 6207 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:47:42.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:41 smithi132 bash[27079]: cephadm 2020-07-16T15:47:40.538939+0000 mgr.x (mgr.34562) 6208 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:47:42.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:41 smithi188 bash[23329]: cephadm 2020-07-16T15:47:40.538860+0000 mgr.x (mgr.34562) 6207 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:47:42.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:41 smithi188 bash[23329]: cephadm 2020-07-16T15:47:40.538939+0000 mgr.x (mgr.34562) 6208 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:47:43.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:42 smithi132 bash[27079]: cluster 2020-07-16T15:47:41.229051+0000 mgr.x (mgr.34562) 6209 : cluster [DBG] pgmap v3870: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:47:43.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:42 smithi188 bash[23329]: cluster 2020-07-16T15:47:41.229051+0000 mgr.x (mgr.34562) 6209 : cluster [DBG] pgmap v3870: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:47:45.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:44 smithi132 bash[27079]: cluster 2020-07-16T15:47:43.229446+0000 mgr.x (mgr.34562) 6210 : cluster [DBG] pgmap v3871: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:47:45.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:44 smithi188 bash[23329]: cluster 2020-07-16T15:47:43.229446+0000 mgr.x (mgr.34562) 6210 : cluster [DBG] pgmap v3871: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:47:47.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:46 smithi132 bash[27079]: cluster 2020-07-16T15:47:45.229917+0000 mgr.x (mgr.34562) 6211 : cluster [DBG] pgmap v3872: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:47:47.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:46 smithi188 bash[23329]: cluster 2020-07-16T15:47:45.229917+0000 mgr.x (mgr.34562) 6211 : cluster [DBG] pgmap v3872: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:47:49.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:48 smithi132 bash[27079]: cluster 2020-07-16T15:47:47.230470+0000 mgr.x (mgr.34562) 6212 : cluster [DBG] pgmap v3873: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:47:49.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:48 smithi188 bash[23329]: cluster 2020-07-16T15:47:47.230470+0000 mgr.x (mgr.34562) 6212 : cluster [DBG] pgmap v3873: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:47:51.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:50 smithi132 bash[27079]: cluster 2020-07-16T15:47:49.230950+0000 mgr.x (mgr.34562) 6213 : cluster [DBG] pgmap v3874: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:47:51.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:50 smithi188 bash[23329]: cluster 2020-07-16T15:47:49.230950+0000 mgr.x (mgr.34562) 6213 : cluster [DBG] pgmap v3874: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:47:53.133 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:47:53.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:52 smithi132 bash[27079]: cluster 2020-07-16T15:47:51.231368+0000 mgr.x (mgr.34562) 6214 : cluster [DBG] pgmap v3875: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:47:53.394 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:47:53.394 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 2m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:47:53.395 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 2m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:47:53.395 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 2m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:47:53.395 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 2m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:47:53.395 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 2m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:47:53.396 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:47:53.396 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:47:53.396 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 2m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:47:53.396 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 2m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:47:53.396 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:47:53.397 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:47:53.397 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:47:53.397 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:47:53.397 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:47:53.398 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:47:53.398 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:47:53.398 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:47:53.399 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 2m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:47:53.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:52 smithi188 bash[23329]: cluster 2020-07-16T15:47:51.231368+0000 mgr.x (mgr.34562) 6214 : cluster [DBG] pgmap v3875: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:47:53.689 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:47:53.689 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:47:53.689 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:47:53.690 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:47:53.690 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:47:53.690 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:47:53.690 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:47:53.690 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:47:53.691 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:47:53.691 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:47:53.691 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:47:53.691 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:47:53.691 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:47:53.692 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:47:53.692 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:47:53.692 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:47:53.692 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:47:54.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:53 smithi132 bash[27079]: audit 2020-07-16T15:47:53.121956+0000 mgr.x (mgr.34562) 6215 : audit [DBG] from='client.29158 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:47:54.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:53 smithi132 bash[27079]: audit 2020-07-16T15:47:53.688524+0000 mon.c (mon.1) 431 : audit [DBG] from='client.? 172.21.15.132:0/3581806326' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:47:54.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:53 smithi188 bash[23329]: audit 2020-07-16T15:47:53.121956+0000 mgr.x (mgr.34562) 6215 : audit [DBG] from='client.29158 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:47:54.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:53 smithi188 bash[23329]: audit 2020-07-16T15:47:53.688524+0000 mon.c (mon.1) 431 : audit [DBG] from='client.? 172.21.15.132:0/3581806326' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:47:55.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:54 smithi132 bash[27079]: cluster 2020-07-16T15:47:53.231874+0000 mgr.x (mgr.34562) 6216 : cluster [DBG] pgmap v3876: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:47:55.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:54 smithi132 bash[27079]: audit 2020-07-16T15:47:53.390560+0000 mgr.x (mgr.34562) 6217 : audit [DBG] from='client.29164 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:47:55.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:54 smithi188 bash[23329]: cluster 2020-07-16T15:47:53.231874+0000 mgr.x (mgr.34562) 6216 : cluster [DBG] pgmap v3876: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:47:55.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:54 smithi188 bash[23329]: audit 2020-07-16T15:47:53.390560+0000 mgr.x (mgr.34562) 6217 : audit [DBG] from='client.29164 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:47:56.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:55 smithi132 bash[27079]: audit 2020-07-16T15:47:55.543910+0000 mon.b (mon.2) 1356 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:47:56.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:55 smithi188 bash[23329]: audit 2020-07-16T15:47:55.543910+0000 mon.b (mon.2) 1356 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:47:57.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:56 smithi132 bash[27079]: cluster 2020-07-16T15:47:55.232415+0000 mgr.x (mgr.34562) 6218 : cluster [DBG] pgmap v3877: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:47:57.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:56 smithi132 bash[27079]: cephadm 2020-07-16T15:47:55.544607+0000 mgr.x (mgr.34562) 6219 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:47:57.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:56 smithi132 bash[27079]: cephadm 2020-07-16T15:47:55.544707+0000 mgr.x (mgr.34562) 6220 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:47:57.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:56 smithi188 bash[23329]: cluster 2020-07-16T15:47:55.232415+0000 mgr.x (mgr.34562) 6218 : cluster [DBG] pgmap v3877: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:47:57.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:56 smithi188 bash[23329]: cephadm 2020-07-16T15:47:55.544607+0000 mgr.x (mgr.34562) 6219 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:47:57.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:56 smithi188 bash[23329]: cephadm 2020-07-16T15:47:55.544707+0000 mgr.x (mgr.34562) 6220 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:47:59.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:47:58 smithi132 bash[27079]: cluster 2020-07-16T15:47:57.232766+0000 mgr.x (mgr.34562) 6221 : cluster [DBG] pgmap v3878: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:47:59.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:47:58 smithi188 bash[23329]: cluster 2020-07-16T15:47:57.232766+0000 mgr.x (mgr.34562) 6221 : cluster [DBG] pgmap v3878: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:48:01.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:48:00 smithi132 bash[27079]: cluster 2020-07-16T15:47:59.233238+0000 mgr.x (mgr.34562) 6222 : cluster [DBG] pgmap v3879: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:48:01.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:48:00 smithi188 bash[23329]: cluster 2020-07-16T15:47:59.233238+0000 mgr.x (mgr.34562) 6222 : cluster [DBG] pgmap v3879: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:48:03.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:48:02 smithi132 bash[27079]: cluster 2020-07-16T15:48:01.233609+0000 mgr.x (mgr.34562) 6223 : cluster [DBG] pgmap v3880: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:48:03.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:48:02 smithi188 bash[23329]: cluster 2020-07-16T15:48:01.233609+0000 mgr.x (mgr.34562) 6223 : cluster [DBG] pgmap v3880: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:48:05.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:48:04 smithi132 bash[27079]: cluster 2020-07-16T15:48:03.234155+0000 mgr.x (mgr.34562) 6224 : cluster [DBG] pgmap v3881: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:48:05.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:48:04 smithi188 bash[23329]: cluster 2020-07-16T15:48:03.234155+0000 mgr.x (mgr.34562) 6224 : cluster [DBG] pgmap v3881: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:48:07.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:48:06 smithi132 bash[27079]: cluster 2020-07-16T15:48:05.234668+0000 mgr.x (mgr.34562) 6225 : cluster [DBG] pgmap v3882: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:48:07.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:48:06 smithi188 bash[23329]: cluster 2020-07-16T15:48:05.234668+0000 mgr.x (mgr.34562) 6225 : cluster [DBG] pgmap v3882: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:48:09.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:48:08 smithi132 bash[27079]: cluster 2020-07-16T15:48:07.235105+0000 mgr.x (mgr.34562) 6226 : cluster [DBG] pgmap v3883: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:48:09.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:48:08 smithi188 bash[23329]: cluster 2020-07-16T15:48:07.235105+0000 mgr.x (mgr.34562) 6226 : cluster [DBG] pgmap v3883: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:48:11.285 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:48:10 smithi132 bash[27079]: cluster 2020-07-16T15:48:09.235483+0000 mgr.x (mgr.34562) 6227 : cluster [DBG] pgmap v3884: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:48:11.285 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:48:10 smithi132 bash[27079]: audit 2020-07-16T15:48:10.553712+0000 mon.b (mon.2) 1357 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:48:11.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:48:10 smithi188 bash[23329]: cluster 2020-07-16T15:48:09.235483+0000 mgr.x (mgr.34562) 6227 : cluster [DBG] pgmap v3884: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:48:11.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:48:10 smithi188 bash[23329]: audit 2020-07-16T15:48:10.553712+0000 mon.b (mon.2) 1357 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:48:12.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:48:11 smithi132 bash[27079]: cephadm 2020-07-16T15:48:10.554447+0000 mgr.x (mgr.34562) 6228 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:48:12.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:48:11 smithi132 bash[27079]: cephadm 2020-07-16T15:48:10.554850+0000 mgr.x (mgr.34562) 6229 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:48:12.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:48:11 smithi188 bash[23329]: cephadm 2020-07-16T15:48:10.554447+0000 mgr.x (mgr.34562) 6228 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:48:12.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:48:11 smithi188 bash[23329]: cephadm 2020-07-16T15:48:10.554850+0000 mgr.x (mgr.34562) 6229 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:48:13.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:48:12 smithi132 bash[27079]: cluster 2020-07-16T15:48:11.235899+0000 mgr.x (mgr.34562) 6230 : cluster [DBG] pgmap v3885: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:48:13.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:48:12 smithi188 bash[23329]: cluster 2020-07-16T15:48:11.235899+0000 mgr.x (mgr.34562) 6230 : cluster [DBG] pgmap v3885: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:48:15.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:48:15 smithi132 bash[27079]: cluster 2020-07-16T15:48:13.236358+0000 mgr.x (mgr.34562) 6231 : cluster [DBG] pgmap v3886: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:48:15.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:48:15 smithi188 bash[23329]: cluster 2020-07-16T15:48:13.236358+0000 mgr.x (mgr.34562) 6231 : cluster [DBG] pgmap v3886: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:48:17.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:48:17 smithi132 bash[27079]: cluster 2020-07-16T15:48:15.236789+0000 mgr.x (mgr.34562) 6232 : cluster [DBG] pgmap v3887: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:48:17.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:48:17 smithi188 bash[23329]: cluster 2020-07-16T15:48:15.236789+0000 mgr.x (mgr.34562) 6232 : cluster [DBG] pgmap v3887: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:48:19.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:48:19 smithi132 bash[27079]: cluster 2020-07-16T15:48:17.237141+0000 mgr.x (mgr.34562) 6233 : cluster [DBG] pgmap v3888: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:48:19.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:48:19 smithi188 bash[23329]: cluster 2020-07-16T15:48:17.237141+0000 mgr.x (mgr.34562) 6233 : cluster [DBG] pgmap v3888: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:48:21.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:48:21 smithi132 bash[27079]: cluster 2020-07-16T15:48:19.237618+0000 mgr.x (mgr.34562) 6234 : cluster [DBG] pgmap v3889: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:48:21.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:48:21 smithi188 bash[23329]: cluster 2020-07-16T15:48:19.237618+0000 mgr.x (mgr.34562) 6234 : cluster [DBG] pgmap v3889: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:48:23.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:48:23 smithi132 bash[27079]: cluster 2020-07-16T15:48:21.238078+0000 mgr.x (mgr.34562) 6235 : cluster [DBG] pgmap v3890: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:48:23.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:48:23 smithi188 bash[23329]: cluster 2020-07-16T15:48:21.238078+0000 mgr.x (mgr.34562) 6235 : cluster [DBG] pgmap v3890: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:48:23.987 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:48:24.247 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:48:24.247 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 2m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:48:24.247 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 2m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:48:24.247 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 2m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:48:24.248 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 2m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:48:24.248 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 2m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:48:24.248 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:48:24.248 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:48:24.248 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 2m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:48:24.249 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 2m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:48:24.249 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:48:24.249 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:48:24.249 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:48:24.249 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:48:24.250 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:48:24.250 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:48:24.250 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:48:24.250 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:48:24.250 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 2m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:48:24.542 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:48:24.543 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:48:24.543 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:48:24.543 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:48:24.543 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:48:24.544 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:48:24.544 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:48:24.544 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:48:24.544 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:48:24.544 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:48:24.545 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:48:24.545 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:48:24.545 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:48:24.545 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:48:24.545 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:48:24.545 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:48:24.546 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:48:25.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:48:25 smithi132 bash[27079]: cluster 2020-07-16T15:48:23.238520+0000 mgr.x (mgr.34562) 6236 : cluster [DBG] pgmap v3891: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:48:25.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:48:25 smithi132 bash[27079]: audit 2020-07-16T15:48:23.974940+0000 mgr.x (mgr.34562) 6237 : audit [DBG] from='client.29176 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:48:25.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:48:25 smithi132 bash[27079]: audit 2020-07-16T15:48:24.541911+0000 mon.c (mon.1) 432 : audit [DBG] from='client.? 172.21.15.132:0/1747597931' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:48:25.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:48:25 smithi188 bash[23329]: cluster 2020-07-16T15:48:23.238520+0000 mgr.x (mgr.34562) 6236 : cluster [DBG] pgmap v3891: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:48:25.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:48:25 smithi188 bash[23329]: audit 2020-07-16T15:48:23.974940+0000 mgr.x (mgr.34562) 6237 : audit [DBG] from='client.29176 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:48:25.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:48:25 smithi188 bash[23329]: audit 2020-07-16T15:48:24.541911+0000 mon.c (mon.1) 432 : audit [DBG] from='client.? 172.21.15.132:0/1747597931' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:48:26.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:48:26 smithi132 bash[27079]: audit 2020-07-16T15:48:24.242838+0000 mgr.x (mgr.34562) 6238 : audit [DBG] from='client.29182 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:48:26.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:48:26 smithi132 bash[27079]: audit 2020-07-16T15:48:25.570397+0000 mon.b (mon.2) 1358 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:48:26.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:48:26 smithi188 bash[23329]: audit 2020-07-16T15:48:24.242838+0000 mgr.x (mgr.34562) 6238 : audit [DBG] from='client.29182 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:48:26.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:48:26 smithi188 bash[23329]: audit 2020-07-16T15:48:25.570397+0000 mon.b (mon.2) 1358 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:48:27.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:48:27 smithi188 bash[23329]: cluster 2020-07-16T15:48:25.238911+0000 mgr.x (mgr.34562) 6239 : cluster [DBG] pgmap v3892: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:48:27.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:48:27 smithi188 bash[23329]: cephadm 2020-07-16T15:48:25.571122+0000 mgr.x (mgr.34562) 6240 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:48:27.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:48:27 smithi188 bash[23329]: cephadm 2020-07-16T15:48:25.571370+0000 mgr.x (mgr.34562) 6241 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:48:27.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:48:27 smithi132 bash[27079]: cluster 2020-07-16T15:48:25.238911+0000 mgr.x (mgr.34562) 6239 : cluster [DBG] pgmap v3892: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:48:27.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:48:27 smithi132 bash[27079]: cephadm 2020-07-16T15:48:25.571122+0000 mgr.x (mgr.34562) 6240 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:48:27.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:48:27 smithi132 bash[27079]: cephadm 2020-07-16T15:48:25.571370+0000 mgr.x (mgr.34562) 6241 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:48:29.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:48:29 smithi188 bash[23329]: cluster 2020-07-16T15:48:27.239497+0000 mgr.x (mgr.34562) 6242 : cluster [DBG] pgmap v3893: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:48:29.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:48:29 smithi132 bash[27079]: cluster 2020-07-16T15:48:27.239497+0000 mgr.x (mgr.34562) 6242 : cluster [DBG] pgmap v3893: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:48:31.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:48:31 smithi188 bash[23329]: cluster 2020-07-16T15:48:29.239982+0000 mgr.x (mgr.34562) 6243 : cluster [DBG] pgmap v3894: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:48:31.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:48:31 smithi132 bash[27079]: cluster 2020-07-16T15:48:29.239982+0000 mgr.x (mgr.34562) 6243 : cluster [DBG] pgmap v3894: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:48:33.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:48:33 smithi188 bash[23329]: cluster 2020-07-16T15:48:31.240513+0000 mgr.x (mgr.34562) 6244 : cluster [DBG] pgmap v3895: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:48:33.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:48:33 smithi132 bash[27079]: cluster 2020-07-16T15:48:31.240513+0000 mgr.x (mgr.34562) 6244 : cluster [DBG] pgmap v3895: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:48:35.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:48:35 smithi188 bash[23329]: cluster 2020-07-16T15:48:33.240920+0000 mgr.x (mgr.34562) 6245 : cluster [DBG] pgmap v3896: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:48:35.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:48:35 smithi132 bash[27079]: cluster 2020-07-16T15:48:33.240920+0000 mgr.x (mgr.34562) 6245 : cluster [DBG] pgmap v3896: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:48:37.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:48:37 smithi188 bash[23329]: cluster 2020-07-16T15:48:35.241325+0000 mgr.x (mgr.34562) 6246 : cluster [DBG] pgmap v3897: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:48:37.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:48:37 smithi132 bash[27079]: cluster 2020-07-16T15:48:35.241325+0000 mgr.x (mgr.34562) 6246 : cluster [DBG] pgmap v3897: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:48:39.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:48:39 smithi188 bash[23329]: cluster 2020-07-16T15:48:37.241853+0000 mgr.x (mgr.34562) 6247 : cluster [DBG] pgmap v3898: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:48:39.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:48:39 smithi132 bash[27079]: cluster 2020-07-16T15:48:37.241853+0000 mgr.x (mgr.34562) 6247 : cluster [DBG] pgmap v3898: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:48:41.390 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:48:41 smithi132 bash[27079]: cluster 2020-07-16T15:48:39.242409+0000 mgr.x (mgr.34562) 6248 : cluster [DBG] pgmap v3899: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:48:41.390 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:48:41 smithi132 bash[27079]: audit 2020-07-16T15:48:40.579148+0000 mon.b (mon.2) 1359 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:48:41.391 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:48:41 smithi132 bash[27079]: audit 2020-07-16T15:48:40.580577+0000 mon.b (mon.2) 1360 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:48:41.391 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:48:41 smithi132 bash[27079]: audit 2020-07-16T15:48:40.581776+0000 mon.b (mon.2) 1361 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:48:41.391 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:48:41 smithi132 bash[27079]: audit 2020-07-16T15:48:40.583115+0000 mon.b (mon.2) 1362 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:48:41.391 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:48:41 smithi132 bash[27079]: audit 2020-07-16T15:48:40.584386+0000 mon.b (mon.2) 1363 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:48:41.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:48:41 smithi188 bash[23329]: cluster 2020-07-16T15:48:39.242409+0000 mgr.x (mgr.34562) 6248 : cluster [DBG] pgmap v3899: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:48:41.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:48:41 smithi188 bash[23329]: audit 2020-07-16T15:48:40.579148+0000 mon.b (mon.2) 1359 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:48:41.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:48:41 smithi188 bash[23329]: audit 2020-07-16T15:48:40.580577+0000 mon.b (mon.2) 1360 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:48:41.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:48:41 smithi188 bash[23329]: audit 2020-07-16T15:48:40.581776+0000 mon.b (mon.2) 1361 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:48:41.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:48:41 smithi188 bash[23329]: audit 2020-07-16T15:48:40.583115+0000 mon.b (mon.2) 1362 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:48:41.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:48:41 smithi188 bash[23329]: audit 2020-07-16T15:48:40.584386+0000 mon.b (mon.2) 1363 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:48:42.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:48:42 smithi188 bash[23329]: audit 2020-07-16T15:48:40.579536+0000 mgr.x (mgr.34562) 6249 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:48:42.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:48:42 smithi188 bash[23329]: audit 2020-07-16T15:48:40.580894+0000 mgr.x (mgr.34562) 6250 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:48:42.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:48:42 smithi188 bash[23329]: audit 2020-07-16T15:48:40.582045+0000 mgr.x (mgr.34562) 6251 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:48:42.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:48:42 smithi188 bash[23329]: cephadm 2020-07-16T15:48:40.582749+0000 mgr.x (mgr.34562) 6252 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:48:42.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:48:42 smithi188 bash[23329]: cephadm 2020-07-16T15:48:40.583965+0000 mgr.x (mgr.34562) 6253 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:48:42.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:48:42 smithi188 bash[23329]: cephadm 2020-07-16T15:48:40.585103+0000 mgr.x (mgr.34562) 6254 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:48:42.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:48:42 smithi188 bash[23329]: cephadm 2020-07-16T15:48:40.585315+0000 mgr.x (mgr.34562) 6255 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:48:42.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:48:42 smithi132 bash[27079]: audit 2020-07-16T15:48:40.579536+0000 mgr.x (mgr.34562) 6249 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:48:42.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:48:42 smithi132 bash[27079]: audit 2020-07-16T15:48:40.580894+0000 mgr.x (mgr.34562) 6250 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:48:42.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:48:42 smithi132 bash[27079]: audit 2020-07-16T15:48:40.582045+0000 mgr.x (mgr.34562) 6251 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:48:42.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:48:42 smithi132 bash[27079]: cephadm 2020-07-16T15:48:40.582749+0000 mgr.x (mgr.34562) 6252 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:48:42.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:48:42 smithi132 bash[27079]: cephadm 2020-07-16T15:48:40.583965+0000 mgr.x (mgr.34562) 6253 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:48:42.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:48:42 smithi132 bash[27079]: cephadm 2020-07-16T15:48:40.585103+0000 mgr.x (mgr.34562) 6254 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:48:42.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:48:42 smithi132 bash[27079]: cephadm 2020-07-16T15:48:40.585315+0000 mgr.x (mgr.34562) 6255 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:48:43.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:48:43 smithi132 bash[27079]: cluster 2020-07-16T15:48:41.242723+0000 mgr.x (mgr.34562) 6256 : cluster [DBG] pgmap v3900: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:48:43.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:48:43 smithi188 bash[23329]: cluster 2020-07-16T15:48:41.242723+0000 mgr.x (mgr.34562) 6256 : cluster [DBG] pgmap v3900: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:48:44.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:48:44 smithi188 bash[23329]: audit 2020-07-16T15:48:43.408814+0000 mon.b (mon.2) 1364 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:48:44.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:48:44 smithi132 bash[27079]: audit 2020-07-16T15:48:43.408814+0000 mon.b (mon.2) 1364 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:48:45.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:48:45 smithi188 bash[23329]: cluster 2020-07-16T15:48:43.243111+0000 mgr.x (mgr.34562) 6257 : cluster [DBG] pgmap v3901: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:48:45.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:48:45 smithi188 bash[23329]: cephadm 2020-07-16T15:48:43.409427+0000 mgr.x (mgr.34562) 6258 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:48:45.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:48:45 smithi188 bash[23329]: cephadm 2020-07-16T15:48:43.409598+0000 mgr.x (mgr.34562) 6259 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:48:45.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:48:45 smithi132 bash[27079]: cluster 2020-07-16T15:48:43.243111+0000 mgr.x (mgr.34562) 6257 : cluster [DBG] pgmap v3901: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:48:45.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:48:45 smithi132 bash[27079]: cephadm 2020-07-16T15:48:43.409427+0000 mgr.x (mgr.34562) 6258 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:48:45.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:48:45 smithi132 bash[27079]: cephadm 2020-07-16T15:48:43.409598+0000 mgr.x (mgr.34562) 6259 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:48:47.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:48:47 smithi188 bash[23329]: cluster 2020-07-16T15:48:45.243609+0000 mgr.x (mgr.34562) 6260 : cluster [DBG] pgmap v3902: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:48:47.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:48:47 smithi132 bash[27079]: cluster 2020-07-16T15:48:45.243609+0000 mgr.x (mgr.34562) 6260 : cluster [DBG] pgmap v3902: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:48:49.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:48:49 smithi188 bash[23329]: cluster 2020-07-16T15:48:47.244074+0000 mgr.x (mgr.34562) 6261 : cluster [DBG] pgmap v3903: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:48:49.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:48:49 smithi132 bash[27079]: cluster 2020-07-16T15:48:47.244074+0000 mgr.x (mgr.34562) 6261 : cluster [DBG] pgmap v3903: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:48:51.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:48:51 smithi188 bash[23329]: cluster 2020-07-16T15:48:49.244487+0000 mgr.x (mgr.34562) 6262 : cluster [DBG] pgmap v3904: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:48:51.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:48:51 smithi132 bash[27079]: cluster 2020-07-16T15:48:49.244487+0000 mgr.x (mgr.34562) 6262 : cluster [DBG] pgmap v3904: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:48:53.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:48:53 smithi188 bash[23329]: cluster 2020-07-16T15:48:51.244991+0000 mgr.x (mgr.34562) 6263 : cluster [DBG] pgmap v3905: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:48:53.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:48:53 smithi132 bash[27079]: cluster 2020-07-16T15:48:51.244991+0000 mgr.x (mgr.34562) 6263 : cluster [DBG] pgmap v3905: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:48:54.859 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:48:55.122 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:48:55.122 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 3m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:48:55.122 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 3m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:48:55.123 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 3m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:48:55.123 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 3m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:48:55.123 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 3m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:48:55.123 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:48:55.123 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:48:55.124 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 3m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:48:55.124 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 3m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:48:55.124 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:48:55.124 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:48:55.124 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:48:55.125 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:48:55.125 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:48:55.125 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:48:55.125 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:48:55.125 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:48:55.125 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 3m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:48:55.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:48:55 smithi188 bash[23329]: cluster 2020-07-16T15:48:53.245460+0000 mgr.x (mgr.34562) 6264 : cluster [DBG] pgmap v3906: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:48:55.421 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:48:55.421 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:48:55.421 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:48:55.421 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:48:55.421 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:48:55.422 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:48:55.422 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:48:55.422 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:48:55.422 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:48:55.422 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:48:55.423 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:48:55.423 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:48:55.423 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:48:55.423 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:48:55.423 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:48:55.424 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:48:55.424 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:48:55.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:48:55 smithi132 bash[27079]: cluster 2020-07-16T15:48:53.245460+0000 mgr.x (mgr.34562) 6264 : cluster [DBG] pgmap v3906: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:48:56.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:48:56 smithi188 bash[23329]: audit 2020-07-16T15:48:54.848351+0000 mgr.x (mgr.34562) 6265 : audit [DBG] from='client.29194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:48:56.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:48:56 smithi188 bash[23329]: audit 2020-07-16T15:48:55.117771+0000 mgr.x (mgr.34562) 6266 : audit [DBG] from='client.29200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:48:56.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:48:56 smithi188 bash[23329]: audit 2020-07-16T15:48:55.419902+0000 mon.c (mon.1) 433 : audit [DBG] from='client.? 172.21.15.132:0/3898420009' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:48:56.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:48:56 smithi132 bash[27079]: audit 2020-07-16T15:48:54.848351+0000 mgr.x (mgr.34562) 6265 : audit [DBG] from='client.29194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:48:56.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:48:56 smithi132 bash[27079]: audit 2020-07-16T15:48:55.117771+0000 mgr.x (mgr.34562) 6266 : audit [DBG] from='client.29200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:48:56.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:48:56 smithi132 bash[27079]: audit 2020-07-16T15:48:55.419902+0000 mon.c (mon.1) 433 : audit [DBG] from='client.? 172.21.15.132:0/3898420009' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:48:57.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:48:57 smithi188 bash[23329]: cluster 2020-07-16T15:48:55.245755+0000 mgr.x (mgr.34562) 6267 : cluster [DBG] pgmap v3907: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:48:57.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:48:57 smithi132 bash[27079]: cluster 2020-07-16T15:48:55.245755+0000 mgr.x (mgr.34562) 6267 : cluster [DBG] pgmap v3907: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:48:59.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:48:59 smithi188 bash[23329]: cluster 2020-07-16T15:48:57.246264+0000 mgr.x (mgr.34562) 6268 : cluster [DBG] pgmap v3908: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:48:59.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:48:59 smithi188 bash[23329]: audit 2020-07-16T15:48:58.425326+0000 mon.b (mon.2) 1365 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:48:59.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:48:59 smithi132 bash[27079]: cluster 2020-07-16T15:48:57.246264+0000 mgr.x (mgr.34562) 6268 : cluster [DBG] pgmap v3908: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:48:59.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:48:59 smithi132 bash[27079]: audit 2020-07-16T15:48:58.425326+0000 mon.b (mon.2) 1365 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:49:00.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:49:00 smithi188 bash[23329]: cephadm 2020-07-16T15:48:58.426098+0000 mgr.x (mgr.34562) 6269 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:49:00.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:49:00 smithi188 bash[23329]: cephadm 2020-07-16T15:48:58.426192+0000 mgr.x (mgr.34562) 6270 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:49:00.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:49:00 smithi132 bash[27079]: cephadm 2020-07-16T15:48:58.426098+0000 mgr.x (mgr.34562) 6269 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:49:00.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:49:00 smithi132 bash[27079]: cephadm 2020-07-16T15:48:58.426192+0000 mgr.x (mgr.34562) 6270 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:49:01.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:49:01 smithi188 bash[23329]: cluster 2020-07-16T15:48:59.246644+0000 mgr.x (mgr.34562) 6271 : cluster [DBG] pgmap v3909: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:49:01.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:49:01 smithi132 bash[27079]: cluster 2020-07-16T15:48:59.246644+0000 mgr.x (mgr.34562) 6271 : cluster [DBG] pgmap v3909: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:49:03.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:49:03 smithi188 bash[23329]: cluster 2020-07-16T15:49:01.247139+0000 mgr.x (mgr.34562) 6272 : cluster [DBG] pgmap v3910: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:49:03.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:49:03 smithi132 bash[27079]: cluster 2020-07-16T15:49:01.247139+0000 mgr.x (mgr.34562) 6272 : cluster [DBG] pgmap v3910: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:49:05.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:49:05 smithi188 bash[23329]: cluster 2020-07-16T15:49:03.247528+0000 mgr.x (mgr.34562) 6273 : cluster [DBG] pgmap v3911: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:49:05.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:49:05 smithi132 bash[27079]: cluster 2020-07-16T15:49:03.247528+0000 mgr.x (mgr.34562) 6273 : cluster [DBG] pgmap v3911: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:49:07.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:49:07 smithi188 bash[23329]: cluster 2020-07-16T15:49:05.247912+0000 mgr.x (mgr.34562) 6274 : cluster [DBG] pgmap v3912: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:49:07.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:49:07 smithi132 bash[27079]: cluster 2020-07-16T15:49:05.247912+0000 mgr.x (mgr.34562) 6274 : cluster [DBG] pgmap v3912: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:49:09.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:49:09 smithi188 bash[23329]: cluster 2020-07-16T15:49:07.248482+0000 mgr.x (mgr.34562) 6275 : cluster [DBG] pgmap v3913: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:49:09.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:49:09 smithi132 bash[27079]: cluster 2020-07-16T15:49:07.248482+0000 mgr.x (mgr.34562) 6275 : cluster [DBG] pgmap v3913: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:49:11.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:49:11 smithi188 bash[23329]: cluster 2020-07-16T15:49:09.248985+0000 mgr.x (mgr.34562) 6276 : cluster [DBG] pgmap v3914: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:49:11.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:49:11 smithi132 bash[27079]: cluster 2020-07-16T15:49:09.248985+0000 mgr.x (mgr.34562) 6276 : cluster [DBG] pgmap v3914: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:49:13.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:49:13 smithi188 bash[23329]: cluster 2020-07-16T15:49:11.249479+0000 mgr.x (mgr.34562) 6277 : cluster [DBG] pgmap v3915: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:49:13.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:49:13 smithi132 bash[27079]: cluster 2020-07-16T15:49:11.249479+0000 mgr.x (mgr.34562) 6277 : cluster [DBG] pgmap v3915: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:49:14.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:49:14 smithi188 bash[23329]: audit 2020-07-16T15:49:13.442102+0000 mon.b (mon.2) 1366 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:49:14.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:49:14 smithi132 bash[27079]: audit 2020-07-16T15:49:13.442102+0000 mon.b (mon.2) 1366 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:49:15.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:49:15 smithi188 bash[23329]: cluster 2020-07-16T15:49:13.249910+0000 mgr.x (mgr.34562) 6278 : cluster [DBG] pgmap v3916: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:49:15.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:49:15 smithi188 bash[23329]: cephadm 2020-07-16T15:49:13.442776+0000 mgr.x (mgr.34562) 6279 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:49:15.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:49:15 smithi188 bash[23329]: cephadm 2020-07-16T15:49:13.443192+0000 mgr.x (mgr.34562) 6280 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:49:15.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:49:15 smithi132 bash[27079]: cluster 2020-07-16T15:49:13.249910+0000 mgr.x (mgr.34562) 6278 : cluster [DBG] pgmap v3916: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:49:15.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:49:15 smithi132 bash[27079]: cephadm 2020-07-16T15:49:13.442776+0000 mgr.x (mgr.34562) 6279 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:49:15.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:49:15 smithi132 bash[27079]: cephadm 2020-07-16T15:49:13.443192+0000 mgr.x (mgr.34562) 6280 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:49:17.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:49:17 smithi188 bash[23329]: cluster 2020-07-16T15:49:15.250394+0000 mgr.x (mgr.34562) 6281 : cluster [DBG] pgmap v3917: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:49:17.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:49:17 smithi132 bash[27079]: cluster 2020-07-16T15:49:15.250394+0000 mgr.x (mgr.34562) 6281 : cluster [DBG] pgmap v3917: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:49:19.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:49:19 smithi188 bash[23329]: cluster 2020-07-16T15:49:17.250867+0000 mgr.x (mgr.34562) 6282 : cluster [DBG] pgmap v3918: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:49:19.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:49:19 smithi132 bash[27079]: cluster 2020-07-16T15:49:17.250867+0000 mgr.x (mgr.34562) 6282 : cluster [DBG] pgmap v3918: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:49:21.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:49:21 smithi188 bash[23329]: cluster 2020-07-16T15:49:19.251435+0000 mgr.x (mgr.34562) 6283 : cluster [DBG] pgmap v3919: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:49:21.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:49:21 smithi132 bash[27079]: cluster 2020-07-16T15:49:19.251435+0000 mgr.x (mgr.34562) 6283 : cluster [DBG] pgmap v3919: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:49:23.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:49:23 smithi188 bash[23329]: cluster 2020-07-16T15:49:21.251901+0000 mgr.x (mgr.34562) 6284 : cluster [DBG] pgmap v3920: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:49:23.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:49:23 smithi132 bash[27079]: cluster 2020-07-16T15:49:21.251901+0000 mgr.x (mgr.34562) 6284 : cluster [DBG] pgmap v3920: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:49:25.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:49:25 smithi188 bash[23329]: cluster 2020-07-16T15:49:23.252368+0000 mgr.x (mgr.34562) 6285 : cluster [DBG] pgmap v3921: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:49:25.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:49:25 smithi132 bash[27079]: cluster 2020-07-16T15:49:23.252368+0000 mgr.x (mgr.34562) 6285 : cluster [DBG] pgmap v3921: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:49:25.720 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:49:25.980 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:49:25.981 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 3m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:49:25.981 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 3m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:49:25.981 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 3m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:49:25.981 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 3m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:49:25.982 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 3m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:49:25.982 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:49:25.982 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:49:25.982 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 3m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:49:25.982 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 3m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:49:25.983 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:49:25.983 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:49:25.983 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:49:25.983 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:49:25.983 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:49:25.984 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:49:25.984 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:49:25.984 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:49:25.984 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 3m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:49:26.278 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:49:26.278 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:49:26.279 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:49:26.279 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:49:26.279 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:49:26.279 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:49:26.279 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:49:26.280 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:49:26.280 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:49:26.280 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:49:26.280 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:49:26.280 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:49:26.281 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:49:26.281 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:49:26.281 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:49:26.281 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:49:26.281 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:49:27.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:49:27 smithi188 bash[23329]: cluster 2020-07-16T15:49:25.252902+0000 mgr.x (mgr.34562) 6286 : cluster [DBG] pgmap v3922: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:49:27.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:49:27 smithi188 bash[23329]: audit 2020-07-16T15:49:25.708774+0000 mgr.x (mgr.34562) 6287 : audit [DBG] from='client.29212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:49:27.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:49:27 smithi188 bash[23329]: audit 2020-07-16T15:49:25.976417+0000 mgr.x (mgr.34562) 6288 : audit [DBG] from='client.29218 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:49:27.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:49:27 smithi188 bash[23329]: audit 2020-07-16T15:49:26.277749+0000 mon.c (mon.1) 434 : audit [DBG] from='client.? 172.21.15.132:0/1662656855' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:49:27.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:49:27 smithi132 bash[27079]: cluster 2020-07-16T15:49:25.252902+0000 mgr.x (mgr.34562) 6286 : cluster [DBG] pgmap v3922: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:49:27.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:49:27 smithi132 bash[27079]: audit 2020-07-16T15:49:25.708774+0000 mgr.x (mgr.34562) 6287 : audit [DBG] from='client.29212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:49:27.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:49:27 smithi132 bash[27079]: audit 2020-07-16T15:49:25.976417+0000 mgr.x (mgr.34562) 6288 : audit [DBG] from='client.29218 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:49:27.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:49:27 smithi132 bash[27079]: audit 2020-07-16T15:49:26.277749+0000 mon.c (mon.1) 434 : audit [DBG] from='client.? 172.21.15.132:0/1662656855' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:49:29.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:49:29 smithi132 bash[27079]: cluster 2020-07-16T15:49:27.253362+0000 mgr.x (mgr.34562) 6289 : cluster [DBG] pgmap v3923: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:49:29.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:49:29 smithi132 bash[27079]: audit 2020-07-16T15:49:28.458629+0000 mon.b (mon.2) 1367 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:49:29.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:49:29 smithi188 bash[23329]: cluster 2020-07-16T15:49:27.253362+0000 mgr.x (mgr.34562) 6289 : cluster [DBG] pgmap v3923: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:49:29.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:49:29 smithi188 bash[23329]: audit 2020-07-16T15:49:28.458629+0000 mon.b (mon.2) 1367 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:49:30.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:49:30 smithi132 bash[27079]: cephadm 2020-07-16T15:49:28.459323+0000 mgr.x (mgr.34562) 6290 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:49:30.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:49:30 smithi132 bash[27079]: cephadm 2020-07-16T15:49:28.459639+0000 mgr.x (mgr.34562) 6291 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:49:30.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:49:30 smithi188 bash[23329]: cephadm 2020-07-16T15:49:28.459323+0000 mgr.x (mgr.34562) 6290 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:49:30.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:49:30 smithi188 bash[23329]: cephadm 2020-07-16T15:49:28.459639+0000 mgr.x (mgr.34562) 6291 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:49:31.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:49:31 smithi132 bash[27079]: cluster 2020-07-16T15:49:29.253788+0000 mgr.x (mgr.34562) 6292 : cluster [DBG] pgmap v3924: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:49:31.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:49:31 smithi188 bash[23329]: cluster 2020-07-16T15:49:29.253788+0000 mgr.x (mgr.34562) 6292 : cluster [DBG] pgmap v3924: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:49:33.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:49:33 smithi132 bash[27079]: cluster 2020-07-16T15:49:31.254252+0000 mgr.x (mgr.34562) 6293 : cluster [DBG] pgmap v3925: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:49:33.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:49:33 smithi188 bash[23329]: cluster 2020-07-16T15:49:31.254252+0000 mgr.x (mgr.34562) 6293 : cluster [DBG] pgmap v3925: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:49:35.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:49:35 smithi132 bash[27079]: cluster 2020-07-16T15:49:33.254653+0000 mgr.x (mgr.34562) 6294 : cluster [DBG] pgmap v3926: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:49:35.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:49:35 smithi188 bash[23329]: cluster 2020-07-16T15:49:33.254653+0000 mgr.x (mgr.34562) 6294 : cluster [DBG] pgmap v3926: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:49:37.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:49:37 smithi132 bash[27079]: cluster 2020-07-16T15:49:35.255037+0000 mgr.x (mgr.34562) 6295 : cluster [DBG] pgmap v3927: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:49:37.676 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:49:37 smithi188 bash[23329]: cluster 2020-07-16T15:49:35.255037+0000 mgr.x (mgr.34562) 6295 : cluster [DBG] pgmap v3927: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:49:39.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:49:39 smithi132 bash[27079]: cluster 2020-07-16T15:49:37.255414+0000 mgr.x (mgr.34562) 6296 : cluster [DBG] pgmap v3928: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:49:39.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:49:39 smithi188 bash[23329]: cluster 2020-07-16T15:49:37.255414+0000 mgr.x (mgr.34562) 6296 : cluster [DBG] pgmap v3928: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:49:41.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:49:41 smithi132 bash[27079]: cluster 2020-07-16T15:49:39.255796+0000 mgr.x (mgr.34562) 6297 : cluster [DBG] pgmap v3929: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:49:41.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:49:41 smithi188 bash[23329]: cluster 2020-07-16T15:49:39.255796+0000 mgr.x (mgr.34562) 6297 : cluster [DBG] pgmap v3929: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:49:43.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:49:43 smithi132 bash[27079]: cluster 2020-07-16T15:49:41.256308+0000 mgr.x (mgr.34562) 6298 : cluster [DBG] pgmap v3930: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:49:43.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:49:43 smithi188 bash[23329]: cluster 2020-07-16T15:49:41.256308+0000 mgr.x (mgr.34562) 6298 : cluster [DBG] pgmap v3930: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:49:44.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:49:44 smithi132 bash[27079]: audit 2020-07-16T15:49:43.477143+0000 mon.b (mon.2) 1368 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:49:44.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:49:44 smithi132 bash[27079]: audit 2020-07-16T15:49:43.478481+0000 mon.b (mon.2) 1369 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:49:44.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:49:44 smithi132 bash[27079]: audit 2020-07-16T15:49:43.479716+0000 mon.b (mon.2) 1370 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:49:44.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:49:44 smithi132 bash[27079]: audit 2020-07-16T15:49:43.481099+0000 mon.b (mon.2) 1371 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:49:44.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:49:44 smithi132 bash[27079]: audit 2020-07-16T15:49:43.482329+0000 mon.b (mon.2) 1372 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:49:44.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:49:44 smithi188 bash[23329]: audit 2020-07-16T15:49:43.477143+0000 mon.b (mon.2) 1368 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:49:44.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:49:44 smithi188 bash[23329]: audit 2020-07-16T15:49:43.478481+0000 mon.b (mon.2) 1369 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:49:44.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:49:44 smithi188 bash[23329]: audit 2020-07-16T15:49:43.479716+0000 mon.b (mon.2) 1370 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:49:44.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:49:44 smithi188 bash[23329]: audit 2020-07-16T15:49:43.481099+0000 mon.b (mon.2) 1371 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:49:44.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:49:44 smithi188 bash[23329]: audit 2020-07-16T15:49:43.482329+0000 mon.b (mon.2) 1372 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:49:45.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:49:45 smithi132 bash[27079]: cluster 2020-07-16T15:49:43.256668+0000 mgr.x (mgr.34562) 6299 : cluster [DBG] pgmap v3931: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:49:45.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:49:45 smithi132 bash[27079]: audit 2020-07-16T15:49:43.477549+0000 mgr.x (mgr.34562) 6300 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:49:45.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:49:45 smithi132 bash[27079]: audit 2020-07-16T15:49:43.478787+0000 mgr.x (mgr.34562) 6301 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:49:45.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:49:45 smithi132 bash[27079]: audit 2020-07-16T15:49:43.479977+0000 mgr.x (mgr.34562) 6302 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:49:45.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:49:45 smithi132 bash[27079]: cephadm 2020-07-16T15:49:43.480718+0000 mgr.x (mgr.34562) 6303 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:49:45.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:49:45 smithi132 bash[27079]: cephadm 2020-07-16T15:49:43.481920+0000 mgr.x (mgr.34562) 6304 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:49:45.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:49:45 smithi132 bash[27079]: cephadm 2020-07-16T15:49:43.483090+0000 mgr.x (mgr.34562) 6305 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:49:45.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:49:45 smithi132 bash[27079]: cephadm 2020-07-16T15:49:43.483165+0000 mgr.x (mgr.34562) 6306 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:49:45.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:49:45 smithi188 bash[23329]: cluster 2020-07-16T15:49:43.256668+0000 mgr.x (mgr.34562) 6299 : cluster [DBG] pgmap v3931: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:49:45.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:49:45 smithi188 bash[23329]: audit 2020-07-16T15:49:43.477549+0000 mgr.x (mgr.34562) 6300 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:49:45.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:49:45 smithi188 bash[23329]: audit 2020-07-16T15:49:43.478787+0000 mgr.x (mgr.34562) 6301 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:49:45.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:49:45 smithi188 bash[23329]: audit 2020-07-16T15:49:43.479977+0000 mgr.x (mgr.34562) 6302 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:49:45.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:49:45 smithi188 bash[23329]: cephadm 2020-07-16T15:49:43.480718+0000 mgr.x (mgr.34562) 6303 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:49:45.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:49:45 smithi188 bash[23329]: cephadm 2020-07-16T15:49:43.481920+0000 mgr.x (mgr.34562) 6304 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:49:45.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:49:45 smithi188 bash[23329]: cephadm 2020-07-16T15:49:43.483090+0000 mgr.x (mgr.34562) 6305 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:49:45.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:49:45 smithi188 bash[23329]: cephadm 2020-07-16T15:49:43.483165+0000 mgr.x (mgr.34562) 6306 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:49:47.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:49:47 smithi132 bash[27079]: cluster 2020-07-16T15:49:45.257164+0000 mgr.x (mgr.34562) 6307 : cluster [DBG] pgmap v3932: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:49:47.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:49:47 smithi132 bash[27079]: audit 2020-07-16T15:49:46.386443+0000 mon.b (mon.2) 1373 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:49:47.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:49:47 smithi188 bash[23329]: cluster 2020-07-16T15:49:45.257164+0000 mgr.x (mgr.34562) 6307 : cluster [DBG] pgmap v3932: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:49:47.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:49:47 smithi188 bash[23329]: audit 2020-07-16T15:49:46.386443+0000 mon.b (mon.2) 1373 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:49:48.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:49:48 smithi132 bash[27079]: cephadm 2020-07-16T15:49:46.387033+0000 mgr.x (mgr.34562) 6308 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:49:48.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:49:48 smithi132 bash[27079]: cephadm 2020-07-16T15:49:46.387440+0000 mgr.x (mgr.34562) 6309 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:49:48.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:49:48 smithi188 bash[23329]: cephadm 2020-07-16T15:49:46.387033+0000 mgr.x (mgr.34562) 6308 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:49:48.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:49:48 smithi188 bash[23329]: cephadm 2020-07-16T15:49:46.387440+0000 mgr.x (mgr.34562) 6309 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:49:49.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:49:49 smithi132 bash[27079]: cluster 2020-07-16T15:49:47.257598+0000 mgr.x (mgr.34562) 6310 : cluster [DBG] pgmap v3933: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:49:49.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:49:49 smithi188 bash[23329]: cluster 2020-07-16T15:49:47.257598+0000 mgr.x (mgr.34562) 6310 : cluster [DBG] pgmap v3933: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:49:51.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:49:51 smithi132 bash[27079]: cluster 2020-07-16T15:49:49.258085+0000 mgr.x (mgr.34562) 6311 : cluster [DBG] pgmap v3934: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:49:51.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:49:51 smithi188 bash[23329]: cluster 2020-07-16T15:49:49.258085+0000 mgr.x (mgr.34562) 6311 : cluster [DBG] pgmap v3934: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:49:52.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:49:52 smithi132 bash[27079]: cluster 2020-07-16T15:49:51.258637+0000 mgr.x (mgr.34562) 6312 : cluster [DBG] pgmap v3935: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:49:52.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:49:52 smithi188 bash[23329]: cluster 2020-07-16T15:49:51.258637+0000 mgr.x (mgr.34562) 6312 : cluster [DBG] pgmap v3935: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:49:54.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:49:54 smithi188 bash[23329]: cluster 2020-07-16T15:49:53.259125+0000 mgr.x (mgr.34562) 6313 : cluster [DBG] pgmap v3936: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:49:54.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:49:54 smithi132 bash[27079]: cluster 2020-07-16T15:49:53.259125+0000 mgr.x (mgr.34562) 6313 : cluster [DBG] pgmap v3936: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:49:56.577 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:49:56.840 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:49:56.841 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 4m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:49:56.841 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 4m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:49:56.841 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 4m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:49:56.841 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 4m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:49:56.842 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 4m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:49:56.842 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:49:56.842 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:49:56.842 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 4m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:49:56.843 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 4m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:49:56.843 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:49:56.843 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:49:56.843 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:49:56.843 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:49:56.843 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:49:56.844 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:49:56.844 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:49:56.844 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:49:56.844 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 4m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:49:57.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:49:56 smithi132 bash[27079]: cluster 2020-07-16T15:49:55.259557+0000 mgr.x (mgr.34562) 6314 : cluster [DBG] pgmap v3937: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:49:57.138 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:49:57.139 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:49:57.139 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:49:57.139 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:49:57.139 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:49:57.140 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:49:57.140 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:49:57.140 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:49:57.140 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:49:57.141 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:49:57.141 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:49:57.141 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:49:57.142 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:49:57.142 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:49:57.142 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:49:57.142 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:49:57.143 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:49:57.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:49:56 smithi188 bash[23329]: cluster 2020-07-16T15:49:55.259557+0000 mgr.x (mgr.34562) 6314 : cluster [DBG] pgmap v3937: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:49:58.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:49:57 smithi132 bash[27079]: audit 2020-07-16T15:49:56.566061+0000 mgr.x (mgr.34562) 6315 : audit [DBG] from='client.29230 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:49:58.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:49:57 smithi132 bash[27079]: audit 2020-07-16T15:49:56.836230+0000 mgr.x (mgr.34562) 6316 : audit [DBG] from='client.29236 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:49:58.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:49:57 smithi132 bash[27079]: audit 2020-07-16T15:49:57.138146+0000 mon.c (mon.1) 435 : audit [DBG] from='client.? 172.21.15.132:0/791429312' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:49:58.177 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:49:57 smithi188 bash[23329]: audit 2020-07-16T15:49:56.566061+0000 mgr.x (mgr.34562) 6315 : audit [DBG] from='client.29230 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:49:58.178 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:49:57 smithi188 bash[23329]: audit 2020-07-16T15:49:56.836230+0000 mgr.x (mgr.34562) 6316 : audit [DBG] from='client.29236 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:49:58.178 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:49:57 smithi188 bash[23329]: audit 2020-07-16T15:49:57.138146+0000 mon.c (mon.1) 435 : audit [DBG] from='client.? 172.21.15.132:0/791429312' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:49:59.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:49:58 smithi132 bash[27079]: cluster 2020-07-16T15:49:57.260002+0000 mgr.x (mgr.34562) 6317 : cluster [DBG] pgmap v3938: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:49:59.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:49:58 smithi188 bash[23329]: cluster 2020-07-16T15:49:57.260002+0000 mgr.x (mgr.34562) 6317 : cluster [DBG] pgmap v3938: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:50:01.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:50:00 smithi132 bash[27079]: cluster 2020-07-16T15:49:59.260472+0000 mgr.x (mgr.34562) 6318 : cluster [DBG] pgmap v3939: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:50:01.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:50:00 smithi188 bash[23329]: cluster 2020-07-16T15:49:59.260472+0000 mgr.x (mgr.34562) 6318 : cluster [DBG] pgmap v3939: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:50:02.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:50:01 smithi132 bash[27079]: audit 2020-07-16T15:50:01.403000+0000 mon.b (mon.2) 1374 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:50:02.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:50:01 smithi188 bash[23329]: audit 2020-07-16T15:50:01.403000+0000 mon.b (mon.2) 1374 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:50:03.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:50:02 smithi132 bash[27079]: cluster 2020-07-16T15:50:01.260846+0000 mgr.x (mgr.34562) 6319 : cluster [DBG] pgmap v3940: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:50:03.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:50:02 smithi132 bash[27079]: cephadm 2020-07-16T15:50:01.403707+0000 mgr.x (mgr.34562) 6320 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:50:03.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:50:02 smithi132 bash[27079]: cephadm 2020-07-16T15:50:01.403795+0000 mgr.x (mgr.34562) 6321 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:50:03.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:50:02 smithi188 bash[23329]: cluster 2020-07-16T15:50:01.260846+0000 mgr.x (mgr.34562) 6319 : cluster [DBG] pgmap v3940: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:50:03.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:50:02 smithi188 bash[23329]: cephadm 2020-07-16T15:50:01.403707+0000 mgr.x (mgr.34562) 6320 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:50:03.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:50:02 smithi188 bash[23329]: cephadm 2020-07-16T15:50:01.403795+0000 mgr.x (mgr.34562) 6321 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:50:05.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:50:04 smithi132 bash[27079]: cluster 2020-07-16T15:50:03.261410+0000 mgr.x (mgr.34562) 6322 : cluster [DBG] pgmap v3941: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:50:05.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:50:04 smithi188 bash[23329]: cluster 2020-07-16T15:50:03.261410+0000 mgr.x (mgr.34562) 6322 : cluster [DBG] pgmap v3941: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:50:07.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:50:06 smithi132 bash[27079]: cluster 2020-07-16T15:50:05.261777+0000 mgr.x (mgr.34562) 6323 : cluster [DBG] pgmap v3942: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:50:07.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:50:06 smithi188 bash[23329]: cluster 2020-07-16T15:50:05.261777+0000 mgr.x (mgr.34562) 6323 : cluster [DBG] pgmap v3942: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:50:09.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:50:08 smithi132 bash[27079]: cluster 2020-07-16T15:50:07.262130+0000 mgr.x (mgr.34562) 6324 : cluster [DBG] pgmap v3943: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:50:09.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:50:08 smithi188 bash[23329]: cluster 2020-07-16T15:50:07.262130+0000 mgr.x (mgr.34562) 6324 : cluster [DBG] pgmap v3943: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:50:11.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:50:10 smithi132 bash[27079]: cluster 2020-07-16T15:50:09.262621+0000 mgr.x (mgr.34562) 6325 : cluster [DBG] pgmap v3944: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:50:11.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:50:10 smithi188 bash[23329]: cluster 2020-07-16T15:50:09.262621+0000 mgr.x (mgr.34562) 6325 : cluster [DBG] pgmap v3944: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:50:13.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:50:12 smithi132 bash[27079]: cluster 2020-07-16T15:50:11.263023+0000 mgr.x (mgr.34562) 6326 : cluster [DBG] pgmap v3945: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:50:13.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:50:12 smithi188 bash[23329]: cluster 2020-07-16T15:50:11.263023+0000 mgr.x (mgr.34562) 6326 : cluster [DBG] pgmap v3945: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:50:15.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:50:14 smithi132 bash[27079]: cluster 2020-07-16T15:50:13.263538+0000 mgr.x (mgr.34562) 6327 : cluster [DBG] pgmap v3946: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:50:15.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:50:14 smithi188 bash[23329]: cluster 2020-07-16T15:50:13.263538+0000 mgr.x (mgr.34562) 6327 : cluster [DBG] pgmap v3946: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:50:17.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:50:16 smithi132 bash[27079]: cluster 2020-07-16T15:50:15.264143+0000 mgr.x (mgr.34562) 6328 : cluster [DBG] pgmap v3947: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:50:17.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:50:16 smithi132 bash[27079]: audit 2020-07-16T15:50:16.413933+0000 mon.b (mon.2) 1375 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:50:17.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:50:16 smithi188 bash[23329]: cluster 2020-07-16T15:50:15.264143+0000 mgr.x (mgr.34562) 6328 : cluster [DBG] pgmap v3947: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:50:17.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:50:16 smithi188 bash[23329]: audit 2020-07-16T15:50:16.413933+0000 mon.b (mon.2) 1375 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:50:18.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:50:17 smithi132 bash[27079]: cephadm 2020-07-16T15:50:16.414685+0000 mgr.x (mgr.34562) 6329 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:50:18.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:50:17 smithi132 bash[27079]: cephadm 2020-07-16T15:50:16.415054+0000 mgr.x (mgr.34562) 6330 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:50:18.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:50:17 smithi188 bash[23329]: cephadm 2020-07-16T15:50:16.414685+0000 mgr.x (mgr.34562) 6329 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:50:18.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:50:17 smithi188 bash[23329]: cephadm 2020-07-16T15:50:16.415054+0000 mgr.x (mgr.34562) 6330 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:50:18.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:50:18 smithi188 bash[23329]: cluster 2020-07-16T15:50:17.264730+0000 mgr.x (mgr.34562) 6331 : cluster [DBG] pgmap v3948: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:50:19.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:50:18 smithi132 bash[27079]: cluster 2020-07-16T15:50:17.264730+0000 mgr.x (mgr.34562) 6331 : cluster [DBG] pgmap v3948: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:50:21.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:50:20 smithi132 bash[27079]: cluster 2020-07-16T15:50:19.265167+0000 mgr.x (mgr.34562) 6332 : cluster [DBG] pgmap v3949: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:50:21.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:50:20 smithi188 bash[23329]: cluster 2020-07-16T15:50:19.265167+0000 mgr.x (mgr.34562) 6332 : cluster [DBG] pgmap v3949: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:50:23.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:50:22 smithi132 bash[27079]: cluster 2020-07-16T15:50:21.265585+0000 mgr.x (mgr.34562) 6333 : cluster [DBG] pgmap v3950: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:50:23.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:50:22 smithi188 bash[23329]: cluster 2020-07-16T15:50:21.265585+0000 mgr.x (mgr.34562) 6333 : cluster [DBG] pgmap v3950: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:50:25.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:50:24 smithi132 bash[27079]: cluster 2020-07-16T15:50:23.266064+0000 mgr.x (mgr.34562) 6334 : cluster [DBG] pgmap v3951: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:50:25.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:50:24 smithi188 bash[23329]: cluster 2020-07-16T15:50:23.266064+0000 mgr.x (mgr.34562) 6334 : cluster [DBG] pgmap v3951: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:50:27.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:50:26 smithi132 bash[27079]: cluster 2020-07-16T15:50:25.266640+0000 mgr.x (mgr.34562) 6335 : cluster [DBG] pgmap v3952: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:50:27.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:50:26 smithi188 bash[23329]: cluster 2020-07-16T15:50:25.266640+0000 mgr.x (mgr.34562) 6335 : cluster [DBG] pgmap v3952: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:50:27.438 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:50:27.697 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:50:27.698 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 4m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:50:27.698 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 4m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:50:27.698 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 4m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:50:27.699 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 4m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:50:27.699 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 4m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:50:27.699 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:50:27.699 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:50:27.699 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 4m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:50:27.700 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 4m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:50:27.700 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:50:27.700 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:50:27.700 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:50:27.701 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:50:27.701 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:50:27.701 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:50:27.702 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:50:27.702 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:50:27.702 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 4m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:50:27.992 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:50:27.993 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:50:27.993 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:50:27.993 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:50:27.993 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:50:27.994 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:50:27.994 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:50:27.994 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:50:27.994 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:50:27.994 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:50:27.995 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:50:27.995 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:50:27.995 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:50:27.995 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:50:27.995 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:50:27.996 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:50:27.996 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:50:29.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:50:28 smithi132 bash[27079]: cluster 2020-07-16T15:50:27.267108+0000 mgr.x (mgr.34562) 6336 : cluster [DBG] pgmap v3953: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:50:29.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:50:28 smithi132 bash[27079]: audit 2020-07-16T15:50:27.427203+0000 mgr.x (mgr.34562) 6337 : audit [DBG] from='client.29248 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:50:29.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:50:28 smithi132 bash[27079]: audit 2020-07-16T15:50:27.693764+0000 mgr.x (mgr.34562) 6338 : audit [DBG] from='client.29254 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:50:29.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:50:28 smithi132 bash[27079]: audit 2020-07-16T15:50:27.991892+0000 mon.c (mon.1) 436 : audit [DBG] from='client.? 172.21.15.132:0/2276560671' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:50:29.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:50:28 smithi188 bash[23329]: cluster 2020-07-16T15:50:27.267108+0000 mgr.x (mgr.34562) 6336 : cluster [DBG] pgmap v3953: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:50:29.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:50:28 smithi188 bash[23329]: audit 2020-07-16T15:50:27.427203+0000 mgr.x (mgr.34562) 6337 : audit [DBG] from='client.29248 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:50:29.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:50:28 smithi188 bash[23329]: audit 2020-07-16T15:50:27.693764+0000 mgr.x (mgr.34562) 6338 : audit [DBG] from='client.29254 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:50:29.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:50:28 smithi188 bash[23329]: audit 2020-07-16T15:50:27.991892+0000 mon.c (mon.1) 436 : audit [DBG] from='client.? 172.21.15.132:0/2276560671' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:50:31.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:50:30 smithi188 bash[23329]: cluster 2020-07-16T15:50:29.267609+0000 mgr.x (mgr.34562) 6339 : cluster [DBG] pgmap v3954: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:50:31.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:50:30 smithi132 bash[27079]: cluster 2020-07-16T15:50:29.267609+0000 mgr.x (mgr.34562) 6339 : cluster [DBG] pgmap v3954: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:50:32.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:50:31 smithi188 bash[23329]: audit 2020-07-16T15:50:31.423942+0000 mon.b (mon.2) 1376 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:50:32.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:50:31 smithi132 bash[27079]: audit 2020-07-16T15:50:31.423942+0000 mon.b (mon.2) 1376 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:50:33.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:50:32 smithi188 bash[23329]: cluster 2020-07-16T15:50:31.267935+0000 mgr.x (mgr.34562) 6340 : cluster [DBG] pgmap v3955: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:50:33.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:50:32 smithi188 bash[23329]: cephadm 2020-07-16T15:50:31.424691+0000 mgr.x (mgr.34562) 6341 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:50:33.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:50:32 smithi188 bash[23329]: cephadm 2020-07-16T15:50:31.425086+0000 mgr.x (mgr.34562) 6342 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:50:33.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:50:32 smithi132 bash[27079]: cluster 2020-07-16T15:50:31.267935+0000 mgr.x (mgr.34562) 6340 : cluster [DBG] pgmap v3955: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:50:33.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:50:32 smithi132 bash[27079]: cephadm 2020-07-16T15:50:31.424691+0000 mgr.x (mgr.34562) 6341 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:50:33.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:50:32 smithi132 bash[27079]: cephadm 2020-07-16T15:50:31.425086+0000 mgr.x (mgr.34562) 6342 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:50:35.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:50:34 smithi188 bash[23329]: cluster 2020-07-16T15:50:33.268337+0000 mgr.x (mgr.34562) 6343 : cluster [DBG] pgmap v3956: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:50:35.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:50:34 smithi132 bash[27079]: cluster 2020-07-16T15:50:33.268337+0000 mgr.x (mgr.34562) 6343 : cluster [DBG] pgmap v3956: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:50:37.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:50:36 smithi188 bash[23329]: cluster 2020-07-16T15:50:35.268735+0000 mgr.x (mgr.34562) 6344 : cluster [DBG] pgmap v3957: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:50:37.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:50:36 smithi132 bash[27079]: cluster 2020-07-16T15:50:35.268735+0000 mgr.x (mgr.34562) 6344 : cluster [DBG] pgmap v3957: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:50:39.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:50:38 smithi188 bash[23329]: cluster 2020-07-16T15:50:37.269207+0000 mgr.x (mgr.34562) 6345 : cluster [DBG] pgmap v3958: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:50:39.250 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:50:38 smithi132 bash[27079]: cluster 2020-07-16T15:50:37.269207+0000 mgr.x (mgr.34562) 6345 : cluster [DBG] pgmap v3958: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:50:41.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:50:40 smithi188 bash[23329]: cluster 2020-07-16T15:50:39.269596+0000 mgr.x (mgr.34562) 6346 : cluster [DBG] pgmap v3959: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:50:41.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:50:40 smithi132 bash[27079]: cluster 2020-07-16T15:50:39.269596+0000 mgr.x (mgr.34562) 6346 : cluster [DBG] pgmap v3959: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:50:43.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:50:42 smithi188 bash[23329]: cluster 2020-07-16T15:50:41.269937+0000 mgr.x (mgr.34562) 6347 : cluster [DBG] pgmap v3960: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:50:43.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:50:42 smithi132 bash[27079]: cluster 2020-07-16T15:50:41.269937+0000 mgr.x (mgr.34562) 6347 : cluster [DBG] pgmap v3960: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:50:45.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:50:44 smithi188 bash[23329]: cluster 2020-07-16T15:50:43.270419+0000 mgr.x (mgr.34562) 6348 : cluster [DBG] pgmap v3961: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:50:45.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:50:44 smithi132 bash[27079]: cluster 2020-07-16T15:50:43.270419+0000 mgr.x (mgr.34562) 6348 : cluster [DBG] pgmap v3961: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:50:47.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:50:46 smithi188 bash[23329]: cluster 2020-07-16T15:50:45.270809+0000 mgr.x (mgr.34562) 6349 : cluster [DBG] pgmap v3962: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:50:47.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:50:46 smithi188 bash[23329]: audit 2020-07-16T15:50:46.437608+0000 mon.b (mon.2) 1377 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:50:47.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:50:46 smithi188 bash[23329]: audit 2020-07-16T15:50:46.438819+0000 mon.b (mon.2) 1378 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:50:47.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:50:46 smithi188 bash[23329]: audit 2020-07-16T15:50:46.439893+0000 mon.b (mon.2) 1379 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:50:47.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:50:46 smithi188 bash[23329]: audit 2020-07-16T15:50:46.441200+0000 mon.b (mon.2) 1380 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:50:47.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:50:46 smithi188 bash[23329]: audit 2020-07-16T15:50:46.442448+0000 mon.b (mon.2) 1381 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:50:47.187 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:50:46 smithi132 bash[27079]: cluster 2020-07-16T15:50:45.270809+0000 mgr.x (mgr.34562) 6349 : cluster [DBG] pgmap v3962: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:50:47.187 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:50:46 smithi132 bash[27079]: audit 2020-07-16T15:50:46.437608+0000 mon.b (mon.2) 1377 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:50:47.187 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:50:46 smithi132 bash[27079]: audit 2020-07-16T15:50:46.438819+0000 mon.b (mon.2) 1378 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:50:47.188 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:50:46 smithi132 bash[27079]: audit 2020-07-16T15:50:46.439893+0000 mon.b (mon.2) 1379 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:50:47.188 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:50:46 smithi132 bash[27079]: audit 2020-07-16T15:50:46.441200+0000 mon.b (mon.2) 1380 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:50:47.188 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:50:46 smithi132 bash[27079]: audit 2020-07-16T15:50:46.442448+0000 mon.b (mon.2) 1381 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:50:48.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:50:47 smithi188 bash[23329]: audit 2020-07-16T15:50:46.437959+0000 mgr.x (mgr.34562) 6350 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:50:48.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:50:47 smithi188 bash[23329]: audit 2020-07-16T15:50:46.439130+0000 mgr.x (mgr.34562) 6351 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:50:48.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:50:47 smithi188 bash[23329]: audit 2020-07-16T15:50:46.440156+0000 mgr.x (mgr.34562) 6352 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:50:48.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:50:47 smithi188 bash[23329]: cephadm 2020-07-16T15:50:46.440777+0000 mgr.x (mgr.34562) 6353 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:50:48.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:50:47 smithi188 bash[23329]: cephadm 2020-07-16T15:50:46.441985+0000 mgr.x (mgr.34562) 6354 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:50:48.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:50:47 smithi188 bash[23329]: cephadm 2020-07-16T15:50:46.443104+0000 mgr.x (mgr.34562) 6355 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:50:48.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:50:47 smithi188 bash[23329]: cephadm 2020-07-16T15:50:46.443391+0000 mgr.x (mgr.34562) 6356 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:50:48.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:50:47 smithi132 bash[27079]: audit 2020-07-16T15:50:46.437959+0000 mgr.x (mgr.34562) 6350 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:50:48.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:50:47 smithi132 bash[27079]: audit 2020-07-16T15:50:46.439130+0000 mgr.x (mgr.34562) 6351 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:50:48.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:50:47 smithi132 bash[27079]: audit 2020-07-16T15:50:46.440156+0000 mgr.x (mgr.34562) 6352 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:50:48.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:50:47 smithi132 bash[27079]: cephadm 2020-07-16T15:50:46.440777+0000 mgr.x (mgr.34562) 6353 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:50:48.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:50:47 smithi132 bash[27079]: cephadm 2020-07-16T15:50:46.441985+0000 mgr.x (mgr.34562) 6354 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:50:48.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:50:47 smithi132 bash[27079]: cephadm 2020-07-16T15:50:46.443104+0000 mgr.x (mgr.34562) 6355 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:50:48.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:50:47 smithi132 bash[27079]: cephadm 2020-07-16T15:50:46.443391+0000 mgr.x (mgr.34562) 6356 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:50:49.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:50:48 smithi132 bash[27079]: cluster 2020-07-16T15:50:47.271360+0000 mgr.x (mgr.34562) 6357 : cluster [DBG] pgmap v3963: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:50:49.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:50:48 smithi188 bash[23329]: cluster 2020-07-16T15:50:47.271360+0000 mgr.x (mgr.34562) 6357 : cluster [DBG] pgmap v3963: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:50:50.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:50:49 smithi188 bash[23329]: audit 2020-07-16T15:50:49.265373+0000 mon.b (mon.2) 1382 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:50:50.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:50:49 smithi132 bash[27079]: audit 2020-07-16T15:50:49.265373+0000 mon.b (mon.2) 1382 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:50:51.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:50:50 smithi188 bash[23329]: cephadm 2020-07-16T15:50:49.265975+0000 mgr.x (mgr.34562) 6358 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:50:51.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:50:50 smithi188 bash[23329]: cephadm 2020-07-16T15:50:49.266052+0000 mgr.x (mgr.34562) 6359 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:50:51.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:50:50 smithi188 bash[23329]: cluster 2020-07-16T15:50:49.271676+0000 mgr.x (mgr.34562) 6360 : cluster [DBG] pgmap v3964: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:50:51.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:50:50 smithi132 bash[27079]: cephadm 2020-07-16T15:50:49.265975+0000 mgr.x (mgr.34562) 6358 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:50:51.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:50:50 smithi132 bash[27079]: cephadm 2020-07-16T15:50:49.266052+0000 mgr.x (mgr.34562) 6359 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:50:51.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:50:50 smithi132 bash[27079]: cluster 2020-07-16T15:50:49.271676+0000 mgr.x (mgr.34562) 6360 : cluster [DBG] pgmap v3964: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:50:53.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:50:52 smithi188 bash[23329]: cluster 2020-07-16T15:50:51.272045+0000 mgr.x (mgr.34562) 6361 : cluster [DBG] pgmap v3965: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:50:53.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:50:52 smithi132 bash[27079]: cluster 2020-07-16T15:50:51.272045+0000 mgr.x (mgr.34562) 6361 : cluster [DBG] pgmap v3965: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:50:55.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:50:54 smithi188 bash[23329]: cluster 2020-07-16T15:50:53.272580+0000 mgr.x (mgr.34562) 6362 : cluster [DBG] pgmap v3966: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:50:55.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:50:54 smithi132 bash[27079]: cluster 2020-07-16T15:50:53.272580+0000 mgr.x (mgr.34562) 6362 : cluster [DBG] pgmap v3966: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:50:57.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:50:56 smithi188 bash[23329]: cluster 2020-07-16T15:50:55.272968+0000 mgr.x (mgr.34562) 6363 : cluster [DBG] pgmap v3967: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:50:57.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:50:56 smithi132 bash[27079]: cluster 2020-07-16T15:50:55.272968+0000 mgr.x (mgr.34562) 6363 : cluster [DBG] pgmap v3967: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:50:58.291 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:50:58.553 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:50:58.554 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 5m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:50:58.554 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 5m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:50:58.554 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 5m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:50:58.555 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 5m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:50:58.555 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 5m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:50:58.555 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:50:58.555 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:50:58.556 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 5m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:50:58.556 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 5m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:50:58.556 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:50:58.556 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:50:58.557 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:50:58.557 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:50:58.557 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:50:58.557 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:50:58.558 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:50:58.558 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:50:58.558 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 5m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:50:58.854 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:50:58.855 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:50:58.855 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:50:58.856 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:50:58.856 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:50:58.856 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:50:58.856 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:50:58.857 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:50:58.857 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:50:58.857 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:50:58.857 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:50:58.857 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:50:58.858 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:50:58.858 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:50:58.858 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:50:58.858 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:50:58.858 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:50:59.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:50:58 smithi188 bash[23329]: cluster 2020-07-16T15:50:57.273555+0000 mgr.x (mgr.34562) 6364 : cluster [DBG] pgmap v3968: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:50:59.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:50:58 smithi132 bash[27079]: cluster 2020-07-16T15:50:57.273555+0000 mgr.x (mgr.34562) 6364 : cluster [DBG] pgmap v3968: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:51:00.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:50:59 smithi188 bash[23329]: audit 2020-07-16T15:50:58.280082+0000 mgr.x (mgr.34562) 6365 : audit [DBG] from='client.29266 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:51:01.476 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:50:59 smithi188 bash[23329]: audit 2020-07-16T15:50:58.549913+0000 mgr.x (mgr.34562) 6366 : audit [DBG] from='client.29272 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:51:01.476 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:50:59 smithi188 bash[23329]: audit 2020-07-16T15:50:58.853954+0000 mon.c (mon.1) 437 : audit [DBG] from='client.? 172.21.15.132:0/2049309695' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:51:01.477 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:50:59 smithi132 bash[27079]: audit 2020-07-16T15:50:58.280082+0000 mgr.x (mgr.34562) 6365 : audit [DBG] from='client.29266 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:51:01.478 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:50:59 smithi132 bash[27079]: audit 2020-07-16T15:50:58.549913+0000 mgr.x (mgr.34562) 6366 : audit [DBG] from='client.29272 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:51:01.478 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:50:59 smithi132 bash[27079]: audit 2020-07-16T15:50:58.853954+0000 mon.c (mon.1) 437 : audit [DBG] from='client.? 172.21.15.132:0/2049309695' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:51:01.478 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:51:00 smithi132 bash[27079]: cluster 2020-07-16T15:50:59.274086+0000 mgr.x (mgr.34562) 6367 : cluster [DBG] pgmap v3969: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:51:01.479 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:51:00 smithi188 bash[23329]: cluster 2020-07-16T15:50:59.274086+0000 mgr.x (mgr.34562) 6367 : cluster [DBG] pgmap v3969: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:51:03.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:51:02 smithi188 bash[23329]: cluster 2020-07-16T15:51:01.274539+0000 mgr.x (mgr.34562) 6368 : cluster [DBG] pgmap v3970: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:51:03.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:51:02 smithi132 bash[27079]: cluster 2020-07-16T15:51:01.274539+0000 mgr.x (mgr.34562) 6368 : cluster [DBG] pgmap v3970: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:51:05.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:51:04 smithi188 bash[23329]: cluster 2020-07-16T15:51:03.275135+0000 mgr.x (mgr.34562) 6369 : cluster [DBG] pgmap v3971: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:51:05.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:51:04 smithi188 bash[23329]: audit 2020-07-16T15:51:04.281758+0000 mon.b (mon.2) 1383 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:51:05.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:51:04 smithi132 bash[27079]: cluster 2020-07-16T15:51:03.275135+0000 mgr.x (mgr.34562) 6369 : cluster [DBG] pgmap v3971: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:51:05.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:51:04 smithi132 bash[27079]: audit 2020-07-16T15:51:04.281758+0000 mon.b (mon.2) 1383 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:51:06.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:51:05 smithi188 bash[23329]: cephadm 2020-07-16T15:51:04.282448+0000 mgr.x (mgr.34562) 6370 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:51:06.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:51:05 smithi188 bash[23329]: cephadm 2020-07-16T15:51:04.282973+0000 mgr.x (mgr.34562) 6371 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:51:06.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:51:05 smithi132 bash[27079]: cephadm 2020-07-16T15:51:04.282448+0000 mgr.x (mgr.34562) 6370 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:51:06.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:51:05 smithi132 bash[27079]: cephadm 2020-07-16T15:51:04.282973+0000 mgr.x (mgr.34562) 6371 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:51:07.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:51:06 smithi188 bash[23329]: cluster 2020-07-16T15:51:05.275636+0000 mgr.x (mgr.34562) 6372 : cluster [DBG] pgmap v3972: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:51:07.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:51:06 smithi132 bash[27079]: cluster 2020-07-16T15:51:05.275636+0000 mgr.x (mgr.34562) 6372 : cluster [DBG] pgmap v3972: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:51:09.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:51:08 smithi188 bash[23329]: cluster 2020-07-16T15:51:07.276075+0000 mgr.x (mgr.34562) 6373 : cluster [DBG] pgmap v3973: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:51:09.284 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:51:08 smithi132 bash[27079]: cluster 2020-07-16T15:51:07.276075+0000 mgr.x (mgr.34562) 6373 : cluster [DBG] pgmap v3973: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:51:11.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:51:10 smithi188 bash[23329]: cluster 2020-07-16T15:51:09.276611+0000 mgr.x (mgr.34562) 6374 : cluster [DBG] pgmap v3974: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:51:11.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:51:10 smithi132 bash[27079]: cluster 2020-07-16T15:51:09.276611+0000 mgr.x (mgr.34562) 6374 : cluster [DBG] pgmap v3974: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:51:13.175 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:51:12 smithi188 bash[23329]: cluster 2020-07-16T15:51:11.277008+0000 mgr.x (mgr.34562) 6375 : cluster [DBG] pgmap v3975: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:51:13.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:51:12 smithi132 bash[27079]: cluster 2020-07-16T15:51:11.277008+0000 mgr.x (mgr.34562) 6375 : cluster [DBG] pgmap v3975: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:51:15.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:51:14 smithi188 bash[23329]: cluster 2020-07-16T15:51:13.277459+0000 mgr.x (mgr.34562) 6376 : cluster [DBG] pgmap v3976: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:51:15.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:51:14 smithi132 bash[27079]: cluster 2020-07-16T15:51:13.277459+0000 mgr.x (mgr.34562) 6376 : cluster [DBG] pgmap v3976: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:51:17.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:51:16 smithi188 bash[23329]: cluster 2020-07-16T15:51:15.277822+0000 mgr.x (mgr.34562) 6377 : cluster [DBG] pgmap v3977: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:51:17.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:51:16 smithi132 bash[27079]: cluster 2020-07-16T15:51:15.277822+0000 mgr.x (mgr.34562) 6377 : cluster [DBG] pgmap v3977: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:51:19.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:51:18 smithi188 bash[23329]: cluster 2020-07-16T15:51:17.278383+0000 mgr.x (mgr.34562) 6378 : cluster [DBG] pgmap v3978: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:51:19.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:51:18 smithi132 bash[27079]: cluster 2020-07-16T15:51:17.278383+0000 mgr.x (mgr.34562) 6378 : cluster [DBG] pgmap v3978: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:51:20.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:51:19 smithi188 bash[23329]: audit 2020-07-16T15:51:19.298440+0000 mon.b (mon.2) 1384 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:51:20.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:51:19 smithi132 bash[27079]: audit 2020-07-16T15:51:19.298440+0000 mon.b (mon.2) 1384 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:51:21.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:51:20 smithi188 bash[23329]: cluster 2020-07-16T15:51:19.278734+0000 mgr.x (mgr.34562) 6379 : cluster [DBG] pgmap v3979: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:51:21.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:51:20 smithi188 bash[23329]: cephadm 2020-07-16T15:51:19.299123+0000 mgr.x (mgr.34562) 6380 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:51:21.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:51:20 smithi188 bash[23329]: cephadm 2020-07-16T15:51:19.299379+0000 mgr.x (mgr.34562) 6381 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:51:21.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:51:20 smithi132 bash[27079]: cluster 2020-07-16T15:51:19.278734+0000 mgr.x (mgr.34562) 6379 : cluster [DBG] pgmap v3979: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:51:21.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:51:20 smithi132 bash[27079]: cephadm 2020-07-16T15:51:19.299123+0000 mgr.x (mgr.34562) 6380 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:51:21.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:51:20 smithi132 bash[27079]: cephadm 2020-07-16T15:51:19.299379+0000 mgr.x (mgr.34562) 6381 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:51:23.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:51:22 smithi188 bash[23329]: cluster 2020-07-16T15:51:21.279156+0000 mgr.x (mgr.34562) 6382 : cluster [DBG] pgmap v3980: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:51:23.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:51:22 smithi132 bash[27079]: cluster 2020-07-16T15:51:21.279156+0000 mgr.x (mgr.34562) 6382 : cluster [DBG] pgmap v3980: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:51:25.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:51:24 smithi188 bash[23329]: cluster 2020-07-16T15:51:23.279559+0000 mgr.x (mgr.34562) 6383 : cluster [DBG] pgmap v3981: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:51:25.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:51:24 smithi132 bash[27079]: cluster 2020-07-16T15:51:23.279559+0000 mgr.x (mgr.34562) 6383 : cluster [DBG] pgmap v3981: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:51:27.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:51:26 smithi188 bash[23329]: cluster 2020-07-16T15:51:25.280071+0000 mgr.x (mgr.34562) 6384 : cluster [DBG] pgmap v3982: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:51:27.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:51:26 smithi132 bash[27079]: cluster 2020-07-16T15:51:25.280071+0000 mgr.x (mgr.34562) 6384 : cluster [DBG] pgmap v3982: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:51:29.151 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:51:29.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:51:28 smithi188 bash[23329]: cluster 2020-07-16T15:51:27.280498+0000 mgr.x (mgr.34562) 6385 : cluster [DBG] pgmap v3983: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:51:29.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:51:28 smithi132 bash[27079]: cluster 2020-07-16T15:51:27.280498+0000 mgr.x (mgr.34562) 6385 : cluster [DBG] pgmap v3983: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:51:29.411 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:51:29.412 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 5m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:51:29.413 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 5m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:51:29.413 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 5m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:51:29.414 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 5m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:51:29.414 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 5m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:51:29.414 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:51:29.415 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:51:29.415 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 5m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:51:29.416 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 5m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:51:29.416 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:51:29.416 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:51:29.416 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:51:29.417 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:51:29.417 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:51:29.417 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:51:29.418 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:51:29.418 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:51:29.418 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 5m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:51:29.716 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:51:29.716 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:51:29.717 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:51:29.717 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:51:29.717 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:51:29.717 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:51:29.717 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:51:29.718 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:51:29.718 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:51:29.718 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:51:29.718 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:51:29.718 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:51:29.719 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:51:29.719 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:51:29.719 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:51:29.719 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:51:29.719 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:51:30.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:51:29 smithi188 bash[23329]: audit 2020-07-16T15:51:29.140392+0000 mgr.x (mgr.34562) 6386 : audit [DBG] from='client.29284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:51:30.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:51:29 smithi188 bash[23329]: audit 2020-07-16T15:51:29.712684+0000 mon.c (mon.1) 438 : audit [DBG] from='client.? 172.21.15.132:0/1960714860' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:51:30.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:51:29 smithi132 bash[27079]: audit 2020-07-16T15:51:29.140392+0000 mgr.x (mgr.34562) 6386 : audit [DBG] from='client.29284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:51:30.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:51:29 smithi132 bash[27079]: audit 2020-07-16T15:51:29.712684+0000 mon.c (mon.1) 438 : audit [DBG] from='client.? 172.21.15.132:0/1960714860' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:51:31.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:51:30 smithi188 bash[23329]: cluster 2020-07-16T15:51:29.280992+0000 mgr.x (mgr.34562) 6387 : cluster [DBG] pgmap v3984: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:51:31.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:51:30 smithi188 bash[23329]: audit 2020-07-16T15:51:29.407609+0000 mgr.x (mgr.34562) 6388 : audit [DBG] from='client.29290 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:51:31.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:51:30 smithi132 bash[27079]: cluster 2020-07-16T15:51:29.280992+0000 mgr.x (mgr.34562) 6387 : cluster [DBG] pgmap v3984: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:51:31.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:51:30 smithi132 bash[27079]: audit 2020-07-16T15:51:29.407609+0000 mgr.x (mgr.34562) 6388 : audit [DBG] from='client.29290 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:51:33.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:51:32 smithi188 bash[23329]: cluster 2020-07-16T15:51:31.281494+0000 mgr.x (mgr.34562) 6389 : cluster [DBG] pgmap v3985: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:51:33.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:51:32 smithi132 bash[27079]: cluster 2020-07-16T15:51:31.281494+0000 mgr.x (mgr.34562) 6389 : cluster [DBG] pgmap v3985: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:51:35.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:51:34 smithi188 bash[23329]: cluster 2020-07-16T15:51:33.281910+0000 mgr.x (mgr.34562) 6390 : cluster [DBG] pgmap v3986: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:51:35.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:51:34 smithi188 bash[23329]: audit 2020-07-16T15:51:34.315119+0000 mon.b (mon.2) 1385 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:51:35.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:51:34 smithi132 bash[27079]: cluster 2020-07-16T15:51:33.281910+0000 mgr.x (mgr.34562) 6390 : cluster [DBG] pgmap v3986: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:51:35.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:51:34 smithi132 bash[27079]: audit 2020-07-16T15:51:34.315119+0000 mon.b (mon.2) 1385 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:51:36.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:51:35 smithi188 bash[23329]: cephadm 2020-07-16T15:51:34.315841+0000 mgr.x (mgr.34562) 6391 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:51:36.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:51:35 smithi188 bash[23329]: cephadm 2020-07-16T15:51:34.316267+0000 mgr.x (mgr.34562) 6392 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:51:36.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:51:35 smithi132 bash[27079]: cephadm 2020-07-16T15:51:34.315841+0000 mgr.x (mgr.34562) 6391 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:51:36.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:51:35 smithi132 bash[27079]: cephadm 2020-07-16T15:51:34.316267+0000 mgr.x (mgr.34562) 6392 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:51:37.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:51:36 smithi188 bash[23329]: cluster 2020-07-16T15:51:35.282380+0000 mgr.x (mgr.34562) 6393 : cluster [DBG] pgmap v3987: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:51:37.285 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:51:36 smithi132 bash[27079]: cluster 2020-07-16T15:51:35.282380+0000 mgr.x (mgr.34562) 6393 : cluster [DBG] pgmap v3987: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:51:39.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:51:38 smithi132 bash[27079]: cluster 2020-07-16T15:51:37.282775+0000 mgr.x (mgr.34562) 6394 : cluster [DBG] pgmap v3988: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:51:39.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:51:38 smithi188 bash[23329]: cluster 2020-07-16T15:51:37.282775+0000 mgr.x (mgr.34562) 6394 : cluster [DBG] pgmap v3988: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:51:41.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:51:40 smithi132 bash[27079]: cluster 2020-07-16T15:51:39.283219+0000 mgr.x (mgr.34562) 6395 : cluster [DBG] pgmap v3989: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:51:41.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:51:40 smithi188 bash[23329]: cluster 2020-07-16T15:51:39.283219+0000 mgr.x (mgr.34562) 6395 : cluster [DBG] pgmap v3989: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:51:43.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:51:42 smithi132 bash[27079]: cluster 2020-07-16T15:51:41.283645+0000 mgr.x (mgr.34562) 6396 : cluster [DBG] pgmap v3990: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:51:43.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:51:42 smithi188 bash[23329]: cluster 2020-07-16T15:51:41.283645+0000 mgr.x (mgr.34562) 6396 : cluster [DBG] pgmap v3990: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:51:45.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:51:44 smithi132 bash[27079]: cluster 2020-07-16T15:51:43.284116+0000 mgr.x (mgr.34562) 6397 : cluster [DBG] pgmap v3991: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:51:45.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:51:44 smithi188 bash[23329]: cluster 2020-07-16T15:51:43.284116+0000 mgr.x (mgr.34562) 6397 : cluster [DBG] pgmap v3991: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:51:47.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:51:46 smithi132 bash[27079]: cluster 2020-07-16T15:51:45.284532+0000 mgr.x (mgr.34562) 6398 : cluster [DBG] pgmap v3992: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:51:47.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:51:46 smithi188 bash[23329]: cluster 2020-07-16T15:51:45.284532+0000 mgr.x (mgr.34562) 6398 : cluster [DBG] pgmap v3992: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:51:49.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:51:48 smithi132 bash[27079]: cluster 2020-07-16T15:51:47.285070+0000 mgr.x (mgr.34562) 6399 : cluster [DBG] pgmap v3993: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:51:49.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:51:48 smithi188 bash[23329]: cluster 2020-07-16T15:51:47.285070+0000 mgr.x (mgr.34562) 6399 : cluster [DBG] pgmap v3993: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:51:50.152 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:51:49 smithi132 bash[27079]: audit 2020-07-16T15:51:49.334250+0000 mon.b (mon.2) 1386 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:51:50.152 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:51:49 smithi132 bash[27079]: audit 2020-07-16T15:51:49.335666+0000 mon.b (mon.2) 1387 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:51:50.153 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:51:49 smithi132 bash[27079]: audit 2020-07-16T15:51:49.336868+0000 mon.b (mon.2) 1388 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:51:50.153 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:51:49 smithi132 bash[27079]: audit 2020-07-16T15:51:49.338196+0000 mon.b (mon.2) 1389 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:51:50.153 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:51:49 smithi132 bash[27079]: audit 2020-07-16T15:51:49.339372+0000 mon.b (mon.2) 1390 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:51:50.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:51:49 smithi188 bash[23329]: audit 2020-07-16T15:51:49.334250+0000 mon.b (mon.2) 1386 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:51:50.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:51:49 smithi188 bash[23329]: audit 2020-07-16T15:51:49.335666+0000 mon.b (mon.2) 1387 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:51:50.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:51:49 smithi188 bash[23329]: audit 2020-07-16T15:51:49.336868+0000 mon.b (mon.2) 1388 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:51:50.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:51:49 smithi188 bash[23329]: audit 2020-07-16T15:51:49.338196+0000 mon.b (mon.2) 1389 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:51:50.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:51:49 smithi188 bash[23329]: audit 2020-07-16T15:51:49.339372+0000 mon.b (mon.2) 1390 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:51:51.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:51:50 smithi132 bash[27079]: cluster 2020-07-16T15:51:49.285528+0000 mgr.x (mgr.34562) 6400 : cluster [DBG] pgmap v3994: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:51:51.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:51:50 smithi132 bash[27079]: audit 2020-07-16T15:51:49.334628+0000 mgr.x (mgr.34562) 6401 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:51:51.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:51:50 smithi132 bash[27079]: audit 2020-07-16T15:51:49.335967+0000 mgr.x (mgr.34562) 6402 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:51:51.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:51:50 smithi132 bash[27079]: audit 2020-07-16T15:51:49.337167+0000 mgr.x (mgr.34562) 6403 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:51:51.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:51:50 smithi132 bash[27079]: cephadm 2020-07-16T15:51:49.337896+0000 mgr.x (mgr.34562) 6404 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:51:51.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:51:50 smithi132 bash[27079]: cephadm 2020-07-16T15:51:49.339058+0000 mgr.x (mgr.34562) 6405 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:51:51.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:51:50 smithi132 bash[27079]: cephadm 2020-07-16T15:51:49.340171+0000 mgr.x (mgr.34562) 6406 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:51:51.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:51:50 smithi132 bash[27079]: cephadm 2020-07-16T15:51:49.340240+0000 mgr.x (mgr.34562) 6407 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:51:51.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:51:50 smithi188 bash[23329]: cluster 2020-07-16T15:51:49.285528+0000 mgr.x (mgr.34562) 6400 : cluster [DBG] pgmap v3994: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:51:51.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:51:50 smithi188 bash[23329]: audit 2020-07-16T15:51:49.334628+0000 mgr.x (mgr.34562) 6401 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:51:51.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:51:50 smithi188 bash[23329]: audit 2020-07-16T15:51:49.335967+0000 mgr.x (mgr.34562) 6402 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:51:51.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:51:50 smithi188 bash[23329]: audit 2020-07-16T15:51:49.337167+0000 mgr.x (mgr.34562) 6403 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:51:51.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:51:50 smithi188 bash[23329]: cephadm 2020-07-16T15:51:49.337896+0000 mgr.x (mgr.34562) 6404 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:51:51.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:51:50 smithi188 bash[23329]: cephadm 2020-07-16T15:51:49.339058+0000 mgr.x (mgr.34562) 6405 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:51:51.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:51:50 smithi188 bash[23329]: cephadm 2020-07-16T15:51:49.340171+0000 mgr.x (mgr.34562) 6406 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:51:51.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:51:50 smithi188 bash[23329]: cephadm 2020-07-16T15:51:49.340240+0000 mgr.x (mgr.34562) 6407 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:51:53.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:51:52 smithi132 bash[27079]: cluster 2020-07-16T15:51:51.285916+0000 mgr.x (mgr.34562) 6408 : cluster [DBG] pgmap v3995: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:51:53.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:51:52 smithi132 bash[27079]: audit 2020-07-16T15:51:52.210335+0000 mon.b (mon.2) 1391 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:51:53.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:51:52 smithi132 bash[27079]: cephadm 2020-07-16T15:51:52.211004+0000 mgr.x (mgr.34562) 6409 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:51:53.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:51:52 smithi132 bash[27079]: cephadm 2020-07-16T15:51:52.211149+0000 mgr.x (mgr.34562) 6410 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:51:53.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:51:52 smithi188 bash[23329]: cluster 2020-07-16T15:51:51.285916+0000 mgr.x (mgr.34562) 6408 : cluster [DBG] pgmap v3995: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:51:53.635 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:51:52 smithi188 bash[23329]: audit 2020-07-16T15:51:52.210335+0000 mon.b (mon.2) 1391 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:51:53.636 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:51:52 smithi188 bash[23329]: cephadm 2020-07-16T15:51:52.211004+0000 mgr.x (mgr.34562) 6409 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:51:53.636 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:51:52 smithi188 bash[23329]: cephadm 2020-07-16T15:51:52.211149+0000 mgr.x (mgr.34562) 6410 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:51:55.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:51:54 smithi132 bash[27079]: cluster 2020-07-16T15:51:53.286327+0000 mgr.x (mgr.34562) 6411 : cluster [DBG] pgmap v3996: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:51:55.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:51:54 smithi188 bash[23329]: cluster 2020-07-16T15:51:53.286327+0000 mgr.x (mgr.34562) 6411 : cluster [DBG] pgmap v3996: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:51:57.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:51:56 smithi132 bash[27079]: cluster 2020-07-16T15:51:55.286742+0000 mgr.x (mgr.34562) 6412 : cluster [DBG] pgmap v3997: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:51:57.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:51:56 smithi188 bash[23329]: cluster 2020-07-16T15:51:55.286742+0000 mgr.x (mgr.34562) 6412 : cluster [DBG] pgmap v3997: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:51:59.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:51:58 smithi132 bash[27079]: cluster 2020-07-16T15:51:57.287266+0000 mgr.x (mgr.34562) 6413 : cluster [DBG] pgmap v3998: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:51:59.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:51:58 smithi188 bash[23329]: cluster 2020-07-16T15:51:57.287266+0000 mgr.x (mgr.34562) 6413 : cluster [DBG] pgmap v3998: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:52:00.021 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:52:00.282 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:52:00.282 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 6m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:52:00.283 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 6m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:52:00.283 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 6m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:52:00.283 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 6m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:52:00.283 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 6m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:52:00.283 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:52:00.284 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:52:00.284 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 6m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:52:00.284 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 6m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:52:00.284 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:52:00.284 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:52:00.285 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:52:00.285 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:52:00.285 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:52:00.285 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:52:00.285 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:52:00.286 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:52:00.286 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 6m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:52:00.580 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:52:00.580 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:52:00.580 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:52:00.581 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:52:00.581 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:52:00.581 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:52:00.581 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:52:00.581 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:52:00.582 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:52:00.582 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:52:00.582 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:52:00.582 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:52:00.582 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:52:00.582 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:52:00.583 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:52:00.583 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:52:00.587 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:52:01.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:52:00 smithi132 bash[27079]: cluster 2020-07-16T15:51:59.287691+0000 mgr.x (mgr.34562) 6414 : cluster [DBG] pgmap v3999: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:52:01.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:52:00 smithi132 bash[27079]: audit 2020-07-16T15:52:00.009892+0000 mgr.x (mgr.34562) 6415 : audit [DBG] from='client.29302 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:52:01.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:52:00 smithi132 bash[27079]: audit 2020-07-16T15:52:00.579529+0000 mon.c (mon.1) 439 : audit [DBG] from='client.? 172.21.15.132:0/2778418820' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:52:01.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:52:00 smithi188 bash[23329]: cluster 2020-07-16T15:51:59.287691+0000 mgr.x (mgr.34562) 6414 : cluster [DBG] pgmap v3999: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:52:01.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:52:00 smithi188 bash[23329]: audit 2020-07-16T15:52:00.009892+0000 mgr.x (mgr.34562) 6415 : audit [DBG] from='client.29302 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:52:01.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:52:00 smithi188 bash[23329]: audit 2020-07-16T15:52:00.579529+0000 mon.c (mon.1) 439 : audit [DBG] from='client.? 172.21.15.132:0/2778418820' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:52:02.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:52:01 smithi132 bash[27079]: audit 2020-07-16T15:52:00.278540+0000 mgr.x (mgr.34562) 6416 : audit [DBG] from='client.29308 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:52:02.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:52:01 smithi188 bash[23329]: audit 2020-07-16T15:52:00.278540+0000 mgr.x (mgr.34562) 6416 : audit [DBG] from='client.29308 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:52:03.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:52:02 smithi132 bash[27079]: cluster 2020-07-16T15:52:01.288087+0000 mgr.x (mgr.34562) 6417 : cluster [DBG] pgmap v4000: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:52:03.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:52:02 smithi188 bash[23329]: cluster 2020-07-16T15:52:01.288087+0000 mgr.x (mgr.34562) 6417 : cluster [DBG] pgmap v4000: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:52:05.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:52:04 smithi132 bash[27079]: cluster 2020-07-16T15:52:03.288629+0000 mgr.x (mgr.34562) 6418 : cluster [DBG] pgmap v4001: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:52:05.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:52:04 smithi188 bash[23329]: cluster 2020-07-16T15:52:03.288629+0000 mgr.x (mgr.34562) 6418 : cluster [DBG] pgmap v4001: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:52:07.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:52:06 smithi132 bash[27079]: cluster 2020-07-16T15:52:05.289156+0000 mgr.x (mgr.34562) 6419 : cluster [DBG] pgmap v4002: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:52:07.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:52:06 smithi188 bash[23329]: cluster 2020-07-16T15:52:05.289156+0000 mgr.x (mgr.34562) 6419 : cluster [DBG] pgmap v4002: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:52:08.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:52:07 smithi132 bash[27079]: audit 2020-07-16T15:52:07.226926+0000 mon.b (mon.2) 1392 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:52:08.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:52:07 smithi132 bash[27079]: cephadm 2020-07-16T15:52:07.227633+0000 mgr.x (mgr.34562) 6420 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:52:08.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:52:07 smithi132 bash[27079]: cephadm 2020-07-16T15:52:07.227878+0000 mgr.x (mgr.34562) 6421 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:52:08.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:52:07 smithi188 bash[23329]: audit 2020-07-16T15:52:07.226926+0000 mon.b (mon.2) 1392 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:52:08.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:52:07 smithi188 bash[23329]: cephadm 2020-07-16T15:52:07.227633+0000 mgr.x (mgr.34562) 6420 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:52:08.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:52:07 smithi188 bash[23329]: cephadm 2020-07-16T15:52:07.227878+0000 mgr.x (mgr.34562) 6421 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:52:09.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:52:08 smithi132 bash[27079]: cluster 2020-07-16T15:52:07.289557+0000 mgr.x (mgr.34562) 6422 : cluster [DBG] pgmap v4003: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:52:09.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:52:08 smithi188 bash[23329]: cluster 2020-07-16T15:52:07.289557+0000 mgr.x (mgr.34562) 6422 : cluster [DBG] pgmap v4003: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:52:11.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:52:10 smithi132 bash[27079]: cluster 2020-07-16T15:52:09.289991+0000 mgr.x (mgr.34562) 6423 : cluster [DBG] pgmap v4004: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:52:11.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:52:10 smithi188 bash[23329]: cluster 2020-07-16T15:52:09.289991+0000 mgr.x (mgr.34562) 6423 : cluster [DBG] pgmap v4004: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:52:13.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:52:12 smithi132 bash[27079]: cluster 2020-07-16T15:52:11.290596+0000 mgr.x (mgr.34562) 6424 : cluster [DBG] pgmap v4005: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:52:13.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:52:12 smithi188 bash[23329]: cluster 2020-07-16T15:52:11.290596+0000 mgr.x (mgr.34562) 6424 : cluster [DBG] pgmap v4005: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:52:15.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:52:14 smithi132 bash[27079]: cluster 2020-07-16T15:52:13.291033+0000 mgr.x (mgr.34562) 6425 : cluster [DBG] pgmap v4006: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:52:15.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:52:14 smithi188 bash[23329]: cluster 2020-07-16T15:52:13.291033+0000 mgr.x (mgr.34562) 6425 : cluster [DBG] pgmap v4006: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:52:17.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:52:17 smithi132 bash[27079]: cluster 2020-07-16T15:52:15.291429+0000 mgr.x (mgr.34562) 6426 : cluster [DBG] pgmap v4007: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:52:17.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:52:17 smithi188 bash[23329]: cluster 2020-07-16T15:52:15.291429+0000 mgr.x (mgr.34562) 6426 : cluster [DBG] pgmap v4007: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:52:19.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:52:19 smithi132 bash[27079]: cluster 2020-07-16T15:52:17.291904+0000 mgr.x (mgr.34562) 6427 : cluster [DBG] pgmap v4008: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:52:19.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:52:19 smithi188 bash[23329]: cluster 2020-07-16T15:52:17.291904+0000 mgr.x (mgr.34562) 6427 : cluster [DBG] pgmap v4008: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:52:21.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:52:21 smithi132 bash[27079]: cluster 2020-07-16T15:52:19.292261+0000 mgr.x (mgr.34562) 6428 : cluster [DBG] pgmap v4009: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:52:21.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:52:21 smithi188 bash[23329]: cluster 2020-07-16T15:52:19.292261+0000 mgr.x (mgr.34562) 6428 : cluster [DBG] pgmap v4009: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:52:23.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:52:23 smithi132 bash[27079]: cluster 2020-07-16T15:52:21.292760+0000 mgr.x (mgr.34562) 6429 : cluster [DBG] pgmap v4010: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:52:23.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:52:23 smithi132 bash[27079]: audit 2020-07-16T15:52:22.237079+0000 mon.b (mon.2) 1393 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:52:23.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:52:23 smithi132 bash[27079]: cephadm 2020-07-16T15:52:22.237795+0000 mgr.x (mgr.34562) 6430 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:52:23.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:52:23 smithi132 bash[27079]: cephadm 2020-07-16T15:52:22.238204+0000 mgr.x (mgr.34562) 6431 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:52:23.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:52:23 smithi188 bash[23329]: cluster 2020-07-16T15:52:21.292760+0000 mgr.x (mgr.34562) 6429 : cluster [DBG] pgmap v4010: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:52:23.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:52:23 smithi188 bash[23329]: audit 2020-07-16T15:52:22.237079+0000 mon.b (mon.2) 1393 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:52:23.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:52:23 smithi188 bash[23329]: cephadm 2020-07-16T15:52:22.237795+0000 mgr.x (mgr.34562) 6430 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:52:23.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:52:23 smithi188 bash[23329]: cephadm 2020-07-16T15:52:22.238204+0000 mgr.x (mgr.34562) 6431 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:52:25.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:52:25 smithi132 bash[27079]: cluster 2020-07-16T15:52:23.293317+0000 mgr.x (mgr.34562) 6432 : cluster [DBG] pgmap v4011: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:52:25.425 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:52:25 smithi188 bash[23329]: cluster 2020-07-16T15:52:23.293317+0000 mgr.x (mgr.34562) 6432 : cluster [DBG] pgmap v4011: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:52:27.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:52:27 smithi132 bash[27079]: cluster 2020-07-16T15:52:25.293718+0000 mgr.x (mgr.34562) 6433 : cluster [DBG] pgmap v4012: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:52:27.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:52:27 smithi188 bash[23329]: cluster 2020-07-16T15:52:25.293718+0000 mgr.x (mgr.34562) 6433 : cluster [DBG] pgmap v4012: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:52:29.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:52:29 smithi132 bash[27079]: cluster 2020-07-16T15:52:27.294110+0000 mgr.x (mgr.34562) 6434 : cluster [DBG] pgmap v4013: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:52:29.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:52:29 smithi188 bash[23329]: cluster 2020-07-16T15:52:27.294110+0000 mgr.x (mgr.34562) 6434 : cluster [DBG] pgmap v4013: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:52:30.878 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:52:31.139 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:52:31.140 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 6m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:52:31.140 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 6m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:52:31.140 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 6m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:52:31.140 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 6m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:52:31.140 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 6m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:52:31.141 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:52:31.141 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:52:31.141 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 6m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:52:31.141 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 6m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:52:31.141 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:52:31.142 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:52:31.142 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:52:31.142 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:52:31.142 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:52:31.142 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:52:31.143 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:52:31.143 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:52:31.143 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 6m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:52:31.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:52:31 smithi132 bash[27079]: cluster 2020-07-16T15:52:29.294560+0000 mgr.x (mgr.34562) 6435 : cluster [DBG] pgmap v4014: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:52:31.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:52:31 smithi188 bash[23329]: cluster 2020-07-16T15:52:29.294560+0000 mgr.x (mgr.34562) 6435 : cluster [DBG] pgmap v4014: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:52:31.438 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:52:31.438 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:52:31.438 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:52:31.438 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:52:31.438 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:52:31.439 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:52:31.439 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:52:31.439 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:52:31.439 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:52:31.439 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:52:31.440 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:52:31.440 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:52:31.440 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:52:31.440 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:52:31.440 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:52:31.441 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:52:31.441 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:52:32.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:52:32 smithi188 bash[23329]: audit 2020-07-16T15:52:30.866648+0000 mgr.x (mgr.34562) 6436 : audit [DBG] from='client.29320 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:52:32.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:52:32 smithi188 bash[23329]: audit 2020-07-16T15:52:31.135629+0000 mgr.x (mgr.34562) 6437 : audit [DBG] from='client.29326 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:52:32.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:52:32 smithi188 bash[23329]: audit 2020-07-16T15:52:31.435923+0000 mon.c (mon.1) 440 : audit [DBG] from='client.? 172.21.15.132:0/653951784' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:52:32.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:52:32 smithi132 bash[27079]: audit 2020-07-16T15:52:30.866648+0000 mgr.x (mgr.34562) 6436 : audit [DBG] from='client.29320 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:52:32.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:52:32 smithi132 bash[27079]: audit 2020-07-16T15:52:31.135629+0000 mgr.x (mgr.34562) 6437 : audit [DBG] from='client.29326 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:52:32.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:52:32 smithi132 bash[27079]: audit 2020-07-16T15:52:31.435923+0000 mon.c (mon.1) 440 : audit [DBG] from='client.? 172.21.15.132:0/653951784' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:52:33.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:52:33 smithi188 bash[23329]: cluster 2020-07-16T15:52:31.294940+0000 mgr.x (mgr.34562) 6438 : cluster [DBG] pgmap v4015: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:52:33.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:52:33 smithi132 bash[27079]: cluster 2020-07-16T15:52:31.294940+0000 mgr.x (mgr.34562) 6438 : cluster [DBG] pgmap v4015: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:52:35.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:52:35 smithi188 bash[23329]: cluster 2020-07-16T15:52:33.295420+0000 mgr.x (mgr.34562) 6439 : cluster [DBG] pgmap v4016: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:52:35.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:52:35 smithi132 bash[27079]: cluster 2020-07-16T15:52:33.295420+0000 mgr.x (mgr.34562) 6439 : cluster [DBG] pgmap v4016: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:52:37.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:52:37 smithi188 bash[23329]: cluster 2020-07-16T15:52:35.295815+0000 mgr.x (mgr.34562) 6440 : cluster [DBG] pgmap v4017: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:52:37.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:52:37 smithi132 bash[27079]: cluster 2020-07-16T15:52:35.295815+0000 mgr.x (mgr.34562) 6440 : cluster [DBG] pgmap v4017: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:52:38.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:52:38 smithi188 bash[23329]: audit 2020-07-16T15:52:37.253015+0000 mon.b (mon.2) 1394 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:52:38.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:52:38 smithi132 bash[27079]: audit 2020-07-16T15:52:37.253015+0000 mon.b (mon.2) 1394 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:52:39.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:52:39 smithi188 bash[23329]: cephadm 2020-07-16T15:52:37.253739+0000 mgr.x (mgr.34562) 6441 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:52:39.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:52:39 smithi188 bash[23329]: cephadm 2020-07-16T15:52:37.253865+0000 mgr.x (mgr.34562) 6442 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:52:39.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:52:39 smithi188 bash[23329]: cluster 2020-07-16T15:52:37.296235+0000 mgr.x (mgr.34562) 6443 : cluster [DBG] pgmap v4018: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:52:39.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:52:39 smithi132 bash[27079]: cephadm 2020-07-16T15:52:37.253739+0000 mgr.x (mgr.34562) 6441 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:52:39.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:52:39 smithi132 bash[27079]: cephadm 2020-07-16T15:52:37.253865+0000 mgr.x (mgr.34562) 6442 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:52:39.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:52:39 smithi132 bash[27079]: cluster 2020-07-16T15:52:37.296235+0000 mgr.x (mgr.34562) 6443 : cluster [DBG] pgmap v4018: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:52:41.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:52:41 smithi188 bash[23329]: cluster 2020-07-16T15:52:39.296809+0000 mgr.x (mgr.34562) 6444 : cluster [DBG] pgmap v4019: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:52:41.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:52:41 smithi132 bash[27079]: cluster 2020-07-16T15:52:39.296809+0000 mgr.x (mgr.34562) 6444 : cluster [DBG] pgmap v4019: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:52:43.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:52:43 smithi188 bash[23329]: cluster 2020-07-16T15:52:41.297200+0000 mgr.x (mgr.34562) 6445 : cluster [DBG] pgmap v4020: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:52:43.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:52:43 smithi132 bash[27079]: cluster 2020-07-16T15:52:41.297200+0000 mgr.x (mgr.34562) 6445 : cluster [DBG] pgmap v4020: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:52:45.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:52:45 smithi188 bash[23329]: cluster 2020-07-16T15:52:43.297740+0000 mgr.x (mgr.34562) 6446 : cluster [DBG] pgmap v4021: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:52:45.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:52:45 smithi132 bash[27079]: cluster 2020-07-16T15:52:43.297740+0000 mgr.x (mgr.34562) 6446 : cluster [DBG] pgmap v4021: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:52:47.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:52:47 smithi188 bash[23329]: cluster 2020-07-16T15:52:45.298198+0000 mgr.x (mgr.34562) 6447 : cluster [DBG] pgmap v4022: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:52:47.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:52:47 smithi132 bash[27079]: cluster 2020-07-16T15:52:45.298198+0000 mgr.x (mgr.34562) 6447 : cluster [DBG] pgmap v4022: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:52:49.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:52:49 smithi188 bash[23329]: cluster 2020-07-16T15:52:47.298660+0000 mgr.x (mgr.34562) 6448 : cluster [DBG] pgmap v4023: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:52:49.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:52:49 smithi132 bash[27079]: cluster 2020-07-16T15:52:47.298660+0000 mgr.x (mgr.34562) 6448 : cluster [DBG] pgmap v4023: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:52:51.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:52:51 smithi188 bash[23329]: cluster 2020-07-16T15:52:49.299236+0000 mgr.x (mgr.34562) 6449 : cluster [DBG] pgmap v4024: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:52:51.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:52:51 smithi132 bash[27079]: cluster 2020-07-16T15:52:49.299236+0000 mgr.x (mgr.34562) 6449 : cluster [DBG] pgmap v4024: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:52:53.167 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:52:53 smithi132 bash[27079]: cluster 2020-07-16T15:52:51.299828+0000 mgr.x (mgr.34562) 6450 : cluster [DBG] pgmap v4025: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:52:53.167 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:52:53 smithi132 bash[27079]: audit 2020-07-16T15:52:52.272358+0000 mon.b (mon.2) 1395 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:52:53.168 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:52:53 smithi132 bash[27079]: audit 2020-07-16T15:52:52.273681+0000 mon.b (mon.2) 1396 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:52:53.168 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:52:53 smithi132 bash[27079]: audit 2020-07-16T15:52:52.274977+0000 mon.b (mon.2) 1397 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:52:53.168 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:52:53 smithi132 bash[27079]: audit 2020-07-16T15:52:52.276236+0000 mon.b (mon.2) 1398 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:52:53.168 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:52:53 smithi132 bash[27079]: audit 2020-07-16T15:52:52.277494+0000 mon.b (mon.2) 1399 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:52:53.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:52:53 smithi188 bash[23329]: cluster 2020-07-16T15:52:51.299828+0000 mgr.x (mgr.34562) 6450 : cluster [DBG] pgmap v4025: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:52:53.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:52:53 smithi188 bash[23329]: audit 2020-07-16T15:52:52.272358+0000 mon.b (mon.2) 1395 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:52:53.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:52:53 smithi188 bash[23329]: audit 2020-07-16T15:52:52.273681+0000 mon.b (mon.2) 1396 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:52:53.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:52:53 smithi188 bash[23329]: audit 2020-07-16T15:52:52.274977+0000 mon.b (mon.2) 1397 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:52:53.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:52:53 smithi188 bash[23329]: audit 2020-07-16T15:52:52.276236+0000 mon.b (mon.2) 1398 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:52:53.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:52:53 smithi188 bash[23329]: audit 2020-07-16T15:52:52.277494+0000 mon.b (mon.2) 1399 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:52:54.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:52:54 smithi132 bash[27079]: audit 2020-07-16T15:52:52.272703+0000 mgr.x (mgr.34562) 6451 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:52:54.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:52:54 smithi132 bash[27079]: audit 2020-07-16T15:52:52.274011+0000 mgr.x (mgr.34562) 6452 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:52:54.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:52:54 smithi132 bash[27079]: audit 2020-07-16T15:52:52.275280+0000 mgr.x (mgr.34562) 6453 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:52:54.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:52:54 smithi132 bash[27079]: cephadm 2020-07-16T15:52:52.275985+0000 mgr.x (mgr.34562) 6454 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:52:54.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:52:54 smithi132 bash[27079]: cephadm 2020-07-16T15:52:52.277046+0000 mgr.x (mgr.34562) 6455 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:52:54.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:52:54 smithi132 bash[27079]: cephadm 2020-07-16T15:52:52.278200+0000 mgr.x (mgr.34562) 6456 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:52:54.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:52:54 smithi132 bash[27079]: cephadm 2020-07-16T15:52:52.278376+0000 mgr.x (mgr.34562) 6457 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:52:54.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:52:54 smithi188 bash[23329]: audit 2020-07-16T15:52:52.272703+0000 mgr.x (mgr.34562) 6451 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:52:54.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:52:54 smithi188 bash[23329]: audit 2020-07-16T15:52:52.274011+0000 mgr.x (mgr.34562) 6452 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:52:54.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:52:54 smithi188 bash[23329]: audit 2020-07-16T15:52:52.275280+0000 mgr.x (mgr.34562) 6453 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:52:54.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:52:54 smithi188 bash[23329]: cephadm 2020-07-16T15:52:52.275985+0000 mgr.x (mgr.34562) 6454 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:52:54.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:52:54 smithi188 bash[23329]: cephadm 2020-07-16T15:52:52.277046+0000 mgr.x (mgr.34562) 6455 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:52:54.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:52:54 smithi188 bash[23329]: cephadm 2020-07-16T15:52:52.278200+0000 mgr.x (mgr.34562) 6456 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:52:54.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:52:54 smithi188 bash[23329]: cephadm 2020-07-16T15:52:52.278376+0000 mgr.x (mgr.34562) 6457 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:52:55.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:52:55 smithi188 bash[23329]: cluster 2020-07-16T15:52:53.300277+0000 mgr.x (mgr.34562) 6458 : cluster [DBG] pgmap v4026: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:52:55.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:52:55 smithi132 bash[27079]: cluster 2020-07-16T15:52:53.300277+0000 mgr.x (mgr.34562) 6458 : cluster [DBG] pgmap v4026: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:52:56.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:52:56 smithi188 bash[23329]: audit 2020-07-16T15:52:55.189797+0000 mon.b (mon.2) 1400 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:52:56.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:52:56 smithi188 bash[23329]: cephadm 2020-07-16T15:52:55.190456+0000 mgr.x (mgr.34562) 6459 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:52:56.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:52:56 smithi188 bash[23329]: cephadm 2020-07-16T15:52:55.190615+0000 mgr.x (mgr.34562) 6460 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:52:56.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:52:56 smithi132 bash[27079]: audit 2020-07-16T15:52:55.189797+0000 mon.b (mon.2) 1400 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:52:56.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:52:56 smithi132 bash[27079]: cephadm 2020-07-16T15:52:55.190456+0000 mgr.x (mgr.34562) 6459 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:52:56.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:52:56 smithi132 bash[27079]: cephadm 2020-07-16T15:52:55.190615+0000 mgr.x (mgr.34562) 6460 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:52:57.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:52:57 smithi188 bash[23329]: cluster 2020-07-16T15:52:55.300853+0000 mgr.x (mgr.34562) 6461 : cluster [DBG] pgmap v4027: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:52:57.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:52:57 smithi132 bash[27079]: cluster 2020-07-16T15:52:55.300853+0000 mgr.x (mgr.34562) 6461 : cluster [DBG] pgmap v4027: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:52:59.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:52:59 smithi188 bash[23329]: cluster 2020-07-16T15:52:57.301236+0000 mgr.x (mgr.34562) 6462 : cluster [DBG] pgmap v4028: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:52:59.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:52:59 smithi132 bash[27079]: cluster 2020-07-16T15:52:57.301236+0000 mgr.x (mgr.34562) 6462 : cluster [DBG] pgmap v4028: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:53:01.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:53:01 smithi188 bash[23329]: cluster 2020-07-16T15:52:59.301697+0000 mgr.x (mgr.34562) 6463 : cluster [DBG] pgmap v4029: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:53:01.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:53:01 smithi132 bash[27079]: cluster 2020-07-16T15:52:59.301697+0000 mgr.x (mgr.34562) 6463 : cluster [DBG] pgmap v4029: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:53:01.735 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:53:01.999 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:53:01.999 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 7m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:53:01.999 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 7m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:53:01.999 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 7m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:53:02.000 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 7m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:53:02.000 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 7m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:53:02.000 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:53:02.000 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:53:02.000 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 7m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:53:02.001 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 7m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:53:02.001 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:53:02.001 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:53:02.001 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:53:02.001 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:53:02.002 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:53:02.002 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:53:02.002 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:53:02.002 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:53:02.002 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 7m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:53:02.295 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:53:02.296 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:53:02.296 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:53:02.296 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:53:02.296 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:53:02.297 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:53:02.297 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:53:02.297 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:53:02.297 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:53:02.297 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:53:02.298 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:53:02.298 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:53:02.298 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:53:02.298 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:53:02.298 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:53:02.299 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:53:02.299 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:53:03.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:53:03 smithi188 bash[23329]: cluster 2020-07-16T15:53:01.302164+0000 mgr.x (mgr.34562) 6464 : cluster [DBG] pgmap v4030: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:53:03.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:53:03 smithi188 bash[23329]: audit 2020-07-16T15:53:01.723573+0000 mgr.x (mgr.34562) 6465 : audit [DBG] from='client.29338 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:53:03.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:53:03 smithi188 bash[23329]: audit 2020-07-16T15:53:01.994778+0000 mgr.x (mgr.34562) 6466 : audit [DBG] from='client.29344 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:53:03.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:53:03 smithi188 bash[23329]: audit 2020-07-16T15:53:02.295143+0000 mon.c (mon.1) 441 : audit [DBG] from='client.? 172.21.15.132:0/4100306590' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:53:03.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:53:03 smithi132 bash[27079]: cluster 2020-07-16T15:53:01.302164+0000 mgr.x (mgr.34562) 6464 : cluster [DBG] pgmap v4030: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:53:03.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:53:03 smithi132 bash[27079]: audit 2020-07-16T15:53:01.723573+0000 mgr.x (mgr.34562) 6465 : audit [DBG] from='client.29338 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:53:03.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:53:03 smithi132 bash[27079]: audit 2020-07-16T15:53:01.994778+0000 mgr.x (mgr.34562) 6466 : audit [DBG] from='client.29344 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:53:03.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:53:03 smithi132 bash[27079]: audit 2020-07-16T15:53:02.295143+0000 mon.c (mon.1) 441 : audit [DBG] from='client.? 172.21.15.132:0/4100306590' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:53:05.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:53:05 smithi188 bash[23329]: cluster 2020-07-16T15:53:03.302633+0000 mgr.x (mgr.34562) 6467 : cluster [DBG] pgmap v4031: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:53:05.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:53:05 smithi132 bash[27079]: cluster 2020-07-16T15:53:03.302633+0000 mgr.x (mgr.34562) 6467 : cluster [DBG] pgmap v4031: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:53:07.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:53:07 smithi188 bash[23329]: cluster 2020-07-16T15:53:05.302980+0000 mgr.x (mgr.34562) 6468 : cluster [DBG] pgmap v4032: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:53:07.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:53:07 smithi132 bash[27079]: cluster 2020-07-16T15:53:05.302980+0000 mgr.x (mgr.34562) 6468 : cluster [DBG] pgmap v4032: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:53:09.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:53:09 smithi188 bash[23329]: cluster 2020-07-16T15:53:07.303417+0000 mgr.x (mgr.34562) 6469 : cluster [DBG] pgmap v4033: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:53:09.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:53:09 smithi132 bash[27079]: cluster 2020-07-16T15:53:07.303417+0000 mgr.x (mgr.34562) 6469 : cluster [DBG] pgmap v4033: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:53:11.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:53:11 smithi188 bash[23329]: cluster 2020-07-16T15:53:09.303838+0000 mgr.x (mgr.34562) 6470 : cluster [DBG] pgmap v4034: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:53:11.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:53:11 smithi188 bash[23329]: audit 2020-07-16T15:53:10.206505+0000 mon.b (mon.2) 1401 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:53:11.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:53:11 smithi188 bash[23329]: cephadm 2020-07-16T15:53:10.207193+0000 mgr.x (mgr.34562) 6471 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:53:11.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:53:11 smithi188 bash[23329]: cephadm 2020-07-16T15:53:10.207607+0000 mgr.x (mgr.34562) 6472 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:53:11.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:53:11 smithi132 bash[27079]: cluster 2020-07-16T15:53:09.303838+0000 mgr.x (mgr.34562) 6470 : cluster [DBG] pgmap v4034: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:53:11.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:53:11 smithi132 bash[27079]: audit 2020-07-16T15:53:10.206505+0000 mon.b (mon.2) 1401 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:53:11.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:53:11 smithi132 bash[27079]: cephadm 2020-07-16T15:53:10.207193+0000 mgr.x (mgr.34562) 6471 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:53:11.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:53:11 smithi132 bash[27079]: cephadm 2020-07-16T15:53:10.207607+0000 mgr.x (mgr.34562) 6472 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:53:13.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:53:13 smithi188 bash[23329]: cluster 2020-07-16T15:53:11.304205+0000 mgr.x (mgr.34562) 6473 : cluster [DBG] pgmap v4035: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:53:13.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:53:13 smithi132 bash[27079]: cluster 2020-07-16T15:53:11.304205+0000 mgr.x (mgr.34562) 6473 : cluster [DBG] pgmap v4035: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:53:15.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:53:15 smithi188 bash[23329]: cluster 2020-07-16T15:53:13.304666+0000 mgr.x (mgr.34562) 6474 : cluster [DBG] pgmap v4036: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:53:15.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:53:15 smithi132 bash[27079]: cluster 2020-07-16T15:53:13.304666+0000 mgr.x (mgr.34562) 6474 : cluster [DBG] pgmap v4036: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:53:17.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:53:17 smithi188 bash[23329]: cluster 2020-07-16T15:53:15.305063+0000 mgr.x (mgr.34562) 6475 : cluster [DBG] pgmap v4037: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:53:17.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:53:17 smithi132 bash[27079]: cluster 2020-07-16T15:53:15.305063+0000 mgr.x (mgr.34562) 6475 : cluster [DBG] pgmap v4037: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:53:19.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:53:19 smithi188 bash[23329]: cluster 2020-07-16T15:53:17.305621+0000 mgr.x (mgr.34562) 6476 : cluster [DBG] pgmap v4038: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:53:19.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:53:19 smithi132 bash[27079]: cluster 2020-07-16T15:53:17.305621+0000 mgr.x (mgr.34562) 6476 : cluster [DBG] pgmap v4038: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:53:21.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:53:21 smithi188 bash[23329]: cluster 2020-07-16T15:53:19.306102+0000 mgr.x (mgr.34562) 6477 : cluster [DBG] pgmap v4039: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:53:21.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:53:21 smithi132 bash[27079]: cluster 2020-07-16T15:53:19.306102+0000 mgr.x (mgr.34562) 6477 : cluster [DBG] pgmap v4039: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:53:23.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:53:23 smithi188 bash[23329]: cluster 2020-07-16T15:53:21.306603+0000 mgr.x (mgr.34562) 6478 : cluster [DBG] pgmap v4040: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:53:23.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:53:23 smithi132 bash[27079]: cluster 2020-07-16T15:53:21.306603+0000 mgr.x (mgr.34562) 6478 : cluster [DBG] pgmap v4040: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:53:25.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:53:25 smithi188 bash[23329]: cluster 2020-07-16T15:53:23.307167+0000 mgr.x (mgr.34562) 6479 : cluster [DBG] pgmap v4041: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:53:25.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:53:25 smithi132 bash[27079]: cluster 2020-07-16T15:53:23.307167+0000 mgr.x (mgr.34562) 6479 : cluster [DBG] pgmap v4041: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:53:26.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:53:26 smithi188 bash[23329]: audit 2020-07-16T15:53:25.221723+0000 mon.b (mon.2) 1402 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:53:26.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:53:26 smithi188 bash[23329]: cephadm 2020-07-16T15:53:25.222412+0000 mgr.x (mgr.34562) 6480 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:53:26.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:53:26 smithi188 bash[23329]: cephadm 2020-07-16T15:53:25.222887+0000 mgr.x (mgr.34562) 6481 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:53:26.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:53:26 smithi132 bash[27079]: audit 2020-07-16T15:53:25.221723+0000 mon.b (mon.2) 1402 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:53:26.824 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:53:26 smithi132 bash[27079]: cephadm 2020-07-16T15:53:25.222412+0000 mgr.x (mgr.34562) 6480 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:53:26.824 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:53:26 smithi132 bash[27079]: cephadm 2020-07-16T15:53:25.222887+0000 mgr.x (mgr.34562) 6481 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:53:27.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:53:27 smithi188 bash[23329]: cluster 2020-07-16T15:53:25.307630+0000 mgr.x (mgr.34562) 6482 : cluster [DBG] pgmap v4042: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:53:27.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:53:27 smithi132 bash[27079]: cluster 2020-07-16T15:53:25.307630+0000 mgr.x (mgr.34562) 6482 : cluster [DBG] pgmap v4042: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:53:29.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:53:29 smithi188 bash[23329]: cluster 2020-07-16T15:53:27.308132+0000 mgr.x (mgr.34562) 6483 : cluster [DBG] pgmap v4043: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:53:29.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:53:29 smithi132 bash[27079]: cluster 2020-07-16T15:53:27.308132+0000 mgr.x (mgr.34562) 6483 : cluster [DBG] pgmap v4043: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:53:31.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:53:31 smithi188 bash[23329]: cluster 2020-07-16T15:53:29.308484+0000 mgr.x (mgr.34562) 6484 : cluster [DBG] pgmap v4044: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:53:31.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:53:31 smithi132 bash[27079]: cluster 2020-07-16T15:53:29.308484+0000 mgr.x (mgr.34562) 6484 : cluster [DBG] pgmap v4044: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:53:32.596 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:53:32.859 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:53:32.859 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 8m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:53:32.860 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 8m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:53:32.860 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 8m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:53:32.860 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 8m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:53:32.860 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 8m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:53:32.861 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:53:32.861 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:53:32.861 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 8m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:53:32.861 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 8m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:53:32.861 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:53:32.862 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:53:32.862 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:53:32.862 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:53:32.862 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:53:32.862 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:53:32.863 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:53:32.863 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:53:32.863 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 8m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:53:33.156 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:53:33.156 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:53:33.157 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:53:33.157 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:53:33.157 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:53:33.157 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:53:33.158 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:53:33.158 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:53:33.158 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:53:33.158 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:53:33.158 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:53:33.159 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:53:33.159 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:53:33.159 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:53:33.159 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:53:33.159 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:53:33.159 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:53:33.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:53:33 smithi188 bash[23329]: cluster 2020-07-16T15:53:31.308892+0000 mgr.x (mgr.34562) 6485 : cluster [DBG] pgmap v4045: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:53:33.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:53:33 smithi132 bash[27079]: cluster 2020-07-16T15:53:31.308892+0000 mgr.x (mgr.34562) 6485 : cluster [DBG] pgmap v4045: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:53:34.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:53:34 smithi188 bash[23329]: audit 2020-07-16T15:53:32.585076+0000 mgr.x (mgr.34562) 6486 : audit [DBG] from='client.29356 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:53:34.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:53:34 smithi188 bash[23329]: audit 2020-07-16T15:53:32.854841+0000 mgr.x (mgr.34562) 6487 : audit [DBG] from='client.29362 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:53:34.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:53:34 smithi188 bash[23329]: audit 2020-07-16T15:53:33.155802+0000 mon.c (mon.1) 442 : audit [DBG] from='client.? 172.21.15.132:0/3461620117' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:53:34.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:53:34 smithi132 bash[27079]: audit 2020-07-16T15:53:32.585076+0000 mgr.x (mgr.34562) 6486 : audit [DBG] from='client.29356 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:53:34.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:53:34 smithi132 bash[27079]: audit 2020-07-16T15:53:32.854841+0000 mgr.x (mgr.34562) 6487 : audit [DBG] from='client.29362 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:53:34.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:53:34 smithi132 bash[27079]: audit 2020-07-16T15:53:33.155802+0000 mon.c (mon.1) 442 : audit [DBG] from='client.? 172.21.15.132:0/3461620117' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:53:35.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:53:35 smithi188 bash[23329]: cluster 2020-07-16T15:53:33.309397+0000 mgr.x (mgr.34562) 6488 : cluster [DBG] pgmap v4046: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:53:35.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:53:35 smithi132 bash[27079]: cluster 2020-07-16T15:53:33.309397+0000 mgr.x (mgr.34562) 6488 : cluster [DBG] pgmap v4046: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:53:37.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:53:37 smithi188 bash[23329]: cluster 2020-07-16T15:53:35.309765+0000 mgr.x (mgr.34562) 6489 : cluster [DBG] pgmap v4047: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:53:37.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:53:37 smithi132 bash[27079]: cluster 2020-07-16T15:53:35.309765+0000 mgr.x (mgr.34562) 6489 : cluster [DBG] pgmap v4047: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:53:39.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:53:39 smithi188 bash[23329]: cluster 2020-07-16T15:53:37.310354+0000 mgr.x (mgr.34562) 6490 : cluster [DBG] pgmap v4048: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:53:39.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:53:39 smithi132 bash[27079]: cluster 2020-07-16T15:53:37.310354+0000 mgr.x (mgr.34562) 6490 : cluster [DBG] pgmap v4048: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:53:41.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:53:41 smithi132 bash[27079]: cluster 2020-07-16T15:53:39.310710+0000 mgr.x (mgr.34562) 6491 : cluster [DBG] pgmap v4049: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:53:41.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:53:41 smithi132 bash[27079]: audit 2020-07-16T15:53:40.238455+0000 mon.b (mon.2) 1403 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:53:41.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:53:41 smithi132 bash[27079]: cephadm 2020-07-16T15:53:40.239202+0000 mgr.x (mgr.34562) 6492 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:53:41.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:53:41 smithi132 bash[27079]: cephadm 2020-07-16T15:53:40.239468+0000 mgr.x (mgr.34562) 6493 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:53:41.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:53:41 smithi188 bash[23329]: cluster 2020-07-16T15:53:39.310710+0000 mgr.x (mgr.34562) 6491 : cluster [DBG] pgmap v4049: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:53:41.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:53:41 smithi188 bash[23329]: audit 2020-07-16T15:53:40.238455+0000 mon.b (mon.2) 1403 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:53:41.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:53:41 smithi188 bash[23329]: cephadm 2020-07-16T15:53:40.239202+0000 mgr.x (mgr.34562) 6492 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:53:41.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:53:41 smithi188 bash[23329]: cephadm 2020-07-16T15:53:40.239468+0000 mgr.x (mgr.34562) 6493 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:53:43.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:53:43 smithi132 bash[27079]: cluster 2020-07-16T15:53:41.311216+0000 mgr.x (mgr.34562) 6494 : cluster [DBG] pgmap v4050: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:53:43.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:53:43 smithi188 bash[23329]: cluster 2020-07-16T15:53:41.311216+0000 mgr.x (mgr.34562) 6494 : cluster [DBG] pgmap v4050: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:53:45.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:53:45 smithi132 bash[27079]: cluster 2020-07-16T15:53:43.311635+0000 mgr.x (mgr.34562) 6495 : cluster [DBG] pgmap v4051: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:53:45.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:53:45 smithi188 bash[23329]: cluster 2020-07-16T15:53:43.311635+0000 mgr.x (mgr.34562) 6495 : cluster [DBG] pgmap v4051: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:53:47.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:53:47 smithi132 bash[27079]: cluster 2020-07-16T15:53:45.312072+0000 mgr.x (mgr.34562) 6496 : cluster [DBG] pgmap v4052: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:53:47.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:53:47 smithi188 bash[23329]: cluster 2020-07-16T15:53:45.312072+0000 mgr.x (mgr.34562) 6496 : cluster [DBG] pgmap v4052: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:53:49.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:53:49 smithi132 bash[27079]: cluster 2020-07-16T15:53:47.312568+0000 mgr.x (mgr.34562) 6497 : cluster [DBG] pgmap v4053: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:53:49.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:53:49 smithi188 bash[23329]: cluster 2020-07-16T15:53:47.312568+0000 mgr.x (mgr.34562) 6497 : cluster [DBG] pgmap v4053: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:53:51.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:53:51 smithi132 bash[27079]: cluster 2020-07-16T15:53:49.313045+0000 mgr.x (mgr.34562) 6498 : cluster [DBG] pgmap v4054: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:53:51.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:53:51 smithi188 bash[23329]: cluster 2020-07-16T15:53:49.313045+0000 mgr.x (mgr.34562) 6498 : cluster [DBG] pgmap v4054: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:53:53.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:53:53 smithi132 bash[27079]: cluster 2020-07-16T15:53:51.313543+0000 mgr.x (mgr.34562) 6499 : cluster [DBG] pgmap v4055: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:53:53.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:53:53 smithi188 bash[23329]: cluster 2020-07-16T15:53:51.313543+0000 mgr.x (mgr.34562) 6499 : cluster [DBG] pgmap v4055: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:53:55.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:53:55 smithi132 bash[27079]: cluster 2020-07-16T15:53:53.314073+0000 mgr.x (mgr.34562) 6500 : cluster [DBG] pgmap v4056: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:53:55.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:53:55 smithi188 bash[23329]: cluster 2020-07-16T15:53:53.314073+0000 mgr.x (mgr.34562) 6500 : cluster [DBG] pgmap v4056: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:53:56.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:53:56 smithi132 bash[27079]: audit 2020-07-16T15:53:55.257657+0000 mon.b (mon.2) 1404 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:53:56.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:53:56 smithi132 bash[27079]: audit 2020-07-16T15:53:55.258027+0000 mgr.x (mgr.34562) 6501 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:53:56.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:53:56 smithi132 bash[27079]: audit 2020-07-16T15:53:55.259059+0000 mon.b (mon.2) 1405 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:53:56.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:53:56 smithi132 bash[27079]: audit 2020-07-16T15:53:55.259395+0000 mgr.x (mgr.34562) 6502 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:53:56.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:53:56 smithi132 bash[27079]: audit 2020-07-16T15:53:55.260246+0000 mon.b (mon.2) 1406 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:53:56.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:53:56 smithi132 bash[27079]: audit 2020-07-16T15:53:55.260528+0000 mgr.x (mgr.34562) 6503 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:53:56.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:53:56 smithi132 bash[27079]: cephadm 2020-07-16T15:53:55.261295+0000 mgr.x (mgr.34562) 6504 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:53:56.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:53:56 smithi132 bash[27079]: audit 2020-07-16T15:53:55.261725+0000 mon.b (mon.2) 1407 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:53:56.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:53:56 smithi132 bash[27079]: cephadm 2020-07-16T15:53:55.262563+0000 mgr.x (mgr.34562) 6505 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:53:56.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:53:56 smithi132 bash[27079]: audit 2020-07-16T15:53:55.262911+0000 mon.b (mon.2) 1408 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:53:56.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:53:56 smithi132 bash[27079]: cephadm 2020-07-16T15:53:55.263633+0000 mgr.x (mgr.34562) 6506 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:53:56.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:53:56 smithi132 bash[27079]: cephadm 2020-07-16T15:53:55.263824+0000 mgr.x (mgr.34562) 6507 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:53:56.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:53:56 smithi188 bash[23329]: audit 2020-07-16T15:53:55.257657+0000 mon.b (mon.2) 1404 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:53:56.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:53:56 smithi188 bash[23329]: audit 2020-07-16T15:53:55.258027+0000 mgr.x (mgr.34562) 6501 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:53:56.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:53:56 smithi188 bash[23329]: audit 2020-07-16T15:53:55.259059+0000 mon.b (mon.2) 1405 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:53:56.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:53:56 smithi188 bash[23329]: audit 2020-07-16T15:53:55.259395+0000 mgr.x (mgr.34562) 6502 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:53:56.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:53:56 smithi188 bash[23329]: audit 2020-07-16T15:53:55.260246+0000 mon.b (mon.2) 1406 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:53:56.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:53:56 smithi188 bash[23329]: audit 2020-07-16T15:53:55.260528+0000 mgr.x (mgr.34562) 6503 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:53:56.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:53:56 smithi188 bash[23329]: cephadm 2020-07-16T15:53:55.261295+0000 mgr.x (mgr.34562) 6504 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:53:56.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:53:56 smithi188 bash[23329]: audit 2020-07-16T15:53:55.261725+0000 mon.b (mon.2) 1407 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:53:56.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:53:56 smithi188 bash[23329]: cephadm 2020-07-16T15:53:55.262563+0000 mgr.x (mgr.34562) 6505 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:53:56.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:53:56 smithi188 bash[23329]: audit 2020-07-16T15:53:55.262911+0000 mon.b (mon.2) 1408 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:53:56.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:53:56 smithi188 bash[23329]: cephadm 2020-07-16T15:53:55.263633+0000 mgr.x (mgr.34562) 6506 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:53:56.675 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:53:56 smithi188 bash[23329]: cephadm 2020-07-16T15:53:55.263824+0000 mgr.x (mgr.34562) 6507 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:53:57.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:53:57 smithi132 bash[27079]: cluster 2020-07-16T15:53:55.314565+0000 mgr.x (mgr.34562) 6508 : cluster [DBG] pgmap v4057: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:53:57.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:53:57 smithi188 bash[23329]: cluster 2020-07-16T15:53:55.314565+0000 mgr.x (mgr.34562) 6508 : cluster [DBG] pgmap v4057: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:53:58.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:53:58 smithi132 bash[27079]: audit 2020-07-16T15:53:58.094335+0000 mon.b (mon.2) 1409 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:53:58.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:53:58 smithi188 bash[23329]: audit 2020-07-16T15:53:58.094335+0000 mon.b (mon.2) 1409 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:53:59.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:53:59 smithi132 bash[27079]: cluster 2020-07-16T15:53:57.315099+0000 mgr.x (mgr.34562) 6509 : cluster [DBG] pgmap v4058: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:53:59.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:53:59 smithi132 bash[27079]: cephadm 2020-07-16T15:53:58.095004+0000 mgr.x (mgr.34562) 6510 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:53:59.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:53:59 smithi132 bash[27079]: cephadm 2020-07-16T15:53:58.095418+0000 mgr.x (mgr.34562) 6511 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:53:59.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:53:59 smithi188 bash[23329]: cluster 2020-07-16T15:53:57.315099+0000 mgr.x (mgr.34562) 6509 : cluster [DBG] pgmap v4058: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:53:59.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:53:59 smithi188 bash[23329]: cephadm 2020-07-16T15:53:58.095004+0000 mgr.x (mgr.34562) 6510 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:53:59.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:53:59 smithi188 bash[23329]: cephadm 2020-07-16T15:53:58.095418+0000 mgr.x (mgr.34562) 6511 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:54:01.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:54:01 smithi132 bash[27079]: cluster 2020-07-16T15:53:59.315587+0000 mgr.x (mgr.34562) 6512 : cluster [DBG] pgmap v4059: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:54:01.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:54:01 smithi188 bash[23329]: cluster 2020-07-16T15:53:59.315587+0000 mgr.x (mgr.34562) 6512 : cluster [DBG] pgmap v4059: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:54:03.453 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:54:03.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:54:03 smithi132 bash[27079]: cluster 2020-07-16T15:54:01.315946+0000 mgr.x (mgr.34562) 6513 : cluster [DBG] pgmap v4060: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:54:03.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:54:03 smithi188 bash[23329]: cluster 2020-07-16T15:54:01.315946+0000 mgr.x (mgr.34562) 6513 : cluster [DBG] pgmap v4060: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:54:03.715 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:54:03.715 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 8m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:54:03.715 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 8m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:54:03.715 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 8m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:54:03.716 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 8m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:54:03.716 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 8m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:54:03.716 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:54:03.716 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:54:03.716 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 8m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:54:03.717 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 8m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:54:03.717 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:54:03.717 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:54:03.717 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:54:03.717 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:54:03.718 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:54:03.718 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:54:03.718 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:54:03.718 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:54:03.718 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 8m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:54:04.011 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:54:04.011 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:54:04.011 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:54:04.012 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:54:04.012 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:54:04.012 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:54:04.012 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:54:04.012 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:54:04.013 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:54:04.013 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:54:04.013 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:54:04.013 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:54:04.014 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:54:04.014 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:54:04.021 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:54:04.021 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:54:04.022 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:54:04.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:54:04 smithi132 bash[27079]: audit 2020-07-16T15:54:04.010477+0000 mon.c (mon.1) 443 : audit [DBG] from='client.? 172.21.15.132:0/2260119626' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:54:04.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:54:04 smithi188 bash[23329]: audit 2020-07-16T15:54:04.010477+0000 mon.c (mon.1) 443 : audit [DBG] from='client.? 172.21.15.132:0/2260119626' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:54:05.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:54:05 smithi132 bash[27079]: cluster 2020-07-16T15:54:03.316359+0000 mgr.x (mgr.34562) 6514 : cluster [DBG] pgmap v4061: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:54:05.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:54:05 smithi132 bash[27079]: audit 2020-07-16T15:54:03.442250+0000 mgr.x (mgr.34562) 6515 : audit [DBG] from='client.29374 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:54:05.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:54:05 smithi132 bash[27079]: audit 2020-07-16T15:54:03.711183+0000 mgr.x (mgr.34562) 6516 : audit [DBG] from='client.29380 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:54:05.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:54:05 smithi188 bash[23329]: cluster 2020-07-16T15:54:03.316359+0000 mgr.x (mgr.34562) 6514 : cluster [DBG] pgmap v4061: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:54:05.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:54:05 smithi188 bash[23329]: audit 2020-07-16T15:54:03.442250+0000 mgr.x (mgr.34562) 6515 : audit [DBG] from='client.29374 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:54:05.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:54:05 smithi188 bash[23329]: audit 2020-07-16T15:54:03.711183+0000 mgr.x (mgr.34562) 6516 : audit [DBG] from='client.29380 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:54:07.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:54:07 smithi132 bash[27079]: cluster 2020-07-16T15:54:05.316730+0000 mgr.x (mgr.34562) 6517 : cluster [DBG] pgmap v4062: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:54:07.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:54:07 smithi188 bash[23329]: cluster 2020-07-16T15:54:05.316730+0000 mgr.x (mgr.34562) 6517 : cluster [DBG] pgmap v4062: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:54:09.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:54:09 smithi132 bash[27079]: cluster 2020-07-16T15:54:07.317165+0000 mgr.x (mgr.34562) 6518 : cluster [DBG] pgmap v4063: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:54:09.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:54:09 smithi188 bash[23329]: cluster 2020-07-16T15:54:07.317165+0000 mgr.x (mgr.34562) 6518 : cluster [DBG] pgmap v4063: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:54:11.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:54:11 smithi132 bash[27079]: cluster 2020-07-16T15:54:09.317731+0000 mgr.x (mgr.34562) 6519 : cluster [DBG] pgmap v4064: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:54:11.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:54:11 smithi188 bash[23329]: cluster 2020-07-16T15:54:09.317731+0000 mgr.x (mgr.34562) 6519 : cluster [DBG] pgmap v4064: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:54:13.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:54:13 smithi132 bash[27079]: cluster 2020-07-16T15:54:11.318106+0000 mgr.x (mgr.34562) 6520 : cluster [DBG] pgmap v4065: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:54:13.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:54:13 smithi132 bash[27079]: audit 2020-07-16T15:54:13.105268+0000 mon.b (mon.2) 1410 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:54:13.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:54:13 smithi188 bash[23329]: cluster 2020-07-16T15:54:11.318106+0000 mgr.x (mgr.34562) 6520 : cluster [DBG] pgmap v4065: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:54:13.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:54:13 smithi188 bash[23329]: audit 2020-07-16T15:54:13.105268+0000 mon.b (mon.2) 1410 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:54:14.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:54:14 smithi132 bash[27079]: cephadm 2020-07-16T15:54:13.106101+0000 mgr.x (mgr.34562) 6521 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:54:14.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:54:14 smithi132 bash[27079]: cephadm 2020-07-16T15:54:13.106436+0000 mgr.x (mgr.34562) 6522 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:54:14.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:54:14 smithi188 bash[23329]: cephadm 2020-07-16T15:54:13.106101+0000 mgr.x (mgr.34562) 6521 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:54:14.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:54:14 smithi188 bash[23329]: cephadm 2020-07-16T15:54:13.106436+0000 mgr.x (mgr.34562) 6522 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:54:15.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:54:15 smithi132 bash[27079]: cluster 2020-07-16T15:54:13.318610+0000 mgr.x (mgr.34562) 6523 : cluster [DBG] pgmap v4066: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:54:15.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:54:15 smithi188 bash[23329]: cluster 2020-07-16T15:54:13.318610+0000 mgr.x (mgr.34562) 6523 : cluster [DBG] pgmap v4066: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:54:17.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:54:17 smithi132 bash[27079]: cluster 2020-07-16T15:54:15.318985+0000 mgr.x (mgr.34562) 6524 : cluster [DBG] pgmap v4067: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:54:17.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:54:17 smithi188 bash[23329]: cluster 2020-07-16T15:54:15.318985+0000 mgr.x (mgr.34562) 6524 : cluster [DBG] pgmap v4067: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:54:19.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:54:19 smithi132 bash[27079]: cluster 2020-07-16T15:54:17.319452+0000 mgr.x (mgr.34562) 6525 : cluster [DBG] pgmap v4068: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:54:19.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:54:19 smithi188 bash[23329]: cluster 2020-07-16T15:54:17.319452+0000 mgr.x (mgr.34562) 6525 : cluster [DBG] pgmap v4068: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:54:21.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:54:21 smithi132 bash[27079]: cluster 2020-07-16T15:54:19.319925+0000 mgr.x (mgr.34562) 6526 : cluster [DBG] pgmap v4069: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:54:21.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:54:21 smithi188 bash[23329]: cluster 2020-07-16T15:54:19.319925+0000 mgr.x (mgr.34562) 6526 : cluster [DBG] pgmap v4069: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:54:23.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:54:23 smithi132 bash[27079]: cluster 2020-07-16T15:54:21.320416+0000 mgr.x (mgr.34562) 6527 : cluster [DBG] pgmap v4070: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:54:23.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:54:23 smithi188 bash[23329]: cluster 2020-07-16T15:54:21.320416+0000 mgr.x (mgr.34562) 6527 : cluster [DBG] pgmap v4070: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:54:25.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:54:25 smithi132 bash[27079]: cluster 2020-07-16T15:54:23.320751+0000 mgr.x (mgr.34562) 6528 : cluster [DBG] pgmap v4071: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:54:25.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:54:25 smithi188 bash[23329]: cluster 2020-07-16T15:54:23.320751+0000 mgr.x (mgr.34562) 6528 : cluster [DBG] pgmap v4071: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:54:27.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:54:27 smithi132 bash[27079]: cluster 2020-07-16T15:54:25.321234+0000 mgr.x (mgr.34562) 6529 : cluster [DBG] pgmap v4072: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:54:27.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:54:27 smithi188 bash[23329]: cluster 2020-07-16T15:54:25.321234+0000 mgr.x (mgr.34562) 6529 : cluster [DBG] pgmap v4072: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:54:28.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:54:28 smithi132 bash[27079]: audit 2020-07-16T15:54:28.121967+0000 mon.b (mon.2) 1411 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:54:28.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:54:28 smithi188 bash[23329]: audit 2020-07-16T15:54:28.121967+0000 mon.b (mon.2) 1411 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:54:29.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:54:29 smithi132 bash[27079]: cluster 2020-07-16T15:54:27.321664+0000 mgr.x (mgr.34562) 6530 : cluster [DBG] pgmap v4073: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:54:29.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:54:29 smithi132 bash[27079]: cephadm 2020-07-16T15:54:28.122663+0000 mgr.x (mgr.34562) 6531 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:54:29.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:54:29 smithi132 bash[27079]: cephadm 2020-07-16T15:54:28.122741+0000 mgr.x (mgr.34562) 6532 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:54:29.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:54:29 smithi188 bash[23329]: cluster 2020-07-16T15:54:27.321664+0000 mgr.x (mgr.34562) 6530 : cluster [DBG] pgmap v4073: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:54:29.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:54:29 smithi188 bash[23329]: cephadm 2020-07-16T15:54:28.122663+0000 mgr.x (mgr.34562) 6531 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:54:29.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:54:29 smithi188 bash[23329]: cephadm 2020-07-16T15:54:28.122741+0000 mgr.x (mgr.34562) 6532 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:54:30.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:54:30 smithi188 bash[23329]: cluster 2020-07-16T15:54:29.322006+0000 mgr.x (mgr.34562) 6533 : cluster [DBG] pgmap v4074: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:54:30.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:54:30 smithi132 bash[27079]: cluster 2020-07-16T15:54:29.322006+0000 mgr.x (mgr.34562) 6533 : cluster [DBG] pgmap v4074: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:54:33.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:54:32 smithi132 bash[27079]: cluster 2020-07-16T15:54:31.322574+0000 mgr.x (mgr.34562) 6534 : cluster [DBG] pgmap v4075: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:54:33.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:54:32 smithi188 bash[23329]: cluster 2020-07-16T15:54:31.322574+0000 mgr.x (mgr.34562) 6534 : cluster [DBG] pgmap v4075: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:54:34.309 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:54:34.570 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:54:34.570 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 9m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:54:34.570 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 9m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:54:34.570 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 9m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:54:34.571 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 9m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:54:34.571 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 9m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:54:34.571 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:54:34.571 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:54:34.572 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 9m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:54:34.572 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 9m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:54:34.572 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:54:34.572 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:54:34.572 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:54:34.573 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:54:34.573 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:54:34.573 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:54:34.573 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:54:34.573 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:54:34.574 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 9m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:54:34.885 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:54:34.886 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:54:34.886 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:54:34.886 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:54:34.886 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:54:34.887 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:54:34.887 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:54:34.887 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:54:34.887 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:54:34.887 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:54:34.888 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:54:34.888 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:54:34.888 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:54:34.888 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:54:34.888 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:54:34.888 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:54:34.889 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:54:35.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:54:34 smithi132 bash[27079]: cluster 2020-07-16T15:54:33.323005+0000 mgr.x (mgr.34562) 6535 : cluster [DBG] pgmap v4076: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:54:35.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:54:34 smithi188 bash[23329]: cluster 2020-07-16T15:54:33.323005+0000 mgr.x (mgr.34562) 6535 : cluster [DBG] pgmap v4076: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:54:36.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:54:35 smithi188 bash[23329]: audit 2020-07-16T15:54:34.297866+0000 mgr.x (mgr.34562) 6536 : audit [DBG] from='client.29392 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:54:36.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:54:35 smithi188 bash[23329]: audit 2020-07-16T15:54:34.565746+0000 mgr.x (mgr.34562) 6537 : audit [DBG] from='client.29398 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:54:36.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:54:35 smithi188 bash[23329]: audit 2020-07-16T15:54:34.885029+0000 mon.c (mon.1) 444 : audit [DBG] from='client.? 172.21.15.132:0/1015408225' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:54:36.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:54:35 smithi132 bash[27079]: audit 2020-07-16T15:54:34.297866+0000 mgr.x (mgr.34562) 6536 : audit [DBG] from='client.29392 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:54:36.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:54:35 smithi132 bash[27079]: audit 2020-07-16T15:54:34.565746+0000 mgr.x (mgr.34562) 6537 : audit [DBG] from='client.29398 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:54:36.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:54:35 smithi132 bash[27079]: audit 2020-07-16T15:54:34.885029+0000 mon.c (mon.1) 444 : audit [DBG] from='client.? 172.21.15.132:0/1015408225' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:54:37.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:54:36 smithi188 bash[23329]: cluster 2020-07-16T15:54:35.323440+0000 mgr.x (mgr.34562) 6538 : cluster [DBG] pgmap v4077: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:54:37.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:54:36 smithi132 bash[27079]: cluster 2020-07-16T15:54:35.323440+0000 mgr.x (mgr.34562) 6538 : cluster [DBG] pgmap v4077: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:54:39.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:54:38 smithi188 bash[23329]: cluster 2020-07-16T15:54:37.323937+0000 mgr.x (mgr.34562) 6539 : cluster [DBG] pgmap v4078: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:54:39.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:54:38 smithi132 bash[27079]: cluster 2020-07-16T15:54:37.323937+0000 mgr.x (mgr.34562) 6539 : cluster [DBG] pgmap v4078: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:54:41.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:54:40 smithi188 bash[23329]: cluster 2020-07-16T15:54:39.324414+0000 mgr.x (mgr.34562) 6540 : cluster [DBG] pgmap v4079: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:54:41.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:54:40 smithi132 bash[27079]: cluster 2020-07-16T15:54:39.324414+0000 mgr.x (mgr.34562) 6540 : cluster [DBG] pgmap v4079: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:54:43.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:54:42 smithi188 bash[23329]: cluster 2020-07-16T15:54:41.324759+0000 mgr.x (mgr.34562) 6541 : cluster [DBG] pgmap v4080: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:54:43.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:54:42 smithi132 bash[27079]: cluster 2020-07-16T15:54:41.324759+0000 mgr.x (mgr.34562) 6541 : cluster [DBG] pgmap v4080: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:54:44.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:54:43 smithi188 bash[23329]: audit 2020-07-16T15:54:43.138522+0000 mon.b (mon.2) 1412 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:54:44.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:54:43 smithi188 bash[23329]: cephadm 2020-07-16T15:54:43.139550+0000 mgr.x (mgr.34562) 6542 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:54:44.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:54:43 smithi188 bash[23329]: cephadm 2020-07-16T15:54:43.139701+0000 mgr.x (mgr.34562) 6543 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:54:44.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:54:43 smithi132 bash[27079]: audit 2020-07-16T15:54:43.138522+0000 mon.b (mon.2) 1412 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:54:44.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:54:43 smithi132 bash[27079]: cephadm 2020-07-16T15:54:43.139550+0000 mgr.x (mgr.34562) 6542 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:54:44.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:54:43 smithi132 bash[27079]: cephadm 2020-07-16T15:54:43.139701+0000 mgr.x (mgr.34562) 6543 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:54:45.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:54:44 smithi188 bash[23329]: cluster 2020-07-16T15:54:43.325295+0000 mgr.x (mgr.34562) 6544 : cluster [DBG] pgmap v4081: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:54:45.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:54:44 smithi132 bash[27079]: cluster 2020-07-16T15:54:43.325295+0000 mgr.x (mgr.34562) 6544 : cluster [DBG] pgmap v4081: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:54:47.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:54:46 smithi188 bash[23329]: cluster 2020-07-16T15:54:45.325715+0000 mgr.x (mgr.34562) 6545 : cluster [DBG] pgmap v4082: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:54:47.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:54:46 smithi132 bash[27079]: cluster 2020-07-16T15:54:45.325715+0000 mgr.x (mgr.34562) 6545 : cluster [DBG] pgmap v4082: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:54:49.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:54:48 smithi188 bash[23329]: cluster 2020-07-16T15:54:47.326267+0000 mgr.x (mgr.34562) 6546 : cluster [DBG] pgmap v4083: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:54:49.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:54:48 smithi132 bash[27079]: cluster 2020-07-16T15:54:47.326267+0000 mgr.x (mgr.34562) 6546 : cluster [DBG] pgmap v4083: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:54:51.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:54:50 smithi188 bash[23329]: cluster 2020-07-16T15:54:49.326692+0000 mgr.x (mgr.34562) 6547 : cluster [DBG] pgmap v4084: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:54:51.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:54:50 smithi132 bash[27079]: cluster 2020-07-16T15:54:49.326692+0000 mgr.x (mgr.34562) 6547 : cluster [DBG] pgmap v4084: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:54:53.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:54:52 smithi188 bash[23329]: cluster 2020-07-16T15:54:51.327073+0000 mgr.x (mgr.34562) 6548 : cluster [DBG] pgmap v4085: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:54:53.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:54:52 smithi132 bash[27079]: cluster 2020-07-16T15:54:51.327073+0000 mgr.x (mgr.34562) 6548 : cluster [DBG] pgmap v4085: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:54:55.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:54:54 smithi188 bash[23329]: cluster 2020-07-16T15:54:53.327656+0000 mgr.x (mgr.34562) 6549 : cluster [DBG] pgmap v4086: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:54:55.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:54:54 smithi132 bash[27079]: cluster 2020-07-16T15:54:53.327656+0000 mgr.x (mgr.34562) 6549 : cluster [DBG] pgmap v4086: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:54:57.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:54:56 smithi188 bash[23329]: cluster 2020-07-16T15:54:55.328086+0000 mgr.x (mgr.34562) 6550 : cluster [DBG] pgmap v4087: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:54:57.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:54:56 smithi132 bash[27079]: cluster 2020-07-16T15:54:55.328086+0000 mgr.x (mgr.34562) 6550 : cluster [DBG] pgmap v4087: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:54:59.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:54:58 smithi132 bash[27079]: cluster 2020-07-16T15:54:57.328521+0000 mgr.x (mgr.34562) 6551 : cluster [DBG] pgmap v4088: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:54:59.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:54:58 smithi132 bash[27079]: audit 2020-07-16T15:54:58.157758+0000 mon.b (mon.2) 1413 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:54:59.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:54:58 smithi132 bash[27079]: audit 2020-07-16T15:54:58.158119+0000 mgr.x (mgr.34562) 6552 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:54:59.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:54:58 smithi132 bash[27079]: audit 2020-07-16T15:54:58.159085+0000 mon.b (mon.2) 1414 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:54:59.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:54:58 smithi132 bash[27079]: audit 2020-07-16T15:54:58.159443+0000 mgr.x (mgr.34562) 6553 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:54:59.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:54:58 smithi132 bash[27079]: audit 2020-07-16T15:54:58.160296+0000 mon.b (mon.2) 1415 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:54:59.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:54:58 smithi132 bash[27079]: audit 2020-07-16T15:54:58.160587+0000 mgr.x (mgr.34562) 6554 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:54:59.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:54:58 smithi132 bash[27079]: cephadm 2020-07-16T15:54:58.161267+0000 mgr.x (mgr.34562) 6555 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:54:59.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:54:58 smithi132 bash[27079]: audit 2020-07-16T15:54:58.161618+0000 mon.b (mon.2) 1416 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:54:59.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:54:58 smithi132 bash[27079]: cephadm 2020-07-16T15:54:58.162432+0000 mgr.x (mgr.34562) 6556 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:54:59.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:54:58 smithi132 bash[27079]: audit 2020-07-16T15:54:58.162761+0000 mon.b (mon.2) 1417 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:54:59.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:54:58 smithi132 bash[27079]: cephadm 2020-07-16T15:54:58.163479+0000 mgr.x (mgr.34562) 6557 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:54:59.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:54:58 smithi132 bash[27079]: cephadm 2020-07-16T15:54:58.163718+0000 mgr.x (mgr.34562) 6558 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:54:59.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:54:58 smithi188 bash[23329]: cluster 2020-07-16T15:54:57.328521+0000 mgr.x (mgr.34562) 6551 : cluster [DBG] pgmap v4088: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:54:59.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:54:58 smithi188 bash[23329]: audit 2020-07-16T15:54:58.157758+0000 mon.b (mon.2) 1413 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:54:59.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:54:58 smithi188 bash[23329]: audit 2020-07-16T15:54:58.158119+0000 mgr.x (mgr.34562) 6552 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:54:59.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:54:58 smithi188 bash[23329]: audit 2020-07-16T15:54:58.159085+0000 mon.b (mon.2) 1414 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:54:59.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:54:58 smithi188 bash[23329]: audit 2020-07-16T15:54:58.159443+0000 mgr.x (mgr.34562) 6553 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:54:59.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:54:58 smithi188 bash[23329]: audit 2020-07-16T15:54:58.160296+0000 mon.b (mon.2) 1415 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:54:59.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:54:58 smithi188 bash[23329]: audit 2020-07-16T15:54:58.160587+0000 mgr.x (mgr.34562) 6554 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:54:59.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:54:58 smithi188 bash[23329]: cephadm 2020-07-16T15:54:58.161267+0000 mgr.x (mgr.34562) 6555 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:54:59.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:54:58 smithi188 bash[23329]: audit 2020-07-16T15:54:58.161618+0000 mon.b (mon.2) 1416 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:54:59.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:54:58 smithi188 bash[23329]: cephadm 2020-07-16T15:54:58.162432+0000 mgr.x (mgr.34562) 6556 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:54:59.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:54:58 smithi188 bash[23329]: audit 2020-07-16T15:54:58.162761+0000 mon.b (mon.2) 1417 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:54:59.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:54:58 smithi188 bash[23329]: cephadm 2020-07-16T15:54:58.163479+0000 mgr.x (mgr.34562) 6557 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:54:59.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:54:58 smithi188 bash[23329]: cephadm 2020-07-16T15:54:58.163718+0000 mgr.x (mgr.34562) 6558 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:55:01.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:55:00 smithi188 bash[23329]: cluster 2020-07-16T15:54:59.329051+0000 mgr.x (mgr.34562) 6559 : cluster [DBG] pgmap v4089: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:55:01.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:55:00 smithi132 bash[27079]: cluster 2020-07-16T15:54:59.329051+0000 mgr.x (mgr.34562) 6559 : cluster [DBG] pgmap v4089: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:55:02.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:55:01 smithi188 bash[23329]: audit 2020-07-16T15:55:01.030401+0000 mon.b (mon.2) 1418 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:55:02.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:55:01 smithi188 bash[23329]: cephadm 2020-07-16T15:55:01.031133+0000 mgr.x (mgr.34562) 6560 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:55:02.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:55:01 smithi188 bash[23329]: cephadm 2020-07-16T15:55:01.031257+0000 mgr.x (mgr.34562) 6561 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:55:02.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:55:01 smithi132 bash[27079]: audit 2020-07-16T15:55:01.030401+0000 mon.b (mon.2) 1418 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:55:02.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:55:01 smithi132 bash[27079]: cephadm 2020-07-16T15:55:01.031133+0000 mgr.x (mgr.34562) 6560 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:55:02.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:55:01 smithi132 bash[27079]: cephadm 2020-07-16T15:55:01.031257+0000 mgr.x (mgr.34562) 6561 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:55:03.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:55:02 smithi188 bash[23329]: cluster 2020-07-16T15:55:01.329470+0000 mgr.x (mgr.34562) 6562 : cluster [DBG] pgmap v4090: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:55:03.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:55:02 smithi132 bash[27079]: cluster 2020-07-16T15:55:01.329470+0000 mgr.x (mgr.34562) 6562 : cluster [DBG] pgmap v4090: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:55:05.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:55:04 smithi188 bash[23329]: cluster 2020-07-16T15:55:03.329840+0000 mgr.x (mgr.34562) 6563 : cluster [DBG] pgmap v4091: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:55:05.187 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:55:05.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:55:04 smithi132 bash[27079]: cluster 2020-07-16T15:55:03.329840+0000 mgr.x (mgr.34562) 6563 : cluster [DBG] pgmap v4091: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:55:05.448 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:55:05.448 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 9m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:55:05.448 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 9m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:55:05.448 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 9m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:55:05.449 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 9m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:55:05.449 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 9m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:55:05.449 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:55:05.449 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:55:05.450 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 9m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:55:05.450 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 9m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:55:05.450 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:55:05.450 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:55:05.450 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:55:05.451 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:55:05.451 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:55:05.451 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:55:05.451 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:55:05.451 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:55:05.451 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 9m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:55:05.746 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:55:05.746 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:55:05.747 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:55:05.747 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:55:05.747 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:55:05.747 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:55:05.747 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:55:05.748 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:55:05.748 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:55:05.748 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:55:05.748 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:55:05.748 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:55:05.748 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:55:05.749 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:55:05.749 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:55:05.749 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:55:05.749 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:55:06.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:55:05 smithi188 bash[23329]: audit 2020-07-16T15:55:05.175275+0000 mgr.x (mgr.34562) 6564 : audit [DBG] from='client.29410 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:55:06.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:55:05 smithi188 bash[23329]: audit 2020-07-16T15:55:05.745642+0000 mon.c (mon.1) 445 : audit [DBG] from='client.? 172.21.15.132:0/1219887617' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:55:06.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:55:05 smithi132 bash[27079]: audit 2020-07-16T15:55:05.175275+0000 mgr.x (mgr.34562) 6564 : audit [DBG] from='client.29410 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:55:06.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:55:05 smithi132 bash[27079]: audit 2020-07-16T15:55:05.745642+0000 mon.c (mon.1) 445 : audit [DBG] from='client.? 172.21.15.132:0/1219887617' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:55:07.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:55:06 smithi188 bash[23329]: cluster 2020-07-16T15:55:05.330190+0000 mgr.x (mgr.34562) 6565 : cluster [DBG] pgmap v4092: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:55:07.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:55:06 smithi188 bash[23329]: audit 2020-07-16T15:55:05.443928+0000 mgr.x (mgr.34562) 6566 : audit [DBG] from='client.29416 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:55:07.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:55:06 smithi132 bash[27079]: cluster 2020-07-16T15:55:05.330190+0000 mgr.x (mgr.34562) 6565 : cluster [DBG] pgmap v4092: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:55:07.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:55:06 smithi132 bash[27079]: audit 2020-07-16T15:55:05.443928+0000 mgr.x (mgr.34562) 6566 : audit [DBG] from='client.29416 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:55:09.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:55:08 smithi188 bash[23329]: cluster 2020-07-16T15:55:07.330601+0000 mgr.x (mgr.34562) 6567 : cluster [DBG] pgmap v4093: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:55:09.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:55:08 smithi132 bash[27079]: cluster 2020-07-16T15:55:07.330601+0000 mgr.x (mgr.34562) 6567 : cluster [DBG] pgmap v4093: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:55:11.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:55:10 smithi188 bash[23329]: cluster 2020-07-16T15:55:09.331001+0000 mgr.x (mgr.34562) 6568 : cluster [DBG] pgmap v4094: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:55:11.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:55:10 smithi132 bash[27079]: cluster 2020-07-16T15:55:09.331001+0000 mgr.x (mgr.34562) 6568 : cluster [DBG] pgmap v4094: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:55:13.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:55:12 smithi188 bash[23329]: cluster 2020-07-16T15:55:11.331449+0000 mgr.x (mgr.34562) 6569 : cluster [DBG] pgmap v4095: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:55:13.286 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:55:12 smithi132 bash[27079]: cluster 2020-07-16T15:55:11.331449+0000 mgr.x (mgr.34562) 6569 : cluster [DBG] pgmap v4095: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:55:15.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:55:14 smithi188 bash[23329]: cluster 2020-07-16T15:55:13.331862+0000 mgr.x (mgr.34562) 6570 : cluster [DBG] pgmap v4096: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:55:15.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:55:14 smithi132 bash[27079]: cluster 2020-07-16T15:55:13.331862+0000 mgr.x (mgr.34562) 6570 : cluster [DBG] pgmap v4096: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:55:17.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:55:16 smithi188 bash[23329]: cluster 2020-07-16T15:55:15.332367+0000 mgr.x (mgr.34562) 6571 : cluster [DBG] pgmap v4097: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:55:17.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:55:16 smithi188 bash[23329]: audit 2020-07-16T15:55:16.047152+0000 mon.b (mon.2) 1419 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:55:17.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:55:16 smithi188 bash[23329]: cephadm 2020-07-16T15:55:16.047838+0000 mgr.x (mgr.34562) 6572 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:55:17.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:55:16 smithi188 bash[23329]: cephadm 2020-07-16T15:55:16.048151+0000 mgr.x (mgr.34562) 6573 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:55:17.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:55:16 smithi132 bash[27079]: cluster 2020-07-16T15:55:15.332367+0000 mgr.x (mgr.34562) 6571 : cluster [DBG] pgmap v4097: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:55:17.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:55:16 smithi132 bash[27079]: audit 2020-07-16T15:55:16.047152+0000 mon.b (mon.2) 1419 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:55:17.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:55:16 smithi132 bash[27079]: cephadm 2020-07-16T15:55:16.047838+0000 mgr.x (mgr.34562) 6572 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:55:17.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:55:16 smithi132 bash[27079]: cephadm 2020-07-16T15:55:16.048151+0000 mgr.x (mgr.34562) 6573 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:55:19.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:55:18 smithi188 bash[23329]: cluster 2020-07-16T15:55:17.332727+0000 mgr.x (mgr.34562) 6574 : cluster [DBG] pgmap v4098: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:55:19.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:55:18 smithi132 bash[27079]: cluster 2020-07-16T15:55:17.332727+0000 mgr.x (mgr.34562) 6574 : cluster [DBG] pgmap v4098: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:55:21.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:55:20 smithi188 bash[23329]: cluster 2020-07-16T15:55:19.333276+0000 mgr.x (mgr.34562) 6575 : cluster [DBG] pgmap v4099: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:55:21.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:55:20 smithi132 bash[27079]: cluster 2020-07-16T15:55:19.333276+0000 mgr.x (mgr.34562) 6575 : cluster [DBG] pgmap v4099: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:55:23.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:55:22 smithi188 bash[23329]: cluster 2020-07-16T15:55:21.333779+0000 mgr.x (mgr.34562) 6576 : cluster [DBG] pgmap v4100: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:55:23.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:55:22 smithi132 bash[27079]: cluster 2020-07-16T15:55:21.333779+0000 mgr.x (mgr.34562) 6576 : cluster [DBG] pgmap v4100: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:55:25.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:55:24 smithi188 bash[23329]: cluster 2020-07-16T15:55:23.334352+0000 mgr.x (mgr.34562) 6577 : cluster [DBG] pgmap v4101: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:55:25.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:55:24 smithi132 bash[27079]: cluster 2020-07-16T15:55:23.334352+0000 mgr.x (mgr.34562) 6577 : cluster [DBG] pgmap v4101: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:55:27.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:55:26 smithi188 bash[23329]: cluster 2020-07-16T15:55:25.334853+0000 mgr.x (mgr.34562) 6578 : cluster [DBG] pgmap v4102: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:55:27.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:55:26 smithi132 bash[27079]: cluster 2020-07-16T15:55:25.334853+0000 mgr.x (mgr.34562) 6578 : cluster [DBG] pgmap v4102: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:55:29.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:55:28 smithi188 bash[23329]: cluster 2020-07-16T15:55:27.335322+0000 mgr.x (mgr.34562) 6579 : cluster [DBG] pgmap v4103: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:55:29.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:55:28 smithi132 bash[27079]: cluster 2020-07-16T15:55:27.335322+0000 mgr.x (mgr.34562) 6579 : cluster [DBG] pgmap v4103: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:55:31.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:55:30 smithi188 bash[23329]: cluster 2020-07-16T15:55:29.335638+0000 mgr.x (mgr.34562) 6580 : cluster [DBG] pgmap v4104: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:55:31.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:55:30 smithi132 bash[27079]: cluster 2020-07-16T15:55:29.335638+0000 mgr.x (mgr.34562) 6580 : cluster [DBG] pgmap v4104: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:55:32.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:55:31 smithi188 bash[23329]: audit 2020-07-16T15:55:31.063601+0000 mon.b (mon.2) 1420 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:55:32.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:55:31 smithi188 bash[23329]: cephadm 2020-07-16T15:55:31.064266+0000 mgr.x (mgr.34562) 6581 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:55:32.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:55:31 smithi188 bash[23329]: cephadm 2020-07-16T15:55:31.064408+0000 mgr.x (mgr.34562) 6582 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:55:32.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:55:31 smithi132 bash[27079]: audit 2020-07-16T15:55:31.063601+0000 mon.b (mon.2) 1420 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:55:32.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:55:31 smithi132 bash[27079]: cephadm 2020-07-16T15:55:31.064266+0000 mgr.x (mgr.34562) 6581 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:55:32.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:55:31 smithi132 bash[27079]: cephadm 2020-07-16T15:55:31.064408+0000 mgr.x (mgr.34562) 6582 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:55:33.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:55:32 smithi188 bash[23329]: cluster 2020-07-16T15:55:31.336043+0000 mgr.x (mgr.34562) 6583 : cluster [DBG] pgmap v4105: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:55:33.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:55:32 smithi132 bash[27079]: cluster 2020-07-16T15:55:31.336043+0000 mgr.x (mgr.34562) 6583 : cluster [DBG] pgmap v4105: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:55:35.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:55:34 smithi188 bash[23329]: cluster 2020-07-16T15:55:33.336534+0000 mgr.x (mgr.34562) 6584 : cluster [DBG] pgmap v4106: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:55:35.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:55:34 smithi132 bash[27079]: cluster 2020-07-16T15:55:33.336534+0000 mgr.x (mgr.34562) 6584 : cluster [DBG] pgmap v4106: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:55:36.047 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:55:36.308 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:55:36.309 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 10m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:55:36.309 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 10m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:55:36.309 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 10m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:55:36.309 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 10m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:55:36.309 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 10m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:55:36.310 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:55:36.310 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:55:36.310 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 10m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:55:36.310 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 10m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:55:36.310 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:55:36.311 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:55:36.311 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:55:36.311 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:55:36.311 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:55:36.311 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:55:36.312 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:55:36.312 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:55:36.312 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 10m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:55:36.609 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:55:36.609 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:55:36.609 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:55:36.609 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:55:36.610 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:55:36.610 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:55:36.610 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:55:36.610 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:55:36.610 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:55:36.611 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:55:36.611 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:55:36.611 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:55:36.611 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:55:36.611 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:55:36.612 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:55:36.612 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:55:36.612 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:55:37.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:55:36 smithi188 bash[23329]: cluster 2020-07-16T15:55:35.336914+0000 mgr.x (mgr.34562) 6585 : cluster [DBG] pgmap v4107: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:55:37.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:55:36 smithi188 bash[23329]: audit 2020-07-16T15:55:36.036347+0000 mgr.x (mgr.34562) 6586 : audit [DBG] from='client.29428 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:55:37.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:55:36 smithi188 bash[23329]: audit 2020-07-16T15:55:36.606313+0000 mon.c (mon.1) 446 : audit [DBG] from='client.? 172.21.15.132:0/2811625696' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:55:37.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:55:36 smithi132 bash[27079]: cluster 2020-07-16T15:55:35.336914+0000 mgr.x (mgr.34562) 6585 : cluster [DBG] pgmap v4107: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:55:37.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:55:36 smithi132 bash[27079]: audit 2020-07-16T15:55:36.036347+0000 mgr.x (mgr.34562) 6586 : audit [DBG] from='client.29428 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:55:37.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:55:36 smithi132 bash[27079]: audit 2020-07-16T15:55:36.606313+0000 mon.c (mon.1) 446 : audit [DBG] from='client.? 172.21.15.132:0/2811625696' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:55:38.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:55:37 smithi188 bash[23329]: audit 2020-07-16T15:55:36.304702+0000 mgr.x (mgr.34562) 6587 : audit [DBG] from='client.29434 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:55:38.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:55:37 smithi132 bash[27079]: audit 2020-07-16T15:55:36.304702+0000 mgr.x (mgr.34562) 6587 : audit [DBG] from='client.29434 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:55:39.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:55:38 smithi188 bash[23329]: cluster 2020-07-16T15:55:37.337277+0000 mgr.x (mgr.34562) 6588 : cluster [DBG] pgmap v4108: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:55:39.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:55:38 smithi132 bash[27079]: cluster 2020-07-16T15:55:37.337277+0000 mgr.x (mgr.34562) 6588 : cluster [DBG] pgmap v4108: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:55:41.177 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:55:40 smithi188 bash[23329]: cluster 2020-07-16T15:55:39.337719+0000 mgr.x (mgr.34562) 6589 : cluster [DBG] pgmap v4109: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:55:41.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:55:40 smithi132 bash[27079]: cluster 2020-07-16T15:55:39.337719+0000 mgr.x (mgr.34562) 6589 : cluster [DBG] pgmap v4109: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:55:43.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:55:42 smithi188 bash[23329]: cluster 2020-07-16T15:55:41.338200+0000 mgr.x (mgr.34562) 6590 : cluster [DBG] pgmap v4110: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:55:43.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:55:42 smithi132 bash[27079]: cluster 2020-07-16T15:55:41.338200+0000 mgr.x (mgr.34562) 6590 : cluster [DBG] pgmap v4110: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:55:45.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:55:44 smithi188 bash[23329]: cluster 2020-07-16T15:55:43.338720+0000 mgr.x (mgr.34562) 6591 : cluster [DBG] pgmap v4111: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:55:45.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:55:44 smithi132 bash[27079]: cluster 2020-07-16T15:55:43.338720+0000 mgr.x (mgr.34562) 6591 : cluster [DBG] pgmap v4111: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:55:47.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:55:46 smithi132 bash[27079]: cluster 2020-07-16T15:55:45.339185+0000 mgr.x (mgr.34562) 6592 : cluster [DBG] pgmap v4112: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:55:47.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:55:46 smithi132 bash[27079]: audit 2020-07-16T15:55:46.080095+0000 mon.b (mon.2) 1421 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:55:47.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:55:46 smithi132 bash[27079]: cephadm 2020-07-16T15:55:46.080737+0000 mgr.x (mgr.34562) 6593 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:55:47.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:55:46 smithi132 bash[27079]: cephadm 2020-07-16T15:55:46.080944+0000 mgr.x (mgr.34562) 6594 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:55:47.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:55:46 smithi188 bash[23329]: cluster 2020-07-16T15:55:45.339185+0000 mgr.x (mgr.34562) 6592 : cluster [DBG] pgmap v4112: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:55:47.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:55:46 smithi188 bash[23329]: audit 2020-07-16T15:55:46.080095+0000 mon.b (mon.2) 1421 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:55:47.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:55:46 smithi188 bash[23329]: cephadm 2020-07-16T15:55:46.080737+0000 mgr.x (mgr.34562) 6593 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:55:47.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:55:46 smithi188 bash[23329]: cephadm 2020-07-16T15:55:46.080944+0000 mgr.x (mgr.34562) 6594 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:55:49.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:55:48 smithi132 bash[27079]: cluster 2020-07-16T15:55:47.339695+0000 mgr.x (mgr.34562) 6595 : cluster [DBG] pgmap v4113: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:55:49.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:55:48 smithi188 bash[23329]: cluster 2020-07-16T15:55:47.339695+0000 mgr.x (mgr.34562) 6595 : cluster [DBG] pgmap v4113: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:55:51.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:55:50 smithi132 bash[27079]: cluster 2020-07-16T15:55:49.340082+0000 mgr.x (mgr.34562) 6596 : cluster [DBG] pgmap v4114: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:55:51.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:55:50 smithi188 bash[23329]: cluster 2020-07-16T15:55:49.340082+0000 mgr.x (mgr.34562) 6596 : cluster [DBG] pgmap v4114: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:55:53.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:55:52 smithi132 bash[27079]: cluster 2020-07-16T15:55:51.340386+0000 mgr.x (mgr.34562) 6597 : cluster [DBG] pgmap v4115: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:55:53.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:55:52 smithi188 bash[23329]: cluster 2020-07-16T15:55:51.340386+0000 mgr.x (mgr.34562) 6597 : cluster [DBG] pgmap v4115: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:55:55.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:55:54 smithi132 bash[27079]: cluster 2020-07-16T15:55:53.340826+0000 mgr.x (mgr.34562) 6598 : cluster [DBG] pgmap v4116: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:55:55.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:55:54 smithi188 bash[23329]: cluster 2020-07-16T15:55:53.340826+0000 mgr.x (mgr.34562) 6598 : cluster [DBG] pgmap v4116: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:55:57.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:55:56 smithi132 bash[27079]: cluster 2020-07-16T15:55:55.341254+0000 mgr.x (mgr.34562) 6599 : cluster [DBG] pgmap v4117: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:55:57.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:55:56 smithi188 bash[23329]: cluster 2020-07-16T15:55:55.341254+0000 mgr.x (mgr.34562) 6599 : cluster [DBG] pgmap v4117: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:55:59.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:55:58 smithi132 bash[27079]: cluster 2020-07-16T15:55:57.341653+0000 mgr.x (mgr.34562) 6600 : cluster [DBG] pgmap v4118: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:55:59.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:55:58 smithi188 bash[23329]: cluster 2020-07-16T15:55:57.341653+0000 mgr.x (mgr.34562) 6600 : cluster [DBG] pgmap v4118: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:56:01.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:00 smithi132 bash[27079]: cluster 2020-07-16T15:55:59.342081+0000 mgr.x (mgr.34562) 6601 : cluster [DBG] pgmap v4119: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:56:01.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:00 smithi188 bash[23329]: cluster 2020-07-16T15:55:59.342081+0000 mgr.x (mgr.34562) 6601 : cluster [DBG] pgmap v4119: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:56:02.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:01 smithi132 bash[27079]: audit 2020-07-16T15:56:01.097180+0000 mon.b (mon.2) 1422 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T15:56:02.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:01 smithi132 bash[27079]: audit 2020-07-16T15:56:01.097425+0000 mon.b (mon.2) 1423 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T15:56:02.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:01 smithi188 bash[23329]: audit 2020-07-16T15:56:01.097180+0000 mon.b (mon.2) 1422 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T15:56:02.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:01 smithi188 bash[23329]: audit 2020-07-16T15:56:01.097425+0000 mon.b (mon.2) 1423 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T15:56:03.114 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:02 smithi188 bash[23329]: cluster 2020-07-16T15:56:01.342465+0000 mgr.x (mgr.34562) 6602 : cluster [DBG] pgmap v4120: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:56:03.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:02 smithi132 bash[27079]: cluster 2020-07-16T15:56:01.342465+0000 mgr.x (mgr.34562) 6602 : cluster [DBG] pgmap v4120: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:56:04.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:03 smithi132 bash[27079]: audit 2020-07-16T15:56:03.437123+0000 mon.b (mon.2) 1424 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:56:03.434893\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.434968\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435027\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435079\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435346\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435534\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435728\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435905\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435964\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:56:03.436077\", \"last_device_update\": \"2020-07-16T15:34:56.840832\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:47:37.720588\"}"}]: dispatch 2020-07-16T15:56:04.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:03 smithi132 bash[27079]: audit 2020-07-16T15:56:03.437487+0000 mon.c (mon.1) 447 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:56:03.434893\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.434968\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435027\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435079\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435346\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435534\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435728\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435905\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435964\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:56:03.436077\", \"last_device_update\": \"2020-07-16T15:34:56.840832\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:47:37.720588\"}"}]: dispatch 2020-07-16T15:56:04.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:03 smithi132 bash[27079]: audit 2020-07-16T15:56:03.440217+0000 mon.c (mon.1) 448 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:56:03.434893\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.434968\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435027\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435079\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435346\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435534\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435728\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435905\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435964\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:56:03.436077\", \"last_device_update\": \"2020-07-16T15:34:56.840832\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:47:37.720588\"}"}]': finished 2020-07-16T15:56:04.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:03 smithi132 bash[27079]: audit 2020-07-16T15:56:03.604484+0000 mon.b (mon.2) 1425 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.602998\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603070\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603100\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603259\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603389\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603492\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603606\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603639\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603667\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:56:03.603733\", \"last_device_update\": \"2020-07-16T15:36:02.606623\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:47:37.718791\"}"}]: dispatch 2020-07-16T15:56:04.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:03 smithi132 bash[27079]: audit 2020-07-16T15:56:03.605113+0000 mon.c (mon.1) 449 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.602998\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603070\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603100\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603259\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603389\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603492\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603606\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603639\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603667\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:56:03.603733\", \"last_device_update\": \"2020-07-16T15:36:02.606623\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:47:37.718791\"}"}]: dispatch 2020-07-16T15:56:04.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:03 smithi132 bash[27079]: audit 2020-07-16T15:56:03.609560+0000 mon.c (mon.1) 450 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.602998\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603070\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603100\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603259\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603389\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603492\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603606\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603639\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603667\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:56:03.603733\", \"last_device_update\": \"2020-07-16T15:36:02.606623\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:47:37.718791\"}"}]': finished 2020-07-16T15:56:04.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:03 smithi132 bash[27079]: audit 2020-07-16T15:56:03.612376+0000 mon.b (mon.2) 1426 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:56:04.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:03 smithi132 bash[27079]: audit 2020-07-16T15:56:03.613328+0000 mon.b (mon.2) 1427 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:56:04.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:03 smithi132 bash[27079]: audit 2020-07-16T15:56:03.614178+0000 mon.b (mon.2) 1428 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:56:04.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:03 smithi132 bash[27079]: audit 2020-07-16T15:56:03.615194+0000 mon.b (mon.2) 1429 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:56:04.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:03 smithi132 bash[27079]: audit 2020-07-16T15:56:03.616206+0000 mon.b (mon.2) 1430 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:56:04.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:03 smithi188 bash[23329]: audit 2020-07-16T15:56:03.437123+0000 mon.b (mon.2) 1424 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:56:03.434893\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.434968\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435027\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435079\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435346\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435534\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435728\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435905\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435964\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:56:03.436077\", \"last_device_update\": \"2020-07-16T15:34:56.840832\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:47:37.720588\"}"}]: dispatch 2020-07-16T15:56:04.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:03 smithi188 bash[23329]: audit 2020-07-16T15:56:03.437487+0000 mon.c (mon.1) 447 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:56:03.434893\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.434968\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435027\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435079\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435346\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435534\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435728\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435905\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435964\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:56:03.436077\", \"last_device_update\": \"2020-07-16T15:34:56.840832\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:47:37.720588\"}"}]: dispatch 2020-07-16T15:56:04.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:03 smithi188 bash[23329]: audit 2020-07-16T15:56:03.440217+0000 mon.c (mon.1) 448 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:56:03.434893\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.434968\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435027\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435079\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435346\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435534\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435728\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435905\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435964\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:56:03.436077\", \"last_device_update\": \"2020-07-16T15:34:56.840832\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:47:37.720588\"}"}]': finished 2020-07-16T15:56:04.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:03 smithi188 bash[23329]: audit 2020-07-16T15:56:03.604484+0000 mon.b (mon.2) 1425 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.602998\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603070\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603100\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603259\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603389\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603492\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603606\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603639\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603667\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:56:03.603733\", \"last_device_update\": \"2020-07-16T15:36:02.606623\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:47:37.718791\"}"}]: dispatch 2020-07-16T15:56:04.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:03 smithi188 bash[23329]: audit 2020-07-16T15:56:03.605113+0000 mon.c (mon.1) 449 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.602998\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603070\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603100\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603259\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603389\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603492\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603606\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603639\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603667\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:56:03.603733\", \"last_device_update\": \"2020-07-16T15:36:02.606623\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:47:37.718791\"}"}]: dispatch 2020-07-16T15:56:04.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:03 smithi188 bash[23329]: audit 2020-07-16T15:56:03.609560+0000 mon.c (mon.1) 450 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.602998\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603070\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603100\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603259\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603389\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603492\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603606\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603639\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603667\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:56:03.603733\", \"last_device_update\": \"2020-07-16T15:36:02.606623\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:47:37.718791\"}"}]': finished 2020-07-16T15:56:04.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:03 smithi188 bash[23329]: audit 2020-07-16T15:56:03.612376+0000 mon.b (mon.2) 1426 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:56:04.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:03 smithi188 bash[23329]: audit 2020-07-16T15:56:03.613328+0000 mon.b (mon.2) 1427 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:56:04.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:03 smithi188 bash[23329]: audit 2020-07-16T15:56:03.614178+0000 mon.b (mon.2) 1428 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:56:04.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:03 smithi188 bash[23329]: audit 2020-07-16T15:56:03.615194+0000 mon.b (mon.2) 1429 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:56:04.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:03 smithi188 bash[23329]: audit 2020-07-16T15:56:03.616206+0000 mon.b (mon.2) 1430 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:56:05.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:04 smithi132 bash[27079]: cluster 2020-07-16T15:56:03.342794+0000 mgr.x (mgr.34562) 6603 : cluster [DBG] pgmap v4121: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:56:05.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:04 smithi132 bash[27079]: audit 2020-07-16T15:56:03.612651+0000 mgr.x (mgr.34562) 6604 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:56:05.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:04 smithi132 bash[27079]: audit 2020-07-16T15:56:03.613571+0000 mgr.x (mgr.34562) 6605 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:56:05.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:04 smithi132 bash[27079]: audit 2020-07-16T15:56:03.614411+0000 mgr.x (mgr.34562) 6606 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:56:05.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:04 smithi132 bash[27079]: cephadm 2020-07-16T15:56:03.614896+0000 mgr.x (mgr.34562) 6607 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:56:05.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:04 smithi132 bash[27079]: cephadm 2020-07-16T15:56:03.615885+0000 mgr.x (mgr.34562) 6608 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:56:05.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:04 smithi132 bash[27079]: cephadm 2020-07-16T15:56:03.616711+0000 mgr.x (mgr.34562) 6609 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:56:05.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:04 smithi132 bash[27079]: cephadm 2020-07-16T15:56:03.616893+0000 mgr.x (mgr.34562) 6610 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:56:05.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:04 smithi188 bash[23329]: cluster 2020-07-16T15:56:03.342794+0000 mgr.x (mgr.34562) 6603 : cluster [DBG] pgmap v4121: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:56:05.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:04 smithi188 bash[23329]: audit 2020-07-16T15:56:03.612651+0000 mgr.x (mgr.34562) 6604 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:56:05.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:04 smithi188 bash[23329]: audit 2020-07-16T15:56:03.613571+0000 mgr.x (mgr.34562) 6605 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:56:05.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:04 smithi188 bash[23329]: audit 2020-07-16T15:56:03.614411+0000 mgr.x (mgr.34562) 6606 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:56:05.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:04 smithi188 bash[23329]: cephadm 2020-07-16T15:56:03.614896+0000 mgr.x (mgr.34562) 6607 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:56:05.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:04 smithi188 bash[23329]: cephadm 2020-07-16T15:56:03.615885+0000 mgr.x (mgr.34562) 6608 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:56:05.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:04 smithi188 bash[23329]: cephadm 2020-07-16T15:56:03.616711+0000 mgr.x (mgr.34562) 6609 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:56:05.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:04 smithi188 bash[23329]: cephadm 2020-07-16T15:56:03.616893+0000 mgr.x (mgr.34562) 6610 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:56:06.897 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:56:07.157 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:56:07.158 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 3s ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:56:07.158 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 3s ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:56:07.158 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 3s ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:56:07.158 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 3s ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:56:07.158 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 3s ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:56:07.159 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 3s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:56:07.159 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 3s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:56:07.159 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 3s ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:56:07.159 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 3s ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:56:07.159 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 3s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:56:07.160 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 3s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:56:07.160 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 3s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:56:07.160 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 3s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:56:07.160 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 3s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:56:07.160 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 3s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:56:07.160 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 3s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:56:07.161 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 3s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:56:07.161 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 3s ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:56:07.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:06 smithi132 bash[27079]: cluster 2020-07-16T15:56:05.343146+0000 mgr.x (mgr.34562) 6611 : cluster [DBG] pgmap v4122: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:56:07.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:06 smithi132 bash[27079]: audit 2020-07-16T15:56:06.396014+0000 mon.b (mon.2) 1431 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:56:07.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:06 smithi188 bash[23329]: cluster 2020-07-16T15:56:05.343146+0000 mgr.x (mgr.34562) 6611 : cluster [DBG] pgmap v4122: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:56:07.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:06 smithi188 bash[23329]: audit 2020-07-16T15:56:06.396014+0000 mon.b (mon.2) 1431 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:56:07.455 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:56:07.455 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:56:07.455 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:56:07.455 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:56:07.456 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:56:07.456 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:56:07.456 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:56:07.456 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:56:07.456 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:56:07.457 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:56:07.457 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:56:07.457 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:56:07.457 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:56:07.457 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:56:07.458 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:56:07.458 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:56:07.458 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:56:08.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:07 smithi132 bash[27079]: cephadm 2020-07-16T15:56:06.396603+0000 mgr.x (mgr.34562) 6612 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:56:08.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:07 smithi132 bash[27079]: cephadm 2020-07-16T15:56:06.396988+0000 mgr.x (mgr.34562) 6613 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:56:08.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:07 smithi132 bash[27079]: audit 2020-07-16T15:56:06.886255+0000 mgr.x (mgr.34562) 6614 : audit [DBG] from='client.29446 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:56:08.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:07 smithi132 bash[27079]: audit 2020-07-16T15:56:07.153469+0000 mgr.x (mgr.34562) 6615 : audit [DBG] from='client.29452 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:56:08.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:07 smithi132 bash[27079]: audit 2020-07-16T15:56:07.454478+0000 mon.c (mon.1) 451 : audit [DBG] from='client.? 172.21.15.132:0/2626543916' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:56:08.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:07 smithi188 bash[23329]: cephadm 2020-07-16T15:56:06.396603+0000 mgr.x (mgr.34562) 6612 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:56:08.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:07 smithi188 bash[23329]: cephadm 2020-07-16T15:56:06.396988+0000 mgr.x (mgr.34562) 6613 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:56:08.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:07 smithi188 bash[23329]: audit 2020-07-16T15:56:06.886255+0000 mgr.x (mgr.34562) 6614 : audit [DBG] from='client.29446 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:56:08.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:07 smithi188 bash[23329]: audit 2020-07-16T15:56:07.153469+0000 mgr.x (mgr.34562) 6615 : audit [DBG] from='client.29452 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:56:08.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:07 smithi188 bash[23329]: audit 2020-07-16T15:56:07.454478+0000 mon.c (mon.1) 451 : audit [DBG] from='client.? 172.21.15.132:0/2626543916' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:56:09.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:08 smithi132 bash[27079]: cluster 2020-07-16T15:56:07.343613+0000 mgr.x (mgr.34562) 6616 : cluster [DBG] pgmap v4123: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:56:09.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:08 smithi188 bash[23329]: cluster 2020-07-16T15:56:07.343613+0000 mgr.x (mgr.34562) 6616 : cluster [DBG] pgmap v4123: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:56:11.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:10 smithi132 bash[27079]: cluster 2020-07-16T15:56:09.344123+0000 mgr.x (mgr.34562) 6617 : cluster [DBG] pgmap v4124: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:56:11.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:10 smithi188 bash[23329]: cluster 2020-07-16T15:56:09.344123+0000 mgr.x (mgr.34562) 6617 : cluster [DBG] pgmap v4124: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:56:13.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:12 smithi132 bash[27079]: cluster 2020-07-16T15:56:11.344552+0000 mgr.x (mgr.34562) 6618 : cluster [DBG] pgmap v4125: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:56:13.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:12 smithi188 bash[23329]: cluster 2020-07-16T15:56:11.344552+0000 mgr.x (mgr.34562) 6618 : cluster [DBG] pgmap v4125: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:56:15.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:14 smithi132 bash[27079]: cluster 2020-07-16T15:56:13.344987+0000 mgr.x (mgr.34562) 6619 : cluster [DBG] pgmap v4126: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:56:15.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:14 smithi188 bash[23329]: cluster 2020-07-16T15:56:13.344987+0000 mgr.x (mgr.34562) 6619 : cluster [DBG] pgmap v4126: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:56:17.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:16 smithi132 bash[27079]: cluster 2020-07-16T15:56:15.345428+0000 mgr.x (mgr.34562) 6620 : cluster [DBG] pgmap v4127: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:56:17.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:16 smithi188 bash[23329]: cluster 2020-07-16T15:56:15.345428+0000 mgr.x (mgr.34562) 6620 : cluster [DBG] pgmap v4127: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:56:19.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:18 smithi132 bash[27079]: cluster 2020-07-16T15:56:17.345813+0000 mgr.x (mgr.34562) 6621 : cluster [DBG] pgmap v4128: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:56:19.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:18 smithi188 bash[23329]: cluster 2020-07-16T15:56:17.345813+0000 mgr.x (mgr.34562) 6621 : cluster [DBG] pgmap v4128: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:56:21.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:20 smithi132 bash[27079]: cluster 2020-07-16T15:56:19.346305+0000 mgr.x (mgr.34562) 6622 : cluster [DBG] pgmap v4129: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:56:21.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:20 smithi188 bash[23329]: cluster 2020-07-16T15:56:19.346305+0000 mgr.x (mgr.34562) 6622 : cluster [DBG] pgmap v4129: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:56:22.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:21 smithi132 bash[27079]: audit 2020-07-16T15:56:21.411705+0000 mon.b (mon.2) 1432 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:56:22.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:21 smithi188 bash[23329]: audit 2020-07-16T15:56:21.411705+0000 mon.b (mon.2) 1432 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:56:23.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:22 smithi132 bash[27079]: cluster 2020-07-16T15:56:21.346712+0000 mgr.x (mgr.34562) 6623 : cluster [DBG] pgmap v4130: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:56:23.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:22 smithi132 bash[27079]: cephadm 2020-07-16T15:56:21.412349+0000 mgr.x (mgr.34562) 6624 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:56:23.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:22 smithi132 bash[27079]: cephadm 2020-07-16T15:56:21.412641+0000 mgr.x (mgr.34562) 6625 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:56:23.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:22 smithi188 bash[23329]: cluster 2020-07-16T15:56:21.346712+0000 mgr.x (mgr.34562) 6623 : cluster [DBG] pgmap v4130: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:56:23.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:22 smithi188 bash[23329]: cephadm 2020-07-16T15:56:21.412349+0000 mgr.x (mgr.34562) 6624 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:56:23.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:22 smithi188 bash[23329]: cephadm 2020-07-16T15:56:21.412641+0000 mgr.x (mgr.34562) 6625 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:56:25.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:24 smithi132 bash[27079]: cluster 2020-07-16T15:56:23.347204+0000 mgr.x (mgr.34562) 6626 : cluster [DBG] pgmap v4131: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:56:25.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:24 smithi188 bash[23329]: cluster 2020-07-16T15:56:23.347204+0000 mgr.x (mgr.34562) 6626 : cluster [DBG] pgmap v4131: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:56:27.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:27 smithi132 bash[27079]: cluster 2020-07-16T15:56:25.347695+0000 mgr.x (mgr.34562) 6627 : cluster [DBG] pgmap v4132: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:56:27.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:27 smithi188 bash[23329]: cluster 2020-07-16T15:56:25.347695+0000 mgr.x (mgr.34562) 6627 : cluster [DBG] pgmap v4132: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:56:29.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:29 smithi132 bash[27079]: cluster 2020-07-16T15:56:27.348193+0000 mgr.x (mgr.34562) 6628 : cluster [DBG] pgmap v4133: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:56:29.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:29 smithi188 bash[23329]: cluster 2020-07-16T15:56:27.348193+0000 mgr.x (mgr.34562) 6628 : cluster [DBG] pgmap v4133: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:56:31.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:31 smithi132 bash[27079]: cluster 2020-07-16T15:56:29.348480+0000 mgr.x (mgr.34562) 6629 : cluster [DBG] pgmap v4134: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:56:31.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:31 smithi188 bash[23329]: cluster 2020-07-16T15:56:29.348480+0000 mgr.x (mgr.34562) 6629 : cluster [DBG] pgmap v4134: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:56:33.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:33 smithi132 bash[27079]: cluster 2020-07-16T15:56:31.348803+0000 mgr.x (mgr.34562) 6630 : cluster [DBG] pgmap v4135: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:56:33.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:33 smithi188 bash[23329]: cluster 2020-07-16T15:56:31.348803+0000 mgr.x (mgr.34562) 6630 : cluster [DBG] pgmap v4135: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:56:35.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:35 smithi132 bash[27079]: cluster 2020-07-16T15:56:33.349232+0000 mgr.x (mgr.34562) 6631 : cluster [DBG] pgmap v4136: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:56:35.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:35 smithi188 bash[23329]: cluster 2020-07-16T15:56:33.349232+0000 mgr.x (mgr.34562) 6631 : cluster [DBG] pgmap v4136: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:56:37.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:37 smithi132 bash[27079]: cluster 2020-07-16T15:56:35.349576+0000 mgr.x (mgr.34562) 6632 : cluster [DBG] pgmap v4137: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:56:37.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:37 smithi132 bash[27079]: audit 2020-07-16T15:56:36.423230+0000 mon.b (mon.2) 1433 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:56:37.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:37 smithi188 bash[23329]: cluster 2020-07-16T15:56:35.349576+0000 mgr.x (mgr.34562) 6632 : cluster [DBG] pgmap v4137: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:56:37.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:37 smithi188 bash[23329]: audit 2020-07-16T15:56:36.423230+0000 mon.b (mon.2) 1433 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:56:37.750 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:56:38.013 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:56:38.014 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 34s ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:56:38.014 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 34s ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:56:38.014 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 34s ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:56:38.014 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 34s ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:56:38.015 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 34s ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:56:38.015 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 34s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:56:38.015 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 34s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:56:38.015 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 34s ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:56:38.015 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 34s ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:56:38.016 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 34s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:56:38.016 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 34s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:56:38.016 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 34s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:56:38.016 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 34s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:56:38.016 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 34s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:56:38.017 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 34s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:56:38.017 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 34s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:56:38.017 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 34s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:56:38.017 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 34s ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:56:38.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:38 smithi132 bash[27079]: cephadm 2020-07-16T15:56:36.423939+0000 mgr.x (mgr.34562) 6633 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:56:38.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:38 smithi132 bash[27079]: cephadm 2020-07-16T15:56:36.424016+0000 mgr.x (mgr.34562) 6634 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:56:38.314 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:56:38.314 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:56:38.314 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:56:38.315 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:56:38.315 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:56:38.315 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:56:38.315 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:56:38.315 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:56:38.316 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:56:38.316 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:56:38.316 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:56:38.316 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:56:38.316 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:56:38.317 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:56:38.317 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:56:38.317 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:56:38.317 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:56:38.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:38 smithi188 bash[23329]: cephadm 2020-07-16T15:56:36.423939+0000 mgr.x (mgr.34562) 6633 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:56:38.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:38 smithi188 bash[23329]: cephadm 2020-07-16T15:56:36.424016+0000 mgr.x (mgr.34562) 6634 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:56:39.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:39 smithi132 bash[27079]: cluster 2020-07-16T15:56:37.350042+0000 mgr.x (mgr.34562) 6635 : cluster [DBG] pgmap v4138: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:56:39.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:39 smithi132 bash[27079]: audit 2020-07-16T15:56:37.739731+0000 mgr.x (mgr.34562) 6636 : audit [DBG] from='client.29464 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:56:39.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:39 smithi132 bash[27079]: audit 2020-07-16T15:56:38.009734+0000 mgr.x (mgr.34562) 6637 : audit [DBG] from='client.29470 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:56:39.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:39 smithi132 bash[27079]: audit 2020-07-16T15:56:38.313625+0000 mon.c (mon.1) 452 : audit [DBG] from='client.? 172.21.15.132:0/2775215132' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:56:39.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:39 smithi188 bash[23329]: cluster 2020-07-16T15:56:37.350042+0000 mgr.x (mgr.34562) 6635 : cluster [DBG] pgmap v4138: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:56:39.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:39 smithi188 bash[23329]: audit 2020-07-16T15:56:37.739731+0000 mgr.x (mgr.34562) 6636 : audit [DBG] from='client.29464 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:56:39.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:39 smithi188 bash[23329]: audit 2020-07-16T15:56:38.009734+0000 mgr.x (mgr.34562) 6637 : audit [DBG] from='client.29470 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:56:39.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:39 smithi188 bash[23329]: audit 2020-07-16T15:56:38.313625+0000 mon.c (mon.1) 452 : audit [DBG] from='client.? 172.21.15.132:0/2775215132' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:56:41.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:41 smithi188 bash[23329]: cluster 2020-07-16T15:56:39.350589+0000 mgr.x (mgr.34562) 6638 : cluster [DBG] pgmap v4139: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:56:41.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:41 smithi132 bash[27079]: cluster 2020-07-16T15:56:39.350589+0000 mgr.x (mgr.34562) 6638 : cluster [DBG] pgmap v4139: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:56:43.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:43 smithi188 bash[23329]: cluster 2020-07-16T15:56:41.350934+0000 mgr.x (mgr.34562) 6639 : cluster [DBG] pgmap v4140: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:56:43.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:43 smithi132 bash[27079]: cluster 2020-07-16T15:56:41.350934+0000 mgr.x (mgr.34562) 6639 : cluster [DBG] pgmap v4140: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:56:45.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:45 smithi188 bash[23329]: cluster 2020-07-16T15:56:43.351431+0000 mgr.x (mgr.34562) 6640 : cluster [DBG] pgmap v4141: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:56:45.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:45 smithi132 bash[27079]: cluster 2020-07-16T15:56:43.351431+0000 mgr.x (mgr.34562) 6640 : cluster [DBG] pgmap v4141: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:56:47.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:47 smithi188 bash[23329]: cluster 2020-07-16T15:56:45.351932+0000 mgr.x (mgr.34562) 6641 : cluster [DBG] pgmap v4142: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:56:47.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:47 smithi132 bash[27079]: cluster 2020-07-16T15:56:45.351932+0000 mgr.x (mgr.34562) 6641 : cluster [DBG] pgmap v4142: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:56:49.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:49 smithi188 bash[23329]: cluster 2020-07-16T15:56:47.352382+0000 mgr.x (mgr.34562) 6642 : cluster [DBG] pgmap v4143: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:56:49.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:49 smithi132 bash[27079]: cluster 2020-07-16T15:56:47.352382+0000 mgr.x (mgr.34562) 6642 : cluster [DBG] pgmap v4143: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:56:51.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:51 smithi188 bash[23329]: cluster 2020-07-16T15:56:49.352798+0000 mgr.x (mgr.34562) 6643 : cluster [DBG] pgmap v4144: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:56:51.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:51 smithi132 bash[27079]: cluster 2020-07-16T15:56:49.352798+0000 mgr.x (mgr.34562) 6643 : cluster [DBG] pgmap v4144: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:56:52.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:52 smithi188 bash[23329]: audit 2020-07-16T15:56:51.428729+0000 mon.b (mon.2) 1434 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:56:52.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:52 smithi132 bash[27079]: audit 2020-07-16T15:56:51.428729+0000 mon.b (mon.2) 1434 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:56:53.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:53 smithi188 bash[23329]: cluster 2020-07-16T15:56:51.353130+0000 mgr.x (mgr.34562) 6644 : cluster [DBG] pgmap v4145: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:56:53.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:53 smithi188 bash[23329]: cephadm 2020-07-16T15:56:51.429409+0000 mgr.x (mgr.34562) 6645 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:56:53.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:53 smithi188 bash[23329]: cephadm 2020-07-16T15:56:51.429480+0000 mgr.x (mgr.34562) 6646 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:56:53.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:53 smithi132 bash[27079]: cluster 2020-07-16T15:56:51.353130+0000 mgr.x (mgr.34562) 6644 : cluster [DBG] pgmap v4145: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:56:53.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:53 smithi132 bash[27079]: cephadm 2020-07-16T15:56:51.429409+0000 mgr.x (mgr.34562) 6645 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:56:53.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:53 smithi132 bash[27079]: cephadm 2020-07-16T15:56:51.429480+0000 mgr.x (mgr.34562) 6646 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:56:55.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:55 smithi188 bash[23329]: cluster 2020-07-16T15:56:53.353550+0000 mgr.x (mgr.34562) 6647 : cluster [DBG] pgmap v4146: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:56:55.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:55 smithi132 bash[27079]: cluster 2020-07-16T15:56:53.353550+0000 mgr.x (mgr.34562) 6647 : cluster [DBG] pgmap v4146: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:56:57.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:57 smithi188 bash[23329]: cluster 2020-07-16T15:56:55.354005+0000 mgr.x (mgr.34562) 6648 : cluster [DBG] pgmap v4147: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:56:57.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:57 smithi132 bash[27079]: cluster 2020-07-16T15:56:55.354005+0000 mgr.x (mgr.34562) 6648 : cluster [DBG] pgmap v4147: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:56:59.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:56:59 smithi188 bash[23329]: cluster 2020-07-16T15:56:57.354413+0000 mgr.x (mgr.34562) 6649 : cluster [DBG] pgmap v4148: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:56:59.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:56:59 smithi132 bash[27079]: cluster 2020-07-16T15:56:57.354413+0000 mgr.x (mgr.34562) 6649 : cluster [DBG] pgmap v4148: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:57:01.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:57:01 smithi188 bash[23329]: cluster 2020-07-16T15:56:59.354783+0000 mgr.x (mgr.34562) 6650 : cluster [DBG] pgmap v4149: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:57:01.536 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:57:01 smithi132 bash[27079]: cluster 2020-07-16T15:56:59.354783+0000 mgr.x (mgr.34562) 6650 : cluster [DBG] pgmap v4149: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:57:03.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:57:03 smithi188 bash[23329]: cluster 2020-07-16T15:57:01.355253+0000 mgr.x (mgr.34562) 6651 : cluster [DBG] pgmap v4150: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:57:03.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:57:03 smithi132 bash[27079]: cluster 2020-07-16T15:57:01.355253+0000 mgr.x (mgr.34562) 6651 : cluster [DBG] pgmap v4150: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:57:05.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:57:05 smithi188 bash[23329]: cluster 2020-07-16T15:57:03.355851+0000 mgr.x (mgr.34562) 6652 : cluster [DBG] pgmap v4151: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:57:05.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:57:05 smithi132 bash[27079]: cluster 2020-07-16T15:57:03.355851+0000 mgr.x (mgr.34562) 6652 : cluster [DBG] pgmap v4151: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:57:07.227 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:57:07 smithi132 bash[27079]: cluster 2020-07-16T15:57:05.356239+0000 mgr.x (mgr.34562) 6653 : cluster [DBG] pgmap v4152: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:57:07.228 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:57:07 smithi132 bash[27079]: audit 2020-07-16T15:57:06.447780+0000 mon.b (mon.2) 1435 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:57:07.228 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:57:07 smithi132 bash[27079]: audit 2020-07-16T15:57:06.449416+0000 mon.b (mon.2) 1436 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:57:07.228 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:57:07 smithi132 bash[27079]: audit 2020-07-16T15:57:06.450582+0000 mon.b (mon.2) 1437 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:57:07.228 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:57:07 smithi132 bash[27079]: audit 2020-07-16T15:57:06.451859+0000 mon.b (mon.2) 1438 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:57:07.228 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:57:07 smithi132 bash[27079]: audit 2020-07-16T15:57:06.453129+0000 mon.b (mon.2) 1439 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:57:07.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:57:07 smithi188 bash[23329]: cluster 2020-07-16T15:57:05.356239+0000 mgr.x (mgr.34562) 6653 : cluster [DBG] pgmap v4152: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:57:07.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:57:07 smithi188 bash[23329]: audit 2020-07-16T15:57:06.447780+0000 mon.b (mon.2) 1435 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:57:07.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:57:07 smithi188 bash[23329]: audit 2020-07-16T15:57:06.449416+0000 mon.b (mon.2) 1436 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:57:07.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:57:07 smithi188 bash[23329]: audit 2020-07-16T15:57:06.450582+0000 mon.b (mon.2) 1437 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:57:07.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:57:07 smithi188 bash[23329]: audit 2020-07-16T15:57:06.451859+0000 mon.b (mon.2) 1438 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:57:07.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:57:07 smithi188 bash[23329]: audit 2020-07-16T15:57:06.453129+0000 mon.b (mon.2) 1439 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:57:08.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:57:08 smithi132 bash[27079]: audit 2020-07-16T15:57:06.448190+0000 mgr.x (mgr.34562) 6654 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:57:08.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:57:08 smithi132 bash[27079]: audit 2020-07-16T15:57:06.449755+0000 mgr.x (mgr.34562) 6655 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:57:08.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:57:08 smithi132 bash[27079]: audit 2020-07-16T15:57:06.450851+0000 mgr.x (mgr.34562) 6656 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:57:08.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:57:08 smithi132 bash[27079]: cephadm 2020-07-16T15:57:06.451518+0000 mgr.x (mgr.34562) 6657 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:57:08.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:57:08 smithi132 bash[27079]: cephadm 2020-07-16T15:57:06.452756+0000 mgr.x (mgr.34562) 6658 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:57:08.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:57:08 smithi132 bash[27079]: cephadm 2020-07-16T15:57:06.453860+0000 mgr.x (mgr.34562) 6659 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:57:08.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:57:08 smithi132 bash[27079]: cephadm 2020-07-16T15:57:06.454081+0000 mgr.x (mgr.34562) 6660 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:57:08.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:57:08 smithi188 bash[23329]: audit 2020-07-16T15:57:06.448190+0000 mgr.x (mgr.34562) 6654 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:57:08.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:57:08 smithi188 bash[23329]: audit 2020-07-16T15:57:06.449755+0000 mgr.x (mgr.34562) 6655 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:57:08.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:57:08 smithi188 bash[23329]: audit 2020-07-16T15:57:06.450851+0000 mgr.x (mgr.34562) 6656 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:57:08.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:57:08 smithi188 bash[23329]: cephadm 2020-07-16T15:57:06.451518+0000 mgr.x (mgr.34562) 6657 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:57:08.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:57:08 smithi188 bash[23329]: cephadm 2020-07-16T15:57:06.452756+0000 mgr.x (mgr.34562) 6658 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:57:08.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:57:08 smithi188 bash[23329]: cephadm 2020-07-16T15:57:06.453860+0000 mgr.x (mgr.34562) 6659 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:57:08.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:57:08 smithi188 bash[23329]: cephadm 2020-07-16T15:57:06.454081+0000 mgr.x (mgr.34562) 6660 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:57:08.627 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:57:09.020 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:57:09.020 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 65s ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:57:09.020 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 65s ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:57:09.021 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 65s ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:57:09.021 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 65s ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:57:09.021 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 65s ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:57:09.021 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 65s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:57:09.022 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 65s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:57:09.022 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 65s ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:57:09.022 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 65s ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:57:09.022 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 65s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:57:09.022 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 65s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:57:09.023 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 65s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:57:09.023 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 65s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:57:09.023 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 65s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:57:09.023 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 65s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:57:09.024 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 65s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:57:09.024 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 65s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:57:09.024 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 65s ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:57:09.232 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:57:09.233 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:57:09.233 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:57:09.233 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:57:09.233 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:57:09.233 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:57:09.234 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:57:09.234 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:57:09.234 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:57:09.234 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:57:09.234 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:57:09.235 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:57:09.235 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:57:09.235 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:57:09.235 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:57:09.235 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:57:09.235 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:57:09.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:57:09 smithi188 bash[23329]: cluster 2020-07-16T15:57:07.356656+0000 mgr.x (mgr.34562) 6661 : cluster [DBG] pgmap v4153: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:57:09.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:57:09 smithi132 bash[27079]: cluster 2020-07-16T15:57:07.356656+0000 mgr.x (mgr.34562) 6661 : cluster [DBG] pgmap v4153: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:57:10.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:57:10 smithi188 bash[23329]: audit 2020-07-16T15:57:08.616231+0000 mgr.x (mgr.34562) 6662 : audit [DBG] from='client.29482 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:57:10.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:57:10 smithi188 bash[23329]: audit 2020-07-16T15:57:08.917353+0000 mgr.x (mgr.34562) 6663 : audit [DBG] from='client.29488 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:57:10.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:57:10 smithi188 bash[23329]: audit 2020-07-16T15:57:09.231808+0000 mon.c (mon.1) 453 : audit [DBG] from='client.? 172.21.15.132:0/1033888419' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:57:10.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:57:10 smithi188 bash[23329]: audit 2020-07-16T15:57:09.291118+0000 mon.b (mon.2) 1440 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:57:10.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:57:10 smithi188 bash[23329]: cephadm 2020-07-16T15:57:09.291724+0000 mgr.x (mgr.34562) 6664 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:57:10.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:57:10 smithi188 bash[23329]: cephadm 2020-07-16T15:57:09.292127+0000 mgr.x (mgr.34562) 6665 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:57:10.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:57:10 smithi132 bash[27079]: audit 2020-07-16T15:57:08.616231+0000 mgr.x (mgr.34562) 6662 : audit [DBG] from='client.29482 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:57:10.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:57:10 smithi132 bash[27079]: audit 2020-07-16T15:57:08.917353+0000 mgr.x (mgr.34562) 6663 : audit [DBG] from='client.29488 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:57:10.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:57:10 smithi132 bash[27079]: audit 2020-07-16T15:57:09.231808+0000 mon.c (mon.1) 453 : audit [DBG] from='client.? 172.21.15.132:0/1033888419' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:57:10.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:57:10 smithi132 bash[27079]: audit 2020-07-16T15:57:09.291118+0000 mon.b (mon.2) 1440 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:57:10.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:57:10 smithi132 bash[27079]: cephadm 2020-07-16T15:57:09.291724+0000 mgr.x (mgr.34562) 6664 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:57:10.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:57:10 smithi132 bash[27079]: cephadm 2020-07-16T15:57:09.292127+0000 mgr.x (mgr.34562) 6665 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:57:11.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:57:11 smithi188 bash[23329]: cluster 2020-07-16T15:57:09.357137+0000 mgr.x (mgr.34562) 6666 : cluster [DBG] pgmap v4154: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:57:11.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:57:11 smithi132 bash[27079]: cluster 2020-07-16T15:57:09.357137+0000 mgr.x (mgr.34562) 6666 : cluster [DBG] pgmap v4154: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:57:13.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:57:13 smithi188 bash[23329]: cluster 2020-07-16T15:57:11.357536+0000 mgr.x (mgr.34562) 6667 : cluster [DBG] pgmap v4155: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:57:13.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:57:13 smithi132 bash[27079]: cluster 2020-07-16T15:57:11.357536+0000 mgr.x (mgr.34562) 6667 : cluster [DBG] pgmap v4155: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:57:15.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:57:15 smithi188 bash[23329]: cluster 2020-07-16T15:57:13.357963+0000 mgr.x (mgr.34562) 6668 : cluster [DBG] pgmap v4156: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:57:15.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:57:15 smithi132 bash[27079]: cluster 2020-07-16T15:57:13.357963+0000 mgr.x (mgr.34562) 6668 : cluster [DBG] pgmap v4156: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:57:17.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:57:17 smithi188 bash[23329]: cluster 2020-07-16T15:57:15.358404+0000 mgr.x (mgr.34562) 6669 : cluster [DBG] pgmap v4157: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:57:17.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:57:17 smithi132 bash[27079]: cluster 2020-07-16T15:57:15.358404+0000 mgr.x (mgr.34562) 6669 : cluster [DBG] pgmap v4157: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:57:19.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:57:19 smithi188 bash[23329]: cluster 2020-07-16T15:57:17.358922+0000 mgr.x (mgr.34562) 6670 : cluster [DBG] pgmap v4158: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:57:19.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:57:19 smithi132 bash[27079]: cluster 2020-07-16T15:57:17.358922+0000 mgr.x (mgr.34562) 6670 : cluster [DBG] pgmap v4158: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:57:21.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:57:21 smithi188 bash[23329]: cluster 2020-07-16T15:57:19.359449+0000 mgr.x (mgr.34562) 6671 : cluster [DBG] pgmap v4159: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:57:21.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:57:21 smithi132 bash[27079]: cluster 2020-07-16T15:57:19.359449+0000 mgr.x (mgr.34562) 6671 : cluster [DBG] pgmap v4159: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:57:23.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:57:23 smithi188 bash[23329]: cluster 2020-07-16T15:57:21.359832+0000 mgr.x (mgr.34562) 6672 : cluster [DBG] pgmap v4160: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:57:23.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:57:23 smithi132 bash[27079]: cluster 2020-07-16T15:57:21.359832+0000 mgr.x (mgr.34562) 6672 : cluster [DBG] pgmap v4160: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:57:25.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:57:25 smithi188 bash[23329]: cluster 2020-07-16T15:57:23.360276+0000 mgr.x (mgr.34562) 6673 : cluster [DBG] pgmap v4161: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:57:25.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:57:25 smithi188 bash[23329]: audit 2020-07-16T15:57:24.294365+0000 mon.b (mon.2) 1441 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:57:25.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:57:25 smithi188 bash[23329]: cephadm 2020-07-16T15:57:24.295087+0000 mgr.x (mgr.34562) 6674 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:57:25.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:57:25 smithi188 bash[23329]: cephadm 2020-07-16T15:57:24.295235+0000 mgr.x (mgr.34562) 6675 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:57:25.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:57:25 smithi132 bash[27079]: cluster 2020-07-16T15:57:23.360276+0000 mgr.x (mgr.34562) 6673 : cluster [DBG] pgmap v4161: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:57:25.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:57:25 smithi132 bash[27079]: audit 2020-07-16T15:57:24.294365+0000 mon.b (mon.2) 1441 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:57:25.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:57:25 smithi132 bash[27079]: cephadm 2020-07-16T15:57:24.295087+0000 mgr.x (mgr.34562) 6674 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:57:25.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:57:25 smithi132 bash[27079]: cephadm 2020-07-16T15:57:24.295235+0000 mgr.x (mgr.34562) 6675 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:57:27.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:57:27 smithi188 bash[23329]: cluster 2020-07-16T15:57:25.360674+0000 mgr.x (mgr.34562) 6676 : cluster [DBG] pgmap v4162: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:57:27.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:57:27 smithi132 bash[27079]: cluster 2020-07-16T15:57:25.360674+0000 mgr.x (mgr.34562) 6676 : cluster [DBG] pgmap v4162: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:57:29.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:57:29 smithi188 bash[23329]: cluster 2020-07-16T15:57:27.361083+0000 mgr.x (mgr.34562) 6677 : cluster [DBG] pgmap v4163: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:57:29.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:57:29 smithi132 bash[27079]: cluster 2020-07-16T15:57:27.361083+0000 mgr.x (mgr.34562) 6677 : cluster [DBG] pgmap v4163: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:57:31.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:57:31 smithi188 bash[23329]: cluster 2020-07-16T15:57:29.361586+0000 mgr.x (mgr.34562) 6678 : cluster [DBG] pgmap v4164: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:57:31.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:57:31 smithi132 bash[27079]: cluster 2020-07-16T15:57:29.361586+0000 mgr.x (mgr.34562) 6678 : cluster [DBG] pgmap v4164: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:57:33.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:57:33 smithi188 bash[23329]: cluster 2020-07-16T15:57:31.361924+0000 mgr.x (mgr.34562) 6679 : cluster [DBG] pgmap v4165: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:57:33.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:57:33 smithi132 bash[27079]: cluster 2020-07-16T15:57:31.361924+0000 mgr.x (mgr.34562) 6679 : cluster [DBG] pgmap v4165: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:57:35.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:57:35 smithi188 bash[23329]: cluster 2020-07-16T15:57:33.362470+0000 mgr.x (mgr.34562) 6680 : cluster [DBG] pgmap v4166: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:57:35.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:57:35 smithi132 bash[27079]: cluster 2020-07-16T15:57:33.362470+0000 mgr.x (mgr.34562) 6680 : cluster [DBG] pgmap v4166: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:57:37.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:57:37 smithi188 bash[23329]: cluster 2020-07-16T15:57:35.363003+0000 mgr.x (mgr.34562) 6681 : cluster [DBG] pgmap v4167: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:57:37.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:57:37 smithi132 bash[27079]: cluster 2020-07-16T15:57:35.363003+0000 mgr.x (mgr.34562) 6681 : cluster [DBG] pgmap v4167: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:57:39.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:57:39 smithi188 bash[23329]: cluster 2020-07-16T15:57:37.363505+0000 mgr.x (mgr.34562) 6682 : cluster [DBG] pgmap v4168: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:57:39.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:57:39 smithi132 bash[27079]: cluster 2020-07-16T15:57:37.363505+0000 mgr.x (mgr.34562) 6682 : cluster [DBG] pgmap v4168: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:57:39.529 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:57:39.803 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:57:39.803 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 96s ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:57:39.804 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 96s ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:57:39.804 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 96s ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:57:39.804 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 96s ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:57:39.804 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 96s ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:57:39.804 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 96s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:57:39.805 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 96s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:57:39.805 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 96s ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:57:39.805 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 96s ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:57:39.805 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 96s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:57:39.805 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 96s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:57:39.806 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 96s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:57:39.806 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 96s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:57:39.806 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 96s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:57:39.806 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 96s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:57:39.806 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 96s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:57:39.807 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 96s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:57:39.807 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 96s ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:57:40.106 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:57:40.107 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:57:40.107 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:57:40.107 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:57:40.107 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:57:40.108 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:57:40.108 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:57:40.108 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:57:40.108 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:57:40.108 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:57:40.108 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:57:40.109 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:57:40.109 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:57:40.109 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:57:40.109 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:57:40.109 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:57:40.110 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:57:40.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:57:40 smithi188 bash[23329]: audit 2020-07-16T15:57:39.311080+0000 mon.b (mon.2) 1442 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:57:40.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:57:40 smithi188 bash[23329]: audit 2020-07-16T15:57:40.105970+0000 mon.c (mon.1) 454 : audit [DBG] from='client.? 172.21.15.132:0/2228118992' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:57:40.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:57:40 smithi132 bash[27079]: audit 2020-07-16T15:57:39.311080+0000 mon.b (mon.2) 1442 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:57:40.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:57:40 smithi132 bash[27079]: audit 2020-07-16T15:57:40.105970+0000 mon.c (mon.1) 454 : audit [DBG] from='client.? 172.21.15.132:0/2228118992' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:57:41.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:57:41 smithi188 bash[23329]: cephadm 2020-07-16T15:57:39.311803+0000 mgr.x (mgr.34562) 6683 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:57:41.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:57:41 smithi188 bash[23329]: cephadm 2020-07-16T15:57:39.311897+0000 mgr.x (mgr.34562) 6684 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:57:41.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:57:41 smithi188 bash[23329]: cluster 2020-07-16T15:57:39.363835+0000 mgr.x (mgr.34562) 6685 : cluster [DBG] pgmap v4169: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:57:41.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:57:41 smithi188 bash[23329]: audit 2020-07-16T15:57:39.517687+0000 mgr.x (mgr.34562) 6686 : audit [DBG] from='client.29500 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:57:41.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:57:41 smithi188 bash[23329]: audit 2020-07-16T15:57:39.799241+0000 mgr.x (mgr.34562) 6687 : audit [DBG] from='client.29506 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:57:41.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:57:41 smithi132 bash[27079]: cephadm 2020-07-16T15:57:39.311803+0000 mgr.x (mgr.34562) 6683 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:57:41.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:57:41 smithi132 bash[27079]: cephadm 2020-07-16T15:57:39.311897+0000 mgr.x (mgr.34562) 6684 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:57:41.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:57:41 smithi132 bash[27079]: cluster 2020-07-16T15:57:39.363835+0000 mgr.x (mgr.34562) 6685 : cluster [DBG] pgmap v4169: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:57:41.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:57:41 smithi132 bash[27079]: audit 2020-07-16T15:57:39.517687+0000 mgr.x (mgr.34562) 6686 : audit [DBG] from='client.29500 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:57:41.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:57:41 smithi132 bash[27079]: audit 2020-07-16T15:57:39.799241+0000 mgr.x (mgr.34562) 6687 : audit [DBG] from='client.29506 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:57:43.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:57:43 smithi188 bash[23329]: cluster 2020-07-16T15:57:41.364188+0000 mgr.x (mgr.34562) 6688 : cluster [DBG] pgmap v4170: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:57:43.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:57:43 smithi132 bash[27079]: cluster 2020-07-16T15:57:41.364188+0000 mgr.x (mgr.34562) 6688 : cluster [DBG] pgmap v4170: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:57:45.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:57:45 smithi132 bash[27079]: cluster 2020-07-16T15:57:43.364579+0000 mgr.x (mgr.34562) 6689 : cluster [DBG] pgmap v4171: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:57:45.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:57:45 smithi188 bash[23329]: cluster 2020-07-16T15:57:43.364579+0000 mgr.x (mgr.34562) 6689 : cluster [DBG] pgmap v4171: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:57:47.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:57:47 smithi132 bash[27079]: cluster 2020-07-16T15:57:45.364928+0000 mgr.x (mgr.34562) 6690 : cluster [DBG] pgmap v4172: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:57:47.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:57:47 smithi188 bash[23329]: cluster 2020-07-16T15:57:45.364928+0000 mgr.x (mgr.34562) 6690 : cluster [DBG] pgmap v4172: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:57:49.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:57:49 smithi132 bash[27079]: cluster 2020-07-16T15:57:47.365372+0000 mgr.x (mgr.34562) 6691 : cluster [DBG] pgmap v4173: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:57:49.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:57:49 smithi188 bash[23329]: cluster 2020-07-16T15:57:47.365372+0000 mgr.x (mgr.34562) 6691 : cluster [DBG] pgmap v4173: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:57:51.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:57:51 smithi132 bash[27079]: cluster 2020-07-16T15:57:49.365772+0000 mgr.x (mgr.34562) 6692 : cluster [DBG] pgmap v4174: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:57:51.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:57:51 smithi188 bash[23329]: cluster 2020-07-16T15:57:49.365772+0000 mgr.x (mgr.34562) 6692 : cluster [DBG] pgmap v4174: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:57:53.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:57:53 smithi132 bash[27079]: cluster 2020-07-16T15:57:51.366148+0000 mgr.x (mgr.34562) 6693 : cluster [DBG] pgmap v4175: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:57:53.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:57:53 smithi188 bash[23329]: cluster 2020-07-16T15:57:51.366148+0000 mgr.x (mgr.34562) 6693 : cluster [DBG] pgmap v4175: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:57:55.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:57:55 smithi132 bash[27079]: cluster 2020-07-16T15:57:53.366602+0000 mgr.x (mgr.34562) 6694 : cluster [DBG] pgmap v4176: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:57:55.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:57:55 smithi132 bash[27079]: audit 2020-07-16T15:57:54.321610+0000 mon.b (mon.2) 1443 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:57:55.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:57:55 smithi188 bash[23329]: cluster 2020-07-16T15:57:53.366602+0000 mgr.x (mgr.34562) 6694 : cluster [DBG] pgmap v4176: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:57:55.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:57:55 smithi188 bash[23329]: audit 2020-07-16T15:57:54.321610+0000 mon.b (mon.2) 1443 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:57:56.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:57:56 smithi132 bash[27079]: cephadm 2020-07-16T15:57:54.322295+0000 mgr.x (mgr.34562) 6695 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:57:56.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:57:56 smithi132 bash[27079]: cephadm 2020-07-16T15:57:54.322375+0000 mgr.x (mgr.34562) 6696 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:57:56.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:57:56 smithi188 bash[23329]: cephadm 2020-07-16T15:57:54.322295+0000 mgr.x (mgr.34562) 6695 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:57:56.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:57:56 smithi188 bash[23329]: cephadm 2020-07-16T15:57:54.322375+0000 mgr.x (mgr.34562) 6696 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:57:57.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:57:57 smithi132 bash[27079]: cluster 2020-07-16T15:57:55.367074+0000 mgr.x (mgr.34562) 6697 : cluster [DBG] pgmap v4177: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:57:57.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:57:57 smithi188 bash[23329]: cluster 2020-07-16T15:57:55.367074+0000 mgr.x (mgr.34562) 6697 : cluster [DBG] pgmap v4177: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:57:59.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:57:59 smithi132 bash[27079]: cluster 2020-07-16T15:57:57.367503+0000 mgr.x (mgr.34562) 6698 : cluster [DBG] pgmap v4178: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:57:59.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:57:59 smithi188 bash[23329]: cluster 2020-07-16T15:57:57.367503+0000 mgr.x (mgr.34562) 6698 : cluster [DBG] pgmap v4178: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:58:01.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:01 smithi132 bash[27079]: cluster 2020-07-16T15:57:59.367997+0000 mgr.x (mgr.34562) 6699 : cluster [DBG] pgmap v4179: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:58:01.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:01 smithi188 bash[23329]: cluster 2020-07-16T15:57:59.367997+0000 mgr.x (mgr.34562) 6699 : cluster [DBG] pgmap v4179: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:58:03.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:03 smithi132 bash[27079]: cluster 2020-07-16T15:58:01.368499+0000 mgr.x (mgr.34562) 6700 : cluster [DBG] pgmap v4180: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:58:03.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:03 smithi188 bash[23329]: cluster 2020-07-16T15:58:01.368499+0000 mgr.x (mgr.34562) 6700 : cluster [DBG] pgmap v4180: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:58:05.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:05 smithi132 bash[27079]: cluster 2020-07-16T15:58:03.368919+0000 mgr.x (mgr.34562) 6701 : cluster [DBG] pgmap v4181: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:58:05.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:05 smithi188 bash[23329]: cluster 2020-07-16T15:58:03.368919+0000 mgr.x (mgr.34562) 6701 : cluster [DBG] pgmap v4181: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:58:07.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:07 smithi132 bash[27079]: cluster 2020-07-16T15:58:05.369269+0000 mgr.x (mgr.34562) 6702 : cluster [DBG] pgmap v4182: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:58:07.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:07 smithi188 bash[23329]: cluster 2020-07-16T15:58:05.369269+0000 mgr.x (mgr.34562) 6702 : cluster [DBG] pgmap v4182: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:58:09.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:09 smithi132 bash[27079]: cluster 2020-07-16T15:58:07.369810+0000 mgr.x (mgr.34562) 6703 : cluster [DBG] pgmap v4183: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:58:09.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:09 smithi188 bash[23329]: cluster 2020-07-16T15:58:07.369810+0000 mgr.x (mgr.34562) 6703 : cluster [DBG] pgmap v4183: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:58:10.344 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:10 smithi132 bash[27079]: audit 2020-07-16T15:58:09.567573+0000 mon.b (mon.2) 1444 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:56:03.434893\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.434968\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435027\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435079\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435346\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435534\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435728\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435905\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435964\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:56:03.436077\", \"last_device_update\": \"2020-07-16T15:34:56.840832\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:58:09.566665\"}"}]: dispatch 2020-07-16T15:58:10.344 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:10 smithi132 bash[27079]: audit 2020-07-16T15:58:09.567959+0000 mon.b (mon.2) 1445 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.602998\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603070\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603100\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603259\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603389\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603492\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603606\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603639\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603667\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:56:03.603733\", \"last_device_update\": \"2020-07-16T15:36:02.606623\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:58:09.567322\"}"}]: dispatch 2020-07-16T15:58:10.344 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:10 smithi132 bash[27079]: audit 2020-07-16T15:58:09.568173+0000 mon.c (mon.1) 455 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:56:03.434893\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.434968\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435027\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435079\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435346\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435534\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435728\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435905\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435964\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:56:03.436077\", \"last_device_update\": \"2020-07-16T15:34:56.840832\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:58:09.566665\"}"}]: dispatch 2020-07-16T15:58:10.345 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:10 smithi132 bash[27079]: audit 2020-07-16T15:58:09.568819+0000 mon.c (mon.1) 456 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.602998\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603070\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603100\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603259\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603389\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603492\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603606\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603639\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603667\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:56:03.603733\", \"last_device_update\": \"2020-07-16T15:36:02.606623\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:58:09.567322\"}"}]: dispatch 2020-07-16T15:58:10.345 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:10 smithi132 bash[27079]: audit 2020-07-16T15:58:09.570852+0000 mon.c (mon.1) 457 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:56:03.434893\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.434968\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435027\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435079\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435346\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435534\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435728\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435905\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435964\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:56:03.436077\", \"last_device_update\": \"2020-07-16T15:34:56.840832\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:58:09.566665\"}"}]': finished 2020-07-16T15:58:10.345 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:10 smithi132 bash[27079]: audit 2020-07-16T15:58:09.573467+0000 mon.c (mon.1) 458 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.602998\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603070\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603100\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603259\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603389\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603492\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603606\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603639\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603667\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:56:03.603733\", \"last_device_update\": \"2020-07-16T15:36:02.606623\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:58:09.567322\"}"}]': finished 2020-07-16T15:58:10.346 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:10 smithi132 bash[27079]: audit 2020-07-16T15:58:09.575872+0000 mon.b (mon.2) 1446 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:58:10.346 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:10 smithi132 bash[27079]: audit 2020-07-16T15:58:09.576805+0000 mon.b (mon.2) 1447 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:58:10.346 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:10 smithi132 bash[27079]: audit 2020-07-16T15:58:09.577647+0000 mon.b (mon.2) 1448 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:58:10.346 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:10 smithi132 bash[27079]: audit 2020-07-16T15:58:09.578595+0000 mon.b (mon.2) 1449 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:58:10.347 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:10 smithi132 bash[27079]: audit 2020-07-16T15:58:09.579423+0000 mon.b (mon.2) 1450 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:58:10.426 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:58:10.572 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:10 smithi188 bash[23329]: audit 2020-07-16T15:58:09.567573+0000 mon.b (mon.2) 1444 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:56:03.434893\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.434968\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435027\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435079\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435346\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435534\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435728\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435905\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435964\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:56:03.436077\", \"last_device_update\": \"2020-07-16T15:34:56.840832\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:58:09.566665\"}"}]: dispatch 2020-07-16T15:58:10.573 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:10 smithi188 bash[23329]: audit 2020-07-16T15:58:09.567959+0000 mon.b (mon.2) 1445 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.602998\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603070\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603100\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603259\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603389\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603492\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603606\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603639\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603667\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:56:03.603733\", \"last_device_update\": \"2020-07-16T15:36:02.606623\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:58:09.567322\"}"}]: dispatch 2020-07-16T15:58:10.573 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:10 smithi188 bash[23329]: audit 2020-07-16T15:58:09.568173+0000 mon.c (mon.1) 455 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:56:03.434893\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.434968\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435027\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435079\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435346\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435534\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435728\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435905\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435964\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:56:03.436077\", \"last_device_update\": \"2020-07-16T15:34:56.840832\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:58:09.566665\"}"}]: dispatch 2020-07-16T15:58:10.574 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:10 smithi188 bash[23329]: audit 2020-07-16T15:58:09.568819+0000 mon.c (mon.1) 456 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.602998\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603070\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603100\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603259\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603389\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603492\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603606\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603639\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603667\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:56:03.603733\", \"last_device_update\": \"2020-07-16T15:36:02.606623\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:58:09.567322\"}"}]: dispatch 2020-07-16T15:58:10.574 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:10 smithi188 bash[23329]: audit 2020-07-16T15:58:09.570852+0000 mon.c (mon.1) 457 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:56:03.434893\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.434968\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435027\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435079\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435346\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435534\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435728\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435905\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435964\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:56:03.436077\", \"last_device_update\": \"2020-07-16T15:34:56.840832\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:58:09.566665\"}"}]': finished 2020-07-16T15:58:10.574 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:10 smithi188 bash[23329]: audit 2020-07-16T15:58:09.573467+0000 mon.c (mon.1) 458 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.602998\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603070\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603100\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603259\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603389\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603492\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603606\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603639\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.603667\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T15:56:03.603733\", \"last_device_update\": \"2020-07-16T15:36:02.606623\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:58:09.567322\"}"}]': finished 2020-07-16T15:58:10.575 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:10 smithi188 bash[23329]: audit 2020-07-16T15:58:09.575872+0000 mon.b (mon.2) 1446 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:58:10.575 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:10 smithi188 bash[23329]: audit 2020-07-16T15:58:09.576805+0000 mon.b (mon.2) 1447 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:58:10.575 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:10 smithi188 bash[23329]: audit 2020-07-16T15:58:09.577647+0000 mon.b (mon.2) 1448 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:58:10.575 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:10 smithi188 bash[23329]: audit 2020-07-16T15:58:09.578595+0000 mon.b (mon.2) 1449 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:58:10.575 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:10 smithi188 bash[23329]: audit 2020-07-16T15:58:09.579423+0000 mon.b (mon.2) 1450 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:58:10.699 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:58:10.700 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 2m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:58:10.700 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 2m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:58:10.700 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 2m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:58:10.700 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 2m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:58:10.701 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 2m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:58:10.701 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:58:10.701 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:58:10.702 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 2m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:58:10.702 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 2m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:58:10.702 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:58:10.703 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:58:10.703 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:58:10.703 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:58:10.703 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:58:10.704 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:58:10.704 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:58:10.704 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:58:10.705 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 2m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:58:11.009 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:58:11.010 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:58:11.010 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:58:11.010 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:58:11.010 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:58:11.011 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:58:11.011 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:58:11.011 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:58:11.011 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:58:11.011 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:58:11.012 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:58:11.013 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:58:11.013 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:58:11.014 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:58:11.014 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:58:11.014 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:58:11.014 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:58:11.286 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:11 smithi132 bash[27079]: cluster 2020-07-16T15:58:09.370193+0000 mgr.x (mgr.34562) 6704 : cluster [DBG] pgmap v4184: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:58:11.287 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:11 smithi132 bash[27079]: audit 2020-07-16T15:58:09.576172+0000 mgr.x (mgr.34562) 6705 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:58:11.287 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:11 smithi132 bash[27079]: audit 2020-07-16T15:58:09.577073+0000 mgr.x (mgr.34562) 6706 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:58:11.288 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:11 smithi132 bash[27079]: audit 2020-07-16T15:58:09.577851+0000 mgr.x (mgr.34562) 6707 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:58:11.288 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:11 smithi132 bash[27079]: cephadm 2020-07-16T15:58:09.578369+0000 mgr.x (mgr.34562) 6708 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:58:11.288 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:11 smithi132 bash[27079]: cephadm 2020-07-16T15:58:09.579198+0000 mgr.x (mgr.34562) 6709 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:58:11.289 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:11 smithi132 bash[27079]: cephadm 2020-07-16T15:58:09.579921+0000 mgr.x (mgr.34562) 6710 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:58:11.289 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:11 smithi132 bash[27079]: cephadm 2020-07-16T15:58:09.579971+0000 mgr.x (mgr.34562) 6711 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:58:11.289 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:11 smithi132 bash[27079]: audit 2020-07-16T15:58:11.008427+0000 mon.c (mon.1) 459 : audit [DBG] from='client.? 172.21.15.132:0/985244527' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:58:11.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:11 smithi188 bash[23329]: cluster 2020-07-16T15:58:09.370193+0000 mgr.x (mgr.34562) 6704 : cluster [DBG] pgmap v4184: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:58:11.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:11 smithi188 bash[23329]: audit 2020-07-16T15:58:09.576172+0000 mgr.x (mgr.34562) 6705 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:58:11.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:11 smithi188 bash[23329]: audit 2020-07-16T15:58:09.577073+0000 mgr.x (mgr.34562) 6706 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:58:11.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:11 smithi188 bash[23329]: audit 2020-07-16T15:58:09.577851+0000 mgr.x (mgr.34562) 6707 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:58:11.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:11 smithi188 bash[23329]: cephadm 2020-07-16T15:58:09.578369+0000 mgr.x (mgr.34562) 6708 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:58:11.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:11 smithi188 bash[23329]: cephadm 2020-07-16T15:58:09.579198+0000 mgr.x (mgr.34562) 6709 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:58:11.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:11 smithi188 bash[23329]: cephadm 2020-07-16T15:58:09.579921+0000 mgr.x (mgr.34562) 6710 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:58:11.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:11 smithi188 bash[23329]: cephadm 2020-07-16T15:58:09.579971+0000 mgr.x (mgr.34562) 6711 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:58:11.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:11 smithi188 bash[23329]: audit 2020-07-16T15:58:11.008427+0000 mon.c (mon.1) 459 : audit [DBG] from='client.? 172.21.15.132:0/985244527' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:58:12.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:12 smithi132 bash[27079]: audit 2020-07-16T15:58:10.414096+0000 mgr.x (mgr.34562) 6712 : audit [DBG] from='client.29518 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:58:12.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:12 smithi132 bash[27079]: audit 2020-07-16T15:58:10.695057+0000 mgr.x (mgr.34562) 6713 : audit [DBG] from='client.29524 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:58:12.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:12 smithi188 bash[23329]: audit 2020-07-16T15:58:10.414096+0000 mgr.x (mgr.34562) 6712 : audit [DBG] from='client.29518 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:58:12.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:12 smithi188 bash[23329]: audit 2020-07-16T15:58:10.695057+0000 mgr.x (mgr.34562) 6713 : audit [DBG] from='client.29524 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:58:13.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:13 smithi132 bash[27079]: cluster 2020-07-16T15:58:11.370698+0000 mgr.x (mgr.34562) 6714 : cluster [DBG] pgmap v4185: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:58:13.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:13 smithi132 bash[27079]: audit 2020-07-16T15:58:12.361413+0000 mon.b (mon.2) 1451 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:58:13.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:13 smithi188 bash[23329]: cluster 2020-07-16T15:58:11.370698+0000 mgr.x (mgr.34562) 6714 : cluster [DBG] pgmap v4185: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:58:13.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:13 smithi188 bash[23329]: audit 2020-07-16T15:58:12.361413+0000 mon.b (mon.2) 1451 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:58:14.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:14 smithi132 bash[27079]: cephadm 2020-07-16T15:58:12.362007+0000 mgr.x (mgr.34562) 6715 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:58:14.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:14 smithi132 bash[27079]: cephadm 2020-07-16T15:58:12.362221+0000 mgr.x (mgr.34562) 6716 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:58:14.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:14 smithi188 bash[23329]: cephadm 2020-07-16T15:58:12.362007+0000 mgr.x (mgr.34562) 6715 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:58:14.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:14 smithi188 bash[23329]: cephadm 2020-07-16T15:58:12.362221+0000 mgr.x (mgr.34562) 6716 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:58:15.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:15 smithi132 bash[27079]: cluster 2020-07-16T15:58:13.371116+0000 mgr.x (mgr.34562) 6717 : cluster [DBG] pgmap v4186: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:58:15.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:15 smithi188 bash[23329]: cluster 2020-07-16T15:58:13.371116+0000 mgr.x (mgr.34562) 6717 : cluster [DBG] pgmap v4186: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:58:17.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:17 smithi132 bash[27079]: cluster 2020-07-16T15:58:15.371491+0000 mgr.x (mgr.34562) 6718 : cluster [DBG] pgmap v4187: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:58:17.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:17 smithi188 bash[23329]: cluster 2020-07-16T15:58:15.371491+0000 mgr.x (mgr.34562) 6718 : cluster [DBG] pgmap v4187: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:58:19.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:19 smithi132 bash[27079]: cluster 2020-07-16T15:58:17.371932+0000 mgr.x (mgr.34562) 6719 : cluster [DBG] pgmap v4188: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:58:19.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:19 smithi188 bash[23329]: cluster 2020-07-16T15:58:17.371932+0000 mgr.x (mgr.34562) 6719 : cluster [DBG] pgmap v4188: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:58:21.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:21 smithi132 bash[27079]: cluster 2020-07-16T15:58:19.372322+0000 mgr.x (mgr.34562) 6720 : cluster [DBG] pgmap v4189: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:58:21.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:21 smithi188 bash[23329]: cluster 2020-07-16T15:58:19.372322+0000 mgr.x (mgr.34562) 6720 : cluster [DBG] pgmap v4189: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:58:23.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:23 smithi132 bash[27079]: cluster 2020-07-16T15:58:21.372799+0000 mgr.x (mgr.34562) 6721 : cluster [DBG] pgmap v4190: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:58:23.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:23 smithi188 bash[23329]: cluster 2020-07-16T15:58:21.372799+0000 mgr.x (mgr.34562) 6721 : cluster [DBG] pgmap v4190: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:58:25.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:25 smithi132 bash[27079]: cluster 2020-07-16T15:58:23.373191+0000 mgr.x (mgr.34562) 6722 : cluster [DBG] pgmap v4191: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:58:25.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:25 smithi188 bash[23329]: cluster 2020-07-16T15:58:23.373191+0000 mgr.x (mgr.34562) 6722 : cluster [DBG] pgmap v4191: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:58:27.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:27 smithi132 bash[27079]: cluster 2020-07-16T15:58:25.373685+0000 mgr.x (mgr.34562) 6723 : cluster [DBG] pgmap v4192: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:58:27.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:27 smithi188 bash[23329]: cluster 2020-07-16T15:58:25.373685+0000 mgr.x (mgr.34562) 6723 : cluster [DBG] pgmap v4192: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:58:28.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:28 smithi132 bash[27079]: audit 2020-07-16T15:58:27.377668+0000 mon.b (mon.2) 1452 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:58:28.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:28 smithi188 bash[23329]: audit 2020-07-16T15:58:27.377668+0000 mon.b (mon.2) 1452 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:58:29.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:29 smithi132 bash[27079]: cluster 2020-07-16T15:58:27.374227+0000 mgr.x (mgr.34562) 6724 : cluster [DBG] pgmap v4193: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:58:29.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:29 smithi132 bash[27079]: cephadm 2020-07-16T15:58:27.378374+0000 mgr.x (mgr.34562) 6725 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:58:29.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:29 smithi132 bash[27079]: cephadm 2020-07-16T15:58:27.378688+0000 mgr.x (mgr.34562) 6726 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:58:29.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:29 smithi188 bash[23329]: cluster 2020-07-16T15:58:27.374227+0000 mgr.x (mgr.34562) 6724 : cluster [DBG] pgmap v4193: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:58:29.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:29 smithi188 bash[23329]: cephadm 2020-07-16T15:58:27.378374+0000 mgr.x (mgr.34562) 6725 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:58:29.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:29 smithi188 bash[23329]: cephadm 2020-07-16T15:58:27.378688+0000 mgr.x (mgr.34562) 6726 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:58:31.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:31 smithi132 bash[27079]: cluster 2020-07-16T15:58:29.374694+0000 mgr.x (mgr.34562) 6727 : cluster [DBG] pgmap v4194: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:58:31.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:31 smithi188 bash[23329]: cluster 2020-07-16T15:58:29.374694+0000 mgr.x (mgr.34562) 6727 : cluster [DBG] pgmap v4194: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:58:33.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:33 smithi188 bash[23329]: cluster 2020-07-16T15:58:31.375197+0000 mgr.x (mgr.34562) 6728 : cluster [DBG] pgmap v4195: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:58:33.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:33 smithi132 bash[27079]: cluster 2020-07-16T15:58:31.375197+0000 mgr.x (mgr.34562) 6728 : cluster [DBG] pgmap v4195: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:58:35.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:35 smithi188 bash[23329]: cluster 2020-07-16T15:58:33.375827+0000 mgr.x (mgr.34562) 6729 : cluster [DBG] pgmap v4196: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:58:35.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:35 smithi132 bash[27079]: cluster 2020-07-16T15:58:33.375827+0000 mgr.x (mgr.34562) 6729 : cluster [DBG] pgmap v4196: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:58:37.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:37 smithi188 bash[23329]: cluster 2020-07-16T15:58:35.376280+0000 mgr.x (mgr.34562) 6730 : cluster [DBG] pgmap v4197: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:58:37.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:37 smithi132 bash[27079]: cluster 2020-07-16T15:58:35.376280+0000 mgr.x (mgr.34562) 6730 : cluster [DBG] pgmap v4197: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:58:39.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:39 smithi188 bash[23329]: cluster 2020-07-16T15:58:37.376785+0000 mgr.x (mgr.34562) 6731 : cluster [DBG] pgmap v4198: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:58:39.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:39 smithi132 bash[27079]: cluster 2020-07-16T15:58:37.376785+0000 mgr.x (mgr.34562) 6731 : cluster [DBG] pgmap v4198: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:58:41.308 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:58:41.570 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:58:41.570 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 2m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:58:41.570 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 2m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:58:41.570 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 2m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:58:41.571 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 2m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:58:41.571 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 2m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:58:41.571 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:58:41.571 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:58:41.571 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 2m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:58:41.572 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 2m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:58:41.572 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:58:41.572 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:58:41.572 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:58:41.572 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:58:41.573 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:58:41.573 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:58:41.573 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:58:41.573 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:58:41.573 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 2m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:58:41.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:41 smithi188 bash[23329]: cluster 2020-07-16T15:58:39.377256+0000 mgr.x (mgr.34562) 6732 : cluster [DBG] pgmap v4199: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:58:41.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:41 smithi132 bash[27079]: cluster 2020-07-16T15:58:39.377256+0000 mgr.x (mgr.34562) 6732 : cluster [DBG] pgmap v4199: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:58:41.872 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:58:41.872 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:58:41.872 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:58:41.872 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:58:41.873 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:58:41.873 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:58:41.873 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:58:41.873 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:58:41.874 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:58:41.874 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:58:41.874 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:58:41.874 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:58:41.874 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:58:41.875 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:58:41.875 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:58:41.875 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:58:41.875 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:58:42.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:42 smithi188 bash[23329]: audit 2020-07-16T15:58:41.296825+0000 mgr.x (mgr.34562) 6733 : audit [DBG] from='client.29536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:58:42.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:42 smithi188 bash[23329]: audit 2020-07-16T15:58:41.871282+0000 mon.c (mon.1) 460 : audit [DBG] from='client.? 172.21.15.132:0/3328172958' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:58:42.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:42 smithi132 bash[27079]: audit 2020-07-16T15:58:41.296825+0000 mgr.x (mgr.34562) 6733 : audit [DBG] from='client.29536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:58:42.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:42 smithi132 bash[27079]: audit 2020-07-16T15:58:41.871282+0000 mon.c (mon.1) 460 : audit [DBG] from='client.? 172.21.15.132:0/3328172958' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:58:43.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:43 smithi188 bash[23329]: cluster 2020-07-16T15:58:41.377655+0000 mgr.x (mgr.34562) 6734 : cluster [DBG] pgmap v4200: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:58:43.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:43 smithi188 bash[23329]: audit 2020-07-16T15:58:41.565314+0000 mgr.x (mgr.34562) 6735 : audit [DBG] from='client.29542 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:58:43.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:43 smithi188 bash[23329]: audit 2020-07-16T15:58:42.390973+0000 mon.b (mon.2) 1453 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:58:43.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:43 smithi132 bash[27079]: cluster 2020-07-16T15:58:41.377655+0000 mgr.x (mgr.34562) 6734 : cluster [DBG] pgmap v4200: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:58:43.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:43 smithi132 bash[27079]: audit 2020-07-16T15:58:41.565314+0000 mgr.x (mgr.34562) 6735 : audit [DBG] from='client.29542 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:58:43.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:43 smithi132 bash[27079]: audit 2020-07-16T15:58:42.390973+0000 mon.b (mon.2) 1453 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:58:44.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:44 smithi188 bash[23329]: cephadm 2020-07-16T15:58:42.391701+0000 mgr.x (mgr.34562) 6736 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:58:44.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:44 smithi188 bash[23329]: cephadm 2020-07-16T15:58:42.391782+0000 mgr.x (mgr.34562) 6737 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:58:44.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:44 smithi132 bash[27079]: cephadm 2020-07-16T15:58:42.391701+0000 mgr.x (mgr.34562) 6736 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:58:44.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:44 smithi132 bash[27079]: cephadm 2020-07-16T15:58:42.391782+0000 mgr.x (mgr.34562) 6737 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:58:45.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:45 smithi188 bash[23329]: cluster 2020-07-16T15:58:43.378074+0000 mgr.x (mgr.34562) 6738 : cluster [DBG] pgmap v4201: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:58:45.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:45 smithi132 bash[27079]: cluster 2020-07-16T15:58:43.378074+0000 mgr.x (mgr.34562) 6738 : cluster [DBG] pgmap v4201: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:58:47.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:47 smithi188 bash[23329]: cluster 2020-07-16T15:58:45.378589+0000 mgr.x (mgr.34562) 6739 : cluster [DBG] pgmap v4202: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:58:47.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:47 smithi132 bash[27079]: cluster 2020-07-16T15:58:45.378589+0000 mgr.x (mgr.34562) 6739 : cluster [DBG] pgmap v4202: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:58:49.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:49 smithi188 bash[23329]: cluster 2020-07-16T15:58:47.379017+0000 mgr.x (mgr.34562) 6740 : cluster [DBG] pgmap v4203: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:58:49.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:49 smithi132 bash[27079]: cluster 2020-07-16T15:58:47.379017+0000 mgr.x (mgr.34562) 6740 : cluster [DBG] pgmap v4203: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:58:50.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:50 smithi188 bash[23329]: cluster 2020-07-16T15:58:49.379543+0000 mgr.x (mgr.34562) 6741 : cluster [DBG] pgmap v4204: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:58:50.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:50 smithi132 bash[27079]: cluster 2020-07-16T15:58:49.379543+0000 mgr.x (mgr.34562) 6741 : cluster [DBG] pgmap v4204: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:58:53.176 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:52 smithi188 bash[23329]: cluster 2020-07-16T15:58:51.380062+0000 mgr.x (mgr.34562) 6742 : cluster [DBG] pgmap v4205: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:58:53.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:52 smithi132 bash[27079]: cluster 2020-07-16T15:58:51.380062+0000 mgr.x (mgr.34562) 6742 : cluster [DBG] pgmap v4205: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:58:55.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:54 smithi188 bash[23329]: cluster 2020-07-16T15:58:53.380557+0000 mgr.x (mgr.34562) 6743 : cluster [DBG] pgmap v4206: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:58:55.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:54 smithi132 bash[27079]: cluster 2020-07-16T15:58:53.380557+0000 mgr.x (mgr.34562) 6743 : cluster [DBG] pgmap v4206: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:58:57.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:56 smithi188 bash[23329]: cluster 2020-07-16T15:58:55.381062+0000 mgr.x (mgr.34562) 6744 : cluster [DBG] pgmap v4207: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:58:57.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:56 smithi132 bash[27079]: cluster 2020-07-16T15:58:55.381062+0000 mgr.x (mgr.34562) 6744 : cluster [DBG] pgmap v4207: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:58:58.174 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:57 smithi188 bash[23329]: audit 2020-07-16T15:58:57.407541+0000 mon.b (mon.2) 1454 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:58:58.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:57 smithi132 bash[27079]: audit 2020-07-16T15:58:57.407541+0000 mon.b (mon.2) 1454 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:58:59.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:58 smithi188 bash[23329]: cluster 2020-07-16T15:58:57.381520+0000 mgr.x (mgr.34562) 6745 : cluster [DBG] pgmap v4208: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:58:59.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:58 smithi188 bash[23329]: cephadm 2020-07-16T15:58:57.408266+0000 mgr.x (mgr.34562) 6746 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:58:59.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:58:58 smithi188 bash[23329]: cephadm 2020-07-16T15:58:57.408469+0000 mgr.x (mgr.34562) 6747 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:58:59.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:58 smithi132 bash[27079]: cluster 2020-07-16T15:58:57.381520+0000 mgr.x (mgr.34562) 6745 : cluster [DBG] pgmap v4208: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:58:59.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:58 smithi132 bash[27079]: cephadm 2020-07-16T15:58:57.408266+0000 mgr.x (mgr.34562) 6746 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:58:59.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:58:58 smithi132 bash[27079]: cephadm 2020-07-16T15:58:57.408469+0000 mgr.x (mgr.34562) 6747 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:59:01.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:59:00 smithi188 bash[23329]: cluster 2020-07-16T15:58:59.381869+0000 mgr.x (mgr.34562) 6748 : cluster [DBG] pgmap v4209: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:59:01.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:59:00 smithi132 bash[27079]: cluster 2020-07-16T15:58:59.381869+0000 mgr.x (mgr.34562) 6748 : cluster [DBG] pgmap v4209: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:59:03.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:59:02 smithi188 bash[23329]: cluster 2020-07-16T15:59:01.382334+0000 mgr.x (mgr.34562) 6749 : cluster [DBG] pgmap v4210: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:59:03.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:59:02 smithi132 bash[27079]: cluster 2020-07-16T15:59:01.382334+0000 mgr.x (mgr.34562) 6749 : cluster [DBG] pgmap v4210: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:59:05.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:59:04 smithi188 bash[23329]: cluster 2020-07-16T15:59:03.382823+0000 mgr.x (mgr.34562) 6750 : cluster [DBG] pgmap v4211: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:59:05.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:59:04 smithi132 bash[27079]: cluster 2020-07-16T15:59:03.382823+0000 mgr.x (mgr.34562) 6750 : cluster [DBG] pgmap v4211: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:59:07.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:59:06 smithi188 bash[23329]: cluster 2020-07-16T15:59:05.383329+0000 mgr.x (mgr.34562) 6751 : cluster [DBG] pgmap v4212: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:59:07.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:59:06 smithi132 bash[27079]: cluster 2020-07-16T15:59:05.383329+0000 mgr.x (mgr.34562) 6751 : cluster [DBG] pgmap v4212: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:59:09.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:59:08 smithi188 bash[23329]: cluster 2020-07-16T15:59:07.383786+0000 mgr.x (mgr.34562) 6752 : cluster [DBG] pgmap v4213: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:59:09.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:59:08 smithi132 bash[27079]: cluster 2020-07-16T15:59:07.383786+0000 mgr.x (mgr.34562) 6752 : cluster [DBG] pgmap v4213: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:59:11.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:59:10 smithi188 bash[23329]: cluster 2020-07-16T15:59:09.384130+0000 mgr.x (mgr.34562) 6753 : cluster [DBG] pgmap v4214: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:59:11.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:59:10 smithi132 bash[27079]: cluster 2020-07-16T15:59:09.384130+0000 mgr.x (mgr.34562) 6753 : cluster [DBG] pgmap v4214: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:59:12.169 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:59:12.429 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:59:12.429 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 3m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:59:12.430 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 3m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:59:12.430 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 3m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:59:12.430 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 3m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:59:12.430 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 3m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:59:12.430 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:59:12.431 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:59:12.431 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 3m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:59:12.431 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 3m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:59:12.431 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:59:12.431 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:59:12.432 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:59:12.432 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:59:12.432 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:59:12.432 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:59:12.432 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:59:12.433 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:59:12.433 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 3m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:59:12.744 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:59:12.744 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:59:12.745 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:59:12.745 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:59:12.745 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:59:12.745 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:59:12.746 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:59:12.746 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:59:12.746 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:59:12.746 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:59:12.747 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:59:12.747 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:59:12.747 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:59:12.747 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:59:12.748 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:59:12.748 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:59:12.748 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:59:13.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:59:12 smithi188 bash[23329]: cluster 2020-07-16T15:59:11.384649+0000 mgr.x (mgr.34562) 6754 : cluster [DBG] pgmap v4215: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:59:13.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:59:12 smithi188 bash[23329]: audit 2020-07-16T15:59:12.158337+0000 mgr.x (mgr.34562) 6755 : audit [DBG] from='client.29554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:59:13.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:59:12 smithi188 bash[23329]: audit 2020-07-16T15:59:12.412179+0000 mon.b (mon.2) 1455 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:59:13.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:59:12 smithi188 bash[23329]: audit 2020-07-16T15:59:12.413526+0000 mon.b (mon.2) 1456 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:59:13.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:59:12 smithi188 bash[23329]: audit 2020-07-16T15:59:12.414766+0000 mon.b (mon.2) 1457 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:59:13.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:59:12 smithi188 bash[23329]: audit 2020-07-16T15:59:12.416162+0000 mon.b (mon.2) 1458 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:59:13.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:59:12 smithi188 bash[23329]: audit 2020-07-16T15:59:12.417419+0000 mon.b (mon.2) 1459 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:59:13.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:59:12 smithi188 bash[23329]: audit 2020-07-16T15:59:12.743353+0000 mon.c (mon.1) 461 : audit [DBG] from='client.? 172.21.15.132:0/1433762241' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:59:13.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:59:12 smithi132 bash[27079]: cluster 2020-07-16T15:59:11.384649+0000 mgr.x (mgr.34562) 6754 : cluster [DBG] pgmap v4215: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:59:13.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:59:12 smithi132 bash[27079]: audit 2020-07-16T15:59:12.158337+0000 mgr.x (mgr.34562) 6755 : audit [DBG] from='client.29554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:59:13.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:59:12 smithi132 bash[27079]: audit 2020-07-16T15:59:12.412179+0000 mon.b (mon.2) 1455 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:59:13.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:59:12 smithi132 bash[27079]: audit 2020-07-16T15:59:12.413526+0000 mon.b (mon.2) 1456 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:59:13.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:59:12 smithi132 bash[27079]: audit 2020-07-16T15:59:12.414766+0000 mon.b (mon.2) 1457 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:59:13.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:59:12 smithi132 bash[27079]: audit 2020-07-16T15:59:12.416162+0000 mon.b (mon.2) 1458 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T15:59:13.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:59:12 smithi132 bash[27079]: audit 2020-07-16T15:59:12.417419+0000 mon.b (mon.2) 1459 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:59:13.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:59:12 smithi132 bash[27079]: audit 2020-07-16T15:59:12.743353+0000 mon.c (mon.1) 461 : audit [DBG] from='client.? 172.21.15.132:0/1433762241' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:59:14.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:59:13 smithi188 bash[23329]: audit 2020-07-16T15:59:12.412547+0000 mgr.x (mgr.34562) 6756 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:59:14.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:59:13 smithi188 bash[23329]: audit 2020-07-16T15:59:12.413812+0000 mgr.x (mgr.34562) 6757 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:59:14.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:59:13 smithi188 bash[23329]: audit 2020-07-16T15:59:12.415059+0000 mgr.x (mgr.34562) 6758 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:59:14.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:59:13 smithi188 bash[23329]: cephadm 2020-07-16T15:59:12.415828+0000 mgr.x (mgr.34562) 6759 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:59:14.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:59:13 smithi188 bash[23329]: cephadm 2020-07-16T15:59:12.417089+0000 mgr.x (mgr.34562) 6760 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:59:14.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:59:13 smithi188 bash[23329]: cephadm 2020-07-16T15:59:12.418190+0000 mgr.x (mgr.34562) 6761 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:59:14.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:59:13 smithi188 bash[23329]: cephadm 2020-07-16T15:59:12.418280+0000 mgr.x (mgr.34562) 6762 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:59:14.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:59:13 smithi188 bash[23329]: audit 2020-07-16T15:59:12.425154+0000 mgr.x (mgr.34562) 6763 : audit [DBG] from='client.29560 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:59:14.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:59:13 smithi132 bash[27079]: audit 2020-07-16T15:59:12.412547+0000 mgr.x (mgr.34562) 6756 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T15:59:14.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:59:13 smithi132 bash[27079]: audit 2020-07-16T15:59:12.413812+0000 mgr.x (mgr.34562) 6757 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T15:59:14.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:59:13 smithi132 bash[27079]: audit 2020-07-16T15:59:12.415059+0000 mgr.x (mgr.34562) 6758 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T15:59:14.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:59:13 smithi132 bash[27079]: cephadm 2020-07-16T15:59:12.415828+0000 mgr.x (mgr.34562) 6759 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T15:59:14.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:59:13 smithi132 bash[27079]: cephadm 2020-07-16T15:59:12.417089+0000 mgr.x (mgr.34562) 6760 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T15:59:14.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:59:13 smithi132 bash[27079]: cephadm 2020-07-16T15:59:12.418190+0000 mgr.x (mgr.34562) 6761 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T15:59:14.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:59:13 smithi132 bash[27079]: cephadm 2020-07-16T15:59:12.418280+0000 mgr.x (mgr.34562) 6762 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T15:59:14.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:59:13 smithi132 bash[27079]: audit 2020-07-16T15:59:12.425154+0000 mgr.x (mgr.34562) 6763 : audit [DBG] from='client.29560 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:59:15.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:59:14 smithi132 bash[27079]: cluster 2020-07-16T15:59:13.385101+0000 mgr.x (mgr.34562) 6764 : cluster [DBG] pgmap v4216: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:59:15.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:59:14 smithi188 bash[23329]: cluster 2020-07-16T15:59:13.385101+0000 mgr.x (mgr.34562) 6764 : cluster [DBG] pgmap v4216: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:59:16.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:59:15 smithi188 bash[23329]: audit 2020-07-16T15:59:15.257029+0000 mon.b (mon.2) 1460 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:59:16.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:59:15 smithi188 bash[23329]: cephadm 2020-07-16T15:59:15.257636+0000 mgr.x (mgr.34562) 6765 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:59:16.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:59:15 smithi188 bash[23329]: cephadm 2020-07-16T15:59:15.257976+0000 mgr.x (mgr.34562) 6766 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:59:16.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:59:15 smithi132 bash[27079]: audit 2020-07-16T15:59:15.257029+0000 mon.b (mon.2) 1460 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:59:16.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:59:15 smithi132 bash[27079]: cephadm 2020-07-16T15:59:15.257636+0000 mgr.x (mgr.34562) 6765 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:59:16.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:59:15 smithi132 bash[27079]: cephadm 2020-07-16T15:59:15.257976+0000 mgr.x (mgr.34562) 6766 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:59:17.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:59:16 smithi188 bash[23329]: cluster 2020-07-16T15:59:15.385563+0000 mgr.x (mgr.34562) 6767 : cluster [DBG] pgmap v4217: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:59:17.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:59:16 smithi132 bash[27079]: cluster 2020-07-16T15:59:15.385563+0000 mgr.x (mgr.34562) 6767 : cluster [DBG] pgmap v4217: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:59:19.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:59:18 smithi188 bash[23329]: cluster 2020-07-16T15:59:17.385902+0000 mgr.x (mgr.34562) 6768 : cluster [DBG] pgmap v4218: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:59:19.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:59:18 smithi132 bash[27079]: cluster 2020-07-16T15:59:17.385902+0000 mgr.x (mgr.34562) 6768 : cluster [DBG] pgmap v4218: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:59:21.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:59:20 smithi188 bash[23329]: cluster 2020-07-16T15:59:19.386279+0000 mgr.x (mgr.34562) 6769 : cluster [DBG] pgmap v4219: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:59:21.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:59:20 smithi132 bash[27079]: cluster 2020-07-16T15:59:19.386279+0000 mgr.x (mgr.34562) 6769 : cluster [DBG] pgmap v4219: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:59:23.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:59:22 smithi188 bash[23329]: cluster 2020-07-16T15:59:21.386777+0000 mgr.x (mgr.34562) 6770 : cluster [DBG] pgmap v4220: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:59:23.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:59:22 smithi132 bash[27079]: cluster 2020-07-16T15:59:21.386777+0000 mgr.x (mgr.34562) 6770 : cluster [DBG] pgmap v4220: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:59:25.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:59:24 smithi188 bash[23329]: cluster 2020-07-16T15:59:23.387375+0000 mgr.x (mgr.34562) 6771 : cluster [DBG] pgmap v4221: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:59:25.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:59:24 smithi132 bash[27079]: cluster 2020-07-16T15:59:23.387375+0000 mgr.x (mgr.34562) 6771 : cluster [DBG] pgmap v4221: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:59:27.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:59:26 smithi188 bash[23329]: cluster 2020-07-16T15:59:25.387863+0000 mgr.x (mgr.34562) 6772 : cluster [DBG] pgmap v4222: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:59:27.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:59:26 smithi132 bash[27079]: cluster 2020-07-16T15:59:25.387863+0000 mgr.x (mgr.34562) 6772 : cluster [DBG] pgmap v4222: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:59:29.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:59:28 smithi188 bash[23329]: cluster 2020-07-16T15:59:27.388427+0000 mgr.x (mgr.34562) 6773 : cluster [DBG] pgmap v4223: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:59:29.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:59:28 smithi132 bash[27079]: cluster 2020-07-16T15:59:27.388427+0000 mgr.x (mgr.34562) 6773 : cluster [DBG] pgmap v4223: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:59:31.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:59:30 smithi132 bash[27079]: cluster 2020-07-16T15:59:29.388830+0000 mgr.x (mgr.34562) 6774 : cluster [DBG] pgmap v4224: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:59:31.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:59:30 smithi132 bash[27079]: audit 2020-07-16T15:59:30.270776+0000 mon.b (mon.2) 1461 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:59:31.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:59:30 smithi132 bash[27079]: cephadm 2020-07-16T15:59:30.271509+0000 mgr.x (mgr.34562) 6775 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:59:31.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:59:30 smithi132 bash[27079]: cephadm 2020-07-16T15:59:30.271585+0000 mgr.x (mgr.34562) 6776 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:59:31.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:59:30 smithi188 bash[23329]: cluster 2020-07-16T15:59:29.388830+0000 mgr.x (mgr.34562) 6774 : cluster [DBG] pgmap v4224: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:59:31.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:59:30 smithi188 bash[23329]: audit 2020-07-16T15:59:30.270776+0000 mon.b (mon.2) 1461 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:59:31.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:59:30 smithi188 bash[23329]: cephadm 2020-07-16T15:59:30.271509+0000 mgr.x (mgr.34562) 6775 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:59:31.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:59:30 smithi188 bash[23329]: cephadm 2020-07-16T15:59:30.271585+0000 mgr.x (mgr.34562) 6776 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:59:33.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:59:32 smithi132 bash[27079]: cluster 2020-07-16T15:59:31.389395+0000 mgr.x (mgr.34562) 6777 : cluster [DBG] pgmap v4225: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:59:33.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:59:32 smithi188 bash[23329]: cluster 2020-07-16T15:59:31.389395+0000 mgr.x (mgr.34562) 6777 : cluster [DBG] pgmap v4225: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:59:35.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:59:34 smithi132 bash[27079]: cluster 2020-07-16T15:59:33.389795+0000 mgr.x (mgr.34562) 6778 : cluster [DBG] pgmap v4226: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:59:35.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:59:34 smithi188 bash[23329]: cluster 2020-07-16T15:59:33.389795+0000 mgr.x (mgr.34562) 6778 : cluster [DBG] pgmap v4226: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:59:37.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:59:36 smithi132 bash[27079]: cluster 2020-07-16T15:59:35.390306+0000 mgr.x (mgr.34562) 6779 : cluster [DBG] pgmap v4227: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:59:37.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:59:36 smithi188 bash[23329]: cluster 2020-07-16T15:59:35.390306+0000 mgr.x (mgr.34562) 6779 : cluster [DBG] pgmap v4227: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:59:39.292 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:59:38 smithi132 bash[27079]: cluster 2020-07-16T15:59:37.390920+0000 mgr.x (mgr.34562) 6780 : cluster [DBG] pgmap v4228: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:59:39.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:59:38 smithi188 bash[23329]: cluster 2020-07-16T15:59:37.390920+0000 mgr.x (mgr.34562) 6780 : cluster [DBG] pgmap v4228: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:59:41.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:59:40 smithi132 bash[27079]: cluster 2020-07-16T15:59:39.391316+0000 mgr.x (mgr.34562) 6781 : cluster [DBG] pgmap v4229: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:59:41.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:59:40 smithi188 bash[23329]: cluster 2020-07-16T15:59:39.391316+0000 mgr.x (mgr.34562) 6781 : cluster [DBG] pgmap v4229: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:59:43.042 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T15:59:43.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:59:42 smithi132 bash[27079]: cluster 2020-07-16T15:59:41.391699+0000 mgr.x (mgr.34562) 6782 : cluster [DBG] pgmap v4230: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:59:43.304 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T15:59:43.305 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 3m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T15:59:43.305 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 3m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T15:59:43.305 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 3m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T15:59:43.306 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 3m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T15:59:43.306 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 3m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T15:59:43.306 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T15:59:43.306 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T15:59:43.306 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 3m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T15:59:43.307 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 3m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T15:59:43.307 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T15:59:43.307 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T15:59:43.307 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T15:59:43.307 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T15:59:43.307 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T15:59:43.308 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T15:59:43.308 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T15:59:43.308 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T15:59:43.308 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 3m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T15:59:43.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:59:42 smithi188 bash[23329]: cluster 2020-07-16T15:59:41.391699+0000 mgr.x (mgr.34562) 6782 : cluster [DBG] pgmap v4230: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:59:43.601 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T15:59:43.602 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T15:59:43.602 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T15:59:43.602 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T15:59:43.602 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:59:43.602 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T15:59:43.603 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T15:59:43.603 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:59:43.603 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T15:59:43.603 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T15:59:43.603 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T15:59:43.604 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T15:59:43.604 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T15:59:43.604 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T15:59:43.604 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T15:59:43.604 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T15:59:43.605 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T15:59:44.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:59:43 smithi132 bash[27079]: audit 2020-07-16T15:59:43.031236+0000 mgr.x (mgr.34562) 6783 : audit [DBG] from='client.29572 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:59:44.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:59:43 smithi132 bash[27079]: audit 2020-07-16T15:59:43.300794+0000 mgr.x (mgr.34562) 6784 : audit [DBG] from='client.29578 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:59:44.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:59:43 smithi132 bash[27079]: audit 2020-07-16T15:59:43.600764+0000 mon.c (mon.1) 462 : audit [DBG] from='client.? 172.21.15.132:0/3651941789' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:59:44.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:59:43 smithi188 bash[23329]: audit 2020-07-16T15:59:43.031236+0000 mgr.x (mgr.34562) 6783 : audit [DBG] from='client.29572 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:59:44.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:59:43 smithi188 bash[23329]: audit 2020-07-16T15:59:43.300794+0000 mgr.x (mgr.34562) 6784 : audit [DBG] from='client.29578 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T15:59:44.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:59:43 smithi188 bash[23329]: audit 2020-07-16T15:59:43.600764+0000 mon.c (mon.1) 462 : audit [DBG] from='client.? 172.21.15.132:0/3651941789' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T15:59:45.283 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:59:44 smithi132 bash[27079]: cluster 2020-07-16T15:59:43.392054+0000 mgr.x (mgr.34562) 6785 : cluster [DBG] pgmap v4231: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:59:45.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:59:44 smithi188 bash[23329]: cluster 2020-07-16T15:59:43.392054+0000 mgr.x (mgr.34562) 6785 : cluster [DBG] pgmap v4231: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:59:46.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:59:45 smithi132 bash[27079]: audit 2020-07-16T15:59:45.287198+0000 mon.b (mon.2) 1462 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:59:46.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:59:45 smithi132 bash[27079]: cephadm 2020-07-16T15:59:45.287858+0000 mgr.x (mgr.34562) 6786 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:59:46.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:59:45 smithi132 bash[27079]: cephadm 2020-07-16T15:59:45.288313+0000 mgr.x (mgr.34562) 6787 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:59:46.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:59:45 smithi188 bash[23329]: audit 2020-07-16T15:59:45.287198+0000 mon.b (mon.2) 1462 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T15:59:46.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:59:45 smithi188 bash[23329]: cephadm 2020-07-16T15:59:45.287858+0000 mgr.x (mgr.34562) 6786 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T15:59:46.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:59:45 smithi188 bash[23329]: cephadm 2020-07-16T15:59:45.288313+0000 mgr.x (mgr.34562) 6787 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T15:59:47.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:59:46 smithi132 bash[27079]: cluster 2020-07-16T15:59:45.392386+0000 mgr.x (mgr.34562) 6788 : cluster [DBG] pgmap v4232: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:59:47.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:59:46 smithi188 bash[23329]: cluster 2020-07-16T15:59:45.392386+0000 mgr.x (mgr.34562) 6788 : cluster [DBG] pgmap v4232: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:59:49.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:59:48 smithi132 bash[27079]: cluster 2020-07-16T15:59:47.392902+0000 mgr.x (mgr.34562) 6789 : cluster [DBG] pgmap v4233: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:59:49.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:59:48 smithi188 bash[23329]: cluster 2020-07-16T15:59:47.392902+0000 mgr.x (mgr.34562) 6789 : cluster [DBG] pgmap v4233: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:59:51.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:59:50 smithi132 bash[27079]: cluster 2020-07-16T15:59:49.393468+0000 mgr.x (mgr.34562) 6790 : cluster [DBG] pgmap v4234: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:59:51.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:59:50 smithi188 bash[23329]: cluster 2020-07-16T15:59:49.393468+0000 mgr.x (mgr.34562) 6790 : cluster [DBG] pgmap v4234: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:59:53.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:59:52 smithi132 bash[27079]: cluster 2020-07-16T15:59:51.393973+0000 mgr.x (mgr.34562) 6791 : cluster [DBG] pgmap v4235: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:59:53.432 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:59:52 smithi188 bash[23329]: cluster 2020-07-16T15:59:51.393973+0000 mgr.x (mgr.34562) 6791 : cluster [DBG] pgmap v4235: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:59:55.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:59:54 smithi132 bash[27079]: cluster 2020-07-16T15:59:53.394568+0000 mgr.x (mgr.34562) 6792 : cluster [DBG] pgmap v4236: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:59:55.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:59:54 smithi188 bash[23329]: cluster 2020-07-16T15:59:53.394568+0000 mgr.x (mgr.34562) 6792 : cluster [DBG] pgmap v4236: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:59:57.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:59:56 smithi132 bash[27079]: cluster 2020-07-16T15:59:55.395127+0000 mgr.x (mgr.34562) 6793 : cluster [DBG] pgmap v4237: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:59:57.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:59:56 smithi188 bash[23329]: cluster 2020-07-16T15:59:55.395127+0000 mgr.x (mgr.34562) 6793 : cluster [DBG] pgmap v4237: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:59:59.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 15:59:58 smithi132 bash[27079]: cluster 2020-07-16T15:59:57.395550+0000 mgr.x (mgr.34562) 6794 : cluster [DBG] pgmap v4238: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T15:59:59.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 15:59:58 smithi188 bash[23329]: cluster 2020-07-16T15:59:57.395550+0000 mgr.x (mgr.34562) 6794 : cluster [DBG] pgmap v4238: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:00:01.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:00:00 smithi132 bash[27079]: cluster 2020-07-16T15:59:59.395901+0000 mgr.x (mgr.34562) 6795 : cluster [DBG] pgmap v4239: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:00:01.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:00:00 smithi132 bash[27079]: cluster 2020-07-16T16:00:00.000152+0000 mon.c (mon.1) 463 : cluster [WRN] overall HEALTH_WARN 1/3 mons down, quorum c,b 2020-07-16T16:00:01.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:00:00 smithi132 bash[27079]: audit 2020-07-16T16:00:00.303797+0000 mon.b (mon.2) 1463 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:00:01.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:00:00 smithi132 bash[27079]: cephadm 2020-07-16T16:00:00.304475+0000 mgr.x (mgr.34562) 6796 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:00:01.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:00:00 smithi132 bash[27079]: cephadm 2020-07-16T16:00:00.304808+0000 mgr.x (mgr.34562) 6797 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:00:01.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:00:00 smithi188 bash[23329]: cluster 2020-07-16T15:59:59.395901+0000 mgr.x (mgr.34562) 6795 : cluster [DBG] pgmap v4239: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:00:01.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:00:00 smithi188 bash[23329]: cluster 2020-07-16T16:00:00.000152+0000 mon.c (mon.1) 463 : cluster [WRN] overall HEALTH_WARN 1/3 mons down, quorum c,b 2020-07-16T16:00:01.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:00:00 smithi188 bash[23329]: audit 2020-07-16T16:00:00.303797+0000 mon.b (mon.2) 1463 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:00:01.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:00:00 smithi188 bash[23329]: cephadm 2020-07-16T16:00:00.304475+0000 mgr.x (mgr.34562) 6796 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:00:01.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:00:00 smithi188 bash[23329]: cephadm 2020-07-16T16:00:00.304808+0000 mgr.x (mgr.34562) 6797 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:00:03.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:00:02 smithi132 bash[27079]: cluster 2020-07-16T16:00:01.396472+0000 mgr.x (mgr.34562) 6798 : cluster [DBG] pgmap v4240: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:00:03.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:00:02 smithi188 bash[23329]: cluster 2020-07-16T16:00:01.396472+0000 mgr.x (mgr.34562) 6798 : cluster [DBG] pgmap v4240: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:00:05.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:00:04 smithi132 bash[27079]: cluster 2020-07-16T16:00:03.396841+0000 mgr.x (mgr.34562) 6799 : cluster [DBG] pgmap v4241: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:00:05.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:00:04 smithi188 bash[23329]: cluster 2020-07-16T16:00:03.396841+0000 mgr.x (mgr.34562) 6799 : cluster [DBG] pgmap v4241: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:00:07.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:00:06 smithi132 bash[27079]: cluster 2020-07-16T16:00:05.397350+0000 mgr.x (mgr.34562) 6800 : cluster [DBG] pgmap v4242: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:00:07.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:00:06 smithi188 bash[23329]: cluster 2020-07-16T16:00:05.397350+0000 mgr.x (mgr.34562) 6800 : cluster [DBG] pgmap v4242: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:00:09.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:00:09 smithi132 bash[27079]: cluster 2020-07-16T16:00:07.397816+0000 mgr.x (mgr.34562) 6801 : cluster [DBG] pgmap v4243: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:00:09.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:00:09 smithi188 bash[23329]: cluster 2020-07-16T16:00:07.397816+0000 mgr.x (mgr.34562) 6801 : cluster [DBG] pgmap v4243: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:00:11.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:00:11 smithi132 bash[27079]: cluster 2020-07-16T16:00:09.398132+0000 mgr.x (mgr.34562) 6802 : cluster [DBG] pgmap v4244: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:00:11.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:00:11 smithi188 bash[23329]: cluster 2020-07-16T16:00:09.398132+0000 mgr.x (mgr.34562) 6802 : cluster [DBG] pgmap v4244: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:00:13.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:00:13 smithi132 bash[27079]: cluster 2020-07-16T16:00:11.398505+0000 mgr.x (mgr.34562) 6803 : cluster [DBG] pgmap v4245: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:00:13.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:00:13 smithi188 bash[23329]: cluster 2020-07-16T16:00:11.398505+0000 mgr.x (mgr.34562) 6803 : cluster [DBG] pgmap v4245: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:00:13.898 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:00:14.160 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:00:14.160 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 4m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:00:14.160 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 4m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:00:14.160 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 4m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:00:14.161 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 4m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:00:14.161 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 4m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:00:14.161 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:00:14.161 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:00:14.161 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 4m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:00:14.162 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 4m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:00:14.162 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:00:14.162 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:00:14.163 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:00:14.163 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:00:14.163 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:00:14.163 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:00:14.163 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:00:14.163 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:00:14.164 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 4m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:00:14.455 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:00:14.455 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:00:14.456 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:00:14.456 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:00:14.456 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:00:14.456 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:00:14.457 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:00:14.457 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:00:14.457 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:00:14.457 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:00:14.457 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:00:14.458 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:00:14.458 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:00:14.458 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:00:14.458 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:00:14.458 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:00:14.459 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:00:15.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:00:15 smithi132 bash[27079]: cluster 2020-07-16T16:00:13.399028+0000 mgr.x (mgr.34562) 6804 : cluster [DBG] pgmap v4246: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:00:15.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:00:15 smithi132 bash[27079]: audit 2020-07-16T16:00:13.886768+0000 mgr.x (mgr.34562) 6805 : audit [DBG] from='client.29590 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:00:15.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:00:15 smithi132 bash[27079]: audit 2020-07-16T16:00:14.155862+0000 mgr.x (mgr.34562) 6806 : audit [DBG] from='client.29596 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:00:15.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:00:15 smithi132 bash[27079]: audit 2020-07-16T16:00:14.454711+0000 mon.c (mon.1) 464 : audit [DBG] from='client.? 172.21.15.132:0/933750443' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:00:15.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:00:15 smithi188 bash[23329]: cluster 2020-07-16T16:00:13.399028+0000 mgr.x (mgr.34562) 6804 : cluster [DBG] pgmap v4246: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:00:15.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:00:15 smithi188 bash[23329]: audit 2020-07-16T16:00:13.886768+0000 mgr.x (mgr.34562) 6805 : audit [DBG] from='client.29590 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:00:15.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:00:15 smithi188 bash[23329]: audit 2020-07-16T16:00:14.155862+0000 mgr.x (mgr.34562) 6806 : audit [DBG] from='client.29596 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:00:15.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:00:15 smithi188 bash[23329]: audit 2020-07-16T16:00:14.454711+0000 mon.c (mon.1) 464 : audit [DBG] from='client.? 172.21.15.132:0/933750443' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:00:16.181 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:00:16 smithi132 bash[27079]: audit 2020-07-16T16:00:15.308412+0000 mon.b (mon.2) 1464 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:00:16.181 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:00:16 smithi132 bash[27079]: audit 2020-07-16T16:00:15.308771+0000 mgr.x (mgr.34562) 6807 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:00:16.182 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:00:16 smithi132 bash[27079]: audit 2020-07-16T16:00:15.309869+0000 mon.b (mon.2) 1465 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:00:16.182 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:00:16 smithi132 bash[27079]: audit 2020-07-16T16:00:15.310172+0000 mgr.x (mgr.34562) 6808 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:00:16.182 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:00:16 smithi132 bash[27079]: audit 2020-07-16T16:00:15.311045+0000 mon.b (mon.2) 1466 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:00:16.182 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:00:16 smithi132 bash[27079]: audit 2020-07-16T16:00:15.311357+0000 mgr.x (mgr.34562) 6809 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:00:16.182 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:00:16 smithi132 bash[27079]: cephadm 2020-07-16T16:00:15.312082+0000 mgr.x (mgr.34562) 6810 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:00:16.183 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:00:16 smithi132 bash[27079]: audit 2020-07-16T16:00:15.312571+0000 mon.b (mon.2) 1467 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:00:16.183 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:00:16 smithi132 bash[27079]: cephadm 2020-07-16T16:00:15.313426+0000 mgr.x (mgr.34562) 6811 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:00:16.183 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:00:16 smithi132 bash[27079]: audit 2020-07-16T16:00:15.313787+0000 mon.b (mon.2) 1468 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:00:16.183 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:00:16 smithi132 bash[27079]: cephadm 2020-07-16T16:00:15.314525+0000 mgr.x (mgr.34562) 6812 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:00:16.183 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:00:16 smithi132 bash[27079]: cephadm 2020-07-16T16:00:15.314892+0000 mgr.x (mgr.34562) 6813 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:00:16.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:00:16 smithi188 bash[23329]: audit 2020-07-16T16:00:15.308412+0000 mon.b (mon.2) 1464 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:00:16.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:00:16 smithi188 bash[23329]: audit 2020-07-16T16:00:15.308771+0000 mgr.x (mgr.34562) 6807 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:00:16.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:00:16 smithi188 bash[23329]: audit 2020-07-16T16:00:15.309869+0000 mon.b (mon.2) 1465 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:00:16.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:00:16 smithi188 bash[23329]: audit 2020-07-16T16:00:15.310172+0000 mgr.x (mgr.34562) 6808 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:00:16.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:00:16 smithi188 bash[23329]: audit 2020-07-16T16:00:15.311045+0000 mon.b (mon.2) 1466 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:00:16.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:00:16 smithi188 bash[23329]: audit 2020-07-16T16:00:15.311357+0000 mgr.x (mgr.34562) 6809 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:00:16.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:00:16 smithi188 bash[23329]: cephadm 2020-07-16T16:00:15.312082+0000 mgr.x (mgr.34562) 6810 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:00:16.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:00:16 smithi188 bash[23329]: audit 2020-07-16T16:00:15.312571+0000 mon.b (mon.2) 1467 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:00:16.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:00:16 smithi188 bash[23329]: cephadm 2020-07-16T16:00:15.313426+0000 mgr.x (mgr.34562) 6811 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:00:16.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:00:16 smithi188 bash[23329]: audit 2020-07-16T16:00:15.313787+0000 mon.b (mon.2) 1468 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:00:16.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:00:16 smithi188 bash[23329]: cephadm 2020-07-16T16:00:15.314525+0000 mgr.x (mgr.34562) 6812 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:00:16.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:00:16 smithi188 bash[23329]: cephadm 2020-07-16T16:00:15.314892+0000 mgr.x (mgr.34562) 6813 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:00:17.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:00:17 smithi132 bash[27079]: cluster 2020-07-16T16:00:15.399509+0000 mgr.x (mgr.34562) 6814 : cluster [DBG] pgmap v4247: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:00:17.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:00:17 smithi188 bash[23329]: cluster 2020-07-16T16:00:15.399509+0000 mgr.x (mgr.34562) 6814 : cluster [DBG] pgmap v4247: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:00:19.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:00:19 smithi132 bash[27079]: cluster 2020-07-16T16:00:17.399990+0000 mgr.x (mgr.34562) 6815 : cluster [DBG] pgmap v4248: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:00:19.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:00:19 smithi132 bash[27079]: audit 2020-07-16T16:00:18.176495+0000 mon.b (mon.2) 1469 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:00:19.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:00:19 smithi132 bash[27079]: cephadm 2020-07-16T16:00:18.177161+0000 mgr.x (mgr.34562) 6816 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:00:19.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:00:19 smithi132 bash[27079]: cephadm 2020-07-16T16:00:18.177410+0000 mgr.x (mgr.34562) 6817 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:00:19.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:00:19 smithi188 bash[23329]: cluster 2020-07-16T16:00:17.399990+0000 mgr.x (mgr.34562) 6815 : cluster [DBG] pgmap v4248: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:00:19.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:00:19 smithi188 bash[23329]: audit 2020-07-16T16:00:18.176495+0000 mon.b (mon.2) 1469 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:00:19.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:00:19 smithi188 bash[23329]: cephadm 2020-07-16T16:00:18.177161+0000 mgr.x (mgr.34562) 6816 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:00:19.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:00:19 smithi188 bash[23329]: cephadm 2020-07-16T16:00:18.177410+0000 mgr.x (mgr.34562) 6817 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:00:21.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:00:21 smithi132 bash[27079]: cluster 2020-07-16T16:00:19.400404+0000 mgr.x (mgr.34562) 6818 : cluster [DBG] pgmap v4249: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:00:21.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:00:21 smithi188 bash[23329]: cluster 2020-07-16T16:00:19.400404+0000 mgr.x (mgr.34562) 6818 : cluster [DBG] pgmap v4249: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:00:23.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:00:23 smithi132 bash[27079]: cluster 2020-07-16T16:00:21.400755+0000 mgr.x (mgr.34562) 6819 : cluster [DBG] pgmap v4250: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:00:23.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:00:23 smithi188 bash[23329]: cluster 2020-07-16T16:00:21.400755+0000 mgr.x (mgr.34562) 6819 : cluster [DBG] pgmap v4250: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:00:25.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:00:25 smithi188 bash[23329]: cluster 2020-07-16T16:00:23.401085+0000 mgr.x (mgr.34562) 6820 : cluster [DBG] pgmap v4251: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:00:25.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:00:25 smithi132 bash[27079]: cluster 2020-07-16T16:00:23.401085+0000 mgr.x (mgr.34562) 6820 : cluster [DBG] pgmap v4251: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:00:27.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:00:27 smithi188 bash[23329]: cluster 2020-07-16T16:00:25.401462+0000 mgr.x (mgr.34562) 6821 : cluster [DBG] pgmap v4252: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:00:27.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:00:27 smithi132 bash[27079]: cluster 2020-07-16T16:00:25.401462+0000 mgr.x (mgr.34562) 6821 : cluster [DBG] pgmap v4252: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:00:29.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:00:29 smithi188 bash[23329]: cluster 2020-07-16T16:00:27.401888+0000 mgr.x (mgr.34562) 6822 : cluster [DBG] pgmap v4253: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:00:29.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:00:29 smithi132 bash[27079]: cluster 2020-07-16T16:00:27.401888+0000 mgr.x (mgr.34562) 6822 : cluster [DBG] pgmap v4253: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:00:31.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:00:31 smithi188 bash[23329]: cluster 2020-07-16T16:00:29.402279+0000 mgr.x (mgr.34562) 6823 : cluster [DBG] pgmap v4254: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:00:31.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:00:31 smithi132 bash[27079]: cluster 2020-07-16T16:00:29.402279+0000 mgr.x (mgr.34562) 6823 : cluster [DBG] pgmap v4254: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:00:33.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:00:33 smithi188 bash[23329]: cluster 2020-07-16T16:00:31.402681+0000 mgr.x (mgr.34562) 6824 : cluster [DBG] pgmap v4255: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:00:33.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:00:33 smithi132 bash[27079]: cluster 2020-07-16T16:00:31.402681+0000 mgr.x (mgr.34562) 6824 : cluster [DBG] pgmap v4255: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:00:34.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:00:34 smithi188 bash[23329]: audit 2020-07-16T16:00:33.193108+0000 mon.b (mon.2) 1470 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:00:34.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:00:34 smithi188 bash[23329]: cephadm 2020-07-16T16:00:33.193820+0000 mgr.x (mgr.34562) 6825 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:00:34.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:00:34 smithi188 bash[23329]: cephadm 2020-07-16T16:00:33.193910+0000 mgr.x (mgr.34562) 6826 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:00:34.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:00:34 smithi132 bash[27079]: audit 2020-07-16T16:00:33.193108+0000 mon.b (mon.2) 1470 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:00:34.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:00:34 smithi132 bash[27079]: cephadm 2020-07-16T16:00:33.193820+0000 mgr.x (mgr.34562) 6825 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:00:34.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:00:34 smithi132 bash[27079]: cephadm 2020-07-16T16:00:33.193910+0000 mgr.x (mgr.34562) 6826 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:00:35.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:00:35 smithi188 bash[23329]: cluster 2020-07-16T16:00:33.403202+0000 mgr.x (mgr.34562) 6827 : cluster [DBG] pgmap v4256: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:00:35.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:00:35 smithi132 bash[27079]: cluster 2020-07-16T16:00:33.403202+0000 mgr.x (mgr.34562) 6827 : cluster [DBG] pgmap v4256: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:00:37.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:00:37 smithi188 bash[23329]: cluster 2020-07-16T16:00:35.403514+0000 mgr.x (mgr.34562) 6828 : cluster [DBG] pgmap v4257: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:00:37.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:00:37 smithi132 bash[27079]: cluster 2020-07-16T16:00:35.403514+0000 mgr.x (mgr.34562) 6828 : cluster [DBG] pgmap v4257: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:00:39.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:00:39 smithi188 bash[23329]: cluster 2020-07-16T16:00:37.404034+0000 mgr.x (mgr.34562) 6829 : cluster [DBG] pgmap v4258: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:00:39.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:00:39 smithi132 bash[27079]: cluster 2020-07-16T16:00:37.404034+0000 mgr.x (mgr.34562) 6829 : cluster [DBG] pgmap v4258: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:00:41.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:00:41 smithi188 bash[23329]: cluster 2020-07-16T16:00:39.404484+0000 mgr.x (mgr.34562) 6830 : cluster [DBG] pgmap v4259: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:00:41.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:00:41 smithi132 bash[27079]: cluster 2020-07-16T16:00:39.404484+0000 mgr.x (mgr.34562) 6830 : cluster [DBG] pgmap v4259: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:00:43.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:00:43 smithi188 bash[23329]: cluster 2020-07-16T16:00:41.404818+0000 mgr.x (mgr.34562) 6831 : cluster [DBG] pgmap v4260: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:00:43.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:00:43 smithi132 bash[27079]: cluster 2020-07-16T16:00:41.404818+0000 mgr.x (mgr.34562) 6831 : cluster [DBG] pgmap v4260: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:00:44.763 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:00:45.030 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:00:45.030 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 4m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:00:45.031 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 4m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:00:45.031 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 4m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:00:45.031 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 4m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:00:45.031 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 4m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:00:45.031 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:00:45.032 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:00:45.032 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 4m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:00:45.032 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 4m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:00:45.032 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:00:45.032 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:00:45.033 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:00:45.033 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:00:45.033 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:00:45.033 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:00:45.033 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:00:45.034 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:00:45.034 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 4m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:00:45.328 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:00:45.329 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:00:45.329 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:00:45.329 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:00:45.330 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:00:45.330 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:00:45.330 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:00:45.331 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:00:45.331 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:00:45.331 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:00:45.332 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:00:45.332 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:00:45.332 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:00:45.332 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:00:45.333 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:00:45.333 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:00:45.333 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:00:45.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:00:45 smithi188 bash[23329]: cluster 2020-07-16T16:00:43.405345+0000 mgr.x (mgr.34562) 6832 : cluster [DBG] pgmap v4261: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:00:45.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:00:45 smithi132 bash[27079]: cluster 2020-07-16T16:00:43.405345+0000 mgr.x (mgr.34562) 6832 : cluster [DBG] pgmap v4261: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:00:46.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:00:46 smithi188 bash[23329]: audit 2020-07-16T16:00:44.751436+0000 mgr.x (mgr.34562) 6833 : audit [DBG] from='client.29608 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:00:46.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:00:46 smithi188 bash[23329]: audit 2020-07-16T16:00:45.026099+0000 mgr.x (mgr.34562) 6834 : audit [DBG] from='client.29614 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:00:46.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:00:46 smithi188 bash[23329]: audit 2020-07-16T16:00:45.327975+0000 mon.c (mon.1) 465 : audit [DBG] from='client.? 172.21.15.132:0/327311539' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:00:46.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:00:46 smithi132 bash[27079]: audit 2020-07-16T16:00:44.751436+0000 mgr.x (mgr.34562) 6833 : audit [DBG] from='client.29608 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:00:46.532 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:00:46 smithi132 bash[27079]: audit 2020-07-16T16:00:45.026099+0000 mgr.x (mgr.34562) 6834 : audit [DBG] from='client.29614 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:00:46.533 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:00:46 smithi132 bash[27079]: audit 2020-07-16T16:00:45.327975+0000 mon.c (mon.1) 465 : audit [DBG] from='client.? 172.21.15.132:0/327311539' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:00:47.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:00:47 smithi188 bash[23329]: cluster 2020-07-16T16:00:45.405658+0000 mgr.x (mgr.34562) 6835 : cluster [DBG] pgmap v4262: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:00:47.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:00:47 smithi132 bash[27079]: cluster 2020-07-16T16:00:45.405658+0000 mgr.x (mgr.34562) 6835 : cluster [DBG] pgmap v4262: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:00:49.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:00:49 smithi188 bash[23329]: cluster 2020-07-16T16:00:47.406124+0000 mgr.x (mgr.34562) 6836 : cluster [DBG] pgmap v4263: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:00:49.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:00:49 smithi188 bash[23329]: audit 2020-07-16T16:00:48.209540+0000 mon.b (mon.2) 1471 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:00:49.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:00:49 smithi188 bash[23329]: cephadm 2020-07-16T16:00:48.210321+0000 mgr.x (mgr.34562) 6837 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:00:49.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:00:49 smithi188 bash[23329]: cephadm 2020-07-16T16:00:48.210431+0000 mgr.x (mgr.34562) 6838 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:00:49.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:00:49 smithi132 bash[27079]: cluster 2020-07-16T16:00:47.406124+0000 mgr.x (mgr.34562) 6836 : cluster [DBG] pgmap v4263: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:00:49.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:00:49 smithi132 bash[27079]: audit 2020-07-16T16:00:48.209540+0000 mon.b (mon.2) 1471 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:00:49.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:00:49 smithi132 bash[27079]: cephadm 2020-07-16T16:00:48.210321+0000 mgr.x (mgr.34562) 6837 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:00:49.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:00:49 smithi132 bash[27079]: cephadm 2020-07-16T16:00:48.210431+0000 mgr.x (mgr.34562) 6838 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:00:51.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:00:51 smithi188 bash[23329]: cluster 2020-07-16T16:00:49.406664+0000 mgr.x (mgr.34562) 6839 : cluster [DBG] pgmap v4264: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:00:51.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:00:51 smithi132 bash[27079]: cluster 2020-07-16T16:00:49.406664+0000 mgr.x (mgr.34562) 6839 : cluster [DBG] pgmap v4264: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:00:53.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:00:53 smithi188 bash[23329]: cluster 2020-07-16T16:00:51.407177+0000 mgr.x (mgr.34562) 6840 : cluster [DBG] pgmap v4265: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:00:53.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:00:53 smithi132 bash[27079]: cluster 2020-07-16T16:00:51.407177+0000 mgr.x (mgr.34562) 6840 : cluster [DBG] pgmap v4265: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:00:55.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:00:55 smithi188 bash[23329]: cluster 2020-07-16T16:00:53.407810+0000 mgr.x (mgr.34562) 6841 : cluster [DBG] pgmap v4266: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:00:55.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:00:55 smithi132 bash[27079]: cluster 2020-07-16T16:00:53.407810+0000 mgr.x (mgr.34562) 6841 : cluster [DBG] pgmap v4266: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:00:57.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:00:57 smithi188 bash[23329]: cluster 2020-07-16T16:00:55.408280+0000 mgr.x (mgr.34562) 6842 : cluster [DBG] pgmap v4267: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:00:57.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:00:57 smithi132 bash[27079]: cluster 2020-07-16T16:00:55.408280+0000 mgr.x (mgr.34562) 6842 : cluster [DBG] pgmap v4267: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:00:59.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:00:59 smithi188 bash[23329]: cluster 2020-07-16T16:00:57.408848+0000 mgr.x (mgr.34562) 6843 : cluster [DBG] pgmap v4268: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:00:59.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:00:59 smithi132 bash[27079]: cluster 2020-07-16T16:00:57.408848+0000 mgr.x (mgr.34562) 6843 : cluster [DBG] pgmap v4268: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:01:01.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:01:01 smithi188 bash[23329]: cluster 2020-07-16T16:00:59.409419+0000 mgr.x (mgr.34562) 6844 : cluster [DBG] pgmap v4269: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:01:01.524 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:01:01 smithi132 bash[27079]: cluster 2020-07-16T16:00:59.409419+0000 mgr.x (mgr.34562) 6844 : cluster [DBG] pgmap v4269: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:01:03.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:01:03 smithi188 bash[23329]: cluster 2020-07-16T16:01:01.409940+0000 mgr.x (mgr.34562) 6845 : cluster [DBG] pgmap v4270: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:01:03.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:01:03 smithi132 bash[27079]: cluster 2020-07-16T16:01:01.409940+0000 mgr.x (mgr.34562) 6845 : cluster [DBG] pgmap v4270: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:01:04.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:01:04 smithi188 bash[23329]: audit 2020-07-16T16:01:03.222254+0000 mon.b (mon.2) 1472 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:01:04.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:01:04 smithi188 bash[23329]: cephadm 2020-07-16T16:01:03.222925+0000 mgr.x (mgr.34562) 6846 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:01:04.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:01:04 smithi188 bash[23329]: cephadm 2020-07-16T16:01:03.223332+0000 mgr.x (mgr.34562) 6847 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:01:04.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:01:04 smithi132 bash[27079]: audit 2020-07-16T16:01:03.222254+0000 mon.b (mon.2) 1472 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:01:04.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:01:04 smithi132 bash[27079]: cephadm 2020-07-16T16:01:03.222925+0000 mgr.x (mgr.34562) 6846 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:01:04.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:01:04 smithi132 bash[27079]: cephadm 2020-07-16T16:01:03.223332+0000 mgr.x (mgr.34562) 6847 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:01:05.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:01:05 smithi188 bash[23329]: cluster 2020-07-16T16:01:03.410498+0000 mgr.x (mgr.34562) 6848 : cluster [DBG] pgmap v4271: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:01:05.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:01:05 smithi132 bash[27079]: cluster 2020-07-16T16:01:03.410498+0000 mgr.x (mgr.34562) 6848 : cluster [DBG] pgmap v4271: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:01:07.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:01:07 smithi188 bash[23329]: cluster 2020-07-16T16:01:05.410829+0000 mgr.x (mgr.34562) 6849 : cluster [DBG] pgmap v4272: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:01:07.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:01:07 smithi132 bash[27079]: cluster 2020-07-16T16:01:05.410829+0000 mgr.x (mgr.34562) 6849 : cluster [DBG] pgmap v4272: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:01:09.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:01:09 smithi188 bash[23329]: cluster 2020-07-16T16:01:07.411325+0000 mgr.x (mgr.34562) 6850 : cluster [DBG] pgmap v4273: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:01:09.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:01:09 smithi132 bash[27079]: cluster 2020-07-16T16:01:07.411325+0000 mgr.x (mgr.34562) 6850 : cluster [DBG] pgmap v4273: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:01:11.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:01:11 smithi188 bash[23329]: cluster 2020-07-16T16:01:09.411744+0000 mgr.x (mgr.34562) 6851 : cluster [DBG] pgmap v4274: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:01:11.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:01:11 smithi132 bash[27079]: cluster 2020-07-16T16:01:09.411744+0000 mgr.x (mgr.34562) 6851 : cluster [DBG] pgmap v4274: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:01:13.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:01:13 smithi188 bash[23329]: cluster 2020-07-16T16:01:11.412281+0000 mgr.x (mgr.34562) 6852 : cluster [DBG] pgmap v4275: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:01:13.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:01:13 smithi132 bash[27079]: cluster 2020-07-16T16:01:11.412281+0000 mgr.x (mgr.34562) 6852 : cluster [DBG] pgmap v4275: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:01:15.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:01:15 smithi188 bash[23329]: cluster 2020-07-16T16:01:13.412697+0000 mgr.x (mgr.34562) 6853 : cluster [DBG] pgmap v4276: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:01:15.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:01:15 smithi132 bash[27079]: cluster 2020-07-16T16:01:13.412697+0000 mgr.x (mgr.34562) 6853 : cluster [DBG] pgmap v4276: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:01:15.628 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:01:15.890 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:01:15.891 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 5m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:01:15.891 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 5m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:01:15.891 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 5m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:01:15.891 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 5m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:01:15.892 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 5m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:01:15.892 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:01:15.892 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:01:15.892 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 5m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:01:15.892 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 5m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:01:15.893 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:01:15.893 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:01:15.893 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:01:15.893 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:01:15.893 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:01:15.894 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:01:15.894 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:01:15.894 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:01:15.894 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 5m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:01:16.186 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:01:16.186 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:01:16.187 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:01:16.187 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:01:16.187 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:01:16.187 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:01:16.187 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:01:16.188 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:01:16.188 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:01:16.188 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:01:16.188 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:01:16.188 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:01:16.189 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:01:16.189 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:01:16.189 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:01:16.189 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:01:16.189 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:01:17.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:01:17 smithi188 bash[23329]: cluster 2020-07-16T16:01:15.413203+0000 mgr.x (mgr.34562) 6854 : cluster [DBG] pgmap v4277: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:01:17.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:01:17 smithi188 bash[23329]: audit 2020-07-16T16:01:15.617158+0000 mgr.x (mgr.34562) 6855 : audit [DBG] from='client.29626 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:01:17.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:01:17 smithi188 bash[23329]: audit 2020-07-16T16:01:15.886598+0000 mgr.x (mgr.34562) 6856 : audit [DBG] from='client.29632 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:01:17.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:01:17 smithi188 bash[23329]: audit 2020-07-16T16:01:16.185583+0000 mon.c (mon.1) 466 : audit [DBG] from='client.? 172.21.15.132:0/1508741665' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:01:17.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:01:17 smithi132 bash[27079]: cluster 2020-07-16T16:01:15.413203+0000 mgr.x (mgr.34562) 6854 : cluster [DBG] pgmap v4277: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:01:17.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:01:17 smithi132 bash[27079]: audit 2020-07-16T16:01:15.617158+0000 mgr.x (mgr.34562) 6855 : audit [DBG] from='client.29626 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:01:17.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:01:17 smithi132 bash[27079]: audit 2020-07-16T16:01:15.886598+0000 mgr.x (mgr.34562) 6856 : audit [DBG] from='client.29632 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:01:17.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:01:17 smithi132 bash[27079]: audit 2020-07-16T16:01:16.185583+0000 mon.c (mon.1) 466 : audit [DBG] from='client.? 172.21.15.132:0/1508741665' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:01:19.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:01:19 smithi188 bash[23329]: cluster 2020-07-16T16:01:17.413696+0000 mgr.x (mgr.34562) 6857 : cluster [DBG] pgmap v4278: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:01:19.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:01:19 smithi188 bash[23329]: audit 2020-07-16T16:01:18.241249+0000 mon.b (mon.2) 1473 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:01:19.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:01:19 smithi188 bash[23329]: audit 2020-07-16T16:01:18.241656+0000 mgr.x (mgr.34562) 6858 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:01:19.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:01:19 smithi188 bash[23329]: audit 2020-07-16T16:01:18.242694+0000 mon.b (mon.2) 1474 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:01:19.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:01:19 smithi188 bash[23329]: audit 2020-07-16T16:01:18.243004+0000 mgr.x (mgr.34562) 6859 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:01:19.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:01:19 smithi188 bash[23329]: audit 2020-07-16T16:01:18.243891+0000 mon.b (mon.2) 1475 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:01:19.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:01:19 smithi188 bash[23329]: audit 2020-07-16T16:01:18.244174+0000 mgr.x (mgr.34562) 6860 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:01:19.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:01:19 smithi188 bash[23329]: cephadm 2020-07-16T16:01:18.244926+0000 mgr.x (mgr.34562) 6861 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:01:19.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:01:19 smithi188 bash[23329]: audit 2020-07-16T16:01:18.245364+0000 mon.b (mon.2) 1476 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:01:19.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:01:19 smithi188 bash[23329]: cephadm 2020-07-16T16:01:18.246201+0000 mgr.x (mgr.34562) 6862 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:01:19.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:01:19 smithi188 bash[23329]: audit 2020-07-16T16:01:18.246790+0000 mon.b (mon.2) 1477 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:01:19.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:01:19 smithi188 bash[23329]: cephadm 2020-07-16T16:01:18.247570+0000 mgr.x (mgr.34562) 6863 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:01:19.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:01:19 smithi188 bash[23329]: cephadm 2020-07-16T16:01:18.247784+0000 mgr.x (mgr.34562) 6864 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:01:19.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:01:19 smithi132 bash[27079]: cluster 2020-07-16T16:01:17.413696+0000 mgr.x (mgr.34562) 6857 : cluster [DBG] pgmap v4278: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:01:19.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:01:19 smithi132 bash[27079]: audit 2020-07-16T16:01:18.241249+0000 mon.b (mon.2) 1473 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:01:19.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:01:19 smithi132 bash[27079]: audit 2020-07-16T16:01:18.241656+0000 mgr.x (mgr.34562) 6858 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:01:19.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:01:19 smithi132 bash[27079]: audit 2020-07-16T16:01:18.242694+0000 mon.b (mon.2) 1474 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:01:19.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:01:19 smithi132 bash[27079]: audit 2020-07-16T16:01:18.243004+0000 mgr.x (mgr.34562) 6859 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:01:19.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:01:19 smithi132 bash[27079]: audit 2020-07-16T16:01:18.243891+0000 mon.b (mon.2) 1475 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:01:19.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:01:19 smithi132 bash[27079]: audit 2020-07-16T16:01:18.244174+0000 mgr.x (mgr.34562) 6860 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:01:19.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:01:19 smithi132 bash[27079]: cephadm 2020-07-16T16:01:18.244926+0000 mgr.x (mgr.34562) 6861 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:01:19.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:01:19 smithi132 bash[27079]: audit 2020-07-16T16:01:18.245364+0000 mon.b (mon.2) 1476 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:01:19.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:01:19 smithi132 bash[27079]: cephadm 2020-07-16T16:01:18.246201+0000 mgr.x (mgr.34562) 6862 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:01:19.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:01:19 smithi132 bash[27079]: audit 2020-07-16T16:01:18.246790+0000 mon.b (mon.2) 1477 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:01:19.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:01:19 smithi132 bash[27079]: cephadm 2020-07-16T16:01:18.247570+0000 mgr.x (mgr.34562) 6863 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:01:19.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:01:19 smithi132 bash[27079]: cephadm 2020-07-16T16:01:18.247784+0000 mgr.x (mgr.34562) 6864 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:01:21.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:01:21 smithi188 bash[23329]: cluster 2020-07-16T16:01:19.414091+0000 mgr.x (mgr.34562) 6865 : cluster [DBG] pgmap v4279: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:01:21.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:01:21 smithi132 bash[27079]: cluster 2020-07-16T16:01:19.414091+0000 mgr.x (mgr.34562) 6865 : cluster [DBG] pgmap v4279: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:01:22.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:01:22 smithi188 bash[23329]: audit 2020-07-16T16:01:21.212943+0000 mon.b (mon.2) 1478 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:01:22.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:01:22 smithi188 bash[23329]: cephadm 2020-07-16T16:01:21.213562+0000 mgr.x (mgr.34562) 6866 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:01:22.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:01:22 smithi188 bash[23329]: cephadm 2020-07-16T16:01:21.213755+0000 mgr.x (mgr.34562) 6867 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:01:22.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:01:22 smithi132 bash[27079]: audit 2020-07-16T16:01:21.212943+0000 mon.b (mon.2) 1478 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:01:22.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:01:22 smithi132 bash[27079]: cephadm 2020-07-16T16:01:21.213562+0000 mgr.x (mgr.34562) 6866 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:01:22.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:01:22 smithi132 bash[27079]: cephadm 2020-07-16T16:01:21.213755+0000 mgr.x (mgr.34562) 6867 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:01:23.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:01:23 smithi188 bash[23329]: cluster 2020-07-16T16:01:21.414521+0000 mgr.x (mgr.34562) 6868 : cluster [DBG] pgmap v4280: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:01:23.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:01:23 smithi132 bash[27079]: cluster 2020-07-16T16:01:21.414521+0000 mgr.x (mgr.34562) 6868 : cluster [DBG] pgmap v4280: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:01:25.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:01:25 smithi188 bash[23329]: cluster 2020-07-16T16:01:23.415031+0000 mgr.x (mgr.34562) 6869 : cluster [DBG] pgmap v4281: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:01:25.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:01:25 smithi132 bash[27079]: cluster 2020-07-16T16:01:23.415031+0000 mgr.x (mgr.34562) 6869 : cluster [DBG] pgmap v4281: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:01:27.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:01:27 smithi188 bash[23329]: cluster 2020-07-16T16:01:25.415527+0000 mgr.x (mgr.34562) 6870 : cluster [DBG] pgmap v4282: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:01:27.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:01:27 smithi132 bash[27079]: cluster 2020-07-16T16:01:25.415527+0000 mgr.x (mgr.34562) 6870 : cluster [DBG] pgmap v4282: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:01:29.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:01:29 smithi188 bash[23329]: cluster 2020-07-16T16:01:27.415974+0000 mgr.x (mgr.34562) 6871 : cluster [DBG] pgmap v4283: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:01:29.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:01:29 smithi132 bash[27079]: cluster 2020-07-16T16:01:27.415974+0000 mgr.x (mgr.34562) 6871 : cluster [DBG] pgmap v4283: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:01:31.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:01:31 smithi188 bash[23329]: cluster 2020-07-16T16:01:29.416542+0000 mgr.x (mgr.34562) 6872 : cluster [DBG] pgmap v4284: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:01:31.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:01:31 smithi132 bash[27079]: cluster 2020-07-16T16:01:29.416542+0000 mgr.x (mgr.34562) 6872 : cluster [DBG] pgmap v4284: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:01:33.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:01:33 smithi188 bash[23329]: cluster 2020-07-16T16:01:31.416972+0000 mgr.x (mgr.34562) 6873 : cluster [DBG] pgmap v4285: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:01:33.533 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:01:33 smithi132 bash[27079]: cluster 2020-07-16T16:01:31.416972+0000 mgr.x (mgr.34562) 6873 : cluster [DBG] pgmap v4285: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:01:35.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:01:35 smithi188 bash[23329]: cluster 2020-07-16T16:01:33.417506+0000 mgr.x (mgr.34562) 6874 : cluster [DBG] pgmap v4286: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:01:35.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:01:35 smithi132 bash[27079]: cluster 2020-07-16T16:01:33.417506+0000 mgr.x (mgr.34562) 6874 : cluster [DBG] pgmap v4286: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:01:37.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:01:37 smithi132 bash[27079]: cluster 2020-07-16T16:01:35.417914+0000 mgr.x (mgr.34562) 6875 : cluster [DBG] pgmap v4287: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:01:37.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:01:37 smithi132 bash[27079]: audit 2020-07-16T16:01:36.229447+0000 mon.b (mon.2) 1479 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:01:37.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:01:37 smithi132 bash[27079]: cephadm 2020-07-16T16:01:36.230128+0000 mgr.x (mgr.34562) 6876 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:01:37.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:01:37 smithi132 bash[27079]: cephadm 2020-07-16T16:01:36.230243+0000 mgr.x (mgr.34562) 6877 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:01:37.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:01:37 smithi188 bash[23329]: cluster 2020-07-16T16:01:35.417914+0000 mgr.x (mgr.34562) 6875 : cluster [DBG] pgmap v4287: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:01:37.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:01:37 smithi188 bash[23329]: audit 2020-07-16T16:01:36.229447+0000 mon.b (mon.2) 1479 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:01:37.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:01:37 smithi188 bash[23329]: cephadm 2020-07-16T16:01:36.230128+0000 mgr.x (mgr.34562) 6876 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:01:37.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:01:37 smithi188 bash[23329]: cephadm 2020-07-16T16:01:36.230243+0000 mgr.x (mgr.34562) 6877 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:01:39.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:01:39 smithi132 bash[27079]: cluster 2020-07-16T16:01:37.418335+0000 mgr.x (mgr.34562) 6878 : cluster [DBG] pgmap v4288: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:01:39.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:01:39 smithi188 bash[23329]: cluster 2020-07-16T16:01:37.418335+0000 mgr.x (mgr.34562) 6878 : cluster [DBG] pgmap v4288: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:01:41.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:01:41 smithi132 bash[27079]: cluster 2020-07-16T16:01:39.418720+0000 mgr.x (mgr.34562) 6879 : cluster [DBG] pgmap v4289: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:01:41.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:01:41 smithi188 bash[23329]: cluster 2020-07-16T16:01:39.418720+0000 mgr.x (mgr.34562) 6879 : cluster [DBG] pgmap v4289: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:01:43.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:01:43 smithi132 bash[27079]: cluster 2020-07-16T16:01:41.419081+0000 mgr.x (mgr.34562) 6880 : cluster [DBG] pgmap v4290: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:01:43.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:01:43 smithi188 bash[23329]: cluster 2020-07-16T16:01:41.419081+0000 mgr.x (mgr.34562) 6880 : cluster [DBG] pgmap v4290: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:01:45.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:01:45 smithi132 bash[27079]: cluster 2020-07-16T16:01:43.419483+0000 mgr.x (mgr.34562) 6881 : cluster [DBG] pgmap v4291: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:01:45.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:01:45 smithi188 bash[23329]: cluster 2020-07-16T16:01:43.419483+0000 mgr.x (mgr.34562) 6881 : cluster [DBG] pgmap v4291: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:01:46.487 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:01:46.749 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:01:46.750 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 5m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:01:46.750 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 5m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:01:46.750 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 5m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:01:46.750 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 5m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:01:46.750 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 5m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:01:46.751 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:01:46.751 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:01:46.751 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 5m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:01:46.751 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 5m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:01:46.751 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:01:46.752 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:01:46.752 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:01:46.752 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:01:46.752 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:01:46.752 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:01:46.752 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:01:46.753 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:01:46.753 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 5m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:01:47.049 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:01:47.049 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:01:47.049 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:01:47.050 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:01:47.050 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:01:47.050 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:01:47.050 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:01:47.050 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:01:47.051 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:01:47.051 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:01:47.051 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:01:47.051 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:01:47.051 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:01:47.052 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:01:47.052 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:01:47.052 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:01:47.052 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:01:47.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:01:47 smithi132 bash[27079]: cluster 2020-07-16T16:01:45.419891+0000 mgr.x (mgr.34562) 6882 : cluster [DBG] pgmap v4292: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:01:47.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:01:47 smithi132 bash[27079]: audit 2020-07-16T16:01:47.048174+0000 mon.c (mon.1) 467 : audit [DBG] from='client.? 172.21.15.132:0/1053857490' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:01:47.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:01:47 smithi188 bash[23329]: cluster 2020-07-16T16:01:45.419891+0000 mgr.x (mgr.34562) 6882 : cluster [DBG] pgmap v4292: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:01:47.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:01:47 smithi188 bash[23329]: audit 2020-07-16T16:01:47.048174+0000 mon.c (mon.1) 467 : audit [DBG] from='client.? 172.21.15.132:0/1053857490' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:01:48.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:01:48 smithi132 bash[27079]: audit 2020-07-16T16:01:46.475729+0000 mgr.x (mgr.34562) 6883 : audit [DBG] from='client.29644 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:01:48.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:01:48 smithi132 bash[27079]: audit 2020-07-16T16:01:46.745376+0000 mgr.x (mgr.34562) 6884 : audit [DBG] from='client.29650 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:01:48.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:01:48 smithi188 bash[23329]: audit 2020-07-16T16:01:46.475729+0000 mgr.x (mgr.34562) 6883 : audit [DBG] from='client.29644 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:01:48.684 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:01:48 smithi188 bash[23329]: audit 2020-07-16T16:01:46.745376+0000 mgr.x (mgr.34562) 6884 : audit [DBG] from='client.29650 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:01:49.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:01:49 smithi132 bash[27079]: cluster 2020-07-16T16:01:47.420271+0000 mgr.x (mgr.34562) 6885 : cluster [DBG] pgmap v4293: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:01:49.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:01:49 smithi188 bash[23329]: cluster 2020-07-16T16:01:47.420271+0000 mgr.x (mgr.34562) 6885 : cluster [DBG] pgmap v4293: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:01:51.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:01:51 smithi132 bash[27079]: cluster 2020-07-16T16:01:49.420712+0000 mgr.x (mgr.34562) 6886 : cluster [DBG] pgmap v4294: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:01:51.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:01:51 smithi188 bash[23329]: cluster 2020-07-16T16:01:49.420712+0000 mgr.x (mgr.34562) 6886 : cluster [DBG] pgmap v4294: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:01:52.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:01:52 smithi132 bash[27079]: audit 2020-07-16T16:01:51.245810+0000 mon.b (mon.2) 1480 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:01:52.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:01:52 smithi132 bash[27079]: cephadm 2020-07-16T16:01:51.246556+0000 mgr.x (mgr.34562) 6887 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:01:52.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:01:52 smithi132 bash[27079]: cephadm 2020-07-16T16:01:51.246648+0000 mgr.x (mgr.34562) 6888 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:01:52.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:01:52 smithi188 bash[23329]: audit 2020-07-16T16:01:51.245810+0000 mon.b (mon.2) 1480 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:01:52.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:01:52 smithi188 bash[23329]: cephadm 2020-07-16T16:01:51.246556+0000 mgr.x (mgr.34562) 6887 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:01:52.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:01:52 smithi188 bash[23329]: cephadm 2020-07-16T16:01:51.246648+0000 mgr.x (mgr.34562) 6888 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:01:53.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:01:53 smithi132 bash[27079]: cluster 2020-07-16T16:01:51.421178+0000 mgr.x (mgr.34562) 6889 : cluster [DBG] pgmap v4295: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:01:53.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:01:53 smithi188 bash[23329]: cluster 2020-07-16T16:01:51.421178+0000 mgr.x (mgr.34562) 6889 : cluster [DBG] pgmap v4295: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:01:55.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:01:55 smithi132 bash[27079]: cluster 2020-07-16T16:01:53.421698+0000 mgr.x (mgr.34562) 6890 : cluster [DBG] pgmap v4296: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:01:55.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:01:55 smithi188 bash[23329]: cluster 2020-07-16T16:01:53.421698+0000 mgr.x (mgr.34562) 6890 : cluster [DBG] pgmap v4296: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:01:57.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:01:57 smithi132 bash[27079]: cluster 2020-07-16T16:01:55.422207+0000 mgr.x (mgr.34562) 6891 : cluster [DBG] pgmap v4297: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:01:57.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:01:57 smithi188 bash[23329]: cluster 2020-07-16T16:01:55.422207+0000 mgr.x (mgr.34562) 6891 : cluster [DBG] pgmap v4297: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:01:59.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:01:59 smithi132 bash[27079]: cluster 2020-07-16T16:01:57.422603+0000 mgr.x (mgr.34562) 6892 : cluster [DBG] pgmap v4298: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:01:59.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:01:59 smithi188 bash[23329]: cluster 2020-07-16T16:01:57.422603+0000 mgr.x (mgr.34562) 6892 : cluster [DBG] pgmap v4298: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:02:01.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:02:01 smithi132 bash[27079]: cluster 2020-07-16T16:01:59.422963+0000 mgr.x (mgr.34562) 6893 : cluster [DBG] pgmap v4299: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:02:01.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:02:01 smithi188 bash[23329]: cluster 2020-07-16T16:01:59.422963+0000 mgr.x (mgr.34562) 6893 : cluster [DBG] pgmap v4299: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:02:03.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:02:03 smithi132 bash[27079]: cluster 2020-07-16T16:02:01.423309+0000 mgr.x (mgr.34562) 6894 : cluster [DBG] pgmap v4300: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:02:03.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:02:03 smithi188 bash[23329]: cluster 2020-07-16T16:02:01.423309+0000 mgr.x (mgr.34562) 6894 : cluster [DBG] pgmap v4300: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:02:05.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:02:05 smithi132 bash[27079]: cluster 2020-07-16T16:02:03.423687+0000 mgr.x (mgr.34562) 6895 : cluster [DBG] pgmap v4301: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:02:05.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:02:05 smithi188 bash[23329]: cluster 2020-07-16T16:02:03.423687+0000 mgr.x (mgr.34562) 6895 : cluster [DBG] pgmap v4301: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:02:07.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:02:07 smithi132 bash[27079]: cluster 2020-07-16T16:02:05.424215+0000 mgr.x (mgr.34562) 6896 : cluster [DBG] pgmap v4302: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:02:07.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:02:07 smithi132 bash[27079]: audit 2020-07-16T16:02:06.262387+0000 mon.b (mon.2) 1481 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:02:07.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:02:07 smithi132 bash[27079]: cephadm 2020-07-16T16:02:06.263027+0000 mgr.x (mgr.34562) 6897 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:02:07.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:02:07 smithi132 bash[27079]: cephadm 2020-07-16T16:02:06.263277+0000 mgr.x (mgr.34562) 6898 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:02:07.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:02:07 smithi188 bash[23329]: cluster 2020-07-16T16:02:05.424215+0000 mgr.x (mgr.34562) 6896 : cluster [DBG] pgmap v4302: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:02:07.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:02:07 smithi188 bash[23329]: audit 2020-07-16T16:02:06.262387+0000 mon.b (mon.2) 1481 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:02:07.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:02:07 smithi188 bash[23329]: cephadm 2020-07-16T16:02:06.263027+0000 mgr.x (mgr.34562) 6897 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:02:07.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:02:07 smithi188 bash[23329]: cephadm 2020-07-16T16:02:06.263277+0000 mgr.x (mgr.34562) 6898 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:02:09.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:02:09 smithi132 bash[27079]: cluster 2020-07-16T16:02:07.424813+0000 mgr.x (mgr.34562) 6899 : cluster [DBG] pgmap v4303: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:02:09.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:02:09 smithi188 bash[23329]: cluster 2020-07-16T16:02:07.424813+0000 mgr.x (mgr.34562) 6899 : cluster [DBG] pgmap v4303: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:02:11.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:02:11 smithi132 bash[27079]: cluster 2020-07-16T16:02:09.425347+0000 mgr.x (mgr.34562) 6900 : cluster [DBG] pgmap v4304: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:02:11.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:02:11 smithi188 bash[23329]: cluster 2020-07-16T16:02:09.425347+0000 mgr.x (mgr.34562) 6900 : cluster [DBG] pgmap v4304: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:02:13.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:02:13 smithi132 bash[27079]: cluster 2020-07-16T16:02:11.425683+0000 mgr.x (mgr.34562) 6901 : cluster [DBG] pgmap v4305: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:02:13.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:02:13 smithi188 bash[23329]: cluster 2020-07-16T16:02:11.425683+0000 mgr.x (mgr.34562) 6901 : cluster [DBG] pgmap v4305: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:02:15.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:02:15 smithi132 bash[27079]: cluster 2020-07-16T16:02:13.426074+0000 mgr.x (mgr.34562) 6902 : cluster [DBG] pgmap v4306: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:02:15.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:02:15 smithi188 bash[23329]: cluster 2020-07-16T16:02:13.426074+0000 mgr.x (mgr.34562) 6902 : cluster [DBG] pgmap v4306: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:02:17.348 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:02:17.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:02:17 smithi132 bash[27079]: cluster 2020-07-16T16:02:15.426585+0000 mgr.x (mgr.34562) 6903 : cluster [DBG] pgmap v4307: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:02:17.612 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:02:17.613 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 6m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:02:17.613 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 6m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:02:17.613 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 6m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:02:17.613 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 6m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:02:17.613 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 6m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:02:17.614 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:02:17.614 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:02:17.614 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 6m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:02:17.614 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 6m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:02:17.614 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:02:17.615 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:02:17.615 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:02:17.615 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:02:17.615 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:02:17.615 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:02:17.616 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:02:17.616 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:02:17.616 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 6m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:02:17.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:02:17 smithi188 bash[23329]: cluster 2020-07-16T16:02:15.426585+0000 mgr.x (mgr.34562) 6903 : cluster [DBG] pgmap v4307: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:02:17.910 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:02:17.910 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:02:17.911 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:02:17.911 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:02:17.911 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:02:17.911 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:02:17.911 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:02:17.911 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:02:17.912 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:02:17.912 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:02:17.912 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:02:17.912 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:02:17.912 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:02:17.913 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:02:17.913 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:02:17.913 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:02:17.913 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:02:18.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:02:18 smithi132 bash[27079]: audit 2020-07-16T16:02:17.337077+0000 mgr.x (mgr.34562) 6904 : audit [DBG] from='client.29662 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:02:18.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:02:18 smithi132 bash[27079]: audit 2020-07-16T16:02:17.909548+0000 mon.c (mon.1) 468 : audit [DBG] from='client.? 172.21.15.132:0/1869781548' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:02:18.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:02:18 smithi188 bash[23329]: audit 2020-07-16T16:02:17.337077+0000 mgr.x (mgr.34562) 6904 : audit [DBG] from='client.29662 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:02:18.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:02:18 smithi188 bash[23329]: audit 2020-07-16T16:02:17.909548+0000 mon.c (mon.1) 468 : audit [DBG] from='client.? 172.21.15.132:0/1869781548' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:02:19.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:02:19 smithi132 bash[27079]: cluster 2020-07-16T16:02:17.426965+0000 mgr.x (mgr.34562) 6905 : cluster [DBG] pgmap v4308: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:02:19.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:02:19 smithi132 bash[27079]: audit 2020-07-16T16:02:17.608178+0000 mgr.x (mgr.34562) 6906 : audit [DBG] from='client.29668 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:02:19.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:02:19 smithi188 bash[23329]: cluster 2020-07-16T16:02:17.426965+0000 mgr.x (mgr.34562) 6905 : cluster [DBG] pgmap v4308: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:02:19.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:02:19 smithi188 bash[23329]: audit 2020-07-16T16:02:17.608178+0000 mgr.x (mgr.34562) 6906 : audit [DBG] from='client.29668 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:02:21.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:02:21 smithi132 bash[27079]: cluster 2020-07-16T16:02:19.427453+0000 mgr.x (mgr.34562) 6907 : cluster [DBG] pgmap v4309: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:02:21.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:02:21 smithi188 bash[23329]: cluster 2020-07-16T16:02:19.427453+0000 mgr.x (mgr.34562) 6907 : cluster [DBG] pgmap v4309: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:02:22.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:02:22 smithi132 bash[27079]: audit 2020-07-16T16:02:21.281346+0000 mon.b (mon.2) 1482 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:02:22.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:02:22 smithi132 bash[27079]: audit 2020-07-16T16:02:21.281710+0000 mgr.x (mgr.34562) 6908 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:02:22.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:02:22 smithi132 bash[27079]: audit 2020-07-16T16:02:21.282839+0000 mon.b (mon.2) 1483 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:02:22.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:02:22 smithi132 bash[27079]: audit 2020-07-16T16:02:21.283163+0000 mgr.x (mgr.34562) 6909 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:02:22.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:02:22 smithi132 bash[27079]: audit 2020-07-16T16:02:21.284037+0000 mon.b (mon.2) 1484 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:02:22.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:02:22 smithi132 bash[27079]: audit 2020-07-16T16:02:21.284329+0000 mgr.x (mgr.34562) 6910 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:02:22.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:02:22 smithi132 bash[27079]: cephadm 2020-07-16T16:02:21.285064+0000 mgr.x (mgr.34562) 6911 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:02:22.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:02:22 smithi132 bash[27079]: audit 2020-07-16T16:02:21.285510+0000 mon.b (mon.2) 1485 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:02:22.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:02:22 smithi132 bash[27079]: cephadm 2020-07-16T16:02:21.286339+0000 mgr.x (mgr.34562) 6912 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:02:22.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:02:22 smithi132 bash[27079]: audit 2020-07-16T16:02:21.286717+0000 mon.b (mon.2) 1486 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:02:22.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:02:22 smithi132 bash[27079]: cephadm 2020-07-16T16:02:21.287422+0000 mgr.x (mgr.34562) 6913 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:02:22.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:02:22 smithi132 bash[27079]: cephadm 2020-07-16T16:02:21.287638+0000 mgr.x (mgr.34562) 6914 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:02:22.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:02:22 smithi188 bash[23329]: audit 2020-07-16T16:02:21.281346+0000 mon.b (mon.2) 1482 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:02:22.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:02:22 smithi188 bash[23329]: audit 2020-07-16T16:02:21.281710+0000 mgr.x (mgr.34562) 6908 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:02:22.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:02:22 smithi188 bash[23329]: audit 2020-07-16T16:02:21.282839+0000 mon.b (mon.2) 1483 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:02:22.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:02:22 smithi188 bash[23329]: audit 2020-07-16T16:02:21.283163+0000 mgr.x (mgr.34562) 6909 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:02:22.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:02:22 smithi188 bash[23329]: audit 2020-07-16T16:02:21.284037+0000 mon.b (mon.2) 1484 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:02:22.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:02:22 smithi188 bash[23329]: audit 2020-07-16T16:02:21.284329+0000 mgr.x (mgr.34562) 6910 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:02:22.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:02:22 smithi188 bash[23329]: cephadm 2020-07-16T16:02:21.285064+0000 mgr.x (mgr.34562) 6911 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:02:22.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:02:22 smithi188 bash[23329]: audit 2020-07-16T16:02:21.285510+0000 mon.b (mon.2) 1485 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:02:22.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:02:22 smithi188 bash[23329]: cephadm 2020-07-16T16:02:21.286339+0000 mgr.x (mgr.34562) 6912 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:02:22.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:02:22 smithi188 bash[23329]: audit 2020-07-16T16:02:21.286717+0000 mon.b (mon.2) 1486 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:02:22.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:02:22 smithi188 bash[23329]: cephadm 2020-07-16T16:02:21.287422+0000 mgr.x (mgr.34562) 6913 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:02:22.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:02:22 smithi188 bash[23329]: cephadm 2020-07-16T16:02:21.287638+0000 mgr.x (mgr.34562) 6914 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:02:23.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:02:23 smithi132 bash[27079]: cluster 2020-07-16T16:02:21.427826+0000 mgr.x (mgr.34562) 6915 : cluster [DBG] pgmap v4310: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:02:23.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:02:23 smithi188 bash[23329]: cluster 2020-07-16T16:02:21.427826+0000 mgr.x (mgr.34562) 6915 : cluster [DBG] pgmap v4310: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:02:24.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:02:24 smithi132 bash[27079]: audit 2020-07-16T16:02:24.158004+0000 mon.b (mon.2) 1487 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:02:24.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:02:24 smithi188 bash[23329]: audit 2020-07-16T16:02:24.158004+0000 mon.b (mon.2) 1487 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:02:25.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:02:25 smithi132 bash[27079]: cluster 2020-07-16T16:02:23.428380+0000 mgr.x (mgr.34562) 6916 : cluster [DBG] pgmap v4311: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:02:25.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:02:25 smithi132 bash[27079]: cephadm 2020-07-16T16:02:24.158606+0000 mgr.x (mgr.34562) 6917 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:02:25.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:02:25 smithi132 bash[27079]: cephadm 2020-07-16T16:02:24.158756+0000 mgr.x (mgr.34562) 6918 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:02:25.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:02:25 smithi188 bash[23329]: cluster 2020-07-16T16:02:23.428380+0000 mgr.x (mgr.34562) 6916 : cluster [DBG] pgmap v4311: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:02:25.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:02:25 smithi188 bash[23329]: cephadm 2020-07-16T16:02:24.158606+0000 mgr.x (mgr.34562) 6917 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:02:25.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:02:25 smithi188 bash[23329]: cephadm 2020-07-16T16:02:24.158756+0000 mgr.x (mgr.34562) 6918 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:02:27.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:02:27 smithi132 bash[27079]: cluster 2020-07-16T16:02:25.428838+0000 mgr.x (mgr.34562) 6919 : cluster [DBG] pgmap v4312: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:02:27.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:02:27 smithi188 bash[23329]: cluster 2020-07-16T16:02:25.428838+0000 mgr.x (mgr.34562) 6919 : cluster [DBG] pgmap v4312: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:02:29.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:02:29 smithi132 bash[27079]: cluster 2020-07-16T16:02:27.429398+0000 mgr.x (mgr.34562) 6920 : cluster [DBG] pgmap v4313: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:02:29.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:02:29 smithi188 bash[23329]: cluster 2020-07-16T16:02:27.429398+0000 mgr.x (mgr.34562) 6920 : cluster [DBG] pgmap v4313: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:02:31.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:02:31 smithi188 bash[23329]: cluster 2020-07-16T16:02:29.429793+0000 mgr.x (mgr.34562) 6921 : cluster [DBG] pgmap v4314: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:02:31.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:02:31 smithi132 bash[27079]: cluster 2020-07-16T16:02:29.429793+0000 mgr.x (mgr.34562) 6921 : cluster [DBG] pgmap v4314: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:02:33.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:02:33 smithi188 bash[23329]: cluster 2020-07-16T16:02:31.430143+0000 mgr.x (mgr.34562) 6922 : cluster [DBG] pgmap v4315: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:02:33.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:02:33 smithi132 bash[27079]: cluster 2020-07-16T16:02:31.430143+0000 mgr.x (mgr.34562) 6922 : cluster [DBG] pgmap v4315: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:02:35.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:02:35 smithi188 bash[23329]: cluster 2020-07-16T16:02:33.430677+0000 mgr.x (mgr.34562) 6923 : cluster [DBG] pgmap v4316: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:02:35.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:02:35 smithi132 bash[27079]: cluster 2020-07-16T16:02:33.430677+0000 mgr.x (mgr.34562) 6923 : cluster [DBG] pgmap v4316: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:02:37.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:02:37 smithi188 bash[23329]: cluster 2020-07-16T16:02:35.431118+0000 mgr.x (mgr.34562) 6924 : cluster [DBG] pgmap v4317: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:02:37.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:02:37 smithi132 bash[27079]: cluster 2020-07-16T16:02:35.431118+0000 mgr.x (mgr.34562) 6924 : cluster [DBG] pgmap v4317: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:02:39.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:02:39 smithi188 bash[23329]: cluster 2020-07-16T16:02:37.431585+0000 mgr.x (mgr.34562) 6925 : cluster [DBG] pgmap v4318: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:02:39.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:02:39 smithi188 bash[23329]: audit 2020-07-16T16:02:39.174498+0000 mon.b (mon.2) 1488 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:02:39.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:02:39 smithi132 bash[27079]: cluster 2020-07-16T16:02:37.431585+0000 mgr.x (mgr.34562) 6925 : cluster [DBG] pgmap v4318: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:02:39.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:02:39 smithi132 bash[27079]: audit 2020-07-16T16:02:39.174498+0000 mon.b (mon.2) 1488 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:02:40.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:02:40 smithi188 bash[23329]: cephadm 2020-07-16T16:02:39.175205+0000 mgr.x (mgr.34562) 6926 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:02:40.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:02:40 smithi188 bash[23329]: cephadm 2020-07-16T16:02:39.175620+0000 mgr.x (mgr.34562) 6927 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:02:40.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:02:40 smithi132 bash[27079]: cephadm 2020-07-16T16:02:39.175205+0000 mgr.x (mgr.34562) 6926 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:02:40.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:02:40 smithi132 bash[27079]: cephadm 2020-07-16T16:02:39.175620+0000 mgr.x (mgr.34562) 6927 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:02:41.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:02:41 smithi188 bash[23329]: cluster 2020-07-16T16:02:39.431953+0000 mgr.x (mgr.34562) 6928 : cluster [DBG] pgmap v4319: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:02:41.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:02:41 smithi132 bash[27079]: cluster 2020-07-16T16:02:39.431953+0000 mgr.x (mgr.34562) 6928 : cluster [DBG] pgmap v4319: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:02:43.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:02:43 smithi188 bash[23329]: cluster 2020-07-16T16:02:41.432288+0000 mgr.x (mgr.34562) 6929 : cluster [DBG] pgmap v4320: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:02:43.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:02:43 smithi132 bash[27079]: cluster 2020-07-16T16:02:41.432288+0000 mgr.x (mgr.34562) 6929 : cluster [DBG] pgmap v4320: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:02:45.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:02:45 smithi188 bash[23329]: cluster 2020-07-16T16:02:43.432826+0000 mgr.x (mgr.34562) 6930 : cluster [DBG] pgmap v4321: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:02:45.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:02:45 smithi132 bash[27079]: cluster 2020-07-16T16:02:43.432826+0000 mgr.x (mgr.34562) 6930 : cluster [DBG] pgmap v4321: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:02:47.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:02:47 smithi188 bash[23329]: cluster 2020-07-16T16:02:45.433342+0000 mgr.x (mgr.34562) 6931 : cluster [DBG] pgmap v4322: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:02:47.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:02:47 smithi132 bash[27079]: cluster 2020-07-16T16:02:45.433342+0000 mgr.x (mgr.34562) 6931 : cluster [DBG] pgmap v4322: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:02:48.206 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:02:48.472 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:02:48.472 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 6m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:02:48.473 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 6m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:02:48.473 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 6m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:02:48.473 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 6m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:02:48.473 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 6m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:02:48.473 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:02:48.474 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:02:48.474 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 6m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:02:48.474 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 6m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:02:48.474 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:02:48.474 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:02:48.475 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:02:48.475 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:02:48.475 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:02:48.475 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:02:48.475 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:02:48.476 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:02:48.476 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 6m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:02:48.766 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:02:48.766 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:02:48.767 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:02:48.767 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:02:48.767 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:02:48.767 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:02:48.767 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:02:48.768 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:02:48.768 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:02:48.768 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:02:48.768 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:02:48.768 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:02:48.769 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:02:48.769 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:02:48.769 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:02:48.769 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:02:48.769 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:02:49.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:02:49 smithi188 bash[23329]: cluster 2020-07-16T16:02:47.433756+0000 mgr.x (mgr.34562) 6932 : cluster [DBG] pgmap v4323: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:02:49.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:02:49 smithi188 bash[23329]: audit 2020-07-16T16:02:48.194640+0000 mgr.x (mgr.34562) 6933 : audit [DBG] from='client.29680 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:02:49.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:02:49 smithi188 bash[23329]: audit 2020-07-16T16:02:48.765381+0000 mon.c (mon.1) 469 : audit [DBG] from='client.? 172.21.15.132:0/2407302826' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:02:49.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:02:49 smithi132 bash[27079]: cluster 2020-07-16T16:02:47.433756+0000 mgr.x (mgr.34562) 6932 : cluster [DBG] pgmap v4323: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:02:49.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:02:49 smithi132 bash[27079]: audit 2020-07-16T16:02:48.194640+0000 mgr.x (mgr.34562) 6933 : audit [DBG] from='client.29680 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:02:49.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:02:49 smithi132 bash[27079]: audit 2020-07-16T16:02:48.765381+0000 mon.c (mon.1) 469 : audit [DBG] from='client.? 172.21.15.132:0/2407302826' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:02:50.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:02:50 smithi188 bash[23329]: audit 2020-07-16T16:02:48.464847+0000 mgr.x (mgr.34562) 6934 : audit [DBG] from='client.29686 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:02:50.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:02:50 smithi132 bash[27079]: audit 2020-07-16T16:02:48.464847+0000 mgr.x (mgr.34562) 6934 : audit [DBG] from='client.29686 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:02:51.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:02:51 smithi188 bash[23329]: cluster 2020-07-16T16:02:49.434267+0000 mgr.x (mgr.34562) 6935 : cluster [DBG] pgmap v4324: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:02:51.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:02:51 smithi132 bash[27079]: cluster 2020-07-16T16:02:49.434267+0000 mgr.x (mgr.34562) 6935 : cluster [DBG] pgmap v4324: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:02:53.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:02:53 smithi188 bash[23329]: cluster 2020-07-16T16:02:51.434743+0000 mgr.x (mgr.34562) 6936 : cluster [DBG] pgmap v4325: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:02:53.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:02:53 smithi132 bash[27079]: cluster 2020-07-16T16:02:51.434743+0000 mgr.x (mgr.34562) 6936 : cluster [DBG] pgmap v4325: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:02:54.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:02:54 smithi188 bash[23329]: audit 2020-07-16T16:02:54.191083+0000 mon.b (mon.2) 1489 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:02:54.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:02:54 smithi132 bash[27079]: audit 2020-07-16T16:02:54.191083+0000 mon.b (mon.2) 1489 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:02:55.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:02:55 smithi188 bash[23329]: cluster 2020-07-16T16:02:53.435201+0000 mgr.x (mgr.34562) 6937 : cluster [DBG] pgmap v4326: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:02:55.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:02:55 smithi188 bash[23329]: cephadm 2020-07-16T16:02:54.191889+0000 mgr.x (mgr.34562) 6938 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:02:55.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:02:55 smithi188 bash[23329]: cephadm 2020-07-16T16:02:54.192341+0000 mgr.x (mgr.34562) 6939 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:02:55.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:02:55 smithi132 bash[27079]: cluster 2020-07-16T16:02:53.435201+0000 mgr.x (mgr.34562) 6937 : cluster [DBG] pgmap v4326: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:02:55.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:02:55 smithi132 bash[27079]: cephadm 2020-07-16T16:02:54.191889+0000 mgr.x (mgr.34562) 6938 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:02:55.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:02:55 smithi132 bash[27079]: cephadm 2020-07-16T16:02:54.192341+0000 mgr.x (mgr.34562) 6939 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:02:57.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:02:57 smithi188 bash[23329]: cluster 2020-07-16T16:02:55.435596+0000 mgr.x (mgr.34562) 6940 : cluster [DBG] pgmap v4327: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:02:57.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:02:57 smithi132 bash[27079]: cluster 2020-07-16T16:02:55.435596+0000 mgr.x (mgr.34562) 6940 : cluster [DBG] pgmap v4327: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:02:59.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:02:59 smithi188 bash[23329]: cluster 2020-07-16T16:02:57.436139+0000 mgr.x (mgr.34562) 6941 : cluster [DBG] pgmap v4328: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:02:59.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:02:59 smithi132 bash[27079]: cluster 2020-07-16T16:02:57.436139+0000 mgr.x (mgr.34562) 6941 : cluster [DBG] pgmap v4328: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:03:01.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:03:01 smithi188 bash[23329]: cluster 2020-07-16T16:02:59.436598+0000 mgr.x (mgr.34562) 6942 : cluster [DBG] pgmap v4329: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:03:01.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:03:01 smithi132 bash[27079]: cluster 2020-07-16T16:02:59.436598+0000 mgr.x (mgr.34562) 6942 : cluster [DBG] pgmap v4329: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:03:03.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:03:03 smithi188 bash[23329]: cluster 2020-07-16T16:03:01.436922+0000 mgr.x (mgr.34562) 6943 : cluster [DBG] pgmap v4330: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:03:03.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:03:03 smithi132 bash[27079]: cluster 2020-07-16T16:03:01.436922+0000 mgr.x (mgr.34562) 6943 : cluster [DBG] pgmap v4330: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:03:05.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:03:05 smithi188 bash[23329]: cluster 2020-07-16T16:03:03.437347+0000 mgr.x (mgr.34562) 6944 : cluster [DBG] pgmap v4331: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:03:05.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:03:05 smithi132 bash[27079]: cluster 2020-07-16T16:03:03.437347+0000 mgr.x (mgr.34562) 6944 : cluster [DBG] pgmap v4331: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:03:07.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:03:07 smithi188 bash[23329]: cluster 2020-07-16T16:03:05.437805+0000 mgr.x (mgr.34562) 6945 : cluster [DBG] pgmap v4332: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:03:07.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:03:07 smithi132 bash[27079]: cluster 2020-07-16T16:03:05.437805+0000 mgr.x (mgr.34562) 6945 : cluster [DBG] pgmap v4332: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:03:09.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:03:09 smithi188 bash[23329]: cluster 2020-07-16T16:03:07.438465+0000 mgr.x (mgr.34562) 6946 : cluster [DBG] pgmap v4333: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:03:09.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:03:09 smithi188 bash[23329]: audit 2020-07-16T16:03:09.207855+0000 mon.b (mon.2) 1490 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:03:09.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:03:09 smithi132 bash[27079]: cluster 2020-07-16T16:03:07.438465+0000 mgr.x (mgr.34562) 6946 : cluster [DBG] pgmap v4333: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:03:09.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:03:09 smithi132 bash[27079]: audit 2020-07-16T16:03:09.207855+0000 mon.b (mon.2) 1490 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:03:10.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:03:10 smithi188 bash[23329]: cephadm 2020-07-16T16:03:09.208553+0000 mgr.x (mgr.34562) 6947 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:03:10.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:03:10 smithi188 bash[23329]: cephadm 2020-07-16T16:03:09.208677+0000 mgr.x (mgr.34562) 6948 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:03:10.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:03:10 smithi132 bash[27079]: cephadm 2020-07-16T16:03:09.208553+0000 mgr.x (mgr.34562) 6947 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:03:10.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:03:10 smithi132 bash[27079]: cephadm 2020-07-16T16:03:09.208677+0000 mgr.x (mgr.34562) 6948 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:03:11.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:03:11 smithi188 bash[23329]: cluster 2020-07-16T16:03:09.438872+0000 mgr.x (mgr.34562) 6949 : cluster [DBG] pgmap v4334: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:03:11.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:03:11 smithi132 bash[27079]: cluster 2020-07-16T16:03:09.438872+0000 mgr.x (mgr.34562) 6949 : cluster [DBG] pgmap v4334: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:03:12.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:03:12 smithi132 bash[27079]: cluster 2020-07-16T16:03:11.439198+0000 mgr.x (mgr.34562) 6950 : cluster [DBG] pgmap v4335: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:03:12.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:03:12 smithi188 bash[23329]: cluster 2020-07-16T16:03:11.439198+0000 mgr.x (mgr.34562) 6950 : cluster [DBG] pgmap v4335: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:03:14.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:03:14 smithi132 bash[27079]: cluster 2020-07-16T16:03:13.439510+0000 mgr.x (mgr.34562) 6951 : cluster [DBG] pgmap v4336: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:03:14.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:03:14 smithi188 bash[23329]: cluster 2020-07-16T16:03:13.439510+0000 mgr.x (mgr.34562) 6951 : cluster [DBG] pgmap v4336: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:03:17.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:03:16 smithi188 bash[23329]: cluster 2020-07-16T16:03:15.439927+0000 mgr.x (mgr.34562) 6952 : cluster [DBG] pgmap v4337: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:03:17.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:03:16 smithi132 bash[27079]: cluster 2020-07-16T16:03:15.439927+0000 mgr.x (mgr.34562) 6952 : cluster [DBG] pgmap v4337: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:03:19.064 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:03:19.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:03:18 smithi188 bash[23329]: cluster 2020-07-16T16:03:17.440471+0000 mgr.x (mgr.34562) 6953 : cluster [DBG] pgmap v4338: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:03:19.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:03:18 smithi132 bash[27079]: cluster 2020-07-16T16:03:17.440471+0000 mgr.x (mgr.34562) 6953 : cluster [DBG] pgmap v4338: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:03:19.328 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:03:19.328 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 7m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:03:19.328 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 7m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:03:19.328 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 7m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:03:19.329 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 7m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:03:19.329 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 7m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:03:19.329 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:03:19.329 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:03:19.329 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 7m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:03:19.330 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 7m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:03:19.330 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:03:19.330 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:03:19.330 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:03:19.330 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:03:19.331 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:03:19.331 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:03:19.331 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:03:19.331 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:03:19.331 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 7m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:03:19.624 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:03:19.624 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:03:19.625 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:03:19.625 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:03:19.625 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:03:19.625 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:03:19.625 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:03:19.626 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:03:19.626 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:03:19.626 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:03:19.626 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:03:19.626 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:03:19.627 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:03:19.627 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:03:19.627 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:03:19.627 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:03:19.627 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:03:20.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:03:19 smithi188 bash[23329]: audit 2020-07-16T16:03:19.052352+0000 mgr.x (mgr.34562) 6954 : audit [DBG] from='client.29698 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:03:20.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:03:19 smithi188 bash[23329]: audit 2020-07-16T16:03:19.323811+0000 mgr.x (mgr.34562) 6955 : audit [DBG] from='client.29704 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:03:20.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:03:19 smithi188 bash[23329]: audit 2020-07-16T16:03:19.623422+0000 mon.c (mon.1) 470 : audit [DBG] from='client.? 172.21.15.132:0/3592131630' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:03:20.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:03:19 smithi132 bash[27079]: audit 2020-07-16T16:03:19.052352+0000 mgr.x (mgr.34562) 6954 : audit [DBG] from='client.29698 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:03:20.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:03:19 smithi132 bash[27079]: audit 2020-07-16T16:03:19.323811+0000 mgr.x (mgr.34562) 6955 : audit [DBG] from='client.29704 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:03:20.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:03:19 smithi132 bash[27079]: audit 2020-07-16T16:03:19.623422+0000 mon.c (mon.1) 470 : audit [DBG] from='client.? 172.21.15.132:0/3592131630' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:03:21.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:03:20 smithi188 bash[23329]: cluster 2020-07-16T16:03:19.440937+0000 mgr.x (mgr.34562) 6956 : cluster [DBG] pgmap v4339: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:03:21.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:03:20 smithi132 bash[27079]: cluster 2020-07-16T16:03:19.440937+0000 mgr.x (mgr.34562) 6956 : cluster [DBG] pgmap v4339: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:03:23.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:03:22 smithi188 bash[23329]: cluster 2020-07-16T16:03:21.441354+0000 mgr.x (mgr.34562) 6957 : cluster [DBG] pgmap v4340: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:03:23.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:03:22 smithi132 bash[27079]: cluster 2020-07-16T16:03:21.441354+0000 mgr.x (mgr.34562) 6957 : cluster [DBG] pgmap v4340: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:03:25.018 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:03:24 smithi132 bash[27079]: cluster 2020-07-16T16:03:23.441801+0000 mgr.x (mgr.34562) 6958 : cluster [DBG] pgmap v4341: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:03:25.019 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:03:24 smithi132 bash[27079]: audit 2020-07-16T16:03:24.220357+0000 mon.b (mon.2) 1491 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:03:25.019 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:03:24 smithi132 bash[27079]: audit 2020-07-16T16:03:24.220761+0000 mgr.x (mgr.34562) 6959 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:03:25.019 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:03:24 smithi132 bash[27079]: audit 2020-07-16T16:03:24.221835+0000 mon.b (mon.2) 1492 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:03:25.019 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:03:24 smithi132 bash[27079]: audit 2020-07-16T16:03:24.222141+0000 mgr.x (mgr.34562) 6960 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:03:25.019 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:03:24 smithi132 bash[27079]: audit 2020-07-16T16:03:24.223063+0000 mon.b (mon.2) 1493 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:03:25.020 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:03:24 smithi132 bash[27079]: audit 2020-07-16T16:03:24.223368+0000 mgr.x (mgr.34562) 6961 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:03:25.020 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:03:24 smithi132 bash[27079]: cephadm 2020-07-16T16:03:24.224119+0000 mgr.x (mgr.34562) 6962 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:03:25.020 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:03:24 smithi132 bash[27079]: audit 2020-07-16T16:03:24.224407+0000 mon.b (mon.2) 1494 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:03:25.020 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:03:24 smithi132 bash[27079]: cephadm 2020-07-16T16:03:24.225266+0000 mgr.x (mgr.34562) 6963 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:03:25.020 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:03:24 smithi132 bash[27079]: audit 2020-07-16T16:03:24.225636+0000 mon.b (mon.2) 1495 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:03:25.021 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:03:24 smithi132 bash[27079]: cephadm 2020-07-16T16:03:24.226339+0000 mgr.x (mgr.34562) 6964 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:03:25.021 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:03:24 smithi132 bash[27079]: cephadm 2020-07-16T16:03:24.226409+0000 mgr.x (mgr.34562) 6965 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:03:25.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:03:24 smithi188 bash[23329]: cluster 2020-07-16T16:03:23.441801+0000 mgr.x (mgr.34562) 6958 : cluster [DBG] pgmap v4341: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:03:25.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:03:24 smithi188 bash[23329]: audit 2020-07-16T16:03:24.220357+0000 mon.b (mon.2) 1491 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:03:25.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:03:24 smithi188 bash[23329]: audit 2020-07-16T16:03:24.220761+0000 mgr.x (mgr.34562) 6959 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:03:25.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:03:24 smithi188 bash[23329]: audit 2020-07-16T16:03:24.221835+0000 mon.b (mon.2) 1492 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:03:25.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:03:24 smithi188 bash[23329]: audit 2020-07-16T16:03:24.222141+0000 mgr.x (mgr.34562) 6960 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:03:25.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:03:24 smithi188 bash[23329]: audit 2020-07-16T16:03:24.223063+0000 mon.b (mon.2) 1493 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:03:25.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:03:24 smithi188 bash[23329]: audit 2020-07-16T16:03:24.223368+0000 mgr.x (mgr.34562) 6961 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:03:25.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:03:24 smithi188 bash[23329]: cephadm 2020-07-16T16:03:24.224119+0000 mgr.x (mgr.34562) 6962 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:03:25.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:03:24 smithi188 bash[23329]: audit 2020-07-16T16:03:24.224407+0000 mon.b (mon.2) 1494 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:03:25.172 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:03:24 smithi188 bash[23329]: cephadm 2020-07-16T16:03:24.225266+0000 mgr.x (mgr.34562) 6963 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:03:25.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:03:24 smithi188 bash[23329]: audit 2020-07-16T16:03:24.225636+0000 mon.b (mon.2) 1495 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:03:25.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:03:24 smithi188 bash[23329]: cephadm 2020-07-16T16:03:24.226339+0000 mgr.x (mgr.34562) 6964 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:03:25.173 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:03:24 smithi188 bash[23329]: cephadm 2020-07-16T16:03:24.226409+0000 mgr.x (mgr.34562) 6965 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:03:27.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:03:26 smithi188 bash[23329]: cluster 2020-07-16T16:03:25.442279+0000 mgr.x (mgr.34562) 6966 : cluster [DBG] pgmap v4342: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:03:27.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:03:26 smithi132 bash[27079]: cluster 2020-07-16T16:03:25.442279+0000 mgr.x (mgr.34562) 6966 : cluster [DBG] pgmap v4342: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:03:28.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:03:27 smithi188 bash[23329]: audit 2020-07-16T16:03:26.919386+0000 mon.b (mon.2) 1496 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:03:28.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:03:27 smithi188 bash[23329]: cephadm 2020-07-16T16:03:26.919957+0000 mgr.x (mgr.34562) 6967 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:03:28.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:03:27 smithi188 bash[23329]: cephadm 2020-07-16T16:03:26.920031+0000 mgr.x (mgr.34562) 6968 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:03:28.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:03:27 smithi132 bash[27079]: audit 2020-07-16T16:03:26.919386+0000 mon.b (mon.2) 1496 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:03:28.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:03:27 smithi132 bash[27079]: cephadm 2020-07-16T16:03:26.919957+0000 mgr.x (mgr.34562) 6967 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:03:28.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:03:27 smithi132 bash[27079]: cephadm 2020-07-16T16:03:26.920031+0000 mgr.x (mgr.34562) 6968 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:03:29.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:03:28 smithi188 bash[23329]: cluster 2020-07-16T16:03:27.442687+0000 mgr.x (mgr.34562) 6969 : cluster [DBG] pgmap v4343: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:03:29.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:03:28 smithi132 bash[27079]: cluster 2020-07-16T16:03:27.442687+0000 mgr.x (mgr.34562) 6969 : cluster [DBG] pgmap v4343: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:03:31.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:03:30 smithi188 bash[23329]: cluster 2020-07-16T16:03:29.443179+0000 mgr.x (mgr.34562) 6970 : cluster [DBG] pgmap v4344: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:03:31.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:03:30 smithi132 bash[27079]: cluster 2020-07-16T16:03:29.443179+0000 mgr.x (mgr.34562) 6970 : cluster [DBG] pgmap v4344: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:03:33.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:03:32 smithi188 bash[23329]: cluster 2020-07-16T16:03:31.443583+0000 mgr.x (mgr.34562) 6971 : cluster [DBG] pgmap v4345: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:03:33.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:03:32 smithi132 bash[27079]: cluster 2020-07-16T16:03:31.443583+0000 mgr.x (mgr.34562) 6971 : cluster [DBG] pgmap v4345: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:03:35.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:03:34 smithi132 bash[27079]: cluster 2020-07-16T16:03:33.444011+0000 mgr.x (mgr.34562) 6972 : cluster [DBG] pgmap v4346: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:03:35.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:03:34 smithi188 bash[23329]: cluster 2020-07-16T16:03:33.444011+0000 mgr.x (mgr.34562) 6972 : cluster [DBG] pgmap v4346: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:03:37.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:03:36 smithi132 bash[27079]: cluster 2020-07-16T16:03:35.444473+0000 mgr.x (mgr.34562) 6973 : cluster [DBG] pgmap v4347: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:03:37.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:03:36 smithi188 bash[23329]: cluster 2020-07-16T16:03:35.444473+0000 mgr.x (mgr.34562) 6973 : cluster [DBG] pgmap v4347: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:03:39.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:03:38 smithi132 bash[27079]: cluster 2020-07-16T16:03:37.444946+0000 mgr.x (mgr.34562) 6974 : cluster [DBG] pgmap v4348: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:03:39.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:03:38 smithi188 bash[23329]: cluster 2020-07-16T16:03:37.444946+0000 mgr.x (mgr.34562) 6974 : cluster [DBG] pgmap v4348: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:03:41.284 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:03:40 smithi132 bash[27079]: cluster 2020-07-16T16:03:39.445348+0000 mgr.x (mgr.34562) 6975 : cluster [DBG] pgmap v4349: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:03:41.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:03:40 smithi188 bash[23329]: cluster 2020-07-16T16:03:39.445348+0000 mgr.x (mgr.34562) 6975 : cluster [DBG] pgmap v4349: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:03:42.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:03:41 smithi132 bash[27079]: audit 2020-07-16T16:03:41.923984+0000 mon.b (mon.2) 1497 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:03:42.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:03:41 smithi188 bash[23329]: audit 2020-07-16T16:03:41.923984+0000 mon.b (mon.2) 1497 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:03:43.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:03:42 smithi132 bash[27079]: cluster 2020-07-16T16:03:41.445754+0000 mgr.x (mgr.34562) 6976 : cluster [DBG] pgmap v4350: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:03:43.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:03:42 smithi132 bash[27079]: cephadm 2020-07-16T16:03:41.924721+0000 mgr.x (mgr.34562) 6977 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:03:43.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:03:42 smithi132 bash[27079]: cephadm 2020-07-16T16:03:41.925199+0000 mgr.x (mgr.34562) 6978 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:03:43.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:03:42 smithi188 bash[23329]: cluster 2020-07-16T16:03:41.445754+0000 mgr.x (mgr.34562) 6976 : cluster [DBG] pgmap v4350: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:03:43.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:03:42 smithi188 bash[23329]: cephadm 2020-07-16T16:03:41.924721+0000 mgr.x (mgr.34562) 6977 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:03:43.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:03:42 smithi188 bash[23329]: cephadm 2020-07-16T16:03:41.925199+0000 mgr.x (mgr.34562) 6978 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:03:45.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:03:44 smithi132 bash[27079]: cluster 2020-07-16T16:03:43.446171+0000 mgr.x (mgr.34562) 6979 : cluster [DBG] pgmap v4351: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:03:45.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:03:44 smithi188 bash[23329]: cluster 2020-07-16T16:03:43.446171+0000 mgr.x (mgr.34562) 6979 : cluster [DBG] pgmap v4351: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:03:47.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:03:46 smithi132 bash[27079]: cluster 2020-07-16T16:03:45.446618+0000 mgr.x (mgr.34562) 6980 : cluster [DBG] pgmap v4352: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:03:47.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:03:46 smithi188 bash[23329]: cluster 2020-07-16T16:03:45.446618+0000 mgr.x (mgr.34562) 6980 : cluster [DBG] pgmap v4352: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:03:49.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:03:48 smithi132 bash[27079]: cluster 2020-07-16T16:03:47.447156+0000 mgr.x (mgr.34562) 6981 : cluster [DBG] pgmap v4353: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:03:49.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:03:48 smithi188 bash[23329]: cluster 2020-07-16T16:03:47.447156+0000 mgr.x (mgr.34562) 6981 : cluster [DBG] pgmap v4353: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:03:49.940 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:03:50.202 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:03:50.202 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 7m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:03:50.203 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 7m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:03:50.203 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 7m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:03:50.203 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 7m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:03:50.203 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 7m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:03:50.204 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:03:50.204 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:03:50.204 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 7m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:03:50.204 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 7m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:03:50.204 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:03:50.205 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:03:50.205 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:03:50.205 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:03:50.205 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:03:50.206 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:03:50.206 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:03:50.206 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:03:50.206 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 7m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:03:50.502 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:03:50.502 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:03:50.503 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:03:50.503 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:03:50.503 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:03:50.503 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:03:50.504 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:03:50.504 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:03:50.504 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:03:50.504 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:03:50.504 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:03:50.505 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:03:50.505 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:03:50.505 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:03:50.505 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:03:50.505 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:03:50.506 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:03:51.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:03:50 smithi132 bash[27079]: cluster 2020-07-16T16:03:49.447564+0000 mgr.x (mgr.34562) 6982 : cluster [DBG] pgmap v4354: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:03:51.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:03:50 smithi132 bash[27079]: audit 2020-07-16T16:03:49.928556+0000 mgr.x (mgr.34562) 6983 : audit [DBG] from='client.29716 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:03:51.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:03:50 smithi132 bash[27079]: audit 2020-07-16T16:03:50.198190+0000 mgr.x (mgr.34562) 6984 : audit [DBG] from='client.29722 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:03:51.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:03:50 smithi132 bash[27079]: audit 2020-07-16T16:03:50.501617+0000 mon.c (mon.1) 471 : audit [DBG] from='client.? 172.21.15.132:0/3820571013' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:03:51.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:03:50 smithi188 bash[23329]: cluster 2020-07-16T16:03:49.447564+0000 mgr.x (mgr.34562) 6982 : cluster [DBG] pgmap v4354: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:03:51.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:03:50 smithi188 bash[23329]: audit 2020-07-16T16:03:49.928556+0000 mgr.x (mgr.34562) 6983 : audit [DBG] from='client.29716 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:03:51.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:03:50 smithi188 bash[23329]: audit 2020-07-16T16:03:50.198190+0000 mgr.x (mgr.34562) 6984 : audit [DBG] from='client.29722 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:03:51.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:03:50 smithi188 bash[23329]: audit 2020-07-16T16:03:50.501617+0000 mon.c (mon.1) 471 : audit [DBG] from='client.? 172.21.15.132:0/3820571013' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:03:53.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:03:52 smithi132 bash[27079]: cluster 2020-07-16T16:03:51.448002+0000 mgr.x (mgr.34562) 6985 : cluster [DBG] pgmap v4355: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:03:53.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:03:52 smithi188 bash[23329]: cluster 2020-07-16T16:03:51.448002+0000 mgr.x (mgr.34562) 6985 : cluster [DBG] pgmap v4355: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:03:55.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:03:54 smithi132 bash[27079]: cluster 2020-07-16T16:03:53.448626+0000 mgr.x (mgr.34562) 6986 : cluster [DBG] pgmap v4356: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:03:55.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:03:54 smithi188 bash[23329]: cluster 2020-07-16T16:03:53.448626+0000 mgr.x (mgr.34562) 6986 : cluster [DBG] pgmap v4356: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:03:57.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:03:56 smithi132 bash[27079]: cluster 2020-07-16T16:03:55.449089+0000 mgr.x (mgr.34562) 6987 : cluster [DBG] pgmap v4357: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:03:57.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:03:56 smithi132 bash[27079]: audit 2020-07-16T16:03:56.926752+0000 mon.b (mon.2) 1498 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:03:57.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:03:56 smithi188 bash[23329]: cluster 2020-07-16T16:03:55.449089+0000 mgr.x (mgr.34562) 6987 : cluster [DBG] pgmap v4357: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:03:57.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:03:56 smithi188 bash[23329]: audit 2020-07-16T16:03:56.926752+0000 mon.b (mon.2) 1498 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:03:58.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:03:57 smithi132 bash[27079]: cephadm 2020-07-16T16:03:56.927438+0000 mgr.x (mgr.34562) 6988 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:03:58.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:03:57 smithi132 bash[27079]: cephadm 2020-07-16T16:03:56.927630+0000 mgr.x (mgr.34562) 6989 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:03:58.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:03:57 smithi188 bash[23329]: cephadm 2020-07-16T16:03:56.927438+0000 mgr.x (mgr.34562) 6988 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:03:58.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:03:57 smithi188 bash[23329]: cephadm 2020-07-16T16:03:56.927630+0000 mgr.x (mgr.34562) 6989 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:03:59.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:03:58 smithi132 bash[27079]: cluster 2020-07-16T16:03:57.449464+0000 mgr.x (mgr.34562) 6990 : cluster [DBG] pgmap v4358: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:03:59.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:03:58 smithi188 bash[23329]: cluster 2020-07-16T16:03:57.449464+0000 mgr.x (mgr.34562) 6990 : cluster [DBG] pgmap v4358: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:04:01.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:04:00 smithi132 bash[27079]: cluster 2020-07-16T16:03:59.449931+0000 mgr.x (mgr.34562) 6991 : cluster [DBG] pgmap v4359: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:04:01.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:04:00 smithi188 bash[23329]: cluster 2020-07-16T16:03:59.449931+0000 mgr.x (mgr.34562) 6991 : cluster [DBG] pgmap v4359: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:04:03.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:04:02 smithi132 bash[27079]: cluster 2020-07-16T16:04:01.450302+0000 mgr.x (mgr.34562) 6992 : cluster [DBG] pgmap v4360: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:04:03.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:04:02 smithi188 bash[23329]: cluster 2020-07-16T16:04:01.450302+0000 mgr.x (mgr.34562) 6992 : cluster [DBG] pgmap v4360: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:04:05.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:04:04 smithi132 bash[27079]: cluster 2020-07-16T16:04:03.450659+0000 mgr.x (mgr.34562) 6993 : cluster [DBG] pgmap v4361: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:04:05.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:04:04 smithi188 bash[23329]: cluster 2020-07-16T16:04:03.450659+0000 mgr.x (mgr.34562) 6993 : cluster [DBG] pgmap v4361: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:04:07.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:04:06 smithi132 bash[27079]: cluster 2020-07-16T16:04:05.451064+0000 mgr.x (mgr.34562) 6994 : cluster [DBG] pgmap v4362: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:04:07.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:04:06 smithi188 bash[23329]: cluster 2020-07-16T16:04:05.451064+0000 mgr.x (mgr.34562) 6994 : cluster [DBG] pgmap v4362: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:04:09.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:04:08 smithi132 bash[27079]: cluster 2020-07-16T16:04:07.451528+0000 mgr.x (mgr.34562) 6995 : cluster [DBG] pgmap v4363: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:04:09.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:04:08 smithi188 bash[23329]: cluster 2020-07-16T16:04:07.451528+0000 mgr.x (mgr.34562) 6995 : cluster [DBG] pgmap v4363: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:04:11.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:04:10 smithi132 bash[27079]: cluster 2020-07-16T16:04:09.452030+0000 mgr.x (mgr.34562) 6996 : cluster [DBG] pgmap v4364: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:04:11.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:04:10 smithi188 bash[23329]: cluster 2020-07-16T16:04:09.452030+0000 mgr.x (mgr.34562) 6996 : cluster [DBG] pgmap v4364: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:04:12.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:04:12 smithi132 bash[27079]: audit 2020-07-16T16:04:11.937719+0000 mon.b (mon.2) 1499 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:04:12.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:04:12 smithi188 bash[23329]: audit 2020-07-16T16:04:11.937719+0000 mon.b (mon.2) 1499 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:04:13.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:04:13 smithi132 bash[27079]: cluster 2020-07-16T16:04:11.452549+0000 mgr.x (mgr.34562) 6997 : cluster [DBG] pgmap v4365: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:04:13.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:04:13 smithi132 bash[27079]: cephadm 2020-07-16T16:04:11.938436+0000 mgr.x (mgr.34562) 6998 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:04:13.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:04:13 smithi132 bash[27079]: cephadm 2020-07-16T16:04:11.938833+0000 mgr.x (mgr.34562) 6999 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:04:13.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:04:13 smithi188 bash[23329]: cluster 2020-07-16T16:04:11.452549+0000 mgr.x (mgr.34562) 6997 : cluster [DBG] pgmap v4365: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:04:13.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:04:13 smithi188 bash[23329]: cephadm 2020-07-16T16:04:11.938436+0000 mgr.x (mgr.34562) 6998 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:04:13.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:04:13 smithi188 bash[23329]: cephadm 2020-07-16T16:04:11.938833+0000 mgr.x (mgr.34562) 6999 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:04:15.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:04:15 smithi132 bash[27079]: cluster 2020-07-16T16:04:13.453106+0000 mgr.x (mgr.34562) 7000 : cluster [DBG] pgmap v4366: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:04:15.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:04:15 smithi188 bash[23329]: cluster 2020-07-16T16:04:13.453106+0000 mgr.x (mgr.34562) 7000 : cluster [DBG] pgmap v4366: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:04:17.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:04:17 smithi132 bash[27079]: cluster 2020-07-16T16:04:15.453595+0000 mgr.x (mgr.34562) 7001 : cluster [DBG] pgmap v4367: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:04:17.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:04:17 smithi188 bash[23329]: cluster 2020-07-16T16:04:15.453595+0000 mgr.x (mgr.34562) 7001 : cluster [DBG] pgmap v4367: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:04:19.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:04:19 smithi132 bash[27079]: cluster 2020-07-16T16:04:17.454165+0000 mgr.x (mgr.34562) 7002 : cluster [DBG] pgmap v4368: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:04:19.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:04:19 smithi188 bash[23329]: cluster 2020-07-16T16:04:17.454165+0000 mgr.x (mgr.34562) 7002 : cluster [DBG] pgmap v4368: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:04:20.798 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:04:21.060 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:04:21.060 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 8m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:04:21.061 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 8m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:04:21.061 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 8m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:04:21.061 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 8m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:04:21.061 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 8m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:04:21.061 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:04:21.062 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:04:21.062 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 8m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:04:21.062 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 8m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:04:21.062 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:04:21.062 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:04:21.063 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:04:21.063 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:04:21.063 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:04:21.063 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:04:21.063 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:04:21.064 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:04:21.064 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 8m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:04:21.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:04:21 smithi132 bash[27079]: cluster 2020-07-16T16:04:19.454628+0000 mgr.x (mgr.34562) 7003 : cluster [DBG] pgmap v4369: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:04:21.358 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:04:21.359 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:04:21.359 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:04:21.359 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:04:21.359 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:04:21.359 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:04:21.360 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:04:21.360 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:04:21.360 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:04:21.360 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:04:21.360 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:04:21.361 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:04:21.361 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:04:21.361 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:04:21.361 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:04:21.361 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:04:21.362 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:04:21.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:04:21 smithi188 bash[23329]: cluster 2020-07-16T16:04:19.454628+0000 mgr.x (mgr.34562) 7003 : cluster [DBG] pgmap v4369: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:04:22.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:04:22 smithi132 bash[27079]: audit 2020-07-16T16:04:20.787382+0000 mgr.x (mgr.34562) 7004 : audit [DBG] from='client.29734 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:04:22.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:04:22 smithi132 bash[27079]: audit 2020-07-16T16:04:21.056087+0000 mgr.x (mgr.34562) 7005 : audit [DBG] from='client.29740 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:04:22.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:04:22 smithi132 bash[27079]: audit 2020-07-16T16:04:21.357784+0000 mon.c (mon.1) 472 : audit [DBG] from='client.? 172.21.15.132:0/2642394800' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:04:22.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:04:22 smithi188 bash[23329]: audit 2020-07-16T16:04:20.787382+0000 mgr.x (mgr.34562) 7004 : audit [DBG] from='client.29734 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:04:22.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:04:22 smithi188 bash[23329]: audit 2020-07-16T16:04:21.056087+0000 mgr.x (mgr.34562) 7005 : audit [DBG] from='client.29740 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:04:22.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:04:22 smithi188 bash[23329]: audit 2020-07-16T16:04:21.357784+0000 mon.c (mon.1) 472 : audit [DBG] from='client.? 172.21.15.132:0/2642394800' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:04:23.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:04:23 smithi132 bash[27079]: cluster 2020-07-16T16:04:21.454977+0000 mgr.x (mgr.34562) 7006 : cluster [DBG] pgmap v4370: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:04:23.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:04:23 smithi188 bash[23329]: cluster 2020-07-16T16:04:21.454977+0000 mgr.x (mgr.34562) 7006 : cluster [DBG] pgmap v4370: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:04:25.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:04:25 smithi132 bash[27079]: cluster 2020-07-16T16:04:23.455531+0000 mgr.x (mgr.34562) 7007 : cluster [DBG] pgmap v4371: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:04:25.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:04:25 smithi188 bash[23329]: cluster 2020-07-16T16:04:23.455531+0000 mgr.x (mgr.34562) 7007 : cluster [DBG] pgmap v4371: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:04:27.417 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:04:27 smithi132 bash[27079]: cluster 2020-07-16T16:04:25.455885+0000 mgr.x (mgr.34562) 7008 : cluster [DBG] pgmap v4372: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:04:27.417 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:04:27 smithi132 bash[27079]: audit 2020-07-16T16:04:26.949290+0000 mon.b (mon.2) 1500 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:04:27.417 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:04:27 smithi132 bash[27079]: audit 2020-07-16T16:04:26.950649+0000 mon.b (mon.2) 1501 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:04:27.417 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:04:27 smithi132 bash[27079]: audit 2020-07-16T16:04:26.951865+0000 mon.b (mon.2) 1502 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:04:27.418 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:04:27 smithi132 bash[27079]: audit 2020-07-16T16:04:26.953319+0000 mon.b (mon.2) 1503 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:04:27.418 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:04:27 smithi132 bash[27079]: audit 2020-07-16T16:04:26.954657+0000 mon.b (mon.2) 1504 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:04:27.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:04:27 smithi188 bash[23329]: cluster 2020-07-16T16:04:25.455885+0000 mgr.x (mgr.34562) 7008 : cluster [DBG] pgmap v4372: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:04:27.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:04:27 smithi188 bash[23329]: audit 2020-07-16T16:04:26.949290+0000 mon.b (mon.2) 1500 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:04:27.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:04:27 smithi188 bash[23329]: audit 2020-07-16T16:04:26.950649+0000 mon.b (mon.2) 1501 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:04:27.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:04:27 smithi188 bash[23329]: audit 2020-07-16T16:04:26.951865+0000 mon.b (mon.2) 1502 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:04:27.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:04:27 smithi188 bash[23329]: audit 2020-07-16T16:04:26.953319+0000 mon.b (mon.2) 1503 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:04:27.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:04:27 smithi188 bash[23329]: audit 2020-07-16T16:04:26.954657+0000 mon.b (mon.2) 1504 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:04:28.414 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:04:28 smithi132 bash[27079]: audit 2020-07-16T16:04:26.949667+0000 mgr.x (mgr.34562) 7009 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:04:28.414 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:04:28 smithi132 bash[27079]: audit 2020-07-16T16:04:26.950985+0000 mgr.x (mgr.34562) 7010 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:04:28.414 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:04:28 smithi132 bash[27079]: audit 2020-07-16T16:04:26.952144+0000 mgr.x (mgr.34562) 7011 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:04:28.414 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:04:28 smithi132 bash[27079]: cephadm 2020-07-16T16:04:26.952877+0000 mgr.x (mgr.34562) 7012 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:04:28.415 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:04:28 smithi132 bash[27079]: cephadm 2020-07-16T16:04:26.954164+0000 mgr.x (mgr.34562) 7013 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:04:28.415 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:04:28 smithi132 bash[27079]: cephadm 2020-07-16T16:04:26.955380+0000 mgr.x (mgr.34562) 7014 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:04:28.415 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:04:28 smithi132 bash[27079]: cephadm 2020-07-16T16:04:26.955696+0000 mgr.x (mgr.34562) 7015 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:04:28.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:04:28 smithi188 bash[23329]: audit 2020-07-16T16:04:26.949667+0000 mgr.x (mgr.34562) 7009 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:04:28.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:04:28 smithi188 bash[23329]: audit 2020-07-16T16:04:26.950985+0000 mgr.x (mgr.34562) 7010 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:04:28.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:04:28 smithi188 bash[23329]: audit 2020-07-16T16:04:26.952144+0000 mgr.x (mgr.34562) 7011 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:04:28.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:04:28 smithi188 bash[23329]: cephadm 2020-07-16T16:04:26.952877+0000 mgr.x (mgr.34562) 7012 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:04:28.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:04:28 smithi188 bash[23329]: cephadm 2020-07-16T16:04:26.954164+0000 mgr.x (mgr.34562) 7013 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:04:28.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:04:28 smithi188 bash[23329]: cephadm 2020-07-16T16:04:26.955380+0000 mgr.x (mgr.34562) 7014 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:04:28.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:04:28 smithi188 bash[23329]: cephadm 2020-07-16T16:04:26.955696+0000 mgr.x (mgr.34562) 7015 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:04:29.183 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:04:29 smithi132 bash[27079]: cluster 2020-07-16T16:04:27.456490+0000 mgr.x (mgr.34562) 7016 : cluster [DBG] pgmap v4373: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:04:29.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:04:29 smithi188 bash[23329]: cluster 2020-07-16T16:04:27.456490+0000 mgr.x (mgr.34562) 7016 : cluster [DBG] pgmap v4373: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:04:30.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:04:30 smithi188 bash[23329]: audit 2020-07-16T16:04:29.781852+0000 mon.b (mon.2) 1505 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:04:30.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:04:30 smithi132 bash[27079]: audit 2020-07-16T16:04:29.781852+0000 mon.b (mon.2) 1505 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:04:31.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:04:31 smithi188 bash[23329]: cluster 2020-07-16T16:04:29.456950+0000 mgr.x (mgr.34562) 7017 : cluster [DBG] pgmap v4374: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:04:31.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:04:31 smithi188 bash[23329]: cephadm 2020-07-16T16:04:29.782496+0000 mgr.x (mgr.34562) 7018 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:04:31.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:04:31 smithi188 bash[23329]: cephadm 2020-07-16T16:04:29.782953+0000 mgr.x (mgr.34562) 7019 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:04:31.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:04:31 smithi132 bash[27079]: cluster 2020-07-16T16:04:29.456950+0000 mgr.x (mgr.34562) 7017 : cluster [DBG] pgmap v4374: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:04:31.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:04:31 smithi132 bash[27079]: cephadm 2020-07-16T16:04:29.782496+0000 mgr.x (mgr.34562) 7018 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:04:31.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:04:31 smithi132 bash[27079]: cephadm 2020-07-16T16:04:29.782953+0000 mgr.x (mgr.34562) 7019 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:04:33.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:04:33 smithi188 bash[23329]: cluster 2020-07-16T16:04:31.457469+0000 mgr.x (mgr.34562) 7020 : cluster [DBG] pgmap v4375: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:04:33.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:04:33 smithi132 bash[27079]: cluster 2020-07-16T16:04:31.457469+0000 mgr.x (mgr.34562) 7020 : cluster [DBG] pgmap v4375: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:04:35.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:04:35 smithi188 bash[23329]: cluster 2020-07-16T16:04:33.458051+0000 mgr.x (mgr.34562) 7021 : cluster [DBG] pgmap v4376: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:04:35.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:04:35 smithi132 bash[27079]: cluster 2020-07-16T16:04:33.458051+0000 mgr.x (mgr.34562) 7021 : cluster [DBG] pgmap v4376: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:04:37.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:04:37 smithi188 bash[23329]: cluster 2020-07-16T16:04:35.458519+0000 mgr.x (mgr.34562) 7022 : cluster [DBG] pgmap v4377: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:04:37.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:04:37 smithi132 bash[27079]: cluster 2020-07-16T16:04:35.458519+0000 mgr.x (mgr.34562) 7022 : cluster [DBG] pgmap v4377: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:04:39.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:04:39 smithi188 bash[23329]: cluster 2020-07-16T16:04:37.458958+0000 mgr.x (mgr.34562) 7023 : cluster [DBG] pgmap v4378: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:04:39.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:04:39 smithi132 bash[27079]: cluster 2020-07-16T16:04:37.458958+0000 mgr.x (mgr.34562) 7023 : cluster [DBG] pgmap v4378: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:04:41.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:04:41 smithi188 bash[23329]: cluster 2020-07-16T16:04:39.459380+0000 mgr.x (mgr.34562) 7024 : cluster [DBG] pgmap v4379: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:04:41.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:04:41 smithi132 bash[27079]: cluster 2020-07-16T16:04:39.459380+0000 mgr.x (mgr.34562) 7024 : cluster [DBG] pgmap v4379: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:04:43.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:04:43 smithi188 bash[23329]: cluster 2020-07-16T16:04:41.459720+0000 mgr.x (mgr.34562) 7025 : cluster [DBG] pgmap v4380: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:04:43.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:04:43 smithi132 bash[27079]: cluster 2020-07-16T16:04:41.459720+0000 mgr.x (mgr.34562) 7025 : cluster [DBG] pgmap v4380: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:04:45.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:04:45 smithi188 bash[23329]: cluster 2020-07-16T16:04:43.460196+0000 mgr.x (mgr.34562) 7026 : cluster [DBG] pgmap v4381: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:04:45.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:04:45 smithi188 bash[23329]: audit 2020-07-16T16:04:44.789947+0000 mon.b (mon.2) 1506 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:04:45.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:04:45 smithi132 bash[27079]: cluster 2020-07-16T16:04:43.460196+0000 mgr.x (mgr.34562) 7026 : cluster [DBG] pgmap v4381: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:04:45.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:04:45 smithi132 bash[27079]: audit 2020-07-16T16:04:44.789947+0000 mon.b (mon.2) 1506 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:04:46.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:04:46 smithi188 bash[23329]: cephadm 2020-07-16T16:04:44.790711+0000 mgr.x (mgr.34562) 7027 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:04:46.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:04:46 smithi188 bash[23329]: cephadm 2020-07-16T16:04:44.791124+0000 mgr.x (mgr.34562) 7028 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:04:46.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:04:46 smithi132 bash[27079]: cephadm 2020-07-16T16:04:44.790711+0000 mgr.x (mgr.34562) 7027 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:04:46.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:04:46 smithi132 bash[27079]: cephadm 2020-07-16T16:04:44.791124+0000 mgr.x (mgr.34562) 7028 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:04:47.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:04:47 smithi188 bash[23329]: cluster 2020-07-16T16:04:45.460656+0000 mgr.x (mgr.34562) 7029 : cluster [DBG] pgmap v4382: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:04:47.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:04:47 smithi132 bash[27079]: cluster 2020-07-16T16:04:45.460656+0000 mgr.x (mgr.34562) 7029 : cluster [DBG] pgmap v4382: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:04:49.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:04:49 smithi188 bash[23329]: cluster 2020-07-16T16:04:47.461034+0000 mgr.x (mgr.34562) 7030 : cluster [DBG] pgmap v4383: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:04:49.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:04:49 smithi132 bash[27079]: cluster 2020-07-16T16:04:47.461034+0000 mgr.x (mgr.34562) 7030 : cluster [DBG] pgmap v4383: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:04:51.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:04:51 smithi188 bash[23329]: cluster 2020-07-16T16:04:49.461579+0000 mgr.x (mgr.34562) 7031 : cluster [DBG] pgmap v4384: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:04:51.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:04:51 smithi132 bash[27079]: cluster 2020-07-16T16:04:49.461579+0000 mgr.x (mgr.34562) 7031 : cluster [DBG] pgmap v4384: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:04:51.658 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:04:51.919 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:04:51.919 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 8m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:04:51.920 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 8m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:04:51.920 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 8m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:04:51.920 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 8m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:04:51.920 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 8m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:04:51.921 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:04:51.921 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:04:51.921 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 8m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:04:51.921 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 8m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:04:51.921 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:04:51.922 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:04:51.922 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:04:51.922 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:04:51.922 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:04:51.922 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:04:51.923 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:04:51.923 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:04:51.923 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 8m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:04:52.219 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:04:52.220 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:04:52.220 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:04:52.220 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:04:52.220 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:04:52.221 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:04:52.221 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:04:52.221 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:04:52.221 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:04:52.221 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:04:52.222 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:04:52.222 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:04:52.222 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:04:52.222 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:04:52.222 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:04:52.223 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:04:52.223 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:04:53.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:04:53 smithi188 bash[23329]: cluster 2020-07-16T16:04:51.462034+0000 mgr.x (mgr.34562) 7032 : cluster [DBG] pgmap v4385: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:04:53.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:04:53 smithi188 bash[23329]: audit 2020-07-16T16:04:51.647055+0000 mgr.x (mgr.34562) 7033 : audit [DBG] from='client.29752 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:04:53.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:04:53 smithi188 bash[23329]: audit 2020-07-16T16:04:51.915203+0000 mgr.x (mgr.34562) 7034 : audit [DBG] from='client.29758 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:04:53.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:04:53 smithi188 bash[23329]: audit 2020-07-16T16:04:52.218916+0000 mon.c (mon.1) 473 : audit [DBG] from='client.? 172.21.15.132:0/2054218752' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:04:53.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:04:53 smithi132 bash[27079]: cluster 2020-07-16T16:04:51.462034+0000 mgr.x (mgr.34562) 7032 : cluster [DBG] pgmap v4385: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:04:53.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:04:53 smithi132 bash[27079]: audit 2020-07-16T16:04:51.647055+0000 mgr.x (mgr.34562) 7033 : audit [DBG] from='client.29752 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:04:53.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:04:53 smithi132 bash[27079]: audit 2020-07-16T16:04:51.915203+0000 mgr.x (mgr.34562) 7034 : audit [DBG] from='client.29758 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:04:53.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:04:53 smithi132 bash[27079]: audit 2020-07-16T16:04:52.218916+0000 mon.c (mon.1) 473 : audit [DBG] from='client.? 172.21.15.132:0/2054218752' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:04:55.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:04:55 smithi188 bash[23329]: cluster 2020-07-16T16:04:53.462600+0000 mgr.x (mgr.34562) 7035 : cluster [DBG] pgmap v4386: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:04:55.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:04:55 smithi132 bash[27079]: cluster 2020-07-16T16:04:53.462600+0000 mgr.x (mgr.34562) 7035 : cluster [DBG] pgmap v4386: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:04:57.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:04:57 smithi188 bash[23329]: cluster 2020-07-16T16:04:55.463149+0000 mgr.x (mgr.34562) 7036 : cluster [DBG] pgmap v4387: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:04:57.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:04:57 smithi132 bash[27079]: cluster 2020-07-16T16:04:55.463149+0000 mgr.x (mgr.34562) 7036 : cluster [DBG] pgmap v4387: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:04:59.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:04:59 smithi188 bash[23329]: cluster 2020-07-16T16:04:57.463621+0000 mgr.x (mgr.34562) 7037 : cluster [DBG] pgmap v4388: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:04:59.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:04:59 smithi132 bash[27079]: cluster 2020-07-16T16:04:57.463621+0000 mgr.x (mgr.34562) 7037 : cluster [DBG] pgmap v4388: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:05:00.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:00 smithi188 bash[23329]: audit 2020-07-16T16:04:59.806667+0000 mon.b (mon.2) 1507 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:05:00.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:00 smithi132 bash[27079]: audit 2020-07-16T16:04:59.806667+0000 mon.b (mon.2) 1507 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:05:01.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:01 smithi188 bash[23329]: cluster 2020-07-16T16:04:59.464123+0000 mgr.x (mgr.34562) 7038 : cluster [DBG] pgmap v4389: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:05:01.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:01 smithi188 bash[23329]: cephadm 2020-07-16T16:04:59.807322+0000 mgr.x (mgr.34562) 7039 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:05:01.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:01 smithi188 bash[23329]: cephadm 2020-07-16T16:04:59.807744+0000 mgr.x (mgr.34562) 7040 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:05:01.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:01 smithi132 bash[27079]: cluster 2020-07-16T16:04:59.464123+0000 mgr.x (mgr.34562) 7038 : cluster [DBG] pgmap v4389: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:05:01.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:01 smithi132 bash[27079]: cephadm 2020-07-16T16:04:59.807322+0000 mgr.x (mgr.34562) 7039 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:05:01.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:01 smithi132 bash[27079]: cephadm 2020-07-16T16:04:59.807744+0000 mgr.x (mgr.34562) 7040 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:05:03.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:03 smithi188 bash[23329]: cluster 2020-07-16T16:05:01.464487+0000 mgr.x (mgr.34562) 7041 : cluster [DBG] pgmap v4390: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:05:03.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:03 smithi132 bash[27079]: cluster 2020-07-16T16:05:01.464487+0000 mgr.x (mgr.34562) 7041 : cluster [DBG] pgmap v4390: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:05:05.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:05 smithi188 bash[23329]: cluster 2020-07-16T16:05:03.464954+0000 mgr.x (mgr.34562) 7042 : cluster [DBG] pgmap v4391: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:05:05.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:05 smithi132 bash[27079]: cluster 2020-07-16T16:05:03.464954+0000 mgr.x (mgr.34562) 7042 : cluster [DBG] pgmap v4391: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:05:07.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:07 smithi188 bash[23329]: cluster 2020-07-16T16:05:05.465377+0000 mgr.x (mgr.34562) 7043 : cluster [DBG] pgmap v4392: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:05:07.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:07 smithi132 bash[27079]: cluster 2020-07-16T16:05:05.465377+0000 mgr.x (mgr.34562) 7043 : cluster [DBG] pgmap v4392: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:05:09.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:09 smithi188 bash[23329]: cluster 2020-07-16T16:05:07.465766+0000 mgr.x (mgr.34562) 7044 : cluster [DBG] pgmap v4393: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:05:09.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:09 smithi132 bash[27079]: cluster 2020-07-16T16:05:07.465766+0000 mgr.x (mgr.34562) 7044 : cluster [DBG] pgmap v4393: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:05:11.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:11 smithi188 bash[23329]: cluster 2020-07-16T16:05:09.466267+0000 mgr.x (mgr.34562) 7045 : cluster [DBG] pgmap v4394: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:05:11.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:11 smithi132 bash[27079]: cluster 2020-07-16T16:05:09.466267+0000 mgr.x (mgr.34562) 7045 : cluster [DBG] pgmap v4394: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:05:13.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:13 smithi188 bash[23329]: cluster 2020-07-16T16:05:11.466908+0000 mgr.x (mgr.34562) 7046 : cluster [DBG] pgmap v4395: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:05:13.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:13 smithi132 bash[27079]: cluster 2020-07-16T16:05:11.466908+0000 mgr.x (mgr.34562) 7046 : cluster [DBG] pgmap v4395: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:05:15.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:15 smithi188 bash[23329]: cluster 2020-07-16T16:05:13.467494+0000 mgr.x (mgr.34562) 7047 : cluster [DBG] pgmap v4396: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:05:15.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:15 smithi188 bash[23329]: audit 2020-07-16T16:05:14.821833+0000 mon.b (mon.2) 1508 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:05:15.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:15 smithi132 bash[27079]: cluster 2020-07-16T16:05:13.467494+0000 mgr.x (mgr.34562) 7047 : cluster [DBG] pgmap v4396: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:05:15.532 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:15 smithi132 bash[27079]: audit 2020-07-16T16:05:14.821833+0000 mon.b (mon.2) 1508 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:05:16.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:16 smithi188 bash[23329]: cephadm 2020-07-16T16:05:14.822623+0000 mgr.x (mgr.34562) 7048 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:05:16.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:16 smithi188 bash[23329]: cephadm 2020-07-16T16:05:14.823061+0000 mgr.x (mgr.34562) 7049 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:05:16.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:16 smithi132 bash[27079]: cephadm 2020-07-16T16:05:14.822623+0000 mgr.x (mgr.34562) 7048 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:05:16.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:16 smithi132 bash[27079]: cephadm 2020-07-16T16:05:14.823061+0000 mgr.x (mgr.34562) 7049 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:05:17.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:17 smithi188 bash[23329]: cluster 2020-07-16T16:05:15.467864+0000 mgr.x (mgr.34562) 7050 : cluster [DBG] pgmap v4397: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:05:17.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:17 smithi132 bash[27079]: cluster 2020-07-16T16:05:15.467864+0000 mgr.x (mgr.34562) 7050 : cluster [DBG] pgmap v4397: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:05:19.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:19 smithi188 bash[23329]: cluster 2020-07-16T16:05:17.468248+0000 mgr.x (mgr.34562) 7051 : cluster [DBG] pgmap v4398: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:05:19.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:19 smithi132 bash[27079]: cluster 2020-07-16T16:05:17.468248+0000 mgr.x (mgr.34562) 7051 : cluster [DBG] pgmap v4398: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:05:21.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:21 smithi188 bash[23329]: cluster 2020-07-16T16:05:19.468660+0000 mgr.x (mgr.34562) 7052 : cluster [DBG] pgmap v4399: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:05:21.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:21 smithi132 bash[27079]: cluster 2020-07-16T16:05:19.468660+0000 mgr.x (mgr.34562) 7052 : cluster [DBG] pgmap v4399: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:05:22.519 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:05:22.782 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:05:22.782 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 9m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:05:22.783 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 9m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:05:22.783 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 9m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:05:22.783 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 9m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:05:22.783 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 9m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:05:22.783 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:05:22.784 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:05:22.784 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 9m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:05:22.784 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 9m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:05:22.784 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:05:22.784 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:05:22.785 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:05:22.785 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:05:22.785 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:05:22.785 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:05:22.785 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:05:22.785 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:05:22.786 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 9m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:05:23.084 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:05:23.084 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:05:23.084 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:05:23.085 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:05:23.085 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:05:23.085 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:05:23.085 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:05:23.085 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:05:23.086 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:05:23.086 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:05:23.086 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:05:23.086 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:05:23.086 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:05:23.087 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:05:23.087 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:05:23.087 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:05:23.087 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:05:23.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:23 smithi188 bash[23329]: cluster 2020-07-16T16:05:21.469052+0000 mgr.x (mgr.34562) 7053 : cluster [DBG] pgmap v4400: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:05:23.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:23 smithi188 bash[23329]: audit 2020-07-16T16:05:23.080879+0000 mon.c (mon.1) 474 : audit [DBG] from='client.? 172.21.15.132:0/3543239711' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:05:23.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:23 smithi132 bash[27079]: cluster 2020-07-16T16:05:21.469052+0000 mgr.x (mgr.34562) 7053 : cluster [DBG] pgmap v4400: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:05:23.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:23 smithi132 bash[27079]: audit 2020-07-16T16:05:23.080879+0000 mon.c (mon.1) 474 : audit [DBG] from='client.? 172.21.15.132:0/3543239711' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:05:24.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:24 smithi188 bash[23329]: audit 2020-07-16T16:05:22.507831+0000 mgr.x (mgr.34562) 7054 : audit [DBG] from='client.29770 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:05:24.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:24 smithi188 bash[23329]: audit 2020-07-16T16:05:22.778066+0000 mgr.x (mgr.34562) 7055 : audit [DBG] from='client.29776 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:05:24.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:24 smithi132 bash[27079]: audit 2020-07-16T16:05:22.507831+0000 mgr.x (mgr.34562) 7054 : audit [DBG] from='client.29770 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:05:24.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:24 smithi132 bash[27079]: audit 2020-07-16T16:05:22.778066+0000 mgr.x (mgr.34562) 7055 : audit [DBG] from='client.29776 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:05:25.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:25 smithi188 bash[23329]: cluster 2020-07-16T16:05:23.469669+0000 mgr.x (mgr.34562) 7056 : cluster [DBG] pgmap v4401: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:05:25.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:25 smithi132 bash[27079]: cluster 2020-07-16T16:05:23.469669+0000 mgr.x (mgr.34562) 7056 : cluster [DBG] pgmap v4401: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:05:27.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:27 smithi188 bash[23329]: cluster 2020-07-16T16:05:25.470095+0000 mgr.x (mgr.34562) 7057 : cluster [DBG] pgmap v4402: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:05:27.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:27 smithi132 bash[27079]: cluster 2020-07-16T16:05:25.470095+0000 mgr.x (mgr.34562) 7057 : cluster [DBG] pgmap v4402: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:05:29.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:29 smithi188 bash[23329]: cluster 2020-07-16T16:05:27.470583+0000 mgr.x (mgr.34562) 7058 : cluster [DBG] pgmap v4403: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:05:29.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:29 smithi132 bash[27079]: cluster 2020-07-16T16:05:27.470583+0000 mgr.x (mgr.34562) 7058 : cluster [DBG] pgmap v4403: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:05:30.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:30 smithi188 bash[23329]: audit 2020-07-16T16:05:29.839336+0000 mon.b (mon.2) 1509 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T16:05:30.421 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:30 smithi132 bash[27079]: audit 2020-07-16T16:05:29.839336+0000 mon.b (mon.2) 1509 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T16:05:31.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:31 smithi188 bash[23329]: cluster 2020-07-16T16:05:29.471022+0000 mgr.x (mgr.34562) 7059 : cluster [DBG] pgmap v4404: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:05:31.498 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:31 smithi132 bash[27079]: cluster 2020-07-16T16:05:29.471022+0000 mgr.x (mgr.34562) 7059 : cluster [DBG] pgmap v4404: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:05:33.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:33 smithi188 bash[23329]: cluster 2020-07-16T16:05:31.471443+0000 mgr.x (mgr.34562) 7060 : cluster [DBG] pgmap v4405: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:05:33.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:33 smithi188 bash[23329]: audit 2020-07-16T16:05:32.769012+0000 mon.b (mon.2) 1510 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T16:05:33.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:33 smithi188 bash[23329]: audit 2020-07-16T16:05:32.973499+0000 mon.b (mon.2) 1511 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:56:03.434893\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.434968\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435027\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435079\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435346\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435534\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435728\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435905\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435964\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:56:03.436077\", \"last_device_update\": \"2020-07-16T16:05:32.972399\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:58:09.566665\"}"}]: dispatch 2020-07-16T16:05:33.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:33 smithi188 bash[23329]: audit 2020-07-16T16:05:32.974028+0000 mon.c (mon.1) 475 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:56:03.434893\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.434968\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435027\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435079\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435346\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435534\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435728\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435905\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435964\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:56:03.436077\", \"last_device_update\": \"2020-07-16T16:05:32.972399\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:58:09.566665\"}"}]: dispatch 2020-07-16T16:05:33.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:33 smithi188 bash[23329]: audit 2020-07-16T16:05:32.976900+0000 mon.c (mon.1) 476 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:56:03.434893\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.434968\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435027\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435079\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435346\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435534\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435728\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435905\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435964\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:56:03.436077\", \"last_device_update\": \"2020-07-16T16:05:32.972399\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:58:09.566665\"}"}]': finished 2020-07-16T16:05:33.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:33 smithi188 bash[23329]: audit 2020-07-16T16:05:32.980685+0000 mon.b (mon.2) 1512 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:05:33.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:33 smithi188 bash[23329]: audit 2020-07-16T16:05:32.982032+0000 mon.b (mon.2) 1513 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:05:33.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:33 smithi188 bash[23329]: audit 2020-07-16T16:05:32.983236+0000 mon.b (mon.2) 1514 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:05:33.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:33 smithi188 bash[23329]: audit 2020-07-16T16:05:32.984637+0000 mon.b (mon.2) 1515 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:05:33.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:33 smithi188 bash[23329]: audit 2020-07-16T16:05:32.985767+0000 mon.b (mon.2) 1516 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:05:33.448 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:33 smithi132 bash[27079]: cluster 2020-07-16T16:05:31.471443+0000 mgr.x (mgr.34562) 7060 : cluster [DBG] pgmap v4405: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:05:33.448 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:33 smithi132 bash[27079]: audit 2020-07-16T16:05:32.769012+0000 mon.b (mon.2) 1510 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T16:05:33.449 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:33 smithi132 bash[27079]: audit 2020-07-16T16:05:32.973499+0000 mon.b (mon.2) 1511 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:56:03.434893\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.434968\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435027\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435079\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435346\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435534\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435728\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435905\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435964\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:56:03.436077\", \"last_device_update\": \"2020-07-16T16:05:32.972399\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:58:09.566665\"}"}]: dispatch 2020-07-16T16:05:33.449 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:33 smithi132 bash[27079]: audit 2020-07-16T16:05:32.974028+0000 mon.c (mon.1) 475 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:56:03.434893\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.434968\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435027\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435079\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435346\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435534\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435728\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435905\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435964\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:56:03.436077\", \"last_device_update\": \"2020-07-16T16:05:32.972399\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:58:09.566665\"}"}]: dispatch 2020-07-16T16:05:33.449 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:33 smithi132 bash[27079]: audit 2020-07-16T16:05:32.976900+0000 mon.c (mon.1) 476 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T15:56:03.434893\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.434968\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435027\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435079\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435346\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435534\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435728\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435905\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T15:56:03.435964\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T15:56:03.436077\", \"last_device_update\": \"2020-07-16T16:05:32.972399\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:58:09.566665\"}"}]': finished 2020-07-16T16:05:33.450 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:33 smithi132 bash[27079]: audit 2020-07-16T16:05:32.980685+0000 mon.b (mon.2) 1512 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:05:33.450 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:33 smithi132 bash[27079]: audit 2020-07-16T16:05:32.982032+0000 mon.b (mon.2) 1513 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:05:33.450 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:33 smithi132 bash[27079]: audit 2020-07-16T16:05:32.983236+0000 mon.b (mon.2) 1514 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:05:33.450 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:33 smithi132 bash[27079]: audit 2020-07-16T16:05:32.984637+0000 mon.b (mon.2) 1515 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:05:33.451 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:33 smithi132 bash[27079]: audit 2020-07-16T16:05:32.985767+0000 mon.b (mon.2) 1516 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:05:34.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:34 smithi132 bash[27079]: audit 2020-07-16T16:05:32.981055+0000 mgr.x (mgr.34562) 7061 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:05:34.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:34 smithi132 bash[27079]: audit 2020-07-16T16:05:32.982365+0000 mgr.x (mgr.34562) 7062 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:05:34.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:34 smithi132 bash[27079]: audit 2020-07-16T16:05:32.983535+0000 mgr.x (mgr.34562) 7063 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:05:34.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:34 smithi132 bash[27079]: cephadm 2020-07-16T16:05:32.984313+0000 mgr.x (mgr.34562) 7064 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:05:34.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:34 smithi132 bash[27079]: cephadm 2020-07-16T16:05:32.985450+0000 mgr.x (mgr.34562) 7065 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:05:34.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:34 smithi132 bash[27079]: cephadm 2020-07-16T16:05:32.986497+0000 mgr.x (mgr.34562) 7066 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:05:34.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:34 smithi132 bash[27079]: cephadm 2020-07-16T16:05:32.986695+0000 mgr.x (mgr.34562) 7067 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:05:34.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:34 smithi188 bash[23329]: audit 2020-07-16T16:05:32.981055+0000 mgr.x (mgr.34562) 7061 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:05:34.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:34 smithi188 bash[23329]: audit 2020-07-16T16:05:32.982365+0000 mgr.x (mgr.34562) 7062 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:05:34.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:34 smithi188 bash[23329]: audit 2020-07-16T16:05:32.983535+0000 mgr.x (mgr.34562) 7063 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:05:34.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:34 smithi188 bash[23329]: cephadm 2020-07-16T16:05:32.984313+0000 mgr.x (mgr.34562) 7064 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:05:34.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:34 smithi188 bash[23329]: cephadm 2020-07-16T16:05:32.985450+0000 mgr.x (mgr.34562) 7065 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:05:34.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:34 smithi188 bash[23329]: cephadm 2020-07-16T16:05:32.986497+0000 mgr.x (mgr.34562) 7066 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:05:34.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:34 smithi188 bash[23329]: cephadm 2020-07-16T16:05:32.986695+0000 mgr.x (mgr.34562) 7067 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:05:35.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:35 smithi132 bash[27079]: cluster 2020-07-16T16:05:33.471951+0000 mgr.x (mgr.34562) 7068 : cluster [DBG] pgmap v4406: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:05:35.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:35 smithi188 bash[23329]: cluster 2020-07-16T16:05:33.471951+0000 mgr.x (mgr.34562) 7068 : cluster [DBG] pgmap v4406: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:05:36.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:36 smithi132 bash[27079]: audit 2020-07-16T16:05:35.628150+0000 mon.b (mon.2) 1517 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:05:36.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:36 smithi188 bash[23329]: audit 2020-07-16T16:05:35.628150+0000 mon.b (mon.2) 1517 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:05:37.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:37 smithi132 bash[27079]: cluster 2020-07-16T16:05:35.472416+0000 mgr.x (mgr.34562) 7069 : cluster [DBG] pgmap v4407: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:05:37.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:37 smithi132 bash[27079]: cephadm 2020-07-16T16:05:35.628747+0000 mgr.x (mgr.34562) 7070 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:05:37.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:37 smithi132 bash[27079]: cephadm 2020-07-16T16:05:35.629056+0000 mgr.x (mgr.34562) 7071 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:05:37.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:37 smithi188 bash[23329]: cluster 2020-07-16T16:05:35.472416+0000 mgr.x (mgr.34562) 7069 : cluster [DBG] pgmap v4407: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:05:37.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:37 smithi188 bash[23329]: cephadm 2020-07-16T16:05:35.628747+0000 mgr.x (mgr.34562) 7070 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:05:37.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:37 smithi188 bash[23329]: cephadm 2020-07-16T16:05:35.629056+0000 mgr.x (mgr.34562) 7071 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:05:39.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:39 smithi132 bash[27079]: cluster 2020-07-16T16:05:37.472936+0000 mgr.x (mgr.34562) 7072 : cluster [DBG] pgmap v4408: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:05:39.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:39 smithi188 bash[23329]: cluster 2020-07-16T16:05:37.472936+0000 mgr.x (mgr.34562) 7072 : cluster [DBG] pgmap v4408: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:05:41.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:41 smithi132 bash[27079]: cluster 2020-07-16T16:05:39.473292+0000 mgr.x (mgr.34562) 7073 : cluster [DBG] pgmap v4409: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:05:41.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:41 smithi188 bash[23329]: cluster 2020-07-16T16:05:39.473292+0000 mgr.x (mgr.34562) 7073 : cluster [DBG] pgmap v4409: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:05:43.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:43 smithi132 bash[27079]: cluster 2020-07-16T16:05:41.473650+0000 mgr.x (mgr.34562) 7074 : cluster [DBG] pgmap v4410: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:05:43.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:43 smithi188 bash[23329]: cluster 2020-07-16T16:05:41.473650+0000 mgr.x (mgr.34562) 7074 : cluster [DBG] pgmap v4410: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:05:45.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:45 smithi132 bash[27079]: cluster 2020-07-16T16:05:43.474196+0000 mgr.x (mgr.34562) 7075 : cluster [DBG] pgmap v4411: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:05:45.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:45 smithi188 bash[23329]: cluster 2020-07-16T16:05:43.474196+0000 mgr.x (mgr.34562) 7075 : cluster [DBG] pgmap v4411: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:05:47.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:47 smithi132 bash[27079]: cluster 2020-07-16T16:05:45.474723+0000 mgr.x (mgr.34562) 7076 : cluster [DBG] pgmap v4412: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:05:47.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:47 smithi188 bash[23329]: cluster 2020-07-16T16:05:45.474723+0000 mgr.x (mgr.34562) 7076 : cluster [DBG] pgmap v4412: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:05:49.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:49 smithi132 bash[27079]: cluster 2020-07-16T16:05:47.475203+0000 mgr.x (mgr.34562) 7077 : cluster [DBG] pgmap v4413: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:05:49.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:49 smithi188 bash[23329]: cluster 2020-07-16T16:05:47.475203+0000 mgr.x (mgr.34562) 7077 : cluster [DBG] pgmap v4413: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:05:51.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:51 smithi132 bash[27079]: cluster 2020-07-16T16:05:49.475617+0000 mgr.x (mgr.34562) 7078 : cluster [DBG] pgmap v4414: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:05:51.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:51 smithi132 bash[27079]: audit 2020-07-16T16:05:50.644658+0000 mon.b (mon.2) 1518 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:05:51.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:51 smithi188 bash[23329]: cluster 2020-07-16T16:05:49.475617+0000 mgr.x (mgr.34562) 7078 : cluster [DBG] pgmap v4414: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:05:51.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:51 smithi188 bash[23329]: audit 2020-07-16T16:05:50.644658+0000 mon.b (mon.2) 1518 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:05:52.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:52 smithi132 bash[27079]: cephadm 2020-07-16T16:05:50.645393+0000 mgr.x (mgr.34562) 7079 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:05:52.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:52 smithi132 bash[27079]: cephadm 2020-07-16T16:05:50.645839+0000 mgr.x (mgr.34562) 7080 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:05:52.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:52 smithi188 bash[23329]: cephadm 2020-07-16T16:05:50.645393+0000 mgr.x (mgr.34562) 7079 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:05:52.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:52 smithi188 bash[23329]: cephadm 2020-07-16T16:05:50.645839+0000 mgr.x (mgr.34562) 7080 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:05:53.380 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:05:53.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:53 smithi132 bash[27079]: cluster 2020-07-16T16:05:51.476024+0000 mgr.x (mgr.34562) 7081 : cluster [DBG] pgmap v4415: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:05:53.641 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:05:53.641 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 9m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:05:53.641 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 9m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:05:53.642 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 9m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:05:53.642 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 9m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:05:53.642 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 9m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:05:53.642 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:05:53.643 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:05:53.643 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 9m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:05:53.643 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 9m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:05:53.643 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:05:53.644 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:05:53.644 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:05:53.645 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:05:53.645 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:05:53.645 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:05:53.645 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:05:53.646 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:05:53.646 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 9m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:05:53.677 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:53 smithi188 bash[23329]: cluster 2020-07-16T16:05:51.476024+0000 mgr.x (mgr.34562) 7081 : cluster [DBG] pgmap v4415: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:05:53.938 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:05:53.938 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:05:53.938 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:05:53.939 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:05:53.939 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:05:53.939 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:05:53.939 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:05:53.940 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:05:53.940 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:05:53.940 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:05:53.940 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:05:53.941 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:05:53.941 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:05:53.941 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:05:53.941 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:05:53.942 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:05:53.942 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:05:54.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:54 smithi132 bash[27079]: audit 2020-07-16T16:05:53.367951+0000 mgr.x (mgr.34562) 7082 : audit [DBG] from='client.29788 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:05:54.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:54 smithi132 bash[27079]: audit 2020-07-16T16:05:53.937004+0000 mon.c (mon.1) 477 : audit [DBG] from='client.? 172.21.15.132:0/2008383530' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:05:54.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:54 smithi188 bash[23329]: audit 2020-07-16T16:05:53.367951+0000 mgr.x (mgr.34562) 7082 : audit [DBG] from='client.29788 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:05:54.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:54 smithi188 bash[23329]: audit 2020-07-16T16:05:53.937004+0000 mon.c (mon.1) 477 : audit [DBG] from='client.? 172.21.15.132:0/2008383530' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:05:55.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:55 smithi132 bash[27079]: cluster 2020-07-16T16:05:53.476437+0000 mgr.x (mgr.34562) 7083 : cluster [DBG] pgmap v4416: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:05:55.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:55 smithi132 bash[27079]: audit 2020-07-16T16:05:53.636521+0000 mgr.x (mgr.34562) 7084 : audit [DBG] from='client.29794 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:05:55.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:55 smithi188 bash[23329]: cluster 2020-07-16T16:05:53.476437+0000 mgr.x (mgr.34562) 7083 : cluster [DBG] pgmap v4416: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:05:55.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:55 smithi188 bash[23329]: audit 2020-07-16T16:05:53.636521+0000 mgr.x (mgr.34562) 7084 : audit [DBG] from='client.29794 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:05:57.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:57 smithi132 bash[27079]: cluster 2020-07-16T16:05:55.476880+0000 mgr.x (mgr.34562) 7085 : cluster [DBG] pgmap v4417: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:05:57.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:57 smithi188 bash[23329]: cluster 2020-07-16T16:05:55.476880+0000 mgr.x (mgr.34562) 7085 : cluster [DBG] pgmap v4417: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:05:59.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:05:59 smithi132 bash[27079]: cluster 2020-07-16T16:05:57.477369+0000 mgr.x (mgr.34562) 7086 : cluster [DBG] pgmap v4418: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:05:59.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:05:59 smithi188 bash[23329]: cluster 2020-07-16T16:05:57.477369+0000 mgr.x (mgr.34562) 7086 : cluster [DBG] pgmap v4418: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:06:01.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:01 smithi132 bash[27079]: cluster 2020-07-16T16:05:59.477730+0000 mgr.x (mgr.34562) 7087 : cluster [DBG] pgmap v4419: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:06:01.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:01 smithi188 bash[23329]: cluster 2020-07-16T16:05:59.477730+0000 mgr.x (mgr.34562) 7087 : cluster [DBG] pgmap v4419: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:06:03.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:03 smithi132 bash[27079]: cluster 2020-07-16T16:06:01.478077+0000 mgr.x (mgr.34562) 7088 : cluster [DBG] pgmap v4420: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:06:03.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:03 smithi188 bash[23329]: cluster 2020-07-16T16:06:01.478077+0000 mgr.x (mgr.34562) 7088 : cluster [DBG] pgmap v4420: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:06:05.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:05 smithi132 bash[27079]: cluster 2020-07-16T16:06:03.478463+0000 mgr.x (mgr.34562) 7089 : cluster [DBG] pgmap v4421: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:06:05.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:05 smithi188 bash[23329]: cluster 2020-07-16T16:06:03.478463+0000 mgr.x (mgr.34562) 7089 : cluster [DBG] pgmap v4421: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:06:06.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:06 smithi132 bash[27079]: audit 2020-07-16T16:06:05.659120+0000 mon.b (mon.2) 1519 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:06:06.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:06 smithi188 bash[23329]: audit 2020-07-16T16:06:05.659120+0000 mon.b (mon.2) 1519 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:06:07.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:07 smithi132 bash[27079]: cluster 2020-07-16T16:06:05.478902+0000 mgr.x (mgr.34562) 7090 : cluster [DBG] pgmap v4422: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:06:07.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:07 smithi132 bash[27079]: cephadm 2020-07-16T16:06:05.659846+0000 mgr.x (mgr.34562) 7091 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:06:07.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:07 smithi132 bash[27079]: cephadm 2020-07-16T16:06:05.660268+0000 mgr.x (mgr.34562) 7092 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:06:07.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:07 smithi188 bash[23329]: cluster 2020-07-16T16:06:05.478902+0000 mgr.x (mgr.34562) 7090 : cluster [DBG] pgmap v4422: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:06:07.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:07 smithi188 bash[23329]: cephadm 2020-07-16T16:06:05.659846+0000 mgr.x (mgr.34562) 7091 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:06:07.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:07 smithi188 bash[23329]: cephadm 2020-07-16T16:06:05.660268+0000 mgr.x (mgr.34562) 7092 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:06:09.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:09 smithi132 bash[27079]: cluster 2020-07-16T16:06:07.479462+0000 mgr.x (mgr.34562) 7093 : cluster [DBG] pgmap v4423: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:06:09.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:09 smithi188 bash[23329]: cluster 2020-07-16T16:06:07.479462+0000 mgr.x (mgr.34562) 7093 : cluster [DBG] pgmap v4423: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:06:11.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:11 smithi132 bash[27079]: cluster 2020-07-16T16:06:09.479827+0000 mgr.x (mgr.34562) 7094 : cluster [DBG] pgmap v4424: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:06:11.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:11 smithi188 bash[23329]: cluster 2020-07-16T16:06:09.479827+0000 mgr.x (mgr.34562) 7094 : cluster [DBG] pgmap v4424: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:06:13.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:13 smithi132 bash[27079]: cluster 2020-07-16T16:06:11.480368+0000 mgr.x (mgr.34562) 7095 : cluster [DBG] pgmap v4425: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:06:13.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:13 smithi188 bash[23329]: cluster 2020-07-16T16:06:11.480368+0000 mgr.x (mgr.34562) 7095 : cluster [DBG] pgmap v4425: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:06:15.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:15 smithi132 bash[27079]: cluster 2020-07-16T16:06:13.480896+0000 mgr.x (mgr.34562) 7096 : cluster [DBG] pgmap v4426: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:06:15.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:15 smithi188 bash[23329]: cluster 2020-07-16T16:06:13.480896+0000 mgr.x (mgr.34562) 7096 : cluster [DBG] pgmap v4426: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:06:17.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:17 smithi132 bash[27079]: cluster 2020-07-16T16:06:15.481277+0000 mgr.x (mgr.34562) 7097 : cluster [DBG] pgmap v4427: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:06:17.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:17 smithi188 bash[23329]: cluster 2020-07-16T16:06:15.481277+0000 mgr.x (mgr.34562) 7097 : cluster [DBG] pgmap v4427: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:06:19.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:19 smithi132 bash[27079]: cluster 2020-07-16T16:06:17.481675+0000 mgr.x (mgr.34562) 7098 : cluster [DBG] pgmap v4428: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:06:19.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:19 smithi188 bash[23329]: cluster 2020-07-16T16:06:17.481675+0000 mgr.x (mgr.34562) 7098 : cluster [DBG] pgmap v4428: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:06:21.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:21 smithi132 bash[27079]: cluster 2020-07-16T16:06:19.482129+0000 mgr.x (mgr.34562) 7099 : cluster [DBG] pgmap v4429: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:06:21.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:21 smithi132 bash[27079]: audit 2020-07-16T16:06:20.675775+0000 mon.b (mon.2) 1520 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:06:21.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:21 smithi188 bash[23329]: cluster 2020-07-16T16:06:19.482129+0000 mgr.x (mgr.34562) 7099 : cluster [DBG] pgmap v4429: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:06:21.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:21 smithi188 bash[23329]: audit 2020-07-16T16:06:20.675775+0000 mon.b (mon.2) 1520 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:06:22.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:22 smithi132 bash[27079]: cephadm 2020-07-16T16:06:20.676566+0000 mgr.x (mgr.34562) 7100 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:06:22.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:22 smithi132 bash[27079]: cephadm 2020-07-16T16:06:20.676968+0000 mgr.x (mgr.34562) 7101 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:06:22.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:22 smithi188 bash[23329]: cephadm 2020-07-16T16:06:20.676566+0000 mgr.x (mgr.34562) 7100 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:06:22.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:22 smithi188 bash[23329]: cephadm 2020-07-16T16:06:20.676968+0000 mgr.x (mgr.34562) 7101 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:06:23.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:23 smithi188 bash[23329]: cluster 2020-07-16T16:06:21.482601+0000 mgr.x (mgr.34562) 7102 : cluster [DBG] pgmap v4430: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:06:23.782 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:23 smithi132 bash[27079]: cluster 2020-07-16T16:06:21.482601+0000 mgr.x (mgr.34562) 7102 : cluster [DBG] pgmap v4430: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:06:24.235 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:06:24.496 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:06:24.496 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 10m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:06:24.496 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 10m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:06:24.497 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 10m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:06:24.497 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 10m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:06:24.497 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 10m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:06:24.497 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:06:24.498 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:06:24.498 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 10m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:06:24.498 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 10m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:06:24.498 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:06:24.498 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:06:24.499 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:06:24.499 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:06:24.499 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:06:24.499 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:06:24.500 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:06:24.500 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:06:24.500 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 10m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:06:24.795 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:06:24.796 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:06:24.796 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:06:24.796 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:06:24.796 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:06:24.797 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:06:24.797 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:06:24.797 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:06:24.797 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:06:24.797 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:06:24.798 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:06:24.798 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:06:24.798 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:06:24.798 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:06:24.798 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:06:24.799 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:06:24.799 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:06:25.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:25 smithi188 bash[23329]: cluster 2020-07-16T16:06:23.483140+0000 mgr.x (mgr.34562) 7103 : cluster [DBG] pgmap v4431: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:06:25.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:25 smithi188 bash[23329]: audit 2020-07-16T16:06:24.224061+0000 mgr.x (mgr.34562) 7104 : audit [DBG] from='client.29806 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:06:25.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:25 smithi188 bash[23329]: audit 2020-07-16T16:06:24.794886+0000 mon.c (mon.1) 478 : audit [DBG] from='client.? 172.21.15.132:0/279943790' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:06:25.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:25 smithi132 bash[27079]: cluster 2020-07-16T16:06:23.483140+0000 mgr.x (mgr.34562) 7103 : cluster [DBG] pgmap v4431: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:06:25.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:25 smithi132 bash[27079]: audit 2020-07-16T16:06:24.224061+0000 mgr.x (mgr.34562) 7104 : audit [DBG] from='client.29806 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:06:25.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:25 smithi132 bash[27079]: audit 2020-07-16T16:06:24.794886+0000 mon.c (mon.1) 478 : audit [DBG] from='client.? 172.21.15.132:0/279943790' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:06:26.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:26 smithi188 bash[23329]: audit 2020-07-16T16:06:24.492072+0000 mgr.x (mgr.34562) 7105 : audit [DBG] from='client.29812 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:06:26.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:26 smithi132 bash[27079]: audit 2020-07-16T16:06:24.492072+0000 mgr.x (mgr.34562) 7105 : audit [DBG] from='client.29812 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:06:27.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:27 smithi188 bash[23329]: cluster 2020-07-16T16:06:25.483525+0000 mgr.x (mgr.34562) 7106 : cluster [DBG] pgmap v4432: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:06:27.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:27 smithi132 bash[27079]: cluster 2020-07-16T16:06:25.483525+0000 mgr.x (mgr.34562) 7106 : cluster [DBG] pgmap v4432: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:06:29.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:29 smithi188 bash[23329]: cluster 2020-07-16T16:06:27.483887+0000 mgr.x (mgr.34562) 7107 : cluster [DBG] pgmap v4433: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:06:29.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:29 smithi132 bash[27079]: cluster 2020-07-16T16:06:27.483887+0000 mgr.x (mgr.34562) 7107 : cluster [DBG] pgmap v4433: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:06:31.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:31 smithi188 bash[23329]: cluster 2020-07-16T16:06:29.484272+0000 mgr.x (mgr.34562) 7108 : cluster [DBG] pgmap v4434: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:06:31.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:31 smithi132 bash[27079]: cluster 2020-07-16T16:06:29.484272+0000 mgr.x (mgr.34562) 7108 : cluster [DBG] pgmap v4434: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:06:33.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:33 smithi188 bash[23329]: cluster 2020-07-16T16:06:31.484706+0000 mgr.x (mgr.34562) 7109 : cluster [DBG] pgmap v4435: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:06:33.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:33 smithi132 bash[27079]: cluster 2020-07-16T16:06:31.484706+0000 mgr.x (mgr.34562) 7109 : cluster [DBG] pgmap v4435: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:06:35.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:35 smithi188 bash[23329]: cluster 2020-07-16T16:06:33.485119+0000 mgr.x (mgr.34562) 7110 : cluster [DBG] pgmap v4436: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:06:35.783 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:35 smithi132 bash[27079]: cluster 2020-07-16T16:06:33.485119+0000 mgr.x (mgr.34562) 7110 : cluster [DBG] pgmap v4436: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:06:36.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:36 smithi188 bash[23329]: audit 2020-07-16T16:06:35.693125+0000 mon.b (mon.2) 1521 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T16:06:36.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:36 smithi188 bash[23329]: audit 2020-07-16T16:06:35.693361+0000 mon.b (mon.2) 1522 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T16:06:36.647 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:36 smithi132 bash[27079]: audit 2020-07-16T16:06:35.693125+0000 mon.b (mon.2) 1521 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T16:06:36.647 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:36 smithi132 bash[27079]: audit 2020-07-16T16:06:35.693361+0000 mon.b (mon.2) 1522 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T16:06:37.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:37 smithi188 bash[23329]: cluster 2020-07-16T16:06:35.485603+0000 mgr.x (mgr.34562) 7111 : cluster [DBG] pgmap v4437: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:06:37.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:37 smithi132 bash[27079]: cluster 2020-07-16T16:06:35.485603+0000 mgr.x (mgr.34562) 7111 : cluster [DBG] pgmap v4437: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:06:38.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:38 smithi188 bash[23329]: audit 2020-07-16T16:06:37.895755+0000 mon.b (mon.2) 1523 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T16:06:37.894248\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894312\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894349\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894379\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894541\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894660\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894757\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894854\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894887\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T16:06:37.894972\", \"last_device_update\": \"2020-07-16T16:05:32.972399\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:58:09.566665\"}"}]: dispatch 2020-07-16T16:06:38.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:38 smithi188 bash[23329]: audit 2020-07-16T16:06:37.896375+0000 mon.c (mon.1) 479 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T16:06:37.894248\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894312\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894349\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894379\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894541\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894660\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894757\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894854\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894887\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T16:06:37.894972\", \"last_device_update\": \"2020-07-16T16:05:32.972399\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:58:09.566665\"}"}]: dispatch 2020-07-16T16:06:38.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:38 smithi188 bash[23329]: audit 2020-07-16T16:06:37.898956+0000 mon.c (mon.1) 480 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T16:06:37.894248\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894312\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894349\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894379\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894541\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894660\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894757\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894854\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894887\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T16:06:37.894972\", \"last_device_update\": \"2020-07-16T16:05:32.972399\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:58:09.566665\"}"}]': finished 2020-07-16T16:06:38.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:38 smithi188 bash[23329]: audit 2020-07-16T16:06:38.190541+0000 mon.b (mon.2) 1524 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189044\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189117\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189147\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189334\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189440\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189541\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189654\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189686\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189714\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T16:06:38.189780\", \"last_device_update\": \"2020-07-16T15:36:02.606623\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:58:09.567322\"}"}]: dispatch 2020-07-16T16:06:38.425 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:38 smithi188 bash[23329]: audit 2020-07-16T16:06:38.191201+0000 mon.c (mon.1) 481 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189044\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189117\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189147\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189334\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189440\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189541\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189654\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189686\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189714\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T16:06:38.189780\", \"last_device_update\": \"2020-07-16T15:36:02.606623\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:58:09.567322\"}"}]: dispatch 2020-07-16T16:06:38.425 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:38 smithi188 bash[23329]: audit 2020-07-16T16:06:38.193524+0000 mon.c (mon.1) 482 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189044\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189117\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189147\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189334\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189440\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189541\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189654\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189686\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189714\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T16:06:38.189780\", \"last_device_update\": \"2020-07-16T15:36:02.606623\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:58:09.567322\"}"}]': finished 2020-07-16T16:06:38.426 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:38 smithi188 bash[23329]: audit 2020-07-16T16:06:38.195027+0000 mon.b (mon.2) 1525 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T16:06:38.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:38 smithi132 bash[27079]: audit 2020-07-16T16:06:37.895755+0000 mon.b (mon.2) 1523 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T16:06:37.894248\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894312\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894349\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894379\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894541\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894660\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894757\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894854\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894887\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T16:06:37.894972\", \"last_device_update\": \"2020-07-16T16:05:32.972399\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:58:09.566665\"}"}]: dispatch 2020-07-16T16:06:38.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:38 smithi132 bash[27079]: audit 2020-07-16T16:06:37.896375+0000 mon.c (mon.1) 479 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T16:06:37.894248\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894312\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894349\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894379\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894541\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894660\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894757\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894854\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894887\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T16:06:37.894972\", \"last_device_update\": \"2020-07-16T16:05:32.972399\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:58:09.566665\"}"}]: dispatch 2020-07-16T16:06:38.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:38 smithi132 bash[27079]: audit 2020-07-16T16:06:37.898956+0000 mon.c (mon.1) 480 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T16:06:37.894248\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894312\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894349\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894379\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894541\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894660\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894757\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894854\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894887\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T16:06:37.894972\", \"last_device_update\": \"2020-07-16T16:05:32.972399\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T15:58:09.566665\"}"}]': finished 2020-07-16T16:06:38.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:38 smithi132 bash[27079]: audit 2020-07-16T16:06:38.190541+0000 mon.b (mon.2) 1524 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189044\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189117\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189147\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189334\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189440\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189541\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189654\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189686\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189714\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T16:06:38.189780\", \"last_device_update\": \"2020-07-16T15:36:02.606623\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:58:09.567322\"}"}]: dispatch 2020-07-16T16:06:38.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:38 smithi132 bash[27079]: audit 2020-07-16T16:06:38.191201+0000 mon.c (mon.1) 481 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189044\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189117\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189147\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189334\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189440\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189541\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189654\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189686\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189714\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T16:06:38.189780\", \"last_device_update\": \"2020-07-16T15:36:02.606623\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:58:09.567322\"}"}]: dispatch 2020-07-16T16:06:38.782 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:38 smithi132 bash[27079]: audit 2020-07-16T16:06:38.193524+0000 mon.c (mon.1) 482 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189044\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189117\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189147\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189334\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189440\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189541\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189654\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189686\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189714\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T16:06:38.189780\", \"last_device_update\": \"2020-07-16T15:36:02.606623\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:58:09.567322\"}"}]': finished 2020-07-16T16:06:38.782 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:38 smithi132 bash[27079]: audit 2020-07-16T16:06:38.195027+0000 mon.b (mon.2) 1525 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T16:06:39.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:39 smithi188 bash[23329]: cluster 2020-07-16T16:06:37.485932+0000 mgr.x (mgr.34562) 7112 : cluster [DBG] pgmap v4438: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:06:39.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:39 smithi132 bash[27079]: cluster 2020-07-16T16:06:37.485932+0000 mgr.x (mgr.34562) 7112 : cluster [DBG] pgmap v4438: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:06:41.583 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:41 smithi132 bash[27079]: cluster 2020-07-16T16:06:39.486333+0000 mgr.x (mgr.34562) 7113 : cluster [DBG] pgmap v4439: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:06:41.583 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:41 smithi132 bash[27079]: audit 2020-07-16T16:06:40.963746+0000 mon.b (mon.2) 1526 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T16:06:41.584 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:41 smithi132 bash[27079]: audit 2020-07-16T16:06:41.171651+0000 mon.b (mon.2) 1527 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189044\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189117\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189147\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189334\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189440\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189541\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189654\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189686\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189714\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T16:06:38.189780\", \"last_device_update\": \"2020-07-16T16:06:41.170725\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:58:09.567322\"}"}]: dispatch 2020-07-16T16:06:41.584 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:41 smithi132 bash[27079]: audit 2020-07-16T16:06:41.172336+0000 mon.c (mon.1) 483 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189044\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189117\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189147\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189334\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189440\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189541\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189654\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189686\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189714\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T16:06:38.189780\", \"last_device_update\": \"2020-07-16T16:06:41.170725\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:58:09.567322\"}"}]: dispatch 2020-07-16T16:06:41.584 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:41 smithi132 bash[27079]: audit 2020-07-16T16:06:41.175375+0000 mon.c (mon.1) 484 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189044\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189117\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189147\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189334\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189440\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189541\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189654\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189686\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189714\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T16:06:38.189780\", \"last_device_update\": \"2020-07-16T16:06:41.170725\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:58:09.567322\"}"}]': finished 2020-07-16T16:06:41.585 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:41 smithi132 bash[27079]: audit 2020-07-16T16:06:41.178017+0000 mon.b (mon.2) 1528 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:06:41.585 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:41 smithi132 bash[27079]: audit 2020-07-16T16:06:41.178935+0000 mon.b (mon.2) 1529 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:06:41.585 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:41 smithi132 bash[27079]: audit 2020-07-16T16:06:41.179724+0000 mon.b (mon.2) 1530 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:06:41.585 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:41 smithi132 bash[27079]: audit 2020-07-16T16:06:41.180782+0000 mon.b (mon.2) 1531 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:06:41.585 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:41 smithi132 bash[27079]: audit 2020-07-16T16:06:41.181813+0000 mon.b (mon.2) 1532 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:06:41.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:41 smithi188 bash[23329]: cluster 2020-07-16T16:06:39.486333+0000 mgr.x (mgr.34562) 7113 : cluster [DBG] pgmap v4439: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:06:41.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:41 smithi188 bash[23329]: audit 2020-07-16T16:06:40.963746+0000 mon.b (mon.2) 1526 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T16:06:41.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:41 smithi188 bash[23329]: audit 2020-07-16T16:06:41.171651+0000 mon.b (mon.2) 1527 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189044\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189117\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189147\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189334\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189440\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189541\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189654\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189686\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189714\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T16:06:38.189780\", \"last_device_update\": \"2020-07-16T16:06:41.170725\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:58:09.567322\"}"}]: dispatch 2020-07-16T16:06:41.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:41 smithi188 bash[23329]: audit 2020-07-16T16:06:41.172336+0000 mon.c (mon.1) 483 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189044\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189117\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189147\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189334\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189440\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189541\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189654\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189686\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189714\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T16:06:38.189780\", \"last_device_update\": \"2020-07-16T16:06:41.170725\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:58:09.567322\"}"}]: dispatch 2020-07-16T16:06:41.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:41 smithi188 bash[23329]: audit 2020-07-16T16:06:41.175375+0000 mon.c (mon.1) 484 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189044\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189117\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189147\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189334\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189440\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189541\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189654\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189686\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189714\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T16:06:38.189780\", \"last_device_update\": \"2020-07-16T16:06:41.170725\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T15:58:09.567322\"}"}]': finished 2020-07-16T16:06:41.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:41 smithi188 bash[23329]: audit 2020-07-16T16:06:41.178017+0000 mon.b (mon.2) 1528 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:06:41.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:41 smithi188 bash[23329]: audit 2020-07-16T16:06:41.178935+0000 mon.b (mon.2) 1529 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:06:41.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:41 smithi188 bash[23329]: audit 2020-07-16T16:06:41.179724+0000 mon.b (mon.2) 1530 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:06:41.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:41 smithi188 bash[23329]: audit 2020-07-16T16:06:41.180782+0000 mon.b (mon.2) 1531 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:06:41.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:41 smithi188 bash[23329]: audit 2020-07-16T16:06:41.181813+0000 mon.b (mon.2) 1532 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:06:42.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:42 smithi188 bash[23329]: audit 2020-07-16T16:06:41.178303+0000 mgr.x (mgr.34562) 7114 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:06:42.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:42 smithi188 bash[23329]: audit 2020-07-16T16:06:41.179164+0000 mgr.x (mgr.34562) 7115 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:06:42.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:42 smithi188 bash[23329]: audit 2020-07-16T16:06:41.179932+0000 mgr.x (mgr.34562) 7116 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:06:42.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:42 smithi188 bash[23329]: cephadm 2020-07-16T16:06:41.180445+0000 mgr.x (mgr.34562) 7117 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:06:42.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:42 smithi188 bash[23329]: cephadm 2020-07-16T16:06:41.181398+0000 mgr.x (mgr.34562) 7118 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:06:42.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:42 smithi188 bash[23329]: cephadm 2020-07-16T16:06:41.182373+0000 mgr.x (mgr.34562) 7119 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:06:42.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:42 smithi188 bash[23329]: cephadm 2020-07-16T16:06:41.182626+0000 mgr.x (mgr.34562) 7120 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:06:42.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:42 smithi132 bash[27079]: audit 2020-07-16T16:06:41.178303+0000 mgr.x (mgr.34562) 7114 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:06:42.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:42 smithi132 bash[27079]: audit 2020-07-16T16:06:41.179164+0000 mgr.x (mgr.34562) 7115 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:06:42.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:42 smithi132 bash[27079]: audit 2020-07-16T16:06:41.179932+0000 mgr.x (mgr.34562) 7116 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:06:42.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:42 smithi132 bash[27079]: cephadm 2020-07-16T16:06:41.180445+0000 mgr.x (mgr.34562) 7117 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:06:42.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:42 smithi132 bash[27079]: cephadm 2020-07-16T16:06:41.181398+0000 mgr.x (mgr.34562) 7118 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:06:42.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:42 smithi132 bash[27079]: cephadm 2020-07-16T16:06:41.182373+0000 mgr.x (mgr.34562) 7119 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:06:42.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:42 smithi132 bash[27079]: cephadm 2020-07-16T16:06:41.182626+0000 mgr.x (mgr.34562) 7120 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:06:43.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:43 smithi188 bash[23329]: cluster 2020-07-16T16:06:41.486720+0000 mgr.x (mgr.34562) 7121 : cluster [DBG] pgmap v4440: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:06:43.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:43 smithi132 bash[27079]: cluster 2020-07-16T16:06:41.486720+0000 mgr.x (mgr.34562) 7121 : cluster [DBG] pgmap v4440: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:06:44.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:44 smithi188 bash[23329]: audit 2020-07-16T16:06:43.959752+0000 mon.b (mon.2) 1533 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:06:44.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:44 smithi132 bash[27079]: audit 2020-07-16T16:06:43.959752+0000 mon.b (mon.2) 1533 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:06:45.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:45 smithi188 bash[23329]: cluster 2020-07-16T16:06:43.487063+0000 mgr.x (mgr.34562) 7122 : cluster [DBG] pgmap v4441: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:06:45.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:45 smithi188 bash[23329]: cephadm 2020-07-16T16:06:43.960382+0000 mgr.x (mgr.34562) 7123 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:06:45.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:45 smithi188 bash[23329]: cephadm 2020-07-16T16:06:43.960600+0000 mgr.x (mgr.34562) 7124 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:06:45.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:45 smithi132 bash[27079]: cluster 2020-07-16T16:06:43.487063+0000 mgr.x (mgr.34562) 7122 : cluster [DBG] pgmap v4441: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:06:45.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:45 smithi132 bash[27079]: cephadm 2020-07-16T16:06:43.960382+0000 mgr.x (mgr.34562) 7123 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:06:45.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:45 smithi132 bash[27079]: cephadm 2020-07-16T16:06:43.960600+0000 mgr.x (mgr.34562) 7124 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:06:47.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:47 smithi188 bash[23329]: cluster 2020-07-16T16:06:45.487456+0000 mgr.x (mgr.34562) 7125 : cluster [DBG] pgmap v4442: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:06:47.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:47 smithi132 bash[27079]: cluster 2020-07-16T16:06:45.487456+0000 mgr.x (mgr.34562) 7125 : cluster [DBG] pgmap v4442: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:06:49.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:49 smithi188 bash[23329]: cluster 2020-07-16T16:06:47.487975+0000 mgr.x (mgr.34562) 7126 : cluster [DBG] pgmap v4443: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:06:49.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:49 smithi132 bash[27079]: cluster 2020-07-16T16:06:47.487975+0000 mgr.x (mgr.34562) 7126 : cluster [DBG] pgmap v4443: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:06:51.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:51 smithi188 bash[23329]: cluster 2020-07-16T16:06:49.488496+0000 mgr.x (mgr.34562) 7127 : cluster [DBG] pgmap v4444: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:06:51.784 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:51 smithi132 bash[27079]: cluster 2020-07-16T16:06:49.488496+0000 mgr.x (mgr.34562) 7127 : cluster [DBG] pgmap v4444: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:06:53.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:53 smithi188 bash[23329]: cluster 2020-07-16T16:06:51.488926+0000 mgr.x (mgr.34562) 7128 : cluster [DBG] pgmap v4445: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:06:53.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:53 smithi132 bash[27079]: cluster 2020-07-16T16:06:51.488926+0000 mgr.x (mgr.34562) 7128 : cluster [DBG] pgmap v4445: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:06:55.102 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:06:55.356 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:06:55.357 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 17s ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:06:55.357 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 17s ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:06:55.358 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 17s ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:06:55.358 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 17s ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:06:55.358 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 17s ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:06:55.359 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 17s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:06:55.359 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 17s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:06:55.359 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 17s ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:06:55.360 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 17s ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:06:55.360 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 17s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:06:55.360 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 17s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:06:55.361 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 17s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:06:55.361 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 17s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:06:55.361 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 17s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:06:55.362 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 17s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:06:55.362 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 17s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:06:55.362 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 17s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:06:55.363 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 17s ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:06:55.656 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:06:55.657 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:06:55.657 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:06:55.657 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:06:55.658 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:06:55.658 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:06:55.658 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:06:55.658 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:06:55.658 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:06:55.659 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:06:55.659 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:06:55.659 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:06:55.659 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:06:55.659 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:06:55.660 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:06:55.660 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:06:55.660 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:06:55.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:55 smithi188 bash[23329]: cluster 2020-07-16T16:06:53.489487+0000 mgr.x (mgr.34562) 7129 : cluster [DBG] pgmap v4446: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:06:55.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:55 smithi132 bash[27079]: cluster 2020-07-16T16:06:53.489487+0000 mgr.x (mgr.34562) 7129 : cluster [DBG] pgmap v4446: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:06:56.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:56 smithi188 bash[23329]: audit 2020-07-16T16:06:55.084866+0000 mgr.x (mgr.34562) 7130 : audit [DBG] from='client.29824 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:06:56.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:56 smithi188 bash[23329]: audit 2020-07-16T16:06:55.352406+0000 mgr.x (mgr.34562) 7131 : audit [DBG] from='client.29830 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:06:56.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:56 smithi188 bash[23329]: audit 2020-07-16T16:06:55.656002+0000 mon.c (mon.1) 485 : audit [DBG] from='client.? 172.21.15.132:0/1746087830' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:06:56.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:56 smithi132 bash[27079]: audit 2020-07-16T16:06:55.084866+0000 mgr.x (mgr.34562) 7130 : audit [DBG] from='client.29824 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:06:56.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:56 smithi132 bash[27079]: audit 2020-07-16T16:06:55.352406+0000 mgr.x (mgr.34562) 7131 : audit [DBG] from='client.29830 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:06:56.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:56 smithi132 bash[27079]: audit 2020-07-16T16:06:55.656002+0000 mon.c (mon.1) 485 : audit [DBG] from='client.? 172.21.15.132:0/1746087830' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:06:57.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:57 smithi188 bash[23329]: cluster 2020-07-16T16:06:55.489817+0000 mgr.x (mgr.34562) 7132 : cluster [DBG] pgmap v4447: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:06:57.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:57 smithi132 bash[27079]: cluster 2020-07-16T16:06:55.489817+0000 mgr.x (mgr.34562) 7132 : cluster [DBG] pgmap v4447: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:06:59.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:59 smithi188 bash[23329]: cluster 2020-07-16T16:06:57.490242+0000 mgr.x (mgr.34562) 7133 : cluster [DBG] pgmap v4448: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:06:59.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:06:59 smithi188 bash[23329]: audit 2020-07-16T16:06:58.972589+0000 mon.b (mon.2) 1534 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:06:59.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:59 smithi132 bash[27079]: cluster 2020-07-16T16:06:57.490242+0000 mgr.x (mgr.34562) 7133 : cluster [DBG] pgmap v4448: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:06:59.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:06:59 smithi132 bash[27079]: audit 2020-07-16T16:06:58.972589+0000 mon.b (mon.2) 1534 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:07:00.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:07:00 smithi188 bash[23329]: cephadm 2020-07-16T16:06:58.973322+0000 mgr.x (mgr.34562) 7134 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:07:00.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:07:00 smithi188 bash[23329]: cephadm 2020-07-16T16:06:58.973833+0000 mgr.x (mgr.34562) 7135 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:07:00.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:07:00 smithi132 bash[27079]: cephadm 2020-07-16T16:06:58.973322+0000 mgr.x (mgr.34562) 7134 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:07:00.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:07:00 smithi132 bash[27079]: cephadm 2020-07-16T16:06:58.973833+0000 mgr.x (mgr.34562) 7135 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:07:01.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:07:01 smithi188 bash[23329]: cluster 2020-07-16T16:06:59.490679+0000 mgr.x (mgr.34562) 7136 : cluster [DBG] pgmap v4449: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:07:01.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:07:01 smithi132 bash[27079]: cluster 2020-07-16T16:06:59.490679+0000 mgr.x (mgr.34562) 7136 : cluster [DBG] pgmap v4449: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:07:03.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:07:03 smithi188 bash[23329]: cluster 2020-07-16T16:07:01.491134+0000 mgr.x (mgr.34562) 7137 : cluster [DBG] pgmap v4450: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:07:03.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:07:03 smithi132 bash[27079]: cluster 2020-07-16T16:07:01.491134+0000 mgr.x (mgr.34562) 7137 : cluster [DBG] pgmap v4450: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:07:05.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:07:05 smithi188 bash[23329]: cluster 2020-07-16T16:07:03.491536+0000 mgr.x (mgr.34562) 7138 : cluster [DBG] pgmap v4451: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:07:05.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:07:05 smithi132 bash[27079]: cluster 2020-07-16T16:07:03.491536+0000 mgr.x (mgr.34562) 7138 : cluster [DBG] pgmap v4451: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:07:07.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:07:07 smithi188 bash[23329]: cluster 2020-07-16T16:07:05.491979+0000 mgr.x (mgr.34562) 7139 : cluster [DBG] pgmap v4452: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:07:07.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:07:07 smithi132 bash[27079]: cluster 2020-07-16T16:07:05.491979+0000 mgr.x (mgr.34562) 7139 : cluster [DBG] pgmap v4452: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:07:09.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:07:09 smithi188 bash[23329]: cluster 2020-07-16T16:07:07.492532+0000 mgr.x (mgr.34562) 7140 : cluster [DBG] pgmap v4453: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:07:09.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:07:09 smithi132 bash[27079]: cluster 2020-07-16T16:07:07.492532+0000 mgr.x (mgr.34562) 7140 : cluster [DBG] pgmap v4453: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:07:11.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:07:11 smithi188 bash[23329]: cluster 2020-07-16T16:07:09.492967+0000 mgr.x (mgr.34562) 7141 : cluster [DBG] pgmap v4454: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:07:11.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:07:11 smithi132 bash[27079]: cluster 2020-07-16T16:07:09.492967+0000 mgr.x (mgr.34562) 7141 : cluster [DBG] pgmap v4454: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:07:13.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:07:13 smithi188 bash[23329]: cluster 2020-07-16T16:07:11.493381+0000 mgr.x (mgr.34562) 7142 : cluster [DBG] pgmap v4455: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:07:13.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:07:13 smithi132 bash[27079]: cluster 2020-07-16T16:07:11.493381+0000 mgr.x (mgr.34562) 7142 : cluster [DBG] pgmap v4455: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:07:14.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:07:14 smithi188 bash[23329]: cluster 2020-07-16T16:07:13.493916+0000 mgr.x (mgr.34562) 7143 : cluster [DBG] pgmap v4456: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:07:14.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:07:14 smithi188 bash[23329]: audit 2020-07-16T16:07:13.977687+0000 mon.b (mon.2) 1535 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:07:14.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:07:14 smithi188 bash[23329]: cephadm 2020-07-16T16:07:13.978388+0000 mgr.x (mgr.34562) 7144 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:07:14.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:07:14 smithi188 bash[23329]: cephadm 2020-07-16T16:07:13.978794+0000 mgr.x (mgr.34562) 7145 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:07:14.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:07:14 smithi132 bash[27079]: cluster 2020-07-16T16:07:13.493916+0000 mgr.x (mgr.34562) 7143 : cluster [DBG] pgmap v4456: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:07:14.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:07:14 smithi132 bash[27079]: audit 2020-07-16T16:07:13.977687+0000 mon.b (mon.2) 1535 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:07:14.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:07:14 smithi132 bash[27079]: cephadm 2020-07-16T16:07:13.978388+0000 mgr.x (mgr.34562) 7144 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:07:14.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:07:14 smithi132 bash[27079]: cephadm 2020-07-16T16:07:13.978794+0000 mgr.x (mgr.34562) 7145 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:07:17.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:07:16 smithi132 bash[27079]: cluster 2020-07-16T16:07:15.494450+0000 mgr.x (mgr.34562) 7146 : cluster [DBG] pgmap v4457: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:07:17.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:07:16 smithi188 bash[23329]: cluster 2020-07-16T16:07:15.494450+0000 mgr.x (mgr.34562) 7146 : cluster [DBG] pgmap v4457: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:07:19.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:07:18 smithi132 bash[27079]: cluster 2020-07-16T16:07:17.494987+0000 mgr.x (mgr.34562) 7147 : cluster [DBG] pgmap v4458: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:07:19.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:07:18 smithi188 bash[23329]: cluster 2020-07-16T16:07:17.494987+0000 mgr.x (mgr.34562) 7147 : cluster [DBG] pgmap v4458: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:07:21.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:07:20 smithi132 bash[27079]: cluster 2020-07-16T16:07:19.495511+0000 mgr.x (mgr.34562) 7148 : cluster [DBG] pgmap v4459: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:07:21.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:07:20 smithi188 bash[23329]: cluster 2020-07-16T16:07:19.495511+0000 mgr.x (mgr.34562) 7148 : cluster [DBG] pgmap v4459: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:07:23.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:07:22 smithi132 bash[27079]: cluster 2020-07-16T16:07:21.495901+0000 mgr.x (mgr.34562) 7149 : cluster [DBG] pgmap v4460: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:07:23.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:07:22 smithi188 bash[23329]: cluster 2020-07-16T16:07:21.495901+0000 mgr.x (mgr.34562) 7149 : cluster [DBG] pgmap v4460: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:07:25.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:07:24 smithi132 bash[27079]: cluster 2020-07-16T16:07:23.496411+0000 mgr.x (mgr.34562) 7150 : cluster [DBG] pgmap v4461: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:07:25.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:07:24 smithi188 bash[23329]: cluster 2020-07-16T16:07:23.496411+0000 mgr.x (mgr.34562) 7150 : cluster [DBG] pgmap v4461: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:07:25.955 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:07:26.216 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:07:26.216 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 48s ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:07:26.216 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 48s ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:07:26.216 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 48s ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:07:26.217 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 48s ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:07:26.217 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 48s ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:07:26.217 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 48s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:07:26.217 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 48s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:07:26.217 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 48s ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:07:26.218 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 48s ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:07:26.218 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 48s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:07:26.218 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 48s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:07:26.218 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 48s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:07:26.218 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 48s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:07:26.219 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 48s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:07:26.219 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 48s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:07:26.219 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 48s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:07:26.219 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 48s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:07:26.219 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 48s ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:07:26.511 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:07:26.511 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:07:26.511 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:07:26.512 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:07:26.512 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:07:26.512 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:07:26.512 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:07:26.512 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:07:26.512 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:07:26.513 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:07:26.513 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:07:26.513 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:07:26.513 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:07:26.513 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:07:26.514 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:07:26.514 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:07:26.514 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:07:27.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:07:26 smithi132 bash[27079]: cluster 2020-07-16T16:07:25.496877+0000 mgr.x (mgr.34562) 7151 : cluster [DBG] pgmap v4462: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:07:27.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:07:26 smithi132 bash[27079]: audit 2020-07-16T16:07:25.943696+0000 mgr.x (mgr.34562) 7152 : audit [DBG] from='client.29842 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:07:27.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:07:26 smithi132 bash[27079]: audit 2020-07-16T16:07:26.211589+0000 mgr.x (mgr.34562) 7153 : audit [DBG] from='client.29848 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:07:27.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:07:26 smithi132 bash[27079]: audit 2020-07-16T16:07:26.510206+0000 mon.c (mon.1) 486 : audit [DBG] from='client.? 172.21.15.132:0/3144803063' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:07:27.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:07:26 smithi188 bash[23329]: cluster 2020-07-16T16:07:25.496877+0000 mgr.x (mgr.34562) 7151 : cluster [DBG] pgmap v4462: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:07:27.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:07:26 smithi188 bash[23329]: audit 2020-07-16T16:07:25.943696+0000 mgr.x (mgr.34562) 7152 : audit [DBG] from='client.29842 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:07:27.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:07:26 smithi188 bash[23329]: audit 2020-07-16T16:07:26.211589+0000 mgr.x (mgr.34562) 7153 : audit [DBG] from='client.29848 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:07:27.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:07:26 smithi188 bash[23329]: audit 2020-07-16T16:07:26.510206+0000 mon.c (mon.1) 486 : audit [DBG] from='client.? 172.21.15.132:0/3144803063' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:07:29.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:07:28 smithi132 bash[27079]: cluster 2020-07-16T16:07:27.497317+0000 mgr.x (mgr.34562) 7154 : cluster [DBG] pgmap v4463: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:07:29.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:07:28 smithi188 bash[23329]: cluster 2020-07-16T16:07:27.497317+0000 mgr.x (mgr.34562) 7154 : cluster [DBG] pgmap v4463: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:07:30.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:07:29 smithi132 bash[27079]: audit 2020-07-16T16:07:28.994257+0000 mon.b (mon.2) 1536 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:07:30.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:07:29 smithi132 bash[27079]: cephadm 2020-07-16T16:07:28.994983+0000 mgr.x (mgr.34562) 7155 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:07:30.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:07:29 smithi132 bash[27079]: cephadm 2020-07-16T16:07:28.995389+0000 mgr.x (mgr.34562) 7156 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:07:30.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:07:29 smithi188 bash[23329]: audit 2020-07-16T16:07:28.994257+0000 mon.b (mon.2) 1536 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:07:30.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:07:29 smithi188 bash[23329]: cephadm 2020-07-16T16:07:28.994983+0000 mgr.x (mgr.34562) 7155 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:07:30.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:07:29 smithi188 bash[23329]: cephadm 2020-07-16T16:07:28.995389+0000 mgr.x (mgr.34562) 7156 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:07:31.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:07:30 smithi132 bash[27079]: cluster 2020-07-16T16:07:29.497785+0000 mgr.x (mgr.34562) 7157 : cluster [DBG] pgmap v4464: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:07:31.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:07:30 smithi188 bash[23329]: cluster 2020-07-16T16:07:29.497785+0000 mgr.x (mgr.34562) 7157 : cluster [DBG] pgmap v4464: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:07:33.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:07:32 smithi132 bash[27079]: cluster 2020-07-16T16:07:31.498174+0000 mgr.x (mgr.34562) 7158 : cluster [DBG] pgmap v4465: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:07:33.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:07:32 smithi188 bash[23329]: cluster 2020-07-16T16:07:31.498174+0000 mgr.x (mgr.34562) 7158 : cluster [DBG] pgmap v4465: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:07:35.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:07:34 smithi132 bash[27079]: cluster 2020-07-16T16:07:33.498702+0000 mgr.x (mgr.34562) 7159 : cluster [DBG] pgmap v4466: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:07:35.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:07:34 smithi188 bash[23329]: cluster 2020-07-16T16:07:33.498702+0000 mgr.x (mgr.34562) 7159 : cluster [DBG] pgmap v4466: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:07:37.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:07:36 smithi132 bash[27079]: cluster 2020-07-16T16:07:35.499155+0000 mgr.x (mgr.34562) 7160 : cluster [DBG] pgmap v4467: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:07:37.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:07:36 smithi188 bash[23329]: cluster 2020-07-16T16:07:35.499155+0000 mgr.x (mgr.34562) 7160 : cluster [DBG] pgmap v4467: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:07:39.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:07:38 smithi132 bash[27079]: cluster 2020-07-16T16:07:37.499679+0000 mgr.x (mgr.34562) 7161 : cluster [DBG] pgmap v4468: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:07:39.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:07:38 smithi188 bash[23329]: cluster 2020-07-16T16:07:37.499679+0000 mgr.x (mgr.34562) 7161 : cluster [DBG] pgmap v4468: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:07:41.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:07:40 smithi132 bash[27079]: cluster 2020-07-16T16:07:39.500153+0000 mgr.x (mgr.34562) 7162 : cluster [DBG] pgmap v4469: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:07:41.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:07:40 smithi188 bash[23329]: cluster 2020-07-16T16:07:39.500153+0000 mgr.x (mgr.34562) 7162 : cluster [DBG] pgmap v4469: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:07:43.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:07:42 smithi132 bash[27079]: cluster 2020-07-16T16:07:41.500580+0000 mgr.x (mgr.34562) 7163 : cluster [DBG] pgmap v4470: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:07:43.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:07:42 smithi188 bash[23329]: cluster 2020-07-16T16:07:41.500580+0000 mgr.x (mgr.34562) 7163 : cluster [DBG] pgmap v4470: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:07:45.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:07:45 smithi132 bash[27079]: cluster 2020-07-16T16:07:43.500940+0000 mgr.x (mgr.34562) 7164 : cluster [DBG] pgmap v4471: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:07:45.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:07:45 smithi132 bash[27079]: audit 2020-07-16T16:07:44.013368+0000 mon.b (mon.2) 1537 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:07:45.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:07:45 smithi132 bash[27079]: audit 2020-07-16T16:07:44.013751+0000 mgr.x (mgr.34562) 7165 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:07:45.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:07:45 smithi132 bash[27079]: audit 2020-07-16T16:07:44.014764+0000 mon.b (mon.2) 1538 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:07:45.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:07:45 smithi132 bash[27079]: audit 2020-07-16T16:07:44.015060+0000 mgr.x (mgr.34562) 7166 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:07:45.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:07:45 smithi132 bash[27079]: audit 2020-07-16T16:07:44.016016+0000 mon.b (mon.2) 1539 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:07:45.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:07:45 smithi132 bash[27079]: audit 2020-07-16T16:07:44.016347+0000 mgr.x (mgr.34562) 7167 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:07:45.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:07:45 smithi132 bash[27079]: cephadm 2020-07-16T16:07:44.017065+0000 mgr.x (mgr.34562) 7168 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:07:45.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:07:45 smithi132 bash[27079]: audit 2020-07-16T16:07:44.017533+0000 mon.b (mon.2) 1540 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:07:45.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:07:45 smithi132 bash[27079]: cephadm 2020-07-16T16:07:44.018415+0000 mgr.x (mgr.34562) 7169 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:07:45.281 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:07:45 smithi132 bash[27079]: audit 2020-07-16T16:07:44.018964+0000 mon.b (mon.2) 1541 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:07:45.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:07:45 smithi132 bash[27079]: cephadm 2020-07-16T16:07:44.019677+0000 mgr.x (mgr.34562) 7170 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:07:45.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:07:45 smithi132 bash[27079]: cephadm 2020-07-16T16:07:44.019923+0000 mgr.x (mgr.34562) 7171 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:07:45.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:07:45 smithi188 bash[23329]: cluster 2020-07-16T16:07:43.500940+0000 mgr.x (mgr.34562) 7164 : cluster [DBG] pgmap v4471: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:07:45.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:07:45 smithi188 bash[23329]: audit 2020-07-16T16:07:44.013368+0000 mon.b (mon.2) 1537 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:07:45.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:07:45 smithi188 bash[23329]: audit 2020-07-16T16:07:44.013751+0000 mgr.x (mgr.34562) 7165 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:07:45.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:07:45 smithi188 bash[23329]: audit 2020-07-16T16:07:44.014764+0000 mon.b (mon.2) 1538 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:07:45.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:07:45 smithi188 bash[23329]: audit 2020-07-16T16:07:44.015060+0000 mgr.x (mgr.34562) 7166 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:07:45.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:07:45 smithi188 bash[23329]: audit 2020-07-16T16:07:44.016016+0000 mon.b (mon.2) 1539 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:07:45.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:07:45 smithi188 bash[23329]: audit 2020-07-16T16:07:44.016347+0000 mgr.x (mgr.34562) 7167 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:07:45.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:07:45 smithi188 bash[23329]: cephadm 2020-07-16T16:07:44.017065+0000 mgr.x (mgr.34562) 7168 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:07:45.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:07:45 smithi188 bash[23329]: audit 2020-07-16T16:07:44.017533+0000 mon.b (mon.2) 1540 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:07:45.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:07:45 smithi188 bash[23329]: cephadm 2020-07-16T16:07:44.018415+0000 mgr.x (mgr.34562) 7169 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:07:45.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:07:45 smithi188 bash[23329]: audit 2020-07-16T16:07:44.018964+0000 mon.b (mon.2) 1541 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:07:45.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:07:45 smithi188 bash[23329]: cephadm 2020-07-16T16:07:44.019677+0000 mgr.x (mgr.34562) 7170 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:07:45.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:07:45 smithi188 bash[23329]: cephadm 2020-07-16T16:07:44.019923+0000 mgr.x (mgr.34562) 7171 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:07:47.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:07:47 smithi132 bash[27079]: cluster 2020-07-16T16:07:45.501365+0000 mgr.x (mgr.34562) 7172 : cluster [DBG] pgmap v4472: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:07:47.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:07:47 smithi132 bash[27079]: audit 2020-07-16T16:07:46.837588+0000 mon.b (mon.2) 1542 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:07:47.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:07:47 smithi188 bash[23329]: cluster 2020-07-16T16:07:45.501365+0000 mgr.x (mgr.34562) 7172 : cluster [DBG] pgmap v4472: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:07:47.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:07:47 smithi188 bash[23329]: audit 2020-07-16T16:07:46.837588+0000 mon.b (mon.2) 1542 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:07:48.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:07:48 smithi132 bash[27079]: cephadm 2020-07-16T16:07:46.838204+0000 mgr.x (mgr.34562) 7173 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:07:48.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:07:48 smithi132 bash[27079]: cephadm 2020-07-16T16:07:46.838650+0000 mgr.x (mgr.34562) 7174 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:07:48.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:07:48 smithi188 bash[23329]: cephadm 2020-07-16T16:07:46.838204+0000 mgr.x (mgr.34562) 7173 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:07:48.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:07:48 smithi188 bash[23329]: cephadm 2020-07-16T16:07:46.838650+0000 mgr.x (mgr.34562) 7174 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:07:49.285 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:07:49 smithi132 bash[27079]: cluster 2020-07-16T16:07:47.501776+0000 mgr.x (mgr.34562) 7175 : cluster [DBG] pgmap v4473: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:07:49.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:07:49 smithi188 bash[23329]: cluster 2020-07-16T16:07:47.501776+0000 mgr.x (mgr.34562) 7175 : cluster [DBG] pgmap v4473: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:07:51.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:07:51 smithi132 bash[27079]: cluster 2020-07-16T16:07:49.502108+0000 mgr.x (mgr.34562) 7176 : cluster [DBG] pgmap v4474: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:07:51.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:07:51 smithi188 bash[23329]: cluster 2020-07-16T16:07:49.502108+0000 mgr.x (mgr.34562) 7176 : cluster [DBG] pgmap v4474: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:07:53.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:07:53 smithi132 bash[27079]: cluster 2020-07-16T16:07:51.502507+0000 mgr.x (mgr.34562) 7177 : cluster [DBG] pgmap v4475: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:07:53.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:07:53 smithi188 bash[23329]: cluster 2020-07-16T16:07:51.502507+0000 mgr.x (mgr.34562) 7177 : cluster [DBG] pgmap v4475: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:07:55.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:07:55 smithi188 bash[23329]: cluster 2020-07-16T16:07:53.502951+0000 mgr.x (mgr.34562) 7178 : cluster [DBG] pgmap v4476: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:07:55.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:07:55 smithi132 bash[27079]: cluster 2020-07-16T16:07:53.502951+0000 mgr.x (mgr.34562) 7178 : cluster [DBG] pgmap v4476: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:07:56.807 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:07:57.069 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:07:57.069 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 79s ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:07:57.069 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 78s ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:07:57.070 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 78s ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:07:57.070 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 79s ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:07:57.070 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 79s ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:07:57.070 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 78s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:07:57.071 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 79s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:07:57.071 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 79s ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:07:57.071 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 78s ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:07:57.071 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 79s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:07:57.071 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 79s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:07:57.072 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 79s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:07:57.072 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 79s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:07:57.072 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 78s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:07:57.072 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 78s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:07:57.072 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 78s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:07:57.073 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 78s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:07:57.073 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 78s ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:07:57.368 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:07:57.369 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:07:57.369 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:07:57.369 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:07:57.370 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:07:57.370 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:07:57.370 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:07:57.370 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:07:57.370 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:07:57.371 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:07:57.371 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:07:57.371 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:07:57.371 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:07:57.371 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:07:57.372 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:07:57.372 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:07:57.372 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:07:57.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:07:57 smithi188 bash[23329]: cluster 2020-07-16T16:07:55.503461+0000 mgr.x (mgr.34562) 7179 : cluster [DBG] pgmap v4477: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:07:57.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:07:57 smithi132 bash[27079]: cluster 2020-07-16T16:07:55.503461+0000 mgr.x (mgr.34562) 7179 : cluster [DBG] pgmap v4477: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:07:58.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:07:58 smithi188 bash[23329]: audit 2020-07-16T16:07:56.795273+0000 mgr.x (mgr.34562) 7180 : audit [DBG] from='client.29860 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:07:58.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:07:58 smithi188 bash[23329]: audit 2020-07-16T16:07:57.064763+0000 mgr.x (mgr.34562) 7181 : audit [DBG] from='client.29866 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:07:58.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:07:58 smithi188 bash[23329]: audit 2020-07-16T16:07:57.367775+0000 mon.c (mon.1) 487 : audit [DBG] from='client.? 172.21.15.132:0/3710418391' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:07:58.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:07:58 smithi132 bash[27079]: audit 2020-07-16T16:07:56.795273+0000 mgr.x (mgr.34562) 7180 : audit [DBG] from='client.29860 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:07:58.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:07:58 smithi132 bash[27079]: audit 2020-07-16T16:07:57.064763+0000 mgr.x (mgr.34562) 7181 : audit [DBG] from='client.29866 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:07:58.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:07:58 smithi132 bash[27079]: audit 2020-07-16T16:07:57.367775+0000 mon.c (mon.1) 487 : audit [DBG] from='client.? 172.21.15.132:0/3710418391' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:07:59.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:07:59 smithi188 bash[23329]: cluster 2020-07-16T16:07:57.503940+0000 mgr.x (mgr.34562) 7182 : cluster [DBG] pgmap v4478: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:07:59.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:07:59 smithi132 bash[27079]: cluster 2020-07-16T16:07:57.503940+0000 mgr.x (mgr.34562) 7182 : cluster [DBG] pgmap v4478: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:08:01.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:01 smithi188 bash[23329]: cluster 2020-07-16T16:07:59.504404+0000 mgr.x (mgr.34562) 7183 : cluster [DBG] pgmap v4479: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:08:01.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:01 smithi132 bash[27079]: cluster 2020-07-16T16:07:59.504404+0000 mgr.x (mgr.34562) 7183 : cluster [DBG] pgmap v4479: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:08:02.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:02 smithi188 bash[23329]: audit 2020-07-16T16:08:01.854320+0000 mon.b (mon.2) 1543 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:08:02.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:02 smithi132 bash[27079]: audit 2020-07-16T16:08:01.854320+0000 mon.b (mon.2) 1543 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:08:03.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:03 smithi188 bash[23329]: cluster 2020-07-16T16:08:01.504778+0000 mgr.x (mgr.34562) 7184 : cluster [DBG] pgmap v4480: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:08:03.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:03 smithi188 bash[23329]: cephadm 2020-07-16T16:08:01.855023+0000 mgr.x (mgr.34562) 7185 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:08:03.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:03 smithi188 bash[23329]: cephadm 2020-07-16T16:08:01.855175+0000 mgr.x (mgr.34562) 7186 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:08:03.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:03 smithi132 bash[27079]: cluster 2020-07-16T16:08:01.504778+0000 mgr.x (mgr.34562) 7184 : cluster [DBG] pgmap v4480: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:08:03.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:03 smithi132 bash[27079]: cephadm 2020-07-16T16:08:01.855023+0000 mgr.x (mgr.34562) 7185 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:08:03.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:03 smithi132 bash[27079]: cephadm 2020-07-16T16:08:01.855175+0000 mgr.x (mgr.34562) 7186 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:08:05.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:05 smithi188 bash[23329]: cluster 2020-07-16T16:08:03.505346+0000 mgr.x (mgr.34562) 7187 : cluster [DBG] pgmap v4481: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:08:05.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:05 smithi132 bash[27079]: cluster 2020-07-16T16:08:03.505346+0000 mgr.x (mgr.34562) 7187 : cluster [DBG] pgmap v4481: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:08:07.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:07 smithi188 bash[23329]: cluster 2020-07-16T16:08:05.505738+0000 mgr.x (mgr.34562) 7188 : cluster [DBG] pgmap v4482: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:08:07.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:07 smithi132 bash[27079]: cluster 2020-07-16T16:08:05.505738+0000 mgr.x (mgr.34562) 7188 : cluster [DBG] pgmap v4482: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:08:09.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:09 smithi188 bash[23329]: cluster 2020-07-16T16:08:07.506191+0000 mgr.x (mgr.34562) 7189 : cluster [DBG] pgmap v4483: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:08:09.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:09 smithi132 bash[27079]: cluster 2020-07-16T16:08:07.506191+0000 mgr.x (mgr.34562) 7189 : cluster [DBG] pgmap v4483: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:08:11.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:11 smithi188 bash[23329]: cluster 2020-07-16T16:08:09.506668+0000 mgr.x (mgr.34562) 7190 : cluster [DBG] pgmap v4484: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:08:11.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:11 smithi132 bash[27079]: cluster 2020-07-16T16:08:09.506668+0000 mgr.x (mgr.34562) 7190 : cluster [DBG] pgmap v4484: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:08:13.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:13 smithi188 bash[23329]: cluster 2020-07-16T16:08:11.506985+0000 mgr.x (mgr.34562) 7191 : cluster [DBG] pgmap v4485: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:08:13.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:13 smithi132 bash[27079]: cluster 2020-07-16T16:08:11.506985+0000 mgr.x (mgr.34562) 7191 : cluster [DBG] pgmap v4485: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:08:15.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:15 smithi188 bash[23329]: cluster 2020-07-16T16:08:13.507459+0000 mgr.x (mgr.34562) 7192 : cluster [DBG] pgmap v4486: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:08:15.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:15 smithi132 bash[27079]: cluster 2020-07-16T16:08:13.507459+0000 mgr.x (mgr.34562) 7192 : cluster [DBG] pgmap v4486: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:08:17.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:17 smithi188 bash[23329]: cluster 2020-07-16T16:08:15.507911+0000 mgr.x (mgr.34562) 7193 : cluster [DBG] pgmap v4487: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:08:17.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:17 smithi188 bash[23329]: audit 2020-07-16T16:08:16.859875+0000 mon.b (mon.2) 1544 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:08:17.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:17 smithi132 bash[27079]: cluster 2020-07-16T16:08:15.507911+0000 mgr.x (mgr.34562) 7193 : cluster [DBG] pgmap v4487: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:08:17.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:17 smithi132 bash[27079]: audit 2020-07-16T16:08:16.859875+0000 mon.b (mon.2) 1544 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:08:18.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:18 smithi188 bash[23329]: cephadm 2020-07-16T16:08:16.860567+0000 mgr.x (mgr.34562) 7194 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:08:18.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:18 smithi188 bash[23329]: cephadm 2020-07-16T16:08:16.860644+0000 mgr.x (mgr.34562) 7195 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:08:18.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:18 smithi132 bash[27079]: cephadm 2020-07-16T16:08:16.860567+0000 mgr.x (mgr.34562) 7194 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:08:18.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:18 smithi132 bash[27079]: cephadm 2020-07-16T16:08:16.860644+0000 mgr.x (mgr.34562) 7195 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:08:19.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:19 smithi188 bash[23329]: cluster 2020-07-16T16:08:17.508439+0000 mgr.x (mgr.34562) 7196 : cluster [DBG] pgmap v4488: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:08:19.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:19 smithi132 bash[27079]: cluster 2020-07-16T16:08:17.508439+0000 mgr.x (mgr.34562) 7196 : cluster [DBG] pgmap v4488: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:08:21.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:21 smithi188 bash[23329]: cluster 2020-07-16T16:08:19.508916+0000 mgr.x (mgr.34562) 7197 : cluster [DBG] pgmap v4489: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:08:21.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:21 smithi132 bash[27079]: cluster 2020-07-16T16:08:19.508916+0000 mgr.x (mgr.34562) 7197 : cluster [DBG] pgmap v4489: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:08:23.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:23 smithi188 bash[23329]: cluster 2020-07-16T16:08:21.509380+0000 mgr.x (mgr.34562) 7198 : cluster [DBG] pgmap v4490: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:08:23.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:23 smithi132 bash[27079]: cluster 2020-07-16T16:08:21.509380+0000 mgr.x (mgr.34562) 7198 : cluster [DBG] pgmap v4490: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:08:25.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:25 smithi188 bash[23329]: cluster 2020-07-16T16:08:23.509768+0000 mgr.x (mgr.34562) 7199 : cluster [DBG] pgmap v4491: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:08:25.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:25 smithi132 bash[27079]: cluster 2020-07-16T16:08:23.509768+0000 mgr.x (mgr.34562) 7199 : cluster [DBG] pgmap v4491: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:08:27.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:27 smithi188 bash[23329]: cluster 2020-07-16T16:08:25.510158+0000 mgr.x (mgr.34562) 7200 : cluster [DBG] pgmap v4492: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:08:27.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:27 smithi132 bash[27079]: cluster 2020-07-16T16:08:25.510158+0000 mgr.x (mgr.34562) 7200 : cluster [DBG] pgmap v4492: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:08:27.669 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:08:27.930 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:08:27.930 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 110s ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:08:27.930 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 109s ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:08:27.930 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 109s ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:08:27.931 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 110s ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:08:27.931 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 110s ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:08:27.931 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 109s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:08:27.931 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 110s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:08:27.931 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 110s ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:08:27.932 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 109s ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:08:27.932 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 110s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:08:27.932 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 110s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:08:27.932 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 110s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:08:27.932 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 110s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:08:27.933 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 109s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:08:27.933 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 109s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:08:27.933 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 109s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:08:27.933 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 109s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:08:27.933 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 109s ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:08:28.226 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:08:28.226 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:08:28.226 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:08:28.226 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:08:28.227 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:08:28.227 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:08:28.227 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:08:28.227 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:08:28.227 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:08:28.228 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:08:28.228 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:08:28.228 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:08:28.228 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:08:28.228 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:08:28.229 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:08:28.229 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:08:28.229 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:08:29.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:29 smithi188 bash[23329]: cluster 2020-07-16T16:08:27.510614+0000 mgr.x (mgr.34562) 7201 : cluster [DBG] pgmap v4493: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:08:29.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:29 smithi188 bash[23329]: audit 2020-07-16T16:08:27.658053+0000 mgr.x (mgr.34562) 7202 : audit [DBG] from='client.29878 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:08:29.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:29 smithi188 bash[23329]: audit 2020-07-16T16:08:27.925980+0000 mgr.x (mgr.34562) 7203 : audit [DBG] from='client.29884 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:08:29.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:29 smithi188 bash[23329]: audit 2020-07-16T16:08:28.225269+0000 mon.c (mon.1) 488 : audit [DBG] from='client.? 172.21.15.132:0/398520551' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:08:29.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:29 smithi132 bash[27079]: cluster 2020-07-16T16:08:27.510614+0000 mgr.x (mgr.34562) 7201 : cluster [DBG] pgmap v4493: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:08:29.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:29 smithi132 bash[27079]: audit 2020-07-16T16:08:27.658053+0000 mgr.x (mgr.34562) 7202 : audit [DBG] from='client.29878 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:08:29.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:29 smithi132 bash[27079]: audit 2020-07-16T16:08:27.925980+0000 mgr.x (mgr.34562) 7203 : audit [DBG] from='client.29884 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:08:29.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:29 smithi132 bash[27079]: audit 2020-07-16T16:08:28.225269+0000 mon.c (mon.1) 488 : audit [DBG] from='client.? 172.21.15.132:0/398520551' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:08:31.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:31 smithi188 bash[23329]: cluster 2020-07-16T16:08:29.511031+0000 mgr.x (mgr.34562) 7204 : cluster [DBG] pgmap v4494: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:08:31.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:31 smithi132 bash[27079]: cluster 2020-07-16T16:08:29.511031+0000 mgr.x (mgr.34562) 7204 : cluster [DBG] pgmap v4494: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:08:32.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:32 smithi188 bash[23329]: audit 2020-07-16T16:08:31.864266+0000 mon.b (mon.2) 1545 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:08:32.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:32 smithi132 bash[27079]: audit 2020-07-16T16:08:31.864266+0000 mon.b (mon.2) 1545 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:08:33.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:33 smithi188 bash[23329]: cluster 2020-07-16T16:08:31.511607+0000 mgr.x (mgr.34562) 7205 : cluster [DBG] pgmap v4495: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:08:33.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:33 smithi188 bash[23329]: cephadm 2020-07-16T16:08:31.865059+0000 mgr.x (mgr.34562) 7206 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:08:33.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:33 smithi188 bash[23329]: cephadm 2020-07-16T16:08:31.865321+0000 mgr.x (mgr.34562) 7207 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:08:33.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:33 smithi132 bash[27079]: cluster 2020-07-16T16:08:31.511607+0000 mgr.x (mgr.34562) 7205 : cluster [DBG] pgmap v4495: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:08:33.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:33 smithi132 bash[27079]: cephadm 2020-07-16T16:08:31.865059+0000 mgr.x (mgr.34562) 7206 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:08:33.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:33 smithi132 bash[27079]: cephadm 2020-07-16T16:08:31.865321+0000 mgr.x (mgr.34562) 7207 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:08:35.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:35 smithi188 bash[23329]: cluster 2020-07-16T16:08:33.512138+0000 mgr.x (mgr.34562) 7208 : cluster [DBG] pgmap v4496: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:08:35.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:35 smithi132 bash[27079]: cluster 2020-07-16T16:08:33.512138+0000 mgr.x (mgr.34562) 7208 : cluster [DBG] pgmap v4496: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:08:37.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:37 smithi188 bash[23329]: cluster 2020-07-16T16:08:35.512624+0000 mgr.x (mgr.34562) 7209 : cluster [DBG] pgmap v4497: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:08:37.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:37 smithi132 bash[27079]: cluster 2020-07-16T16:08:35.512624+0000 mgr.x (mgr.34562) 7209 : cluster [DBG] pgmap v4497: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:08:39.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:39 smithi188 bash[23329]: cluster 2020-07-16T16:08:37.513144+0000 mgr.x (mgr.34562) 7210 : cluster [DBG] pgmap v4498: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:08:39.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:39 smithi132 bash[27079]: cluster 2020-07-16T16:08:37.513144+0000 mgr.x (mgr.34562) 7210 : cluster [DBG] pgmap v4498: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:08:41.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:41 smithi188 bash[23329]: cluster 2020-07-16T16:08:39.513592+0000 mgr.x (mgr.34562) 7211 : cluster [DBG] pgmap v4499: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:08:41.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:41 smithi132 bash[27079]: cluster 2020-07-16T16:08:39.513592+0000 mgr.x (mgr.34562) 7211 : cluster [DBG] pgmap v4499: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:08:43.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:43 smithi188 bash[23329]: cluster 2020-07-16T16:08:41.513886+0000 mgr.x (mgr.34562) 7212 : cluster [DBG] pgmap v4500: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:08:43.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:43 smithi132 bash[27079]: cluster 2020-07-16T16:08:41.513886+0000 mgr.x (mgr.34562) 7212 : cluster [DBG] pgmap v4500: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:08:45.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:45 smithi188 bash[23329]: cluster 2020-07-16T16:08:43.514326+0000 mgr.x (mgr.34562) 7213 : cluster [DBG] pgmap v4501: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:08:45.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:45 smithi132 bash[27079]: cluster 2020-07-16T16:08:43.514326+0000 mgr.x (mgr.34562) 7213 : cluster [DBG] pgmap v4501: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:08:47.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:47 smithi188 bash[23329]: cluster 2020-07-16T16:08:45.514721+0000 mgr.x (mgr.34562) 7214 : cluster [DBG] pgmap v4502: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:08:47.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:47 smithi188 bash[23329]: audit 2020-07-16T16:08:47.108270+0000 mon.b (mon.2) 1546 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T16:06:37.894248\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894312\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894349\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894379\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894541\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894660\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894757\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894854\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894887\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T16:06:37.894972\", \"last_device_update\": \"2020-07-16T16:05:32.972399\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T16:08:47.107456\"}"}]: dispatch 2020-07-16T16:08:47.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:47 smithi188 bash[23329]: audit 2020-07-16T16:08:47.108728+0000 mon.c (mon.1) 489 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T16:06:37.894248\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894312\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894349\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894379\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894541\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894660\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894757\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894854\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894887\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T16:06:37.894972\", \"last_device_update\": \"2020-07-16T16:05:32.972399\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T16:08:47.107456\"}"}]: dispatch 2020-07-16T16:08:47.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:47 smithi188 bash[23329]: audit 2020-07-16T16:08:47.108909+0000 mon.b (mon.2) 1547 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189044\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189117\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189147\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189334\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189440\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189541\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189654\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189686\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189714\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T16:06:38.189780\", \"last_device_update\": \"2020-07-16T16:06:41.170725\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T16:08:47.108250\"}"}]: dispatch 2020-07-16T16:08:47.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:47 smithi188 bash[23329]: audit 2020-07-16T16:08:47.109389+0000 mon.c (mon.1) 490 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189044\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189117\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189147\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189334\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189440\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189541\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189654\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189686\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189714\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T16:06:38.189780\", \"last_device_update\": \"2020-07-16T16:06:41.170725\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T16:08:47.108250\"}"}]: dispatch 2020-07-16T16:08:47.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:47 smithi188 bash[23329]: audit 2020-07-16T16:08:47.111597+0000 mon.c (mon.1) 491 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T16:06:37.894248\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894312\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894349\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894379\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894541\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894660\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894757\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894854\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894887\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T16:06:37.894972\", \"last_device_update\": \"2020-07-16T16:05:32.972399\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T16:08:47.107456\"}"}]': finished 2020-07-16T16:08:47.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:47 smithi188 bash[23329]: audit 2020-07-16T16:08:47.113603+0000 mon.c (mon.1) 492 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189044\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189117\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189147\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189334\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189440\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189541\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189654\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189686\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189714\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T16:06:38.189780\", \"last_device_update\": \"2020-07-16T16:06:41.170725\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T16:08:47.108250\"}"}]': finished 2020-07-16T16:08:47.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:47 smithi188 bash[23329]: audit 2020-07-16T16:08:47.115823+0000 mon.b (mon.2) 1548 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:08:47.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:47 smithi188 bash[23329]: audit 2020-07-16T16:08:47.116777+0000 mon.b (mon.2) 1549 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:08:47.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:47 smithi188 bash[23329]: audit 2020-07-16T16:08:47.117626+0000 mon.b (mon.2) 1550 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:08:47.425 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:47 smithi188 bash[23329]: audit 2020-07-16T16:08:47.118536+0000 mon.b (mon.2) 1551 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:08:47.425 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:47 smithi188 bash[23329]: audit 2020-07-16T16:08:47.119430+0000 mon.b (mon.2) 1552 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:08:47.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:47 smithi132 bash[27079]: cluster 2020-07-16T16:08:45.514721+0000 mgr.x (mgr.34562) 7214 : cluster [DBG] pgmap v4502: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:08:47.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:47 smithi132 bash[27079]: audit 2020-07-16T16:08:47.108270+0000 mon.b (mon.2) 1546 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T16:06:37.894248\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894312\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894349\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894379\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894541\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894660\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894757\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894854\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894887\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T16:06:37.894972\", \"last_device_update\": \"2020-07-16T16:05:32.972399\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T16:08:47.107456\"}"}]: dispatch 2020-07-16T16:08:47.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:47 smithi132 bash[27079]: audit 2020-07-16T16:08:47.108728+0000 mon.c (mon.1) 489 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T16:06:37.894248\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894312\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894349\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894379\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894541\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894660\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894757\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894854\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894887\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T16:06:37.894972\", \"last_device_update\": \"2020-07-16T16:05:32.972399\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T16:08:47.107456\"}"}]: dispatch 2020-07-16T16:08:47.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:47 smithi132 bash[27079]: audit 2020-07-16T16:08:47.108909+0000 mon.b (mon.2) 1547 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189044\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189117\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189147\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189334\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189440\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189541\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189654\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189686\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189714\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T16:06:38.189780\", \"last_device_update\": \"2020-07-16T16:06:41.170725\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T16:08:47.108250\"}"}]: dispatch 2020-07-16T16:08:47.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:47 smithi132 bash[27079]: audit 2020-07-16T16:08:47.109389+0000 mon.c (mon.1) 490 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189044\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189117\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189147\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189334\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189440\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189541\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189654\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189686\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189714\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T16:06:38.189780\", \"last_device_update\": \"2020-07-16T16:06:41.170725\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T16:08:47.108250\"}"}]: dispatch 2020-07-16T16:08:47.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:47 smithi132 bash[27079]: audit 2020-07-16T16:08:47.111597+0000 mon.c (mon.1) 491 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T16:06:37.894248\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894312\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894349\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894379\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894541\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894660\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894757\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894854\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:37.894887\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T16:06:37.894972\", \"last_device_update\": \"2020-07-16T16:05:32.972399\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T16:08:47.107456\"}"}]': finished 2020-07-16T16:08:47.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:47 smithi132 bash[27079]: audit 2020-07-16T16:08:47.113603+0000 mon.c (mon.1) 492 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189044\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189117\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189147\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189334\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189440\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189541\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189654\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189686\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:06:38.189714\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T16:06:38.189780\", \"last_device_update\": \"2020-07-16T16:06:41.170725\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T16:08:47.108250\"}"}]': finished 2020-07-16T16:08:47.532 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:47 smithi132 bash[27079]: audit 2020-07-16T16:08:47.115823+0000 mon.b (mon.2) 1548 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:08:47.532 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:47 smithi132 bash[27079]: audit 2020-07-16T16:08:47.116777+0000 mon.b (mon.2) 1549 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:08:47.532 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:47 smithi132 bash[27079]: audit 2020-07-16T16:08:47.117626+0000 mon.b (mon.2) 1550 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:08:47.532 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:47 smithi132 bash[27079]: audit 2020-07-16T16:08:47.118536+0000 mon.b (mon.2) 1551 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:08:47.533 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:47 smithi132 bash[27079]: audit 2020-07-16T16:08:47.119430+0000 mon.b (mon.2) 1552 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:08:48.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:48 smithi132 bash[27079]: audit 2020-07-16T16:08:47.116095+0000 mgr.x (mgr.34562) 7215 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:08:48.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:48 smithi132 bash[27079]: audit 2020-07-16T16:08:47.117010+0000 mgr.x (mgr.34562) 7216 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:08:48.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:48 smithi132 bash[27079]: audit 2020-07-16T16:08:47.117855+0000 mgr.x (mgr.34562) 7217 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:08:48.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:48 smithi132 bash[27079]: cephadm 2020-07-16T16:08:47.118318+0000 mgr.x (mgr.34562) 7218 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:08:48.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:48 smithi132 bash[27079]: cephadm 2020-07-16T16:08:47.119156+0000 mgr.x (mgr.34562) 7219 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:08:48.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:48 smithi132 bash[27079]: cephadm 2020-07-16T16:08:47.119925+0000 mgr.x (mgr.34562) 7220 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:08:48.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:48 smithi132 bash[27079]: cephadm 2020-07-16T16:08:47.119984+0000 mgr.x (mgr.34562) 7221 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:08:48.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:48 smithi188 bash[23329]: audit 2020-07-16T16:08:47.116095+0000 mgr.x (mgr.34562) 7215 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:08:48.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:48 smithi188 bash[23329]: audit 2020-07-16T16:08:47.117010+0000 mgr.x (mgr.34562) 7216 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:08:48.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:48 smithi188 bash[23329]: audit 2020-07-16T16:08:47.117855+0000 mgr.x (mgr.34562) 7217 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:08:48.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:48 smithi188 bash[23329]: cephadm 2020-07-16T16:08:47.118318+0000 mgr.x (mgr.34562) 7218 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:08:48.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:48 smithi188 bash[23329]: cephadm 2020-07-16T16:08:47.119156+0000 mgr.x (mgr.34562) 7219 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:08:48.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:48 smithi188 bash[23329]: cephadm 2020-07-16T16:08:47.119925+0000 mgr.x (mgr.34562) 7220 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:08:48.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:48 smithi188 bash[23329]: cephadm 2020-07-16T16:08:47.119984+0000 mgr.x (mgr.34562) 7221 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:08:49.392 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:49 smithi132 bash[27079]: cluster 2020-07-16T16:08:47.515066+0000 mgr.x (mgr.34562) 7222 : cluster [DBG] pgmap v4503: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:08:49.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:49 smithi188 bash[23329]: cluster 2020-07-16T16:08:47.515066+0000 mgr.x (mgr.34562) 7222 : cluster [DBG] pgmap v4503: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:08:50.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:50 smithi132 bash[27079]: audit 2020-07-16T16:08:49.966185+0000 mon.b (mon.2) 1553 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:08:50.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:50 smithi188 bash[23329]: audit 2020-07-16T16:08:49.966185+0000 mon.b (mon.2) 1553 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:08:51.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:51 smithi188 bash[23329]: cluster 2020-07-16T16:08:49.515410+0000 mgr.x (mgr.34562) 7223 : cluster [DBG] pgmap v4504: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:08:51.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:51 smithi188 bash[23329]: cephadm 2020-07-16T16:08:49.966810+0000 mgr.x (mgr.34562) 7224 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:08:51.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:51 smithi188 bash[23329]: cephadm 2020-07-16T16:08:49.967215+0000 mgr.x (mgr.34562) 7225 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:08:51.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:51 smithi132 bash[27079]: cluster 2020-07-16T16:08:49.515410+0000 mgr.x (mgr.34562) 7223 : cluster [DBG] pgmap v4504: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:08:51.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:51 smithi132 bash[27079]: cephadm 2020-07-16T16:08:49.966810+0000 mgr.x (mgr.34562) 7224 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:08:51.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:51 smithi132 bash[27079]: cephadm 2020-07-16T16:08:49.967215+0000 mgr.x (mgr.34562) 7225 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:08:53.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:53 smithi132 bash[27079]: cluster 2020-07-16T16:08:51.515732+0000 mgr.x (mgr.34562) 7226 : cluster [DBG] pgmap v4505: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:08:53.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:53 smithi188 bash[23329]: cluster 2020-07-16T16:08:51.515732+0000 mgr.x (mgr.34562) 7226 : cluster [DBG] pgmap v4505: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:08:55.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:55 smithi132 bash[27079]: cluster 2020-07-16T16:08:53.516217+0000 mgr.x (mgr.34562) 7227 : cluster [DBG] pgmap v4506: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:08:55.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:55 smithi188 bash[23329]: cluster 2020-07-16T16:08:53.516217+0000 mgr.x (mgr.34562) 7227 : cluster [DBG] pgmap v4506: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:08:57.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:57 smithi132 bash[27079]: cluster 2020-07-16T16:08:55.516748+0000 mgr.x (mgr.34562) 7228 : cluster [DBG] pgmap v4507: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:08:57.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:57 smithi188 bash[23329]: cluster 2020-07-16T16:08:55.516748+0000 mgr.x (mgr.34562) 7228 : cluster [DBG] pgmap v4507: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:08:58.523 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:08:58.782 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:08:58.782 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 2m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:08:58.783 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 2m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:08:58.783 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 2m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:08:58.783 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 2m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:08:58.783 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 2m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:08:58.783 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:08:58.784 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:08:58.784 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 2m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:08:58.784 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 2m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:08:58.784 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:08:58.784 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:08:58.785 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:08:58.785 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:08:58.785 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:08:58.785 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:08:58.785 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:08:58.786 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:08:58.786 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 2m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:08:59.078 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:08:59.078 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:08:59.078 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:08:59.078 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:08:59.079 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:08:59.079 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:08:59.079 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:08:59.079 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:08:59.079 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:08:59.080 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:08:59.080 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:08:59.080 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:08:59.080 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:08:59.080 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:08:59.081 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:08:59.081 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:08:59.081 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:08:59.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:59 smithi132 bash[27079]: cluster 2020-07-16T16:08:57.517235+0000 mgr.x (mgr.34562) 7229 : cluster [DBG] pgmap v4508: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:08:59.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:08:59 smithi132 bash[27079]: audit 2020-07-16T16:08:59.077064+0000 mon.c (mon.1) 493 : audit [DBG] from='client.? 172.21.15.132:0/2053804248' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:08:59.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:59 smithi188 bash[23329]: cluster 2020-07-16T16:08:57.517235+0000 mgr.x (mgr.34562) 7229 : cluster [DBG] pgmap v4508: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:08:59.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:08:59 smithi188 bash[23329]: audit 2020-07-16T16:08:59.077064+0000 mon.c (mon.1) 493 : audit [DBG] from='client.? 172.21.15.132:0/2053804248' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:09:00.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:09:00 smithi132 bash[27079]: audit 2020-07-16T16:08:58.512035+0000 mgr.x (mgr.34562) 7230 : audit [DBG] from='client.29896 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:09:00.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:09:00 smithi132 bash[27079]: audit 2020-07-16T16:08:58.778498+0000 mgr.x (mgr.34562) 7231 : audit [DBG] from='client.29902 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:09:00.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:09:00 smithi188 bash[23329]: audit 2020-07-16T16:08:58.512035+0000 mgr.x (mgr.34562) 7230 : audit [DBG] from='client.29896 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:09:00.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:09:00 smithi188 bash[23329]: audit 2020-07-16T16:08:58.778498+0000 mgr.x (mgr.34562) 7231 : audit [DBG] from='client.29902 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:09:01.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:09:01 smithi132 bash[27079]: cluster 2020-07-16T16:08:59.517633+0000 mgr.x (mgr.34562) 7232 : cluster [DBG] pgmap v4509: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:09:01.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:09:01 smithi188 bash[23329]: cluster 2020-07-16T16:08:59.517633+0000 mgr.x (mgr.34562) 7232 : cluster [DBG] pgmap v4509: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:09:03.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:09:03 smithi132 bash[27079]: cluster 2020-07-16T16:09:01.517999+0000 mgr.x (mgr.34562) 7233 : cluster [DBG] pgmap v4510: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:09:03.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:09:03 smithi188 bash[23329]: cluster 2020-07-16T16:09:01.517999+0000 mgr.x (mgr.34562) 7233 : cluster [DBG] pgmap v4510: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:09:05.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:09:05 smithi132 bash[27079]: cluster 2020-07-16T16:09:03.518456+0000 mgr.x (mgr.34562) 7234 : cluster [DBG] pgmap v4511: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:09:05.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:09:05 smithi132 bash[27079]: audit 2020-07-16T16:09:04.981026+0000 mon.b (mon.2) 1554 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:09:05.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:09:05 smithi188 bash[23329]: cluster 2020-07-16T16:09:03.518456+0000 mgr.x (mgr.34562) 7234 : cluster [DBG] pgmap v4511: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:09:05.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:09:05 smithi188 bash[23329]: audit 2020-07-16T16:09:04.981026+0000 mon.b (mon.2) 1554 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:09:06.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:09:06 smithi132 bash[27079]: cephadm 2020-07-16T16:09:04.981800+0000 mgr.x (mgr.34562) 7235 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:09:06.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:09:06 smithi132 bash[27079]: cephadm 2020-07-16T16:09:04.982194+0000 mgr.x (mgr.34562) 7236 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:09:06.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:09:06 smithi188 bash[23329]: cephadm 2020-07-16T16:09:04.981800+0000 mgr.x (mgr.34562) 7235 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:09:06.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:09:06 smithi188 bash[23329]: cephadm 2020-07-16T16:09:04.982194+0000 mgr.x (mgr.34562) 7236 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:09:07.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:09:07 smithi132 bash[27079]: cluster 2020-07-16T16:09:05.518921+0000 mgr.x (mgr.34562) 7237 : cluster [DBG] pgmap v4512: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:09:07.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:09:07 smithi188 bash[23329]: cluster 2020-07-16T16:09:05.518921+0000 mgr.x (mgr.34562) 7237 : cluster [DBG] pgmap v4512: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:09:09.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:09:09 smithi132 bash[27079]: cluster 2020-07-16T16:09:07.519454+0000 mgr.x (mgr.34562) 7238 : cluster [DBG] pgmap v4513: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:09:09.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:09:09 smithi188 bash[23329]: cluster 2020-07-16T16:09:07.519454+0000 mgr.x (mgr.34562) 7238 : cluster [DBG] pgmap v4513: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:09:11.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:09:11 smithi132 bash[27079]: cluster 2020-07-16T16:09:09.519918+0000 mgr.x (mgr.34562) 7239 : cluster [DBG] pgmap v4514: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:09:11.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:09:11 smithi188 bash[23329]: cluster 2020-07-16T16:09:09.519918+0000 mgr.x (mgr.34562) 7239 : cluster [DBG] pgmap v4514: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:09:13.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:09:13 smithi132 bash[27079]: cluster 2020-07-16T16:09:11.520272+0000 mgr.x (mgr.34562) 7240 : cluster [DBG] pgmap v4515: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:09:13.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:09:13 smithi188 bash[23329]: cluster 2020-07-16T16:09:11.520272+0000 mgr.x (mgr.34562) 7240 : cluster [DBG] pgmap v4515: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:09:15.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:09:15 smithi132 bash[27079]: cluster 2020-07-16T16:09:13.520665+0000 mgr.x (mgr.34562) 7241 : cluster [DBG] pgmap v4516: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:09:15.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:09:15 smithi188 bash[23329]: cluster 2020-07-16T16:09:13.520665+0000 mgr.x (mgr.34562) 7241 : cluster [DBG] pgmap v4516: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:09:17.534 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:09:17 smithi132 bash[27079]: cluster 2020-07-16T16:09:15.521183+0000 mgr.x (mgr.34562) 7242 : cluster [DBG] pgmap v4517: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:09:17.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:09:17 smithi188 bash[23329]: cluster 2020-07-16T16:09:15.521183+0000 mgr.x (mgr.34562) 7242 : cluster [DBG] pgmap v4517: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:09:19.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:09:19 smithi132 bash[27079]: cluster 2020-07-16T16:09:17.521594+0000 mgr.x (mgr.34562) 7243 : cluster [DBG] pgmap v4518: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:09:19.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:09:19 smithi188 bash[23329]: cluster 2020-07-16T16:09:17.521594+0000 mgr.x (mgr.34562) 7243 : cluster [DBG] pgmap v4518: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:09:20.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:09:20 smithi132 bash[27079]: audit 2020-07-16T16:09:19.997763+0000 mon.b (mon.2) 1555 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:09:20.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:09:20 smithi188 bash[23329]: audit 2020-07-16T16:09:19.997763+0000 mon.b (mon.2) 1555 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:09:21.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:09:21 smithi132 bash[27079]: cluster 2020-07-16T16:09:19.521990+0000 mgr.x (mgr.34562) 7244 : cluster [DBG] pgmap v4519: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:09:21.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:09:21 smithi132 bash[27079]: cephadm 2020-07-16T16:09:19.998498+0000 mgr.x (mgr.34562) 7245 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:09:21.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:09:21 smithi132 bash[27079]: cephadm 2020-07-16T16:09:19.998575+0000 mgr.x (mgr.34562) 7246 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:09:21.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:09:21 smithi188 bash[23329]: cluster 2020-07-16T16:09:19.521990+0000 mgr.x (mgr.34562) 7244 : cluster [DBG] pgmap v4519: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:09:21.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:09:21 smithi188 bash[23329]: cephadm 2020-07-16T16:09:19.998498+0000 mgr.x (mgr.34562) 7245 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:09:21.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:09:21 smithi188 bash[23329]: cephadm 2020-07-16T16:09:19.998575+0000 mgr.x (mgr.34562) 7246 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:09:23.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:09:23 smithi132 bash[27079]: cluster 2020-07-16T16:09:21.522348+0000 mgr.x (mgr.34562) 7247 : cluster [DBG] pgmap v4520: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:09:23.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:09:23 smithi188 bash[23329]: cluster 2020-07-16T16:09:21.522348+0000 mgr.x (mgr.34562) 7247 : cluster [DBG] pgmap v4520: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:09:25.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:09:25 smithi132 bash[27079]: cluster 2020-07-16T16:09:23.522719+0000 mgr.x (mgr.34562) 7248 : cluster [DBG] pgmap v4521: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:09:25.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:09:25 smithi188 bash[23329]: cluster 2020-07-16T16:09:23.522719+0000 mgr.x (mgr.34562) 7248 : cluster [DBG] pgmap v4521: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:09:27.535 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:09:27 smithi132 bash[27079]: cluster 2020-07-16T16:09:25.523174+0000 mgr.x (mgr.34562) 7249 : cluster [DBG] pgmap v4522: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:09:27.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:09:27 smithi188 bash[23329]: cluster 2020-07-16T16:09:25.523174+0000 mgr.x (mgr.34562) 7249 : cluster [DBG] pgmap v4522: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:09:29.380 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:09:29.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:09:29 smithi132 bash[27079]: cluster 2020-07-16T16:09:27.523714+0000 mgr.x (mgr.34562) 7250 : cluster [DBG] pgmap v4523: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:09:29.641 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:09:29.641 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 2m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:09:29.642 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 2m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:09:29.642 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 2m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:09:29.642 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 2m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:09:29.642 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 2m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:09:29.643 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:09:29.643 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:09:29.643 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 2m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:09:29.643 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 2m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:09:29.644 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:09:29.644 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:09:29.644 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:09:29.644 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:09:29.645 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:09:29.645 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:09:29.645 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:09:29.645 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:09:29.645 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 2m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:09:29.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:09:29 smithi188 bash[23329]: cluster 2020-07-16T16:09:27.523714+0000 mgr.x (mgr.34562) 7250 : cluster [DBG] pgmap v4523: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:09:29.958 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:09:29.958 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:09:29.958 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:09:29.959 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:09:29.959 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:09:29.959 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:09:29.960 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:09:29.960 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:09:29.960 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:09:29.960 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:09:29.960 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:09:29.961 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:09:29.961 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:09:29.961 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:09:29.961 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:09:29.961 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:09:29.962 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:09:30.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:09:30 smithi132 bash[27079]: audit 2020-07-16T16:09:29.367819+0000 mgr.x (mgr.34562) 7251 : audit [DBG] from='client.29914 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:09:30.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:09:30 smithi132 bash[27079]: audit 2020-07-16T16:09:29.957187+0000 mon.c (mon.1) 494 : audit [DBG] from='client.? 172.21.15.132:0/2835013653' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:09:30.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:09:30 smithi188 bash[23329]: audit 2020-07-16T16:09:29.367819+0000 mgr.x (mgr.34562) 7251 : audit [DBG] from='client.29914 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:09:30.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:09:30 smithi188 bash[23329]: audit 2020-07-16T16:09:29.957187+0000 mon.c (mon.1) 494 : audit [DBG] from='client.? 172.21.15.132:0/2835013653' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:09:31.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:09:31 smithi132 bash[27079]: cluster 2020-07-16T16:09:29.524119+0000 mgr.x (mgr.34562) 7252 : cluster [DBG] pgmap v4524: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:09:31.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:09:31 smithi132 bash[27079]: audit 2020-07-16T16:09:29.637180+0000 mgr.x (mgr.34562) 7253 : audit [DBG] from='client.29920 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:09:31.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:09:31 smithi188 bash[23329]: cluster 2020-07-16T16:09:29.524119+0000 mgr.x (mgr.34562) 7252 : cluster [DBG] pgmap v4524: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:09:31.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:09:31 smithi188 bash[23329]: audit 2020-07-16T16:09:29.637180+0000 mgr.x (mgr.34562) 7253 : audit [DBG] from='client.29920 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:09:33.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:09:33 smithi132 bash[27079]: cluster 2020-07-16T16:09:31.524547+0000 mgr.x (mgr.34562) 7254 : cluster [DBG] pgmap v4525: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:09:33.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:09:33 smithi188 bash[23329]: cluster 2020-07-16T16:09:31.524547+0000 mgr.x (mgr.34562) 7254 : cluster [DBG] pgmap v4525: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:09:35.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:09:35 smithi132 bash[27079]: cluster 2020-07-16T16:09:33.525049+0000 mgr.x (mgr.34562) 7255 : cluster [DBG] pgmap v4526: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:09:35.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:09:35 smithi132 bash[27079]: audit 2020-07-16T16:09:35.004585+0000 mon.b (mon.2) 1556 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:09:35.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:09:35 smithi188 bash[23329]: cluster 2020-07-16T16:09:33.525049+0000 mgr.x (mgr.34562) 7255 : cluster [DBG] pgmap v4526: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:09:35.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:09:35 smithi188 bash[23329]: audit 2020-07-16T16:09:35.004585+0000 mon.b (mon.2) 1556 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:09:36.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:09:36 smithi132 bash[27079]: cephadm 2020-07-16T16:09:35.005304+0000 mgr.x (mgr.34562) 7256 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:09:36.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:09:36 smithi132 bash[27079]: cephadm 2020-07-16T16:09:35.005769+0000 mgr.x (mgr.34562) 7257 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:09:36.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:09:36 smithi188 bash[23329]: cephadm 2020-07-16T16:09:35.005304+0000 mgr.x (mgr.34562) 7256 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:09:36.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:09:36 smithi188 bash[23329]: cephadm 2020-07-16T16:09:35.005769+0000 mgr.x (mgr.34562) 7257 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:09:37.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:09:37 smithi132 bash[27079]: cluster 2020-07-16T16:09:35.525551+0000 mgr.x (mgr.34562) 7258 : cluster [DBG] pgmap v4527: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:09:37.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:09:37 smithi188 bash[23329]: cluster 2020-07-16T16:09:35.525551+0000 mgr.x (mgr.34562) 7258 : cluster [DBG] pgmap v4527: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:09:39.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:09:39 smithi132 bash[27079]: cluster 2020-07-16T16:09:37.526077+0000 mgr.x (mgr.34562) 7259 : cluster [DBG] pgmap v4528: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:09:39.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:09:39 smithi188 bash[23329]: cluster 2020-07-16T16:09:37.526077+0000 mgr.x (mgr.34562) 7259 : cluster [DBG] pgmap v4528: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:09:41.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:09:41 smithi188 bash[23329]: cluster 2020-07-16T16:09:39.526592+0000 mgr.x (mgr.34562) 7260 : cluster [DBG] pgmap v4529: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:09:41.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:09:41 smithi132 bash[27079]: cluster 2020-07-16T16:09:39.526592+0000 mgr.x (mgr.34562) 7260 : cluster [DBG] pgmap v4529: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:09:43.676 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:09:43 smithi188 bash[23329]: cluster 2020-07-16T16:09:41.526976+0000 mgr.x (mgr.34562) 7261 : cluster [DBG] pgmap v4530: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:09:43.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:09:43 smithi132 bash[27079]: cluster 2020-07-16T16:09:41.526976+0000 mgr.x (mgr.34562) 7261 : cluster [DBG] pgmap v4530: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:09:45.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:09:45 smithi188 bash[23329]: cluster 2020-07-16T16:09:43.527374+0000 mgr.x (mgr.34562) 7262 : cluster [DBG] pgmap v4531: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:09:45.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:09:45 smithi132 bash[27079]: cluster 2020-07-16T16:09:43.527374+0000 mgr.x (mgr.34562) 7262 : cluster [DBG] pgmap v4531: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:09:47.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:09:47 smithi188 bash[23329]: cluster 2020-07-16T16:09:45.527742+0000 mgr.x (mgr.34562) 7263 : cluster [DBG] pgmap v4532: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:09:47.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:09:47 smithi132 bash[27079]: cluster 2020-07-16T16:09:45.527742+0000 mgr.x (mgr.34562) 7263 : cluster [DBG] pgmap v4532: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:09:49.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:09:49 smithi188 bash[23329]: cluster 2020-07-16T16:09:47.528196+0000 mgr.x (mgr.34562) 7264 : cluster [DBG] pgmap v4533: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:09:49.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:09:49 smithi132 bash[27079]: cluster 2020-07-16T16:09:47.528196+0000 mgr.x (mgr.34562) 7264 : cluster [DBG] pgmap v4533: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:09:50.566 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:09:50 smithi132 bash[27079]: audit 2020-07-16T16:09:50.023942+0000 mon.b (mon.2) 1557 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:09:50.566 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:09:50 smithi132 bash[27079]: audit 2020-07-16T16:09:50.025367+0000 mon.b (mon.2) 1558 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:09:50.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:09:50 smithi132 bash[27079]: audit 2020-07-16T16:09:50.026599+0000 mon.b (mon.2) 1559 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:09:50.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:09:50 smithi132 bash[27079]: audit 2020-07-16T16:09:50.028084+0000 mon.b (mon.2) 1560 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:09:50.567 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:09:50 smithi132 bash[27079]: audit 2020-07-16T16:09:50.029306+0000 mon.b (mon.2) 1561 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:09:50.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:09:50 smithi188 bash[23329]: audit 2020-07-16T16:09:50.023942+0000 mon.b (mon.2) 1557 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:09:50.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:09:50 smithi188 bash[23329]: audit 2020-07-16T16:09:50.025367+0000 mon.b (mon.2) 1558 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:09:50.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:09:50 smithi188 bash[23329]: audit 2020-07-16T16:09:50.026599+0000 mon.b (mon.2) 1559 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:09:50.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:09:50 smithi188 bash[23329]: audit 2020-07-16T16:09:50.028084+0000 mon.b (mon.2) 1560 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:09:50.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:09:50 smithi188 bash[23329]: audit 2020-07-16T16:09:50.029306+0000 mon.b (mon.2) 1561 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:09:51.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:09:51 smithi188 bash[23329]: cluster 2020-07-16T16:09:49.528729+0000 mgr.x (mgr.34562) 7265 : cluster [DBG] pgmap v4534: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:09:51.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:09:51 smithi188 bash[23329]: audit 2020-07-16T16:09:50.024323+0000 mgr.x (mgr.34562) 7266 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:09:51.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:09:51 smithi188 bash[23329]: audit 2020-07-16T16:09:50.025692+0000 mgr.x (mgr.34562) 7267 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:09:51.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:09:51 smithi188 bash[23329]: audit 2020-07-16T16:09:50.026887+0000 mgr.x (mgr.34562) 7268 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:09:51.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:09:51 smithi188 bash[23329]: cephadm 2020-07-16T16:09:50.027655+0000 mgr.x (mgr.34562) 7269 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:09:51.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:09:51 smithi188 bash[23329]: cephadm 2020-07-16T16:09:50.028976+0000 mgr.x (mgr.34562) 7270 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:09:51.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:09:51 smithi188 bash[23329]: cephadm 2020-07-16T16:09:50.030030+0000 mgr.x (mgr.34562) 7271 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:09:51.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:09:51 smithi188 bash[23329]: cephadm 2020-07-16T16:09:50.030133+0000 mgr.x (mgr.34562) 7272 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:09:51.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:09:51 smithi132 bash[27079]: cluster 2020-07-16T16:09:49.528729+0000 mgr.x (mgr.34562) 7265 : cluster [DBG] pgmap v4534: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:09:51.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:09:51 smithi132 bash[27079]: audit 2020-07-16T16:09:50.024323+0000 mgr.x (mgr.34562) 7266 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:09:51.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:09:51 smithi132 bash[27079]: audit 2020-07-16T16:09:50.025692+0000 mgr.x (mgr.34562) 7267 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:09:51.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:09:51 smithi132 bash[27079]: audit 2020-07-16T16:09:50.026887+0000 mgr.x (mgr.34562) 7268 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:09:51.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:09:51 smithi132 bash[27079]: cephadm 2020-07-16T16:09:50.027655+0000 mgr.x (mgr.34562) 7269 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:09:51.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:09:51 smithi132 bash[27079]: cephadm 2020-07-16T16:09:50.028976+0000 mgr.x (mgr.34562) 7270 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:09:51.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:09:51 smithi132 bash[27079]: cephadm 2020-07-16T16:09:50.030030+0000 mgr.x (mgr.34562) 7271 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:09:51.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:09:51 smithi132 bash[27079]: cephadm 2020-07-16T16:09:50.030133+0000 mgr.x (mgr.34562) 7272 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:09:53.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:09:53 smithi188 bash[23329]: cluster 2020-07-16T16:09:51.529239+0000 mgr.x (mgr.34562) 7273 : cluster [DBG] pgmap v4535: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:09:53.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:09:53 smithi188 bash[23329]: audit 2020-07-16T16:09:52.827669+0000 mon.b (mon.2) 1562 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:09:53.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:09:53 smithi132 bash[27079]: cluster 2020-07-16T16:09:51.529239+0000 mgr.x (mgr.34562) 7273 : cluster [DBG] pgmap v4535: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:09:53.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:09:53 smithi132 bash[27079]: audit 2020-07-16T16:09:52.827669+0000 mon.b (mon.2) 1562 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:09:54.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:09:54 smithi188 bash[23329]: cephadm 2020-07-16T16:09:52.828366+0000 mgr.x (mgr.34562) 7274 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:09:54.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:09:54 smithi188 bash[23329]: cephadm 2020-07-16T16:09:52.828779+0000 mgr.x (mgr.34562) 7275 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:09:54.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:09:54 smithi132 bash[27079]: cephadm 2020-07-16T16:09:52.828366+0000 mgr.x (mgr.34562) 7274 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:09:54.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:09:54 smithi132 bash[27079]: cephadm 2020-07-16T16:09:52.828779+0000 mgr.x (mgr.34562) 7275 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:09:55.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:09:55 smithi188 bash[23329]: cluster 2020-07-16T16:09:53.529575+0000 mgr.x (mgr.34562) 7276 : cluster [DBG] pgmap v4536: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:09:55.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:09:55 smithi132 bash[27079]: cluster 2020-07-16T16:09:53.529575+0000 mgr.x (mgr.34562) 7276 : cluster [DBG] pgmap v4536: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:09:57.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:09:57 smithi188 bash[23329]: cluster 2020-07-16T16:09:55.530112+0000 mgr.x (mgr.34562) 7277 : cluster [DBG] pgmap v4537: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:09:57.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:09:57 smithi132 bash[27079]: cluster 2020-07-16T16:09:55.530112+0000 mgr.x (mgr.34562) 7277 : cluster [DBG] pgmap v4537: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:09:59.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:09:59 smithi188 bash[23329]: cluster 2020-07-16T16:09:57.530522+0000 mgr.x (mgr.34562) 7278 : cluster [DBG] pgmap v4538: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:09:59.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:09:59 smithi132 bash[27079]: cluster 2020-07-16T16:09:57.530522+0000 mgr.x (mgr.34562) 7278 : cluster [DBG] pgmap v4538: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:10:00.266 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:10:00.525 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:10:00.526 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 3m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:10:00.526 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 3m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:10:00.526 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 3m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:10:00.526 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 3m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:10:00.527 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 3m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:10:00.527 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:10:00.527 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:10:00.527 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 3m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:10:00.527 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 3m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:10:00.528 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:10:00.528 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:10:00.528 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:10:00.528 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:10:00.528 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:10:00.528 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:10:00.529 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:10:00.529 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:10:00.529 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 3m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:10:00.822 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:10:00.823 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:10:00.823 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:10:00.823 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:10:00.823 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:10:00.823 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:10:00.824 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:10:00.824 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:10:00.824 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:10:00.824 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:10:00.824 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:10:00.824 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:10:00.825 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:10:00.825 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:10:00.825 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:10:00.825 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:10:00.825 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:10:01.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:10:01 smithi188 bash[23329]: cluster 2020-07-16T16:09:59.530933+0000 mgr.x (mgr.34562) 7279 : cluster [DBG] pgmap v4539: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:10:01.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:10:01 smithi188 bash[23329]: audit 2020-07-16T16:10:00.254696+0000 mgr.x (mgr.34562) 7280 : audit [DBG] from='client.29932 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:10:01.675 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:10:01 smithi188 bash[23329]: audit 2020-07-16T16:10:00.821732+0000 mon.c (mon.1) 495 : audit [DBG] from='client.? 172.21.15.132:0/1251283600' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:10:01.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:10:01 smithi132 bash[27079]: cluster 2020-07-16T16:09:59.530933+0000 mgr.x (mgr.34562) 7279 : cluster [DBG] pgmap v4539: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:10:01.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:10:01 smithi132 bash[27079]: audit 2020-07-16T16:10:00.254696+0000 mgr.x (mgr.34562) 7280 : audit [DBG] from='client.29932 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:10:01.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:10:01 smithi132 bash[27079]: audit 2020-07-16T16:10:00.821732+0000 mon.c (mon.1) 495 : audit [DBG] from='client.? 172.21.15.132:0/1251283600' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:10:02.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:10:02 smithi188 bash[23329]: audit 2020-07-16T16:10:00.521369+0000 mgr.x (mgr.34562) 7281 : audit [DBG] from='client.29938 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:10:02.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:10:02 smithi132 bash[27079]: audit 2020-07-16T16:10:00.521369+0000 mgr.x (mgr.34562) 7281 : audit [DBG] from='client.29938 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:10:03.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:10:03 smithi188 bash[23329]: cluster 2020-07-16T16:10:01.531333+0000 mgr.x (mgr.34562) 7282 : cluster [DBG] pgmap v4540: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:10:03.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:10:03 smithi132 bash[27079]: cluster 2020-07-16T16:10:01.531333+0000 mgr.x (mgr.34562) 7282 : cluster [DBG] pgmap v4540: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:10:05.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:10:05 smithi188 bash[23329]: cluster 2020-07-16T16:10:03.531755+0000 mgr.x (mgr.34562) 7283 : cluster [DBG] pgmap v4541: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:10:05.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:10:05 smithi132 bash[27079]: cluster 2020-07-16T16:10:03.531755+0000 mgr.x (mgr.34562) 7283 : cluster [DBG] pgmap v4541: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:10:07.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:10:07 smithi188 bash[23329]: cluster 2020-07-16T16:10:05.532259+0000 mgr.x (mgr.34562) 7284 : cluster [DBG] pgmap v4542: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:10:07.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:10:07 smithi132 bash[27079]: cluster 2020-07-16T16:10:05.532259+0000 mgr.x (mgr.34562) 7284 : cluster [DBG] pgmap v4542: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:10:08.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:10:08 smithi188 bash[23329]: audit 2020-07-16T16:10:07.844259+0000 mon.b (mon.2) 1563 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:10:08.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:10:08 smithi132 bash[27079]: audit 2020-07-16T16:10:07.844259+0000 mon.b (mon.2) 1563 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:10:09.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:10:09 smithi188 bash[23329]: cluster 2020-07-16T16:10:07.532750+0000 mgr.x (mgr.34562) 7285 : cluster [DBG] pgmap v4543: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:10:09.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:10:09 smithi188 bash[23329]: cephadm 2020-07-16T16:10:07.844966+0000 mgr.x (mgr.34562) 7286 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:10:09.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:10:09 smithi188 bash[23329]: cephadm 2020-07-16T16:10:07.845306+0000 mgr.x (mgr.34562) 7287 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:10:09.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:10:09 smithi132 bash[27079]: cluster 2020-07-16T16:10:07.532750+0000 mgr.x (mgr.34562) 7285 : cluster [DBG] pgmap v4543: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:10:09.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:10:09 smithi132 bash[27079]: cephadm 2020-07-16T16:10:07.844966+0000 mgr.x (mgr.34562) 7286 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:10:09.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:10:09 smithi132 bash[27079]: cephadm 2020-07-16T16:10:07.845306+0000 mgr.x (mgr.34562) 7287 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:10:11.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:10:11 smithi188 bash[23329]: cluster 2020-07-16T16:10:09.533145+0000 mgr.x (mgr.34562) 7288 : cluster [DBG] pgmap v4544: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:10:11.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:10:11 smithi132 bash[27079]: cluster 2020-07-16T16:10:09.533145+0000 mgr.x (mgr.34562) 7288 : cluster [DBG] pgmap v4544: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:10:13.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:10:13 smithi188 bash[23329]: cluster 2020-07-16T16:10:11.533563+0000 mgr.x (mgr.34562) 7289 : cluster [DBG] pgmap v4545: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:10:13.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:10:13 smithi132 bash[27079]: cluster 2020-07-16T16:10:11.533563+0000 mgr.x (mgr.34562) 7289 : cluster [DBG] pgmap v4545: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:10:15.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:10:15 smithi188 bash[23329]: cluster 2020-07-16T16:10:13.534083+0000 mgr.x (mgr.34562) 7290 : cluster [DBG] pgmap v4546: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:10:15.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:10:15 smithi132 bash[27079]: cluster 2020-07-16T16:10:13.534083+0000 mgr.x (mgr.34562) 7290 : cluster [DBG] pgmap v4546: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:10:17.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:10:17 smithi188 bash[23329]: cluster 2020-07-16T16:10:15.534598+0000 mgr.x (mgr.34562) 7291 : cluster [DBG] pgmap v4547: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:10:17.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:10:17 smithi132 bash[27079]: cluster 2020-07-16T16:10:15.534598+0000 mgr.x (mgr.34562) 7291 : cluster [DBG] pgmap v4547: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:10:19.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:10:19 smithi188 bash[23329]: cluster 2020-07-16T16:10:17.535192+0000 mgr.x (mgr.34562) 7292 : cluster [DBG] pgmap v4548: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:10:19.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:10:19 smithi132 bash[27079]: cluster 2020-07-16T16:10:17.535192+0000 mgr.x (mgr.34562) 7292 : cluster [DBG] pgmap v4548: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:10:21.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:10:21 smithi188 bash[23329]: cluster 2020-07-16T16:10:19.535687+0000 mgr.x (mgr.34562) 7293 : cluster [DBG] pgmap v4549: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:10:21.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:10:21 smithi132 bash[27079]: cluster 2020-07-16T16:10:19.535687+0000 mgr.x (mgr.34562) 7293 : cluster [DBG] pgmap v4549: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:10:23.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:10:23 smithi188 bash[23329]: cluster 2020-07-16T16:10:21.536316+0000 mgr.x (mgr.34562) 7294 : cluster [DBG] pgmap v4550: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:10:23.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:10:23 smithi188 bash[23329]: audit 2020-07-16T16:10:22.854691+0000 mon.b (mon.2) 1564 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:10:23.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:10:23 smithi132 bash[27079]: cluster 2020-07-16T16:10:21.536316+0000 mgr.x (mgr.34562) 7294 : cluster [DBG] pgmap v4550: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:10:23.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:10:23 smithi132 bash[27079]: audit 2020-07-16T16:10:22.854691+0000 mon.b (mon.2) 1564 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:10:24.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:10:24 smithi188 bash[23329]: cephadm 2020-07-16T16:10:22.855364+0000 mgr.x (mgr.34562) 7295 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:10:24.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:10:24 smithi188 bash[23329]: cephadm 2020-07-16T16:10:22.855767+0000 mgr.x (mgr.34562) 7296 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:10:24.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:10:24 smithi132 bash[27079]: cephadm 2020-07-16T16:10:22.855364+0000 mgr.x (mgr.34562) 7295 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:10:24.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:10:24 smithi132 bash[27079]: cephadm 2020-07-16T16:10:22.855767+0000 mgr.x (mgr.34562) 7296 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:10:25.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:10:25 smithi188 bash[23329]: cluster 2020-07-16T16:10:23.536860+0000 mgr.x (mgr.34562) 7297 : cluster [DBG] pgmap v4551: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:10:25.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:10:25 smithi132 bash[27079]: cluster 2020-07-16T16:10:23.536860+0000 mgr.x (mgr.34562) 7297 : cluster [DBG] pgmap v4551: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:10:27.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:10:27 smithi188 bash[23329]: cluster 2020-07-16T16:10:25.537322+0000 mgr.x (mgr.34562) 7298 : cluster [DBG] pgmap v4552: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:10:27.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:10:27 smithi132 bash[27079]: cluster 2020-07-16T16:10:25.537322+0000 mgr.x (mgr.34562) 7298 : cluster [DBG] pgmap v4552: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:10:29.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:10:29 smithi188 bash[23329]: cluster 2020-07-16T16:10:27.537710+0000 mgr.x (mgr.34562) 7299 : cluster [DBG] pgmap v4553: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:10:29.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:10:29 smithi132 bash[27079]: cluster 2020-07-16T16:10:27.537710+0000 mgr.x (mgr.34562) 7299 : cluster [DBG] pgmap v4553: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:10:31.124 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:10:31.385 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:10:31.385 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 3m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:10:31.386 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 3m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:10:31.386 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 3m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:10:31.386 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 3m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:10:31.386 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 3m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:10:31.387 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:10:31.387 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:10:31.387 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 3m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:10:31.387 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 3m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:10:31.387 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:10:31.388 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:10:31.388 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:10:31.388 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:10:31.388 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:10:31.388 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:10:31.388 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:10:31.389 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:10:31.389 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 3m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:10:31.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:10:31 smithi188 bash[23329]: cluster 2020-07-16T16:10:29.538217+0000 mgr.x (mgr.34562) 7300 : cluster [DBG] pgmap v4554: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:10:31.684 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:10:31.684 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:10:31.685 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:10:31.685 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:10:31.685 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:10:31.685 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:10:31.686 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:10:31.686 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:10:31.686 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:10:31.686 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:10:31.687 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:10:31.687 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:10:31.687 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:10:31.687 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:10:31.687 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:10:31.688 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:10:31.688 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:10:31.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:10:31 smithi132 bash[27079]: cluster 2020-07-16T16:10:29.538217+0000 mgr.x (mgr.34562) 7300 : cluster [DBG] pgmap v4554: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:10:32.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:10:32 smithi188 bash[23329]: audit 2020-07-16T16:10:31.112173+0000 mgr.x (mgr.34562) 7301 : audit [DBG] from='client.29950 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:10:32.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:10:32 smithi188 bash[23329]: audit 2020-07-16T16:10:31.380742+0000 mgr.x (mgr.34562) 7302 : audit [DBG] from='client.29956 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:10:32.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:10:32 smithi188 bash[23329]: audit 2020-07-16T16:10:31.681265+0000 mon.c (mon.1) 496 : audit [DBG] from='client.? 172.21.15.132:0/2056971970' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:10:32.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:10:32 smithi132 bash[27079]: audit 2020-07-16T16:10:31.112173+0000 mgr.x (mgr.34562) 7301 : audit [DBG] from='client.29950 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:10:32.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:10:32 smithi132 bash[27079]: audit 2020-07-16T16:10:31.380742+0000 mgr.x (mgr.34562) 7302 : audit [DBG] from='client.29956 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:10:32.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:10:32 smithi132 bash[27079]: audit 2020-07-16T16:10:31.681265+0000 mon.c (mon.1) 496 : audit [DBG] from='client.? 172.21.15.132:0/2056971970' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:10:33.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:10:33 smithi188 bash[23329]: cluster 2020-07-16T16:10:31.538627+0000 mgr.x (mgr.34562) 7303 : cluster [DBG] pgmap v4555: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:10:33.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:10:33 smithi132 bash[27079]: cluster 2020-07-16T16:10:31.538627+0000 mgr.x (mgr.34562) 7303 : cluster [DBG] pgmap v4555: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:10:35.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:10:35 smithi188 bash[23329]: cluster 2020-07-16T16:10:33.539078+0000 mgr.x (mgr.34562) 7304 : cluster [DBG] pgmap v4556: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:10:35.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:10:35 smithi132 bash[27079]: cluster 2020-07-16T16:10:33.539078+0000 mgr.x (mgr.34562) 7304 : cluster [DBG] pgmap v4556: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:10:37.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:10:37 smithi188 bash[23329]: cluster 2020-07-16T16:10:35.539449+0000 mgr.x (mgr.34562) 7305 : cluster [DBG] pgmap v4557: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:10:37.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:10:37 smithi132 bash[27079]: cluster 2020-07-16T16:10:35.539449+0000 mgr.x (mgr.34562) 7305 : cluster [DBG] pgmap v4557: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:10:38.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:10:38 smithi188 bash[23329]: audit 2020-07-16T16:10:37.866444+0000 mon.b (mon.2) 1565 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:10:38.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:10:38 smithi132 bash[27079]: audit 2020-07-16T16:10:37.866444+0000 mon.b (mon.2) 1565 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:10:39.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:10:39 smithi132 bash[27079]: cluster 2020-07-16T16:10:37.539794+0000 mgr.x (mgr.34562) 7306 : cluster [DBG] pgmap v4558: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:10:39.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:10:39 smithi132 bash[27079]: cephadm 2020-07-16T16:10:37.867148+0000 mgr.x (mgr.34562) 7307 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:10:39.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:10:39 smithi132 bash[27079]: cephadm 2020-07-16T16:10:37.867424+0000 mgr.x (mgr.34562) 7308 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:10:39.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:10:39 smithi188 bash[23329]: cluster 2020-07-16T16:10:37.539794+0000 mgr.x (mgr.34562) 7306 : cluster [DBG] pgmap v4558: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:10:39.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:10:39 smithi188 bash[23329]: cephadm 2020-07-16T16:10:37.867148+0000 mgr.x (mgr.34562) 7307 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:10:39.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:10:39 smithi188 bash[23329]: cephadm 2020-07-16T16:10:37.867424+0000 mgr.x (mgr.34562) 7308 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:10:41.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:10:41 smithi132 bash[27079]: cluster 2020-07-16T16:10:39.540147+0000 mgr.x (mgr.34562) 7309 : cluster [DBG] pgmap v4559: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:10:41.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:10:41 smithi188 bash[23329]: cluster 2020-07-16T16:10:39.540147+0000 mgr.x (mgr.34562) 7309 : cluster [DBG] pgmap v4559: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:10:43.782 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:10:43 smithi132 bash[27079]: cluster 2020-07-16T16:10:41.540510+0000 mgr.x (mgr.34562) 7310 : cluster [DBG] pgmap v4560: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:10:43.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:10:43 smithi188 bash[23329]: cluster 2020-07-16T16:10:41.540510+0000 mgr.x (mgr.34562) 7310 : cluster [DBG] pgmap v4560: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:10:45.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:10:45 smithi132 bash[27079]: cluster 2020-07-16T16:10:43.540980+0000 mgr.x (mgr.34562) 7311 : cluster [DBG] pgmap v4561: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:10:45.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:10:45 smithi188 bash[23329]: cluster 2020-07-16T16:10:43.540980+0000 mgr.x (mgr.34562) 7311 : cluster [DBG] pgmap v4561: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:10:47.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:10:47 smithi132 bash[27079]: cluster 2020-07-16T16:10:45.541372+0000 mgr.x (mgr.34562) 7312 : cluster [DBG] pgmap v4562: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:10:47.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:10:47 smithi188 bash[23329]: cluster 2020-07-16T16:10:45.541372+0000 mgr.x (mgr.34562) 7312 : cluster [DBG] pgmap v4562: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:10:49.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:10:49 smithi132 bash[27079]: cluster 2020-07-16T16:10:47.541924+0000 mgr.x (mgr.34562) 7313 : cluster [DBG] pgmap v4563: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:10:49.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:10:49 smithi188 bash[23329]: cluster 2020-07-16T16:10:47.541924+0000 mgr.x (mgr.34562) 7313 : cluster [DBG] pgmap v4563: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:10:51.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:10:51 smithi132 bash[27079]: cluster 2020-07-16T16:10:49.542336+0000 mgr.x (mgr.34562) 7314 : cluster [DBG] pgmap v4564: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:10:51.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:10:51 smithi188 bash[23329]: cluster 2020-07-16T16:10:49.542336+0000 mgr.x (mgr.34562) 7314 : cluster [DBG] pgmap v4564: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:10:53.773 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:10:53 smithi132 bash[27079]: cluster 2020-07-16T16:10:51.542849+0000 mgr.x (mgr.34562) 7315 : cluster [DBG] pgmap v4565: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:10:53.774 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:10:53 smithi132 bash[27079]: audit 2020-07-16T16:10:52.874425+0000 mon.b (mon.2) 1566 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:10:53.774 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:10:53 smithi132 bash[27079]: audit 2020-07-16T16:10:52.875831+0000 mon.b (mon.2) 1567 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:10:53.774 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:10:53 smithi132 bash[27079]: audit 2020-07-16T16:10:52.876983+0000 mon.b (mon.2) 1568 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:10:53.775 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:10:53 smithi132 bash[27079]: audit 2020-07-16T16:10:52.878488+0000 mon.b (mon.2) 1569 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:10:53.775 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:10:53 smithi132 bash[27079]: audit 2020-07-16T16:10:52.879638+0000 mon.b (mon.2) 1570 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:10:53.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:10:53 smithi188 bash[23329]: cluster 2020-07-16T16:10:51.542849+0000 mgr.x (mgr.34562) 7315 : cluster [DBG] pgmap v4565: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:10:53.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:10:53 smithi188 bash[23329]: audit 2020-07-16T16:10:52.874425+0000 mon.b (mon.2) 1566 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:10:53.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:10:53 smithi188 bash[23329]: audit 2020-07-16T16:10:52.875831+0000 mon.b (mon.2) 1567 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:10:53.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:10:53 smithi188 bash[23329]: audit 2020-07-16T16:10:52.876983+0000 mon.b (mon.2) 1568 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:10:53.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:10:53 smithi188 bash[23329]: audit 2020-07-16T16:10:52.878488+0000 mon.b (mon.2) 1569 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:10:53.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:10:53 smithi188 bash[23329]: audit 2020-07-16T16:10:52.879638+0000 mon.b (mon.2) 1570 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:10:54.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:10:54 smithi132 bash[27079]: audit 2020-07-16T16:10:52.874805+0000 mgr.x (mgr.34562) 7316 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:10:54.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:10:54 smithi132 bash[27079]: audit 2020-07-16T16:10:52.876119+0000 mgr.x (mgr.34562) 7317 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:10:54.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:10:54 smithi132 bash[27079]: audit 2020-07-16T16:10:52.877258+0000 mgr.x (mgr.34562) 7318 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:10:54.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:10:54 smithi132 bash[27079]: cephadm 2020-07-16T16:10:52.878034+0000 mgr.x (mgr.34562) 7319 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:10:54.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:10:54 smithi132 bash[27079]: cephadm 2020-07-16T16:10:52.879293+0000 mgr.x (mgr.34562) 7320 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:10:54.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:10:54 smithi132 bash[27079]: cephadm 2020-07-16T16:10:52.880361+0000 mgr.x (mgr.34562) 7321 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:10:54.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:10:54 smithi132 bash[27079]: cephadm 2020-07-16T16:10:52.880667+0000 mgr.x (mgr.34562) 7322 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:10:54.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:10:54 smithi188 bash[23329]: audit 2020-07-16T16:10:52.874805+0000 mgr.x (mgr.34562) 7316 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:10:54.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:10:54 smithi188 bash[23329]: audit 2020-07-16T16:10:52.876119+0000 mgr.x (mgr.34562) 7317 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:10:54.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:10:54 smithi188 bash[23329]: audit 2020-07-16T16:10:52.877258+0000 mgr.x (mgr.34562) 7318 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:10:54.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:10:54 smithi188 bash[23329]: cephadm 2020-07-16T16:10:52.878034+0000 mgr.x (mgr.34562) 7319 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:10:54.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:10:54 smithi188 bash[23329]: cephadm 2020-07-16T16:10:52.879293+0000 mgr.x (mgr.34562) 7320 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:10:54.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:10:54 smithi188 bash[23329]: cephadm 2020-07-16T16:10:52.880361+0000 mgr.x (mgr.34562) 7321 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:10:54.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:10:54 smithi188 bash[23329]: cephadm 2020-07-16T16:10:52.880667+0000 mgr.x (mgr.34562) 7322 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:10:55.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:10:55 smithi132 bash[27079]: cluster 2020-07-16T16:10:53.543431+0000 mgr.x (mgr.34562) 7323 : cluster [DBG] pgmap v4566: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:10:55.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:10:55 smithi188 bash[23329]: cluster 2020-07-16T16:10:53.543431+0000 mgr.x (mgr.34562) 7323 : cluster [DBG] pgmap v4566: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:10:56.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:10:56 smithi132 bash[27079]: audit 2020-07-16T16:10:55.864856+0000 mon.b (mon.2) 1571 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:10:56.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:10:56 smithi188 bash[23329]: audit 2020-07-16T16:10:55.864856+0000 mon.b (mon.2) 1571 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:10:57.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:10:57 smithi132 bash[27079]: cluster 2020-07-16T16:10:55.543926+0000 mgr.x (mgr.34562) 7324 : cluster [DBG] pgmap v4567: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:10:57.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:10:57 smithi132 bash[27079]: cephadm 2020-07-16T16:10:55.865473+0000 mgr.x (mgr.34562) 7325 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:10:57.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:10:57 smithi132 bash[27079]: cephadm 2020-07-16T16:10:55.865887+0000 mgr.x (mgr.34562) 7326 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:10:57.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:10:57 smithi188 bash[23329]: cluster 2020-07-16T16:10:55.543926+0000 mgr.x (mgr.34562) 7324 : cluster [DBG] pgmap v4567: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:10:57.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:10:57 smithi188 bash[23329]: cephadm 2020-07-16T16:10:55.865473+0000 mgr.x (mgr.34562) 7325 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:10:57.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:10:57 smithi188 bash[23329]: cephadm 2020-07-16T16:10:55.865887+0000 mgr.x (mgr.34562) 7326 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:10:58.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:10:58 smithi132 bash[27079]: cluster 2020-07-16T16:10:57.544457+0000 mgr.x (mgr.34562) 7327 : cluster [DBG] pgmap v4568: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:10:58.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:10:58 smithi188 bash[23329]: cluster 2020-07-16T16:10:57.544457+0000 mgr.x (mgr.34562) 7327 : cluster [DBG] pgmap v4568: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:11:00.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:11:00 smithi188 bash[23329]: cluster 2020-07-16T16:10:59.544967+0000 mgr.x (mgr.34562) 7328 : cluster [DBG] pgmap v4569: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:11:01.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:11:00 smithi132 bash[27079]: cluster 2020-07-16T16:10:59.544967+0000 mgr.x (mgr.34562) 7328 : cluster [DBG] pgmap v4569: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:11:01.978 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:11:02.247 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:11:02.247 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 4m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:11:02.247 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 4m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:11:02.248 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 4m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:11:02.248 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 4m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:11:02.248 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 4m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:11:02.248 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:11:02.248 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:11:02.249 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 4m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:11:02.249 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 4m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:11:02.249 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:11:02.249 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:11:02.249 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:11:02.250 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:11:02.250 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:11:02.250 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:11:02.250 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:11:02.250 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:11:02.251 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 4m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:11:02.543 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:11:02.543 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:11:02.544 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:11:02.544 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:11:02.544 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:11:02.544 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:11:02.544 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:11:02.545 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:11:02.545 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:11:02.545 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:11:02.545 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:11:02.545 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:11:02.546 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:11:02.546 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:11:02.546 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:11:02.546 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:11:02.546 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:11:03.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:11:02 smithi132 bash[27079]: cluster 2020-07-16T16:11:01.545438+0000 mgr.x (mgr.34562) 7329 : cluster [DBG] pgmap v4570: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:11:03.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:11:02 smithi132 bash[27079]: audit 2020-07-16T16:11:01.966902+0000 mgr.x (mgr.34562) 7330 : audit [DBG] from='client.29968 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:11:03.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:11:02 smithi132 bash[27079]: audit 2020-07-16T16:11:02.242772+0000 mgr.x (mgr.34562) 7331 : audit [DBG] from='client.29974 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:11:03.280 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:11:02 smithi132 bash[27079]: audit 2020-07-16T16:11:02.542595+0000 mon.c (mon.1) 497 : audit [DBG] from='client.? 172.21.15.132:0/3474778353' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:11:03.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:11:02 smithi188 bash[23329]: cluster 2020-07-16T16:11:01.545438+0000 mgr.x (mgr.34562) 7329 : cluster [DBG] pgmap v4570: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:11:03.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:11:02 smithi188 bash[23329]: audit 2020-07-16T16:11:01.966902+0000 mgr.x (mgr.34562) 7330 : audit [DBG] from='client.29968 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:11:03.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:11:02 smithi188 bash[23329]: audit 2020-07-16T16:11:02.242772+0000 mgr.x (mgr.34562) 7331 : audit [DBG] from='client.29974 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:11:03.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:11:02 smithi188 bash[23329]: audit 2020-07-16T16:11:02.542595+0000 mon.c (mon.1) 497 : audit [DBG] from='client.? 172.21.15.132:0/3474778353' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:11:05.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:11:04 smithi132 bash[27079]: cluster 2020-07-16T16:11:03.545747+0000 mgr.x (mgr.34562) 7332 : cluster [DBG] pgmap v4571: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:11:05.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:11:04 smithi188 bash[23329]: cluster 2020-07-16T16:11:03.545747+0000 mgr.x (mgr.34562) 7332 : cluster [DBG] pgmap v4571: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:11:07.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:11:06 smithi132 bash[27079]: cluster 2020-07-16T16:11:05.546193+0000 mgr.x (mgr.34562) 7333 : cluster [DBG] pgmap v4572: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:11:07.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:11:06 smithi188 bash[23329]: cluster 2020-07-16T16:11:05.546193+0000 mgr.x (mgr.34562) 7333 : cluster [DBG] pgmap v4572: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:11:09.282 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:11:08 smithi132 bash[27079]: cluster 2020-07-16T16:11:07.546660+0000 mgr.x (mgr.34562) 7334 : cluster [DBG] pgmap v4573: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:11:09.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:11:08 smithi188 bash[23329]: cluster 2020-07-16T16:11:07.546660+0000 mgr.x (mgr.34562) 7334 : cluster [DBG] pgmap v4573: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:11:11.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:11:11 smithi132 bash[27079]: cluster 2020-07-16T16:11:09.547062+0000 mgr.x (mgr.34562) 7335 : cluster [DBG] pgmap v4574: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:11:11.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:11:11 smithi132 bash[27079]: audit 2020-07-16T16:11:10.881329+0000 mon.b (mon.2) 1572 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:11:11.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:11:11 smithi188 bash[23329]: cluster 2020-07-16T16:11:09.547062+0000 mgr.x (mgr.34562) 7335 : cluster [DBG] pgmap v4574: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:11:11.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:11:11 smithi188 bash[23329]: audit 2020-07-16T16:11:10.881329+0000 mon.b (mon.2) 1572 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:11:12.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:11:12 smithi132 bash[27079]: cephadm 2020-07-16T16:11:10.882084+0000 mgr.x (mgr.34562) 7336 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:11:12.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:11:12 smithi132 bash[27079]: cephadm 2020-07-16T16:11:10.882252+0000 mgr.x (mgr.34562) 7337 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:11:12.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:11:12 smithi188 bash[23329]: cephadm 2020-07-16T16:11:10.882084+0000 mgr.x (mgr.34562) 7336 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:11:12.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:11:12 smithi188 bash[23329]: cephadm 2020-07-16T16:11:10.882252+0000 mgr.x (mgr.34562) 7337 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:11:13.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:11:13 smithi132 bash[27079]: cluster 2020-07-16T16:11:11.547491+0000 mgr.x (mgr.34562) 7338 : cluster [DBG] pgmap v4575: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:11:13.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:11:13 smithi188 bash[23329]: cluster 2020-07-16T16:11:11.547491+0000 mgr.x (mgr.34562) 7338 : cluster [DBG] pgmap v4575: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:11:15.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:11:15 smithi132 bash[27079]: cluster 2020-07-16T16:11:13.547844+0000 mgr.x (mgr.34562) 7339 : cluster [DBG] pgmap v4576: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:11:15.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:11:15 smithi188 bash[23329]: cluster 2020-07-16T16:11:13.547844+0000 mgr.x (mgr.34562) 7339 : cluster [DBG] pgmap v4576: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:11:17.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:11:17 smithi132 bash[27079]: cluster 2020-07-16T16:11:15.548248+0000 mgr.x (mgr.34562) 7340 : cluster [DBG] pgmap v4577: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:11:17.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:11:17 smithi188 bash[23329]: cluster 2020-07-16T16:11:15.548248+0000 mgr.x (mgr.34562) 7340 : cluster [DBG] pgmap v4577: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:11:19.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:11:19 smithi132 bash[27079]: cluster 2020-07-16T16:11:17.548648+0000 mgr.x (mgr.34562) 7341 : cluster [DBG] pgmap v4578: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:11:19.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:11:19 smithi188 bash[23329]: cluster 2020-07-16T16:11:17.548648+0000 mgr.x (mgr.34562) 7341 : cluster [DBG] pgmap v4578: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:11:21.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:11:21 smithi132 bash[27079]: cluster 2020-07-16T16:11:19.549141+0000 mgr.x (mgr.34562) 7342 : cluster [DBG] pgmap v4579: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:11:21.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:11:21 smithi188 bash[23329]: cluster 2020-07-16T16:11:19.549141+0000 mgr.x (mgr.34562) 7342 : cluster [DBG] pgmap v4579: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:11:23.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:11:23 smithi132 bash[27079]: cluster 2020-07-16T16:11:21.549566+0000 mgr.x (mgr.34562) 7343 : cluster [DBG] pgmap v4580: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:11:23.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:11:23 smithi188 bash[23329]: cluster 2020-07-16T16:11:21.549566+0000 mgr.x (mgr.34562) 7343 : cluster [DBG] pgmap v4580: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:11:25.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:11:25 smithi188 bash[23329]: cluster 2020-07-16T16:11:23.550053+0000 mgr.x (mgr.34562) 7344 : cluster [DBG] pgmap v4581: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:11:25.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:11:25 smithi132 bash[27079]: cluster 2020-07-16T16:11:23.550053+0000 mgr.x (mgr.34562) 7344 : cluster [DBG] pgmap v4581: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:11:26.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:11:26 smithi188 bash[23329]: audit 2020-07-16T16:11:25.895878+0000 mon.b (mon.2) 1573 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:11:26.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:11:26 smithi132 bash[27079]: audit 2020-07-16T16:11:25.895878+0000 mon.b (mon.2) 1573 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:11:27.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:11:27 smithi188 bash[23329]: cluster 2020-07-16T16:11:25.550576+0000 mgr.x (mgr.34562) 7345 : cluster [DBG] pgmap v4582: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:11:27.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:11:27 smithi188 bash[23329]: cephadm 2020-07-16T16:11:25.896606+0000 mgr.x (mgr.34562) 7346 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:11:27.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:11:27 smithi188 bash[23329]: cephadm 2020-07-16T16:11:25.896926+0000 mgr.x (mgr.34562) 7347 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:11:27.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:11:27 smithi132 bash[27079]: cluster 2020-07-16T16:11:25.550576+0000 mgr.x (mgr.34562) 7345 : cluster [DBG] pgmap v4582: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:11:27.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:11:27 smithi132 bash[27079]: cephadm 2020-07-16T16:11:25.896606+0000 mgr.x (mgr.34562) 7346 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:11:27.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:11:27 smithi132 bash[27079]: cephadm 2020-07-16T16:11:25.896926+0000 mgr.x (mgr.34562) 7347 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:11:29.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:11:29 smithi188 bash[23329]: cluster 2020-07-16T16:11:27.551064+0000 mgr.x (mgr.34562) 7348 : cluster [DBG] pgmap v4583: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:11:29.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:11:29 smithi132 bash[27079]: cluster 2020-07-16T16:11:27.551064+0000 mgr.x (mgr.34562) 7348 : cluster [DBG] pgmap v4583: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:11:31.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:11:31 smithi188 bash[23329]: cluster 2020-07-16T16:11:29.551511+0000 mgr.x (mgr.34562) 7349 : cluster [DBG] pgmap v4584: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:11:31.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:11:31 smithi132 bash[27079]: cluster 2020-07-16T16:11:29.551511+0000 mgr.x (mgr.34562) 7349 : cluster [DBG] pgmap v4584: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:11:32.846 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:11:33.114 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:11:33.114 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 4m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:11:33.115 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 4m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:11:33.115 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 4m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:11:33.115 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 4m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:11:33.116 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 4m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:11:33.116 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:11:33.116 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:11:33.116 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 4m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:11:33.116 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 4m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:11:33.117 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:11:33.117 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:11:33.117 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:11:33.117 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:11:33.117 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:11:33.118 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:11:33.118 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:11:33.118 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:11:33.118 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 4m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:11:33.406 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:11:33.406 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:11:33.406 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:11:33.407 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:11:33.407 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:11:33.407 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:11:33.407 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:11:33.407 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:11:33.407 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:11:33.408 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:11:33.408 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:11:33.408 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:11:33.408 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:11:33.408 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:11:33.409 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:11:33.409 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:11:33.409 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:11:33.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:11:33 smithi188 bash[23329]: cluster 2020-07-16T16:11:31.551863+0000 mgr.x (mgr.34562) 7350 : cluster [DBG] pgmap v4585: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:11:33.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:11:33 smithi132 bash[27079]: cluster 2020-07-16T16:11:31.551863+0000 mgr.x (mgr.34562) 7350 : cluster [DBG] pgmap v4585: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:11:34.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:11:34 smithi188 bash[23329]: audit 2020-07-16T16:11:32.835186+0000 mgr.x (mgr.34562) 7351 : audit [DBG] from='client.29986 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:11:34.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:11:34 smithi188 bash[23329]: audit 2020-07-16T16:11:33.105840+0000 mgr.x (mgr.34562) 7352 : audit [DBG] from='client.29992 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:11:34.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:11:34 smithi188 bash[23329]: audit 2020-07-16T16:11:33.405150+0000 mon.c (mon.1) 498 : audit [DBG] from='client.? 172.21.15.132:0/2889875658' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:11:34.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:11:34 smithi132 bash[27079]: audit 2020-07-16T16:11:32.835186+0000 mgr.x (mgr.34562) 7351 : audit [DBG] from='client.29986 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:11:34.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:11:34 smithi132 bash[27079]: audit 2020-07-16T16:11:33.105840+0000 mgr.x (mgr.34562) 7352 : audit [DBG] from='client.29992 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:11:34.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:11:34 smithi132 bash[27079]: audit 2020-07-16T16:11:33.405150+0000 mon.c (mon.1) 498 : audit [DBG] from='client.? 172.21.15.132:0/2889875658' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:11:35.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:11:35 smithi188 bash[23329]: cluster 2020-07-16T16:11:33.552365+0000 mgr.x (mgr.34562) 7353 : cluster [DBG] pgmap v4586: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:11:35.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:11:35 smithi132 bash[27079]: cluster 2020-07-16T16:11:33.552365+0000 mgr.x (mgr.34562) 7353 : cluster [DBG] pgmap v4586: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:11:37.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:11:37 smithi188 bash[23329]: cluster 2020-07-16T16:11:35.552806+0000 mgr.x (mgr.34562) 7354 : cluster [DBG] pgmap v4587: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:11:37.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:11:37 smithi132 bash[27079]: cluster 2020-07-16T16:11:35.552806+0000 mgr.x (mgr.34562) 7354 : cluster [DBG] pgmap v4587: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:11:39.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:11:39 smithi188 bash[23329]: cluster 2020-07-16T16:11:37.553245+0000 mgr.x (mgr.34562) 7355 : cluster [DBG] pgmap v4588: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:11:39.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:11:39 smithi132 bash[27079]: cluster 2020-07-16T16:11:37.553245+0000 mgr.x (mgr.34562) 7355 : cluster [DBG] pgmap v4588: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:11:41.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:11:41 smithi188 bash[23329]: cluster 2020-07-16T16:11:39.553582+0000 mgr.x (mgr.34562) 7356 : cluster [DBG] pgmap v4589: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:11:41.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:11:41 smithi188 bash[23329]: audit 2020-07-16T16:11:40.905687+0000 mon.b (mon.2) 1574 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:11:41.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:11:41 smithi132 bash[27079]: cluster 2020-07-16T16:11:39.553582+0000 mgr.x (mgr.34562) 7356 : cluster [DBG] pgmap v4589: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:11:41.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:11:41 smithi132 bash[27079]: audit 2020-07-16T16:11:40.905687+0000 mon.b (mon.2) 1574 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:11:42.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:11:42 smithi188 bash[23329]: cephadm 2020-07-16T16:11:40.906380+0000 mgr.x (mgr.34562) 7357 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:11:42.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:11:42 smithi188 bash[23329]: cephadm 2020-07-16T16:11:40.906798+0000 mgr.x (mgr.34562) 7358 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:11:42.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:11:42 smithi132 bash[27079]: cephadm 2020-07-16T16:11:40.906380+0000 mgr.x (mgr.34562) 7357 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:11:42.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:11:42 smithi132 bash[27079]: cephadm 2020-07-16T16:11:40.906798+0000 mgr.x (mgr.34562) 7358 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:11:43.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:11:43 smithi188 bash[23329]: cluster 2020-07-16T16:11:41.554031+0000 mgr.x (mgr.34562) 7359 : cluster [DBG] pgmap v4590: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:11:43.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:11:43 smithi132 bash[27079]: cluster 2020-07-16T16:11:41.554031+0000 mgr.x (mgr.34562) 7359 : cluster [DBG] pgmap v4590: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:11:45.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:11:45 smithi188 bash[23329]: cluster 2020-07-16T16:11:43.554583+0000 mgr.x (mgr.34562) 7360 : cluster [DBG] pgmap v4591: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:11:45.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:11:45 smithi132 bash[27079]: cluster 2020-07-16T16:11:43.554583+0000 mgr.x (mgr.34562) 7360 : cluster [DBG] pgmap v4591: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:11:47.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:11:47 smithi188 bash[23329]: cluster 2020-07-16T16:11:45.554961+0000 mgr.x (mgr.34562) 7361 : cluster [DBG] pgmap v4592: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:11:47.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:11:47 smithi132 bash[27079]: cluster 2020-07-16T16:11:45.554961+0000 mgr.x (mgr.34562) 7361 : cluster [DBG] pgmap v4592: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:11:49.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:11:49 smithi188 bash[23329]: cluster 2020-07-16T16:11:47.555453+0000 mgr.x (mgr.34562) 7362 : cluster [DBG] pgmap v4593: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:11:49.532 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:11:49 smithi132 bash[27079]: cluster 2020-07-16T16:11:47.555453+0000 mgr.x (mgr.34562) 7362 : cluster [DBG] pgmap v4593: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:11:51.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:11:51 smithi188 bash[23329]: cluster 2020-07-16T16:11:49.555899+0000 mgr.x (mgr.34562) 7363 : cluster [DBG] pgmap v4594: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:11:51.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:11:51 smithi132 bash[27079]: cluster 2020-07-16T16:11:49.555899+0000 mgr.x (mgr.34562) 7363 : cluster [DBG] pgmap v4594: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:11:53.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:11:53 smithi188 bash[23329]: cluster 2020-07-16T16:11:51.556399+0000 mgr.x (mgr.34562) 7364 : cluster [DBG] pgmap v4595: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:11:53.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:11:53 smithi132 bash[27079]: cluster 2020-07-16T16:11:51.556399+0000 mgr.x (mgr.34562) 7364 : cluster [DBG] pgmap v4595: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:11:55.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:11:55 smithi188 bash[23329]: cluster 2020-07-16T16:11:53.556847+0000 mgr.x (mgr.34562) 7365 : cluster [DBG] pgmap v4596: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:11:55.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:11:55 smithi132 bash[27079]: cluster 2020-07-16T16:11:53.556847+0000 mgr.x (mgr.34562) 7365 : cluster [DBG] pgmap v4596: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:11:56.404 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:11:56 smithi132 bash[27079]: audit 2020-07-16T16:11:55.924840+0000 mon.b (mon.2) 1575 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:11:56.405 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:11:56 smithi132 bash[27079]: audit 2020-07-16T16:11:55.926298+0000 mon.b (mon.2) 1576 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:11:56.405 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:11:56 smithi132 bash[27079]: audit 2020-07-16T16:11:55.927555+0000 mon.b (mon.2) 1577 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:11:56.405 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:11:56 smithi132 bash[27079]: audit 2020-07-16T16:11:55.929081+0000 mon.b (mon.2) 1578 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:11:56.406 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:11:56 smithi132 bash[27079]: audit 2020-07-16T16:11:55.930561+0000 mon.b (mon.2) 1579 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:11:56.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:11:56 smithi188 bash[23329]: audit 2020-07-16T16:11:55.924840+0000 mon.b (mon.2) 1575 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:11:56.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:11:56 smithi188 bash[23329]: audit 2020-07-16T16:11:55.926298+0000 mon.b (mon.2) 1576 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:11:56.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:11:56 smithi188 bash[23329]: audit 2020-07-16T16:11:55.927555+0000 mon.b (mon.2) 1577 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:11:56.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:11:56 smithi188 bash[23329]: audit 2020-07-16T16:11:55.929081+0000 mon.b (mon.2) 1578 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:11:56.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:11:56 smithi188 bash[23329]: audit 2020-07-16T16:11:55.930561+0000 mon.b (mon.2) 1579 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:11:57.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:11:57 smithi188 bash[23329]: cluster 2020-07-16T16:11:55.557401+0000 mgr.x (mgr.34562) 7366 : cluster [DBG] pgmap v4597: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:11:57.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:11:57 smithi188 bash[23329]: audit 2020-07-16T16:11:55.925216+0000 mgr.x (mgr.34562) 7367 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:11:57.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:11:57 smithi188 bash[23329]: audit 2020-07-16T16:11:55.926625+0000 mgr.x (mgr.34562) 7368 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:11:57.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:11:57 smithi188 bash[23329]: audit 2020-07-16T16:11:55.927860+0000 mgr.x (mgr.34562) 7369 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:11:57.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:11:57 smithi188 bash[23329]: cephadm 2020-07-16T16:11:55.928621+0000 mgr.x (mgr.34562) 7370 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:11:57.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:11:57 smithi188 bash[23329]: cephadm 2020-07-16T16:11:55.930007+0000 mgr.x (mgr.34562) 7371 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:11:57.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:11:57 smithi188 bash[23329]: cephadm 2020-07-16T16:11:55.931411+0000 mgr.x (mgr.34562) 7372 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:11:57.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:11:57 smithi188 bash[23329]: cephadm 2020-07-16T16:11:55.931509+0000 mgr.x (mgr.34562) 7373 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:11:57.492 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:11:57 smithi132 bash[27079]: cluster 2020-07-16T16:11:55.557401+0000 mgr.x (mgr.34562) 7366 : cluster [DBG] pgmap v4597: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:11:57.492 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:11:57 smithi132 bash[27079]: audit 2020-07-16T16:11:55.925216+0000 mgr.x (mgr.34562) 7367 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:11:57.493 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:11:57 smithi132 bash[27079]: audit 2020-07-16T16:11:55.926625+0000 mgr.x (mgr.34562) 7368 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:11:57.493 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:11:57 smithi132 bash[27079]: audit 2020-07-16T16:11:55.927860+0000 mgr.x (mgr.34562) 7369 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:11:57.494 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:11:57 smithi132 bash[27079]: cephadm 2020-07-16T16:11:55.928621+0000 mgr.x (mgr.34562) 7370 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:11:57.494 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:11:57 smithi132 bash[27079]: cephadm 2020-07-16T16:11:55.930007+0000 mgr.x (mgr.34562) 7371 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:11:57.494 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:11:57 smithi132 bash[27079]: cephadm 2020-07-16T16:11:55.931411+0000 mgr.x (mgr.34562) 7372 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:11:57.494 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:11:57 smithi132 bash[27079]: cephadm 2020-07-16T16:11:55.931509+0000 mgr.x (mgr.34562) 7373 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:11:59.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:11:59 smithi132 bash[27079]: cluster 2020-07-16T16:11:57.557929+0000 mgr.x (mgr.34562) 7374 : cluster [DBG] pgmap v4598: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:11:59.279 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:11:59 smithi132 bash[27079]: audit 2020-07-16T16:11:58.901387+0000 mon.b (mon.2) 1580 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:11:59.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:11:59 smithi188 bash[23329]: cluster 2020-07-16T16:11:57.557929+0000 mgr.x (mgr.34562) 7374 : cluster [DBG] pgmap v4598: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:11:59.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:11:59 smithi188 bash[23329]: audit 2020-07-16T16:11:58.901387+0000 mon.b (mon.2) 1580 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:12:00.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:12:00 smithi188 bash[23329]: cephadm 2020-07-16T16:11:58.901959+0000 mgr.x (mgr.34562) 7375 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:12:00.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:12:00 smithi188 bash[23329]: cephadm 2020-07-16T16:11:58.902423+0000 mgr.x (mgr.34562) 7376 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:12:00.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:12:00 smithi132 bash[27079]: cephadm 2020-07-16T16:11:58.901959+0000 mgr.x (mgr.34562) 7375 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:12:00.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:12:00 smithi132 bash[27079]: cephadm 2020-07-16T16:11:58.902423+0000 mgr.x (mgr.34562) 7376 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:12:01.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:12:01 smithi188 bash[23329]: cluster 2020-07-16T16:11:59.558382+0000 mgr.x (mgr.34562) 7377 : cluster [DBG] pgmap v4599: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:12:01.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:12:01 smithi132 bash[27079]: cluster 2020-07-16T16:11:59.558382+0000 mgr.x (mgr.34562) 7377 : cluster [DBG] pgmap v4599: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:12:03.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:12:03 smithi188 bash[23329]: cluster 2020-07-16T16:12:01.558883+0000 mgr.x (mgr.34562) 7378 : cluster [DBG] pgmap v4600: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:12:03.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:12:03 smithi132 bash[27079]: cluster 2020-07-16T16:12:01.558883+0000 mgr.x (mgr.34562) 7378 : cluster [DBG] pgmap v4600: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:12:03.703 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:12:03.964 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:12:03.964 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 5m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:12:03.965 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 5m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:12:03.965 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 5m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:12:03.965 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 5m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:12:03.965 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 5m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:12:03.966 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:12:03.966 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:12:03.966 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 5m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:12:03.966 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 5m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:12:03.966 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:12:03.967 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:12:03.967 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:12:03.967 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:12:03.967 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:12:03.967 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:12:03.968 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:12:03.968 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:12:03.968 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 5m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:12:04.265 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:12:04.266 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:12:04.266 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:12:04.266 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:12:04.266 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:12:04.267 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:12:04.267 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:12:04.267 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:12:04.267 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:12:04.267 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:12:04.268 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:12:04.268 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:12:04.268 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:12:04.268 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:12:04.268 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:12:04.268 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:12:04.269 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:12:05.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:12:05 smithi188 bash[23329]: cluster 2020-07-16T16:12:03.559201+0000 mgr.x (mgr.34562) 7379 : cluster [DBG] pgmap v4601: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:12:05.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:12:05 smithi188 bash[23329]: audit 2020-07-16T16:12:03.691394+0000 mgr.x (mgr.34562) 7380 : audit [DBG] from='client.30004 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:12:05.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:12:05 smithi188 bash[23329]: audit 2020-07-16T16:12:03.960146+0000 mgr.x (mgr.34562) 7381 : audit [DBG] from='client.30010 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:12:05.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:12:05 smithi188 bash[23329]: audit 2020-07-16T16:12:04.264683+0000 mon.c (mon.1) 499 : audit [DBG] from='client.? 172.21.15.132:0/1217351416' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:12:05.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:12:05 smithi132 bash[27079]: cluster 2020-07-16T16:12:03.559201+0000 mgr.x (mgr.34562) 7379 : cluster [DBG] pgmap v4601: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:12:05.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:12:05 smithi132 bash[27079]: audit 2020-07-16T16:12:03.691394+0000 mgr.x (mgr.34562) 7380 : audit [DBG] from='client.30004 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:12:05.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:12:05 smithi132 bash[27079]: audit 2020-07-16T16:12:03.960146+0000 mgr.x (mgr.34562) 7381 : audit [DBG] from='client.30010 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:12:05.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:12:05 smithi132 bash[27079]: audit 2020-07-16T16:12:04.264683+0000 mon.c (mon.1) 499 : audit [DBG] from='client.? 172.21.15.132:0/1217351416' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:12:07.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:12:07 smithi188 bash[23329]: cluster 2020-07-16T16:12:05.559603+0000 mgr.x (mgr.34562) 7382 : cluster [DBG] pgmap v4602: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:12:07.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:12:07 smithi132 bash[27079]: cluster 2020-07-16T16:12:05.559603+0000 mgr.x (mgr.34562) 7382 : cluster [DBG] pgmap v4602: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:12:09.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:12:09 smithi188 bash[23329]: cluster 2020-07-16T16:12:07.559977+0000 mgr.x (mgr.34562) 7383 : cluster [DBG] pgmap v4603: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:12:09.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:12:09 smithi132 bash[27079]: cluster 2020-07-16T16:12:07.559977+0000 mgr.x (mgr.34562) 7383 : cluster [DBG] pgmap v4603: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:12:11.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:12:11 smithi188 bash[23329]: cluster 2020-07-16T16:12:09.560425+0000 mgr.x (mgr.34562) 7384 : cluster [DBG] pgmap v4604: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:12:11.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:12:11 smithi132 bash[27079]: cluster 2020-07-16T16:12:09.560425+0000 mgr.x (mgr.34562) 7384 : cluster [DBG] pgmap v4604: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:12:13.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:12:13 smithi188 bash[23329]: cluster 2020-07-16T16:12:11.560801+0000 mgr.x (mgr.34562) 7385 : cluster [DBG] pgmap v4605: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:12:13.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:12:13 smithi132 bash[27079]: cluster 2020-07-16T16:12:11.560801+0000 mgr.x (mgr.34562) 7385 : cluster [DBG] pgmap v4605: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:12:14.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:12:14 smithi188 bash[23329]: audit 2020-07-16T16:12:13.907740+0000 mon.b (mon.2) 1581 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:12:14.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:12:14 smithi132 bash[27079]: audit 2020-07-16T16:12:13.907740+0000 mon.b (mon.2) 1581 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:12:15.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:12:15 smithi188 bash[23329]: cluster 2020-07-16T16:12:13.561381+0000 mgr.x (mgr.34562) 7386 : cluster [DBG] pgmap v4606: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:12:15.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:12:15 smithi188 bash[23329]: cephadm 2020-07-16T16:12:13.908445+0000 mgr.x (mgr.34562) 7387 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:12:15.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:12:15 smithi188 bash[23329]: cephadm 2020-07-16T16:12:13.908860+0000 mgr.x (mgr.34562) 7388 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:12:15.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:12:15 smithi132 bash[27079]: cluster 2020-07-16T16:12:13.561381+0000 mgr.x (mgr.34562) 7386 : cluster [DBG] pgmap v4606: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:12:15.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:12:15 smithi132 bash[27079]: cephadm 2020-07-16T16:12:13.908445+0000 mgr.x (mgr.34562) 7387 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:12:15.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:12:15 smithi132 bash[27079]: cephadm 2020-07-16T16:12:13.908860+0000 mgr.x (mgr.34562) 7388 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:12:17.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:12:17 smithi188 bash[23329]: cluster 2020-07-16T16:12:15.561797+0000 mgr.x (mgr.34562) 7389 : cluster [DBG] pgmap v4607: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:12:17.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:12:17 smithi132 bash[27079]: cluster 2020-07-16T16:12:15.561797+0000 mgr.x (mgr.34562) 7389 : cluster [DBG] pgmap v4607: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:12:19.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:12:19 smithi188 bash[23329]: cluster 2020-07-16T16:12:17.562245+0000 mgr.x (mgr.34562) 7390 : cluster [DBG] pgmap v4608: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:12:19.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:12:19 smithi132 bash[27079]: cluster 2020-07-16T16:12:17.562245+0000 mgr.x (mgr.34562) 7390 : cluster [DBG] pgmap v4608: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:12:21.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:12:21 smithi188 bash[23329]: cluster 2020-07-16T16:12:19.562675+0000 mgr.x (mgr.34562) 7391 : cluster [DBG] pgmap v4609: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:12:21.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:12:21 smithi132 bash[27079]: cluster 2020-07-16T16:12:19.562675+0000 mgr.x (mgr.34562) 7391 : cluster [DBG] pgmap v4609: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:12:23.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:12:23 smithi188 bash[23329]: cluster 2020-07-16T16:12:21.563064+0000 mgr.x (mgr.34562) 7392 : cluster [DBG] pgmap v4610: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:12:23.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:12:23 smithi132 bash[27079]: cluster 2020-07-16T16:12:21.563064+0000 mgr.x (mgr.34562) 7392 : cluster [DBG] pgmap v4610: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:12:25.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:12:25 smithi188 bash[23329]: cluster 2020-07-16T16:12:23.563472+0000 mgr.x (mgr.34562) 7393 : cluster [DBG] pgmap v4611: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:12:25.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:12:25 smithi132 bash[27079]: cluster 2020-07-16T16:12:23.563472+0000 mgr.x (mgr.34562) 7393 : cluster [DBG] pgmap v4611: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:12:27.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:12:27 smithi188 bash[23329]: cluster 2020-07-16T16:12:25.563976+0000 mgr.x (mgr.34562) 7394 : cluster [DBG] pgmap v4612: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:12:27.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:12:27 smithi132 bash[27079]: cluster 2020-07-16T16:12:25.563976+0000 mgr.x (mgr.34562) 7394 : cluster [DBG] pgmap v4612: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:12:29.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:12:29 smithi188 bash[23329]: cluster 2020-07-16T16:12:27.564341+0000 mgr.x (mgr.34562) 7395 : cluster [DBG] pgmap v4613: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:12:29.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:12:29 smithi188 bash[23329]: audit 2020-07-16T16:12:28.924400+0000 mon.b (mon.2) 1582 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:12:29.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:12:29 smithi132 bash[27079]: cluster 2020-07-16T16:12:27.564341+0000 mgr.x (mgr.34562) 7395 : cluster [DBG] pgmap v4613: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:12:29.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:12:29 smithi132 bash[27079]: audit 2020-07-16T16:12:28.924400+0000 mon.b (mon.2) 1582 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:12:30.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:12:30 smithi188 bash[23329]: cephadm 2020-07-16T16:12:28.925114+0000 mgr.x (mgr.34562) 7396 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:12:30.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:12:30 smithi188 bash[23329]: cephadm 2020-07-16T16:12:28.925190+0000 mgr.x (mgr.34562) 7397 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:12:30.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:12:30 smithi132 bash[27079]: cephadm 2020-07-16T16:12:28.925114+0000 mgr.x (mgr.34562) 7396 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:12:30.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:12:30 smithi132 bash[27079]: cephadm 2020-07-16T16:12:28.925190+0000 mgr.x (mgr.34562) 7397 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:12:31.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:12:31 smithi132 bash[27079]: cluster 2020-07-16T16:12:29.564665+0000 mgr.x (mgr.34562) 7398 : cluster [DBG] pgmap v4614: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:12:31.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:12:31 smithi188 bash[23329]: cluster 2020-07-16T16:12:29.564665+0000 mgr.x (mgr.34562) 7398 : cluster [DBG] pgmap v4614: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:12:33.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:12:33 smithi132 bash[27079]: cluster 2020-07-16T16:12:31.565033+0000 mgr.x (mgr.34562) 7399 : cluster [DBG] pgmap v4615: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:12:33.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:12:33 smithi188 bash[23329]: cluster 2020-07-16T16:12:31.565033+0000 mgr.x (mgr.34562) 7399 : cluster [DBG] pgmap v4615: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:12:34.561 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:12:34.828 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:12:34.829 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 5m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:12:34.829 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 5m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:12:34.829 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 5m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:12:34.830 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 5m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:12:34.830 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 5m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:12:34.830 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:12:34.830 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:12:34.830 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 5m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:12:34.831 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 5m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:12:34.831 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:12:34.831 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:12:34.831 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:12:34.831 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:12:34.832 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:12:34.832 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:12:34.832 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:12:34.832 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:12:34.832 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 5m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:12:35.125 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:12:35.125 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:12:35.126 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:12:35.126 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:12:35.126 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:12:35.126 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:12:35.126 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:12:35.127 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:12:35.127 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:12:35.127 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:12:35.127 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:12:35.127 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:12:35.128 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:12:35.128 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:12:35.128 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:12:35.128 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:12:35.128 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:12:35.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:12:35 smithi132 bash[27079]: cluster 2020-07-16T16:12:33.565537+0000 mgr.x (mgr.34562) 7400 : cluster [DBG] pgmap v4616: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:12:35.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:12:35 smithi132 bash[27079]: audit 2020-07-16T16:12:35.124253+0000 mon.c (mon.1) 500 : audit [DBG] from='client.? 172.21.15.132:0/2813012081' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:12:35.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:12:35 smithi188 bash[23329]: cluster 2020-07-16T16:12:33.565537+0000 mgr.x (mgr.34562) 7400 : cluster [DBG] pgmap v4616: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:12:35.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:12:35 smithi188 bash[23329]: audit 2020-07-16T16:12:35.124253+0000 mon.c (mon.1) 500 : audit [DBG] from='client.? 172.21.15.132:0/2813012081' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:12:36.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:12:36 smithi132 bash[27079]: audit 2020-07-16T16:12:34.550333+0000 mgr.x (mgr.34562) 7401 : audit [DBG] from='client.30022 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:12:36.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:12:36 smithi132 bash[27079]: audit 2020-07-16T16:12:34.824640+0000 mgr.x (mgr.34562) 7402 : audit [DBG] from='client.30028 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:12:36.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:12:36 smithi188 bash[23329]: audit 2020-07-16T16:12:34.550333+0000 mgr.x (mgr.34562) 7401 : audit [DBG] from='client.30022 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:12:36.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:12:36 smithi188 bash[23329]: audit 2020-07-16T16:12:34.824640+0000 mgr.x (mgr.34562) 7402 : audit [DBG] from='client.30028 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:12:37.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:12:37 smithi132 bash[27079]: cluster 2020-07-16T16:12:35.566063+0000 mgr.x (mgr.34562) 7403 : cluster [DBG] pgmap v4617: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:12:37.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:12:37 smithi188 bash[23329]: cluster 2020-07-16T16:12:35.566063+0000 mgr.x (mgr.34562) 7403 : cluster [DBG] pgmap v4617: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:12:39.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:12:39 smithi132 bash[27079]: cluster 2020-07-16T16:12:37.566509+0000 mgr.x (mgr.34562) 7404 : cluster [DBG] pgmap v4618: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:12:39.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:12:39 smithi188 bash[23329]: cluster 2020-07-16T16:12:37.566509+0000 mgr.x (mgr.34562) 7404 : cluster [DBG] pgmap v4618: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:12:41.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:12:41 smithi132 bash[27079]: cluster 2020-07-16T16:12:39.566938+0000 mgr.x (mgr.34562) 7405 : cluster [DBG] pgmap v4619: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:12:41.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:12:41 smithi188 bash[23329]: cluster 2020-07-16T16:12:39.566938+0000 mgr.x (mgr.34562) 7405 : cluster [DBG] pgmap v4619: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:12:43.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:12:43 smithi132 bash[27079]: cluster 2020-07-16T16:12:41.567430+0000 mgr.x (mgr.34562) 7406 : cluster [DBG] pgmap v4620: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:12:43.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:12:43 smithi188 bash[23329]: cluster 2020-07-16T16:12:41.567430+0000 mgr.x (mgr.34562) 7406 : cluster [DBG] pgmap v4620: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:12:44.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:12:44 smithi132 bash[27079]: audit 2020-07-16T16:12:43.929856+0000 mon.b (mon.2) 1583 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:12:44.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:12:44 smithi188 bash[23329]: audit 2020-07-16T16:12:43.929856+0000 mon.b (mon.2) 1583 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:12:45.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:12:45 smithi132 bash[27079]: cluster 2020-07-16T16:12:43.567837+0000 mgr.x (mgr.34562) 7407 : cluster [DBG] pgmap v4621: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:12:45.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:12:45 smithi132 bash[27079]: cephadm 2020-07-16T16:12:43.930530+0000 mgr.x (mgr.34562) 7408 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:12:45.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:12:45 smithi132 bash[27079]: cephadm 2020-07-16T16:12:43.930925+0000 mgr.x (mgr.34562) 7409 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:12:45.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:12:45 smithi188 bash[23329]: cluster 2020-07-16T16:12:43.567837+0000 mgr.x (mgr.34562) 7407 : cluster [DBG] pgmap v4621: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:12:45.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:12:45 smithi188 bash[23329]: cephadm 2020-07-16T16:12:43.930530+0000 mgr.x (mgr.34562) 7408 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:12:45.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:12:45 smithi188 bash[23329]: cephadm 2020-07-16T16:12:43.930925+0000 mgr.x (mgr.34562) 7409 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:12:47.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:12:47 smithi132 bash[27079]: cluster 2020-07-16T16:12:45.568324+0000 mgr.x (mgr.34562) 7410 : cluster [DBG] pgmap v4622: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:12:47.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:12:47 smithi188 bash[23329]: cluster 2020-07-16T16:12:45.568324+0000 mgr.x (mgr.34562) 7410 : cluster [DBG] pgmap v4622: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:12:49.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:12:49 smithi132 bash[27079]: cluster 2020-07-16T16:12:47.568845+0000 mgr.x (mgr.34562) 7411 : cluster [DBG] pgmap v4623: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:12:49.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:12:49 smithi188 bash[23329]: cluster 2020-07-16T16:12:47.568845+0000 mgr.x (mgr.34562) 7411 : cluster [DBG] pgmap v4623: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:12:51.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:12:51 smithi132 bash[27079]: cluster 2020-07-16T16:12:49.569362+0000 mgr.x (mgr.34562) 7412 : cluster [DBG] pgmap v4624: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:12:51.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:12:51 smithi188 bash[23329]: cluster 2020-07-16T16:12:49.569362+0000 mgr.x (mgr.34562) 7412 : cluster [DBG] pgmap v4624: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:12:53.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:12:53 smithi132 bash[27079]: cluster 2020-07-16T16:12:51.569739+0000 mgr.x (mgr.34562) 7413 : cluster [DBG] pgmap v4625: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:12:53.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:12:53 smithi188 bash[23329]: cluster 2020-07-16T16:12:51.569739+0000 mgr.x (mgr.34562) 7413 : cluster [DBG] pgmap v4625: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:12:55.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:12:55 smithi132 bash[27079]: cluster 2020-07-16T16:12:53.570207+0000 mgr.x (mgr.34562) 7414 : cluster [DBG] pgmap v4626: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:12:55.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:12:55 smithi188 bash[23329]: cluster 2020-07-16T16:12:53.570207+0000 mgr.x (mgr.34562) 7414 : cluster [DBG] pgmap v4626: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:12:57.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:12:57 smithi132 bash[27079]: cluster 2020-07-16T16:12:55.570730+0000 mgr.x (mgr.34562) 7415 : cluster [DBG] pgmap v4627: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:12:57.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:12:57 smithi188 bash[23329]: cluster 2020-07-16T16:12:55.570730+0000 mgr.x (mgr.34562) 7415 : cluster [DBG] pgmap v4627: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:12:59.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:12:59 smithi132 bash[27079]: cluster 2020-07-16T16:12:57.571233+0000 mgr.x (mgr.34562) 7416 : cluster [DBG] pgmap v4628: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:12:59.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:12:59 smithi132 bash[27079]: audit 2020-07-16T16:12:58.935301+0000 mon.b (mon.2) 1584 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:12:59.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:12:59 smithi132 bash[27079]: audit 2020-07-16T16:12:58.936697+0000 mon.b (mon.2) 1585 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:12:59.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:12:59 smithi132 bash[27079]: audit 2020-07-16T16:12:58.937940+0000 mon.b (mon.2) 1586 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:12:59.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:12:59 smithi132 bash[27079]: audit 2020-07-16T16:12:58.939332+0000 mon.b (mon.2) 1587 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:12:59.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:12:59 smithi132 bash[27079]: audit 2020-07-16T16:12:58.940707+0000 mon.b (mon.2) 1588 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:12:59.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:12:59 smithi188 bash[23329]: cluster 2020-07-16T16:12:57.571233+0000 mgr.x (mgr.34562) 7416 : cluster [DBG] pgmap v4628: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:12:59.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:12:59 smithi188 bash[23329]: audit 2020-07-16T16:12:58.935301+0000 mon.b (mon.2) 1584 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:12:59.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:12:59 smithi188 bash[23329]: audit 2020-07-16T16:12:58.936697+0000 mon.b (mon.2) 1585 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:12:59.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:12:59 smithi188 bash[23329]: audit 2020-07-16T16:12:58.937940+0000 mon.b (mon.2) 1586 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:12:59.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:12:59 smithi188 bash[23329]: audit 2020-07-16T16:12:58.939332+0000 mon.b (mon.2) 1587 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:12:59.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:12:59 smithi188 bash[23329]: audit 2020-07-16T16:12:58.940707+0000 mon.b (mon.2) 1588 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:13:00.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:13:00 smithi132 bash[27079]: audit 2020-07-16T16:12:58.935705+0000 mgr.x (mgr.34562) 7417 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:13:00.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:13:00 smithi132 bash[27079]: audit 2020-07-16T16:12:58.937010+0000 mgr.x (mgr.34562) 7418 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:13:00.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:13:00 smithi132 bash[27079]: audit 2020-07-16T16:12:58.938258+0000 mgr.x (mgr.34562) 7419 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:13:00.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:13:00 smithi132 bash[27079]: cephadm 2020-07-16T16:12:58.938998+0000 mgr.x (mgr.34562) 7420 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:13:00.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:13:00 smithi132 bash[27079]: cephadm 2020-07-16T16:12:58.940191+0000 mgr.x (mgr.34562) 7421 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:13:00.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:13:00 smithi132 bash[27079]: cephadm 2020-07-16T16:12:58.941443+0000 mgr.x (mgr.34562) 7422 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:13:00.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:13:00 smithi132 bash[27079]: cephadm 2020-07-16T16:12:58.941711+0000 mgr.x (mgr.34562) 7423 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:13:00.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:13:00 smithi188 bash[23329]: audit 2020-07-16T16:12:58.935705+0000 mgr.x (mgr.34562) 7417 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:13:00.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:13:00 smithi188 bash[23329]: audit 2020-07-16T16:12:58.937010+0000 mgr.x (mgr.34562) 7418 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:13:00.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:13:00 smithi188 bash[23329]: audit 2020-07-16T16:12:58.938258+0000 mgr.x (mgr.34562) 7419 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:13:00.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:13:00 smithi188 bash[23329]: cephadm 2020-07-16T16:12:58.938998+0000 mgr.x (mgr.34562) 7420 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:13:00.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:13:00 smithi188 bash[23329]: cephadm 2020-07-16T16:12:58.940191+0000 mgr.x (mgr.34562) 7421 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:13:00.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:13:00 smithi188 bash[23329]: cephadm 2020-07-16T16:12:58.941443+0000 mgr.x (mgr.34562) 7422 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:13:00.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:13:00 smithi188 bash[23329]: cephadm 2020-07-16T16:12:58.941711+0000 mgr.x (mgr.34562) 7423 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:13:01.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:13:01 smithi132 bash[27079]: cluster 2020-07-16T16:12:59.571662+0000 mgr.x (mgr.34562) 7424 : cluster [DBG] pgmap v4629: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:13:01.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:13:01 smithi188 bash[23329]: cluster 2020-07-16T16:12:59.571662+0000 mgr.x (mgr.34562) 7424 : cluster [DBG] pgmap v4629: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:13:02.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:13:02 smithi132 bash[27079]: audit 2020-07-16T16:13:01.671788+0000 mon.b (mon.2) 1589 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:13:02.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:13:02 smithi188 bash[23329]: audit 2020-07-16T16:13:01.671788+0000 mon.b (mon.2) 1589 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:13:03.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:13:03 smithi132 bash[27079]: cluster 2020-07-16T16:13:01.572181+0000 mgr.x (mgr.34562) 7425 : cluster [DBG] pgmap v4630: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:13:03.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:13:03 smithi132 bash[27079]: cephadm 2020-07-16T16:13:01.672393+0000 mgr.x (mgr.34562) 7426 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:13:03.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:13:03 smithi132 bash[27079]: cephadm 2020-07-16T16:13:01.672660+0000 mgr.x (mgr.34562) 7427 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:13:03.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:13:03 smithi188 bash[23329]: cluster 2020-07-16T16:13:01.572181+0000 mgr.x (mgr.34562) 7425 : cluster [DBG] pgmap v4630: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:13:03.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:13:03 smithi188 bash[23329]: cephadm 2020-07-16T16:13:01.672393+0000 mgr.x (mgr.34562) 7426 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:13:03.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:13:03 smithi188 bash[23329]: cephadm 2020-07-16T16:13:01.672660+0000 mgr.x (mgr.34562) 7427 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:13:05.425 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:13:05.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:13:05 smithi132 bash[27079]: cluster 2020-07-16T16:13:03.572527+0000 mgr.x (mgr.34562) 7428 : cluster [DBG] pgmap v4631: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:13:05.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:13:05 smithi188 bash[23329]: cluster 2020-07-16T16:13:03.572527+0000 mgr.x (mgr.34562) 7428 : cluster [DBG] pgmap v4631: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:13:05.687 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:13:05.687 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 6m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:13:05.688 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 6m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:13:05.688 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 6m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:13:05.688 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 6m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:13:05.688 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 6m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:13:05.689 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:13:05.689 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:13:05.689 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 6m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:13:05.689 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 6m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:13:05.689 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:13:05.690 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:13:05.690 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:13:05.690 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:13:05.690 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:13:05.690 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:13:05.691 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:13:05.691 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:13:05.691 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 6m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:13:05.985 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:13:05.986 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:13:05.986 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:13:05.986 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:13:05.986 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:13:05.987 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:13:05.987 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:13:05.987 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:13:05.987 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:13:05.987 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:13:05.988 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:13:05.988 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:13:05.988 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:13:05.988 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:13:05.988 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:13:05.989 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:13:05.989 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:13:06.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:13:06 smithi132 bash[27079]: audit 2020-07-16T16:13:05.413844+0000 mgr.x (mgr.34562) 7429 : audit [DBG] from='client.30040 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:13:06.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:13:06 smithi132 bash[27079]: audit 2020-07-16T16:13:05.984819+0000 mon.c (mon.1) 501 : audit [DBG] from='client.? 172.21.15.132:0/3025798132' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:13:06.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:13:06 smithi188 bash[23329]: audit 2020-07-16T16:13:05.413844+0000 mgr.x (mgr.34562) 7429 : audit [DBG] from='client.30040 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:13:06.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:13:06 smithi188 bash[23329]: audit 2020-07-16T16:13:05.984819+0000 mon.c (mon.1) 501 : audit [DBG] from='client.? 172.21.15.132:0/3025798132' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:13:07.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:13:07 smithi132 bash[27079]: cluster 2020-07-16T16:13:05.572907+0000 mgr.x (mgr.34562) 7430 : cluster [DBG] pgmap v4632: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:13:07.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:13:07 smithi132 bash[27079]: audit 2020-07-16T16:13:05.682987+0000 mgr.x (mgr.34562) 7431 : audit [DBG] from='client.30046 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:13:07.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:13:07 smithi188 bash[23329]: cluster 2020-07-16T16:13:05.572907+0000 mgr.x (mgr.34562) 7430 : cluster [DBG] pgmap v4632: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:13:07.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:13:07 smithi188 bash[23329]: audit 2020-07-16T16:13:05.682987+0000 mgr.x (mgr.34562) 7431 : audit [DBG] from='client.30046 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:13:09.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:13:09 smithi132 bash[27079]: cluster 2020-07-16T16:13:07.573357+0000 mgr.x (mgr.34562) 7432 : cluster [DBG] pgmap v4633: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:13:09.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:13:09 smithi188 bash[23329]: cluster 2020-07-16T16:13:07.573357+0000 mgr.x (mgr.34562) 7432 : cluster [DBG] pgmap v4633: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:13:11.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:13:11 smithi132 bash[27079]: cluster 2020-07-16T16:13:09.573766+0000 mgr.x (mgr.34562) 7433 : cluster [DBG] pgmap v4634: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:13:11.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:13:11 smithi188 bash[23329]: cluster 2020-07-16T16:13:09.573766+0000 mgr.x (mgr.34562) 7433 : cluster [DBG] pgmap v4634: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:13:13.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:13:13 smithi132 bash[27079]: cluster 2020-07-16T16:13:11.574204+0000 mgr.x (mgr.34562) 7434 : cluster [DBG] pgmap v4635: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:13:13.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:13:13 smithi188 bash[23329]: cluster 2020-07-16T16:13:11.574204+0000 mgr.x (mgr.34562) 7434 : cluster [DBG] pgmap v4635: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:13:15.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:13:15 smithi132 bash[27079]: cluster 2020-07-16T16:13:13.574708+0000 mgr.x (mgr.34562) 7435 : cluster [DBG] pgmap v4636: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:13:15.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:13:15 smithi188 bash[23329]: cluster 2020-07-16T16:13:13.574708+0000 mgr.x (mgr.34562) 7435 : cluster [DBG] pgmap v4636: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:13:17.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:13:17 smithi132 bash[27079]: cluster 2020-07-16T16:13:15.575063+0000 mgr.x (mgr.34562) 7436 : cluster [DBG] pgmap v4637: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:13:17.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:13:17 smithi132 bash[27079]: audit 2020-07-16T16:13:16.678720+0000 mon.b (mon.2) 1590 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:13:17.675 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:13:17 smithi188 bash[23329]: cluster 2020-07-16T16:13:15.575063+0000 mgr.x (mgr.34562) 7436 : cluster [DBG] pgmap v4637: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:13:17.676 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:13:17 smithi188 bash[23329]: audit 2020-07-16T16:13:16.678720+0000 mon.b (mon.2) 1590 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:13:18.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:13:18 smithi132 bash[27079]: cephadm 2020-07-16T16:13:16.679414+0000 mgr.x (mgr.34562) 7437 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:13:18.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:13:18 smithi132 bash[27079]: cephadm 2020-07-16T16:13:16.679788+0000 mgr.x (mgr.34562) 7438 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:13:18.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:13:18 smithi188 bash[23329]: cephadm 2020-07-16T16:13:16.679414+0000 mgr.x (mgr.34562) 7437 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:13:18.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:13:18 smithi188 bash[23329]: cephadm 2020-07-16T16:13:16.679788+0000 mgr.x (mgr.34562) 7438 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:13:19.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:13:19 smithi188 bash[23329]: cluster 2020-07-16T16:13:17.575467+0000 mgr.x (mgr.34562) 7439 : cluster [DBG] pgmap v4638: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:13:19.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:13:19 smithi132 bash[27079]: cluster 2020-07-16T16:13:17.575467+0000 mgr.x (mgr.34562) 7439 : cluster [DBG] pgmap v4638: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:13:21.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:13:21 smithi188 bash[23329]: cluster 2020-07-16T16:13:19.575964+0000 mgr.x (mgr.34562) 7440 : cluster [DBG] pgmap v4639: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:13:21.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:13:21 smithi132 bash[27079]: cluster 2020-07-16T16:13:19.575964+0000 mgr.x (mgr.34562) 7440 : cluster [DBG] pgmap v4639: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:13:23.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:13:23 smithi188 bash[23329]: cluster 2020-07-16T16:13:21.576418+0000 mgr.x (mgr.34562) 7441 : cluster [DBG] pgmap v4640: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:13:23.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:13:23 smithi132 bash[27079]: cluster 2020-07-16T16:13:21.576418+0000 mgr.x (mgr.34562) 7441 : cluster [DBG] pgmap v4640: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:13:25.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:13:25 smithi188 bash[23329]: cluster 2020-07-16T16:13:23.576909+0000 mgr.x (mgr.34562) 7442 : cluster [DBG] pgmap v4641: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:13:25.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:13:25 smithi132 bash[27079]: cluster 2020-07-16T16:13:23.576909+0000 mgr.x (mgr.34562) 7442 : cluster [DBG] pgmap v4641: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:13:27.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:13:27 smithi188 bash[23329]: cluster 2020-07-16T16:13:25.577279+0000 mgr.x (mgr.34562) 7443 : cluster [DBG] pgmap v4642: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:13:27.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:13:27 smithi132 bash[27079]: cluster 2020-07-16T16:13:25.577279+0000 mgr.x (mgr.34562) 7443 : cluster [DBG] pgmap v4642: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:13:29.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:13:29 smithi188 bash[23329]: cluster 2020-07-16T16:13:27.577771+0000 mgr.x (mgr.34562) 7444 : cluster [DBG] pgmap v4643: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:13:29.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:13:29 smithi132 bash[27079]: cluster 2020-07-16T16:13:27.577771+0000 mgr.x (mgr.34562) 7444 : cluster [DBG] pgmap v4643: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:13:31.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:13:31 smithi188 bash[23329]: cluster 2020-07-16T16:13:29.578225+0000 mgr.x (mgr.34562) 7445 : cluster [DBG] pgmap v4644: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:13:31.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:13:31 smithi132 bash[27079]: cluster 2020-07-16T16:13:29.578225+0000 mgr.x (mgr.34562) 7445 : cluster [DBG] pgmap v4644: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:13:32.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:13:32 smithi188 bash[23329]: audit 2020-07-16T16:13:31.695358+0000 mon.b (mon.2) 1591 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:13:32.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:13:32 smithi132 bash[27079]: audit 2020-07-16T16:13:31.695358+0000 mon.b (mon.2) 1591 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:13:33.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:13:33 smithi188 bash[23329]: cluster 2020-07-16T16:13:31.578580+0000 mgr.x (mgr.34562) 7446 : cluster [DBG] pgmap v4645: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:13:33.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:13:33 smithi188 bash[23329]: cephadm 2020-07-16T16:13:31.696077+0000 mgr.x (mgr.34562) 7447 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:13:33.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:13:33 smithi188 bash[23329]: cephadm 2020-07-16T16:13:31.696529+0000 mgr.x (mgr.34562) 7448 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:13:33.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:13:33 smithi132 bash[27079]: cluster 2020-07-16T16:13:31.578580+0000 mgr.x (mgr.34562) 7446 : cluster [DBG] pgmap v4645: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:13:33.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:13:33 smithi132 bash[27079]: cephadm 2020-07-16T16:13:31.696077+0000 mgr.x (mgr.34562) 7447 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:13:33.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:13:33 smithi132 bash[27079]: cephadm 2020-07-16T16:13:31.696529+0000 mgr.x (mgr.34562) 7448 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:13:35.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:13:35 smithi188 bash[23329]: cluster 2020-07-16T16:13:33.578949+0000 mgr.x (mgr.34562) 7449 : cluster [DBG] pgmap v4646: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:13:35.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:13:35 smithi132 bash[27079]: cluster 2020-07-16T16:13:33.578949+0000 mgr.x (mgr.34562) 7449 : cluster [DBG] pgmap v4646: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:13:36.286 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:13:36.546 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:13:36.546 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 6m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:13:36.547 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 6m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:13:36.547 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 6m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:13:36.547 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 6m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:13:36.547 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 6m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:13:36.548 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:13:36.548 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:13:36.548 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 6m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:13:36.548 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 6m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:13:36.548 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:13:36.549 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:13:36.549 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:13:36.549 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:13:36.549 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:13:36.549 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:13:36.550 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:13:36.550 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:13:36.550 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 6m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:13:36.846 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:13:36.847 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:13:36.847 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:13:36.848 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:13:36.848 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:13:36.848 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:13:36.849 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:13:36.849 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:13:36.849 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:13:36.850 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:13:36.850 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:13:36.850 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:13:36.851 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:13:36.851 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:13:36.851 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:13:36.852 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:13:36.852 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:13:37.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:13:37 smithi188 bash[23329]: cluster 2020-07-16T16:13:35.579430+0000 mgr.x (mgr.34562) 7450 : cluster [DBG] pgmap v4647: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:13:37.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:13:37 smithi188 bash[23329]: audit 2020-07-16T16:13:36.272041+0000 mgr.x (mgr.34562) 7451 : audit [DBG] from='client.30058 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:13:37.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:13:37 smithi188 bash[23329]: audit 2020-07-16T16:13:36.845643+0000 mon.c (mon.1) 502 : audit [DBG] from='client.? 172.21.15.132:0/1225328680' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:13:37.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:13:37 smithi132 bash[27079]: cluster 2020-07-16T16:13:35.579430+0000 mgr.x (mgr.34562) 7450 : cluster [DBG] pgmap v4647: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:13:37.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:13:37 smithi132 bash[27079]: audit 2020-07-16T16:13:36.272041+0000 mgr.x (mgr.34562) 7451 : audit [DBG] from='client.30058 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:13:37.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:13:37 smithi132 bash[27079]: audit 2020-07-16T16:13:36.845643+0000 mon.c (mon.1) 502 : audit [DBG] from='client.? 172.21.15.132:0/1225328680' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:13:38.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:13:38 smithi188 bash[23329]: audit 2020-07-16T16:13:36.541459+0000 mgr.x (mgr.34562) 7452 : audit [DBG] from='client.30064 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:13:38.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:13:38 smithi132 bash[27079]: audit 2020-07-16T16:13:36.541459+0000 mgr.x (mgr.34562) 7452 : audit [DBG] from='client.30064 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:13:39.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:13:39 smithi188 bash[23329]: cluster 2020-07-16T16:13:37.579888+0000 mgr.x (mgr.34562) 7453 : cluster [DBG] pgmap v4648: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:13:39.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:13:39 smithi132 bash[27079]: cluster 2020-07-16T16:13:37.579888+0000 mgr.x (mgr.34562) 7453 : cluster [DBG] pgmap v4648: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:13:41.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:13:41 smithi188 bash[23329]: cluster 2020-07-16T16:13:39.580412+0000 mgr.x (mgr.34562) 7454 : cluster [DBG] pgmap v4649: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:13:41.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:13:41 smithi132 bash[27079]: cluster 2020-07-16T16:13:39.580412+0000 mgr.x (mgr.34562) 7454 : cluster [DBG] pgmap v4649: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:13:43.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:13:43 smithi188 bash[23329]: cluster 2020-07-16T16:13:41.580939+0000 mgr.x (mgr.34562) 7455 : cluster [DBG] pgmap v4650: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:13:43.786 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:13:43 smithi132 bash[27079]: cluster 2020-07-16T16:13:41.580939+0000 mgr.x (mgr.34562) 7455 : cluster [DBG] pgmap v4650: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:13:45.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:13:45 smithi188 bash[23329]: cluster 2020-07-16T16:13:43.581496+0000 mgr.x (mgr.34562) 7456 : cluster [DBG] pgmap v4651: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:13:45.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:13:45 smithi132 bash[27079]: cluster 2020-07-16T16:13:43.581496+0000 mgr.x (mgr.34562) 7456 : cluster [DBG] pgmap v4651: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:13:47.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:13:47 smithi188 bash[23329]: cluster 2020-07-16T16:13:45.581991+0000 mgr.x (mgr.34562) 7457 : cluster [DBG] pgmap v4652: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:13:47.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:13:47 smithi188 bash[23329]: audit 2020-07-16T16:13:46.699788+0000 mon.b (mon.2) 1592 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:13:47.782 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:13:47 smithi132 bash[27079]: cluster 2020-07-16T16:13:45.581991+0000 mgr.x (mgr.34562) 7457 : cluster [DBG] pgmap v4652: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:13:47.783 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:13:47 smithi132 bash[27079]: audit 2020-07-16T16:13:46.699788+0000 mon.b (mon.2) 1592 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:13:48.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:13:48 smithi188 bash[23329]: cephadm 2020-07-16T16:13:46.700444+0000 mgr.x (mgr.34562) 7458 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:13:48.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:13:48 smithi188 bash[23329]: cephadm 2020-07-16T16:13:46.700855+0000 mgr.x (mgr.34562) 7459 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:13:48.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:13:48 smithi132 bash[27079]: cephadm 2020-07-16T16:13:46.700444+0000 mgr.x (mgr.34562) 7458 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:13:48.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:13:48 smithi132 bash[27079]: cephadm 2020-07-16T16:13:46.700855+0000 mgr.x (mgr.34562) 7459 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:13:49.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:13:49 smithi188 bash[23329]: cluster 2020-07-16T16:13:47.582598+0000 mgr.x (mgr.34562) 7460 : cluster [DBG] pgmap v4653: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:13:49.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:13:49 smithi132 bash[27079]: cluster 2020-07-16T16:13:47.582598+0000 mgr.x (mgr.34562) 7460 : cluster [DBG] pgmap v4653: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:13:51.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:13:51 smithi188 bash[23329]: cluster 2020-07-16T16:13:49.582976+0000 mgr.x (mgr.34562) 7461 : cluster [DBG] pgmap v4654: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:13:51.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:13:51 smithi132 bash[27079]: cluster 2020-07-16T16:13:49.582976+0000 mgr.x (mgr.34562) 7461 : cluster [DBG] pgmap v4654: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:13:53.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:13:53 smithi188 bash[23329]: cluster 2020-07-16T16:13:51.583463+0000 mgr.x (mgr.34562) 7462 : cluster [DBG] pgmap v4655: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:13:53.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:13:53 smithi132 bash[27079]: cluster 2020-07-16T16:13:51.583463+0000 mgr.x (mgr.34562) 7462 : cluster [DBG] pgmap v4655: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:13:55.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:13:55 smithi188 bash[23329]: cluster 2020-07-16T16:13:53.584012+0000 mgr.x (mgr.34562) 7463 : cluster [DBG] pgmap v4656: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:13:55.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:13:55 smithi132 bash[27079]: cluster 2020-07-16T16:13:53.584012+0000 mgr.x (mgr.34562) 7463 : cluster [DBG] pgmap v4656: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:13:57.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:13:57 smithi188 bash[23329]: cluster 2020-07-16T16:13:55.584425+0000 mgr.x (mgr.34562) 7464 : cluster [DBG] pgmap v4657: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:13:57.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:13:57 smithi132 bash[27079]: cluster 2020-07-16T16:13:55.584425+0000 mgr.x (mgr.34562) 7464 : cluster [DBG] pgmap v4657: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:13:59.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:13:59 smithi188 bash[23329]: cluster 2020-07-16T16:13:57.584946+0000 mgr.x (mgr.34562) 7465 : cluster [DBG] pgmap v4658: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:13:59.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:13:59 smithi132 bash[27079]: cluster 2020-07-16T16:13:57.584946+0000 mgr.x (mgr.34562) 7465 : cluster [DBG] pgmap v4658: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:14:01.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:14:01 smithi188 bash[23329]: cluster 2020-07-16T16:13:59.585492+0000 mgr.x (mgr.34562) 7466 : cluster [DBG] pgmap v4659: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:14:01.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:14:01 smithi132 bash[27079]: cluster 2020-07-16T16:13:59.585492+0000 mgr.x (mgr.34562) 7466 : cluster [DBG] pgmap v4659: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:14:02.510 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:14:02 smithi132 bash[27079]: audit 2020-07-16T16:14:01.718871+0000 mon.b (mon.2) 1593 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:14:02.510 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:14:02 smithi132 bash[27079]: audit 2020-07-16T16:14:01.720228+0000 mon.b (mon.2) 1594 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:14:02.510 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:14:02 smithi132 bash[27079]: audit 2020-07-16T16:14:01.721413+0000 mon.b (mon.2) 1595 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:14:02.510 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:14:02 smithi132 bash[27079]: audit 2020-07-16T16:14:01.722840+0000 mon.b (mon.2) 1596 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:14:02.511 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:14:02 smithi132 bash[27079]: audit 2020-07-16T16:14:01.724231+0000 mon.b (mon.2) 1597 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:14:02.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:14:02 smithi188 bash[23329]: audit 2020-07-16T16:14:01.718871+0000 mon.b (mon.2) 1593 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:14:02.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:14:02 smithi188 bash[23329]: audit 2020-07-16T16:14:01.720228+0000 mon.b (mon.2) 1594 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:14:02.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:14:02 smithi188 bash[23329]: audit 2020-07-16T16:14:01.721413+0000 mon.b (mon.2) 1595 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:14:02.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:14:02 smithi188 bash[23329]: audit 2020-07-16T16:14:01.722840+0000 mon.b (mon.2) 1596 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:14:02.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:14:02 smithi188 bash[23329]: audit 2020-07-16T16:14:01.724231+0000 mon.b (mon.2) 1597 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:14:03.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:14:03 smithi188 bash[23329]: cluster 2020-07-16T16:14:01.585867+0000 mgr.x (mgr.34562) 7467 : cluster [DBG] pgmap v4660: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:14:03.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:14:03 smithi188 bash[23329]: audit 2020-07-16T16:14:01.719246+0000 mgr.x (mgr.34562) 7468 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:14:03.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:14:03 smithi188 bash[23329]: audit 2020-07-16T16:14:01.720579+0000 mgr.x (mgr.34562) 7469 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:14:03.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:14:03 smithi188 bash[23329]: audit 2020-07-16T16:14:01.721697+0000 mgr.x (mgr.34562) 7470 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:14:03.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:14:03 smithi188 bash[23329]: cephadm 2020-07-16T16:14:01.722451+0000 mgr.x (mgr.34562) 7471 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:14:03.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:14:03 smithi188 bash[23329]: cephadm 2020-07-16T16:14:01.723728+0000 mgr.x (mgr.34562) 7472 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:14:03.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:14:03 smithi188 bash[23329]: cephadm 2020-07-16T16:14:01.724949+0000 mgr.x (mgr.34562) 7473 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:14:03.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:14:03 smithi188 bash[23329]: cephadm 2020-07-16T16:14:01.725203+0000 mgr.x (mgr.34562) 7474 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:14:03.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:14:03 smithi132 bash[27079]: cluster 2020-07-16T16:14:01.585867+0000 mgr.x (mgr.34562) 7467 : cluster [DBG] pgmap v4660: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:14:03.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:14:03 smithi132 bash[27079]: audit 2020-07-16T16:14:01.719246+0000 mgr.x (mgr.34562) 7468 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:14:03.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:14:03 smithi132 bash[27079]: audit 2020-07-16T16:14:01.720579+0000 mgr.x (mgr.34562) 7469 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:14:03.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:14:03 smithi132 bash[27079]: audit 2020-07-16T16:14:01.721697+0000 mgr.x (mgr.34562) 7470 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:14:03.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:14:03 smithi132 bash[27079]: cephadm 2020-07-16T16:14:01.722451+0000 mgr.x (mgr.34562) 7471 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:14:03.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:14:03 smithi132 bash[27079]: cephadm 2020-07-16T16:14:01.723728+0000 mgr.x (mgr.34562) 7472 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:14:03.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:14:03 smithi132 bash[27079]: cephadm 2020-07-16T16:14:01.724949+0000 mgr.x (mgr.34562) 7473 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:14:03.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:14:03 smithi132 bash[27079]: cephadm 2020-07-16T16:14:01.725203+0000 mgr.x (mgr.34562) 7474 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:14:05.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:14:05 smithi188 bash[23329]: cluster 2020-07-16T16:14:03.586261+0000 mgr.x (mgr.34562) 7475 : cluster [DBG] pgmap v4661: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:14:05.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:14:05 smithi188 bash[23329]: audit 2020-07-16T16:14:04.399602+0000 mon.b (mon.2) 1598 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:14:05.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:14:05 smithi188 bash[23329]: cephadm 2020-07-16T16:14:04.400193+0000 mgr.x (mgr.34562) 7476 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:14:05.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:14:05 smithi188 bash[23329]: cephadm 2020-07-16T16:14:04.400592+0000 mgr.x (mgr.34562) 7477 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:14:05.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:14:05 smithi132 bash[27079]: cluster 2020-07-16T16:14:03.586261+0000 mgr.x (mgr.34562) 7475 : cluster [DBG] pgmap v4661: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:14:05.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:14:05 smithi132 bash[27079]: audit 2020-07-16T16:14:04.399602+0000 mon.b (mon.2) 1598 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:14:05.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:14:05 smithi132 bash[27079]: cephadm 2020-07-16T16:14:04.400193+0000 mgr.x (mgr.34562) 7476 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:14:05.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:14:05 smithi132 bash[27079]: cephadm 2020-07-16T16:14:04.400592+0000 mgr.x (mgr.34562) 7477 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:14:07.145 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:14:07.408 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:14:07.408 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 7m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:14:07.408 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 7m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:14:07.408 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 7m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:14:07.409 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 7m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:14:07.409 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 7m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:14:07.409 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:14:07.409 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:14:07.409 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 7m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:14:07.410 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 7m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:14:07.410 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:14:07.410 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:14:07.410 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:14:07.410 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:14:07.411 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:14:07.411 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:14:07.411 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:14:07.411 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:14:07.411 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 7m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:14:07.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:14:07 smithi188 bash[23329]: cluster 2020-07-16T16:14:05.586622+0000 mgr.x (mgr.34562) 7478 : cluster [DBG] pgmap v4662: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:14:07.708 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:14:07.708 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:14:07.708 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:14:07.709 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:14:07.709 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:14:07.709 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:14:07.709 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:14:07.709 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:14:07.710 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:14:07.710 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:14:07.710 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:14:07.710 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:14:07.710 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:14:07.711 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:14:07.711 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:14:07.711 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:14:07.711 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:14:07.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:14:07 smithi132 bash[27079]: cluster 2020-07-16T16:14:05.586622+0000 mgr.x (mgr.34562) 7478 : cluster [DBG] pgmap v4662: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:14:08.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:14:08 smithi188 bash[23329]: audit 2020-07-16T16:14:07.132981+0000 mgr.x (mgr.34562) 7479 : audit [DBG] from='client.30076 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:14:08.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:14:08 smithi188 bash[23329]: audit 2020-07-16T16:14:07.403732+0000 mgr.x (mgr.34562) 7480 : audit [DBG] from='client.30082 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:14:08.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:14:08 smithi188 bash[23329]: audit 2020-07-16T16:14:07.707334+0000 mon.c (mon.1) 503 : audit [DBG] from='client.? 172.21.15.132:0/2560590008' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:14:08.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:14:08 smithi132 bash[27079]: audit 2020-07-16T16:14:07.132981+0000 mgr.x (mgr.34562) 7479 : audit [DBG] from='client.30076 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:14:08.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:14:08 smithi132 bash[27079]: audit 2020-07-16T16:14:07.403732+0000 mgr.x (mgr.34562) 7480 : audit [DBG] from='client.30082 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:14:08.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:14:08 smithi132 bash[27079]: audit 2020-07-16T16:14:07.707334+0000 mon.c (mon.1) 503 : audit [DBG] from='client.? 172.21.15.132:0/2560590008' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:14:09.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:14:09 smithi188 bash[23329]: cluster 2020-07-16T16:14:07.587023+0000 mgr.x (mgr.34562) 7481 : cluster [DBG] pgmap v4663: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:14:09.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:14:09 smithi132 bash[27079]: cluster 2020-07-16T16:14:07.587023+0000 mgr.x (mgr.34562) 7481 : cluster [DBG] pgmap v4663: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:14:11.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:14:11 smithi188 bash[23329]: cluster 2020-07-16T16:14:09.587402+0000 mgr.x (mgr.34562) 7482 : cluster [DBG] pgmap v4664: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:14:11.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:14:11 smithi132 bash[27079]: cluster 2020-07-16T16:14:09.587402+0000 mgr.x (mgr.34562) 7482 : cluster [DBG] pgmap v4664: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:14:13.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:14:13 smithi188 bash[23329]: cluster 2020-07-16T16:14:11.587874+0000 mgr.x (mgr.34562) 7483 : cluster [DBG] pgmap v4665: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:14:13.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:14:13 smithi132 bash[27079]: cluster 2020-07-16T16:14:11.587874+0000 mgr.x (mgr.34562) 7483 : cluster [DBG] pgmap v4665: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:14:15.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:14:15 smithi188 bash[23329]: cluster 2020-07-16T16:14:13.588405+0000 mgr.x (mgr.34562) 7484 : cluster [DBG] pgmap v4666: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:14:15.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:14:15 smithi132 bash[27079]: cluster 2020-07-16T16:14:13.588405+0000 mgr.x (mgr.34562) 7484 : cluster [DBG] pgmap v4666: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:14:17.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:14:17 smithi188 bash[23329]: cluster 2020-07-16T16:14:15.588768+0000 mgr.x (mgr.34562) 7485 : cluster [DBG] pgmap v4667: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:14:17.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:14:17 smithi132 bash[27079]: cluster 2020-07-16T16:14:15.588768+0000 mgr.x (mgr.34562) 7485 : cluster [DBG] pgmap v4667: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:14:19.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:14:19 smithi188 bash[23329]: cluster 2020-07-16T16:14:17.589188+0000 mgr.x (mgr.34562) 7486 : cluster [DBG] pgmap v4668: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:14:19.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:14:19 smithi132 bash[27079]: cluster 2020-07-16T16:14:17.589188+0000 mgr.x (mgr.34562) 7486 : cluster [DBG] pgmap v4668: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:14:20.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:14:20 smithi188 bash[23329]: audit 2020-07-16T16:14:19.416227+0000 mon.b (mon.2) 1599 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:14:20.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:14:20 smithi188 bash[23329]: cephadm 2020-07-16T16:14:19.416937+0000 mgr.x (mgr.34562) 7487 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:14:20.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:14:20 smithi188 bash[23329]: cephadm 2020-07-16T16:14:19.417253+0000 mgr.x (mgr.34562) 7488 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:14:20.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:14:20 smithi132 bash[27079]: audit 2020-07-16T16:14:19.416227+0000 mon.b (mon.2) 1599 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:14:20.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:14:20 smithi132 bash[27079]: cephadm 2020-07-16T16:14:19.416937+0000 mgr.x (mgr.34562) 7487 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:14:20.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:14:20 smithi132 bash[27079]: cephadm 2020-07-16T16:14:19.417253+0000 mgr.x (mgr.34562) 7488 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:14:21.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:14:21 smithi188 bash[23329]: cluster 2020-07-16T16:14:19.589660+0000 mgr.x (mgr.34562) 7489 : cluster [DBG] pgmap v4669: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:14:21.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:14:21 smithi132 bash[27079]: cluster 2020-07-16T16:14:19.589660+0000 mgr.x (mgr.34562) 7489 : cluster [DBG] pgmap v4669: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:14:23.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:14:23 smithi188 bash[23329]: cluster 2020-07-16T16:14:21.590243+0000 mgr.x (mgr.34562) 7490 : cluster [DBG] pgmap v4670: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:14:23.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:14:23 smithi132 bash[27079]: cluster 2020-07-16T16:14:21.590243+0000 mgr.x (mgr.34562) 7490 : cluster [DBG] pgmap v4670: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:14:25.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:14:25 smithi188 bash[23329]: cluster 2020-07-16T16:14:23.590690+0000 mgr.x (mgr.34562) 7491 : cluster [DBG] pgmap v4671: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:14:25.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:14:25 smithi132 bash[27079]: cluster 2020-07-16T16:14:23.590690+0000 mgr.x (mgr.34562) 7491 : cluster [DBG] pgmap v4671: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:14:27.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:14:27 smithi132 bash[27079]: cluster 2020-07-16T16:14:25.591186+0000 mgr.x (mgr.34562) 7492 : cluster [DBG] pgmap v4672: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:14:27.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:14:27 smithi188 bash[23329]: cluster 2020-07-16T16:14:25.591186+0000 mgr.x (mgr.34562) 7492 : cluster [DBG] pgmap v4672: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:14:29.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:14:29 smithi132 bash[27079]: cluster 2020-07-16T16:14:27.591745+0000 mgr.x (mgr.34562) 7493 : cluster [DBG] pgmap v4673: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:14:29.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:14:29 smithi188 bash[23329]: cluster 2020-07-16T16:14:27.591745+0000 mgr.x (mgr.34562) 7493 : cluster [DBG] pgmap v4673: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:14:31.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:14:31 smithi132 bash[27079]: cluster 2020-07-16T16:14:29.592142+0000 mgr.x (mgr.34562) 7494 : cluster [DBG] pgmap v4674: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:14:31.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:14:31 smithi188 bash[23329]: cluster 2020-07-16T16:14:29.592142+0000 mgr.x (mgr.34562) 7494 : cluster [DBG] pgmap v4674: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:14:33.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:14:33 smithi132 bash[27079]: cluster 2020-07-16T16:14:31.592579+0000 mgr.x (mgr.34562) 7495 : cluster [DBG] pgmap v4675: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:14:33.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:14:33 smithi188 bash[23329]: cluster 2020-07-16T16:14:31.592579+0000 mgr.x (mgr.34562) 7495 : cluster [DBG] pgmap v4675: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:14:34.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:14:34 smithi132 bash[27079]: audit 2020-07-16T16:14:34.431079+0000 mon.b (mon.2) 1600 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:14:34.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:14:34 smithi188 bash[23329]: audit 2020-07-16T16:14:34.431079+0000 mon.b (mon.2) 1600 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:14:35.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:14:35 smithi132 bash[27079]: cluster 2020-07-16T16:14:33.592921+0000 mgr.x (mgr.34562) 7496 : cluster [DBG] pgmap v4676: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:14:35.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:14:35 smithi132 bash[27079]: cephadm 2020-07-16T16:14:34.431771+0000 mgr.x (mgr.34562) 7497 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:14:35.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:14:35 smithi132 bash[27079]: cephadm 2020-07-16T16:14:34.432174+0000 mgr.x (mgr.34562) 7498 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:14:35.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:14:35 smithi188 bash[23329]: cluster 2020-07-16T16:14:33.592921+0000 mgr.x (mgr.34562) 7496 : cluster [DBG] pgmap v4676: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:14:35.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:14:35 smithi188 bash[23329]: cephadm 2020-07-16T16:14:34.431771+0000 mgr.x (mgr.34562) 7497 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:14:35.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:14:35 smithi188 bash[23329]: cephadm 2020-07-16T16:14:34.432174+0000 mgr.x (mgr.34562) 7498 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:14:37.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:14:37 smithi132 bash[27079]: cluster 2020-07-16T16:14:35.593388+0000 mgr.x (mgr.34562) 7499 : cluster [DBG] pgmap v4677: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:14:37.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:14:37 smithi188 bash[23329]: cluster 2020-07-16T16:14:35.593388+0000 mgr.x (mgr.34562) 7499 : cluster [DBG] pgmap v4677: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:14:38.006 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:14:38.267 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:14:38.268 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 8m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:14:38.268 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 8m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:14:38.268 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 8m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:14:38.268 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 8m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:14:38.268 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 8m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:14:38.269 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:14:38.269 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:14:38.269 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 8m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:14:38.269 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 8m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:14:38.270 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:14:38.270 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:14:38.270 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:14:38.270 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:14:38.270 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:14:38.270 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:14:38.271 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:14:38.271 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:14:38.271 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 8m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:14:38.566 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:14:38.567 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:14:38.567 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:14:38.567 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:14:38.567 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:14:38.567 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:14:38.568 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:14:38.568 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:14:38.568 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:14:38.568 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:14:38.568 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:14:38.568 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:14:38.569 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:14:38.569 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:14:38.569 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:14:38.569 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:14:38.569 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:14:39.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:14:39 smithi132 bash[27079]: cluster 2020-07-16T16:14:37.593793+0000 mgr.x (mgr.34562) 7500 : cluster [DBG] pgmap v4678: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:14:39.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:14:39 smithi132 bash[27079]: audit 2020-07-16T16:14:37.994613+0000 mgr.x (mgr.34562) 7501 : audit [DBG] from='client.30094 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:14:39.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:14:39 smithi132 bash[27079]: audit 2020-07-16T16:14:38.263412+0000 mgr.x (mgr.34562) 7502 : audit [DBG] from='client.30100 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:14:39.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:14:39 smithi132 bash[27079]: audit 2020-07-16T16:14:38.565614+0000 mon.c (mon.1) 504 : audit [DBG] from='client.? 172.21.15.132:0/343103883' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:14:39.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:14:39 smithi188 bash[23329]: cluster 2020-07-16T16:14:37.593793+0000 mgr.x (mgr.34562) 7500 : cluster [DBG] pgmap v4678: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:14:39.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:14:39 smithi188 bash[23329]: audit 2020-07-16T16:14:37.994613+0000 mgr.x (mgr.34562) 7501 : audit [DBG] from='client.30094 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:14:39.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:14:39 smithi188 bash[23329]: audit 2020-07-16T16:14:38.263412+0000 mgr.x (mgr.34562) 7502 : audit [DBG] from='client.30100 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:14:39.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:14:39 smithi188 bash[23329]: audit 2020-07-16T16:14:38.565614+0000 mon.c (mon.1) 504 : audit [DBG] from='client.? 172.21.15.132:0/343103883' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:14:41.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:14:41 smithi132 bash[27079]: cluster 2020-07-16T16:14:39.594200+0000 mgr.x (mgr.34562) 7503 : cluster [DBG] pgmap v4679: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:14:41.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:14:41 smithi188 bash[23329]: cluster 2020-07-16T16:14:39.594200+0000 mgr.x (mgr.34562) 7503 : cluster [DBG] pgmap v4679: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:14:43.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:14:43 smithi132 bash[27079]: cluster 2020-07-16T16:14:41.594696+0000 mgr.x (mgr.34562) 7504 : cluster [DBG] pgmap v4680: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:14:43.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:14:43 smithi188 bash[23329]: cluster 2020-07-16T16:14:41.594696+0000 mgr.x (mgr.34562) 7504 : cluster [DBG] pgmap v4680: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:14:45.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:14:45 smithi132 bash[27079]: cluster 2020-07-16T16:14:43.595192+0000 mgr.x (mgr.34562) 7505 : cluster [DBG] pgmap v4681: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:14:45.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:14:45 smithi188 bash[23329]: cluster 2020-07-16T16:14:43.595192+0000 mgr.x (mgr.34562) 7505 : cluster [DBG] pgmap v4681: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:14:47.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:14:47 smithi132 bash[27079]: cluster 2020-07-16T16:14:45.595700+0000 mgr.x (mgr.34562) 7506 : cluster [DBG] pgmap v4682: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:14:47.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:14:47 smithi188 bash[23329]: cluster 2020-07-16T16:14:45.595700+0000 mgr.x (mgr.34562) 7506 : cluster [DBG] pgmap v4682: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:14:49.786 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:14:49 smithi132 bash[27079]: cluster 2020-07-16T16:14:47.596131+0000 mgr.x (mgr.34562) 7507 : cluster [DBG] pgmap v4683: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:14:49.787 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:14:49 smithi132 bash[27079]: audit 2020-07-16T16:14:49.447659+0000 mon.b (mon.2) 1601 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:14:49.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:14:49 smithi188 bash[23329]: cluster 2020-07-16T16:14:47.596131+0000 mgr.x (mgr.34562) 7507 : cluster [DBG] pgmap v4683: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:14:49.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:14:49 smithi188 bash[23329]: audit 2020-07-16T16:14:49.447659+0000 mon.b (mon.2) 1601 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:14:50.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:14:50 smithi132 bash[27079]: cephadm 2020-07-16T16:14:49.448429+0000 mgr.x (mgr.34562) 7508 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:14:50.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:14:50 smithi132 bash[27079]: cephadm 2020-07-16T16:14:49.448847+0000 mgr.x (mgr.34562) 7509 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:14:50.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:14:50 smithi188 bash[23329]: cephadm 2020-07-16T16:14:49.448429+0000 mgr.x (mgr.34562) 7508 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:14:50.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:14:50 smithi188 bash[23329]: cephadm 2020-07-16T16:14:49.448847+0000 mgr.x (mgr.34562) 7509 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:14:51.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:14:51 smithi132 bash[27079]: cluster 2020-07-16T16:14:49.596498+0000 mgr.x (mgr.34562) 7510 : cluster [DBG] pgmap v4684: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:14:51.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:14:51 smithi188 bash[23329]: cluster 2020-07-16T16:14:49.596498+0000 mgr.x (mgr.34562) 7510 : cluster [DBG] pgmap v4684: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:14:53.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:14:53 smithi132 bash[27079]: cluster 2020-07-16T16:14:51.596984+0000 mgr.x (mgr.34562) 7511 : cluster [DBG] pgmap v4685: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:14:53.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:14:53 smithi188 bash[23329]: cluster 2020-07-16T16:14:51.596984+0000 mgr.x (mgr.34562) 7511 : cluster [DBG] pgmap v4685: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:14:55.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:14:55 smithi132 bash[27079]: cluster 2020-07-16T16:14:53.597450+0000 mgr.x (mgr.34562) 7512 : cluster [DBG] pgmap v4686: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:14:55.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:14:55 smithi188 bash[23329]: cluster 2020-07-16T16:14:53.597450+0000 mgr.x (mgr.34562) 7512 : cluster [DBG] pgmap v4686: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:14:57.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:14:57 smithi132 bash[27079]: cluster 2020-07-16T16:14:55.597937+0000 mgr.x (mgr.34562) 7513 : cluster [DBG] pgmap v4687: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:14:57.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:14:57 smithi188 bash[23329]: cluster 2020-07-16T16:14:55.597937+0000 mgr.x (mgr.34562) 7513 : cluster [DBG] pgmap v4687: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:14:59.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:14:59 smithi132 bash[27079]: cluster 2020-07-16T16:14:57.598435+0000 mgr.x (mgr.34562) 7514 : cluster [DBG] pgmap v4688: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:14:59.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:14:59 smithi188 bash[23329]: cluster 2020-07-16T16:14:57.598435+0000 mgr.x (mgr.34562) 7514 : cluster [DBG] pgmap v4688: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:15:01.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:15:01 smithi132 bash[27079]: cluster 2020-07-16T16:14:59.598834+0000 mgr.x (mgr.34562) 7515 : cluster [DBG] pgmap v4689: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:15:01.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:15:01 smithi188 bash[23329]: cluster 2020-07-16T16:14:59.598834+0000 mgr.x (mgr.34562) 7515 : cluster [DBG] pgmap v4689: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:15:03.784 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:15:03 smithi132 bash[27079]: cluster 2020-07-16T16:15:01.599215+0000 mgr.x (mgr.34562) 7516 : cluster [DBG] pgmap v4690: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:15:03.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:15:03 smithi188 bash[23329]: cluster 2020-07-16T16:15:01.599215+0000 mgr.x (mgr.34562) 7516 : cluster [DBG] pgmap v4690: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:15:04.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:15:04 smithi132 bash[27079]: audit 2020-07-16T16:15:04.466783+0000 mon.b (mon.2) 1602 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:15:04.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:15:04 smithi132 bash[27079]: audit 2020-07-16T16:15:04.468169+0000 mon.b (mon.2) 1603 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:15:04.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:15:04 smithi132 bash[27079]: audit 2020-07-16T16:15:04.469383+0000 mon.b (mon.2) 1604 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:15:04.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:15:04 smithi132 bash[27079]: audit 2020-07-16T16:15:04.470828+0000 mon.b (mon.2) 1605 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:15:04.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:15:04 smithi132 bash[27079]: audit 2020-07-16T16:15:04.472019+0000 mon.b (mon.2) 1606 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:15:04.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:15:04 smithi188 bash[23329]: audit 2020-07-16T16:15:04.466783+0000 mon.b (mon.2) 1602 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:15:04.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:15:04 smithi188 bash[23329]: audit 2020-07-16T16:15:04.468169+0000 mon.b (mon.2) 1603 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:15:04.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:15:04 smithi188 bash[23329]: audit 2020-07-16T16:15:04.469383+0000 mon.b (mon.2) 1604 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:15:04.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:15:04 smithi188 bash[23329]: audit 2020-07-16T16:15:04.470828+0000 mon.b (mon.2) 1605 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:15:04.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:15:04 smithi188 bash[23329]: audit 2020-07-16T16:15:04.472019+0000 mon.b (mon.2) 1606 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:15:05.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:15:05 smithi132 bash[27079]: cluster 2020-07-16T16:15:03.599633+0000 mgr.x (mgr.34562) 7517 : cluster [DBG] pgmap v4691: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:15:05.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:15:05 smithi132 bash[27079]: audit 2020-07-16T16:15:04.467168+0000 mgr.x (mgr.34562) 7518 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:15:05.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:15:05 smithi132 bash[27079]: audit 2020-07-16T16:15:04.468520+0000 mgr.x (mgr.34562) 7519 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:15:05.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:15:05 smithi132 bash[27079]: audit 2020-07-16T16:15:04.469679+0000 mgr.x (mgr.34562) 7520 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:15:05.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:15:05 smithi132 bash[27079]: cephadm 2020-07-16T16:15:04.470489+0000 mgr.x (mgr.34562) 7521 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:15:05.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:15:05 smithi132 bash[27079]: cephadm 2020-07-16T16:15:04.471705+0000 mgr.x (mgr.34562) 7522 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:15:05.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:15:05 smithi132 bash[27079]: cephadm 2020-07-16T16:15:04.472817+0000 mgr.x (mgr.34562) 7523 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:15:05.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:15:05 smithi132 bash[27079]: cephadm 2020-07-16T16:15:04.472926+0000 mgr.x (mgr.34562) 7524 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:15:05.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:15:05 smithi188 bash[23329]: cluster 2020-07-16T16:15:03.599633+0000 mgr.x (mgr.34562) 7517 : cluster [DBG] pgmap v4691: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:15:05.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:15:05 smithi188 bash[23329]: audit 2020-07-16T16:15:04.467168+0000 mgr.x (mgr.34562) 7518 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:15:05.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:15:05 smithi188 bash[23329]: audit 2020-07-16T16:15:04.468520+0000 mgr.x (mgr.34562) 7519 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:15:05.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:15:05 smithi188 bash[23329]: audit 2020-07-16T16:15:04.469679+0000 mgr.x (mgr.34562) 7520 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:15:05.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:15:05 smithi188 bash[23329]: cephadm 2020-07-16T16:15:04.470489+0000 mgr.x (mgr.34562) 7521 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:15:05.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:15:05 smithi188 bash[23329]: cephadm 2020-07-16T16:15:04.471705+0000 mgr.x (mgr.34562) 7522 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:15:05.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:15:05 smithi188 bash[23329]: cephadm 2020-07-16T16:15:04.472817+0000 mgr.x (mgr.34562) 7523 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:15:05.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:15:05 smithi188 bash[23329]: cephadm 2020-07-16T16:15:04.472926+0000 mgr.x (mgr.34562) 7524 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:15:07.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:15:07 smithi132 bash[27079]: cluster 2020-07-16T16:15:05.600191+0000 mgr.x (mgr.34562) 7525 : cluster [DBG] pgmap v4692: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:15:07.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:15:07 smithi188 bash[23329]: cluster 2020-07-16T16:15:05.600191+0000 mgr.x (mgr.34562) 7525 : cluster [DBG] pgmap v4692: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:15:08.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:15:08 smithi188 bash[23329]: audit 2020-07-16T16:15:07.387116+0000 mon.b (mon.2) 1607 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:15:08.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:15:08 smithi188 bash[23329]: cephadm 2020-07-16T16:15:07.387726+0000 mgr.x (mgr.34562) 7526 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:15:08.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:15:08 smithi188 bash[23329]: cephadm 2020-07-16T16:15:07.387956+0000 mgr.x (mgr.34562) 7527 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:15:08.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:15:08 smithi132 bash[27079]: audit 2020-07-16T16:15:07.387116+0000 mon.b (mon.2) 1607 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:15:08.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:15:08 smithi132 bash[27079]: cephadm 2020-07-16T16:15:07.387726+0000 mgr.x (mgr.34562) 7526 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:15:08.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:15:08 smithi132 bash[27079]: cephadm 2020-07-16T16:15:07.387956+0000 mgr.x (mgr.34562) 7527 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:15:08.866 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:15:09.128 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:15:09.128 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 8m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:15:09.128 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 8m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:15:09.128 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 8m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:15:09.129 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 8m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:15:09.129 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 8m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:15:09.129 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:15:09.129 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:15:09.130 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 8m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:15:09.130 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 8m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:15:09.130 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:15:09.130 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:15:09.130 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:15:09.131 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:15:09.131 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:15:09.131 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:15:09.131 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:15:09.131 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:15:09.132 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 8m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:15:09.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:15:09 smithi188 bash[23329]: cluster 2020-07-16T16:15:07.600645+0000 mgr.x (mgr.34562) 7528 : cluster [DBG] pgmap v4693: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:15:09.430 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:15:09.431 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:15:09.432 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:15:09.432 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:15:09.432 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:15:09.432 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:15:09.432 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:15:09.433 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:15:09.433 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:15:09.433 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:15:09.433 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:15:09.434 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:15:09.434 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:15:09.434 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:15:09.434 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:15:09.435 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:15:09.435 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:15:09.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:15:09 smithi132 bash[27079]: cluster 2020-07-16T16:15:07.600645+0000 mgr.x (mgr.34562) 7528 : cluster [DBG] pgmap v4693: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:15:10.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:15:10 smithi188 bash[23329]: audit 2020-07-16T16:15:08.854317+0000 mgr.x (mgr.34562) 7529 : audit [DBG] from='client.30112 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:15:10.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:15:10 smithi188 bash[23329]: audit 2020-07-16T16:15:09.123804+0000 mgr.x (mgr.34562) 7530 : audit [DBG] from='client.30118 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:15:10.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:15:10 smithi188 bash[23329]: audit 2020-07-16T16:15:09.424686+0000 mon.c (mon.1) 505 : audit [DBG] from='client.? 172.21.15.132:0/3215675043' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:15:10.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:15:10 smithi132 bash[27079]: audit 2020-07-16T16:15:08.854317+0000 mgr.x (mgr.34562) 7529 : audit [DBG] from='client.30112 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:15:10.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:15:10 smithi132 bash[27079]: audit 2020-07-16T16:15:09.123804+0000 mgr.x (mgr.34562) 7530 : audit [DBG] from='client.30118 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:15:10.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:15:10 smithi132 bash[27079]: audit 2020-07-16T16:15:09.424686+0000 mon.c (mon.1) 505 : audit [DBG] from='client.? 172.21.15.132:0/3215675043' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:15:11.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:15:11 smithi188 bash[23329]: cluster 2020-07-16T16:15:09.601132+0000 mgr.x (mgr.34562) 7531 : cluster [DBG] pgmap v4694: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:15:11.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:15:11 smithi132 bash[27079]: cluster 2020-07-16T16:15:09.601132+0000 mgr.x (mgr.34562) 7531 : cluster [DBG] pgmap v4694: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:15:13.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:15:13 smithi188 bash[23329]: cluster 2020-07-16T16:15:11.601690+0000 mgr.x (mgr.34562) 7532 : cluster [DBG] pgmap v4695: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:15:13.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:15:13 smithi132 bash[27079]: cluster 2020-07-16T16:15:11.601690+0000 mgr.x (mgr.34562) 7532 : cluster [DBG] pgmap v4695: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:15:15.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:15:15 smithi188 bash[23329]: cluster 2020-07-16T16:15:13.602243+0000 mgr.x (mgr.34562) 7533 : cluster [DBG] pgmap v4696: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:15:15.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:15:15 smithi132 bash[27079]: cluster 2020-07-16T16:15:13.602243+0000 mgr.x (mgr.34562) 7533 : cluster [DBG] pgmap v4696: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:15:17.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:15:17 smithi188 bash[23329]: cluster 2020-07-16T16:15:15.602767+0000 mgr.x (mgr.34562) 7534 : cluster [DBG] pgmap v4697: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:15:17.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:15:17 smithi132 bash[27079]: cluster 2020-07-16T16:15:15.602767+0000 mgr.x (mgr.34562) 7534 : cluster [DBG] pgmap v4697: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:15:19.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:15:19 smithi188 bash[23329]: cluster 2020-07-16T16:15:17.603414+0000 mgr.x (mgr.34562) 7535 : cluster [DBG] pgmap v4698: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:15:19.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:15:19 smithi132 bash[27079]: cluster 2020-07-16T16:15:17.603414+0000 mgr.x (mgr.34562) 7535 : cluster [DBG] pgmap v4698: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:15:21.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:15:21 smithi188 bash[23329]: cluster 2020-07-16T16:15:19.603984+0000 mgr.x (mgr.34562) 7536 : cluster [DBG] pgmap v4699: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:15:21.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:15:21 smithi132 bash[27079]: cluster 2020-07-16T16:15:19.603984+0000 mgr.x (mgr.34562) 7536 : cluster [DBG] pgmap v4699: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:15:23.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:15:23 smithi188 bash[23329]: cluster 2020-07-16T16:15:21.604419+0000 mgr.x (mgr.34562) 7537 : cluster [DBG] pgmap v4700: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:15:23.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:15:23 smithi188 bash[23329]: audit 2020-07-16T16:15:22.403616+0000 mon.b (mon.2) 1608 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:15:23.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:15:23 smithi188 bash[23329]: cephadm 2020-07-16T16:15:22.404319+0000 mgr.x (mgr.34562) 7538 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:15:23.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:15:23 smithi188 bash[23329]: cephadm 2020-07-16T16:15:22.404461+0000 mgr.x (mgr.34562) 7539 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:15:23.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:15:23 smithi132 bash[27079]: cluster 2020-07-16T16:15:21.604419+0000 mgr.x (mgr.34562) 7537 : cluster [DBG] pgmap v4700: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:15:23.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:15:23 smithi132 bash[27079]: audit 2020-07-16T16:15:22.403616+0000 mon.b (mon.2) 1608 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:15:23.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:15:23 smithi132 bash[27079]: cephadm 2020-07-16T16:15:22.404319+0000 mgr.x (mgr.34562) 7538 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:15:23.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:15:23 smithi132 bash[27079]: cephadm 2020-07-16T16:15:22.404461+0000 mgr.x (mgr.34562) 7539 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:15:25.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:15:25 smithi188 bash[23329]: cluster 2020-07-16T16:15:23.604760+0000 mgr.x (mgr.34562) 7540 : cluster [DBG] pgmap v4701: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:15:25.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:15:25 smithi132 bash[27079]: cluster 2020-07-16T16:15:23.604760+0000 mgr.x (mgr.34562) 7540 : cluster [DBG] pgmap v4701: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:15:27.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:15:27 smithi188 bash[23329]: cluster 2020-07-16T16:15:25.605114+0000 mgr.x (mgr.34562) 7541 : cluster [DBG] pgmap v4702: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:15:27.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:15:27 smithi132 bash[27079]: cluster 2020-07-16T16:15:25.605114+0000 mgr.x (mgr.34562) 7541 : cluster [DBG] pgmap v4702: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:15:29.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:15:29 smithi188 bash[23329]: cluster 2020-07-16T16:15:27.605535+0000 mgr.x (mgr.34562) 7542 : cluster [DBG] pgmap v4703: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:15:29.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:15:29 smithi132 bash[27079]: cluster 2020-07-16T16:15:27.605535+0000 mgr.x (mgr.34562) 7542 : cluster [DBG] pgmap v4703: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:15:31.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:15:31 smithi188 bash[23329]: cluster 2020-07-16T16:15:29.605821+0000 mgr.x (mgr.34562) 7543 : cluster [DBG] pgmap v4704: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:15:31.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:15:31 smithi132 bash[27079]: cluster 2020-07-16T16:15:29.605821+0000 mgr.x (mgr.34562) 7543 : cluster [DBG] pgmap v4704: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:15:33.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:15:33 smithi188 bash[23329]: cluster 2020-07-16T16:15:31.606345+0000 mgr.x (mgr.34562) 7544 : cluster [DBG] pgmap v4705: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:15:33.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:15:33 smithi132 bash[27079]: cluster 2020-07-16T16:15:31.606345+0000 mgr.x (mgr.34562) 7544 : cluster [DBG] pgmap v4705: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:15:35.425 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:15:35 smithi188 bash[23329]: cluster 2020-07-16T16:15:33.606858+0000 mgr.x (mgr.34562) 7545 : cluster [DBG] pgmap v4706: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:15:35.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:15:35 smithi132 bash[27079]: cluster 2020-07-16T16:15:33.606858+0000 mgr.x (mgr.34562) 7545 : cluster [DBG] pgmap v4706: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:15:37.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:15:37 smithi188 bash[23329]: cluster 2020-07-16T16:15:35.607223+0000 mgr.x (mgr.34562) 7546 : cluster [DBG] pgmap v4707: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:15:37.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:15:37 smithi132 bash[27079]: cluster 2020-07-16T16:15:35.607223+0000 mgr.x (mgr.34562) 7546 : cluster [DBG] pgmap v4707: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:15:38.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:15:38 smithi188 bash[23329]: audit 2020-07-16T16:15:37.420406+0000 mon.b (mon.2) 1609 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:15:38.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:15:38 smithi188 bash[23329]: cephadm 2020-07-16T16:15:37.421117+0000 mgr.x (mgr.34562) 7547 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:15:38.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:15:38 smithi188 bash[23329]: cephadm 2020-07-16T16:15:37.421355+0000 mgr.x (mgr.34562) 7548 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:15:38.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:15:38 smithi132 bash[27079]: audit 2020-07-16T16:15:37.420406+0000 mon.b (mon.2) 1609 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:15:38.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:15:38 smithi132 bash[27079]: cephadm 2020-07-16T16:15:37.421117+0000 mgr.x (mgr.34562) 7547 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:15:38.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:15:38 smithi132 bash[27079]: cephadm 2020-07-16T16:15:37.421355+0000 mgr.x (mgr.34562) 7548 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:15:39.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:15:39 smithi188 bash[23329]: cluster 2020-07-16T16:15:37.607618+0000 mgr.x (mgr.34562) 7549 : cluster [DBG] pgmap v4708: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:15:39.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:15:39 smithi132 bash[27079]: cluster 2020-07-16T16:15:37.607618+0000 mgr.x (mgr.34562) 7549 : cluster [DBG] pgmap v4708: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:15:39.725 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:15:39.985 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:15:39.986 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 9m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:15:39.986 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 9m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:15:39.986 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 9m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:15:39.986 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 9m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:15:39.987 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 9m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:15:39.987 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:15:39.987 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:15:39.987 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 9m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:15:39.987 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 9m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:15:39.988 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:15:39.988 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:15:39.988 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:15:39.988 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:15:39.988 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:15:39.989 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:15:39.989 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:15:39.989 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:15:39.989 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 9m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:15:40.283 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:15:40.284 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:15:40.284 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:15:40.284 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:15:40.284 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:15:40.284 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:15:40.285 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:15:40.285 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:15:40.285 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:15:40.285 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:15:40.285 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:15:40.286 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:15:40.286 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:15:40.286 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:15:40.286 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:15:40.286 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:15:40.287 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:15:41.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:15:41 smithi188 bash[23329]: cluster 2020-07-16T16:15:39.607993+0000 mgr.x (mgr.34562) 7550 : cluster [DBG] pgmap v4709: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:15:41.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:15:41 smithi188 bash[23329]: audit 2020-07-16T16:15:39.714113+0000 mgr.x (mgr.34562) 7551 : audit [DBG] from='client.30130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:15:41.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:15:41 smithi188 bash[23329]: audit 2020-07-16T16:15:39.981506+0000 mgr.x (mgr.34562) 7552 : audit [DBG] from='client.30136 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:15:41.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:15:41 smithi188 bash[23329]: audit 2020-07-16T16:15:40.282379+0000 mon.c (mon.1) 506 : audit [DBG] from='client.? 172.21.15.132:0/2781767025' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:15:41.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:15:41 smithi132 bash[27079]: cluster 2020-07-16T16:15:39.607993+0000 mgr.x (mgr.34562) 7550 : cluster [DBG] pgmap v4709: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:15:41.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:15:41 smithi132 bash[27079]: audit 2020-07-16T16:15:39.714113+0000 mgr.x (mgr.34562) 7551 : audit [DBG] from='client.30130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:15:41.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:15:41 smithi132 bash[27079]: audit 2020-07-16T16:15:39.981506+0000 mgr.x (mgr.34562) 7552 : audit [DBG] from='client.30136 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:15:41.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:15:41 smithi132 bash[27079]: audit 2020-07-16T16:15:40.282379+0000 mon.c (mon.1) 506 : audit [DBG] from='client.? 172.21.15.132:0/2781767025' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:15:43.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:15:43 smithi188 bash[23329]: cluster 2020-07-16T16:15:41.608340+0000 mgr.x (mgr.34562) 7553 : cluster [DBG] pgmap v4710: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:15:43.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:15:43 smithi132 bash[27079]: cluster 2020-07-16T16:15:41.608340+0000 mgr.x (mgr.34562) 7553 : cluster [DBG] pgmap v4710: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:15:45.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:15:45 smithi188 bash[23329]: cluster 2020-07-16T16:15:43.608730+0000 mgr.x (mgr.34562) 7554 : cluster [DBG] pgmap v4711: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:15:45.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:15:45 smithi132 bash[27079]: cluster 2020-07-16T16:15:43.608730+0000 mgr.x (mgr.34562) 7554 : cluster [DBG] pgmap v4711: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:15:47.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:15:47 smithi188 bash[23329]: cluster 2020-07-16T16:15:45.609135+0000 mgr.x (mgr.34562) 7555 : cluster [DBG] pgmap v4712: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:15:47.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:15:47 smithi132 bash[27079]: cluster 2020-07-16T16:15:45.609135+0000 mgr.x (mgr.34562) 7555 : cluster [DBG] pgmap v4712: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:15:49.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:15:49 smithi188 bash[23329]: cluster 2020-07-16T16:15:47.609635+0000 mgr.x (mgr.34562) 7556 : cluster [DBG] pgmap v4713: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:15:49.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:15:49 smithi132 bash[27079]: cluster 2020-07-16T16:15:47.609635+0000 mgr.x (mgr.34562) 7556 : cluster [DBG] pgmap v4713: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:15:51.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:15:51 smithi188 bash[23329]: cluster 2020-07-16T16:15:49.609977+0000 mgr.x (mgr.34562) 7557 : cluster [DBG] pgmap v4714: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:15:51.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:15:51 smithi132 bash[27079]: cluster 2020-07-16T16:15:49.609977+0000 mgr.x (mgr.34562) 7557 : cluster [DBG] pgmap v4714: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:15:53.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:15:53 smithi188 bash[23329]: cluster 2020-07-16T16:15:51.610330+0000 mgr.x (mgr.34562) 7558 : cluster [DBG] pgmap v4715: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:15:53.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:15:53 smithi188 bash[23329]: audit 2020-07-16T16:15:52.437022+0000 mon.b (mon.2) 1610 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:15:53.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:15:53 smithi188 bash[23329]: cephadm 2020-07-16T16:15:52.437789+0000 mgr.x (mgr.34562) 7559 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:15:53.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:15:53 smithi188 bash[23329]: cephadm 2020-07-16T16:15:52.437974+0000 mgr.x (mgr.34562) 7560 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:15:53.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:15:53 smithi132 bash[27079]: cluster 2020-07-16T16:15:51.610330+0000 mgr.x (mgr.34562) 7558 : cluster [DBG] pgmap v4715: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:15:53.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:15:53 smithi132 bash[27079]: audit 2020-07-16T16:15:52.437022+0000 mon.b (mon.2) 1610 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:15:53.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:15:53 smithi132 bash[27079]: cephadm 2020-07-16T16:15:52.437789+0000 mgr.x (mgr.34562) 7559 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:15:53.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:15:53 smithi132 bash[27079]: cephadm 2020-07-16T16:15:52.437974+0000 mgr.x (mgr.34562) 7560 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:15:55.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:15:55 smithi188 bash[23329]: cluster 2020-07-16T16:15:53.610698+0000 mgr.x (mgr.34562) 7561 : cluster [DBG] pgmap v4716: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:15:55.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:15:55 smithi132 bash[27079]: cluster 2020-07-16T16:15:53.610698+0000 mgr.x (mgr.34562) 7561 : cluster [DBG] pgmap v4716: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:15:57.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:15:57 smithi188 bash[23329]: cluster 2020-07-16T16:15:55.611142+0000 mgr.x (mgr.34562) 7562 : cluster [DBG] pgmap v4717: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:15:57.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:15:57 smithi132 bash[27079]: cluster 2020-07-16T16:15:55.611142+0000 mgr.x (mgr.34562) 7562 : cluster [DBG] pgmap v4717: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:15:59.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:15:59 smithi188 bash[23329]: cluster 2020-07-16T16:15:57.611668+0000 mgr.x (mgr.34562) 7563 : cluster [DBG] pgmap v4718: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:15:59.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:15:59 smithi132 bash[27079]: cluster 2020-07-16T16:15:57.611668+0000 mgr.x (mgr.34562) 7563 : cluster [DBG] pgmap v4718: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:16:01.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:16:01 smithi188 bash[23329]: cluster 2020-07-16T16:15:59.612078+0000 mgr.x (mgr.34562) 7564 : cluster [DBG] pgmap v4719: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:16:01.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:16:01 smithi132 bash[27079]: cluster 2020-07-16T16:15:59.612078+0000 mgr.x (mgr.34562) 7564 : cluster [DBG] pgmap v4719: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:16:03.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:16:03 smithi188 bash[23329]: cluster 2020-07-16T16:16:01.612484+0000 mgr.x (mgr.34562) 7565 : cluster [DBG] pgmap v4720: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:16:03.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:16:03 smithi132 bash[27079]: cluster 2020-07-16T16:16:01.612484+0000 mgr.x (mgr.34562) 7565 : cluster [DBG] pgmap v4720: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:16:05.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:16:05 smithi188 bash[23329]: cluster 2020-07-16T16:16:03.612998+0000 mgr.x (mgr.34562) 7566 : cluster [DBG] pgmap v4721: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:16:05.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:16:05 smithi132 bash[27079]: cluster 2020-07-16T16:16:03.612998+0000 mgr.x (mgr.34562) 7566 : cluster [DBG] pgmap v4721: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:16:07.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:16:07 smithi188 bash[23329]: cluster 2020-07-16T16:16:05.613502+0000 mgr.x (mgr.34562) 7567 : cluster [DBG] pgmap v4722: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:16:07.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:16:07 smithi132 bash[27079]: cluster 2020-07-16T16:16:05.613502+0000 mgr.x (mgr.34562) 7567 : cluster [DBG] pgmap v4722: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:16:08.274 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:16:08 smithi132 bash[27079]: audit 2020-07-16T16:16:07.456166+0000 mon.b (mon.2) 1611 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:16:08.274 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:16:08 smithi132 bash[27079]: audit 2020-07-16T16:16:07.456556+0000 mgr.x (mgr.34562) 7568 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:16:08.275 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:16:08 smithi132 bash[27079]: audit 2020-07-16T16:16:07.457618+0000 mon.b (mon.2) 1612 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:16:08.275 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:16:08 smithi132 bash[27079]: audit 2020-07-16T16:16:07.457947+0000 mgr.x (mgr.34562) 7569 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:16:08.275 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:16:08 smithi132 bash[27079]: audit 2020-07-16T16:16:07.458780+0000 mon.b (mon.2) 1613 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:16:08.276 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:16:08 smithi132 bash[27079]: audit 2020-07-16T16:16:07.459069+0000 mgr.x (mgr.34562) 7570 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:16:08.276 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:16:08 smithi132 bash[27079]: cephadm 2020-07-16T16:16:07.459793+0000 mgr.x (mgr.34562) 7571 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:16:08.276 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:16:08 smithi132 bash[27079]: audit 2020-07-16T16:16:07.460186+0000 mon.b (mon.2) 1614 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:16:08.276 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:16:08 smithi132 bash[27079]: cephadm 2020-07-16T16:16:07.461061+0000 mgr.x (mgr.34562) 7572 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:16:08.277 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:16:08 smithi132 bash[27079]: audit 2020-07-16T16:16:07.461429+0000 mon.b (mon.2) 1615 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:16:08.277 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:16:08 smithi132 bash[27079]: cephadm 2020-07-16T16:16:07.462129+0000 mgr.x (mgr.34562) 7573 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:16:08.277 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:16:08 smithi132 bash[27079]: cephadm 2020-07-16T16:16:07.462443+0000 mgr.x (mgr.34562) 7574 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:16:08.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:16:08 smithi188 bash[23329]: audit 2020-07-16T16:16:07.456166+0000 mon.b (mon.2) 1611 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:16:08.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:16:08 smithi188 bash[23329]: audit 2020-07-16T16:16:07.456556+0000 mgr.x (mgr.34562) 7568 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:16:08.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:16:08 smithi188 bash[23329]: audit 2020-07-16T16:16:07.457618+0000 mon.b (mon.2) 1612 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:16:08.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:16:08 smithi188 bash[23329]: audit 2020-07-16T16:16:07.457947+0000 mgr.x (mgr.34562) 7569 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:16:08.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:16:08 smithi188 bash[23329]: audit 2020-07-16T16:16:07.458780+0000 mon.b (mon.2) 1613 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:16:08.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:16:08 smithi188 bash[23329]: audit 2020-07-16T16:16:07.459069+0000 mgr.x (mgr.34562) 7570 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:16:08.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:16:08 smithi188 bash[23329]: cephadm 2020-07-16T16:16:07.459793+0000 mgr.x (mgr.34562) 7571 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:16:08.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:16:08 smithi188 bash[23329]: audit 2020-07-16T16:16:07.460186+0000 mon.b (mon.2) 1614 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:16:08.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:16:08 smithi188 bash[23329]: cephadm 2020-07-16T16:16:07.461061+0000 mgr.x (mgr.34562) 7572 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:16:08.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:16:08 smithi188 bash[23329]: audit 2020-07-16T16:16:07.461429+0000 mon.b (mon.2) 1615 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:16:08.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:16:08 smithi188 bash[23329]: cephadm 2020-07-16T16:16:07.462129+0000 mgr.x (mgr.34562) 7573 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:16:08.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:16:08 smithi188 bash[23329]: cephadm 2020-07-16T16:16:07.462443+0000 mgr.x (mgr.34562) 7574 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:16:09.278 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:16:09 smithi132 bash[27079]: cluster 2020-07-16T16:16:07.614036+0000 mgr.x (mgr.34562) 7575 : cluster [DBG] pgmap v4723: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:16:09.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:16:09 smithi188 bash[23329]: cluster 2020-07-16T16:16:07.614036+0000 mgr.x (mgr.34562) 7575 : cluster [DBG] pgmap v4723: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:16:10.574 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:16:10.833 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:16:10.834 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 9m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:16:10.834 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 9m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:16:10.834 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 9m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:16:10.834 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 9m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:16:10.835 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 9m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:16:10.835 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:16:10.835 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:16:10.835 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 9m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:16:10.835 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 9m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:16:10.836 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:16:10.836 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:16:10.836 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:16:10.836 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:16:10.836 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:16:10.837 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:16:10.837 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:16:10.837 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:16:10.837 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 9m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:16:11.135 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:16:11.136 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:16:11.136 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:16:11.136 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:16:11.136 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:16:11.136 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:16:11.137 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:16:11.137 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:16:11.137 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:16:11.137 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:16:11.138 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:16:11.138 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:16:11.138 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:16:11.138 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:16:11.138 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:16:11.139 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:16:11.139 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:16:11.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:16:11 smithi188 bash[23329]: cluster 2020-07-16T16:16:09.614535+0000 mgr.x (mgr.34562) 7576 : cluster [DBG] pgmap v4724: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:16:11.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:16:11 smithi188 bash[23329]: audit 2020-07-16T16:16:10.431056+0000 mon.b (mon.2) 1616 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:16:11.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:16:11 smithi188 bash[23329]: cephadm 2020-07-16T16:16:10.431696+0000 mgr.x (mgr.34562) 7577 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:16:11.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:16:11 smithi188 bash[23329]: cephadm 2020-07-16T16:16:10.432037+0000 mgr.x (mgr.34562) 7578 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:16:11.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:16:11 smithi188 bash[23329]: audit 2020-07-16T16:16:11.134676+0000 mon.c (mon.1) 507 : audit [DBG] from='client.? 172.21.15.132:0/2091844461' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:16:11.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:16:11 smithi132 bash[27079]: cluster 2020-07-16T16:16:09.614535+0000 mgr.x (mgr.34562) 7576 : cluster [DBG] pgmap v4724: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:16:11.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:16:11 smithi132 bash[27079]: audit 2020-07-16T16:16:10.431056+0000 mon.b (mon.2) 1616 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:16:11.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:16:11 smithi132 bash[27079]: cephadm 2020-07-16T16:16:10.431696+0000 mgr.x (mgr.34562) 7577 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:16:11.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:16:11 smithi132 bash[27079]: cephadm 2020-07-16T16:16:10.432037+0000 mgr.x (mgr.34562) 7578 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:16:11.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:16:11 smithi132 bash[27079]: audit 2020-07-16T16:16:11.134676+0000 mon.c (mon.1) 507 : audit [DBG] from='client.? 172.21.15.132:0/2091844461' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:16:12.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:16:12 smithi132 bash[27079]: audit 2020-07-16T16:16:10.562791+0000 mgr.x (mgr.34562) 7579 : audit [DBG] from='client.30148 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:16:12.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:16:12 smithi132 bash[27079]: audit 2020-07-16T16:16:10.829642+0000 mgr.x (mgr.34562) 7580 : audit [DBG] from='client.30154 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:16:12.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:16:12 smithi188 bash[23329]: audit 2020-07-16T16:16:10.562791+0000 mgr.x (mgr.34562) 7579 : audit [DBG] from='client.30148 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:16:12.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:16:12 smithi188 bash[23329]: audit 2020-07-16T16:16:10.829642+0000 mgr.x (mgr.34562) 7580 : audit [DBG] from='client.30154 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:16:13.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:16:13 smithi132 bash[27079]: cluster 2020-07-16T16:16:11.614961+0000 mgr.x (mgr.34562) 7581 : cluster [DBG] pgmap v4725: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:16:13.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:16:13 smithi188 bash[23329]: cluster 2020-07-16T16:16:11.614961+0000 mgr.x (mgr.34562) 7581 : cluster [DBG] pgmap v4725: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:16:15.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:16:15 smithi132 bash[27079]: cluster 2020-07-16T16:16:13.615445+0000 mgr.x (mgr.34562) 7582 : cluster [DBG] pgmap v4726: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:16:15.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:16:15 smithi188 bash[23329]: cluster 2020-07-16T16:16:13.615445+0000 mgr.x (mgr.34562) 7582 : cluster [DBG] pgmap v4726: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:16:17.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:16:17 smithi132 bash[27079]: cluster 2020-07-16T16:16:15.615894+0000 mgr.x (mgr.34562) 7583 : cluster [DBG] pgmap v4727: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:16:17.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:16:17 smithi188 bash[23329]: cluster 2020-07-16T16:16:15.615894+0000 mgr.x (mgr.34562) 7583 : cluster [DBG] pgmap v4727: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:16:19.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:16:19 smithi132 bash[27079]: cluster 2020-07-16T16:16:17.616363+0000 mgr.x (mgr.34562) 7584 : cluster [DBG] pgmap v4728: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:16:19.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:16:19 smithi188 bash[23329]: cluster 2020-07-16T16:16:17.616363+0000 mgr.x (mgr.34562) 7584 : cluster [DBG] pgmap v4728: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:16:21.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:16:21 smithi132 bash[27079]: cluster 2020-07-16T16:16:19.616756+0000 mgr.x (mgr.34562) 7585 : cluster [DBG] pgmap v4729: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:16:21.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:16:21 smithi188 bash[23329]: cluster 2020-07-16T16:16:19.616756+0000 mgr.x (mgr.34562) 7585 : cluster [DBG] pgmap v4729: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:16:23.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:16:23 smithi132 bash[27079]: cluster 2020-07-16T16:16:21.617118+0000 mgr.x (mgr.34562) 7586 : cluster [DBG] pgmap v4730: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:16:23.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:16:23 smithi188 bash[23329]: cluster 2020-07-16T16:16:21.617118+0000 mgr.x (mgr.34562) 7586 : cluster [DBG] pgmap v4730: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:16:25.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:16:25 smithi132 bash[27079]: cluster 2020-07-16T16:16:23.617676+0000 mgr.x (mgr.34562) 7587 : cluster [DBG] pgmap v4731: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:16:25.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:16:25 smithi188 bash[23329]: cluster 2020-07-16T16:16:23.617676+0000 mgr.x (mgr.34562) 7587 : cluster [DBG] pgmap v4731: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:16:26.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:16:26 smithi132 bash[27079]: audit 2020-07-16T16:16:25.447651+0000 mon.b (mon.2) 1617 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:16:26.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:16:26 smithi132 bash[27079]: cephadm 2020-07-16T16:16:25.448405+0000 mgr.x (mgr.34562) 7588 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:16:26.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:16:26 smithi132 bash[27079]: cephadm 2020-07-16T16:16:25.448656+0000 mgr.x (mgr.34562) 7589 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:16:26.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:16:26 smithi188 bash[23329]: audit 2020-07-16T16:16:25.447651+0000 mon.b (mon.2) 1617 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:16:26.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:16:26 smithi188 bash[23329]: cephadm 2020-07-16T16:16:25.448405+0000 mgr.x (mgr.34562) 7588 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:16:26.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:16:26 smithi188 bash[23329]: cephadm 2020-07-16T16:16:25.448656+0000 mgr.x (mgr.34562) 7589 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:16:27.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:16:27 smithi132 bash[27079]: cluster 2020-07-16T16:16:25.618129+0000 mgr.x (mgr.34562) 7590 : cluster [DBG] pgmap v4732: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:16:27.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:16:27 smithi188 bash[23329]: cluster 2020-07-16T16:16:25.618129+0000 mgr.x (mgr.34562) 7590 : cluster [DBG] pgmap v4732: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:16:29.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:16:29 smithi132 bash[27079]: cluster 2020-07-16T16:16:27.618603+0000 mgr.x (mgr.34562) 7591 : cluster [DBG] pgmap v4733: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:16:29.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:16:29 smithi188 bash[23329]: cluster 2020-07-16T16:16:27.618603+0000 mgr.x (mgr.34562) 7591 : cluster [DBG] pgmap v4733: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:16:31.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:16:31 smithi132 bash[27079]: cluster 2020-07-16T16:16:29.619078+0000 mgr.x (mgr.34562) 7592 : cluster [DBG] pgmap v4734: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:16:31.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:16:31 smithi188 bash[23329]: cluster 2020-07-16T16:16:29.619078+0000 mgr.x (mgr.34562) 7592 : cluster [DBG] pgmap v4734: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:16:33.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:16:33 smithi132 bash[27079]: cluster 2020-07-16T16:16:31.619564+0000 mgr.x (mgr.34562) 7593 : cluster [DBG] pgmap v4735: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:16:33.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:16:33 smithi188 bash[23329]: cluster 2020-07-16T16:16:31.619564+0000 mgr.x (mgr.34562) 7593 : cluster [DBG] pgmap v4735: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:16:35.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:16:35 smithi132 bash[27079]: cluster 2020-07-16T16:16:33.619934+0000 mgr.x (mgr.34562) 7594 : cluster [DBG] pgmap v4736: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:16:35.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:16:35 smithi188 bash[23329]: cluster 2020-07-16T16:16:33.619934+0000 mgr.x (mgr.34562) 7594 : cluster [DBG] pgmap v4736: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:16:37.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:16:37 smithi132 bash[27079]: cluster 2020-07-16T16:16:35.620349+0000 mgr.x (mgr.34562) 7595 : cluster [DBG] pgmap v4737: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:16:37.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:16:37 smithi188 bash[23329]: cluster 2020-07-16T16:16:35.620349+0000 mgr.x (mgr.34562) 7595 : cluster [DBG] pgmap v4737: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:16:39.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:16:39 smithi132 bash[27079]: cluster 2020-07-16T16:16:37.620813+0000 mgr.x (mgr.34562) 7596 : cluster [DBG] pgmap v4738: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:16:39.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:16:39 smithi188 bash[23329]: cluster 2020-07-16T16:16:37.620813+0000 mgr.x (mgr.34562) 7596 : cluster [DBG] pgmap v4738: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:16:41.430 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:16:41.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:16:41 smithi132 bash[27079]: cluster 2020-07-16T16:16:39.621301+0000 mgr.x (mgr.34562) 7597 : cluster [DBG] pgmap v4739: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:16:41.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:16:41 smithi132 bash[27079]: audit 2020-07-16T16:16:40.464337+0000 mon.b (mon.2) 1618 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:16:41.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:16:41 smithi132 bash[27079]: cephadm 2020-07-16T16:16:40.465056+0000 mgr.x (mgr.34562) 7598 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:16:41.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:16:41 smithi132 bash[27079]: cephadm 2020-07-16T16:16:40.465485+0000 mgr.x (mgr.34562) 7599 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:16:41.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:16:41 smithi188 bash[23329]: cluster 2020-07-16T16:16:39.621301+0000 mgr.x (mgr.34562) 7597 : cluster [DBG] pgmap v4739: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:16:41.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:16:41 smithi188 bash[23329]: audit 2020-07-16T16:16:40.464337+0000 mon.b (mon.2) 1618 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:16:41.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:16:41 smithi188 bash[23329]: cephadm 2020-07-16T16:16:40.465056+0000 mgr.x (mgr.34562) 7598 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:16:41.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:16:41 smithi188 bash[23329]: cephadm 2020-07-16T16:16:40.465485+0000 mgr.x (mgr.34562) 7599 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:16:41.691 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:16:41.691 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 10m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:16:41.691 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 10m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:16:41.692 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 10m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:16:41.692 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 10m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:16:41.692 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 10m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:16:41.693 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:16:41.693 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:16:41.694 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 10m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:16:41.694 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 10m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:16:41.694 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:16:41.694 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:16:41.695 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:16:41.695 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:16:41.695 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:16:41.695 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:16:41.695 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:16:41.696 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:16:41.696 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 10m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:16:41.988 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:16:41.989 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:16:41.989 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:16:41.989 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:16:41.990 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:16:41.990 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:16:41.990 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:16:41.991 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:16:41.991 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:16:41.991 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:16:41.991 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:16:41.991 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:16:41.992 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:16:41.992 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:16:41.992 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:16:41.992 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:16:41.992 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:16:42.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:16:42 smithi132 bash[27079]: audit 2020-07-16T16:16:41.419041+0000 mgr.x (mgr.34562) 7600 : audit [DBG] from='client.30166 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:16:42.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:16:42 smithi132 bash[27079]: audit 2020-07-16T16:16:41.987895+0000 mon.c (mon.1) 508 : audit [DBG] from='client.? 172.21.15.132:0/1966599348' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:16:42.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:16:42 smithi188 bash[23329]: audit 2020-07-16T16:16:41.419041+0000 mgr.x (mgr.34562) 7600 : audit [DBG] from='client.30166 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:16:42.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:16:42 smithi188 bash[23329]: audit 2020-07-16T16:16:41.987895+0000 mon.c (mon.1) 508 : audit [DBG] from='client.? 172.21.15.132:0/1966599348' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:16:43.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:16:43 smithi132 bash[27079]: cluster 2020-07-16T16:16:41.621639+0000 mgr.x (mgr.34562) 7601 : cluster [DBG] pgmap v4740: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:16:43.532 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:16:43 smithi132 bash[27079]: audit 2020-07-16T16:16:41.686964+0000 mgr.x (mgr.34562) 7602 : audit [DBG] from='client.30172 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:16:43.678 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:16:43 smithi188 bash[23329]: cluster 2020-07-16T16:16:41.621639+0000 mgr.x (mgr.34562) 7601 : cluster [DBG] pgmap v4740: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:16:43.678 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:16:43 smithi188 bash[23329]: audit 2020-07-16T16:16:41.686964+0000 mgr.x (mgr.34562) 7602 : audit [DBG] from='client.30172 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:16:45.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:16:45 smithi132 bash[27079]: cluster 2020-07-16T16:16:43.622097+0000 mgr.x (mgr.34562) 7603 : cluster [DBG] pgmap v4741: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:16:45.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:16:45 smithi188 bash[23329]: cluster 2020-07-16T16:16:43.622097+0000 mgr.x (mgr.34562) 7603 : cluster [DBG] pgmap v4741: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:16:47.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:16:47 smithi132 bash[27079]: cluster 2020-07-16T16:16:45.622535+0000 mgr.x (mgr.34562) 7604 : cluster [DBG] pgmap v4742: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:16:47.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:16:47 smithi188 bash[23329]: cluster 2020-07-16T16:16:45.622535+0000 mgr.x (mgr.34562) 7604 : cluster [DBG] pgmap v4742: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:16:49.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:16:49 smithi132 bash[27079]: cluster 2020-07-16T16:16:47.623026+0000 mgr.x (mgr.34562) 7605 : cluster [DBG] pgmap v4743: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:16:49.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:16:49 smithi188 bash[23329]: cluster 2020-07-16T16:16:47.623026+0000 mgr.x (mgr.34562) 7605 : cluster [DBG] pgmap v4743: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:16:51.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:16:51 smithi132 bash[27079]: cluster 2020-07-16T16:16:49.623547+0000 mgr.x (mgr.34562) 7606 : cluster [DBG] pgmap v4744: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:16:51.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:16:51 smithi188 bash[23329]: cluster 2020-07-16T16:16:49.623547+0000 mgr.x (mgr.34562) 7606 : cluster [DBG] pgmap v4744: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:16:53.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:16:53 smithi132 bash[27079]: cluster 2020-07-16T16:16:51.624112+0000 mgr.x (mgr.34562) 7607 : cluster [DBG] pgmap v4745: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:16:53.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:16:53 smithi188 bash[23329]: cluster 2020-07-16T16:16:51.624112+0000 mgr.x (mgr.34562) 7607 : cluster [DBG] pgmap v4745: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:16:55.533 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:16:55 smithi132 bash[27079]: cluster 2020-07-16T16:16:53.624492+0000 mgr.x (mgr.34562) 7608 : cluster [DBG] pgmap v4746: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:16:55.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:16:55 smithi188 bash[23329]: cluster 2020-07-16T16:16:53.624492+0000 mgr.x (mgr.34562) 7608 : cluster [DBG] pgmap v4746: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:16:56.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:16:56 smithi132 bash[27079]: audit 2020-07-16T16:16:55.475174+0000 mon.b (mon.2) 1619 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:16:56.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:16:56 smithi132 bash[27079]: cephadm 2020-07-16T16:16:55.475874+0000 mgr.x (mgr.34562) 7609 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:16:56.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:16:56 smithi132 bash[27079]: cephadm 2020-07-16T16:16:55.476176+0000 mgr.x (mgr.34562) 7610 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:16:56.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:16:56 smithi188 bash[23329]: audit 2020-07-16T16:16:55.475174+0000 mon.b (mon.2) 1619 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:16:56.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:16:56 smithi188 bash[23329]: cephadm 2020-07-16T16:16:55.475874+0000 mgr.x (mgr.34562) 7609 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:16:56.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:16:56 smithi188 bash[23329]: cephadm 2020-07-16T16:16:55.476176+0000 mgr.x (mgr.34562) 7610 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:16:57.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:16:57 smithi132 bash[27079]: cluster 2020-07-16T16:16:55.624857+0000 mgr.x (mgr.34562) 7611 : cluster [DBG] pgmap v4747: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:16:57.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:16:57 smithi188 bash[23329]: cluster 2020-07-16T16:16:55.624857+0000 mgr.x (mgr.34562) 7611 : cluster [DBG] pgmap v4747: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:16:59.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:16:59 smithi132 bash[27079]: cluster 2020-07-16T16:16:57.625322+0000 mgr.x (mgr.34562) 7612 : cluster [DBG] pgmap v4748: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:16:59.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:16:59 smithi188 bash[23329]: cluster 2020-07-16T16:16:57.625322+0000 mgr.x (mgr.34562) 7612 : cluster [DBG] pgmap v4748: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:17:01.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:01 smithi132 bash[27079]: cluster 2020-07-16T16:16:59.625678+0000 mgr.x (mgr.34562) 7613 : cluster [DBG] pgmap v4749: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:17:01.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:01 smithi188 bash[23329]: cluster 2020-07-16T16:16:59.625678+0000 mgr.x (mgr.34562) 7613 : cluster [DBG] pgmap v4749: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:17:03.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:03 smithi132 bash[27079]: cluster 2020-07-16T16:17:01.626097+0000 mgr.x (mgr.34562) 7614 : cluster [DBG] pgmap v4750: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:17:03.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:03 smithi188 bash[23329]: cluster 2020-07-16T16:17:01.626097+0000 mgr.x (mgr.34562) 7614 : cluster [DBG] pgmap v4750: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:17:05.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:05 smithi188 bash[23329]: cluster 2020-07-16T16:17:03.626505+0000 mgr.x (mgr.34562) 7615 : cluster [DBG] pgmap v4751: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:17:05.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:05 smithi132 bash[27079]: cluster 2020-07-16T16:17:03.626505+0000 mgr.x (mgr.34562) 7615 : cluster [DBG] pgmap v4751: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:17:07.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:07 smithi188 bash[23329]: cluster 2020-07-16T16:17:05.627069+0000 mgr.x (mgr.34562) 7616 : cluster [DBG] pgmap v4752: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:17:07.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:07 smithi132 bash[27079]: cluster 2020-07-16T16:17:05.627069+0000 mgr.x (mgr.34562) 7616 : cluster [DBG] pgmap v4752: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:17:09.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:09 smithi188 bash[23329]: cluster 2020-07-16T16:17:07.627658+0000 mgr.x (mgr.34562) 7617 : cluster [DBG] pgmap v4753: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:17:09.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:09 smithi132 bash[27079]: cluster 2020-07-16T16:17:07.627658+0000 mgr.x (mgr.34562) 7617 : cluster [DBG] pgmap v4753: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:17:11.405 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:11 smithi132 bash[27079]: cluster 2020-07-16T16:17:09.628090+0000 mgr.x (mgr.34562) 7618 : cluster [DBG] pgmap v4754: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:17:11.406 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:11 smithi132 bash[27079]: audit 2020-07-16T16:17:10.492435+0000 mon.b (mon.2) 1620 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T16:17:11.406 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:11 smithi132 bash[27079]: audit 2020-07-16T16:17:10.492719+0000 mon.b (mon.2) 1621 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T16:17:11.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:11 smithi188 bash[23329]: cluster 2020-07-16T16:17:09.628090+0000 mgr.x (mgr.34562) 7618 : cluster [DBG] pgmap v4754: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:17:11.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:11 smithi188 bash[23329]: audit 2020-07-16T16:17:10.492435+0000 mon.b (mon.2) 1620 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T16:17:11.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:11 smithi188 bash[23329]: audit 2020-07-16T16:17:10.492719+0000 mon.b (mon.2) 1621 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T16:17:12.301 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:17:12.591 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:17:12.592 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 10m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:17:12.592 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 10m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:17:12.592 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 10m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:17:12.592 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 10m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:17:12.592 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 10m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:17:12.593 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:17:12.593 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:17:12.593 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 10m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:17:12.593 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 10m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:17:12.593 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:17:12.594 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:17:12.594 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:17:12.594 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:17:12.594 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:17:12.594 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:17:12.595 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:17:12.595 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:17:12.595 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 10m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:17:12.902 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:17:12.903 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:17:12.903 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:17:12.903 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:17:12.903 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:17:12.904 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:17:12.904 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:17:12.904 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:17:12.904 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:17:12.904 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:17:12.905 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:17:12.905 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:17:12.905 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:17:12.905 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:17:12.905 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:17:12.906 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:17:12.906 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:17:13.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:13 smithi188 bash[23329]: cluster 2020-07-16T16:17:11.628465+0000 mgr.x (mgr.34562) 7619 : cluster [DBG] pgmap v4755: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:17:13.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:13 smithi188 bash[23329]: audit 2020-07-16T16:17:12.290041+0000 mgr.x (mgr.34562) 7620 : audit [DBG] from='client.30184 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:17:13.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:13 smithi188 bash[23329]: audit 2020-07-16T16:17:12.763190+0000 mon.b (mon.2) 1622 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T16:17:12.761603\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.761663\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.761698\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.761728\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.761908\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.762010\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.762108\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.762206\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.762238\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T16:17:12.762339\", \"last_device_update\": \"2020-07-16T16:05:32.972399\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T16:08:47.107456\"}"}]: dispatch 2020-07-16T16:17:13.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:13 smithi188 bash[23329]: audit 2020-07-16T16:17:12.763698+0000 mon.c (mon.1) 509 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T16:17:12.761603\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.761663\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.761698\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.761728\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.761908\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.762010\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.762108\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.762206\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.762238\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T16:17:12.762339\", \"last_device_update\": \"2020-07-16T16:05:32.972399\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T16:08:47.107456\"}"}]: dispatch 2020-07-16T16:17:13.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:13 smithi188 bash[23329]: audit 2020-07-16T16:17:12.766768+0000 mon.c (mon.1) 510 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T16:17:12.761603\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.761663\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.761698\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.761728\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.761908\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.762010\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.762108\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.762206\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.762238\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T16:17:12.762339\", \"last_device_update\": \"2020-07-16T16:05:32.972399\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T16:08:47.107456\"}"}]': finished 2020-07-16T16:17:13.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:13 smithi188 bash[23329]: audit 2020-07-16T16:17:12.901795+0000 mon.c (mon.1) 511 : audit [DBG] from='client.? 172.21.15.132:0/3753268759' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:17:13.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:13 smithi188 bash[23329]: audit 2020-07-16T16:17:13.185443+0000 mon.b (mon.2) 1623 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.183924\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.183997\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184028\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184191\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184317\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184422\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184524\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184558\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184602\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T16:17:13.184670\", \"last_device_update\": \"2020-07-16T16:06:41.170725\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T16:08:47.108250\"}"}]: dispatch 2020-07-16T16:17:13.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:13 smithi188 bash[23329]: audit 2020-07-16T16:17:13.185899+0000 mon.c (mon.1) 512 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.183924\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.183997\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184028\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184191\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184317\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184422\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184524\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184558\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184602\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T16:17:13.184670\", \"last_device_update\": \"2020-07-16T16:06:41.170725\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T16:08:47.108250\"}"}]: dispatch 2020-07-16T16:17:13.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:13 smithi188 bash[23329]: audit 2020-07-16T16:17:13.188984+0000 mon.c (mon.1) 513 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.183924\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.183997\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184028\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184191\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184317\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184422\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184524\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184558\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184602\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T16:17:13.184670\", \"last_device_update\": \"2020-07-16T16:06:41.170725\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T16:08:47.108250\"}"}]': finished 2020-07-16T16:17:13.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:13 smithi188 bash[23329]: audit 2020-07-16T16:17:13.191313+0000 mon.b (mon.2) 1624 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:17:13.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:13 smithi188 bash[23329]: audit 2020-07-16T16:17:13.192250+0000 mon.b (mon.2) 1625 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:17:13.425 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:13 smithi188 bash[23329]: audit 2020-07-16T16:17:13.193078+0000 mon.b (mon.2) 1626 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:17:13.425 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:13 smithi188 bash[23329]: audit 2020-07-16T16:17:13.194118+0000 mon.b (mon.2) 1627 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:17:13.425 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:13 smithi188 bash[23329]: audit 2020-07-16T16:17:13.195117+0000 mon.b (mon.2) 1628 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:17:13.672 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:13 smithi132 bash[27079]: cluster 2020-07-16T16:17:11.628465+0000 mgr.x (mgr.34562) 7619 : cluster [DBG] pgmap v4755: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:17:13.673 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:13 smithi132 bash[27079]: audit 2020-07-16T16:17:12.290041+0000 mgr.x (mgr.34562) 7620 : audit [DBG] from='client.30184 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:17:13.673 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:13 smithi132 bash[27079]: audit 2020-07-16T16:17:12.763190+0000 mon.b (mon.2) 1622 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T16:17:12.761603\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.761663\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.761698\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.761728\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.761908\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.762010\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.762108\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.762206\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.762238\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T16:17:12.762339\", \"last_device_update\": \"2020-07-16T16:05:32.972399\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T16:08:47.107456\"}"}]: dispatch 2020-07-16T16:17:13.673 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:13 smithi132 bash[27079]: audit 2020-07-16T16:17:12.763698+0000 mon.c (mon.1) 509 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T16:17:12.761603\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.761663\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.761698\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.761728\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.761908\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.762010\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.762108\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.762206\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.762238\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T16:17:12.762339\", \"last_device_update\": \"2020-07-16T16:05:32.972399\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T16:08:47.107456\"}"}]: dispatch 2020-07-16T16:17:13.674 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:13 smithi132 bash[27079]: audit 2020-07-16T16:17:12.766768+0000 mon.c (mon.1) 510 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T16:17:12.761603\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.761663\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.761698\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.761728\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.761908\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.762010\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.762108\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.762206\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.762238\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T16:17:12.762339\", \"last_device_update\": \"2020-07-16T16:05:32.972399\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T16:08:47.107456\"}"}]': finished 2020-07-16T16:17:13.674 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:13 smithi132 bash[27079]: audit 2020-07-16T16:17:12.901795+0000 mon.c (mon.1) 511 : audit [DBG] from='client.? 172.21.15.132:0/3753268759' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:17:13.674 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:13 smithi132 bash[27079]: audit 2020-07-16T16:17:13.185443+0000 mon.b (mon.2) 1623 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.183924\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.183997\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184028\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184191\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184317\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184422\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184524\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184558\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184602\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T16:17:13.184670\", \"last_device_update\": \"2020-07-16T16:06:41.170725\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T16:08:47.108250\"}"}]: dispatch 2020-07-16T16:17:13.675 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:13 smithi132 bash[27079]: audit 2020-07-16T16:17:13.185899+0000 mon.c (mon.1) 512 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.183924\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.183997\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184028\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184191\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184317\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184422\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184524\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184558\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184602\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T16:17:13.184670\", \"last_device_update\": \"2020-07-16T16:06:41.170725\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T16:08:47.108250\"}"}]: dispatch 2020-07-16T16:17:13.675 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:13 smithi132 bash[27079]: audit 2020-07-16T16:17:13.188984+0000 mon.c (mon.1) 513 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.183924\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.183997\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184028\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184191\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184317\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184422\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184524\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184558\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184602\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T16:17:13.184670\", \"last_device_update\": \"2020-07-16T16:06:41.170725\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T16:08:47.108250\"}"}]': finished 2020-07-16T16:17:13.675 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:13 smithi132 bash[27079]: audit 2020-07-16T16:17:13.191313+0000 mon.b (mon.2) 1624 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:17:13.676 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:13 smithi132 bash[27079]: audit 2020-07-16T16:17:13.192250+0000 mon.b (mon.2) 1625 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:17:13.676 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:13 smithi132 bash[27079]: audit 2020-07-16T16:17:13.193078+0000 mon.b (mon.2) 1626 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:17:13.676 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:13 smithi132 bash[27079]: audit 2020-07-16T16:17:13.194118+0000 mon.b (mon.2) 1627 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:17:13.676 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:13 smithi132 bash[27079]: audit 2020-07-16T16:17:13.195117+0000 mon.b (mon.2) 1628 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:17:14.628 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:14 smithi132 bash[27079]: audit 2020-07-16T16:17:12.587375+0000 mgr.x (mgr.34562) 7621 : audit [DBG] from='client.30190 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:17:14.629 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:14 smithi132 bash[27079]: audit 2020-07-16T16:17:13.191580+0000 mgr.x (mgr.34562) 7622 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:17:14.629 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:14 smithi132 bash[27079]: audit 2020-07-16T16:17:13.192488+0000 mgr.x (mgr.34562) 7623 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:17:14.629 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:14 smithi132 bash[27079]: audit 2020-07-16T16:17:13.193311+0000 mgr.x (mgr.34562) 7624 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:17:14.629 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:14 smithi132 bash[27079]: cephadm 2020-07-16T16:17:13.193850+0000 mgr.x (mgr.34562) 7625 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:17:14.629 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:14 smithi132 bash[27079]: cephadm 2020-07-16T16:17:13.194771+0000 mgr.x (mgr.34562) 7626 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:17:14.630 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:14 smithi132 bash[27079]: cephadm 2020-07-16T16:17:13.195621+0000 mgr.x (mgr.34562) 7627 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:17:14.630 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:14 smithi132 bash[27079]: cephadm 2020-07-16T16:17:13.195804+0000 mgr.x (mgr.34562) 7628 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:17:14.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:14 smithi188 bash[23329]: audit 2020-07-16T16:17:12.587375+0000 mgr.x (mgr.34562) 7621 : audit [DBG] from='client.30190 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:17:14.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:14 smithi188 bash[23329]: audit 2020-07-16T16:17:13.191580+0000 mgr.x (mgr.34562) 7622 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:17:14.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:14 smithi188 bash[23329]: audit 2020-07-16T16:17:13.192488+0000 mgr.x (mgr.34562) 7623 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:17:14.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:14 smithi188 bash[23329]: audit 2020-07-16T16:17:13.193311+0000 mgr.x (mgr.34562) 7624 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:17:14.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:14 smithi188 bash[23329]: cephadm 2020-07-16T16:17:13.193850+0000 mgr.x (mgr.34562) 7625 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:17:14.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:14 smithi188 bash[23329]: cephadm 2020-07-16T16:17:13.194771+0000 mgr.x (mgr.34562) 7626 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:17:14.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:14 smithi188 bash[23329]: cephadm 2020-07-16T16:17:13.195621+0000 mgr.x (mgr.34562) 7627 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:17:14.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:14 smithi188 bash[23329]: cephadm 2020-07-16T16:17:13.195804+0000 mgr.x (mgr.34562) 7628 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:17:15.438 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:15 smithi132 bash[27079]: cluster 2020-07-16T16:17:13.628801+0000 mgr.x (mgr.34562) 7629 : cluster [DBG] pgmap v4756: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:17:15.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:15 smithi188 bash[23329]: cluster 2020-07-16T16:17:13.628801+0000 mgr.x (mgr.34562) 7629 : cluster [DBG] pgmap v4756: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:17:16.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:16 smithi188 bash[23329]: audit 2020-07-16T16:17:16.003921+0000 mon.b (mon.2) 1629 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:17:16.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:16 smithi132 bash[27079]: audit 2020-07-16T16:17:16.003921+0000 mon.b (mon.2) 1629 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:17:17.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:17 smithi188 bash[23329]: cluster 2020-07-16T16:17:15.629190+0000 mgr.x (mgr.34562) 7630 : cluster [DBG] pgmap v4757: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:17:17.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:17 smithi188 bash[23329]: cephadm 2020-07-16T16:17:16.004565+0000 mgr.x (mgr.34562) 7631 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:17:17.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:17 smithi188 bash[23329]: cephadm 2020-07-16T16:17:16.004975+0000 mgr.x (mgr.34562) 7632 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:17:17.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:17 smithi132 bash[27079]: cluster 2020-07-16T16:17:15.629190+0000 mgr.x (mgr.34562) 7630 : cluster [DBG] pgmap v4757: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:17:17.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:17 smithi132 bash[27079]: cephadm 2020-07-16T16:17:16.004565+0000 mgr.x (mgr.34562) 7631 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:17:17.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:17 smithi132 bash[27079]: cephadm 2020-07-16T16:17:16.004975+0000 mgr.x (mgr.34562) 7632 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:17:19.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:19 smithi188 bash[23329]: cluster 2020-07-16T16:17:17.629713+0000 mgr.x (mgr.34562) 7633 : cluster [DBG] pgmap v4758: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:17:19.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:19 smithi132 bash[27079]: cluster 2020-07-16T16:17:17.629713+0000 mgr.x (mgr.34562) 7633 : cluster [DBG] pgmap v4758: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:17:21.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:21 smithi188 bash[23329]: cluster 2020-07-16T16:17:19.630177+0000 mgr.x (mgr.34562) 7634 : cluster [DBG] pgmap v4759: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:17:21.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:21 smithi132 bash[27079]: cluster 2020-07-16T16:17:19.630177+0000 mgr.x (mgr.34562) 7634 : cluster [DBG] pgmap v4759: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:17:23.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:23 smithi188 bash[23329]: cluster 2020-07-16T16:17:21.630579+0000 mgr.x (mgr.34562) 7635 : cluster [DBG] pgmap v4760: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:17:23.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:23 smithi132 bash[27079]: cluster 2020-07-16T16:17:21.630579+0000 mgr.x (mgr.34562) 7635 : cluster [DBG] pgmap v4760: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:17:25.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:25 smithi188 bash[23329]: cluster 2020-07-16T16:17:23.630960+0000 mgr.x (mgr.34562) 7636 : cluster [DBG] pgmap v4761: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:17:25.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:25 smithi132 bash[27079]: cluster 2020-07-16T16:17:23.630960+0000 mgr.x (mgr.34562) 7636 : cluster [DBG] pgmap v4761: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:17:27.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:27 smithi188 bash[23329]: cluster 2020-07-16T16:17:25.631313+0000 mgr.x (mgr.34562) 7637 : cluster [DBG] pgmap v4762: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:17:27.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:27 smithi132 bash[27079]: cluster 2020-07-16T16:17:25.631313+0000 mgr.x (mgr.34562) 7637 : cluster [DBG] pgmap v4762: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:17:29.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:29 smithi188 bash[23329]: cluster 2020-07-16T16:17:27.631877+0000 mgr.x (mgr.34562) 7638 : cluster [DBG] pgmap v4763: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:17:29.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:29 smithi132 bash[27079]: cluster 2020-07-16T16:17:27.631877+0000 mgr.x (mgr.34562) 7638 : cluster [DBG] pgmap v4763: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:17:31.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:31 smithi188 bash[23329]: cluster 2020-07-16T16:17:29.632333+0000 mgr.x (mgr.34562) 7639 : cluster [DBG] pgmap v4764: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:17:31.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:31 smithi188 bash[23329]: audit 2020-07-16T16:17:31.016028+0000 mon.b (mon.2) 1630 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:17:31.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:31 smithi132 bash[27079]: cluster 2020-07-16T16:17:29.632333+0000 mgr.x (mgr.34562) 7639 : cluster [DBG] pgmap v4764: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:17:31.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:31 smithi132 bash[27079]: audit 2020-07-16T16:17:31.016028+0000 mon.b (mon.2) 1630 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:17:32.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:32 smithi188 bash[23329]: cephadm 2020-07-16T16:17:31.016761+0000 mgr.x (mgr.34562) 7640 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:17:32.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:32 smithi188 bash[23329]: cephadm 2020-07-16T16:17:31.017064+0000 mgr.x (mgr.34562) 7641 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:17:32.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:32 smithi132 bash[27079]: cephadm 2020-07-16T16:17:31.016761+0000 mgr.x (mgr.34562) 7640 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:17:32.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:32 smithi132 bash[27079]: cephadm 2020-07-16T16:17:31.017064+0000 mgr.x (mgr.34562) 7641 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:17:33.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:33 smithi188 bash[23329]: cluster 2020-07-16T16:17:31.632743+0000 mgr.x (mgr.34562) 7642 : cluster [DBG] pgmap v4765: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:17:33.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:33 smithi132 bash[27079]: cluster 2020-07-16T16:17:31.632743+0000 mgr.x (mgr.34562) 7642 : cluster [DBG] pgmap v4765: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:17:35.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:35 smithi188 bash[23329]: cluster 2020-07-16T16:17:33.633352+0000 mgr.x (mgr.34562) 7643 : cluster [DBG] pgmap v4766: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:17:35.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:35 smithi132 bash[27079]: cluster 2020-07-16T16:17:33.633352+0000 mgr.x (mgr.34562) 7643 : cluster [DBG] pgmap v4766: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:17:37.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:37 smithi188 bash[23329]: cluster 2020-07-16T16:17:35.633754+0000 mgr.x (mgr.34562) 7644 : cluster [DBG] pgmap v4767: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:17:37.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:37 smithi132 bash[27079]: cluster 2020-07-16T16:17:35.633754+0000 mgr.x (mgr.34562) 7644 : cluster [DBG] pgmap v4767: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:17:39.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:39 smithi188 bash[23329]: cluster 2020-07-16T16:17:37.634277+0000 mgr.x (mgr.34562) 7645 : cluster [DBG] pgmap v4768: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:17:39.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:39 smithi132 bash[27079]: cluster 2020-07-16T16:17:37.634277+0000 mgr.x (mgr.34562) 7645 : cluster [DBG] pgmap v4768: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:17:41.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:41 smithi188 bash[23329]: cluster 2020-07-16T16:17:39.634805+0000 mgr.x (mgr.34562) 7646 : cluster [DBG] pgmap v4769: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:17:41.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:41 smithi132 bash[27079]: cluster 2020-07-16T16:17:39.634805+0000 mgr.x (mgr.34562) 7646 : cluster [DBG] pgmap v4769: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:17:43.200 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:17:43.464 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:17:43.465 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 30s ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:17:43.465 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 30s ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:17:43.465 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 30s ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:17:43.466 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 30s ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:17:43.466 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 30s ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:17:43.466 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 30s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:17:43.466 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 30s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:17:43.466 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 30s ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:17:43.467 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 30s ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:17:43.467 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 30s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:17:43.467 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 30s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:17:43.467 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 30s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:17:43.467 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 30s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:17:43.468 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 30s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:17:43.468 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 30s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:17:43.468 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 30s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:17:43.468 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 30s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:17:43.468 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 30s ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:17:43.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:43 smithi188 bash[23329]: cluster 2020-07-16T16:17:41.635280+0000 mgr.x (mgr.34562) 7647 : cluster [DBG] pgmap v4770: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:17:43.763 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:17:43.763 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:17:43.763 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:17:43.763 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:17:43.764 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:17:43.764 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:17:43.764 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:17:43.764 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:17:43.764 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:17:43.765 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:17:43.765 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:17:43.765 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:17:43.765 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:17:43.765 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:17:43.766 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:17:43.766 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:17:43.766 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:17:43.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:43 smithi132 bash[27079]: cluster 2020-07-16T16:17:41.635280+0000 mgr.x (mgr.34562) 7647 : cluster [DBG] pgmap v4770: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:17:44.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:44 smithi188 bash[23329]: audit 2020-07-16T16:17:43.188798+0000 mgr.x (mgr.34562) 7648 : audit [DBG] from='client.30202 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:17:44.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:44 smithi188 bash[23329]: audit 2020-07-16T16:17:43.460269+0000 mgr.x (mgr.34562) 7649 : audit [DBG] from='client.30208 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:17:44.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:44 smithi188 bash[23329]: audit 2020-07-16T16:17:43.762147+0000 mon.c (mon.1) 514 : audit [DBG] from='client.? 172.21.15.132:0/2844437384' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:17:44.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:44 smithi132 bash[27079]: audit 2020-07-16T16:17:43.188798+0000 mgr.x (mgr.34562) 7648 : audit [DBG] from='client.30202 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:17:44.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:44 smithi132 bash[27079]: audit 2020-07-16T16:17:43.460269+0000 mgr.x (mgr.34562) 7649 : audit [DBG] from='client.30208 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:17:44.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:44 smithi132 bash[27079]: audit 2020-07-16T16:17:43.762147+0000 mon.c (mon.1) 514 : audit [DBG] from='client.? 172.21.15.132:0/2844437384' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:17:45.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:45 smithi188 bash[23329]: cluster 2020-07-16T16:17:43.635670+0000 mgr.x (mgr.34562) 7650 : cluster [DBG] pgmap v4771: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:17:45.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:45 smithi132 bash[27079]: cluster 2020-07-16T16:17:43.635670+0000 mgr.x (mgr.34562) 7650 : cluster [DBG] pgmap v4771: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:17:46.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:46 smithi188 bash[23329]: audit 2020-07-16T16:17:46.032708+0000 mon.b (mon.2) 1631 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:17:46.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:46 smithi132 bash[27079]: audit 2020-07-16T16:17:46.032708+0000 mon.b (mon.2) 1631 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:17:47.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:47 smithi188 bash[23329]: cluster 2020-07-16T16:17:45.636120+0000 mgr.x (mgr.34562) 7651 : cluster [DBG] pgmap v4772: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:17:47.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:47 smithi188 bash[23329]: cephadm 2020-07-16T16:17:46.033375+0000 mgr.x (mgr.34562) 7652 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:17:47.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:47 smithi188 bash[23329]: cephadm 2020-07-16T16:17:46.033836+0000 mgr.x (mgr.34562) 7653 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:17:47.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:47 smithi132 bash[27079]: cluster 2020-07-16T16:17:45.636120+0000 mgr.x (mgr.34562) 7651 : cluster [DBG] pgmap v4772: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:17:47.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:47 smithi132 bash[27079]: cephadm 2020-07-16T16:17:46.033375+0000 mgr.x (mgr.34562) 7652 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:17:47.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:47 smithi132 bash[27079]: cephadm 2020-07-16T16:17:46.033836+0000 mgr.x (mgr.34562) 7653 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:17:49.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:49 smithi188 bash[23329]: cluster 2020-07-16T16:17:47.636503+0000 mgr.x (mgr.34562) 7654 : cluster [DBG] pgmap v4773: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:17:49.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:49 smithi132 bash[27079]: cluster 2020-07-16T16:17:47.636503+0000 mgr.x (mgr.34562) 7654 : cluster [DBG] pgmap v4773: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:17:51.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:51 smithi188 bash[23329]: cluster 2020-07-16T16:17:49.636968+0000 mgr.x (mgr.34562) 7655 : cluster [DBG] pgmap v4774: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:17:51.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:51 smithi132 bash[27079]: cluster 2020-07-16T16:17:49.636968+0000 mgr.x (mgr.34562) 7655 : cluster [DBG] pgmap v4774: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:17:53.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:53 smithi188 bash[23329]: cluster 2020-07-16T16:17:51.637525+0000 mgr.x (mgr.34562) 7656 : cluster [DBG] pgmap v4775: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:17:53.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:53 smithi132 bash[27079]: cluster 2020-07-16T16:17:51.637525+0000 mgr.x (mgr.34562) 7656 : cluster [DBG] pgmap v4775: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:17:55.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:55 smithi188 bash[23329]: cluster 2020-07-16T16:17:53.638061+0000 mgr.x (mgr.34562) 7657 : cluster [DBG] pgmap v4776: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:17:55.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:55 smithi132 bash[27079]: cluster 2020-07-16T16:17:53.638061+0000 mgr.x (mgr.34562) 7657 : cluster [DBG] pgmap v4776: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:17:57.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:57 smithi188 bash[23329]: cluster 2020-07-16T16:17:55.638582+0000 mgr.x (mgr.34562) 7658 : cluster [DBG] pgmap v4777: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:17:57.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:57 smithi132 bash[27079]: cluster 2020-07-16T16:17:55.638582+0000 mgr.x (mgr.34562) 7658 : cluster [DBG] pgmap v4777: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:17:59.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:17:59 smithi188 bash[23329]: cluster 2020-07-16T16:17:57.638921+0000 mgr.x (mgr.34562) 7659 : cluster [DBG] pgmap v4778: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:17:59.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:17:59 smithi132 bash[27079]: cluster 2020-07-16T16:17:57.638921+0000 mgr.x (mgr.34562) 7659 : cluster [DBG] pgmap v4778: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:18:01.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:18:01 smithi188 bash[23329]: cluster 2020-07-16T16:17:59.639364+0000 mgr.x (mgr.34562) 7660 : cluster [DBG] pgmap v4779: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:18:01.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:18:01 smithi188 bash[23329]: audit 2020-07-16T16:18:01.049442+0000 mon.b (mon.2) 1632 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:18:01.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:18:01 smithi132 bash[27079]: cluster 2020-07-16T16:17:59.639364+0000 mgr.x (mgr.34562) 7660 : cluster [DBG] pgmap v4779: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:18:01.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:18:01 smithi132 bash[27079]: audit 2020-07-16T16:18:01.049442+0000 mon.b (mon.2) 1632 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:18:02.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:18:02 smithi132 bash[27079]: cephadm 2020-07-16T16:18:01.050156+0000 mgr.x (mgr.34562) 7661 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:18:02.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:18:02 smithi132 bash[27079]: cephadm 2020-07-16T16:18:01.050245+0000 mgr.x (mgr.34562) 7662 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:18:02.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:18:02 smithi188 bash[23329]: cephadm 2020-07-16T16:18:01.050156+0000 mgr.x (mgr.34562) 7661 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:18:02.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:18:02 smithi188 bash[23329]: cephadm 2020-07-16T16:18:01.050245+0000 mgr.x (mgr.34562) 7662 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:18:03.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:18:03 smithi132 bash[27079]: cluster 2020-07-16T16:18:01.639769+0000 mgr.x (mgr.34562) 7663 : cluster [DBG] pgmap v4780: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:18:03.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:18:03 smithi188 bash[23329]: cluster 2020-07-16T16:18:01.639769+0000 mgr.x (mgr.34562) 7663 : cluster [DBG] pgmap v4780: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:18:05.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:18:05 smithi132 bash[27079]: cluster 2020-07-16T16:18:03.640241+0000 mgr.x (mgr.34562) 7664 : cluster [DBG] pgmap v4781: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:18:05.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:18:05 smithi188 bash[23329]: cluster 2020-07-16T16:18:03.640241+0000 mgr.x (mgr.34562) 7664 : cluster [DBG] pgmap v4781: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:18:07.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:18:07 smithi132 bash[27079]: cluster 2020-07-16T16:18:05.640685+0000 mgr.x (mgr.34562) 7665 : cluster [DBG] pgmap v4782: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:18:07.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:18:07 smithi188 bash[23329]: cluster 2020-07-16T16:18:05.640685+0000 mgr.x (mgr.34562) 7665 : cluster [DBG] pgmap v4782: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:18:09.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:18:09 smithi132 bash[27079]: cluster 2020-07-16T16:18:07.641272+0000 mgr.x (mgr.34562) 7666 : cluster [DBG] pgmap v4783: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:18:09.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:18:09 smithi188 bash[23329]: cluster 2020-07-16T16:18:07.641272+0000 mgr.x (mgr.34562) 7666 : cluster [DBG] pgmap v4783: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:18:11.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:18:11 smithi132 bash[27079]: cluster 2020-07-16T16:18:09.641811+0000 mgr.x (mgr.34562) 7667 : cluster [DBG] pgmap v4784: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:18:11.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:18:11 smithi188 bash[23329]: cluster 2020-07-16T16:18:09.641811+0000 mgr.x (mgr.34562) 7667 : cluster [DBG] pgmap v4784: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:18:13.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:18:13 smithi132 bash[27079]: cluster 2020-07-16T16:18:11.642331+0000 mgr.x (mgr.34562) 7668 : cluster [DBG] pgmap v4785: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:18:13.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:18:13 smithi188 bash[23329]: cluster 2020-07-16T16:18:11.642331+0000 mgr.x (mgr.34562) 7668 : cluster [DBG] pgmap v4785: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:18:14.061 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:18:14.319 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:18:14.320 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 61s ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:18:14.320 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 61s ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:18:14.320 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 61s ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:18:14.320 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 61s ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:18:14.321 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 61s ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:18:14.321 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 61s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:18:14.321 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 61s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:18:14.321 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 61s ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:18:14.321 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 61s ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:18:14.322 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 61s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:18:14.322 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 61s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:18:14.322 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 61s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:18:14.322 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 61s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:18:14.322 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 61s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:18:14.323 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 61s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:18:14.323 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 61s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:18:14.323 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 61s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:18:14.323 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 61s ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:18:14.618 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:18:14.619 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:18:14.619 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:18:14.619 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:18:14.620 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:18:14.620 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:18:14.620 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:18:14.620 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:18:14.620 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:18:14.621 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:18:14.621 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:18:14.621 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:18:14.621 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:18:14.621 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:18:14.622 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:18:14.622 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:18:14.622 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:18:15.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:18:15 smithi132 bash[27079]: cluster 2020-07-16T16:18:13.642717+0000 mgr.x (mgr.34562) 7669 : cluster [DBG] pgmap v4786: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:18:15.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:18:15 smithi132 bash[27079]: audit 2020-07-16T16:18:14.048878+0000 mgr.x (mgr.34562) 7670 : audit [DBG] from='client.30220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:18:15.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:18:15 smithi132 bash[27079]: audit 2020-07-16T16:18:14.315472+0000 mgr.x (mgr.34562) 7671 : audit [DBG] from='client.30226 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:18:15.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:18:15 smithi132 bash[27079]: audit 2020-07-16T16:18:14.617483+0000 mon.c (mon.1) 515 : audit [DBG] from='client.? 172.21.15.132:0/142681288' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:18:15.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:18:15 smithi188 bash[23329]: cluster 2020-07-16T16:18:13.642717+0000 mgr.x (mgr.34562) 7669 : cluster [DBG] pgmap v4786: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:18:15.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:18:15 smithi188 bash[23329]: audit 2020-07-16T16:18:14.048878+0000 mgr.x (mgr.34562) 7670 : audit [DBG] from='client.30220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:18:15.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:18:15 smithi188 bash[23329]: audit 2020-07-16T16:18:14.315472+0000 mgr.x (mgr.34562) 7671 : audit [DBG] from='client.30226 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:18:15.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:18:15 smithi188 bash[23329]: audit 2020-07-16T16:18:14.617483+0000 mon.c (mon.1) 515 : audit [DBG] from='client.? 172.21.15.132:0/142681288' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:18:16.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:18:16 smithi132 bash[27079]: audit 2020-07-16T16:18:16.060321+0000 mon.b (mon.2) 1633 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:18:16.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:18:16 smithi132 bash[27079]: audit 2020-07-16T16:18:16.061760+0000 mon.b (mon.2) 1634 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:18:16.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:18:16 smithi132 bash[27079]: audit 2020-07-16T16:18:16.062996+0000 mon.b (mon.2) 1635 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:18:16.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:18:16 smithi132 bash[27079]: audit 2020-07-16T16:18:16.064450+0000 mon.b (mon.2) 1636 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:18:16.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:18:16 smithi132 bash[27079]: audit 2020-07-16T16:18:16.065852+0000 mon.b (mon.2) 1637 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:18:16.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:18:16 smithi188 bash[23329]: audit 2020-07-16T16:18:16.060321+0000 mon.b (mon.2) 1633 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:18:16.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:18:16 smithi188 bash[23329]: audit 2020-07-16T16:18:16.061760+0000 mon.b (mon.2) 1634 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:18:16.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:18:16 smithi188 bash[23329]: audit 2020-07-16T16:18:16.062996+0000 mon.b (mon.2) 1635 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:18:16.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:18:16 smithi188 bash[23329]: audit 2020-07-16T16:18:16.064450+0000 mon.b (mon.2) 1636 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:18:16.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:18:16 smithi188 bash[23329]: audit 2020-07-16T16:18:16.065852+0000 mon.b (mon.2) 1637 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:18:17.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:18:17 smithi132 bash[27079]: cluster 2020-07-16T16:18:15.643096+0000 mgr.x (mgr.34562) 7672 : cluster [DBG] pgmap v4787: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:18:17.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:18:17 smithi132 bash[27079]: audit 2020-07-16T16:18:16.060705+0000 mgr.x (mgr.34562) 7673 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:18:17.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:18:17 smithi132 bash[27079]: audit 2020-07-16T16:18:16.062080+0000 mgr.x (mgr.34562) 7674 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:18:17.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:18:17 smithi132 bash[27079]: audit 2020-07-16T16:18:16.063332+0000 mgr.x (mgr.34562) 7675 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:18:17.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:18:17 smithi132 bash[27079]: cephadm 2020-07-16T16:18:16.064028+0000 mgr.x (mgr.34562) 7676 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:18:17.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:18:17 smithi132 bash[27079]: cephadm 2020-07-16T16:18:16.065533+0000 mgr.x (mgr.34562) 7677 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:18:17.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:18:17 smithi132 bash[27079]: cephadm 2020-07-16T16:18:16.066535+0000 mgr.x (mgr.34562) 7678 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:18:17.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:18:17 smithi132 bash[27079]: cephadm 2020-07-16T16:18:16.066794+0000 mgr.x (mgr.34562) 7679 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:18:17.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:18:17 smithi188 bash[23329]: cluster 2020-07-16T16:18:15.643096+0000 mgr.x (mgr.34562) 7672 : cluster [DBG] pgmap v4787: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:18:17.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:18:17 smithi188 bash[23329]: audit 2020-07-16T16:18:16.060705+0000 mgr.x (mgr.34562) 7673 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:18:17.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:18:17 smithi188 bash[23329]: audit 2020-07-16T16:18:16.062080+0000 mgr.x (mgr.34562) 7674 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:18:17.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:18:17 smithi188 bash[23329]: audit 2020-07-16T16:18:16.063332+0000 mgr.x (mgr.34562) 7675 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:18:17.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:18:17 smithi188 bash[23329]: cephadm 2020-07-16T16:18:16.064028+0000 mgr.x (mgr.34562) 7676 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:18:17.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:18:17 smithi188 bash[23329]: cephadm 2020-07-16T16:18:16.065533+0000 mgr.x (mgr.34562) 7677 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:18:17.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:18:17 smithi188 bash[23329]: cephadm 2020-07-16T16:18:16.066535+0000 mgr.x (mgr.34562) 7678 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:18:17.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:18:17 smithi188 bash[23329]: cephadm 2020-07-16T16:18:16.066794+0000 mgr.x (mgr.34562) 7679 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:18:19.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:18:19 smithi132 bash[27079]: cluster 2020-07-16T16:18:17.643526+0000 mgr.x (mgr.34562) 7680 : cluster [DBG] pgmap v4788: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:18:19.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:18:19 smithi132 bash[27079]: audit 2020-07-16T16:18:18.973323+0000 mon.b (mon.2) 1638 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:18:19.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:18:19 smithi188 bash[23329]: cluster 2020-07-16T16:18:17.643526+0000 mgr.x (mgr.34562) 7680 : cluster [DBG] pgmap v4788: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:18:19.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:18:19 smithi188 bash[23329]: audit 2020-07-16T16:18:18.973323+0000 mon.b (mon.2) 1638 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:18:20.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:18:20 smithi132 bash[27079]: cephadm 2020-07-16T16:18:18.973988+0000 mgr.x (mgr.34562) 7681 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:18:20.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:18:20 smithi132 bash[27079]: cephadm 2020-07-16T16:18:18.974406+0000 mgr.x (mgr.34562) 7682 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:18:20.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:18:20 smithi188 bash[23329]: cephadm 2020-07-16T16:18:18.973988+0000 mgr.x (mgr.34562) 7681 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:18:20.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:18:20 smithi188 bash[23329]: cephadm 2020-07-16T16:18:18.974406+0000 mgr.x (mgr.34562) 7682 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:18:21.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:18:21 smithi132 bash[27079]: cluster 2020-07-16T16:18:19.643900+0000 mgr.x (mgr.34562) 7683 : cluster [DBG] pgmap v4789: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:18:21.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:18:21 smithi188 bash[23329]: cluster 2020-07-16T16:18:19.643900+0000 mgr.x (mgr.34562) 7683 : cluster [DBG] pgmap v4789: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:18:23.782 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:18:23 smithi132 bash[27079]: cluster 2020-07-16T16:18:21.644322+0000 mgr.x (mgr.34562) 7684 : cluster [DBG] pgmap v4790: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:18:23.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:18:23 smithi188 bash[23329]: cluster 2020-07-16T16:18:21.644322+0000 mgr.x (mgr.34562) 7684 : cluster [DBG] pgmap v4790: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:18:25.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:18:25 smithi132 bash[27079]: cluster 2020-07-16T16:18:23.644697+0000 mgr.x (mgr.34562) 7685 : cluster [DBG] pgmap v4791: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:18:25.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:18:25 smithi188 bash[23329]: cluster 2020-07-16T16:18:23.644697+0000 mgr.x (mgr.34562) 7685 : cluster [DBG] pgmap v4791: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:18:27.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:18:27 smithi132 bash[27079]: cluster 2020-07-16T16:18:25.645228+0000 mgr.x (mgr.34562) 7686 : cluster [DBG] pgmap v4792: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:18:27.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:18:27 smithi188 bash[23329]: cluster 2020-07-16T16:18:25.645228+0000 mgr.x (mgr.34562) 7686 : cluster [DBG] pgmap v4792: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:18:29.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:18:29 smithi132 bash[27079]: cluster 2020-07-16T16:18:27.645666+0000 mgr.x (mgr.34562) 7687 : cluster [DBG] pgmap v4793: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:18:29.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:18:29 smithi188 bash[23329]: cluster 2020-07-16T16:18:27.645666+0000 mgr.x (mgr.34562) 7687 : cluster [DBG] pgmap v4793: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:18:31.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:18:31 smithi132 bash[27079]: cluster 2020-07-16T16:18:29.646123+0000 mgr.x (mgr.34562) 7688 : cluster [DBG] pgmap v4794: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:18:31.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:18:31 smithi188 bash[23329]: cluster 2020-07-16T16:18:29.646123+0000 mgr.x (mgr.34562) 7688 : cluster [DBG] pgmap v4794: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:18:33.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:18:33 smithi132 bash[27079]: cluster 2020-07-16T16:18:31.646675+0000 mgr.x (mgr.34562) 7689 : cluster [DBG] pgmap v4795: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:18:33.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:18:33 smithi188 bash[23329]: cluster 2020-07-16T16:18:31.646675+0000 mgr.x (mgr.34562) 7689 : cluster [DBG] pgmap v4795: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:18:34.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:18:34 smithi132 bash[27079]: audit 2020-07-16T16:18:33.981037+0000 mon.b (mon.2) 1639 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:18:34.926 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:18:34 smithi188 bash[23329]: audit 2020-07-16T16:18:33.981037+0000 mon.b (mon.2) 1639 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:18:35.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:18:35 smithi132 bash[27079]: cluster 2020-07-16T16:18:33.647204+0000 mgr.x (mgr.34562) 7690 : cluster [DBG] pgmap v4796: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:18:35.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:18:35 smithi132 bash[27079]: cephadm 2020-07-16T16:18:33.981751+0000 mgr.x (mgr.34562) 7691 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:18:35.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:18:35 smithi132 bash[27079]: cephadm 2020-07-16T16:18:33.981981+0000 mgr.x (mgr.34562) 7692 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:18:35.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:18:35 smithi188 bash[23329]: cluster 2020-07-16T16:18:33.647204+0000 mgr.x (mgr.34562) 7690 : cluster [DBG] pgmap v4796: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:18:35.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:18:35 smithi188 bash[23329]: cephadm 2020-07-16T16:18:33.981751+0000 mgr.x (mgr.34562) 7691 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:18:35.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:18:35 smithi188 bash[23329]: cephadm 2020-07-16T16:18:33.981981+0000 mgr.x (mgr.34562) 7692 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:18:37.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:18:37 smithi132 bash[27079]: cluster 2020-07-16T16:18:35.647663+0000 mgr.x (mgr.34562) 7693 : cluster [DBG] pgmap v4797: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:18:37.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:18:37 smithi188 bash[23329]: cluster 2020-07-16T16:18:35.647663+0000 mgr.x (mgr.34562) 7693 : cluster [DBG] pgmap v4797: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:18:39.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:18:39 smithi132 bash[27079]: cluster 2020-07-16T16:18:37.648139+0000 mgr.x (mgr.34562) 7694 : cluster [DBG] pgmap v4798: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:18:39.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:18:39 smithi188 bash[23329]: cluster 2020-07-16T16:18:37.648139+0000 mgr.x (mgr.34562) 7694 : cluster [DBG] pgmap v4798: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:18:41.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:18:41 smithi132 bash[27079]: cluster 2020-07-16T16:18:39.648628+0000 mgr.x (mgr.34562) 7695 : cluster [DBG] pgmap v4799: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:18:41.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:18:41 smithi188 bash[23329]: cluster 2020-07-16T16:18:39.648628+0000 mgr.x (mgr.34562) 7695 : cluster [DBG] pgmap v4799: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:18:43.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:18:43 smithi132 bash[27079]: cluster 2020-07-16T16:18:41.649052+0000 mgr.x (mgr.34562) 7696 : cluster [DBG] pgmap v4800: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:18:43.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:18:43 smithi188 bash[23329]: cluster 2020-07-16T16:18:41.649052+0000 mgr.x (mgr.34562) 7696 : cluster [DBG] pgmap v4800: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:18:44.939 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:18:45.199 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:18:45.200 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 92s ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:18:45.200 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 92s ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:18:45.200 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 92s ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:18:45.200 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 92s ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:18:45.200 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 92s ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:18:45.201 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 92s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:18:45.201 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 92s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:18:45.201 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 92s ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:18:45.201 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 92s ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:18:45.201 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 92s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:18:45.202 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 92s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:18:45.202 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 92s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:18:45.202 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 92s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:18:45.202 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 92s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:18:45.202 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 92s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:18:45.203 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 92s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:18:45.203 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 92s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:18:45.203 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 92s ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:18:45.495 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:18:45.495 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:18:45.496 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:18:45.496 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:18:45.496 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:18:45.496 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:18:45.496 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:18:45.497 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:18:45.497 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:18:45.497 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:18:45.497 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:18:45.497 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:18:45.498 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:18:45.498 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:18:45.498 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:18:45.498 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:18:45.499 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:18:45.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:18:45 smithi132 bash[27079]: cluster 2020-07-16T16:18:43.649489+0000 mgr.x (mgr.34562) 7697 : cluster [DBG] pgmap v4801: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:18:45.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:18:45 smithi132 bash[27079]: audit 2020-07-16T16:18:45.494184+0000 mon.c (mon.1) 516 : audit [DBG] from='client.? 172.21.15.132:0/2325273951' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:18:45.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:18:45 smithi188 bash[23329]: cluster 2020-07-16T16:18:43.649489+0000 mgr.x (mgr.34562) 7697 : cluster [DBG] pgmap v4801: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:18:45.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:18:45 smithi188 bash[23329]: audit 2020-07-16T16:18:45.494184+0000 mon.c (mon.1) 516 : audit [DBG] from='client.? 172.21.15.132:0/2325273951' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:18:46.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:18:46 smithi132 bash[27079]: audit 2020-07-16T16:18:44.927918+0000 mgr.x (mgr.34562) 7698 : audit [DBG] from='client.30238 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:18:46.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:18:46 smithi132 bash[27079]: audit 2020-07-16T16:18:45.195269+0000 mgr.x (mgr.34562) 7699 : audit [DBG] from='client.30244 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:18:46.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:18:46 smithi188 bash[23329]: audit 2020-07-16T16:18:44.927918+0000 mgr.x (mgr.34562) 7698 : audit [DBG] from='client.30238 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:18:46.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:18:46 smithi188 bash[23329]: audit 2020-07-16T16:18:45.195269+0000 mgr.x (mgr.34562) 7699 : audit [DBG] from='client.30244 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:18:47.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:18:47 smithi132 bash[27079]: cluster 2020-07-16T16:18:45.649841+0000 mgr.x (mgr.34562) 7700 : cluster [DBG] pgmap v4802: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:18:47.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:18:47 smithi188 bash[23329]: cluster 2020-07-16T16:18:45.649841+0000 mgr.x (mgr.34562) 7700 : cluster [DBG] pgmap v4802: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:18:49.784 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:18:49 smithi132 bash[27079]: cluster 2020-07-16T16:18:47.650394+0000 mgr.x (mgr.34562) 7701 : cluster [DBG] pgmap v4803: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:18:49.785 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:18:49 smithi132 bash[27079]: audit 2020-07-16T16:18:48.986454+0000 mon.b (mon.2) 1640 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:18:49.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:18:49 smithi188 bash[23329]: cluster 2020-07-16T16:18:47.650394+0000 mgr.x (mgr.34562) 7701 : cluster [DBG] pgmap v4803: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:18:49.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:18:49 smithi188 bash[23329]: audit 2020-07-16T16:18:48.986454+0000 mon.b (mon.2) 1640 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:18:50.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:18:50 smithi188 bash[23329]: cephadm 2020-07-16T16:18:48.987149+0000 mgr.x (mgr.34562) 7702 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:18:50.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:18:50 smithi188 bash[23329]: cephadm 2020-07-16T16:18:48.987569+0000 mgr.x (mgr.34562) 7703 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:18:51.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:18:50 smithi132 bash[27079]: cephadm 2020-07-16T16:18:48.987149+0000 mgr.x (mgr.34562) 7702 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:18:51.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:18:50 smithi132 bash[27079]: cephadm 2020-07-16T16:18:48.987569+0000 mgr.x (mgr.34562) 7703 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:18:51.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:18:51 smithi188 bash[23329]: cluster 2020-07-16T16:18:49.650786+0000 mgr.x (mgr.34562) 7704 : cluster [DBG] pgmap v4804: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:18:52.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:18:51 smithi132 bash[27079]: cluster 2020-07-16T16:18:49.650786+0000 mgr.x (mgr.34562) 7704 : cluster [DBG] pgmap v4804: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:18:53.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:18:53 smithi188 bash[23329]: cluster 2020-07-16T16:18:51.651187+0000 mgr.x (mgr.34562) 7705 : cluster [DBG] pgmap v4805: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:18:54.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:18:53 smithi132 bash[27079]: cluster 2020-07-16T16:18:51.651187+0000 mgr.x (mgr.34562) 7705 : cluster [DBG] pgmap v4805: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:18:55.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:18:55 smithi188 bash[23329]: cluster 2020-07-16T16:18:53.651688+0000 mgr.x (mgr.34562) 7706 : cluster [DBG] pgmap v4806: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:18:56.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:18:55 smithi132 bash[27079]: cluster 2020-07-16T16:18:53.651688+0000 mgr.x (mgr.34562) 7706 : cluster [DBG] pgmap v4806: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:18:57.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:18:57 smithi188 bash[23329]: cluster 2020-07-16T16:18:55.652137+0000 mgr.x (mgr.34562) 7707 : cluster [DBG] pgmap v4807: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:18:58.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:18:57 smithi132 bash[27079]: cluster 2020-07-16T16:18:55.652137+0000 mgr.x (mgr.34562) 7707 : cluster [DBG] pgmap v4807: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:18:58.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:18:58 smithi188 bash[23329]: cluster 2020-07-16T16:18:57.652520+0000 mgr.x (mgr.34562) 7708 : cluster [DBG] pgmap v4808: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:18:59.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:18:58 smithi132 bash[27079]: cluster 2020-07-16T16:18:57.652520+0000 mgr.x (mgr.34562) 7708 : cluster [DBG] pgmap v4808: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:19:01.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:00 smithi132 bash[27079]: cluster 2020-07-16T16:18:59.653046+0000 mgr.x (mgr.34562) 7709 : cluster [DBG] pgmap v4809: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:19:01.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:00 smithi188 bash[23329]: cluster 2020-07-16T16:18:59.653046+0000 mgr.x (mgr.34562) 7709 : cluster [DBG] pgmap v4809: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:19:03.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:03 smithi188 bash[23329]: cluster 2020-07-16T16:19:01.653575+0000 mgr.x (mgr.34562) 7710 : cluster [DBG] pgmap v4810: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:19:03.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:03 smithi132 bash[27079]: cluster 2020-07-16T16:19:01.653575+0000 mgr.x (mgr.34562) 7710 : cluster [DBG] pgmap v4810: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:19:04.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:04 smithi188 bash[23329]: audit 2020-07-16T16:19:04.003133+0000 mon.b (mon.2) 1641 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:19:04.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:04 smithi132 bash[27079]: audit 2020-07-16T16:19:04.003133+0000 mon.b (mon.2) 1641 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:19:05.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:05 smithi188 bash[23329]: cluster 2020-07-16T16:19:03.654107+0000 mgr.x (mgr.34562) 7711 : cluster [DBG] pgmap v4811: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:19:05.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:05 smithi188 bash[23329]: cephadm 2020-07-16T16:19:04.003843+0000 mgr.x (mgr.34562) 7712 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:19:05.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:05 smithi188 bash[23329]: cephadm 2020-07-16T16:19:04.004003+0000 mgr.x (mgr.34562) 7713 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:19:05.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:05 smithi132 bash[27079]: cluster 2020-07-16T16:19:03.654107+0000 mgr.x (mgr.34562) 7711 : cluster [DBG] pgmap v4811: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:19:05.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:05 smithi132 bash[27079]: cephadm 2020-07-16T16:19:04.003843+0000 mgr.x (mgr.34562) 7712 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:19:05.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:05 smithi132 bash[27079]: cephadm 2020-07-16T16:19:04.004003+0000 mgr.x (mgr.34562) 7713 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:19:07.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:07 smithi188 bash[23329]: cluster 2020-07-16T16:19:05.654545+0000 mgr.x (mgr.34562) 7714 : cluster [DBG] pgmap v4812: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:19:07.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:07 smithi132 bash[27079]: cluster 2020-07-16T16:19:05.654545+0000 mgr.x (mgr.34562) 7714 : cluster [DBG] pgmap v4812: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:19:09.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:09 smithi188 bash[23329]: cluster 2020-07-16T16:19:07.654999+0000 mgr.x (mgr.34562) 7715 : cluster [DBG] pgmap v4813: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:19:09.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:09 smithi132 bash[27079]: cluster 2020-07-16T16:19:07.654999+0000 mgr.x (mgr.34562) 7715 : cluster [DBG] pgmap v4813: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:19:11.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:11 smithi188 bash[23329]: cluster 2020-07-16T16:19:09.655486+0000 mgr.x (mgr.34562) 7716 : cluster [DBG] pgmap v4814: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:19:11.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:11 smithi132 bash[27079]: cluster 2020-07-16T16:19:09.655486+0000 mgr.x (mgr.34562) 7716 : cluster [DBG] pgmap v4814: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:19:13.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:13 smithi188 bash[23329]: cluster 2020-07-16T16:19:11.655861+0000 mgr.x (mgr.34562) 7717 : cluster [DBG] pgmap v4815: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:19:13.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:13 smithi132 bash[27079]: cluster 2020-07-16T16:19:11.655861+0000 mgr.x (mgr.34562) 7717 : cluster [DBG] pgmap v4815: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:19:15.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:15 smithi188 bash[23329]: cluster 2020-07-16T16:19:13.656335+0000 mgr.x (mgr.34562) 7718 : cluster [DBG] pgmap v4816: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:19:15.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:15 smithi132 bash[27079]: cluster 2020-07-16T16:19:13.656335+0000 mgr.x (mgr.34562) 7718 : cluster [DBG] pgmap v4816: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:19:15.793 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:19:16.052 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:19:16.053 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 2m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:19:16.053 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 2m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:19:16.053 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 2m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:19:16.054 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 2m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:19:16.054 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 2m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:19:16.054 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:19:16.054 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:19:16.054 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 2m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:19:16.055 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 2m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:19:16.055 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:19:16.055 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:19:16.055 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:19:16.055 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:19:16.056 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:19:16.056 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:19:16.056 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:19:16.056 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:19:16.056 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 2m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:19:16.356 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:19:16.357 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:19:16.357 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:19:16.357 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:19:16.357 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:19:16.358 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:19:16.358 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:19:16.358 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:19:16.358 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:19:16.358 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:19:16.359 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:19:16.359 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:19:16.359 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:19:16.359 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:19:16.359 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:19:16.360 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:19:16.360 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:19:17.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:17 smithi188 bash[23329]: cluster 2020-07-16T16:19:15.656710+0000 mgr.x (mgr.34562) 7719 : cluster [DBG] pgmap v4817: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:19:17.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:17 smithi188 bash[23329]: audit 2020-07-16T16:19:15.782418+0000 mgr.x (mgr.34562) 7720 : audit [DBG] from='client.30256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:19:17.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:17 smithi188 bash[23329]: audit 2020-07-16T16:19:16.048244+0000 mgr.x (mgr.34562) 7721 : audit [DBG] from='client.30262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:19:17.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:17 smithi188 bash[23329]: audit 2020-07-16T16:19:16.355660+0000 mon.c (mon.1) 517 : audit [DBG] from='client.? 172.21.15.132:0/2731508480' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:19:17.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:17 smithi132 bash[27079]: cluster 2020-07-16T16:19:15.656710+0000 mgr.x (mgr.34562) 7719 : cluster [DBG] pgmap v4817: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:19:17.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:17 smithi132 bash[27079]: audit 2020-07-16T16:19:15.782418+0000 mgr.x (mgr.34562) 7720 : audit [DBG] from='client.30256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:19:17.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:17 smithi132 bash[27079]: audit 2020-07-16T16:19:16.048244+0000 mgr.x (mgr.34562) 7721 : audit [DBG] from='client.30262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:19:17.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:17 smithi132 bash[27079]: audit 2020-07-16T16:19:16.355660+0000 mon.c (mon.1) 517 : audit [DBG] from='client.? 172.21.15.132:0/2731508480' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:19:19.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:19 smithi188 bash[23329]: cluster 2020-07-16T16:19:17.657312+0000 mgr.x (mgr.34562) 7722 : cluster [DBG] pgmap v4818: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:19:19.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:19 smithi132 bash[27079]: cluster 2020-07-16T16:19:17.657312+0000 mgr.x (mgr.34562) 7722 : cluster [DBG] pgmap v4818: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:19:20.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:20 smithi188 bash[23329]: audit 2020-07-16T16:19:19.251850+0000 mon.b (mon.2) 1642 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T16:17:12.761603\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.761663\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.761698\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.761728\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.761908\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.762010\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.762108\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.762206\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.762238\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T16:17:12.762339\", \"last_device_update\": \"2020-07-16T16:05:32.972399\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T16:19:19.250999\"}"}]: dispatch 2020-07-16T16:19:20.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:20 smithi188 bash[23329]: audit 2020-07-16T16:19:19.252394+0000 mon.c (mon.1) 518 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T16:17:12.761603\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.761663\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.761698\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.761728\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.761908\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.762010\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.762108\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.762206\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.762238\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T16:17:12.762339\", \"last_device_update\": \"2020-07-16T16:05:32.972399\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T16:19:19.250999\"}"}]: dispatch 2020-07-16T16:19:20.422 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:20 smithi188 bash[23329]: audit 2020-07-16T16:19:19.257474+0000 mon.c (mon.1) 519 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T16:17:12.761603\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.761663\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.761698\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.761728\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.761908\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.762010\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.762108\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.762206\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.762238\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T16:17:12.762339\", \"last_device_update\": \"2020-07-16T16:05:32.972399\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T16:19:19.250999\"}"}]': finished 2020-07-16T16:19:20.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:20 smithi188 bash[23329]: audit 2020-07-16T16:19:19.258180+0000 mon.b (mon.2) 1643 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.183924\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.183997\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184028\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184191\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184317\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184422\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184524\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184558\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184602\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T16:17:13.184670\", \"last_device_update\": \"2020-07-16T16:06:41.170725\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T16:19:19.255976\"}"}]: dispatch 2020-07-16T16:19:20.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:20 smithi188 bash[23329]: audit 2020-07-16T16:19:19.258464+0000 mon.c (mon.1) 520 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.183924\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.183997\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184028\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184191\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184317\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184422\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184524\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184558\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184602\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T16:17:13.184670\", \"last_device_update\": \"2020-07-16T16:06:41.170725\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T16:19:19.255976\"}"}]: dispatch 2020-07-16T16:19:20.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:20 smithi188 bash[23329]: audit 2020-07-16T16:19:19.262804+0000 mon.c (mon.1) 521 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.183924\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.183997\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184028\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184191\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184317\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184422\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184524\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184558\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184602\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T16:17:13.184670\", \"last_device_update\": \"2020-07-16T16:06:41.170725\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T16:19:19.255976\"}"}]': finished 2020-07-16T16:19:20.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:20 smithi188 bash[23329]: audit 2020-07-16T16:19:19.265263+0000 mon.b (mon.2) 1644 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:19:20.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:20 smithi188 bash[23329]: audit 2020-07-16T16:19:19.265548+0000 mgr.x (mgr.34562) 7723 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:19:20.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:20 smithi188 bash[23329]: audit 2020-07-16T16:19:19.266216+0000 mon.b (mon.2) 1645 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:19:20.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:20 smithi188 bash[23329]: audit 2020-07-16T16:19:19.266455+0000 mgr.x (mgr.34562) 7724 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:19:20.424 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:20 smithi188 bash[23329]: audit 2020-07-16T16:19:19.267035+0000 mon.b (mon.2) 1646 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:19:20.425 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:20 smithi188 bash[23329]: audit 2020-07-16T16:19:19.267248+0000 mgr.x (mgr.34562) 7725 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:19:20.425 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:20 smithi188 bash[23329]: cephadm 2020-07-16T16:19:19.267769+0000 mgr.x (mgr.34562) 7726 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:19:20.425 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:20 smithi188 bash[23329]: audit 2020-07-16T16:19:19.268062+0000 mon.b (mon.2) 1647 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:19:20.425 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:20 smithi188 bash[23329]: cephadm 2020-07-16T16:19:19.268669+0000 mgr.x (mgr.34562) 7727 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:19:20.425 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:20 smithi188 bash[23329]: audit 2020-07-16T16:19:19.269007+0000 mon.b (mon.2) 1648 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:19:20.426 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:20 smithi188 bash[23329]: cephadm 2020-07-16T16:19:19.269510+0000 mgr.x (mgr.34562) 7728 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:19:20.426 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:20 smithi188 bash[23329]: cephadm 2020-07-16T16:19:19.269711+0000 mgr.x (mgr.34562) 7729 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:19:20.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:20 smithi132 bash[27079]: audit 2020-07-16T16:19:19.251850+0000 mon.b (mon.2) 1642 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T16:17:12.761603\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.761663\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.761698\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.761728\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.761908\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.762010\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.762108\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.762206\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.762238\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T16:17:12.762339\", \"last_device_update\": \"2020-07-16T16:05:32.972399\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T16:19:19.250999\"}"}]: dispatch 2020-07-16T16:19:20.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:20 smithi132 bash[27079]: audit 2020-07-16T16:19:19.252394+0000 mon.c (mon.1) 518 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T16:17:12.761603\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.761663\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.761698\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.761728\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.761908\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.762010\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.762108\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.762206\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.762238\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T16:17:12.762339\", \"last_device_update\": \"2020-07-16T16:05:32.972399\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T16:19:19.250999\"}"}]: dispatch 2020-07-16T16:19:20.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:20 smithi132 bash[27079]: audit 2020-07-16T16:19:19.257474+0000 mon.c (mon.1) 519 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T16:17:12.761603\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.761663\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.761698\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.761728\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.761908\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.762010\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.762108\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.762206\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:12.762238\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T16:17:12.762339\", \"last_device_update\": \"2020-07-16T16:05:32.972399\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T16:19:19.250999\"}"}]': finished 2020-07-16T16:19:20.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:20 smithi132 bash[27079]: audit 2020-07-16T16:19:19.258180+0000 mon.b (mon.2) 1643 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.183924\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.183997\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184028\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184191\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184317\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184422\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184524\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184558\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184602\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T16:17:13.184670\", \"last_device_update\": \"2020-07-16T16:06:41.170725\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T16:19:19.255976\"}"}]: dispatch 2020-07-16T16:19:20.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:20 smithi132 bash[27079]: audit 2020-07-16T16:19:19.258464+0000 mon.c (mon.1) 520 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.183924\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.183997\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184028\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184191\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184317\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184422\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184524\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184558\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184602\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T16:17:13.184670\", \"last_device_update\": \"2020-07-16T16:06:41.170725\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T16:19:19.255976\"}"}]: dispatch 2020-07-16T16:19:20.531 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:20 smithi132 bash[27079]: audit 2020-07-16T16:19:19.262804+0000 mon.c (mon.1) 521 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.183924\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.183997\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184028\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184191\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184317\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184422\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184524\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184558\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:17:13.184602\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T16:17:13.184670\", \"last_device_update\": \"2020-07-16T16:06:41.170725\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T16:19:19.255976\"}"}]': finished 2020-07-16T16:19:20.532 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:20 smithi132 bash[27079]: audit 2020-07-16T16:19:19.265263+0000 mon.b (mon.2) 1644 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:19:20.532 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:20 smithi132 bash[27079]: audit 2020-07-16T16:19:19.265548+0000 mgr.x (mgr.34562) 7723 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:19:20.532 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:20 smithi132 bash[27079]: audit 2020-07-16T16:19:19.266216+0000 mon.b (mon.2) 1645 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:19:20.532 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:20 smithi132 bash[27079]: audit 2020-07-16T16:19:19.266455+0000 mgr.x (mgr.34562) 7724 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:19:20.533 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:20 smithi132 bash[27079]: audit 2020-07-16T16:19:19.267035+0000 mon.b (mon.2) 1646 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:19:20.533 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:20 smithi132 bash[27079]: audit 2020-07-16T16:19:19.267248+0000 mgr.x (mgr.34562) 7725 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:19:20.533 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:20 smithi132 bash[27079]: cephadm 2020-07-16T16:19:19.267769+0000 mgr.x (mgr.34562) 7726 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:19:20.533 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:20 smithi132 bash[27079]: audit 2020-07-16T16:19:19.268062+0000 mon.b (mon.2) 1647 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:19:20.533 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:20 smithi132 bash[27079]: cephadm 2020-07-16T16:19:19.268669+0000 mgr.x (mgr.34562) 7727 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:19:20.534 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:20 smithi132 bash[27079]: audit 2020-07-16T16:19:19.269007+0000 mon.b (mon.2) 1648 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:19:20.534 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:20 smithi132 bash[27079]: cephadm 2020-07-16T16:19:19.269510+0000 mgr.x (mgr.34562) 7728 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:19:20.534 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:20 smithi132 bash[27079]: cephadm 2020-07-16T16:19:19.269711+0000 mgr.x (mgr.34562) 7729 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:19:21.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:21 smithi132 bash[27079]: cluster 2020-07-16T16:19:19.657832+0000 mgr.x (mgr.34562) 7730 : cluster [DBG] pgmap v4819: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:19:21.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:21 smithi188 bash[23329]: cluster 2020-07-16T16:19:19.657832+0000 mgr.x (mgr.34562) 7730 : cluster [DBG] pgmap v4819: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:19:22.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:22 smithi132 bash[27079]: audit 2020-07-16T16:19:22.191612+0000 mon.b (mon.2) 1649 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:19:22.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:22 smithi188 bash[23329]: audit 2020-07-16T16:19:22.191612+0000 mon.b (mon.2) 1649 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:19:23.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:23 smithi132 bash[27079]: cluster 2020-07-16T16:19:21.658232+0000 mgr.x (mgr.34562) 7731 : cluster [DBG] pgmap v4820: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:19:23.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:23 smithi132 bash[27079]: cephadm 2020-07-16T16:19:22.192237+0000 mgr.x (mgr.34562) 7732 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:19:23.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:23 smithi132 bash[27079]: cephadm 2020-07-16T16:19:22.192332+0000 mgr.x (mgr.34562) 7733 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:19:23.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:23 smithi188 bash[23329]: cluster 2020-07-16T16:19:21.658232+0000 mgr.x (mgr.34562) 7731 : cluster [DBG] pgmap v4820: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:19:23.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:23 smithi188 bash[23329]: cephadm 2020-07-16T16:19:22.192237+0000 mgr.x (mgr.34562) 7732 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:19:23.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:23 smithi188 bash[23329]: cephadm 2020-07-16T16:19:22.192332+0000 mgr.x (mgr.34562) 7733 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:19:25.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:25 smithi188 bash[23329]: cluster 2020-07-16T16:19:23.658639+0000 mgr.x (mgr.34562) 7734 : cluster [DBG] pgmap v4821: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:19:25.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:25 smithi132 bash[27079]: cluster 2020-07-16T16:19:23.658639+0000 mgr.x (mgr.34562) 7734 : cluster [DBG] pgmap v4821: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:19:27.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:27 smithi188 bash[23329]: cluster 2020-07-16T16:19:25.659030+0000 mgr.x (mgr.34562) 7735 : cluster [DBG] pgmap v4822: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:19:27.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:27 smithi132 bash[27079]: cluster 2020-07-16T16:19:25.659030+0000 mgr.x (mgr.34562) 7735 : cluster [DBG] pgmap v4822: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:19:29.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:29 smithi188 bash[23329]: cluster 2020-07-16T16:19:27.659545+0000 mgr.x (mgr.34562) 7736 : cluster [DBG] pgmap v4823: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:19:29.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:29 smithi132 bash[27079]: cluster 2020-07-16T16:19:27.659545+0000 mgr.x (mgr.34562) 7736 : cluster [DBG] pgmap v4823: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:19:31.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:31 smithi188 bash[23329]: cluster 2020-07-16T16:19:29.659894+0000 mgr.x (mgr.34562) 7737 : cluster [DBG] pgmap v4824: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:19:31.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:31 smithi132 bash[27079]: cluster 2020-07-16T16:19:29.659894+0000 mgr.x (mgr.34562) 7737 : cluster [DBG] pgmap v4824: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:19:33.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:33 smithi188 bash[23329]: cluster 2020-07-16T16:19:31.660435+0000 mgr.x (mgr.34562) 7738 : cluster [DBG] pgmap v4825: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:19:33.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:33 smithi132 bash[27079]: cluster 2020-07-16T16:19:31.660435+0000 mgr.x (mgr.34562) 7738 : cluster [DBG] pgmap v4825: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:19:35.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:35 smithi188 bash[23329]: cluster 2020-07-16T16:19:33.660813+0000 mgr.x (mgr.34562) 7739 : cluster [DBG] pgmap v4826: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:19:35.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:35 smithi132 bash[27079]: cluster 2020-07-16T16:19:33.660813+0000 mgr.x (mgr.34562) 7739 : cluster [DBG] pgmap v4826: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:19:37.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:37 smithi188 bash[23329]: cluster 2020-07-16T16:19:35.661328+0000 mgr.x (mgr.34562) 7740 : cluster [DBG] pgmap v4827: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:19:37.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:37 smithi188 bash[23329]: audit 2020-07-16T16:19:37.208182+0000 mon.b (mon.2) 1650 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:19:37.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:37 smithi132 bash[27079]: cluster 2020-07-16T16:19:35.661328+0000 mgr.x (mgr.34562) 7740 : cluster [DBG] pgmap v4827: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:19:37.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:37 smithi132 bash[27079]: audit 2020-07-16T16:19:37.208182+0000 mon.b (mon.2) 1650 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:19:38.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:38 smithi188 bash[23329]: cephadm 2020-07-16T16:19:37.208886+0000 mgr.x (mgr.34562) 7741 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:19:38.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:38 smithi188 bash[23329]: cephadm 2020-07-16T16:19:37.209035+0000 mgr.x (mgr.34562) 7742 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:19:38.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:38 smithi132 bash[27079]: cephadm 2020-07-16T16:19:37.208886+0000 mgr.x (mgr.34562) 7741 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:19:38.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:38 smithi132 bash[27079]: cephadm 2020-07-16T16:19:37.209035+0000 mgr.x (mgr.34562) 7742 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:19:39.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:39 smithi188 bash[23329]: cluster 2020-07-16T16:19:37.661721+0000 mgr.x (mgr.34562) 7743 : cluster [DBG] pgmap v4828: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:19:39.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:39 smithi132 bash[27079]: cluster 2020-07-16T16:19:37.661721+0000 mgr.x (mgr.34562) 7743 : cluster [DBG] pgmap v4828: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:19:41.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:41 smithi188 bash[23329]: cluster 2020-07-16T16:19:39.662220+0000 mgr.x (mgr.34562) 7744 : cluster [DBG] pgmap v4829: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:19:41.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:41 smithi132 bash[27079]: cluster 2020-07-16T16:19:39.662220+0000 mgr.x (mgr.34562) 7744 : cluster [DBG] pgmap v4829: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:19:43.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:43 smithi188 bash[23329]: cluster 2020-07-16T16:19:41.662630+0000 mgr.x (mgr.34562) 7745 : cluster [DBG] pgmap v4830: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:19:43.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:43 smithi132 bash[27079]: cluster 2020-07-16T16:19:41.662630+0000 mgr.x (mgr.34562) 7745 : cluster [DBG] pgmap v4830: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:19:45.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:45 smithi188 bash[23329]: cluster 2020-07-16T16:19:43.663095+0000 mgr.x (mgr.34562) 7746 : cluster [DBG] pgmap v4831: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:19:45.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:45 smithi132 bash[27079]: cluster 2020-07-16T16:19:43.663095+0000 mgr.x (mgr.34562) 7746 : cluster [DBG] pgmap v4831: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:19:46.655 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:19:46.916 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:19:46.916 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 2m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:19:46.917 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 2m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:19:46.917 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 2m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:19:46.917 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 2m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:19:46.917 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 2m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:19:46.917 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:19:46.918 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:19:46.918 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 2m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:19:46.918 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 2m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:19:46.918 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:19:46.918 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:19:46.919 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:19:46.919 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:19:46.919 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:19:46.919 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:19:46.919 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:19:46.920 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:19:46.920 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 2m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:19:47.213 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:19:47.213 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:19:47.214 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:19:47.214 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:19:47.214 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:19:47.214 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:19:47.214 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:19:47.215 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:19:47.215 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:19:47.215 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:19:47.215 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:19:47.215 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:19:47.215 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:19:47.216 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:19:47.216 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:19:47.216 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:19:47.216 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:19:47.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:47 smithi188 bash[23329]: cluster 2020-07-16T16:19:45.663584+0000 mgr.x (mgr.34562) 7747 : cluster [DBG] pgmap v4832: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:19:47.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:47 smithi188 bash[23329]: audit 2020-07-16T16:19:47.212422+0000 mon.c (mon.1) 522 : audit [DBG] from='client.? 172.21.15.132:0/1256007308' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:19:47.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:47 smithi132 bash[27079]: cluster 2020-07-16T16:19:45.663584+0000 mgr.x (mgr.34562) 7747 : cluster [DBG] pgmap v4832: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:19:47.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:47 smithi132 bash[27079]: audit 2020-07-16T16:19:47.212422+0000 mon.c (mon.1) 522 : audit [DBG] from='client.? 172.21.15.132:0/1256007308' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:19:48.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:48 smithi188 bash[23329]: audit 2020-07-16T16:19:46.643332+0000 mgr.x (mgr.34562) 7748 : audit [DBG] from='client.30274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:19:48.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:48 smithi188 bash[23329]: audit 2020-07-16T16:19:46.912110+0000 mgr.x (mgr.34562) 7749 : audit [DBG] from='client.30280 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:19:48.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:48 smithi132 bash[27079]: audit 2020-07-16T16:19:46.643332+0000 mgr.x (mgr.34562) 7748 : audit [DBG] from='client.30274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:19:48.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:48 smithi132 bash[27079]: audit 2020-07-16T16:19:46.912110+0000 mgr.x (mgr.34562) 7749 : audit [DBG] from='client.30280 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:19:49.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:49 smithi188 bash[23329]: cluster 2020-07-16T16:19:47.663952+0000 mgr.x (mgr.34562) 7750 : cluster [DBG] pgmap v4833: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:19:49.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:49 smithi132 bash[27079]: cluster 2020-07-16T16:19:47.663952+0000 mgr.x (mgr.34562) 7750 : cluster [DBG] pgmap v4833: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:19:51.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:51 smithi188 bash[23329]: cluster 2020-07-16T16:19:49.664434+0000 mgr.x (mgr.34562) 7751 : cluster [DBG] pgmap v4834: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:19:51.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:51 smithi132 bash[27079]: cluster 2020-07-16T16:19:49.664434+0000 mgr.x (mgr.34562) 7751 : cluster [DBG] pgmap v4834: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:19:52.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:52 smithi188 bash[23329]: audit 2020-07-16T16:19:52.224667+0000 mon.b (mon.2) 1651 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:19:52.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:52 smithi132 bash[27079]: audit 2020-07-16T16:19:52.224667+0000 mon.b (mon.2) 1651 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:19:53.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:53 smithi188 bash[23329]: cluster 2020-07-16T16:19:51.664836+0000 mgr.x (mgr.34562) 7752 : cluster [DBG] pgmap v4835: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:19:53.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:53 smithi188 bash[23329]: cephadm 2020-07-16T16:19:52.225350+0000 mgr.x (mgr.34562) 7753 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:19:53.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:53 smithi188 bash[23329]: cephadm 2020-07-16T16:19:52.225763+0000 mgr.x (mgr.34562) 7754 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:19:53.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:53 smithi132 bash[27079]: cluster 2020-07-16T16:19:51.664836+0000 mgr.x (mgr.34562) 7752 : cluster [DBG] pgmap v4835: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:19:53.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:53 smithi132 bash[27079]: cephadm 2020-07-16T16:19:52.225350+0000 mgr.x (mgr.34562) 7753 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:19:53.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:53 smithi132 bash[27079]: cephadm 2020-07-16T16:19:52.225763+0000 mgr.x (mgr.34562) 7754 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:19:55.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:55 smithi188 bash[23329]: cluster 2020-07-16T16:19:53.665210+0000 mgr.x (mgr.34562) 7755 : cluster [DBG] pgmap v4836: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:19:55.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:55 smithi132 bash[27079]: cluster 2020-07-16T16:19:53.665210+0000 mgr.x (mgr.34562) 7755 : cluster [DBG] pgmap v4836: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:19:57.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:57 smithi188 bash[23329]: cluster 2020-07-16T16:19:55.665649+0000 mgr.x (mgr.34562) 7756 : cluster [DBG] pgmap v4837: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:19:57.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:57 smithi132 bash[27079]: cluster 2020-07-16T16:19:55.665649+0000 mgr.x (mgr.34562) 7756 : cluster [DBG] pgmap v4837: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:19:59.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:19:59 smithi188 bash[23329]: cluster 2020-07-16T16:19:57.666026+0000 mgr.x (mgr.34562) 7757 : cluster [DBG] pgmap v4838: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:19:59.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:19:59 smithi132 bash[27079]: cluster 2020-07-16T16:19:57.666026+0000 mgr.x (mgr.34562) 7757 : cluster [DBG] pgmap v4838: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:20:01.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:20:01 smithi188 bash[23329]: cluster 2020-07-16T16:19:59.666389+0000 mgr.x (mgr.34562) 7758 : cluster [DBG] pgmap v4839: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:20:01.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:20:01 smithi132 bash[27079]: cluster 2020-07-16T16:19:59.666389+0000 mgr.x (mgr.34562) 7758 : cluster [DBG] pgmap v4839: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:20:03.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:20:03 smithi188 bash[23329]: cluster 2020-07-16T16:20:01.666745+0000 mgr.x (mgr.34562) 7759 : cluster [DBG] pgmap v4840: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:20:03.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:20:03 smithi132 bash[27079]: cluster 2020-07-16T16:20:01.666745+0000 mgr.x (mgr.34562) 7759 : cluster [DBG] pgmap v4840: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:20:05.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:20:05 smithi188 bash[23329]: cluster 2020-07-16T16:20:03.667258+0000 mgr.x (mgr.34562) 7760 : cluster [DBG] pgmap v4841: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:20:05.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:20:05 smithi132 bash[27079]: cluster 2020-07-16T16:20:03.667258+0000 mgr.x (mgr.34562) 7760 : cluster [DBG] pgmap v4841: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:20:07.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:20:07 smithi188 bash[23329]: cluster 2020-07-16T16:20:05.667746+0000 mgr.x (mgr.34562) 7761 : cluster [DBG] pgmap v4842: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:20:07.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:20:07 smithi188 bash[23329]: audit 2020-07-16T16:20:07.241239+0000 mon.b (mon.2) 1652 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:20:07.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:20:07 smithi132 bash[27079]: cluster 2020-07-16T16:20:05.667746+0000 mgr.x (mgr.34562) 7761 : cluster [DBG] pgmap v4842: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:20:07.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:20:07 smithi132 bash[27079]: audit 2020-07-16T16:20:07.241239+0000 mon.b (mon.2) 1652 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:20:08.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:20:08 smithi188 bash[23329]: cephadm 2020-07-16T16:20:07.241960+0000 mgr.x (mgr.34562) 7762 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:20:08.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:20:08 smithi188 bash[23329]: cephadm 2020-07-16T16:20:07.242377+0000 mgr.x (mgr.34562) 7763 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:20:08.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:20:08 smithi132 bash[27079]: cephadm 2020-07-16T16:20:07.241960+0000 mgr.x (mgr.34562) 7762 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:20:08.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:20:08 smithi132 bash[27079]: cephadm 2020-07-16T16:20:07.242377+0000 mgr.x (mgr.34562) 7763 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:20:09.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:20:09 smithi188 bash[23329]: cluster 2020-07-16T16:20:07.668305+0000 mgr.x (mgr.34562) 7764 : cluster [DBG] pgmap v4843: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:20:09.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:20:09 smithi132 bash[27079]: cluster 2020-07-16T16:20:07.668305+0000 mgr.x (mgr.34562) 7764 : cluster [DBG] pgmap v4843: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:20:11.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:20:11 smithi188 bash[23329]: cluster 2020-07-16T16:20:09.668632+0000 mgr.x (mgr.34562) 7765 : cluster [DBG] pgmap v4844: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:20:11.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:20:11 smithi132 bash[27079]: cluster 2020-07-16T16:20:09.668632+0000 mgr.x (mgr.34562) 7765 : cluster [DBG] pgmap v4844: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:20:13.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:20:13 smithi188 bash[23329]: cluster 2020-07-16T16:20:11.669006+0000 mgr.x (mgr.34562) 7766 : cluster [DBG] pgmap v4845: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:20:13.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:20:13 smithi132 bash[27079]: cluster 2020-07-16T16:20:11.669006+0000 mgr.x (mgr.34562) 7766 : cluster [DBG] pgmap v4845: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:20:15.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:20:15 smithi188 bash[23329]: cluster 2020-07-16T16:20:13.669427+0000 mgr.x (mgr.34562) 7767 : cluster [DBG] pgmap v4846: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:20:15.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:20:15 smithi132 bash[27079]: cluster 2020-07-16T16:20:13.669427+0000 mgr.x (mgr.34562) 7767 : cluster [DBG] pgmap v4846: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:20:17.512 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:20:17.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:20:17 smithi188 bash[23329]: cluster 2020-07-16T16:20:15.669797+0000 mgr.x (mgr.34562) 7768 : cluster [DBG] pgmap v4847: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:20:17.775 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:20:17.790 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 3m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:20:17.791 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 3m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:20:17.791 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 3m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:20:17.791 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 3m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:20:17.791 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 3m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:20:17.791 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:20:17.792 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:20:17.792 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 3m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:20:17.792 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 3m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:20:17.792 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:20:17.792 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:20:17.793 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:20:17.793 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:20:17.793 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:20:17.793 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:20:17.793 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:20:17.794 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:20:17.794 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 3m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:20:17.794 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:20:17 smithi132 bash[27079]: cluster 2020-07-16T16:20:15.669797+0000 mgr.x (mgr.34562) 7768 : cluster [DBG] pgmap v4847: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:20:18.073 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:20:18.073 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:20:18.073 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:20:18.074 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:20:18.074 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:20:18.074 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:20:18.074 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:20:18.074 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:20:18.075 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:20:18.075 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:20:18.075 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:20:18.075 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:20:18.075 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:20:18.076 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:20:18.076 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:20:18.076 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:20:18.076 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:20:18.664 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:20:18 smithi188 bash[23329]: audit 2020-07-16T16:20:17.501127+0000 mgr.x (mgr.34562) 7769 : audit [DBG] from='client.30292 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:20:18.665 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:20:18 smithi188 bash[23329]: audit 2020-07-16T16:20:18.072245+0000 mon.c (mon.1) 523 : audit [DBG] from='client.? 172.21.15.132:0/1160293947' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:20:18.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:20:18 smithi132 bash[27079]: audit 2020-07-16T16:20:17.501127+0000 mgr.x (mgr.34562) 7769 : audit [DBG] from='client.30292 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:20:18.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:20:18 smithi132 bash[27079]: audit 2020-07-16T16:20:18.072245+0000 mon.c (mon.1) 523 : audit [DBG] from='client.? 172.21.15.132:0/1160293947' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:20:19.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:20:19 smithi188 bash[23329]: cluster 2020-07-16T16:20:17.670264+0000 mgr.x (mgr.34562) 7770 : cluster [DBG] pgmap v4848: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:20:19.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:20:19 smithi188 bash[23329]: audit 2020-07-16T16:20:17.770832+0000 mgr.x (mgr.34562) 7771 : audit [DBG] from='client.30298 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:20:19.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:20:19 smithi132 bash[27079]: cluster 2020-07-16T16:20:17.670264+0000 mgr.x (mgr.34562) 7770 : cluster [DBG] pgmap v4848: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:20:19.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:20:19 smithi132 bash[27079]: audit 2020-07-16T16:20:17.770832+0000 mgr.x (mgr.34562) 7771 : audit [DBG] from='client.30298 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:20:21.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:20:21 smithi188 bash[23329]: cluster 2020-07-16T16:20:19.670614+0000 mgr.x (mgr.34562) 7772 : cluster [DBG] pgmap v4849: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:20:21.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:20:21 smithi132 bash[27079]: cluster 2020-07-16T16:20:19.670614+0000 mgr.x (mgr.34562) 7772 : cluster [DBG] pgmap v4849: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:20:22.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:20:22 smithi188 bash[23329]: audit 2020-07-16T16:20:22.260293+0000 mon.b (mon.2) 1653 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:20:22.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:20:22 smithi188 bash[23329]: audit 2020-07-16T16:20:22.261649+0000 mon.b (mon.2) 1654 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:20:22.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:20:22 smithi188 bash[23329]: audit 2020-07-16T16:20:22.262889+0000 mon.b (mon.2) 1655 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:20:22.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:20:22 smithi188 bash[23329]: audit 2020-07-16T16:20:22.264361+0000 mon.b (mon.2) 1656 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:20:22.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:20:22 smithi188 bash[23329]: audit 2020-07-16T16:20:22.265843+0000 mon.b (mon.2) 1657 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:20:22.734 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:20:22 smithi132 bash[27079]: audit 2020-07-16T16:20:22.260293+0000 mon.b (mon.2) 1653 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:20:22.735 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:20:22 smithi132 bash[27079]: audit 2020-07-16T16:20:22.261649+0000 mon.b (mon.2) 1654 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:20:22.735 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:20:22 smithi132 bash[27079]: audit 2020-07-16T16:20:22.262889+0000 mon.b (mon.2) 1655 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:20:22.735 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:20:22 smithi132 bash[27079]: audit 2020-07-16T16:20:22.264361+0000 mon.b (mon.2) 1656 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:20:22.735 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:20:22 smithi132 bash[27079]: audit 2020-07-16T16:20:22.265843+0000 mon.b (mon.2) 1657 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:20:23.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:20:23 smithi188 bash[23329]: cluster 2020-07-16T16:20:21.670974+0000 mgr.x (mgr.34562) 7773 : cluster [DBG] pgmap v4850: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:20:23.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:20:23 smithi188 bash[23329]: audit 2020-07-16T16:20:22.260651+0000 mgr.x (mgr.34562) 7774 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:20:23.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:20:23 smithi188 bash[23329]: audit 2020-07-16T16:20:22.261993+0000 mgr.x (mgr.34562) 7775 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:20:23.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:20:23 smithi188 bash[23329]: audit 2020-07-16T16:20:22.263188+0000 mgr.x (mgr.34562) 7776 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:20:23.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:20:23 smithi188 bash[23329]: cephadm 2020-07-16T16:20:22.263914+0000 mgr.x (mgr.34562) 7777 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:20:23.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:20:23 smithi188 bash[23329]: cephadm 2020-07-16T16:20:22.265263+0000 mgr.x (mgr.34562) 7778 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:20:23.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:20:23 smithi188 bash[23329]: cephadm 2020-07-16T16:20:22.266565+0000 mgr.x (mgr.34562) 7779 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:20:23.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:20:23 smithi188 bash[23329]: cephadm 2020-07-16T16:20:22.266806+0000 mgr.x (mgr.34562) 7780 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:20:23.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:20:23 smithi132 bash[27079]: cluster 2020-07-16T16:20:21.670974+0000 mgr.x (mgr.34562) 7773 : cluster [DBG] pgmap v4850: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:20:23.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:20:23 smithi132 bash[27079]: audit 2020-07-16T16:20:22.260651+0000 mgr.x (mgr.34562) 7774 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:20:23.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:20:23 smithi132 bash[27079]: audit 2020-07-16T16:20:22.261993+0000 mgr.x (mgr.34562) 7775 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:20:23.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:20:23 smithi132 bash[27079]: audit 2020-07-16T16:20:22.263188+0000 mgr.x (mgr.34562) 7776 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:20:23.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:20:23 smithi132 bash[27079]: cephadm 2020-07-16T16:20:22.263914+0000 mgr.x (mgr.34562) 7777 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:20:23.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:20:23 smithi132 bash[27079]: cephadm 2020-07-16T16:20:22.265263+0000 mgr.x (mgr.34562) 7778 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:20:23.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:20:23 smithi132 bash[27079]: cephadm 2020-07-16T16:20:22.266565+0000 mgr.x (mgr.34562) 7779 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:20:23.781 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:20:23 smithi132 bash[27079]: cephadm 2020-07-16T16:20:22.266806+0000 mgr.x (mgr.34562) 7780 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:20:25.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:20:25 smithi188 bash[23329]: cluster 2020-07-16T16:20:23.671426+0000 mgr.x (mgr.34562) 7781 : cluster [DBG] pgmap v4851: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:20:25.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:20:25 smithi188 bash[23329]: audit 2020-07-16T16:20:25.161027+0000 mon.b (mon.2) 1658 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:20:25.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:20:25 smithi132 bash[27079]: cluster 2020-07-16T16:20:23.671426+0000 mgr.x (mgr.34562) 7781 : cluster [DBG] pgmap v4851: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:20:25.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:20:25 smithi132 bash[27079]: audit 2020-07-16T16:20:25.161027+0000 mon.b (mon.2) 1658 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:20:26.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:20:26 smithi132 bash[27079]: cephadm 2020-07-16T16:20:25.161684+0000 mgr.x (mgr.34562) 7782 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:20:26.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:20:26 smithi132 bash[27079]: cephadm 2020-07-16T16:20:25.162087+0000 mgr.x (mgr.34562) 7783 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:20:26.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:20:26 smithi188 bash[23329]: cephadm 2020-07-16T16:20:25.161684+0000 mgr.x (mgr.34562) 7782 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:20:26.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:20:26 smithi188 bash[23329]: cephadm 2020-07-16T16:20:25.162087+0000 mgr.x (mgr.34562) 7783 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:20:27.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:20:27 smithi132 bash[27079]: cluster 2020-07-16T16:20:25.671736+0000 mgr.x (mgr.34562) 7784 : cluster [DBG] pgmap v4852: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:20:27.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:20:27 smithi188 bash[23329]: cluster 2020-07-16T16:20:25.671736+0000 mgr.x (mgr.34562) 7784 : cluster [DBG] pgmap v4852: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:20:29.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:20:29 smithi132 bash[27079]: cluster 2020-07-16T16:20:27.672084+0000 mgr.x (mgr.34562) 7785 : cluster [DBG] pgmap v4853: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:20:29.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:20:29 smithi188 bash[23329]: cluster 2020-07-16T16:20:27.672084+0000 mgr.x (mgr.34562) 7785 : cluster [DBG] pgmap v4853: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:20:31.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:20:31 smithi132 bash[27079]: cluster 2020-07-16T16:20:29.672598+0000 mgr.x (mgr.34562) 7786 : cluster [DBG] pgmap v4854: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:20:31.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:20:31 smithi188 bash[23329]: cluster 2020-07-16T16:20:29.672598+0000 mgr.x (mgr.34562) 7786 : cluster [DBG] pgmap v4854: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:20:33.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:20:33 smithi132 bash[27079]: cluster 2020-07-16T16:20:31.673206+0000 mgr.x (mgr.34562) 7787 : cluster [DBG] pgmap v4855: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:20:33.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:20:33 smithi188 bash[23329]: cluster 2020-07-16T16:20:31.673206+0000 mgr.x (mgr.34562) 7787 : cluster [DBG] pgmap v4855: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:20:35.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:20:35 smithi132 bash[27079]: cluster 2020-07-16T16:20:33.673666+0000 mgr.x (mgr.34562) 7788 : cluster [DBG] pgmap v4856: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:20:35.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:20:35 smithi188 bash[23329]: cluster 2020-07-16T16:20:33.673666+0000 mgr.x (mgr.34562) 7788 : cluster [DBG] pgmap v4856: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:20:37.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:20:37 smithi132 bash[27079]: cluster 2020-07-16T16:20:35.674052+0000 mgr.x (mgr.34562) 7789 : cluster [DBG] pgmap v4857: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:20:37.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:20:37 smithi188 bash[23329]: cluster 2020-07-16T16:20:35.674052+0000 mgr.x (mgr.34562) 7789 : cluster [DBG] pgmap v4857: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:20:39.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:20:39 smithi132 bash[27079]: cluster 2020-07-16T16:20:37.674458+0000 mgr.x (mgr.34562) 7790 : cluster [DBG] pgmap v4858: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:20:39.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:20:39 smithi188 bash[23329]: cluster 2020-07-16T16:20:37.674458+0000 mgr.x (mgr.34562) 7790 : cluster [DBG] pgmap v4858: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:20:40.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:20:40 smithi132 bash[27079]: audit 2020-07-16T16:20:40.177672+0000 mon.b (mon.2) 1659 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:20:40.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:20:40 smithi188 bash[23329]: audit 2020-07-16T16:20:40.177672+0000 mon.b (mon.2) 1659 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:20:41.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:20:41 smithi132 bash[27079]: cluster 2020-07-16T16:20:39.674902+0000 mgr.x (mgr.34562) 7791 : cluster [DBG] pgmap v4859: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:20:41.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:20:41 smithi132 bash[27079]: cephadm 2020-07-16T16:20:40.178437+0000 mgr.x (mgr.34562) 7792 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:20:41.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:20:41 smithi132 bash[27079]: cephadm 2020-07-16T16:20:40.178850+0000 mgr.x (mgr.34562) 7793 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:20:41.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:20:41 smithi188 bash[23329]: cluster 2020-07-16T16:20:39.674902+0000 mgr.x (mgr.34562) 7791 : cluster [DBG] pgmap v4859: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:20:41.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:20:41 smithi188 bash[23329]: cephadm 2020-07-16T16:20:40.178437+0000 mgr.x (mgr.34562) 7792 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:20:41.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:20:41 smithi188 bash[23329]: cephadm 2020-07-16T16:20:40.178850+0000 mgr.x (mgr.34562) 7793 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:20:43.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:20:43 smithi132 bash[27079]: cluster 2020-07-16T16:20:41.675424+0000 mgr.x (mgr.34562) 7794 : cluster [DBG] pgmap v4860: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:20:43.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:20:43 smithi188 bash[23329]: cluster 2020-07-16T16:20:41.675424+0000 mgr.x (mgr.34562) 7794 : cluster [DBG] pgmap v4860: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:20:45.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:20:45 smithi132 bash[27079]: cluster 2020-07-16T16:20:43.675911+0000 mgr.x (mgr.34562) 7795 : cluster [DBG] pgmap v4861: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:20:45.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:20:45 smithi188 bash[23329]: cluster 2020-07-16T16:20:43.675911+0000 mgr.x (mgr.34562) 7795 : cluster [DBG] pgmap v4861: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:20:47.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:20:47 smithi132 bash[27079]: cluster 2020-07-16T16:20:45.676361+0000 mgr.x (mgr.34562) 7796 : cluster [DBG] pgmap v4862: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:20:47.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:20:47 smithi188 bash[23329]: cluster 2020-07-16T16:20:45.676361+0000 mgr.x (mgr.34562) 7796 : cluster [DBG] pgmap v4862: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:20:48.370 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:20:48.632 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:20:48.633 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 3m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:20:48.633 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 3m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:20:48.633 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 3m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:20:48.633 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 3m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:20:48.633 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 3m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:20:48.634 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:20:48.634 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:20:48.634 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 3m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:20:48.634 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 3m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:20:48.634 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:20:48.635 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:20:48.635 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:20:48.635 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:20:48.635 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:20:48.635 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:20:48.636 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:20:48.636 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:20:48.636 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 3m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:20:48.933 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:20:48.933 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:20:48.933 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:20:48.934 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:20:48.934 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:20:48.934 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:20:48.934 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:20:48.934 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:20:48.935 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:20:48.935 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:20:48.935 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:20:48.935 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:20:48.935 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:20:48.936 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:20:48.936 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:20:48.936 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:20:48.936 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:20:49.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:20:49 smithi132 bash[27079]: cluster 2020-07-16T16:20:47.676776+0000 mgr.x (mgr.34562) 7797 : cluster [DBG] pgmap v4863: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:20:49.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:20:49 smithi132 bash[27079]: audit 2020-07-16T16:20:48.358887+0000 mgr.x (mgr.34562) 7798 : audit [DBG] from='client.30310 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:20:49.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:20:49 smithi132 bash[27079]: audit 2020-07-16T16:20:48.932394+0000 mon.c (mon.1) 524 : audit [DBG] from='client.? 172.21.15.132:0/822306003' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:20:49.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:20:49 smithi188 bash[23329]: cluster 2020-07-16T16:20:47.676776+0000 mgr.x (mgr.34562) 7797 : cluster [DBG] pgmap v4863: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:20:49.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:20:49 smithi188 bash[23329]: audit 2020-07-16T16:20:48.358887+0000 mgr.x (mgr.34562) 7798 : audit [DBG] from='client.30310 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:20:49.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:20:49 smithi188 bash[23329]: audit 2020-07-16T16:20:48.932394+0000 mon.c (mon.1) 524 : audit [DBG] from='client.? 172.21.15.132:0/822306003' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:20:50.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:20:50 smithi132 bash[27079]: audit 2020-07-16T16:20:48.627927+0000 mgr.x (mgr.34562) 7799 : audit [DBG] from='client.30316 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:20:50.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:20:50 smithi188 bash[23329]: audit 2020-07-16T16:20:48.627927+0000 mgr.x (mgr.34562) 7799 : audit [DBG] from='client.30316 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:20:51.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:20:51 smithi132 bash[27079]: cluster 2020-07-16T16:20:49.677125+0000 mgr.x (mgr.34562) 7800 : cluster [DBG] pgmap v4864: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:20:51.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:20:51 smithi188 bash[23329]: cluster 2020-07-16T16:20:49.677125+0000 mgr.x (mgr.34562) 7800 : cluster [DBG] pgmap v4864: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:20:53.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:20:53 smithi132 bash[27079]: cluster 2020-07-16T16:20:51.677502+0000 mgr.x (mgr.34562) 7801 : cluster [DBG] pgmap v4865: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:20:53.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:20:53 smithi188 bash[23329]: cluster 2020-07-16T16:20:51.677502+0000 mgr.x (mgr.34562) 7801 : cluster [DBG] pgmap v4865: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:20:55.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:20:55 smithi132 bash[27079]: cluster 2020-07-16T16:20:53.677907+0000 mgr.x (mgr.34562) 7802 : cluster [DBG] pgmap v4866: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:20:55.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:20:55 smithi132 bash[27079]: audit 2020-07-16T16:20:55.194466+0000 mon.b (mon.2) 1660 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:20:55.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:20:55 smithi188 bash[23329]: cluster 2020-07-16T16:20:53.677907+0000 mgr.x (mgr.34562) 7802 : cluster [DBG] pgmap v4866: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:20:55.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:20:55 smithi188 bash[23329]: audit 2020-07-16T16:20:55.194466+0000 mon.b (mon.2) 1660 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:20:56.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:20:56 smithi132 bash[27079]: cephadm 2020-07-16T16:20:55.195182+0000 mgr.x (mgr.34562) 7803 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:20:56.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:20:56 smithi132 bash[27079]: cephadm 2020-07-16T16:20:55.195605+0000 mgr.x (mgr.34562) 7804 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:20:56.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:20:56 smithi188 bash[23329]: cephadm 2020-07-16T16:20:55.195182+0000 mgr.x (mgr.34562) 7803 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:20:56.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:20:56 smithi188 bash[23329]: cephadm 2020-07-16T16:20:55.195605+0000 mgr.x (mgr.34562) 7804 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:20:57.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:20:57 smithi132 bash[27079]: cluster 2020-07-16T16:20:55.678336+0000 mgr.x (mgr.34562) 7805 : cluster [DBG] pgmap v4867: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:20:57.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:20:57 smithi188 bash[23329]: cluster 2020-07-16T16:20:55.678336+0000 mgr.x (mgr.34562) 7805 : cluster [DBG] pgmap v4867: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:20:59.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:20:59 smithi132 bash[27079]: cluster 2020-07-16T16:20:57.678718+0000 mgr.x (mgr.34562) 7806 : cluster [DBG] pgmap v4868: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:20:59.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:20:59 smithi188 bash[23329]: cluster 2020-07-16T16:20:57.678718+0000 mgr.x (mgr.34562) 7806 : cluster [DBG] pgmap v4868: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:21:01.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:21:01 smithi132 bash[27079]: cluster 2020-07-16T16:20:59.679076+0000 mgr.x (mgr.34562) 7807 : cluster [DBG] pgmap v4869: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:21:01.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:21:01 smithi188 bash[23329]: cluster 2020-07-16T16:20:59.679076+0000 mgr.x (mgr.34562) 7807 : cluster [DBG] pgmap v4869: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:21:03.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:21:03 smithi132 bash[27079]: cluster 2020-07-16T16:21:01.679448+0000 mgr.x (mgr.34562) 7808 : cluster [DBG] pgmap v4870: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:21:03.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:21:03 smithi188 bash[23329]: cluster 2020-07-16T16:21:01.679448+0000 mgr.x (mgr.34562) 7808 : cluster [DBG] pgmap v4870: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:21:05.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:21:05 smithi132 bash[27079]: cluster 2020-07-16T16:21:03.679931+0000 mgr.x (mgr.34562) 7809 : cluster [DBG] pgmap v4871: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:21:05.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:21:05 smithi188 bash[23329]: cluster 2020-07-16T16:21:03.679931+0000 mgr.x (mgr.34562) 7809 : cluster [DBG] pgmap v4871: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:21:07.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:21:07 smithi132 bash[27079]: cluster 2020-07-16T16:21:05.680497+0000 mgr.x (mgr.34562) 7810 : cluster [DBG] pgmap v4872: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:21:07.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:21:07 smithi188 bash[23329]: cluster 2020-07-16T16:21:05.680497+0000 mgr.x (mgr.34562) 7810 : cluster [DBG] pgmap v4872: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:21:09.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:21:09 smithi188 bash[23329]: cluster 2020-07-16T16:21:07.680993+0000 mgr.x (mgr.34562) 7811 : cluster [DBG] pgmap v4873: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:21:10.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:21:09 smithi132 bash[27079]: cluster 2020-07-16T16:21:07.680993+0000 mgr.x (mgr.34562) 7811 : cluster [DBG] pgmap v4873: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:21:10.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:21:10 smithi188 bash[23329]: audit 2020-07-16T16:21:10.211163+0000 mon.b (mon.2) 1661 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:21:11.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:21:10 smithi132 bash[27079]: audit 2020-07-16T16:21:10.211163+0000 mon.b (mon.2) 1661 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:21:11.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:21:11 smithi188 bash[23329]: cluster 2020-07-16T16:21:09.681461+0000 mgr.x (mgr.34562) 7812 : cluster [DBG] pgmap v4874: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:21:11.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:21:11 smithi188 bash[23329]: cephadm 2020-07-16T16:21:10.211945+0000 mgr.x (mgr.34562) 7813 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:21:11.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:21:11 smithi188 bash[23329]: cephadm 2020-07-16T16:21:10.212191+0000 mgr.x (mgr.34562) 7814 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:21:12.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:21:11 smithi132 bash[27079]: cluster 2020-07-16T16:21:09.681461+0000 mgr.x (mgr.34562) 7812 : cluster [DBG] pgmap v4874: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:21:12.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:21:11 smithi132 bash[27079]: cephadm 2020-07-16T16:21:10.211945+0000 mgr.x (mgr.34562) 7813 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:21:12.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:21:11 smithi132 bash[27079]: cephadm 2020-07-16T16:21:10.212191+0000 mgr.x (mgr.34562) 7814 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:21:13.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:21:13 smithi188 bash[23329]: cluster 2020-07-16T16:21:11.681824+0000 mgr.x (mgr.34562) 7815 : cluster [DBG] pgmap v4875: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:21:14.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:21:13 smithi132 bash[27079]: cluster 2020-07-16T16:21:11.681824+0000 mgr.x (mgr.34562) 7815 : cluster [DBG] pgmap v4875: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:21:15.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:21:15 smithi188 bash[23329]: cluster 2020-07-16T16:21:13.682318+0000 mgr.x (mgr.34562) 7816 : cluster [DBG] pgmap v4876: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:21:16.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:21:15 smithi132 bash[27079]: cluster 2020-07-16T16:21:13.682318+0000 mgr.x (mgr.34562) 7816 : cluster [DBG] pgmap v4876: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:21:17.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:21:17 smithi188 bash[23329]: cluster 2020-07-16T16:21:15.682709+0000 mgr.x (mgr.34562) 7817 : cluster [DBG] pgmap v4877: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:21:18.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:21:17 smithi132 bash[27079]: cluster 2020-07-16T16:21:15.682709+0000 mgr.x (mgr.34562) 7817 : cluster [DBG] pgmap v4877: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:21:19.229 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:21:19.491 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:21:19.491 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 4m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:21:19.491 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 4m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:21:19.491 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 4m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:21:19.492 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 4m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:21:19.492 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 4m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:21:19.492 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:21:19.492 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:21:19.492 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 4m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:21:19.493 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 4m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:21:19.493 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:21:19.493 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:21:19.493 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:21:19.493 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:21:19.494 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:21:19.494 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:21:19.494 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:21:19.495 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:21:19.495 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 4m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:21:19.804 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:21:19.804 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:21:19.804 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:21:19.804 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:21:19.805 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:21:19.805 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:21:19.805 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:21:19.805 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:21:19.805 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:21:19.806 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:21:19.806 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:21:19.806 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:21:19.806 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:21:19.806 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:21:19.807 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:21:19.807 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:21:19.807 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:21:19.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:21:19 smithi188 bash[23329]: cluster 2020-07-16T16:21:17.683271+0000 mgr.x (mgr.34562) 7818 : cluster [DBG] pgmap v4878: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:21:20.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:21:19 smithi132 bash[27079]: cluster 2020-07-16T16:21:17.683271+0000 mgr.x (mgr.34562) 7818 : cluster [DBG] pgmap v4878: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:21:20.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:21:20 smithi188 bash[23329]: audit 2020-07-16T16:21:19.218016+0000 mgr.x (mgr.34562) 7819 : audit [DBG] from='client.30328 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:21:20.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:21:20 smithi188 bash[23329]: audit 2020-07-16T16:21:19.486619+0000 mgr.x (mgr.34562) 7820 : audit [DBG] from='client.30334 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:21:20.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:21:20 smithi188 bash[23329]: audit 2020-07-16T16:21:19.803120+0000 mon.c (mon.1) 525 : audit [DBG] from='client.? 172.21.15.132:0/1845176581' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:21:21.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:21:20 smithi132 bash[27079]: audit 2020-07-16T16:21:19.218016+0000 mgr.x (mgr.34562) 7819 : audit [DBG] from='client.30328 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:21:21.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:21:20 smithi132 bash[27079]: audit 2020-07-16T16:21:19.486619+0000 mgr.x (mgr.34562) 7820 : audit [DBG] from='client.30334 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:21:21.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:21:20 smithi132 bash[27079]: audit 2020-07-16T16:21:19.803120+0000 mon.c (mon.1) 525 : audit [DBG] from='client.? 172.21.15.132:0/1845176581' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:21:21.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:21:21 smithi188 bash[23329]: cluster 2020-07-16T16:21:19.683858+0000 mgr.x (mgr.34562) 7821 : cluster [DBG] pgmap v4879: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:21:22.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:21:21 smithi132 bash[27079]: cluster 2020-07-16T16:21:19.683858+0000 mgr.x (mgr.34562) 7821 : cluster [DBG] pgmap v4879: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:21:23.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:21:23 smithi188 bash[23329]: cluster 2020-07-16T16:21:21.684363+0000 mgr.x (mgr.34562) 7822 : cluster [DBG] pgmap v4880: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:21:24.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:21:23 smithi132 bash[27079]: cluster 2020-07-16T16:21:21.684363+0000 mgr.x (mgr.34562) 7822 : cluster [DBG] pgmap v4880: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:21:25.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:21:25 smithi188 bash[23329]: cluster 2020-07-16T16:21:23.684759+0000 mgr.x (mgr.34562) 7823 : cluster [DBG] pgmap v4881: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:21:25.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:21:25 smithi188 bash[23329]: audit 2020-07-16T16:21:25.230390+0000 mon.b (mon.2) 1662 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:21:25.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:21:25 smithi188 bash[23329]: audit 2020-07-16T16:21:25.231772+0000 mon.b (mon.2) 1663 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:21:25.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:21:25 smithi188 bash[23329]: audit 2020-07-16T16:21:25.232922+0000 mon.b (mon.2) 1664 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:21:25.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:21:25 smithi188 bash[23329]: audit 2020-07-16T16:21:25.234375+0000 mon.b (mon.2) 1665 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:21:25.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:21:25 smithi188 bash[23329]: audit 2020-07-16T16:21:25.235577+0000 mon.b (mon.2) 1666 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:21:26.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:21:25 smithi132 bash[27079]: cluster 2020-07-16T16:21:23.684759+0000 mgr.x (mgr.34562) 7823 : cluster [DBG] pgmap v4881: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:21:26.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:21:25 smithi132 bash[27079]: audit 2020-07-16T16:21:25.230390+0000 mon.b (mon.2) 1662 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:21:26.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:21:25 smithi132 bash[27079]: audit 2020-07-16T16:21:25.231772+0000 mon.b (mon.2) 1663 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:21:26.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:21:25 smithi132 bash[27079]: audit 2020-07-16T16:21:25.232922+0000 mon.b (mon.2) 1664 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:21:26.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:21:25 smithi132 bash[27079]: audit 2020-07-16T16:21:25.234375+0000 mon.b (mon.2) 1665 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:21:26.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:21:25 smithi132 bash[27079]: audit 2020-07-16T16:21:25.235577+0000 mon.b (mon.2) 1666 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:21:26.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:21:26 smithi188 bash[23329]: audit 2020-07-16T16:21:25.230775+0000 mgr.x (mgr.34562) 7824 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:21:26.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:21:26 smithi188 bash[23329]: audit 2020-07-16T16:21:25.232077+0000 mgr.x (mgr.34562) 7825 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:21:26.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:21:26 smithi188 bash[23329]: audit 2020-07-16T16:21:25.233177+0000 mgr.x (mgr.34562) 7826 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:21:26.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:21:26 smithi188 bash[23329]: cephadm 2020-07-16T16:21:25.233941+0000 mgr.x (mgr.34562) 7827 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:21:26.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:21:26 smithi188 bash[23329]: cephadm 2020-07-16T16:21:25.235239+0000 mgr.x (mgr.34562) 7828 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:21:26.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:21:26 smithi188 bash[23329]: cephadm 2020-07-16T16:21:25.236328+0000 mgr.x (mgr.34562) 7829 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:21:26.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:21:26 smithi188 bash[23329]: cephadm 2020-07-16T16:21:25.236631+0000 mgr.x (mgr.34562) 7830 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:21:26.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:21:26 smithi188 bash[23329]: cluster 2020-07-16T16:21:25.685243+0000 mgr.x (mgr.34562) 7831 : cluster [DBG] pgmap v4882: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:21:27.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:21:26 smithi132 bash[27079]: audit 2020-07-16T16:21:25.230775+0000 mgr.x (mgr.34562) 7824 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:21:27.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:21:26 smithi132 bash[27079]: audit 2020-07-16T16:21:25.232077+0000 mgr.x (mgr.34562) 7825 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:21:27.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:21:26 smithi132 bash[27079]: audit 2020-07-16T16:21:25.233177+0000 mgr.x (mgr.34562) 7826 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:21:27.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:21:26 smithi132 bash[27079]: cephadm 2020-07-16T16:21:25.233941+0000 mgr.x (mgr.34562) 7827 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:21:27.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:21:26 smithi132 bash[27079]: cephadm 2020-07-16T16:21:25.235239+0000 mgr.x (mgr.34562) 7828 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:21:27.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:21:26 smithi132 bash[27079]: cephadm 2020-07-16T16:21:25.236328+0000 mgr.x (mgr.34562) 7829 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:21:27.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:21:26 smithi132 bash[27079]: cephadm 2020-07-16T16:21:25.236631+0000 mgr.x (mgr.34562) 7830 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:21:27.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:21:26 smithi132 bash[27079]: cluster 2020-07-16T16:21:25.685243+0000 mgr.x (mgr.34562) 7831 : cluster [DBG] pgmap v4882: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:21:29.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:21:28 smithi132 bash[27079]: cluster 2020-07-16T16:21:27.685597+0000 mgr.x (mgr.34562) 7832 : cluster [DBG] pgmap v4883: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:21:29.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:21:28 smithi132 bash[27079]: audit 2020-07-16T16:21:28.064073+0000 mon.b (mon.2) 1667 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:21:29.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:21:28 smithi132 bash[27079]: cephadm 2020-07-16T16:21:28.064759+0000 mgr.x (mgr.34562) 7833 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:21:29.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:21:28 smithi132 bash[27079]: cephadm 2020-07-16T16:21:28.064923+0000 mgr.x (mgr.34562) 7834 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:21:29.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:21:28 smithi188 bash[23329]: cluster 2020-07-16T16:21:27.685597+0000 mgr.x (mgr.34562) 7832 : cluster [DBG] pgmap v4883: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:21:29.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:21:28 smithi188 bash[23329]: audit 2020-07-16T16:21:28.064073+0000 mon.b (mon.2) 1667 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:21:29.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:21:28 smithi188 bash[23329]: cephadm 2020-07-16T16:21:28.064759+0000 mgr.x (mgr.34562) 7833 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:21:29.171 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:21:28 smithi188 bash[23329]: cephadm 2020-07-16T16:21:28.064923+0000 mgr.x (mgr.34562) 7834 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:21:31.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:21:30 smithi132 bash[27079]: cluster 2020-07-16T16:21:29.686002+0000 mgr.x (mgr.34562) 7835 : cluster [DBG] pgmap v4884: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:21:31.170 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:21:30 smithi188 bash[23329]: cluster 2020-07-16T16:21:29.686002+0000 mgr.x (mgr.34562) 7835 : cluster [DBG] pgmap v4884: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:21:33.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:21:33 smithi188 bash[23329]: cluster 2020-07-16T16:21:31.686343+0000 mgr.x (mgr.34562) 7836 : cluster [DBG] pgmap v4885: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:21:33.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:21:33 smithi132 bash[27079]: cluster 2020-07-16T16:21:31.686343+0000 mgr.x (mgr.34562) 7836 : cluster [DBG] pgmap v4885: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:21:35.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:21:35 smithi188 bash[23329]: cluster 2020-07-16T16:21:33.686809+0000 mgr.x (mgr.34562) 7837 : cluster [DBG] pgmap v4886: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:21:35.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:21:35 smithi132 bash[27079]: cluster 2020-07-16T16:21:33.686809+0000 mgr.x (mgr.34562) 7837 : cluster [DBG] pgmap v4886: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:21:37.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:21:37 smithi188 bash[23329]: cluster 2020-07-16T16:21:35.687255+0000 mgr.x (mgr.34562) 7838 : cluster [DBG] pgmap v4887: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:21:37.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:21:37 smithi132 bash[27079]: cluster 2020-07-16T16:21:35.687255+0000 mgr.x (mgr.34562) 7838 : cluster [DBG] pgmap v4887: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:21:39.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:21:39 smithi188 bash[23329]: cluster 2020-07-16T16:21:37.687659+0000 mgr.x (mgr.34562) 7839 : cluster [DBG] pgmap v4888: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:21:39.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:21:39 smithi132 bash[27079]: cluster 2020-07-16T16:21:37.687659+0000 mgr.x (mgr.34562) 7839 : cluster [DBG] pgmap v4888: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:21:41.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:21:41 smithi188 bash[23329]: cluster 2020-07-16T16:21:39.687998+0000 mgr.x (mgr.34562) 7840 : cluster [DBG] pgmap v4889: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:21:41.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:21:41 smithi132 bash[27079]: cluster 2020-07-16T16:21:39.687998+0000 mgr.x (mgr.34562) 7840 : cluster [DBG] pgmap v4889: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:21:43.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:21:43 smithi188 bash[23329]: cluster 2020-07-16T16:21:41.688491+0000 mgr.x (mgr.34562) 7841 : cluster [DBG] pgmap v4890: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:21:43.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:21:43 smithi188 bash[23329]: audit 2020-07-16T16:21:43.080680+0000 mon.b (mon.2) 1668 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:21:43.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:21:43 smithi132 bash[27079]: cluster 2020-07-16T16:21:41.688491+0000 mgr.x (mgr.34562) 7841 : cluster [DBG] pgmap v4890: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:21:43.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:21:43 smithi132 bash[27079]: audit 2020-07-16T16:21:43.080680+0000 mon.b (mon.2) 1668 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:21:44.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:21:44 smithi188 bash[23329]: cephadm 2020-07-16T16:21:43.081364+0000 mgr.x (mgr.34562) 7842 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:21:44.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:21:44 smithi188 bash[23329]: cephadm 2020-07-16T16:21:43.081779+0000 mgr.x (mgr.34562) 7843 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:21:44.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:21:44 smithi132 bash[27079]: cephadm 2020-07-16T16:21:43.081364+0000 mgr.x (mgr.34562) 7842 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:21:44.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:21:44 smithi132 bash[27079]: cephadm 2020-07-16T16:21:43.081779+0000 mgr.x (mgr.34562) 7843 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:21:45.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:21:45 smithi188 bash[23329]: cluster 2020-07-16T16:21:43.688857+0000 mgr.x (mgr.34562) 7844 : cluster [DBG] pgmap v4891: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:21:45.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:21:45 smithi132 bash[27079]: cluster 2020-07-16T16:21:43.688857+0000 mgr.x (mgr.34562) 7844 : cluster [DBG] pgmap v4891: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:21:47.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:21:47 smithi188 bash[23329]: cluster 2020-07-16T16:21:45.689173+0000 mgr.x (mgr.34562) 7845 : cluster [DBG] pgmap v4892: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:21:47.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:21:47 smithi132 bash[27079]: cluster 2020-07-16T16:21:45.689173+0000 mgr.x (mgr.34562) 7845 : cluster [DBG] pgmap v4892: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:21:49.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:21:49 smithi188 bash[23329]: cluster 2020-07-16T16:21:47.689669+0000 mgr.x (mgr.34562) 7846 : cluster [DBG] pgmap v4893: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:21:49.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:21:49 smithi132 bash[27079]: cluster 2020-07-16T16:21:47.689669+0000 mgr.x (mgr.34562) 7846 : cluster [DBG] pgmap v4893: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:21:50.103 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:21:50.366 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:21:50.366 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 4m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:21:50.367 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 4m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:21:50.367 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 4m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:21:50.367 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 4m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:21:50.367 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 4m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:21:50.368 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:21:50.368 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:21:50.368 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 4m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:21:50.368 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 4m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:21:50.368 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:21:50.369 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:21:50.369 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:21:50.369 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:21:50.369 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:21:50.369 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:21:50.370 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:21:50.370 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:21:50.370 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 4m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:21:50.664 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:21:50.665 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:21:50.665 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:21:50.665 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:21:50.665 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:21:50.666 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:21:50.666 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:21:50.666 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:21:50.666 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:21:50.667 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:21:50.667 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:21:50.667 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:21:50.667 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:21:50.668 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:21:50.668 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:21:50.668 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:21:50.668 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:21:51.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:21:51 smithi188 bash[23329]: cluster 2020-07-16T16:21:49.690059+0000 mgr.x (mgr.34562) 7847 : cluster [DBG] pgmap v4894: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:21:51.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:21:51 smithi188 bash[23329]: audit 2020-07-16T16:21:50.091739+0000 mgr.x (mgr.34562) 7848 : audit [DBG] from='client.30346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:21:51.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:21:51 smithi188 bash[23329]: audit 2020-07-16T16:21:50.361863+0000 mgr.x (mgr.34562) 7849 : audit [DBG] from='client.30352 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:21:51.421 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:21:51 smithi188 bash[23329]: audit 2020-07-16T16:21:50.663778+0000 mon.c (mon.1) 526 : audit [DBG] from='client.? 172.21.15.132:0/645082377' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:21:51.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:21:51 smithi132 bash[27079]: cluster 2020-07-16T16:21:49.690059+0000 mgr.x (mgr.34562) 7847 : cluster [DBG] pgmap v4894: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:21:51.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:21:51 smithi132 bash[27079]: audit 2020-07-16T16:21:50.091739+0000 mgr.x (mgr.34562) 7848 : audit [DBG] from='client.30346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:21:51.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:21:51 smithi132 bash[27079]: audit 2020-07-16T16:21:50.361863+0000 mgr.x (mgr.34562) 7849 : audit [DBG] from='client.30352 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:21:51.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:21:51 smithi132 bash[27079]: audit 2020-07-16T16:21:50.663778+0000 mon.c (mon.1) 526 : audit [DBG] from='client.? 172.21.15.132:0/645082377' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:21:53.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:21:53 smithi188 bash[23329]: cluster 2020-07-16T16:21:51.690447+0000 mgr.x (mgr.34562) 7850 : cluster [DBG] pgmap v4895: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:21:53.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:21:53 smithi132 bash[27079]: cluster 2020-07-16T16:21:51.690447+0000 mgr.x (mgr.34562) 7850 : cluster [DBG] pgmap v4895: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:21:55.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:21:55 smithi132 bash[27079]: cluster 2020-07-16T16:21:53.690856+0000 mgr.x (mgr.34562) 7851 : cluster [DBG] pgmap v4896: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:21:55.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:21:55 smithi188 bash[23329]: cluster 2020-07-16T16:21:53.690856+0000 mgr.x (mgr.34562) 7851 : cluster [DBG] pgmap v4896: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:21:57.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:21:57 smithi132 bash[27079]: cluster 2020-07-16T16:21:55.691453+0000 mgr.x (mgr.34562) 7852 : cluster [DBG] pgmap v4897: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:21:57.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:21:57 smithi188 bash[23329]: cluster 2020-07-16T16:21:55.691453+0000 mgr.x (mgr.34562) 7852 : cluster [DBG] pgmap v4897: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:21:58.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:21:58 smithi132 bash[27079]: audit 2020-07-16T16:21:58.083726+0000 mon.b (mon.2) 1669 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:21:58.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:21:58 smithi188 bash[23329]: audit 2020-07-16T16:21:58.083726+0000 mon.b (mon.2) 1669 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:21:59.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:21:59 smithi132 bash[27079]: cluster 2020-07-16T16:21:57.691832+0000 mgr.x (mgr.34562) 7853 : cluster [DBG] pgmap v4898: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:21:59.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:21:59 smithi132 bash[27079]: cephadm 2020-07-16T16:21:58.084429+0000 mgr.x (mgr.34562) 7854 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:21:59.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:21:59 smithi132 bash[27079]: cephadm 2020-07-16T16:21:58.084866+0000 mgr.x (mgr.34562) 7855 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:21:59.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:21:59 smithi188 bash[23329]: cluster 2020-07-16T16:21:57.691832+0000 mgr.x (mgr.34562) 7853 : cluster [DBG] pgmap v4898: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:21:59.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:21:59 smithi188 bash[23329]: cephadm 2020-07-16T16:21:58.084429+0000 mgr.x (mgr.34562) 7854 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:21:59.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:21:59 smithi188 bash[23329]: cephadm 2020-07-16T16:21:58.084866+0000 mgr.x (mgr.34562) 7855 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:22:01.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:22:01 smithi132 bash[27079]: cluster 2020-07-16T16:21:59.692371+0000 mgr.x (mgr.34562) 7856 : cluster [DBG] pgmap v4899: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:22:01.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:22:01 smithi188 bash[23329]: cluster 2020-07-16T16:21:59.692371+0000 mgr.x (mgr.34562) 7856 : cluster [DBG] pgmap v4899: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:22:03.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:22:03 smithi132 bash[27079]: cluster 2020-07-16T16:22:01.692763+0000 mgr.x (mgr.34562) 7857 : cluster [DBG] pgmap v4900: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:22:03.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:22:03 smithi188 bash[23329]: cluster 2020-07-16T16:22:01.692763+0000 mgr.x (mgr.34562) 7857 : cluster [DBG] pgmap v4900: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:22:05.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:22:05 smithi132 bash[27079]: cluster 2020-07-16T16:22:03.693241+0000 mgr.x (mgr.34562) 7858 : cluster [DBG] pgmap v4901: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:22:05.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:22:05 smithi188 bash[23329]: cluster 2020-07-16T16:22:03.693241+0000 mgr.x (mgr.34562) 7858 : cluster [DBG] pgmap v4901: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:22:07.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:22:07 smithi132 bash[27079]: cluster 2020-07-16T16:22:05.693719+0000 mgr.x (mgr.34562) 7859 : cluster [DBG] pgmap v4902: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:22:07.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:22:07 smithi188 bash[23329]: cluster 2020-07-16T16:22:05.693719+0000 mgr.x (mgr.34562) 7859 : cluster [DBG] pgmap v4902: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:22:09.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:22:09 smithi132 bash[27079]: cluster 2020-07-16T16:22:07.694127+0000 mgr.x (mgr.34562) 7860 : cluster [DBG] pgmap v4903: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:22:09.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:22:09 smithi188 bash[23329]: cluster 2020-07-16T16:22:07.694127+0000 mgr.x (mgr.34562) 7860 : cluster [DBG] pgmap v4903: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:22:11.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:22:11 smithi132 bash[27079]: cluster 2020-07-16T16:22:09.694716+0000 mgr.x (mgr.34562) 7861 : cluster [DBG] pgmap v4904: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:22:11.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:22:11 smithi188 bash[23329]: cluster 2020-07-16T16:22:09.694716+0000 mgr.x (mgr.34562) 7861 : cluster [DBG] pgmap v4904: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:22:13.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:22:13 smithi132 bash[27079]: cluster 2020-07-16T16:22:11.695099+0000 mgr.x (mgr.34562) 7862 : cluster [DBG] pgmap v4905: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:22:13.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:22:13 smithi132 bash[27079]: audit 2020-07-16T16:22:13.097805+0000 mon.b (mon.2) 1670 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:22:13.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:22:13 smithi188 bash[23329]: cluster 2020-07-16T16:22:11.695099+0000 mgr.x (mgr.34562) 7862 : cluster [DBG] pgmap v4905: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:22:13.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:22:13 smithi188 bash[23329]: audit 2020-07-16T16:22:13.097805+0000 mon.b (mon.2) 1670 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:22:14.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:22:14 smithi132 bash[27079]: cephadm 2020-07-16T16:22:13.098489+0000 mgr.x (mgr.34562) 7863 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:22:14.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:22:14 smithi132 bash[27079]: cephadm 2020-07-16T16:22:13.098652+0000 mgr.x (mgr.34562) 7864 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:22:14.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:22:14 smithi188 bash[23329]: cephadm 2020-07-16T16:22:13.098489+0000 mgr.x (mgr.34562) 7863 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:22:14.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:22:14 smithi188 bash[23329]: cephadm 2020-07-16T16:22:13.098652+0000 mgr.x (mgr.34562) 7864 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:22:15.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:22:15 smithi132 bash[27079]: cluster 2020-07-16T16:22:13.695560+0000 mgr.x (mgr.34562) 7865 : cluster [DBG] pgmap v4906: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:22:15.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:22:15 smithi188 bash[23329]: cluster 2020-07-16T16:22:13.695560+0000 mgr.x (mgr.34562) 7865 : cluster [DBG] pgmap v4906: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:22:17.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:22:17 smithi132 bash[27079]: cluster 2020-07-16T16:22:15.695930+0000 mgr.x (mgr.34562) 7866 : cluster [DBG] pgmap v4907: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:22:17.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:22:17 smithi188 bash[23329]: cluster 2020-07-16T16:22:15.695930+0000 mgr.x (mgr.34562) 7866 : cluster [DBG] pgmap v4907: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:22:19.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:22:19 smithi132 bash[27079]: cluster 2020-07-16T16:22:17.696271+0000 mgr.x (mgr.34562) 7867 : cluster [DBG] pgmap v4908: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:22:19.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:22:19 smithi188 bash[23329]: cluster 2020-07-16T16:22:17.696271+0000 mgr.x (mgr.34562) 7867 : cluster [DBG] pgmap v4908: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:22:20.961 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:22:21.224 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:22:21.225 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 5m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:22:21.225 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 5m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:22:21.225 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 5m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:22:21.225 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 5m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:22:21.226 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 5m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:22:21.226 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:22:21.226 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:22:21.226 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 5m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:22:21.226 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 5m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:22:21.227 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:22:21.227 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:22:21.227 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:22:21.227 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:22:21.227 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:22:21.228 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:22:21.228 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:22:21.228 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:22:21.228 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 5m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:22:21.521 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:22:21.521 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:22:21.522 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:22:21.522 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:22:21.522 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:22:21.522 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:22:21.522 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:22:21.523 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:22:21.523 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:22:21.523 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:22:21.523 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:22:21.523 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:22:21.524 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:22:21.524 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:22:21.524 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:22:21.524 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:22:21.524 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:22:21.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:22:21 smithi132 bash[27079]: cluster 2020-07-16T16:22:19.696768+0000 mgr.x (mgr.34562) 7868 : cluster [DBG] pgmap v4909: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:22:21.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:22:21 smithi188 bash[23329]: cluster 2020-07-16T16:22:19.696768+0000 mgr.x (mgr.34562) 7868 : cluster [DBG] pgmap v4909: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:22:22.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:22:22 smithi132 bash[27079]: audit 2020-07-16T16:22:20.949688+0000 mgr.x (mgr.34562) 7869 : audit [DBG] from='client.30364 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:22:22.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:22:22 smithi132 bash[27079]: audit 2020-07-16T16:22:21.220506+0000 mgr.x (mgr.34562) 7870 : audit [DBG] from='client.30370 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:22:22.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:22:22 smithi132 bash[27079]: audit 2020-07-16T16:22:21.520509+0000 mon.c (mon.1) 527 : audit [DBG] from='client.? 172.21.15.132:0/203908206' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:22:22.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:22:22 smithi188 bash[23329]: audit 2020-07-16T16:22:20.949688+0000 mgr.x (mgr.34562) 7869 : audit [DBG] from='client.30364 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:22:22.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:22:22 smithi188 bash[23329]: audit 2020-07-16T16:22:21.220506+0000 mgr.x (mgr.34562) 7870 : audit [DBG] from='client.30370 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:22:22.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:22:22 smithi188 bash[23329]: audit 2020-07-16T16:22:21.520509+0000 mon.c (mon.1) 527 : audit [DBG] from='client.? 172.21.15.132:0/203908206' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:22:23.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:22:23 smithi132 bash[27079]: cluster 2020-07-16T16:22:21.697259+0000 mgr.x (mgr.34562) 7871 : cluster [DBG] pgmap v4910: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:22:23.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:22:23 smithi188 bash[23329]: cluster 2020-07-16T16:22:21.697259+0000 mgr.x (mgr.34562) 7871 : cluster [DBG] pgmap v4910: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:22:25.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:22:25 smithi132 bash[27079]: cluster 2020-07-16T16:22:23.697719+0000 mgr.x (mgr.34562) 7872 : cluster [DBG] pgmap v4911: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:22:25.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:22:25 smithi188 bash[23329]: cluster 2020-07-16T16:22:23.697719+0000 mgr.x (mgr.34562) 7872 : cluster [DBG] pgmap v4911: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:22:27.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:22:27 smithi132 bash[27079]: cluster 2020-07-16T16:22:25.698063+0000 mgr.x (mgr.34562) 7873 : cluster [DBG] pgmap v4912: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:22:27.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:22:27 smithi188 bash[23329]: cluster 2020-07-16T16:22:25.698063+0000 mgr.x (mgr.34562) 7873 : cluster [DBG] pgmap v4912: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:22:28.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:22:28 smithi132 bash[27079]: audit 2020-07-16T16:22:28.116944+0000 mon.b (mon.2) 1671 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:22:28.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:22:28 smithi132 bash[27079]: audit 2020-07-16T16:22:28.118336+0000 mon.b (mon.2) 1672 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:22:28.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:22:28 smithi132 bash[27079]: audit 2020-07-16T16:22:28.119487+0000 mon.b (mon.2) 1673 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:22:28.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:22:28 smithi132 bash[27079]: audit 2020-07-16T16:22:28.121055+0000 mon.b (mon.2) 1674 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:22:28.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:22:28 smithi132 bash[27079]: audit 2020-07-16T16:22:28.122466+0000 mon.b (mon.2) 1675 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:22:28.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:22:28 smithi188 bash[23329]: audit 2020-07-16T16:22:28.116944+0000 mon.b (mon.2) 1671 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:22:28.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:22:28 smithi188 bash[23329]: audit 2020-07-16T16:22:28.118336+0000 mon.b (mon.2) 1672 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:22:28.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:22:28 smithi188 bash[23329]: audit 2020-07-16T16:22:28.119487+0000 mon.b (mon.2) 1673 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:22:28.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:22:28 smithi188 bash[23329]: audit 2020-07-16T16:22:28.121055+0000 mon.b (mon.2) 1674 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:22:28.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:22:28 smithi188 bash[23329]: audit 2020-07-16T16:22:28.122466+0000 mon.b (mon.2) 1675 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:22:29.515 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:22:29 smithi132 bash[27079]: cluster 2020-07-16T16:22:27.698486+0000 mgr.x (mgr.34562) 7874 : cluster [DBG] pgmap v4913: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:22:29.515 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:22:29 smithi132 bash[27079]: audit 2020-07-16T16:22:28.117316+0000 mgr.x (mgr.34562) 7875 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:22:29.515 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:22:29 smithi132 bash[27079]: audit 2020-07-16T16:22:28.118654+0000 mgr.x (mgr.34562) 7876 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:22:29.516 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:22:29 smithi132 bash[27079]: audit 2020-07-16T16:22:28.119758+0000 mgr.x (mgr.34562) 7877 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:22:29.516 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:22:29 smithi132 bash[27079]: cephadm 2020-07-16T16:22:28.120548+0000 mgr.x (mgr.34562) 7878 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:22:29.516 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:22:29 smithi132 bash[27079]: cephadm 2020-07-16T16:22:28.121955+0000 mgr.x (mgr.34562) 7879 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:22:29.516 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:22:29 smithi132 bash[27079]: cephadm 2020-07-16T16:22:28.123176+0000 mgr.x (mgr.34562) 7880 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:22:29.517 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:22:29 smithi132 bash[27079]: cephadm 2020-07-16T16:22:28.123261+0000 mgr.x (mgr.34562) 7881 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:22:29.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:22:29 smithi188 bash[23329]: cluster 2020-07-16T16:22:27.698486+0000 mgr.x (mgr.34562) 7874 : cluster [DBG] pgmap v4913: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:22:29.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:22:29 smithi188 bash[23329]: audit 2020-07-16T16:22:28.117316+0000 mgr.x (mgr.34562) 7875 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:22:29.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:22:29 smithi188 bash[23329]: audit 2020-07-16T16:22:28.118654+0000 mgr.x (mgr.34562) 7876 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:22:29.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:22:29 smithi188 bash[23329]: audit 2020-07-16T16:22:28.119758+0000 mgr.x (mgr.34562) 7877 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:22:29.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:22:29 smithi188 bash[23329]: cephadm 2020-07-16T16:22:28.120548+0000 mgr.x (mgr.34562) 7878 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:22:29.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:22:29 smithi188 bash[23329]: cephadm 2020-07-16T16:22:28.121955+0000 mgr.x (mgr.34562) 7879 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:22:29.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:22:29 smithi188 bash[23329]: cephadm 2020-07-16T16:22:28.123176+0000 mgr.x (mgr.34562) 7880 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:22:29.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:22:29 smithi188 bash[23329]: cephadm 2020-07-16T16:22:28.123261+0000 mgr.x (mgr.34562) 7881 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:22:31.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:22:31 smithi132 bash[27079]: cluster 2020-07-16T16:22:29.698938+0000 mgr.x (mgr.34562) 7882 : cluster [DBG] pgmap v4914: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:22:31.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:22:31 smithi132 bash[27079]: audit 2020-07-16T16:22:30.941601+0000 mon.b (mon.2) 1676 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:22:31.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:22:31 smithi188 bash[23329]: cluster 2020-07-16T16:22:29.698938+0000 mgr.x (mgr.34562) 7882 : cluster [DBG] pgmap v4914: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:22:31.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:22:31 smithi188 bash[23329]: audit 2020-07-16T16:22:30.941601+0000 mon.b (mon.2) 1676 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:22:32.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:22:32 smithi132 bash[27079]: cephadm 2020-07-16T16:22:30.942265+0000 mgr.x (mgr.34562) 7883 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:22:32.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:22:32 smithi132 bash[27079]: cephadm 2020-07-16T16:22:30.942576+0000 mgr.x (mgr.34562) 7884 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:22:32.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:22:32 smithi188 bash[23329]: cephadm 2020-07-16T16:22:30.942265+0000 mgr.x (mgr.34562) 7883 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:22:32.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:22:32 smithi188 bash[23329]: cephadm 2020-07-16T16:22:30.942576+0000 mgr.x (mgr.34562) 7884 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:22:33.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:22:33 smithi132 bash[27079]: cluster 2020-07-16T16:22:31.699321+0000 mgr.x (mgr.34562) 7885 : cluster [DBG] pgmap v4915: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:22:33.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:22:33 smithi188 bash[23329]: cluster 2020-07-16T16:22:31.699321+0000 mgr.x (mgr.34562) 7885 : cluster [DBG] pgmap v4915: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:22:35.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:22:35 smithi132 bash[27079]: cluster 2020-07-16T16:22:33.699702+0000 mgr.x (mgr.34562) 7886 : cluster [DBG] pgmap v4916: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:22:35.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:22:35 smithi188 bash[23329]: cluster 2020-07-16T16:22:33.699702+0000 mgr.x (mgr.34562) 7886 : cluster [DBG] pgmap v4916: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:22:37.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:22:37 smithi132 bash[27079]: cluster 2020-07-16T16:22:35.700058+0000 mgr.x (mgr.34562) 7887 : cluster [DBG] pgmap v4917: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:22:37.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:22:37 smithi188 bash[23329]: cluster 2020-07-16T16:22:35.700058+0000 mgr.x (mgr.34562) 7887 : cluster [DBG] pgmap v4917: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:22:39.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:22:39 smithi132 bash[27079]: cluster 2020-07-16T16:22:37.700556+0000 mgr.x (mgr.34562) 7888 : cluster [DBG] pgmap v4918: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:22:39.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:22:39 smithi188 bash[23329]: cluster 2020-07-16T16:22:37.700556+0000 mgr.x (mgr.34562) 7888 : cluster [DBG] pgmap v4918: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:22:41.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:22:41 smithi132 bash[27079]: cluster 2020-07-16T16:22:39.700914+0000 mgr.x (mgr.34562) 7889 : cluster [DBG] pgmap v4919: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:22:41.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:22:41 smithi188 bash[23329]: cluster 2020-07-16T16:22:39.700914+0000 mgr.x (mgr.34562) 7889 : cluster [DBG] pgmap v4919: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:22:43.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:22:43 smithi188 bash[23329]: cluster 2020-07-16T16:22:41.701298+0000 mgr.x (mgr.34562) 7890 : cluster [DBG] pgmap v4920: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:22:43.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:22:43 smithi132 bash[27079]: cluster 2020-07-16T16:22:41.701298+0000 mgr.x (mgr.34562) 7890 : cluster [DBG] pgmap v4920: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:22:45.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:22:45 smithi188 bash[23329]: cluster 2020-07-16T16:22:43.701667+0000 mgr.x (mgr.34562) 7891 : cluster [DBG] pgmap v4921: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:22:45.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:22:45 smithi132 bash[27079]: cluster 2020-07-16T16:22:43.701667+0000 mgr.x (mgr.34562) 7891 : cluster [DBG] pgmap v4921: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:22:46.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:22:46 smithi188 bash[23329]: audit 2020-07-16T16:22:45.958206+0000 mon.b (mon.2) 1677 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:22:46.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:22:46 smithi132 bash[27079]: audit 2020-07-16T16:22:45.958206+0000 mon.b (mon.2) 1677 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:22:47.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:22:47 smithi188 bash[23329]: cluster 2020-07-16T16:22:45.702142+0000 mgr.x (mgr.34562) 7892 : cluster [DBG] pgmap v4922: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:22:47.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:22:47 smithi188 bash[23329]: cephadm 2020-07-16T16:22:45.958885+0000 mgr.x (mgr.34562) 7893 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:22:47.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:22:47 smithi188 bash[23329]: cephadm 2020-07-16T16:22:45.959277+0000 mgr.x (mgr.34562) 7894 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:22:47.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:22:47 smithi132 bash[27079]: cluster 2020-07-16T16:22:45.702142+0000 mgr.x (mgr.34562) 7892 : cluster [DBG] pgmap v4922: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:22:47.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:22:47 smithi132 bash[27079]: cephadm 2020-07-16T16:22:45.958885+0000 mgr.x (mgr.34562) 7893 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:22:47.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:22:47 smithi132 bash[27079]: cephadm 2020-07-16T16:22:45.959277+0000 mgr.x (mgr.34562) 7894 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:22:49.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:22:49 smithi188 bash[23329]: cluster 2020-07-16T16:22:47.702566+0000 mgr.x (mgr.34562) 7895 : cluster [DBG] pgmap v4923: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:22:49.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:22:49 smithi132 bash[27079]: cluster 2020-07-16T16:22:47.702566+0000 mgr.x (mgr.34562) 7895 : cluster [DBG] pgmap v4923: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:22:51.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:22:51 smithi188 bash[23329]: cluster 2020-07-16T16:22:49.702938+0000 mgr.x (mgr.34562) 7896 : cluster [DBG] pgmap v4924: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:22:51.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:22:51 smithi132 bash[27079]: cluster 2020-07-16T16:22:49.702938+0000 mgr.x (mgr.34562) 7896 : cluster [DBG] pgmap v4924: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:22:51.822 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:22:52.083 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:22:52.083 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 5m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:22:52.083 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 5m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:22:52.084 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 5m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:22:52.084 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 5m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:22:52.084 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 5m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:22:52.084 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:22:52.084 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:22:52.085 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 5m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:22:52.085 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 5m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:22:52.085 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:22:52.085 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:22:52.085 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:22:52.086 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:22:52.086 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:22:52.086 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:22:52.086 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:22:52.086 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:22:52.087 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 5m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:22:52.382 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:22:52.382 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:22:52.382 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:22:52.382 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:22:52.383 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:22:52.383 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:22:52.383 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:22:52.383 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:22:52.383 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:22:52.384 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:22:52.384 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:22:52.384 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:22:52.384 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:22:52.384 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:22:52.385 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:22:52.385 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:22:52.385 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:22:53.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:22:53 smithi188 bash[23329]: cluster 2020-07-16T16:22:51.703320+0000 mgr.x (mgr.34562) 7897 : cluster [DBG] pgmap v4925: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:22:53.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:22:53 smithi188 bash[23329]: audit 2020-07-16T16:22:51.810781+0000 mgr.x (mgr.34562) 7898 : audit [DBG] from='client.30382 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:22:53.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:22:53 smithi188 bash[23329]: audit 2020-07-16T16:22:52.078674+0000 mgr.x (mgr.34562) 7899 : audit [DBG] from='client.30388 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:22:53.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:22:53 smithi188 bash[23329]: audit 2020-07-16T16:22:52.381146+0000 mon.c (mon.1) 528 : audit [DBG] from='client.? 172.21.15.132:0/974690805' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:22:53.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:22:53 smithi132 bash[27079]: cluster 2020-07-16T16:22:51.703320+0000 mgr.x (mgr.34562) 7897 : cluster [DBG] pgmap v4925: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:22:53.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:22:53 smithi132 bash[27079]: audit 2020-07-16T16:22:51.810781+0000 mgr.x (mgr.34562) 7898 : audit [DBG] from='client.30382 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:22:53.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:22:53 smithi132 bash[27079]: audit 2020-07-16T16:22:52.078674+0000 mgr.x (mgr.34562) 7899 : audit [DBG] from='client.30388 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:22:53.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:22:53 smithi132 bash[27079]: audit 2020-07-16T16:22:52.381146+0000 mon.c (mon.1) 528 : audit [DBG] from='client.? 172.21.15.132:0/974690805' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:22:55.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:22:55 smithi188 bash[23329]: cluster 2020-07-16T16:22:53.703731+0000 mgr.x (mgr.34562) 7900 : cluster [DBG] pgmap v4926: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:22:55.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:22:55 smithi132 bash[27079]: cluster 2020-07-16T16:22:53.703731+0000 mgr.x (mgr.34562) 7900 : cluster [DBG] pgmap v4926: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:22:57.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:22:57 smithi188 bash[23329]: cluster 2020-07-16T16:22:55.704086+0000 mgr.x (mgr.34562) 7901 : cluster [DBG] pgmap v4927: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:22:57.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:22:57 smithi132 bash[27079]: cluster 2020-07-16T16:22:55.704086+0000 mgr.x (mgr.34562) 7901 : cluster [DBG] pgmap v4927: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:22:59.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:22:59 smithi188 bash[23329]: cluster 2020-07-16T16:22:57.704621+0000 mgr.x (mgr.34562) 7902 : cluster [DBG] pgmap v4928: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:22:59.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:22:59 smithi132 bash[27079]: cluster 2020-07-16T16:22:57.704621+0000 mgr.x (mgr.34562) 7902 : cluster [DBG] pgmap v4928: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:23:01.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:23:01 smithi188 bash[23329]: cluster 2020-07-16T16:22:59.705161+0000 mgr.x (mgr.34562) 7903 : cluster [DBG] pgmap v4929: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:23:01.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:23:01 smithi188 bash[23329]: audit 2020-07-16T16:23:00.966568+0000 mon.b (mon.2) 1678 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:23:01.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:23:01 smithi132 bash[27079]: cluster 2020-07-16T16:22:59.705161+0000 mgr.x (mgr.34562) 7903 : cluster [DBG] pgmap v4929: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:23:01.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:23:01 smithi132 bash[27079]: audit 2020-07-16T16:23:00.966568+0000 mon.b (mon.2) 1678 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:23:02.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:23:02 smithi188 bash[23329]: cephadm 2020-07-16T16:23:00.967280+0000 mgr.x (mgr.34562) 7904 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:23:02.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:23:02 smithi188 bash[23329]: cephadm 2020-07-16T16:23:00.967709+0000 mgr.x (mgr.34562) 7905 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:23:02.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:23:02 smithi132 bash[27079]: cephadm 2020-07-16T16:23:00.967280+0000 mgr.x (mgr.34562) 7904 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:23:02.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:23:02 smithi132 bash[27079]: cephadm 2020-07-16T16:23:00.967709+0000 mgr.x (mgr.34562) 7905 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:23:03.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:23:03 smithi188 bash[23329]: cluster 2020-07-16T16:23:01.705659+0000 mgr.x (mgr.34562) 7906 : cluster [DBG] pgmap v4930: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:23:03.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:23:03 smithi132 bash[27079]: cluster 2020-07-16T16:23:01.705659+0000 mgr.x (mgr.34562) 7906 : cluster [DBG] pgmap v4930: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:23:05.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:23:05 smithi188 bash[23329]: cluster 2020-07-16T16:23:03.706082+0000 mgr.x (mgr.34562) 7907 : cluster [DBG] pgmap v4931: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:23:05.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:23:05 smithi132 bash[27079]: cluster 2020-07-16T16:23:03.706082+0000 mgr.x (mgr.34562) 7907 : cluster [DBG] pgmap v4931: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:23:07.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:23:07 smithi188 bash[23329]: cluster 2020-07-16T16:23:05.706516+0000 mgr.x (mgr.34562) 7908 : cluster [DBG] pgmap v4932: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:23:07.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:23:07 smithi132 bash[27079]: cluster 2020-07-16T16:23:05.706516+0000 mgr.x (mgr.34562) 7908 : cluster [DBG] pgmap v4932: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:23:09.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:23:09 smithi188 bash[23329]: cluster 2020-07-16T16:23:07.706978+0000 mgr.x (mgr.34562) 7909 : cluster [DBG] pgmap v4933: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:23:09.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:23:09 smithi132 bash[27079]: cluster 2020-07-16T16:23:07.706978+0000 mgr.x (mgr.34562) 7909 : cluster [DBG] pgmap v4933: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:23:11.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:23:11 smithi188 bash[23329]: cluster 2020-07-16T16:23:09.707395+0000 mgr.x (mgr.34562) 7910 : cluster [DBG] pgmap v4934: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:23:11.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:23:11 smithi132 bash[27079]: cluster 2020-07-16T16:23:09.707395+0000 mgr.x (mgr.34562) 7910 : cluster [DBG] pgmap v4934: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:23:13.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:23:13 smithi188 bash[23329]: cluster 2020-07-16T16:23:11.707795+0000 mgr.x (mgr.34562) 7911 : cluster [DBG] pgmap v4935: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:23:13.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:23:13 smithi132 bash[27079]: cluster 2020-07-16T16:23:11.707795+0000 mgr.x (mgr.34562) 7911 : cluster [DBG] pgmap v4935: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:23:15.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:23:15 smithi188 bash[23329]: cluster 2020-07-16T16:23:13.708173+0000 mgr.x (mgr.34562) 7912 : cluster [DBG] pgmap v4936: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:23:15.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:23:15 smithi132 bash[27079]: cluster 2020-07-16T16:23:13.708173+0000 mgr.x (mgr.34562) 7912 : cluster [DBG] pgmap v4936: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:23:16.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:23:16 smithi188 bash[23329]: audit 2020-07-16T16:23:15.975435+0000 mon.b (mon.2) 1679 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:23:16.782 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:23:16 smithi132 bash[27079]: audit 2020-07-16T16:23:15.975435+0000 mon.b (mon.2) 1679 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:23:17.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:23:17 smithi188 bash[23329]: cluster 2020-07-16T16:23:15.708510+0000 mgr.x (mgr.34562) 7913 : cluster [DBG] pgmap v4937: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:23:17.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:23:17 smithi188 bash[23329]: cephadm 2020-07-16T16:23:15.976078+0000 mgr.x (mgr.34562) 7914 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:23:17.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:23:17 smithi188 bash[23329]: cephadm 2020-07-16T16:23:15.976178+0000 mgr.x (mgr.34562) 7915 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:23:17.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:23:17 smithi132 bash[27079]: cluster 2020-07-16T16:23:15.708510+0000 mgr.x (mgr.34562) 7913 : cluster [DBG] pgmap v4937: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:23:17.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:23:17 smithi132 bash[27079]: cephadm 2020-07-16T16:23:15.976078+0000 mgr.x (mgr.34562) 7914 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:23:17.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:23:17 smithi132 bash[27079]: cephadm 2020-07-16T16:23:15.976178+0000 mgr.x (mgr.34562) 7915 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:23:19.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:23:19 smithi188 bash[23329]: cluster 2020-07-16T16:23:17.709037+0000 mgr.x (mgr.34562) 7916 : cluster [DBG] pgmap v4938: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:23:19.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:23:19 smithi132 bash[27079]: cluster 2020-07-16T16:23:17.709037+0000 mgr.x (mgr.34562) 7916 : cluster [DBG] pgmap v4938: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:23:21.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:23:21 smithi188 bash[23329]: cluster 2020-07-16T16:23:19.709564+0000 mgr.x (mgr.34562) 7917 : cluster [DBG] pgmap v4939: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:23:21.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:23:21 smithi132 bash[27079]: cluster 2020-07-16T16:23:19.709564+0000 mgr.x (mgr.34562) 7917 : cluster [DBG] pgmap v4939: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:23:22.683 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:23:22.942 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:23:22.943 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 6m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:23:22.943 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 6m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:23:22.943 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 6m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:23:22.943 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 6m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:23:22.944 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 6m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:23:22.944 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:23:22.944 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:23:22.944 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 6m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:23:22.944 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 6m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:23:22.944 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:23:22.945 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:23:22.945 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:23:22.945 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:23:22.945 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:23:22.946 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:23:22.946 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:23:22.946 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:23:22.946 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 6m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:23:23.242 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:23:23.242 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:23:23.242 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:23:23.242 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:23:23.243 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:23:23.243 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:23:23.243 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:23:23.243 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:23:23.243 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:23:23.243 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:23:23.244 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:23:23.244 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:23:23.244 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:23:23.244 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:23:23.244 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:23:23.245 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:23:23.245 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:23:23.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:23:23 smithi188 bash[23329]: cluster 2020-07-16T16:23:21.710105+0000 mgr.x (mgr.34562) 7918 : cluster [DBG] pgmap v4940: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:23:23.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:23:23 smithi188 bash[23329]: audit 2020-07-16T16:23:23.240951+0000 mon.c (mon.1) 529 : audit [DBG] from='client.? 172.21.15.132:0/3212304118' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:23:23.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:23:23 smithi132 bash[27079]: cluster 2020-07-16T16:23:21.710105+0000 mgr.x (mgr.34562) 7918 : cluster [DBG] pgmap v4940: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:23:23.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:23:23 smithi132 bash[27079]: audit 2020-07-16T16:23:23.240951+0000 mon.c (mon.1) 529 : audit [DBG] from='client.? 172.21.15.132:0/3212304118' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:23:24.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:23:24 smithi188 bash[23329]: audit 2020-07-16T16:23:22.670614+0000 mgr.x (mgr.34562) 7919 : audit [DBG] from='client.30400 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:23:24.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:23:24 smithi188 bash[23329]: audit 2020-07-16T16:23:22.938300+0000 mgr.x (mgr.34562) 7920 : audit [DBG] from='client.30406 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:23:24.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:23:24 smithi132 bash[27079]: audit 2020-07-16T16:23:22.670614+0000 mgr.x (mgr.34562) 7919 : audit [DBG] from='client.30400 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:23:24.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:23:24 smithi132 bash[27079]: audit 2020-07-16T16:23:22.938300+0000 mgr.x (mgr.34562) 7920 : audit [DBG] from='client.30406 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:23:25.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:23:25 smithi188 bash[23329]: cluster 2020-07-16T16:23:23.710467+0000 mgr.x (mgr.34562) 7921 : cluster [DBG] pgmap v4941: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:23:25.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:23:25 smithi132 bash[27079]: cluster 2020-07-16T16:23:23.710467+0000 mgr.x (mgr.34562) 7921 : cluster [DBG] pgmap v4941: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:23:27.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:23:27 smithi188 bash[23329]: cluster 2020-07-16T16:23:25.710815+0000 mgr.x (mgr.34562) 7922 : cluster [DBG] pgmap v4942: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:23:27.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:23:27 smithi132 bash[27079]: cluster 2020-07-16T16:23:25.710815+0000 mgr.x (mgr.34562) 7922 : cluster [DBG] pgmap v4942: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:23:29.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:23:29 smithi188 bash[23329]: cluster 2020-07-16T16:23:27.711377+0000 mgr.x (mgr.34562) 7923 : cluster [DBG] pgmap v4943: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:23:29.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:23:29 smithi132 bash[27079]: cluster 2020-07-16T16:23:27.711377+0000 mgr.x (mgr.34562) 7923 : cluster [DBG] pgmap v4943: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:23:31.643 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:23:31 smithi132 bash[27079]: cluster 2020-07-16T16:23:29.711792+0000 mgr.x (mgr.34562) 7924 : cluster [DBG] pgmap v4944: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:23:31.644 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:23:31 smithi132 bash[27079]: audit 2020-07-16T16:23:30.994036+0000 mon.b (mon.2) 1680 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:23:31.644 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:23:31 smithi132 bash[27079]: audit 2020-07-16T16:23:30.995517+0000 mon.b (mon.2) 1681 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:23:31.644 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:23:31 smithi132 bash[27079]: audit 2020-07-16T16:23:30.996724+0000 mon.b (mon.2) 1682 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:23:31.645 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:23:31 smithi132 bash[27079]: audit 2020-07-16T16:23:30.998206+0000 mon.b (mon.2) 1683 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:23:31.645 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:23:31 smithi132 bash[27079]: audit 2020-07-16T16:23:30.999325+0000 mon.b (mon.2) 1684 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:23:31.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:23:31 smithi188 bash[23329]: cluster 2020-07-16T16:23:29.711792+0000 mgr.x (mgr.34562) 7924 : cluster [DBG] pgmap v4944: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:23:31.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:23:31 smithi188 bash[23329]: audit 2020-07-16T16:23:30.994036+0000 mon.b (mon.2) 1680 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:23:31.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:23:31 smithi188 bash[23329]: audit 2020-07-16T16:23:30.995517+0000 mon.b (mon.2) 1681 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:23:31.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:23:31 smithi188 bash[23329]: audit 2020-07-16T16:23:30.996724+0000 mon.b (mon.2) 1682 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:23:31.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:23:31 smithi188 bash[23329]: audit 2020-07-16T16:23:30.998206+0000 mon.b (mon.2) 1683 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:23:31.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:23:31 smithi188 bash[23329]: audit 2020-07-16T16:23:30.999325+0000 mon.b (mon.2) 1684 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:23:32.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:23:32 smithi188 bash[23329]: audit 2020-07-16T16:23:30.994459+0000 mgr.x (mgr.34562) 7925 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:23:32.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:23:32 smithi188 bash[23329]: audit 2020-07-16T16:23:30.995855+0000 mgr.x (mgr.34562) 7926 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:23:32.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:23:32 smithi188 bash[23329]: audit 2020-07-16T16:23:30.997105+0000 mgr.x (mgr.34562) 7927 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:23:32.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:23:32 smithi188 bash[23329]: cephadm 2020-07-16T16:23:30.997889+0000 mgr.x (mgr.34562) 7928 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:23:32.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:23:32 smithi188 bash[23329]: cephadm 2020-07-16T16:23:30.999025+0000 mgr.x (mgr.34562) 7929 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:23:32.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:23:32 smithi188 bash[23329]: cephadm 2020-07-16T16:23:31.000018+0000 mgr.x (mgr.34562) 7930 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:23:32.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:23:32 smithi188 bash[23329]: cephadm 2020-07-16T16:23:31.000149+0000 mgr.x (mgr.34562) 7931 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:23:32.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:23:32 smithi132 bash[27079]: audit 2020-07-16T16:23:30.994459+0000 mgr.x (mgr.34562) 7925 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:23:32.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:23:32 smithi132 bash[27079]: audit 2020-07-16T16:23:30.995855+0000 mgr.x (mgr.34562) 7926 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:23:32.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:23:32 smithi132 bash[27079]: audit 2020-07-16T16:23:30.997105+0000 mgr.x (mgr.34562) 7927 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:23:32.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:23:32 smithi132 bash[27079]: cephadm 2020-07-16T16:23:30.997889+0000 mgr.x (mgr.34562) 7928 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:23:32.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:23:32 smithi132 bash[27079]: cephadm 2020-07-16T16:23:30.999025+0000 mgr.x (mgr.34562) 7929 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:23:32.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:23:32 smithi132 bash[27079]: cephadm 2020-07-16T16:23:31.000018+0000 mgr.x (mgr.34562) 7930 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:23:32.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:23:32 smithi132 bash[27079]: cephadm 2020-07-16T16:23:31.000149+0000 mgr.x (mgr.34562) 7931 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:23:33.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:23:33 smithi188 bash[23329]: cluster 2020-07-16T16:23:31.712200+0000 mgr.x (mgr.34562) 7932 : cluster [DBG] pgmap v4945: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:23:33.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:23:33 smithi132 bash[27079]: cluster 2020-07-16T16:23:31.712200+0000 mgr.x (mgr.34562) 7932 : cluster [DBG] pgmap v4945: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:23:34.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:23:34 smithi188 bash[23329]: audit 2020-07-16T16:23:33.861210+0000 mon.b (mon.2) 1685 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:23:34.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:23:34 smithi132 bash[27079]: audit 2020-07-16T16:23:33.861210+0000 mon.b (mon.2) 1685 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:23:35.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:23:35 smithi188 bash[23329]: cluster 2020-07-16T16:23:33.712698+0000 mgr.x (mgr.34562) 7933 : cluster [DBG] pgmap v4946: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:23:35.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:23:35 smithi188 bash[23329]: cephadm 2020-07-16T16:23:33.861850+0000 mgr.x (mgr.34562) 7934 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:23:35.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:23:35 smithi188 bash[23329]: cephadm 2020-07-16T16:23:33.862268+0000 mgr.x (mgr.34562) 7935 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:23:35.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:23:35 smithi132 bash[27079]: cluster 2020-07-16T16:23:33.712698+0000 mgr.x (mgr.34562) 7933 : cluster [DBG] pgmap v4946: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:23:35.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:23:35 smithi132 bash[27079]: cephadm 2020-07-16T16:23:33.861850+0000 mgr.x (mgr.34562) 7934 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:23:35.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:23:35 smithi132 bash[27079]: cephadm 2020-07-16T16:23:33.862268+0000 mgr.x (mgr.34562) 7935 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:23:37.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:23:37 smithi188 bash[23329]: cluster 2020-07-16T16:23:35.713137+0000 mgr.x (mgr.34562) 7936 : cluster [DBG] pgmap v4947: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:23:37.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:23:37 smithi132 bash[27079]: cluster 2020-07-16T16:23:35.713137+0000 mgr.x (mgr.34562) 7936 : cluster [DBG] pgmap v4947: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:23:39.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:23:39 smithi188 bash[23329]: cluster 2020-07-16T16:23:37.713583+0000 mgr.x (mgr.34562) 7937 : cluster [DBG] pgmap v4948: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:23:39.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:23:39 smithi132 bash[27079]: cluster 2020-07-16T16:23:37.713583+0000 mgr.x (mgr.34562) 7937 : cluster [DBG] pgmap v4948: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:23:41.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:23:41 smithi188 bash[23329]: cluster 2020-07-16T16:23:39.714040+0000 mgr.x (mgr.34562) 7938 : cluster [DBG] pgmap v4949: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:23:41.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:23:41 smithi132 bash[27079]: cluster 2020-07-16T16:23:39.714040+0000 mgr.x (mgr.34562) 7938 : cluster [DBG] pgmap v4949: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:23:43.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:23:43 smithi188 bash[23329]: cluster 2020-07-16T16:23:41.714500+0000 mgr.x (mgr.34562) 7939 : cluster [DBG] pgmap v4950: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:23:43.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:23:43 smithi132 bash[27079]: cluster 2020-07-16T16:23:41.714500+0000 mgr.x (mgr.34562) 7939 : cluster [DBG] pgmap v4950: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:23:45.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:23:45 smithi188 bash[23329]: cluster 2020-07-16T16:23:43.714831+0000 mgr.x (mgr.34562) 7940 : cluster [DBG] pgmap v4951: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:23:45.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:23:45 smithi132 bash[27079]: cluster 2020-07-16T16:23:43.714831+0000 mgr.x (mgr.34562) 7940 : cluster [DBG] pgmap v4951: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:23:47.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:23:47 smithi188 bash[23329]: cluster 2020-07-16T16:23:45.715228+0000 mgr.x (mgr.34562) 7941 : cluster [DBG] pgmap v4952: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:23:47.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:23:47 smithi132 bash[27079]: cluster 2020-07-16T16:23:45.715228+0000 mgr.x (mgr.34562) 7941 : cluster [DBG] pgmap v4952: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:23:49.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:23:49 smithi188 bash[23329]: cluster 2020-07-16T16:23:47.715583+0000 mgr.x (mgr.34562) 7942 : cluster [DBG] pgmap v4953: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:23:49.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:23:49 smithi188 bash[23329]: audit 2020-07-16T16:23:48.877780+0000 mon.b (mon.2) 1686 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:23:49.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:23:49 smithi132 bash[27079]: cluster 2020-07-16T16:23:47.715583+0000 mgr.x (mgr.34562) 7942 : cluster [DBG] pgmap v4953: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:23:49.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:23:49 smithi132 bash[27079]: audit 2020-07-16T16:23:48.877780+0000 mon.b (mon.2) 1686 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:23:50.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:23:50 smithi132 bash[27079]: cephadm 2020-07-16T16:23:48.878498+0000 mgr.x (mgr.34562) 7943 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:23:50.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:23:50 smithi132 bash[27079]: cephadm 2020-07-16T16:23:48.878578+0000 mgr.x (mgr.34562) 7944 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:23:50.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:23:50 smithi188 bash[23329]: cephadm 2020-07-16T16:23:48.878498+0000 mgr.x (mgr.34562) 7943 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:23:50.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:23:50 smithi188 bash[23329]: cephadm 2020-07-16T16:23:48.878578+0000 mgr.x (mgr.34562) 7944 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:23:51.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:23:51 smithi132 bash[27079]: cluster 2020-07-16T16:23:49.715997+0000 mgr.x (mgr.34562) 7945 : cluster [DBG] pgmap v4954: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:23:51.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:23:51 smithi188 bash[23329]: cluster 2020-07-16T16:23:49.715997+0000 mgr.x (mgr.34562) 7945 : cluster [DBG] pgmap v4954: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:23:53.537 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:23:53.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:23:53 smithi132 bash[27079]: cluster 2020-07-16T16:23:51.716385+0000 mgr.x (mgr.34562) 7946 : cluster [DBG] pgmap v4955: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:23:53.798 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:23:53.798 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 6m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:23:53.798 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 6m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:23:53.799 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 6m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:23:53.799 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 6m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:23:53.799 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 6m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:23:53.799 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:23:53.799 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:23:53.800 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 6m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:23:53.800 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 6m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:23:53.800 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:23:53.800 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:23:53.800 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:23:53.801 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:23:53.801 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:23:53.801 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:23:53.801 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:23:53.801 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 6m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:23:53.802 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 6m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:23:53.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:23:53 smithi188 bash[23329]: cluster 2020-07-16T16:23:51.716385+0000 mgr.x (mgr.34562) 7946 : cluster [DBG] pgmap v4955: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:23:54.097 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:23:54.097 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:23:54.097 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:23:54.098 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:23:54.098 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:23:54.098 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:23:54.098 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:23:54.098 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:23:54.099 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:23:54.099 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:23:54.099 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:23:54.099 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:23:54.099 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:23:54.099 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:23:54.100 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:23:54.100 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:23:54.100 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:23:54.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:23:54 smithi132 bash[27079]: audit 2020-07-16T16:23:53.525924+0000 mgr.x (mgr.34562) 7947 : audit [DBG] from='client.30418 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:23:54.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:23:54 smithi132 bash[27079]: audit 2020-07-16T16:23:54.096225+0000 mon.c (mon.1) 530 : audit [DBG] from='client.? 172.21.15.132:0/4085095753' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:23:54.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:23:54 smithi188 bash[23329]: audit 2020-07-16T16:23:53.525924+0000 mgr.x (mgr.34562) 7947 : audit [DBG] from='client.30418 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:23:54.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:23:54 smithi188 bash[23329]: audit 2020-07-16T16:23:54.096225+0000 mon.c (mon.1) 530 : audit [DBG] from='client.? 172.21.15.132:0/4085095753' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:23:55.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:23:55 smithi132 bash[27079]: cluster 2020-07-16T16:23:53.716788+0000 mgr.x (mgr.34562) 7948 : cluster [DBG] pgmap v4956: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:23:55.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:23:55 smithi132 bash[27079]: audit 2020-07-16T16:23:53.793915+0000 mgr.x (mgr.34562) 7949 : audit [DBG] from='client.30424 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:23:55.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:23:55 smithi188 bash[23329]: cluster 2020-07-16T16:23:53.716788+0000 mgr.x (mgr.34562) 7948 : cluster [DBG] pgmap v4956: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:23:55.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:23:55 smithi188 bash[23329]: audit 2020-07-16T16:23:53.793915+0000 mgr.x (mgr.34562) 7949 : audit [DBG] from='client.30424 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:23:57.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:23:57 smithi132 bash[27079]: cluster 2020-07-16T16:23:55.717238+0000 mgr.x (mgr.34562) 7950 : cluster [DBG] pgmap v4957: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:23:57.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:23:57 smithi188 bash[23329]: cluster 2020-07-16T16:23:55.717238+0000 mgr.x (mgr.34562) 7950 : cluster [DBG] pgmap v4957: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:23:59.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:23:59 smithi132 bash[27079]: cluster 2020-07-16T16:23:57.717581+0000 mgr.x (mgr.34562) 7951 : cluster [DBG] pgmap v4958: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:23:59.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:23:59 smithi188 bash[23329]: cluster 2020-07-16T16:23:57.717581+0000 mgr.x (mgr.34562) 7951 : cluster [DBG] pgmap v4958: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:24:01.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:24:01 smithi132 bash[27079]: cluster 2020-07-16T16:23:59.717978+0000 mgr.x (mgr.34562) 7952 : cluster [DBG] pgmap v4959: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:24:01.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:24:01 smithi188 bash[23329]: cluster 2020-07-16T16:23:59.717978+0000 mgr.x (mgr.34562) 7952 : cluster [DBG] pgmap v4959: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:24:03.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:24:03 smithi132 bash[27079]: cluster 2020-07-16T16:24:01.718327+0000 mgr.x (mgr.34562) 7953 : cluster [DBG] pgmap v4960: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:24:03.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:24:03 smithi188 bash[23329]: cluster 2020-07-16T16:24:01.718327+0000 mgr.x (mgr.34562) 7953 : cluster [DBG] pgmap v4960: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:24:04.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:24:04 smithi132 bash[27079]: audit 2020-07-16T16:24:03.881778+0000 mon.b (mon.2) 1687 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:24:04.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:24:04 smithi188 bash[23329]: audit 2020-07-16T16:24:03.881778+0000 mon.b (mon.2) 1687 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:24:05.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:24:05 smithi132 bash[27079]: cluster 2020-07-16T16:24:03.718808+0000 mgr.x (mgr.34562) 7954 : cluster [DBG] pgmap v4961: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:24:05.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:24:05 smithi132 bash[27079]: cephadm 2020-07-16T16:24:03.882509+0000 mgr.x (mgr.34562) 7955 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:24:05.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:24:05 smithi132 bash[27079]: cephadm 2020-07-16T16:24:03.882932+0000 mgr.x (mgr.34562) 7956 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:24:05.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:24:05 smithi188 bash[23329]: cluster 2020-07-16T16:24:03.718808+0000 mgr.x (mgr.34562) 7954 : cluster [DBG] pgmap v4961: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:24:05.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:24:05 smithi188 bash[23329]: cephadm 2020-07-16T16:24:03.882509+0000 mgr.x (mgr.34562) 7955 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:24:05.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:24:05 smithi188 bash[23329]: cephadm 2020-07-16T16:24:03.882932+0000 mgr.x (mgr.34562) 7956 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:24:07.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:24:07 smithi132 bash[27079]: cluster 2020-07-16T16:24:05.719378+0000 mgr.x (mgr.34562) 7957 : cluster [DBG] pgmap v4962: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:24:07.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:24:07 smithi188 bash[23329]: cluster 2020-07-16T16:24:05.719378+0000 mgr.x (mgr.34562) 7957 : cluster [DBG] pgmap v4962: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:24:09.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:24:09 smithi132 bash[27079]: cluster 2020-07-16T16:24:07.719765+0000 mgr.x (mgr.34562) 7958 : cluster [DBG] pgmap v4963: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:24:09.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:24:09 smithi188 bash[23329]: cluster 2020-07-16T16:24:07.719765+0000 mgr.x (mgr.34562) 7958 : cluster [DBG] pgmap v4963: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:24:11.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:24:11 smithi132 bash[27079]: cluster 2020-07-16T16:24:09.720157+0000 mgr.x (mgr.34562) 7959 : cluster [DBG] pgmap v4964: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:24:11.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:24:11 smithi188 bash[23329]: cluster 2020-07-16T16:24:09.720157+0000 mgr.x (mgr.34562) 7959 : cluster [DBG] pgmap v4964: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:24:13.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:24:13 smithi132 bash[27079]: cluster 2020-07-16T16:24:11.720531+0000 mgr.x (mgr.34562) 7960 : cluster [DBG] pgmap v4965: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:24:13.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:24:13 smithi188 bash[23329]: cluster 2020-07-16T16:24:11.720531+0000 mgr.x (mgr.34562) 7960 : cluster [DBG] pgmap v4965: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:24:15.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:24:15 smithi132 bash[27079]: cluster 2020-07-16T16:24:13.721016+0000 mgr.x (mgr.34562) 7961 : cluster [DBG] pgmap v4966: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:24:15.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:24:15 smithi188 bash[23329]: cluster 2020-07-16T16:24:13.721016+0000 mgr.x (mgr.34562) 7961 : cluster [DBG] pgmap v4966: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:24:17.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:24:17 smithi132 bash[27079]: cluster 2020-07-16T16:24:15.721470+0000 mgr.x (mgr.34562) 7962 : cluster [DBG] pgmap v4967: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:24:17.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:24:17 smithi188 bash[23329]: cluster 2020-07-16T16:24:15.721470+0000 mgr.x (mgr.34562) 7962 : cluster [DBG] pgmap v4967: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:24:19.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:24:19 smithi132 bash[27079]: cluster 2020-07-16T16:24:17.721971+0000 mgr.x (mgr.34562) 7963 : cluster [DBG] pgmap v4968: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:24:19.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:24:19 smithi132 bash[27079]: audit 2020-07-16T16:24:18.898482+0000 mon.b (mon.2) 1688 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:24:19.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:24:19 smithi188 bash[23329]: cluster 2020-07-16T16:24:17.721971+0000 mgr.x (mgr.34562) 7963 : cluster [DBG] pgmap v4968: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:24:19.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:24:19 smithi188 bash[23329]: audit 2020-07-16T16:24:18.898482+0000 mon.b (mon.2) 1688 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:24:20.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:24:20 smithi132 bash[27079]: cephadm 2020-07-16T16:24:18.899176+0000 mgr.x (mgr.34562) 7964 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:24:20.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:24:20 smithi132 bash[27079]: cephadm 2020-07-16T16:24:18.899395+0000 mgr.x (mgr.34562) 7965 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:24:20.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:24:20 smithi188 bash[23329]: cephadm 2020-07-16T16:24:18.899176+0000 mgr.x (mgr.34562) 7964 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:24:20.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:24:20 smithi188 bash[23329]: cephadm 2020-07-16T16:24:18.899395+0000 mgr.x (mgr.34562) 7965 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:24:21.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:24:21 smithi132 bash[27079]: cluster 2020-07-16T16:24:19.722342+0000 mgr.x (mgr.34562) 7966 : cluster [DBG] pgmap v4969: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:24:21.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:24:21 smithi188 bash[23329]: cluster 2020-07-16T16:24:19.722342+0000 mgr.x (mgr.34562) 7966 : cluster [DBG] pgmap v4969: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:24:23.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:24:23 smithi132 bash[27079]: cluster 2020-07-16T16:24:21.722713+0000 mgr.x (mgr.34562) 7967 : cluster [DBG] pgmap v4970: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:24:23.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:24:23 smithi188 bash[23329]: cluster 2020-07-16T16:24:21.722713+0000 mgr.x (mgr.34562) 7967 : cluster [DBG] pgmap v4970: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:24:24.397 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:24:24.661 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:24:24.661 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 7m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:24:24.661 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 7m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:24:24.661 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 7m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:24:24.662 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 7m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:24:24.662 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 7m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:24:24.662 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:24:24.662 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:24:24.663 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 7m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:24:24.663 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 7m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:24:24.663 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:24:24.663 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:24:24.663 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:24:24.664 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:24:24.664 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:24:24.664 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:24:24.664 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:24:24.664 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:24:24.664 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 7m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:24:24.957 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:24:24.958 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:24:24.958 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:24:24.958 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:24:24.958 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:24:24.958 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:24:24.959 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:24:24.959 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:24:24.959 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:24:24.959 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:24:24.959 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:24:24.960 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:24:24.960 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:24:24.960 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:24:24.960 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:24:24.960 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:24:24.961 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:24:25.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:24:25 smithi132 bash[27079]: cluster 2020-07-16T16:24:23.723218+0000 mgr.x (mgr.34562) 7968 : cluster [DBG] pgmap v4971: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:24:25.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:24:25 smithi132 bash[27079]: audit 2020-07-16T16:24:24.385959+0000 mgr.x (mgr.34562) 7969 : audit [DBG] from='client.30436 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:24:25.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:24:25 smithi132 bash[27079]: audit 2020-07-16T16:24:24.956584+0000 mon.c (mon.1) 531 : audit [DBG] from='client.? 172.21.15.132:0/250902683' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:24:25.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:24:25 smithi188 bash[23329]: cluster 2020-07-16T16:24:23.723218+0000 mgr.x (mgr.34562) 7968 : cluster [DBG] pgmap v4971: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:24:25.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:24:25 smithi188 bash[23329]: audit 2020-07-16T16:24:24.385959+0000 mgr.x (mgr.34562) 7969 : audit [DBG] from='client.30436 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:24:25.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:24:25 smithi188 bash[23329]: audit 2020-07-16T16:24:24.956584+0000 mon.c (mon.1) 531 : audit [DBG] from='client.? 172.21.15.132:0/250902683' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:24:26.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:24:26 smithi132 bash[27079]: audit 2020-07-16T16:24:24.656479+0000 mgr.x (mgr.34562) 7970 : audit [DBG] from='client.30442 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:24:26.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:24:26 smithi188 bash[23329]: audit 2020-07-16T16:24:24.656479+0000 mgr.x (mgr.34562) 7970 : audit [DBG] from='client.30442 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:24:27.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:24:27 smithi132 bash[27079]: cluster 2020-07-16T16:24:25.723675+0000 mgr.x (mgr.34562) 7971 : cluster [DBG] pgmap v4972: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:24:27.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:24:27 smithi188 bash[23329]: cluster 2020-07-16T16:24:25.723675+0000 mgr.x (mgr.34562) 7971 : cluster [DBG] pgmap v4972: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:24:29.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:24:29 smithi132 bash[27079]: cluster 2020-07-16T16:24:27.724068+0000 mgr.x (mgr.34562) 7972 : cluster [DBG] pgmap v4973: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:24:29.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:24:29 smithi188 bash[23329]: cluster 2020-07-16T16:24:27.724068+0000 mgr.x (mgr.34562) 7972 : cluster [DBG] pgmap v4973: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:24:31.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:24:31 smithi132 bash[27079]: cluster 2020-07-16T16:24:29.724458+0000 mgr.x (mgr.34562) 7973 : cluster [DBG] pgmap v4974: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:24:31.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:24:31 smithi188 bash[23329]: cluster 2020-07-16T16:24:29.724458+0000 mgr.x (mgr.34562) 7973 : cluster [DBG] pgmap v4974: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:24:33.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:24:33 smithi132 bash[27079]: cluster 2020-07-16T16:24:31.724826+0000 mgr.x (mgr.34562) 7974 : cluster [DBG] pgmap v4975: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:24:33.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:24:33 smithi188 bash[23329]: cluster 2020-07-16T16:24:31.724826+0000 mgr.x (mgr.34562) 7974 : cluster [DBG] pgmap v4975: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:24:34.744 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:24:34 smithi132 bash[27079]: audit 2020-07-16T16:24:33.918170+0000 mon.b (mon.2) 1689 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:24:34.744 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:24:34 smithi132 bash[27079]: audit 2020-07-16T16:24:33.919614+0000 mon.b (mon.2) 1690 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:24:34.744 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:24:34 smithi132 bash[27079]: audit 2020-07-16T16:24:33.920850+0000 mon.b (mon.2) 1691 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:24:34.745 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:24:34 smithi132 bash[27079]: audit 2020-07-16T16:24:33.922231+0000 mon.b (mon.2) 1692 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:24:34.745 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:24:34 smithi132 bash[27079]: audit 2020-07-16T16:24:33.923409+0000 mon.b (mon.2) 1693 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:24:34.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:24:34 smithi188 bash[23329]: audit 2020-07-16T16:24:33.918170+0000 mon.b (mon.2) 1689 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:24:34.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:24:34 smithi188 bash[23329]: audit 2020-07-16T16:24:33.919614+0000 mon.b (mon.2) 1690 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:24:34.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:24:34 smithi188 bash[23329]: audit 2020-07-16T16:24:33.920850+0000 mon.b (mon.2) 1691 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:24:34.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:24:34 smithi188 bash[23329]: audit 2020-07-16T16:24:33.922231+0000 mon.b (mon.2) 1692 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:24:34.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:24:34 smithi188 bash[23329]: audit 2020-07-16T16:24:33.923409+0000 mon.b (mon.2) 1693 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:24:35.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:24:35 smithi132 bash[27079]: cluster 2020-07-16T16:24:33.725196+0000 mgr.x (mgr.34562) 7975 : cluster [DBG] pgmap v4976: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:24:35.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:24:35 smithi132 bash[27079]: audit 2020-07-16T16:24:33.918571+0000 mgr.x (mgr.34562) 7976 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:24:35.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:24:35 smithi132 bash[27079]: audit 2020-07-16T16:24:33.919951+0000 mgr.x (mgr.34562) 7977 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:24:35.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:24:35 smithi132 bash[27079]: audit 2020-07-16T16:24:33.921136+0000 mgr.x (mgr.34562) 7978 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:24:35.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:24:35 smithi132 bash[27079]: cephadm 2020-07-16T16:24:33.921808+0000 mgr.x (mgr.34562) 7979 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:24:35.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:24:35 smithi132 bash[27079]: cephadm 2020-07-16T16:24:33.923093+0000 mgr.x (mgr.34562) 7980 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:24:35.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:24:35 smithi132 bash[27079]: cephadm 2020-07-16T16:24:33.924102+0000 mgr.x (mgr.34562) 7981 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:24:35.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:24:35 smithi132 bash[27079]: cephadm 2020-07-16T16:24:33.924367+0000 mgr.x (mgr.34562) 7982 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:24:35.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:24:35 smithi188 bash[23329]: cluster 2020-07-16T16:24:33.725196+0000 mgr.x (mgr.34562) 7975 : cluster [DBG] pgmap v4976: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:24:35.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:24:35 smithi188 bash[23329]: audit 2020-07-16T16:24:33.918571+0000 mgr.x (mgr.34562) 7976 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:24:35.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:24:35 smithi188 bash[23329]: audit 2020-07-16T16:24:33.919951+0000 mgr.x (mgr.34562) 7977 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:24:35.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:24:35 smithi188 bash[23329]: audit 2020-07-16T16:24:33.921136+0000 mgr.x (mgr.34562) 7978 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:24:35.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:24:35 smithi188 bash[23329]: cephadm 2020-07-16T16:24:33.921808+0000 mgr.x (mgr.34562) 7979 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:24:35.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:24:35 smithi188 bash[23329]: cephadm 2020-07-16T16:24:33.923093+0000 mgr.x (mgr.34562) 7980 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:24:35.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:24:35 smithi188 bash[23329]: cephadm 2020-07-16T16:24:33.924102+0000 mgr.x (mgr.34562) 7981 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:24:35.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:24:35 smithi188 bash[23329]: cephadm 2020-07-16T16:24:33.924367+0000 mgr.x (mgr.34562) 7982 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:24:37.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:24:37 smithi132 bash[27079]: cluster 2020-07-16T16:24:35.725692+0000 mgr.x (mgr.34562) 7983 : cluster [DBG] pgmap v4977: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:24:37.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:24:37 smithi132 bash[27079]: audit 2020-07-16T16:24:36.705105+0000 mon.b (mon.2) 1694 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:24:37.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:24:37 smithi188 bash[23329]: cluster 2020-07-16T16:24:35.725692+0000 mgr.x (mgr.34562) 7983 : cluster [DBG] pgmap v4977: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:24:37.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:24:37 smithi188 bash[23329]: audit 2020-07-16T16:24:36.705105+0000 mon.b (mon.2) 1694 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:24:38.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:24:38 smithi188 bash[23329]: cephadm 2020-07-16T16:24:36.705762+0000 mgr.x (mgr.34562) 7984 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:24:38.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:24:38 smithi188 bash[23329]: cephadm 2020-07-16T16:24:36.706235+0000 mgr.x (mgr.34562) 7985 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:24:39.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:24:38 smithi132 bash[27079]: cephadm 2020-07-16T16:24:36.705762+0000 mgr.x (mgr.34562) 7984 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:24:39.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:24:38 smithi132 bash[27079]: cephadm 2020-07-16T16:24:36.706235+0000 mgr.x (mgr.34562) 7985 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:24:39.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:24:39 smithi188 bash[23329]: cluster 2020-07-16T16:24:37.726168+0000 mgr.x (mgr.34562) 7986 : cluster [DBG] pgmap v4978: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:24:40.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:24:39 smithi132 bash[27079]: cluster 2020-07-16T16:24:37.726168+0000 mgr.x (mgr.34562) 7986 : cluster [DBG] pgmap v4978: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:24:41.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:24:41 smithi188 bash[23329]: cluster 2020-07-16T16:24:39.726690+0000 mgr.x (mgr.34562) 7987 : cluster [DBG] pgmap v4979: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:24:42.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:24:41 smithi132 bash[27079]: cluster 2020-07-16T16:24:39.726690+0000 mgr.x (mgr.34562) 7987 : cluster [DBG] pgmap v4979: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:24:43.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:24:43 smithi188 bash[23329]: cluster 2020-07-16T16:24:41.727099+0000 mgr.x (mgr.34562) 7988 : cluster [DBG] pgmap v4980: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:24:44.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:24:43 smithi132 bash[27079]: cluster 2020-07-16T16:24:41.727099+0000 mgr.x (mgr.34562) 7988 : cluster [DBG] pgmap v4980: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:24:45.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:24:45 smithi188 bash[23329]: cluster 2020-07-16T16:24:43.727589+0000 mgr.x (mgr.34562) 7989 : cluster [DBG] pgmap v4981: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:24:46.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:24:45 smithi132 bash[27079]: cluster 2020-07-16T16:24:43.727589+0000 mgr.x (mgr.34562) 7989 : cluster [DBG] pgmap v4981: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:24:47.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:24:47 smithi188 bash[23329]: cluster 2020-07-16T16:24:45.728018+0000 mgr.x (mgr.34562) 7990 : cluster [DBG] pgmap v4982: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:24:48.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:24:47 smithi132 bash[27079]: cluster 2020-07-16T16:24:45.728018+0000 mgr.x (mgr.34562) 7990 : cluster [DBG] pgmap v4982: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:24:49.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:24:49 smithi188 bash[23329]: cluster 2020-07-16T16:24:47.728503+0000 mgr.x (mgr.34562) 7991 : cluster [DBG] pgmap v4983: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:24:50.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:24:49 smithi132 bash[27079]: cluster 2020-07-16T16:24:47.728503+0000 mgr.x (mgr.34562) 7991 : cluster [DBG] pgmap v4983: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:24:51.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:24:51 smithi188 bash[23329]: cluster 2020-07-16T16:24:49.728912+0000 mgr.x (mgr.34562) 7992 : cluster [DBG] pgmap v4984: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:24:52.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:24:51 smithi132 bash[27079]: cluster 2020-07-16T16:24:49.728912+0000 mgr.x (mgr.34562) 7992 : cluster [DBG] pgmap v4984: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:24:52.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:24:52 smithi188 bash[23329]: audit 2020-07-16T16:24:51.721436+0000 mon.b (mon.2) 1695 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:24:53.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:24:52 smithi132 bash[27079]: audit 2020-07-16T16:24:51.721436+0000 mon.b (mon.2) 1695 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:24:53.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:24:53 smithi188 bash[23329]: cephadm 2020-07-16T16:24:51.722126+0000 mgr.x (mgr.34562) 7993 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:24:53.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:24:53 smithi188 bash[23329]: cephadm 2020-07-16T16:24:51.722289+0000 mgr.x (mgr.34562) 7994 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:24:53.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:24:53 smithi188 bash[23329]: cluster 2020-07-16T16:24:51.729345+0000 mgr.x (mgr.34562) 7995 : cluster [DBG] pgmap v4985: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:24:54.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:24:53 smithi132 bash[27079]: cephadm 2020-07-16T16:24:51.722126+0000 mgr.x (mgr.34562) 7993 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:24:54.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:24:53 smithi132 bash[27079]: cephadm 2020-07-16T16:24:51.722289+0000 mgr.x (mgr.34562) 7994 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:24:54.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:24:53 smithi132 bash[27079]: cluster 2020-07-16T16:24:51.729345+0000 mgr.x (mgr.34562) 7995 : cluster [DBG] pgmap v4985: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:24:55.265 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:24:55.526 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:24:55.527 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 7m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:24:55.527 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 7m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:24:55.528 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 7m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:24:55.528 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 7m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:24:55.528 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 7m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:24:55.528 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:24:55.528 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:24:55.529 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 7m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:24:55.529 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 7m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:24:55.529 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:24:55.529 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:24:55.529 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:24:55.530 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:24:55.530 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:24:55.530 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:24:55.530 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:24:55.530 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 7m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:24:55.531 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 7m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:24:55.828 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:24:55.828 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:24:55.828 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:24:55.828 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:24:55.829 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:24:55.829 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:24:55.829 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:24:55.829 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:24:55.829 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:24:55.830 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:24:55.830 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:24:55.830 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:24:55.830 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:24:55.830 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:24:55.831 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:24:55.831 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:24:55.831 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:24:55.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:24:55 smithi188 bash[23329]: cluster 2020-07-16T16:24:53.729660+0000 mgr.x (mgr.34562) 7996 : cluster [DBG] pgmap v4986: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:24:56.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:24:55 smithi132 bash[27079]: cluster 2020-07-16T16:24:53.729660+0000 mgr.x (mgr.34562) 7996 : cluster [DBG] pgmap v4986: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:24:56.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:24:56 smithi188 bash[23329]: audit 2020-07-16T16:24:55.253127+0000 mgr.x (mgr.34562) 7997 : audit [DBG] from='client.30454 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:24:56.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:24:56 smithi188 bash[23329]: audit 2020-07-16T16:24:55.522354+0000 mgr.x (mgr.34562) 7998 : audit [DBG] from='client.30460 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:24:56.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:24:56 smithi188 bash[23329]: audit 2020-07-16T16:24:55.827069+0000 mon.c (mon.1) 532 : audit [DBG] from='client.? 172.21.15.132:0/2954065108' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:24:57.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:24:56 smithi132 bash[27079]: audit 2020-07-16T16:24:55.253127+0000 mgr.x (mgr.34562) 7997 : audit [DBG] from='client.30454 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:24:57.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:24:56 smithi132 bash[27079]: audit 2020-07-16T16:24:55.522354+0000 mgr.x (mgr.34562) 7998 : audit [DBG] from='client.30460 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:24:57.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:24:56 smithi132 bash[27079]: audit 2020-07-16T16:24:55.827069+0000 mon.c (mon.1) 532 : audit [DBG] from='client.? 172.21.15.132:0/2954065108' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:24:57.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:24:57 smithi188 bash[23329]: cluster 2020-07-16T16:24:55.730041+0000 mgr.x (mgr.34562) 7999 : cluster [DBG] pgmap v4987: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:24:58.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:24:57 smithi132 bash[27079]: cluster 2020-07-16T16:24:55.730041+0000 mgr.x (mgr.34562) 7999 : cluster [DBG] pgmap v4987: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:24:59.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:24:59 smithi188 bash[23329]: cluster 2020-07-16T16:24:57.730471+0000 mgr.x (mgr.34562) 8000 : cluster [DBG] pgmap v4988: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:25:00.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:24:59 smithi132 bash[27079]: cluster 2020-07-16T16:24:57.730471+0000 mgr.x (mgr.34562) 8000 : cluster [DBG] pgmap v4988: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:25:01.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:25:01 smithi188 bash[23329]: cluster 2020-07-16T16:24:59.730967+0000 mgr.x (mgr.34562) 8001 : cluster [DBG] pgmap v4989: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:25:02.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:25:01 smithi132 bash[27079]: cluster 2020-07-16T16:24:59.730967+0000 mgr.x (mgr.34562) 8001 : cluster [DBG] pgmap v4989: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:25:03.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:25:03 smithi188 bash[23329]: cluster 2020-07-16T16:25:01.731492+0000 mgr.x (mgr.34562) 8002 : cluster [DBG] pgmap v4990: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:25:04.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:25:03 smithi132 bash[27079]: cluster 2020-07-16T16:25:01.731492+0000 mgr.x (mgr.34562) 8002 : cluster [DBG] pgmap v4990: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:25:05.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:25:05 smithi188 bash[23329]: cluster 2020-07-16T16:25:03.731872+0000 mgr.x (mgr.34562) 8003 : cluster [DBG] pgmap v4991: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:25:06.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:25:05 smithi132 bash[27079]: cluster 2020-07-16T16:25:03.731872+0000 mgr.x (mgr.34562) 8003 : cluster [DBG] pgmap v4991: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:25:07.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:25:07 smithi188 bash[23329]: cluster 2020-07-16T16:25:05.732383+0000 mgr.x (mgr.34562) 8004 : cluster [DBG] pgmap v4992: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:25:07.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:25:07 smithi188 bash[23329]: audit 2020-07-16T16:25:06.729843+0000 mon.b (mon.2) 1696 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:25:08.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:25:07 smithi132 bash[27079]: cluster 2020-07-16T16:25:05.732383+0000 mgr.x (mgr.34562) 8004 : cluster [DBG] pgmap v4992: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:25:08.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:25:07 smithi132 bash[27079]: audit 2020-07-16T16:25:06.729843+0000 mon.b (mon.2) 1696 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:25:08.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:25:08 smithi188 bash[23329]: cephadm 2020-07-16T16:25:06.730553+0000 mgr.x (mgr.34562) 8005 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:25:08.921 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:25:08 smithi188 bash[23329]: cephadm 2020-07-16T16:25:06.730964+0000 mgr.x (mgr.34562) 8006 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:25:09.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:25:08 smithi132 bash[27079]: cephadm 2020-07-16T16:25:06.730553+0000 mgr.x (mgr.34562) 8005 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:25:09.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:25:08 smithi132 bash[27079]: cephadm 2020-07-16T16:25:06.730964+0000 mgr.x (mgr.34562) 8006 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:25:09.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:25:09 smithi188 bash[23329]: cluster 2020-07-16T16:25:07.732793+0000 mgr.x (mgr.34562) 8007 : cluster [DBG] pgmap v4993: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:25:10.029 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:25:09 smithi132 bash[27079]: cluster 2020-07-16T16:25:07.732793+0000 mgr.x (mgr.34562) 8007 : cluster [DBG] pgmap v4993: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:25:11.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:25:11 smithi188 bash[23329]: cluster 2020-07-16T16:25:09.733279+0000 mgr.x (mgr.34562) 8008 : cluster [DBG] pgmap v4994: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:25:12.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:25:11 smithi132 bash[27079]: cluster 2020-07-16T16:25:09.733279+0000 mgr.x (mgr.34562) 8008 : cluster [DBG] pgmap v4994: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:25:13.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:25:13 smithi188 bash[23329]: cluster 2020-07-16T16:25:11.733828+0000 mgr.x (mgr.34562) 8009 : cluster [DBG] pgmap v4995: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:25:14.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:25:13 smithi132 bash[27079]: cluster 2020-07-16T16:25:11.733828+0000 mgr.x (mgr.34562) 8009 : cluster [DBG] pgmap v4995: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:25:15.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:25:15 smithi188 bash[23329]: cluster 2020-07-16T16:25:13.734383+0000 mgr.x (mgr.34562) 8010 : cluster [DBG] pgmap v4996: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:25:16.028 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:25:15 smithi132 bash[27079]: cluster 2020-07-16T16:25:13.734383+0000 mgr.x (mgr.34562) 8010 : cluster [DBG] pgmap v4996: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:25:17.420 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:25:17 smithi188 bash[23329]: cluster 2020-07-16T16:25:15.734796+0000 mgr.x (mgr.34562) 8011 : cluster [DBG] pgmap v4997: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:25:17.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:25:17 smithi132 bash[27079]: cluster 2020-07-16T16:25:15.734796+0000 mgr.x (mgr.34562) 8011 : cluster [DBG] pgmap v4997: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:25:19.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:25:19 smithi132 bash[27079]: cluster 2020-07-16T16:25:17.735296+0000 mgr.x (mgr.34562) 8012 : cluster [DBG] pgmap v4998: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:25:19.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:25:19 smithi188 bash[23329]: cluster 2020-07-16T16:25:17.735296+0000 mgr.x (mgr.34562) 8012 : cluster [DBG] pgmap v4998: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:25:21.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:25:21 smithi132 bash[27079]: cluster 2020-07-16T16:25:19.735721+0000 mgr.x (mgr.34562) 8013 : cluster [DBG] pgmap v4999: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:25:21.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:25:21 smithi188 bash[23329]: cluster 2020-07-16T16:25:19.735721+0000 mgr.x (mgr.34562) 8013 : cluster [DBG] pgmap v4999: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:25:22.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:25:22 smithi132 bash[27079]: audit 2020-07-16T16:25:21.746489+0000 mon.b (mon.2) 1697 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:25:22.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:25:22 smithi188 bash[23329]: audit 2020-07-16T16:25:21.746489+0000 mon.b (mon.2) 1697 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:25:23.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:25:23 smithi132 bash[27079]: cluster 2020-07-16T16:25:21.736094+0000 mgr.x (mgr.34562) 8014 : cluster [DBG] pgmap v5000: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:25:23.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:25:23 smithi132 bash[27079]: cephadm 2020-07-16T16:25:21.747227+0000 mgr.x (mgr.34562) 8015 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:25:23.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:25:23 smithi132 bash[27079]: cephadm 2020-07-16T16:25:21.747319+0000 mgr.x (mgr.34562) 8016 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:25:23.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:25:23 smithi188 bash[23329]: cluster 2020-07-16T16:25:21.736094+0000 mgr.x (mgr.34562) 8014 : cluster [DBG] pgmap v5000: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:25:23.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:25:23 smithi188 bash[23329]: cephadm 2020-07-16T16:25:21.747227+0000 mgr.x (mgr.34562) 8015 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:25:23.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:25:23 smithi188 bash[23329]: cephadm 2020-07-16T16:25:21.747319+0000 mgr.x (mgr.34562) 8016 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:25:25.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:25:25 smithi132 bash[27079]: cluster 2020-07-16T16:25:23.736584+0000 mgr.x (mgr.34562) 8017 : cluster [DBG] pgmap v5001: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:25:25.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:25:25 smithi188 bash[23329]: cluster 2020-07-16T16:25:23.736584+0000 mgr.x (mgr.34562) 8017 : cluster [DBG] pgmap v5001: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:25:26.125 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:25:26.949 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:25:26.969 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 8m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:25:26.969 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 8m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:25:26.969 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 8m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:25:26.970 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 8m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:25:26.970 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 8m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:25:26.970 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:25:26.970 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:25:26.970 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 8m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:25:26.971 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 8m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:25:26.971 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:25:26.971 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:25:26.971 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:25:26.972 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:25:26.972 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:25:26.972 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:25:26.972 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:25:26.972 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:25:26.973 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 8m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:25:26.973 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:25:26.973 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:25:26.973 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:25:26.994 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:25:26.994 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:25:26.994 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:25:26.994 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:25:26.995 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:25:26.995 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:25:26.995 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:25:26.995 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:25:26.996 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:25:26.996 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:25:26.996 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:25:26.996 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:25:26.996 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:25:26.997 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:25:27.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:25:27 smithi132 bash[27079]: cluster 2020-07-16T16:25:25.736952+0000 mgr.x (mgr.34562) 8018 : cluster [DBG] pgmap v5002: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:25:27.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:25:27 smithi132 bash[27079]: audit 2020-07-16T16:25:26.113827+0000 mgr.x (mgr.34562) 8019 : audit [DBG] from='client.30472 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:25:27.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:25:27 smithi132 bash[27079]: audit 2020-07-16T16:25:26.382126+0000 mgr.x (mgr.34562) 8020 : audit [DBG] from='client.30478 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:25:27.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:25:27 smithi132 bash[27079]: audit 2020-07-16T16:25:26.684764+0000 mon.c (mon.1) 533 : audit [DBG] from='client.? 172.21.15.132:0/3742758576' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:25:27.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:25:27 smithi188 bash[23329]: cluster 2020-07-16T16:25:25.736952+0000 mgr.x (mgr.34562) 8018 : cluster [DBG] pgmap v5002: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:25:27.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:25:27 smithi188 bash[23329]: audit 2020-07-16T16:25:26.113827+0000 mgr.x (mgr.34562) 8019 : audit [DBG] from='client.30472 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:25:27.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:25:27 smithi188 bash[23329]: audit 2020-07-16T16:25:26.382126+0000 mgr.x (mgr.34562) 8020 : audit [DBG] from='client.30478 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:25:27.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:25:27 smithi188 bash[23329]: audit 2020-07-16T16:25:26.684764+0000 mon.c (mon.1) 533 : audit [DBG] from='client.? 172.21.15.132:0/3742758576' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:25:29.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:25:29 smithi132 bash[27079]: cluster 2020-07-16T16:25:27.737375+0000 mgr.x (mgr.34562) 8021 : cluster [DBG] pgmap v5003: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:25:29.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:25:29 smithi188 bash[23329]: cluster 2020-07-16T16:25:27.737375+0000 mgr.x (mgr.34562) 8021 : cluster [DBG] pgmap v5003: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:25:31.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:25:31 smithi132 bash[27079]: cluster 2020-07-16T16:25:29.737797+0000 mgr.x (mgr.34562) 8022 : cluster [DBG] pgmap v5004: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:25:31.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:25:31 smithi188 bash[23329]: cluster 2020-07-16T16:25:29.737797+0000 mgr.x (mgr.34562) 8022 : cluster [DBG] pgmap v5004: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:25:33.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:25:33 smithi132 bash[27079]: cluster 2020-07-16T16:25:31.738246+0000 mgr.x (mgr.34562) 8023 : cluster [DBG] pgmap v5005: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:25:33.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:25:33 smithi188 bash[23329]: cluster 2020-07-16T16:25:31.738246+0000 mgr.x (mgr.34562) 8023 : cluster [DBG] pgmap v5005: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:25:35.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:25:35 smithi132 bash[27079]: cluster 2020-07-16T16:25:33.738753+0000 mgr.x (mgr.34562) 8024 : cluster [DBG] pgmap v5006: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:25:35.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:25:35 smithi188 bash[23329]: cluster 2020-07-16T16:25:33.738753+0000 mgr.x (mgr.34562) 8024 : cluster [DBG] pgmap v5006: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:25:37.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:25:37 smithi132 bash[27079]: cluster 2020-07-16T16:25:35.739160+0000 mgr.x (mgr.34562) 8025 : cluster [DBG] pgmap v5007: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:25:37.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:25:37 smithi132 bash[27079]: audit 2020-07-16T16:25:36.765657+0000 mon.b (mon.2) 1698 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:25:37.534 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:25:37 smithi132 bash[27079]: audit 2020-07-16T16:25:36.767055+0000 mon.b (mon.2) 1699 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:25:37.535 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:25:37 smithi132 bash[27079]: audit 2020-07-16T16:25:36.768307+0000 mon.b (mon.2) 1700 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:25:37.535 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:25:37 smithi132 bash[27079]: audit 2020-07-16T16:25:36.769730+0000 mon.b (mon.2) 1701 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:25:37.536 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:25:37 smithi132 bash[27079]: audit 2020-07-16T16:25:36.771029+0000 mon.b (mon.2) 1702 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:25:37.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:25:37 smithi188 bash[23329]: cluster 2020-07-16T16:25:35.739160+0000 mgr.x (mgr.34562) 8025 : cluster [DBG] pgmap v5007: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:25:37.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:25:37 smithi188 bash[23329]: audit 2020-07-16T16:25:36.765657+0000 mon.b (mon.2) 1698 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:25:37.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:25:37 smithi188 bash[23329]: audit 2020-07-16T16:25:36.767055+0000 mon.b (mon.2) 1699 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:25:37.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:25:37 smithi188 bash[23329]: audit 2020-07-16T16:25:36.768307+0000 mon.b (mon.2) 1700 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:25:37.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:25:37 smithi188 bash[23329]: audit 2020-07-16T16:25:36.769730+0000 mon.b (mon.2) 1701 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:25:37.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:25:37 smithi188 bash[23329]: audit 2020-07-16T16:25:36.771029+0000 mon.b (mon.2) 1702 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:25:38.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:25:38 smithi132 bash[27079]: audit 2020-07-16T16:25:36.766076+0000 mgr.x (mgr.34562) 8026 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:25:38.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:25:38 smithi132 bash[27079]: audit 2020-07-16T16:25:36.767370+0000 mgr.x (mgr.34562) 8027 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:25:38.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:25:38 smithi132 bash[27079]: audit 2020-07-16T16:25:36.768604+0000 mgr.x (mgr.34562) 8028 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:25:38.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:25:38 smithi132 bash[27079]: cephadm 2020-07-16T16:25:36.769347+0000 mgr.x (mgr.34562) 8029 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:25:38.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:25:38 smithi132 bash[27079]: cephadm 2020-07-16T16:25:36.770701+0000 mgr.x (mgr.34562) 8030 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:25:38.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:25:38 smithi132 bash[27079]: cephadm 2020-07-16T16:25:36.771777+0000 mgr.x (mgr.34562) 8031 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:25:38.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:25:38 smithi132 bash[27079]: cephadm 2020-07-16T16:25:36.771913+0000 mgr.x (mgr.34562) 8032 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:25:38.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:25:38 smithi188 bash[23329]: audit 2020-07-16T16:25:36.766076+0000 mgr.x (mgr.34562) 8026 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:25:38.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:25:38 smithi188 bash[23329]: audit 2020-07-16T16:25:36.767370+0000 mgr.x (mgr.34562) 8027 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:25:38.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:25:38 smithi188 bash[23329]: audit 2020-07-16T16:25:36.768604+0000 mgr.x (mgr.34562) 8028 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:25:38.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:25:38 smithi188 bash[23329]: cephadm 2020-07-16T16:25:36.769347+0000 mgr.x (mgr.34562) 8029 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:25:38.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:25:38 smithi188 bash[23329]: cephadm 2020-07-16T16:25:36.770701+0000 mgr.x (mgr.34562) 8030 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:25:38.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:25:38 smithi188 bash[23329]: cephadm 2020-07-16T16:25:36.771777+0000 mgr.x (mgr.34562) 8031 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:25:38.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:25:38 smithi188 bash[23329]: cephadm 2020-07-16T16:25:36.771913+0000 mgr.x (mgr.34562) 8032 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:25:39.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:25:39 smithi132 bash[27079]: cluster 2020-07-16T16:25:37.739644+0000 mgr.x (mgr.34562) 8033 : cluster [DBG] pgmap v5008: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:25:39.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:25:39 smithi188 bash[23329]: cluster 2020-07-16T16:25:37.739644+0000 mgr.x (mgr.34562) 8033 : cluster [DBG] pgmap v5008: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:25:40.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:25:40 smithi132 bash[27079]: audit 2020-07-16T16:25:39.641877+0000 mon.b (mon.2) 1703 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:25:40.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:25:40 smithi188 bash[23329]: audit 2020-07-16T16:25:39.641877+0000 mon.b (mon.2) 1703 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:25:41.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:25:41 smithi132 bash[27079]: cephadm 2020-07-16T16:25:39.642555+0000 mgr.x (mgr.34562) 8034 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:25:41.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:25:41 smithi132 bash[27079]: cephadm 2020-07-16T16:25:39.642636+0000 mgr.x (mgr.34562) 8035 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:25:41.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:25:41 smithi132 bash[27079]: cluster 2020-07-16T16:25:39.740125+0000 mgr.x (mgr.34562) 8036 : cluster [DBG] pgmap v5009: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:25:41.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:25:41 smithi188 bash[23329]: cephadm 2020-07-16T16:25:39.642555+0000 mgr.x (mgr.34562) 8034 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:25:41.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:25:41 smithi188 bash[23329]: cephadm 2020-07-16T16:25:39.642636+0000 mgr.x (mgr.34562) 8035 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:25:41.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:25:41 smithi188 bash[23329]: cluster 2020-07-16T16:25:39.740125+0000 mgr.x (mgr.34562) 8036 : cluster [DBG] pgmap v5009: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:25:43.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:25:43 smithi132 bash[27079]: cluster 2020-07-16T16:25:41.740515+0000 mgr.x (mgr.34562) 8037 : cluster [DBG] pgmap v5010: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:25:43.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:25:43 smithi188 bash[23329]: cluster 2020-07-16T16:25:41.740515+0000 mgr.x (mgr.34562) 8037 : cluster [DBG] pgmap v5010: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:25:45.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:25:45 smithi132 bash[27079]: cluster 2020-07-16T16:25:43.740901+0000 mgr.x (mgr.34562) 8038 : cluster [DBG] pgmap v5011: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:25:45.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:25:45 smithi188 bash[23329]: cluster 2020-07-16T16:25:43.740901+0000 mgr.x (mgr.34562) 8038 : cluster [DBG] pgmap v5011: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:25:47.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:25:47 smithi132 bash[27079]: cluster 2020-07-16T16:25:45.741319+0000 mgr.x (mgr.34562) 8039 : cluster [DBG] pgmap v5012: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:25:47.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:25:47 smithi188 bash[23329]: cluster 2020-07-16T16:25:45.741319+0000 mgr.x (mgr.34562) 8039 : cluster [DBG] pgmap v5012: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:25:49.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:25:49 smithi132 bash[27079]: cluster 2020-07-16T16:25:47.741702+0000 mgr.x (mgr.34562) 8040 : cluster [DBG] pgmap v5013: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:25:49.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:25:49 smithi188 bash[23329]: cluster 2020-07-16T16:25:47.741702+0000 mgr.x (mgr.34562) 8040 : cluster [DBG] pgmap v5013: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:25:51.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:25:51 smithi132 bash[27079]: cluster 2020-07-16T16:25:49.742076+0000 mgr.x (mgr.34562) 8041 : cluster [DBG] pgmap v5014: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:25:51.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:25:51 smithi188 bash[23329]: cluster 2020-07-16T16:25:49.742076+0000 mgr.x (mgr.34562) 8041 : cluster [DBG] pgmap v5014: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:25:53.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:25:53 smithi132 bash[27079]: cluster 2020-07-16T16:25:51.742603+0000 mgr.x (mgr.34562) 8042 : cluster [DBG] pgmap v5015: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:25:53.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:25:53 smithi188 bash[23329]: cluster 2020-07-16T16:25:51.742603+0000 mgr.x (mgr.34562) 8042 : cluster [DBG] pgmap v5015: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:25:55.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:25:55 smithi132 bash[27079]: cluster 2020-07-16T16:25:53.743081+0000 mgr.x (mgr.34562) 8043 : cluster [DBG] pgmap v5016: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:25:55.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:25:55 smithi132 bash[27079]: audit 2020-07-16T16:25:54.658224+0000 mon.b (mon.2) 1704 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:25:55.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:25:55 smithi188 bash[23329]: cluster 2020-07-16T16:25:53.743081+0000 mgr.x (mgr.34562) 8043 : cluster [DBG] pgmap v5016: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:25:55.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:25:55 smithi188 bash[23329]: audit 2020-07-16T16:25:54.658224+0000 mon.b (mon.2) 1704 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:25:56.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:25:56 smithi132 bash[27079]: cephadm 2020-07-16T16:25:54.658922+0000 mgr.x (mgr.34562) 8044 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:25:56.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:25:56 smithi132 bash[27079]: cephadm 2020-07-16T16:25:54.659013+0000 mgr.x (mgr.34562) 8045 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:25:56.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:25:56 smithi188 bash[23329]: cephadm 2020-07-16T16:25:54.658922+0000 mgr.x (mgr.34562) 8044 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:25:56.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:25:56 smithi188 bash[23329]: cephadm 2020-07-16T16:25:54.659013+0000 mgr.x (mgr.34562) 8045 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:25:56.984 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:25:57.241 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:25:57.242 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 8m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:25:57.242 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 8m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:25:57.242 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 8m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:25:57.242 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 8m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:25:57.242 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 8m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:25:57.243 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:25:57.243 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:25:57.243 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 8m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:25:57.243 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 8m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:25:57.243 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:25:57.244 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:25:57.244 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:25:57.244 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:25:57.244 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:25:57.244 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:25:57.245 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:25:57.245 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 8m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:25:57.245 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 8m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:25:57.528 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:25:57 smithi132 bash[27079]: cluster 2020-07-16T16:25:55.743472+0000 mgr.x (mgr.34562) 8046 : cluster [DBG] pgmap v5017: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:25:57.537 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:25:57.538 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:25:57.538 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:25:57.538 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:25:57.538 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:25:57.539 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:25:57.539 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:25:57.539 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:25:57.539 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:25:57.539 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:25:57.540 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:25:57.540 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:25:57.540 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:25:57.540 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:25:57.540 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:25:57.541 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:25:57.541 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:25:57.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:25:57 smithi188 bash[23329]: cluster 2020-07-16T16:25:55.743472+0000 mgr.x (mgr.34562) 8046 : cluster [DBG] pgmap v5017: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:25:58.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:25:58 smithi132 bash[27079]: audit 2020-07-16T16:25:56.972523+0000 mgr.x (mgr.34562) 8047 : audit [DBG] from='client.30490 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:25:58.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:25:58 smithi132 bash[27079]: audit 2020-07-16T16:25:57.236863+0000 mgr.x (mgr.34562) 8048 : audit [DBG] from='client.30496 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:25:58.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:25:58 smithi132 bash[27079]: audit 2020-07-16T16:25:57.536802+0000 mon.c (mon.1) 534 : audit [DBG] from='client.? 172.21.15.132:0/2873487164' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:25:58.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:25:58 smithi188 bash[23329]: audit 2020-07-16T16:25:56.972523+0000 mgr.x (mgr.34562) 8047 : audit [DBG] from='client.30490 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:25:58.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:25:58 smithi188 bash[23329]: audit 2020-07-16T16:25:57.236863+0000 mgr.x (mgr.34562) 8048 : audit [DBG] from='client.30496 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:25:58.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:25:58 smithi188 bash[23329]: audit 2020-07-16T16:25:57.536802+0000 mon.c (mon.1) 534 : audit [DBG] from='client.? 172.21.15.132:0/2873487164' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:25:59.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:25:59 smithi132 bash[27079]: cluster 2020-07-16T16:25:57.743860+0000 mgr.x (mgr.34562) 8049 : cluster [DBG] pgmap v5018: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:25:59.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:25:59 smithi188 bash[23329]: cluster 2020-07-16T16:25:57.743860+0000 mgr.x (mgr.34562) 8049 : cluster [DBG] pgmap v5018: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:26:01.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:26:01 smithi132 bash[27079]: cluster 2020-07-16T16:25:59.744332+0000 mgr.x (mgr.34562) 8050 : cluster [DBG] pgmap v5019: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:26:01.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:26:01 smithi188 bash[23329]: cluster 2020-07-16T16:25:59.744332+0000 mgr.x (mgr.34562) 8050 : cluster [DBG] pgmap v5019: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:26:03.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:26:03 smithi132 bash[27079]: cluster 2020-07-16T16:26:01.744874+0000 mgr.x (mgr.34562) 8051 : cluster [DBG] pgmap v5020: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:26:03.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:26:03 smithi188 bash[23329]: cluster 2020-07-16T16:26:01.744874+0000 mgr.x (mgr.34562) 8051 : cluster [DBG] pgmap v5020: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:26:05.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:26:05 smithi132 bash[27079]: cluster 2020-07-16T16:26:03.745404+0000 mgr.x (mgr.34562) 8052 : cluster [DBG] pgmap v5021: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:26:05.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:26:05 smithi188 bash[23329]: cluster 2020-07-16T16:26:03.745404+0000 mgr.x (mgr.34562) 8052 : cluster [DBG] pgmap v5021: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:26:07.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:26:07 smithi132 bash[27079]: cluster 2020-07-16T16:26:05.745798+0000 mgr.x (mgr.34562) 8053 : cluster [DBG] pgmap v5022: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:26:07.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:26:07 smithi188 bash[23329]: cluster 2020-07-16T16:26:05.745798+0000 mgr.x (mgr.34562) 8053 : cluster [DBG] pgmap v5022: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:26:09.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:26:09 smithi132 bash[27079]: cluster 2020-07-16T16:26:07.746239+0000 mgr.x (mgr.34562) 8054 : cluster [DBG] pgmap v5023: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:26:09.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:26:09 smithi188 bash[23329]: cluster 2020-07-16T16:26:07.746239+0000 mgr.x (mgr.34562) 8054 : cluster [DBG] pgmap v5023: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:26:10.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:26:10 smithi188 bash[23329]: audit 2020-07-16T16:26:09.674743+0000 mon.b (mon.2) 1705 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:26:10.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:26:10 smithi132 bash[27079]: audit 2020-07-16T16:26:09.674743+0000 mon.b (mon.2) 1705 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:26:11.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:26:11 smithi188 bash[23329]: cephadm 2020-07-16T16:26:09.675412+0000 mgr.x (mgr.34562) 8055 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:26:11.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:26:11 smithi188 bash[23329]: cephadm 2020-07-16T16:26:09.675804+0000 mgr.x (mgr.34562) 8056 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:26:11.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:26:11 smithi188 bash[23329]: cluster 2020-07-16T16:26:09.746619+0000 mgr.x (mgr.34562) 8057 : cluster [DBG] pgmap v5024: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:26:11.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:26:11 smithi132 bash[27079]: cephadm 2020-07-16T16:26:09.675412+0000 mgr.x (mgr.34562) 8055 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:26:11.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:26:11 smithi132 bash[27079]: cephadm 2020-07-16T16:26:09.675804+0000 mgr.x (mgr.34562) 8056 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:26:11.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:26:11 smithi132 bash[27079]: cluster 2020-07-16T16:26:09.746619+0000 mgr.x (mgr.34562) 8057 : cluster [DBG] pgmap v5024: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:26:13.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:26:13 smithi188 bash[23329]: cluster 2020-07-16T16:26:11.747142+0000 mgr.x (mgr.34562) 8058 : cluster [DBG] pgmap v5025: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:26:13.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:26:13 smithi132 bash[27079]: cluster 2020-07-16T16:26:11.747142+0000 mgr.x (mgr.34562) 8058 : cluster [DBG] pgmap v5025: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:26:15.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:26:15 smithi188 bash[23329]: cluster 2020-07-16T16:26:13.747550+0000 mgr.x (mgr.34562) 8059 : cluster [DBG] pgmap v5026: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:26:15.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:26:15 smithi132 bash[27079]: cluster 2020-07-16T16:26:13.747550+0000 mgr.x (mgr.34562) 8059 : cluster [DBG] pgmap v5026: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:26:17.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:26:17 smithi188 bash[23329]: cluster 2020-07-16T16:26:15.747975+0000 mgr.x (mgr.34562) 8060 : cluster [DBG] pgmap v5027: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:26:17.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:26:17 smithi132 bash[27079]: cluster 2020-07-16T16:26:15.747975+0000 mgr.x (mgr.34562) 8060 : cluster [DBG] pgmap v5027: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:26:19.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:26:19 smithi188 bash[23329]: cluster 2020-07-16T16:26:17.748571+0000 mgr.x (mgr.34562) 8061 : cluster [DBG] pgmap v5028: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:26:19.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:26:19 smithi132 bash[27079]: cluster 2020-07-16T16:26:17.748571+0000 mgr.x (mgr.34562) 8061 : cluster [DBG] pgmap v5028: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:26:21.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:26:21 smithi188 bash[23329]: cluster 2020-07-16T16:26:19.748968+0000 mgr.x (mgr.34562) 8062 : cluster [DBG] pgmap v5029: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:26:21.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:26:21 smithi132 bash[27079]: cluster 2020-07-16T16:26:19.748968+0000 mgr.x (mgr.34562) 8062 : cluster [DBG] pgmap v5029: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:26:23.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:26:23 smithi188 bash[23329]: cluster 2020-07-16T16:26:21.749517+0000 mgr.x (mgr.34562) 8063 : cluster [DBG] pgmap v5030: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:26:23.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:26:23 smithi132 bash[27079]: cluster 2020-07-16T16:26:21.749517+0000 mgr.x (mgr.34562) 8063 : cluster [DBG] pgmap v5030: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:26:25.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:26:25 smithi188 bash[23329]: cluster 2020-07-16T16:26:23.749886+0000 mgr.x (mgr.34562) 8064 : cluster [DBG] pgmap v5031: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:26:25.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:26:25 smithi188 bash[23329]: audit 2020-07-16T16:26:24.691243+0000 mon.b (mon.2) 1706 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:26:25.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:26:25 smithi132 bash[27079]: cluster 2020-07-16T16:26:23.749886+0000 mgr.x (mgr.34562) 8064 : cluster [DBG] pgmap v5031: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:26:25.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:26:25 smithi132 bash[27079]: audit 2020-07-16T16:26:24.691243+0000 mon.b (mon.2) 1706 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:26:26.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:26:26 smithi188 bash[23329]: cephadm 2020-07-16T16:26:24.691975+0000 mgr.x (mgr.34562) 8065 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:26:26.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:26:26 smithi188 bash[23329]: cephadm 2020-07-16T16:26:24.692401+0000 mgr.x (mgr.34562) 8066 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:26:26.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:26:26 smithi132 bash[27079]: cephadm 2020-07-16T16:26:24.691975+0000 mgr.x (mgr.34562) 8065 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:26:26.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:26:26 smithi132 bash[27079]: cephadm 2020-07-16T16:26:24.692401+0000 mgr.x (mgr.34562) 8066 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:26:27.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:26:27 smithi188 bash[23329]: cluster 2020-07-16T16:26:25.750297+0000 mgr.x (mgr.34562) 8067 : cluster [DBG] pgmap v5032: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:26:27.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:26:27 smithi132 bash[27079]: cluster 2020-07-16T16:26:25.750297+0000 mgr.x (mgr.34562) 8067 : cluster [DBG] pgmap v5032: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:26:27.835 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:26:28.098 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:26:28.098 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 9m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:26:28.099 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 9m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:26:28.099 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 9m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:26:28.099 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 9m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:26:28.099 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 9m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:26:28.099 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:26:28.100 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:26:28.100 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 9m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:26:28.100 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 9m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:26:28.100 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:26:28.100 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:26:28.101 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:26:28.101 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:26:28.101 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:26:28.101 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:26:28.101 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:26:28.102 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:26:28.102 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 9m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:26:28.398 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:26:28.399 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:26:28.399 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:26:28.399 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:26:28.399 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:26:28.400 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:26:28.400 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:26:28.400 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:26:28.400 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:26:28.400 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:26:28.401 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:26:28.401 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:26:28.401 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:26:28.401 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:26:28.402 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:26:28.402 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:26:28.402 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:26:29.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:26:29 smithi188 bash[23329]: cluster 2020-07-16T16:26:27.750814+0000 mgr.x (mgr.34562) 8068 : cluster [DBG] pgmap v5033: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:26:29.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:26:29 smithi188 bash[23329]: audit 2020-07-16T16:26:27.823552+0000 mgr.x (mgr.34562) 8069 : audit [DBG] from='client.30508 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:26:29.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:26:29 smithi188 bash[23329]: audit 2020-07-16T16:26:28.093627+0000 mgr.x (mgr.34562) 8070 : audit [DBG] from='client.30514 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:26:29.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:26:29 smithi188 bash[23329]: audit 2020-07-16T16:26:28.397822+0000 mon.c (mon.1) 535 : audit [DBG] from='client.? 172.21.15.132:0/3841959706' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:26:29.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:26:29 smithi132 bash[27079]: cluster 2020-07-16T16:26:27.750814+0000 mgr.x (mgr.34562) 8068 : cluster [DBG] pgmap v5033: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:26:29.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:26:29 smithi132 bash[27079]: audit 2020-07-16T16:26:27.823552+0000 mgr.x (mgr.34562) 8069 : audit [DBG] from='client.30508 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:26:29.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:26:29 smithi132 bash[27079]: audit 2020-07-16T16:26:28.093627+0000 mgr.x (mgr.34562) 8070 : audit [DBG] from='client.30514 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:26:29.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:26:29 smithi132 bash[27079]: audit 2020-07-16T16:26:28.397822+0000 mon.c (mon.1) 535 : audit [DBG] from='client.? 172.21.15.132:0/3841959706' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:26:31.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:26:31 smithi188 bash[23329]: cluster 2020-07-16T16:26:29.751349+0000 mgr.x (mgr.34562) 8071 : cluster [DBG] pgmap v5034: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:26:31.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:26:31 smithi132 bash[27079]: cluster 2020-07-16T16:26:29.751349+0000 mgr.x (mgr.34562) 8071 : cluster [DBG] pgmap v5034: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:26:33.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:26:33 smithi188 bash[23329]: cluster 2020-07-16T16:26:31.751747+0000 mgr.x (mgr.34562) 8072 : cluster [DBG] pgmap v5035: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:26:33.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:26:33 smithi132 bash[27079]: cluster 2020-07-16T16:26:31.751747+0000 mgr.x (mgr.34562) 8072 : cluster [DBG] pgmap v5035: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:26:35.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:26:35 smithi188 bash[23329]: cluster 2020-07-16T16:26:33.752263+0000 mgr.x (mgr.34562) 8073 : cluster [DBG] pgmap v5036: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:26:35.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:26:35 smithi132 bash[27079]: cluster 2020-07-16T16:26:33.752263+0000 mgr.x (mgr.34562) 8073 : cluster [DBG] pgmap v5036: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:26:37.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:26:37 smithi188 bash[23329]: cluster 2020-07-16T16:26:35.752674+0000 mgr.x (mgr.34562) 8074 : cluster [DBG] pgmap v5037: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:26:37.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:26:37 smithi132 bash[27079]: cluster 2020-07-16T16:26:35.752674+0000 mgr.x (mgr.34562) 8074 : cluster [DBG] pgmap v5037: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:26:39.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:26:39 smithi188 bash[23329]: cluster 2020-07-16T16:26:37.753103+0000 mgr.x (mgr.34562) 8075 : cluster [DBG] pgmap v5038: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:26:39.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:26:39 smithi132 bash[27079]: cluster 2020-07-16T16:26:37.753103+0000 mgr.x (mgr.34562) 8075 : cluster [DBG] pgmap v5038: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:26:40.516 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:26:40 smithi132 bash[27079]: audit 2020-07-16T16:26:39.710331+0000 mon.b (mon.2) 1707 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:26:40.516 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:26:40 smithi132 bash[27079]: audit 2020-07-16T16:26:39.711776+0000 mon.b (mon.2) 1708 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:26:40.517 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:26:40 smithi132 bash[27079]: audit 2020-07-16T16:26:39.713019+0000 mon.b (mon.2) 1709 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:26:40.517 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:26:40 smithi132 bash[27079]: audit 2020-07-16T16:26:39.714455+0000 mon.b (mon.2) 1710 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:26:40.517 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:26:40 smithi132 bash[27079]: audit 2020-07-16T16:26:39.715835+0000 mon.b (mon.2) 1711 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:26:40.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:26:40 smithi188 bash[23329]: audit 2020-07-16T16:26:39.710331+0000 mon.b (mon.2) 1707 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:26:40.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:26:40 smithi188 bash[23329]: audit 2020-07-16T16:26:39.711776+0000 mon.b (mon.2) 1708 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:26:40.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:26:40 smithi188 bash[23329]: audit 2020-07-16T16:26:39.713019+0000 mon.b (mon.2) 1709 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:26:40.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:26:40 smithi188 bash[23329]: audit 2020-07-16T16:26:39.714455+0000 mon.b (mon.2) 1710 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:26:40.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:26:40 smithi188 bash[23329]: audit 2020-07-16T16:26:39.715835+0000 mon.b (mon.2) 1711 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:26:41.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:26:41 smithi132 bash[27079]: audit 2020-07-16T16:26:39.710724+0000 mgr.x (mgr.34562) 8076 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:26:41.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:26:41 smithi132 bash[27079]: audit 2020-07-16T16:26:39.712097+0000 mgr.x (mgr.34562) 8077 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:26:41.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:26:41 smithi132 bash[27079]: audit 2020-07-16T16:26:39.713342+0000 mgr.x (mgr.34562) 8078 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:26:41.529 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:26:41 smithi132 bash[27079]: cephadm 2020-07-16T16:26:39.714073+0000 mgr.x (mgr.34562) 8079 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:26:41.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:26:41 smithi132 bash[27079]: cephadm 2020-07-16T16:26:39.715295+0000 mgr.x (mgr.34562) 8080 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:26:41.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:26:41 smithi132 bash[27079]: cephadm 2020-07-16T16:26:39.716595+0000 mgr.x (mgr.34562) 8081 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:26:41.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:26:41 smithi132 bash[27079]: cephadm 2020-07-16T16:26:39.716898+0000 mgr.x (mgr.34562) 8082 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:26:41.530 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:26:41 smithi132 bash[27079]: cluster 2020-07-16T16:26:39.753542+0000 mgr.x (mgr.34562) 8083 : cluster [DBG] pgmap v5039: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:26:41.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:26:41 smithi188 bash[23329]: audit 2020-07-16T16:26:39.710724+0000 mgr.x (mgr.34562) 8076 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:26:41.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:26:41 smithi188 bash[23329]: audit 2020-07-16T16:26:39.712097+0000 mgr.x (mgr.34562) 8077 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:26:41.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:26:41 smithi188 bash[23329]: audit 2020-07-16T16:26:39.713342+0000 mgr.x (mgr.34562) 8078 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:26:41.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:26:41 smithi188 bash[23329]: cephadm 2020-07-16T16:26:39.714073+0000 mgr.x (mgr.34562) 8079 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:26:41.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:26:41 smithi188 bash[23329]: cephadm 2020-07-16T16:26:39.715295+0000 mgr.x (mgr.34562) 8080 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:26:41.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:26:41 smithi188 bash[23329]: cephadm 2020-07-16T16:26:39.716595+0000 mgr.x (mgr.34562) 8081 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:26:41.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:26:41 smithi188 bash[23329]: cephadm 2020-07-16T16:26:39.716898+0000 mgr.x (mgr.34562) 8082 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:26:41.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:26:41 smithi188 bash[23329]: cluster 2020-07-16T16:26:39.753542+0000 mgr.x (mgr.34562) 8083 : cluster [DBG] pgmap v5039: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:26:43.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:26:43 smithi188 bash[23329]: cluster 2020-07-16T16:26:41.753969+0000 mgr.x (mgr.34562) 8084 : cluster [DBG] pgmap v5040: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:26:43.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:26:43 smithi188 bash[23329]: audit 2020-07-16T16:26:42.527549+0000 mon.b (mon.2) 1712 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:26:43.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:26:43 smithi188 bash[23329]: cephadm 2020-07-16T16:26:42.528210+0000 mgr.x (mgr.34562) 8085 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:26:43.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:26:43 smithi188 bash[23329]: cephadm 2020-07-16T16:26:42.528568+0000 mgr.x (mgr.34562) 8086 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:26:43.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:26:43 smithi132 bash[27079]: cluster 2020-07-16T16:26:41.753969+0000 mgr.x (mgr.34562) 8084 : cluster [DBG] pgmap v5040: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:26:43.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:26:43 smithi132 bash[27079]: audit 2020-07-16T16:26:42.527549+0000 mon.b (mon.2) 1712 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:26:43.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:26:43 smithi132 bash[27079]: cephadm 2020-07-16T16:26:42.528210+0000 mgr.x (mgr.34562) 8085 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:26:43.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:26:43 smithi132 bash[27079]: cephadm 2020-07-16T16:26:42.528568+0000 mgr.x (mgr.34562) 8086 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:26:45.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:26:45 smithi188 bash[23329]: cluster 2020-07-16T16:26:43.754489+0000 mgr.x (mgr.34562) 8087 : cluster [DBG] pgmap v5041: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:26:45.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:26:45 smithi132 bash[27079]: cluster 2020-07-16T16:26:43.754489+0000 mgr.x (mgr.34562) 8087 : cluster [DBG] pgmap v5041: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:26:47.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:26:47 smithi188 bash[23329]: cluster 2020-07-16T16:26:45.755058+0000 mgr.x (mgr.34562) 8088 : cluster [DBG] pgmap v5042: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:26:47.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:26:47 smithi132 bash[27079]: cluster 2020-07-16T16:26:45.755058+0000 mgr.x (mgr.34562) 8088 : cluster [DBG] pgmap v5042: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:26:49.673 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:26:49 smithi188 bash[23329]: cluster 2020-07-16T16:26:47.755521+0000 mgr.x (mgr.34562) 8089 : cluster [DBG] pgmap v5043: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:26:49.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:26:49 smithi132 bash[27079]: cluster 2020-07-16T16:26:47.755521+0000 mgr.x (mgr.34562) 8089 : cluster [DBG] pgmap v5043: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:26:51.711 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:26:51 smithi188 bash[23329]: cluster 2020-07-16T16:26:49.755910+0000 mgr.x (mgr.34562) 8090 : cluster [DBG] pgmap v5044: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:26:51.782 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:26:51 smithi132 bash[27079]: cluster 2020-07-16T16:26:49.755910+0000 mgr.x (mgr.34562) 8090 : cluster [DBG] pgmap v5044: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:26:53.672 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:26:53 smithi188 bash[23329]: cluster 2020-07-16T16:26:51.756335+0000 mgr.x (mgr.34562) 8091 : cluster [DBG] pgmap v5045: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:26:53.808 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:26:53 smithi132 bash[27079]: cluster 2020-07-16T16:26:51.756335+0000 mgr.x (mgr.34562) 8091 : cluster [DBG] pgmap v5045: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:26:55.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:26:55 smithi188 bash[23329]: cluster 2020-07-16T16:26:53.756695+0000 mgr.x (mgr.34562) 8092 : cluster [DBG] pgmap v5046: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:26:55.786 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:26:55 smithi132 bash[27079]: cluster 2020-07-16T16:26:53.756695+0000 mgr.x (mgr.34562) 8092 : cluster [DBG] pgmap v5046: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:26:57.679 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:26:57 smithi188 bash[23329]: cluster 2020-07-16T16:26:55.757201+0000 mgr.x (mgr.34562) 8093 : cluster [DBG] pgmap v5047: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:26:57.816 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:26:57 smithi132 bash[27079]: cluster 2020-07-16T16:26:55.757201+0000 mgr.x (mgr.34562) 8093 : cluster [DBG] pgmap v5047: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:26:58.690 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:26:58 smithi188 bash[23329]: audit 2020-07-16T16:26:57.543991+0000 mon.b (mon.2) 1713 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:26:58.691 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:26:58 smithi188 bash[23329]: cephadm 2020-07-16T16:26:57.544696+0000 mgr.x (mgr.34562) 8094 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:26:58.691 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:26:58 smithi188 bash[23329]: cephadm 2020-07-16T16:26:57.545118+0000 mgr.x (mgr.34562) 8095 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:26:58.710 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:26:58.785 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:26:58 smithi132 bash[27079]: audit 2020-07-16T16:26:57.543991+0000 mon.b (mon.2) 1713 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:26:58.786 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:26:58 smithi132 bash[27079]: cephadm 2020-07-16T16:26:57.544696+0000 mgr.x (mgr.34562) 8094 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:26:58.786 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:26:58 smithi132 bash[27079]: cephadm 2020-07-16T16:26:57.545118+0000 mgr.x (mgr.34562) 8095 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:26:58.963 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:26:58.964 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 9m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:26:58.965 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 9m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:26:58.965 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 9m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:26:58.965 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 9m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:26:58.966 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 9m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:26:58.966 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:26:58.966 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:26:58.967 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 9m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:26:58.967 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 9m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:26:58.968 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:26:58.968 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:26:58.984 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:26:58.984 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:26:58.984 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:26:58.985 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:26:58.989 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:26:58.989 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 9m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:26:58.989 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 9m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:26:59.260 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:26:59.261 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:26:59.261 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:26:59.261 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:26:59.262 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:26:59.262 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:26:59.262 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:26:59.262 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:26:59.263 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:26:59.263 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:26:59.263 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:26:59.263 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:26:59.263 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:26:59.264 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:26:59.264 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:26:59.264 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:26:59.264 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:26:59.670 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:26:59 smithi188 bash[23329]: cluster 2020-07-16T16:26:57.757627+0000 mgr.x (mgr.34562) 8096 : cluster [DBG] pgmap v5048: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:26:59.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:26:59 smithi188 bash[23329]: audit 2020-07-16T16:26:59.259250+0000 mon.c (mon.1) 536 : audit [DBG] from='client.? 172.21.15.132:0/4087796333' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:26:59.789 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:26:59 smithi132 bash[27079]: cluster 2020-07-16T16:26:57.757627+0000 mgr.x (mgr.34562) 8096 : cluster [DBG] pgmap v5048: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:26:59.789 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:26:59 smithi132 bash[27079]: audit 2020-07-16T16:26:59.259250+0000 mon.c (mon.1) 536 : audit [DBG] from='client.? 172.21.15.132:0/4087796333' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:27:00.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:00 smithi188 bash[23329]: audit 2020-07-16T16:26:58.687277+0000 mgr.x (mgr.34562) 8097 : audit [DBG] from='client.30526 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:27:00.675 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:00 smithi188 bash[23329]: audit 2020-07-16T16:26:58.958876+0000 mgr.x (mgr.34562) 8098 : audit [DBG] from='client.30532 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:27:00.778 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:00 smithi132 bash[27079]: audit 2020-07-16T16:26:58.687277+0000 mgr.x (mgr.34562) 8097 : audit [DBG] from='client.30526 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:27:00.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:00 smithi132 bash[27079]: audit 2020-07-16T16:26:58.958876+0000 mgr.x (mgr.34562) 8098 : audit [DBG] from='client.30532 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:27:01.674 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:01 smithi188 bash[23329]: cluster 2020-07-16T16:26:59.758113+0000 mgr.x (mgr.34562) 8099 : cluster [DBG] pgmap v5049: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:27:01.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:01 smithi132 bash[27079]: cluster 2020-07-16T16:26:59.758113+0000 mgr.x (mgr.34562) 8099 : cluster [DBG] pgmap v5049: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:27:03.688 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:03 smithi188 bash[23329]: cluster 2020-07-16T16:27:01.758533+0000 mgr.x (mgr.34562) 8100 : cluster [DBG] pgmap v5050: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:27:03.788 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:03 smithi132 bash[27079]: cluster 2020-07-16T16:27:01.758533+0000 mgr.x (mgr.34562) 8100 : cluster [DBG] pgmap v5050: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:27:05.671 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:05 smithi188 bash[23329]: cluster 2020-07-16T16:27:03.759045+0000 mgr.x (mgr.34562) 8101 : cluster [DBG] pgmap v5051: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:27:05.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:05 smithi132 bash[27079]: cluster 2020-07-16T16:27:03.759045+0000 mgr.x (mgr.34562) 8101 : cluster [DBG] pgmap v5051: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:27:07.758 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:07 smithi188 bash[23329]: cluster 2020-07-16T16:27:05.759557+0000 mgr.x (mgr.34562) 8102 : cluster [DBG] pgmap v5052: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:27:07.863 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:07 smithi132 bash[27079]: cluster 2020-07-16T16:27:05.759557+0000 mgr.x (mgr.34562) 8102 : cluster [DBG] pgmap v5052: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:27:09.798 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:09 smithi188 bash[23329]: cluster 2020-07-16T16:27:07.760048+0000 mgr.x (mgr.34562) 8103 : cluster [DBG] pgmap v5053: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:27:10.349 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:09 smithi132 bash[27079]: cluster 2020-07-16T16:27:07.760048+0000 mgr.x (mgr.34562) 8103 : cluster [DBG] pgmap v5053: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:27:11.354 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:11 smithi188 bash[23329]: cluster 2020-07-16T16:27:09.760449+0000 mgr.x (mgr.34562) 8104 : cluster [DBG] pgmap v5054: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:27:11.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:11 smithi132 bash[27079]: cluster 2020-07-16T16:27:09.760449+0000 mgr.x (mgr.34562) 8104 : cluster [DBG] pgmap v5054: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:27:13.354 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:13 smithi188 bash[23329]: cluster 2020-07-16T16:27:11.760821+0000 mgr.x (mgr.34562) 8105 : cluster [DBG] pgmap v5055: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:27:13.355 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:13 smithi188 bash[23329]: audit 2020-07-16T16:27:12.560614+0000 mon.b (mon.2) 1714 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:27:13.356 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:13 smithi188 bash[23329]: cephadm 2020-07-16T16:27:12.561408+0000 mgr.x (mgr.34562) 8106 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:27:13.356 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:13 smithi188 bash[23329]: cephadm 2020-07-16T16:27:12.561656+0000 mgr.x (mgr.34562) 8107 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:27:13.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:13 smithi132 bash[27079]: cluster 2020-07-16T16:27:11.760821+0000 mgr.x (mgr.34562) 8105 : cluster [DBG] pgmap v5055: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:27:13.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:13 smithi132 bash[27079]: audit 2020-07-16T16:27:12.560614+0000 mon.b (mon.2) 1714 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:27:13.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:13 smithi132 bash[27079]: cephadm 2020-07-16T16:27:12.561408+0000 mgr.x (mgr.34562) 8106 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:27:13.464 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:13 smithi132 bash[27079]: cephadm 2020-07-16T16:27:12.561656+0000 mgr.x (mgr.34562) 8107 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:27:15.354 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:15 smithi188 bash[23329]: cluster 2020-07-16T16:27:13.761220+0000 mgr.x (mgr.34562) 8108 : cluster [DBG] pgmap v5056: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:27:15.462 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:15 smithi132 bash[27079]: cluster 2020-07-16T16:27:13.761220+0000 mgr.x (mgr.34562) 8108 : cluster [DBG] pgmap v5056: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:27:17.354 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:17 smithi188 bash[23329]: cluster 2020-07-16T16:27:15.761586+0000 mgr.x (mgr.34562) 8109 : cluster [DBG] pgmap v5057: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:27:17.462 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:17 smithi132 bash[27079]: cluster 2020-07-16T16:27:15.761586+0000 mgr.x (mgr.34562) 8109 : cluster [DBG] pgmap v5057: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:27:19.354 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:19 smithi188 bash[23329]: cluster 2020-07-16T16:27:17.761985+0000 mgr.x (mgr.34562) 8110 : cluster [DBG] pgmap v5058: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:27:19.462 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:19 smithi132 bash[27079]: cluster 2020-07-16T16:27:17.761985+0000 mgr.x (mgr.34562) 8110 : cluster [DBG] pgmap v5058: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:27:21.354 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:21 smithi188 bash[23329]: cluster 2020-07-16T16:27:19.762366+0000 mgr.x (mgr.34562) 8111 : cluster [DBG] pgmap v5059: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:27:21.462 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:21 smithi132 bash[27079]: cluster 2020-07-16T16:27:19.762366+0000 mgr.x (mgr.34562) 8111 : cluster [DBG] pgmap v5059: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:27:23.354 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:23 smithi188 bash[23329]: cluster 2020-07-16T16:27:21.762742+0000 mgr.x (mgr.34562) 8112 : cluster [DBG] pgmap v5060: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:27:23.462 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:23 smithi132 bash[27079]: cluster 2020-07-16T16:27:21.762742+0000 mgr.x (mgr.34562) 8112 : cluster [DBG] pgmap v5060: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:27:25.354 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:25 smithi188 bash[23329]: cluster 2020-07-16T16:27:23.763163+0000 mgr.x (mgr.34562) 8113 : cluster [DBG] pgmap v5061: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:27:25.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:25 smithi132 bash[27079]: cluster 2020-07-16T16:27:23.763163+0000 mgr.x (mgr.34562) 8113 : cluster [DBG] pgmap v5061: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:27:27.462 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:27 smithi132 bash[27079]: cluster 2020-07-16T16:27:25.763533+0000 mgr.x (mgr.34562) 8114 : cluster [DBG] pgmap v5062: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:27:27.604 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:27 smithi188 bash[23329]: cluster 2020-07-16T16:27:25.763533+0000 mgr.x (mgr.34562) 8114 : cluster [DBG] pgmap v5062: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:27:28.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:28 smithi132 bash[27079]: audit 2020-07-16T16:27:27.577367+0000 mon.b (mon.2) 1715 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:27:28.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:28 smithi132 bash[27079]: cephadm 2020-07-16T16:27:27.578010+0000 mgr.x (mgr.34562) 8115 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:27:28.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:28 smithi132 bash[27079]: cephadm 2020-07-16T16:27:27.578362+0000 mgr.x (mgr.34562) 8116 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:27:28.604 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:28 smithi188 bash[23329]: audit 2020-07-16T16:27:27.577367+0000 mon.b (mon.2) 1715 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:27:28.605 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:28 smithi188 bash[23329]: cephadm 2020-07-16T16:27:27.578010+0000 mgr.x (mgr.34562) 8115 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:27:28.605 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:28 smithi188 bash[23329]: cephadm 2020-07-16T16:27:27.578362+0000 mgr.x (mgr.34562) 8116 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:27:29.243 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:27:29.462 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:29 smithi132 bash[27079]: cluster 2020-07-16T16:27:27.764007+0000 mgr.x (mgr.34562) 8117 : cluster [DBG] pgmap v5063: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:27:29.518 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:27:29.519 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 10m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:27:29.519 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 10m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:27:29.519 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 10m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:27:29.520 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 10m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:27:29.520 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 10m ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:27:29.520 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:27:29.521 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:27:29.521 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 10m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:27:29.521 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 10m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:27:29.522 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:27:29.522 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:27:29.522 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:27:29.523 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:27:29.523 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:27:29.523 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:27:29.524 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:27:29.524 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 10m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:27:29.524 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 10m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:27:29.604 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:29 smithi188 bash[23329]: cluster 2020-07-16T16:27:27.764007+0000 mgr.x (mgr.34562) 8117 : cluster [DBG] pgmap v5063: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:27:29.813 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:27:29.813 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:27:29.814 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:27:29.814 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:27:29.814 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:27:29.815 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:27:29.815 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:27:29.815 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:27:29.816 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:27:29.816 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:27:29.816 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:27:29.817 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:27:29.817 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:27:29.817 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:27:29.818 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:27:29.818 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:27:29.818 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:27:30.466 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:30 smithi132 bash[27079]: audit 2020-07-16T16:27:29.547063+0000 mgr.x (mgr.34562) 8118 : audit [DBG] from='client.30544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:27:30.467 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:30 smithi132 bash[27079]: audit 2020-07-16T16:27:30.128283+0000 mon.c (mon.1) 537 : audit [DBG] from='client.? 172.21.15.132:0/3777815443' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:27:30.604 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:30 smithi188 bash[23329]: audit 2020-07-16T16:27:29.547063+0000 mgr.x (mgr.34562) 8118 : audit [DBG] from='client.30544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:27:30.605 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:30 smithi188 bash[23329]: audit 2020-07-16T16:27:30.128283+0000 mon.c (mon.1) 537 : audit [DBG] from='client.? 172.21.15.132:0/3777815443' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:27:31.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:31 smithi132 bash[27079]: cluster 2020-07-16T16:27:29.764502+0000 mgr.x (mgr.34562) 8119 : cluster [DBG] pgmap v5064: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:27:31.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:31 smithi132 bash[27079]: audit 2020-07-16T16:27:29.830441+0000 mgr.x (mgr.34562) 8120 : audit [DBG] from='client.30550 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:27:31.604 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:31 smithi188 bash[23329]: cluster 2020-07-16T16:27:29.764502+0000 mgr.x (mgr.34562) 8119 : cluster [DBG] pgmap v5064: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:27:31.605 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:31 smithi188 bash[23329]: audit 2020-07-16T16:27:29.830441+0000 mgr.x (mgr.34562) 8120 : audit [DBG] from='client.30550 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:27:33.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:33 smithi132 bash[27079]: cluster 2020-07-16T16:27:31.764915+0000 mgr.x (mgr.34562) 8121 : cluster [DBG] pgmap v5065: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:27:33.604 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:33 smithi188 bash[23329]: cluster 2020-07-16T16:27:31.764915+0000 mgr.x (mgr.34562) 8121 : cluster [DBG] pgmap v5065: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:27:35.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:35 smithi132 bash[27079]: cluster 2020-07-16T16:27:33.765328+0000 mgr.x (mgr.34562) 8122 : cluster [DBG] pgmap v5066: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:27:35.604 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:35 smithi188 bash[23329]: cluster 2020-07-16T16:27:33.765328+0000 mgr.x (mgr.34562) 8122 : cluster [DBG] pgmap v5066: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:27:37.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:37 smithi132 bash[27079]: cluster 2020-07-16T16:27:35.765716+0000 mgr.x (mgr.34562) 8123 : cluster [DBG] pgmap v5067: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:27:37.604 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:37 smithi188 bash[23329]: cluster 2020-07-16T16:27:35.765716+0000 mgr.x (mgr.34562) 8123 : cluster [DBG] pgmap v5067: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:27:39.462 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:39 smithi132 bash[27079]: cluster 2020-07-16T16:27:37.766237+0000 mgr.x (mgr.34562) 8124 : cluster [DBG] pgmap v5068: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:27:39.604 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:39 smithi188 bash[23329]: cluster 2020-07-16T16:27:37.766237+0000 mgr.x (mgr.34562) 8124 : cluster [DBG] pgmap v5068: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:27:41.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:41 smithi132 bash[27079]: cluster 2020-07-16T16:27:39.766691+0000 mgr.x (mgr.34562) 8125 : cluster [DBG] pgmap v5069: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:27:41.604 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:41 smithi188 bash[23329]: cluster 2020-07-16T16:27:39.766691+0000 mgr.x (mgr.34562) 8125 : cluster [DBG] pgmap v5069: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:27:43.207 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:43 smithi132 bash[27079]: cluster 2020-07-16T16:27:41.767069+0000 mgr.x (mgr.34562) 8126 : cluster [DBG] pgmap v5070: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:27:43.208 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:43 smithi132 bash[27079]: audit 2020-07-16T16:27:42.594424+0000 mon.b (mon.2) 1716 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T16:27:43.208 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:43 smithi132 bash[27079]: audit 2020-07-16T16:27:42.594696+0000 mon.b (mon.2) 1717 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T16:27:43.604 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:43 smithi188 bash[23329]: cluster 2020-07-16T16:27:41.767069+0000 mgr.x (mgr.34562) 8126 : cluster [DBG] pgmap v5070: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:27:43.605 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:43 smithi188 bash[23329]: audit 2020-07-16T16:27:42.594424+0000 mon.b (mon.2) 1716 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T16:27:43.605 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:43 smithi188 bash[23329]: audit 2020-07-16T16:27:42.594696+0000 mon.b (mon.2) 1717 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T16:27:45.464 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:45 smithi132 bash[27079]: cluster 2020-07-16T16:27:43.767396+0000 mgr.x (mgr.34562) 8127 : cluster [DBG] pgmap v5071: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:27:45.465 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:45 smithi132 bash[27079]: audit 2020-07-16T16:27:44.813109+0000 mon.b (mon.2) 1718 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T16:27:44.811366\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811424\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811460\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811490\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811652\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811759\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811862\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811962\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811996\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T16:27:44.812067\", \"last_device_update\": \"2020-07-16T16:05:32.972399\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T16:19:19.250999\"}"}]: dispatch 2020-07-16T16:27:45.465 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:45 smithi132 bash[27079]: audit 2020-07-16T16:27:44.813540+0000 mon.c (mon.1) 538 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T16:27:44.811366\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811424\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811460\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811490\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811652\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811759\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811862\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811962\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811996\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T16:27:44.812067\", \"last_device_update\": \"2020-07-16T16:05:32.972399\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T16:19:19.250999\"}"}]: dispatch 2020-07-16T16:27:45.466 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:45 smithi132 bash[27079]: audit 2020-07-16T16:27:44.816423+0000 mon.c (mon.1) 539 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T16:27:44.811366\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811424\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811460\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811490\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811652\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811759\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811862\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811962\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811996\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T16:27:44.812067\", \"last_device_update\": \"2020-07-16T16:05:32.972399\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T16:19:19.250999\"}"}]': finished 2020-07-16T16:27:45.466 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:45 smithi132 bash[27079]: audit 2020-07-16T16:27:45.121763+0000 mon.b (mon.2) 1719 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120242\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120344\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120377\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120537\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120653\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120749\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120847\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120879\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120907\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T16:27:45.120974\", \"last_device_update\": \"2020-07-16T16:06:41.170725\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T16:19:19.255976\"}"}]: dispatch 2020-07-16T16:27:45.467 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:45 smithi132 bash[27079]: audit 2020-07-16T16:27:45.122425+0000 mon.c (mon.1) 540 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120242\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120344\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120377\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120537\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120653\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120749\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120847\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120879\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120907\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T16:27:45.120974\", \"last_device_update\": \"2020-07-16T16:06:41.170725\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T16:19:19.255976\"}"}]: dispatch 2020-07-16T16:27:45.467 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:45 smithi132 bash[27079]: audit 2020-07-16T16:27:45.125058+0000 mon.c (mon.1) 541 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120242\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120344\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120377\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120537\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120653\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120749\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120847\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120879\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120907\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T16:27:45.120974\", \"last_device_update\": \"2020-07-16T16:06:41.170725\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T16:19:19.255976\"}"}]': finished 2020-07-16T16:27:45.468 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:45 smithi132 bash[27079]: audit 2020-07-16T16:27:45.127660+0000 mon.b (mon.2) 1720 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:27:45.468 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:45 smithi132 bash[27079]: audit 2020-07-16T16:27:45.128616+0000 mon.b (mon.2) 1721 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:27:45.469 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:45 smithi132 bash[27079]: audit 2020-07-16T16:27:45.129466+0000 mon.b (mon.2) 1722 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:27:45.469 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:45 smithi132 bash[27079]: audit 2020-07-16T16:27:45.130438+0000 mon.b (mon.2) 1723 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:27:45.470 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:45 smithi132 bash[27079]: audit 2020-07-16T16:27:45.131310+0000 mon.b (mon.2) 1724 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:27:45.605 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:45 smithi188 bash[23329]: cluster 2020-07-16T16:27:43.767396+0000 mgr.x (mgr.34562) 8127 : cluster [DBG] pgmap v5071: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:27:45.606 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:45 smithi188 bash[23329]: audit 2020-07-16T16:27:44.813109+0000 mon.b (mon.2) 1718 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T16:27:44.811366\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811424\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811460\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811490\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811652\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811759\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811862\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811962\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811996\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T16:27:44.812067\", \"last_device_update\": \"2020-07-16T16:05:32.972399\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T16:19:19.250999\"}"}]: dispatch 2020-07-16T16:27:45.606 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:45 smithi188 bash[23329]: audit 2020-07-16T16:27:44.813540+0000 mon.c (mon.1) 538 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T16:27:44.811366\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811424\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811460\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811490\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811652\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811759\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811862\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811962\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811996\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T16:27:44.812067\", \"last_device_update\": \"2020-07-16T16:05:32.972399\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T16:19:19.250999\"}"}]: dispatch 2020-07-16T16:27:45.607 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:45 smithi188 bash[23329]: audit 2020-07-16T16:27:44.816423+0000 mon.c (mon.1) 539 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T16:27:44.811366\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811424\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811460\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811490\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811652\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811759\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811862\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811962\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811996\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T16:27:44.812067\", \"last_device_update\": \"2020-07-16T16:05:32.972399\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T16:19:19.250999\"}"}]': finished 2020-07-16T16:27:45.607 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:45 smithi188 bash[23329]: audit 2020-07-16T16:27:45.121763+0000 mon.b (mon.2) 1719 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120242\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120344\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120377\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120537\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120653\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120749\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120847\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120879\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120907\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T16:27:45.120974\", \"last_device_update\": \"2020-07-16T16:06:41.170725\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T16:19:19.255976\"}"}]: dispatch 2020-07-16T16:27:45.608 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:45 smithi188 bash[23329]: audit 2020-07-16T16:27:45.122425+0000 mon.c (mon.1) 540 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120242\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120344\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120377\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120537\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120653\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120749\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120847\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120879\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120907\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T16:27:45.120974\", \"last_device_update\": \"2020-07-16T16:06:41.170725\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T16:19:19.255976\"}"}]: dispatch 2020-07-16T16:27:45.608 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:45 smithi188 bash[23329]: audit 2020-07-16T16:27:45.125058+0000 mon.c (mon.1) 541 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120242\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120344\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120377\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120537\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120653\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120749\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120847\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120879\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120907\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T16:27:45.120974\", \"last_device_update\": \"2020-07-16T16:06:41.170725\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T16:19:19.255976\"}"}]': finished 2020-07-16T16:27:45.609 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:45 smithi188 bash[23329]: audit 2020-07-16T16:27:45.127660+0000 mon.b (mon.2) 1720 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:27:45.609 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:45 smithi188 bash[23329]: audit 2020-07-16T16:27:45.128616+0000 mon.b (mon.2) 1721 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:27:45.609 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:45 smithi188 bash[23329]: audit 2020-07-16T16:27:45.129466+0000 mon.b (mon.2) 1722 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:27:45.610 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:45 smithi188 bash[23329]: audit 2020-07-16T16:27:45.130438+0000 mon.b (mon.2) 1723 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:27:45.614 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:45 smithi188 bash[23329]: audit 2020-07-16T16:27:45.131310+0000 mon.b (mon.2) 1724 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:27:46.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:46 smithi132 bash[27079]: audit 2020-07-16T16:27:45.127932+0000 mgr.x (mgr.34562) 8128 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:27:46.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:46 smithi132 bash[27079]: audit 2020-07-16T16:27:45.128851+0000 mgr.x (mgr.34562) 8129 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:27:46.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:46 smithi132 bash[27079]: audit 2020-07-16T16:27:45.129677+0000 mgr.x (mgr.34562) 8130 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:27:46.464 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:46 smithi132 bash[27079]: cephadm 2020-07-16T16:27:45.130207+0000 mgr.x (mgr.34562) 8131 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:27:46.464 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:46 smithi132 bash[27079]: cephadm 2020-07-16T16:27:45.131037+0000 mgr.x (mgr.34562) 8132 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:27:46.464 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:46 smithi132 bash[27079]: cephadm 2020-07-16T16:27:45.131807+0000 mgr.x (mgr.34562) 8133 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:27:46.465 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:46 smithi132 bash[27079]: cephadm 2020-07-16T16:27:45.131930+0000 mgr.x (mgr.34562) 8134 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:27:46.604 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:46 smithi188 bash[23329]: audit 2020-07-16T16:27:45.127932+0000 mgr.x (mgr.34562) 8128 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:27:46.605 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:46 smithi188 bash[23329]: audit 2020-07-16T16:27:45.128851+0000 mgr.x (mgr.34562) 8129 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:27:46.605 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:46 smithi188 bash[23329]: audit 2020-07-16T16:27:45.129677+0000 mgr.x (mgr.34562) 8130 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:27:46.606 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:46 smithi188 bash[23329]: cephadm 2020-07-16T16:27:45.130207+0000 mgr.x (mgr.34562) 8131 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:27:46.606 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:46 smithi188 bash[23329]: cephadm 2020-07-16T16:27:45.131037+0000 mgr.x (mgr.34562) 8132 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:27:46.606 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:46 smithi188 bash[23329]: cephadm 2020-07-16T16:27:45.131807+0000 mgr.x (mgr.34562) 8133 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:27:46.607 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:46 smithi188 bash[23329]: cephadm 2020-07-16T16:27:45.131930+0000 mgr.x (mgr.34562) 8134 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:27:47.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:47 smithi132 bash[27079]: cluster 2020-07-16T16:27:45.767718+0000 mgr.x (mgr.34562) 8135 : cluster [DBG] pgmap v5072: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:27:47.604 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:47 smithi188 bash[23329]: cluster 2020-07-16T16:27:45.767718+0000 mgr.x (mgr.34562) 8135 : cluster [DBG] pgmap v5072: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:27:48.462 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:48 smithi132 bash[27079]: audit 2020-07-16T16:27:47.917160+0000 mon.b (mon.2) 1725 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:27:48.604 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:48 smithi188 bash[23329]: audit 2020-07-16T16:27:47.917160+0000 mon.b (mon.2) 1725 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:27:49.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:49 smithi132 bash[27079]: cluster 2020-07-16T16:27:47.768110+0000 mgr.x (mgr.34562) 8136 : cluster [DBG] pgmap v5073: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:27:49.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:49 smithi132 bash[27079]: cephadm 2020-07-16T16:27:47.917793+0000 mgr.x (mgr.34562) 8137 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:27:49.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:49 smithi132 bash[27079]: cephadm 2020-07-16T16:27:47.918238+0000 mgr.x (mgr.34562) 8138 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:27:49.604 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:49 smithi188 bash[23329]: cluster 2020-07-16T16:27:47.768110+0000 mgr.x (mgr.34562) 8136 : cluster [DBG] pgmap v5073: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:27:49.605 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:49 smithi188 bash[23329]: cephadm 2020-07-16T16:27:47.917793+0000 mgr.x (mgr.34562) 8137 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:27:49.605 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:49 smithi188 bash[23329]: cephadm 2020-07-16T16:27:47.918238+0000 mgr.x (mgr.34562) 8138 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:27:51.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:51 smithi132 bash[27079]: cluster 2020-07-16T16:27:49.768590+0000 mgr.x (mgr.34562) 8139 : cluster [DBG] pgmap v5074: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:27:51.604 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:51 smithi188 bash[23329]: cluster 2020-07-16T16:27:49.768590+0000 mgr.x (mgr.34562) 8139 : cluster [DBG] pgmap v5074: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:27:53.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:53 smithi132 bash[27079]: cluster 2020-07-16T16:27:51.769049+0000 mgr.x (mgr.34562) 8140 : cluster [DBG] pgmap v5075: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:27:53.604 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:53 smithi188 bash[23329]: cluster 2020-07-16T16:27:51.769049+0000 mgr.x (mgr.34562) 8140 : cluster [DBG] pgmap v5075: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:27:55.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:55 smithi132 bash[27079]: cluster 2020-07-16T16:27:53.769535+0000 mgr.x (mgr.34562) 8141 : cluster [DBG] pgmap v5076: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:27:55.604 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:55 smithi188 bash[23329]: cluster 2020-07-16T16:27:53.769535+0000 mgr.x (mgr.34562) 8141 : cluster [DBG] pgmap v5076: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:27:57.462 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:57 smithi132 bash[27079]: cluster 2020-07-16T16:27:55.770065+0000 mgr.x (mgr.34562) 8142 : cluster [DBG] pgmap v5077: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:27:57.604 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:57 smithi188 bash[23329]: cluster 2020-07-16T16:27:55.770065+0000 mgr.x (mgr.34562) 8142 : cluster [DBG] pgmap v5077: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:27:59.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:27:59 smithi132 bash[27079]: cluster 2020-07-16T16:27:57.770545+0000 mgr.x (mgr.34562) 8143 : cluster [DBG] pgmap v5078: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:27:59.604 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:27:59 smithi188 bash[23329]: cluster 2020-07-16T16:27:57.770545+0000 mgr.x (mgr.34562) 8143 : cluster [DBG] pgmap v5078: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:28:00.110 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:28:00.376 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:28:00.376 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 15s ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:28:00.376 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 15s ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:28:00.377 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 15s ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:28:00.377 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 15s ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:28:00.377 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 15s ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:28:00.378 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 15s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:28:00.378 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 15s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:28:00.378 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 15s ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:28:00.379 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 15s ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:28:00.379 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 15s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:28:00.379 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 15s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:28:00.380 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 15s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:28:00.380 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 15s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:28:00.380 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 15s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:28:00.381 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 15s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:28:00.381 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 15s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:28:00.381 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 15s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:28:00.382 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 15s ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:28:00.676 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:28:00.676 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:28:00.676 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:28:00.677 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:28:00.677 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:28:00.677 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:28:00.678 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:28:00.678 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:28:00.679 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:28:00.679 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:28:00.679 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:28:00.680 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:28:00.680 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:28:00.680 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:28:00.681 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:28:00.681 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:28:00.681 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:28:01.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:28:01 smithi132 bash[27079]: cluster 2020-07-16T16:27:59.771044+0000 mgr.x (mgr.34562) 8144 : cluster [DBG] pgmap v5079: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:28:01.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:28:01 smithi132 bash[27079]: audit 2020-07-16T16:28:00.414853+0000 mgr.x (mgr.34562) 8145 : audit [DBG] from='client.30562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:28:01.464 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:28:01 smithi132 bash[27079]: audit 2020-07-16T16:28:00.990890+0000 mon.c (mon.1) 542 : audit [DBG] from='client.? 172.21.15.132:0/2617921675' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:28:01.604 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:28:01 smithi188 bash[23329]: cluster 2020-07-16T16:27:59.771044+0000 mgr.x (mgr.34562) 8144 : cluster [DBG] pgmap v5079: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:28:01.605 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:28:01 smithi188 bash[23329]: audit 2020-07-16T16:28:00.414853+0000 mgr.x (mgr.34562) 8145 : audit [DBG] from='client.30562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:28:01.606 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:28:01 smithi188 bash[23329]: audit 2020-07-16T16:28:00.990890+0000 mon.c (mon.1) 542 : audit [DBG] from='client.? 172.21.15.132:0/2617921675' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:28:02.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:28:02 smithi132 bash[27079]: audit 2020-07-16T16:28:00.687366+0000 mgr.x (mgr.34562) 8146 : audit [DBG] from='client.30568 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:28:02.604 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:28:02 smithi188 bash[23329]: audit 2020-07-16T16:28:00.687366+0000 mgr.x (mgr.34562) 8146 : audit [DBG] from='client.30568 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:28:03.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:28:03 smithi132 bash[27079]: cluster 2020-07-16T16:28:01.771622+0000 mgr.x (mgr.34562) 8147 : cluster [DBG] pgmap v5080: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:28:03.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:28:03 smithi132 bash[27079]: audit 2020-07-16T16:28:02.933846+0000 mon.b (mon.2) 1726 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:28:03.604 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:28:03 smithi188 bash[23329]: cluster 2020-07-16T16:28:01.771622+0000 mgr.x (mgr.34562) 8147 : cluster [DBG] pgmap v5080: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:28:03.605 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:28:03 smithi188 bash[23329]: audit 2020-07-16T16:28:02.933846+0000 mon.b (mon.2) 1726 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:28:04.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:28:04 smithi132 bash[27079]: cephadm 2020-07-16T16:28:02.934593+0000 mgr.x (mgr.34562) 8148 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:28:04.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:28:04 smithi132 bash[27079]: cephadm 2020-07-16T16:28:02.934891+0000 mgr.x (mgr.34562) 8149 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:28:04.604 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:28:04 smithi188 bash[23329]: cephadm 2020-07-16T16:28:02.934593+0000 mgr.x (mgr.34562) 8148 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:28:04.605 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:28:04 smithi188 bash[23329]: cephadm 2020-07-16T16:28:02.934891+0000 mgr.x (mgr.34562) 8149 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:28:05.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:28:05 smithi132 bash[27079]: cluster 2020-07-16T16:28:03.771965+0000 mgr.x (mgr.34562) 8150 : cluster [DBG] pgmap v5081: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:28:05.604 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:28:05 smithi188 bash[23329]: cluster 2020-07-16T16:28:03.771965+0000 mgr.x (mgr.34562) 8150 : cluster [DBG] pgmap v5081: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:28:07.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:28:07 smithi132 bash[27079]: cluster 2020-07-16T16:28:05.772510+0000 mgr.x (mgr.34562) 8151 : cluster [DBG] pgmap v5082: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:28:07.604 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:28:07 smithi188 bash[23329]: cluster 2020-07-16T16:28:05.772510+0000 mgr.x (mgr.34562) 8151 : cluster [DBG] pgmap v5082: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:28:09.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:28:09 smithi132 bash[27079]: cluster 2020-07-16T16:28:07.773059+0000 mgr.x (mgr.34562) 8152 : cluster [DBG] pgmap v5083: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:28:09.604 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:28:09 smithi188 bash[23329]: cluster 2020-07-16T16:28:07.773059+0000 mgr.x (mgr.34562) 8152 : cluster [DBG] pgmap v5083: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:28:11.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:28:11 smithi132 bash[27079]: cluster 2020-07-16T16:28:09.773445+0000 mgr.x (mgr.34562) 8153 : cluster [DBG] pgmap v5084: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:28:11.604 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:28:11 smithi188 bash[23329]: cluster 2020-07-16T16:28:09.773445+0000 mgr.x (mgr.34562) 8153 : cluster [DBG] pgmap v5084: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:28:13.605 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:28:13 smithi188 bash[23329]: cluster 2020-07-16T16:28:11.773856+0000 mgr.x (mgr.34562) 8154 : cluster [DBG] pgmap v5085: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:28:13.713 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:28:13 smithi132 bash[27079]: cluster 2020-07-16T16:28:11.773856+0000 mgr.x (mgr.34562) 8154 : cluster [DBG] pgmap v5085: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:28:15.605 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:28:15 smithi188 bash[23329]: cluster 2020-07-16T16:28:13.774295+0000 mgr.x (mgr.34562) 8155 : cluster [DBG] pgmap v5086: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:28:15.713 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:28:15 smithi132 bash[27079]: cluster 2020-07-16T16:28:13.774295+0000 mgr.x (mgr.34562) 8155 : cluster [DBG] pgmap v5086: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:28:17.604 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:28:17 smithi188 bash[23329]: cluster 2020-07-16T16:28:15.774767+0000 mgr.x (mgr.34562) 8156 : cluster [DBG] pgmap v5087: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:28:17.713 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:28:17 smithi132 bash[27079]: cluster 2020-07-16T16:28:15.774767+0000 mgr.x (mgr.34562) 8156 : cluster [DBG] pgmap v5087: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:28:18.604 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:28:18 smithi188 bash[23329]: audit 2020-07-16T16:28:17.950493+0000 mon.b (mon.2) 1727 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:28:18.712 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:28:18 smithi132 bash[27079]: audit 2020-07-16T16:28:17.950493+0000 mon.b (mon.2) 1727 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:28:19.604 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:28:19 smithi188 bash[23329]: cluster 2020-07-16T16:28:17.775321+0000 mgr.x (mgr.34562) 8157 : cluster [DBG] pgmap v5088: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:28:19.605 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:28:19 smithi188 bash[23329]: cephadm 2020-07-16T16:28:17.951209+0000 mgr.x (mgr.34562) 8158 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:28:19.605 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:28:19 smithi188 bash[23329]: cephadm 2020-07-16T16:28:17.951646+0000 mgr.x (mgr.34562) 8159 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:28:19.713 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:28:19 smithi132 bash[27079]: cluster 2020-07-16T16:28:17.775321+0000 mgr.x (mgr.34562) 8157 : cluster [DBG] pgmap v5088: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:28:19.713 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:28:19 smithi132 bash[27079]: cephadm 2020-07-16T16:28:17.951209+0000 mgr.x (mgr.34562) 8158 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:28:19.713 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:28:19 smithi132 bash[27079]: cephadm 2020-07-16T16:28:17.951646+0000 mgr.x (mgr.34562) 8159 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:28:21.604 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:28:21 smithi188 bash[23329]: cluster 2020-07-16T16:28:19.775870+0000 mgr.x (mgr.34562) 8160 : cluster [DBG] pgmap v5089: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:28:21.713 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:28:21 smithi132 bash[27079]: cluster 2020-07-16T16:28:19.775870+0000 mgr.x (mgr.34562) 8160 : cluster [DBG] pgmap v5089: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:28:23.604 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:28:23 smithi188 bash[23329]: cluster 2020-07-16T16:28:21.776435+0000 mgr.x (mgr.34562) 8161 : cluster [DBG] pgmap v5090: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:28:23.713 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:28:23 smithi132 bash[27079]: cluster 2020-07-16T16:28:21.776435+0000 mgr.x (mgr.34562) 8161 : cluster [DBG] pgmap v5090: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:28:25.604 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:28:25 smithi188 bash[23329]: cluster 2020-07-16T16:28:23.776846+0000 mgr.x (mgr.34562) 8162 : cluster [DBG] pgmap v5091: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:28:25.712 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:28:25 smithi132 bash[27079]: cluster 2020-07-16T16:28:23.776846+0000 mgr.x (mgr.34562) 8162 : cluster [DBG] pgmap v5091: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:28:27.610 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:28:27 smithi188 bash[23329]: cluster 2020-07-16T16:28:25.777363+0000 mgr.x (mgr.34562) 8163 : cluster [DBG] pgmap v5092: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:28:27.713 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:28:27 smithi132 bash[27079]: cluster 2020-07-16T16:28:25.777363+0000 mgr.x (mgr.34562) 8163 : cluster [DBG] pgmap v5092: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:28:29.604 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:28:29 smithi188 bash[23329]: cluster 2020-07-16T16:28:27.777898+0000 mgr.x (mgr.34562) 8164 : cluster [DBG] pgmap v5093: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:28:29.713 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:28:29 smithi132 bash[27079]: cluster 2020-07-16T16:28:27.777898+0000 mgr.x (mgr.34562) 8164 : cluster [DBG] pgmap v5093: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:28:30.974 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:28:31.235 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:28:31.235 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 46s ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:28:31.236 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 46s ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:28:31.236 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 46s ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:28:31.237 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 46s ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:28:31.237 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 46s ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:28:31.237 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 46s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:28:31.238 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 46s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:28:31.238 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 46s ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:28:31.238 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 46s ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:28:31.239 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 46s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:28:31.239 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 46s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:28:31.239 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 46s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:28:31.240 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 46s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:28:31.240 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 46s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:28:31.240 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 46s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:28:31.241 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 46s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:28:31.241 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 46s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:28:31.249 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 46s ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:28:31.533 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:28:31.534 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:28:31.534 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:28:31.534 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:28:31.535 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:28:31.535 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:28:31.535 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:28:31.536 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:28:31.536 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:28:31.536 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:28:31.537 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:28:31.537 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:28:31.537 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:28:31.538 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:28:31.538 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:28:31.538 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:28:31.539 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:28:31.604 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:28:31 smithi188 bash[23329]: cluster 2020-07-16T16:28:29.778424+0000 mgr.x (mgr.34562) 8165 : cluster [DBG] pgmap v5094: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:28:31.713 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:28:31 smithi132 bash[27079]: cluster 2020-07-16T16:28:29.778424+0000 mgr.x (mgr.34562) 8165 : cluster [DBG] pgmap v5094: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:28:32.604 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:28:32 smithi188 bash[23329]: audit 2020-07-16T16:28:31.279141+0000 mgr.x (mgr.34562) 8166 : audit [DBG] from='client.30580 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:28:32.605 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:28:32 smithi188 bash[23329]: audit 2020-07-16T16:28:31.546420+0000 mgr.x (mgr.34562) 8167 : audit [DBG] from='client.30586 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:28:32.605 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:28:32 smithi188 bash[23329]: audit 2020-07-16T16:28:31.848602+0000 mon.c (mon.1) 543 : audit [DBG] from='client.? 172.21.15.132:0/2603687436' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:28:32.713 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:28:32 smithi132 bash[27079]: audit 2020-07-16T16:28:31.279141+0000 mgr.x (mgr.34562) 8166 : audit [DBG] from='client.30580 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:28:32.714 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:28:32 smithi132 bash[27079]: audit 2020-07-16T16:28:31.546420+0000 mgr.x (mgr.34562) 8167 : audit [DBG] from='client.30586 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:28:32.714 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:28:32 smithi132 bash[27079]: audit 2020-07-16T16:28:31.848602+0000 mon.c (mon.1) 543 : audit [DBG] from='client.? 172.21.15.132:0/2603687436' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:28:33.605 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:28:33 smithi188 bash[23329]: cluster 2020-07-16T16:28:31.778803+0000 mgr.x (mgr.34562) 8168 : cluster [DBG] pgmap v5095: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:28:33.605 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:28:33 smithi188 bash[23329]: audit 2020-07-16T16:28:32.967088+0000 mon.b (mon.2) 1728 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:28:33.712 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:28:33 smithi132 bash[27079]: cluster 2020-07-16T16:28:31.778803+0000 mgr.x (mgr.34562) 8168 : cluster [DBG] pgmap v5095: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:28:33.713 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:28:33 smithi132 bash[27079]: audit 2020-07-16T16:28:32.967088+0000 mon.b (mon.2) 1728 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:28:34.605 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:28:34 smithi188 bash[23329]: cephadm 2020-07-16T16:28:32.967811+0000 mgr.x (mgr.34562) 8169 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:28:34.606 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:28:34 smithi188 bash[23329]: cephadm 2020-07-16T16:28:32.968252+0000 mgr.x (mgr.34562) 8170 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:28:34.713 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:28:34 smithi132 bash[27079]: cephadm 2020-07-16T16:28:32.967811+0000 mgr.x (mgr.34562) 8169 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:28:34.713 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:28:34 smithi132 bash[27079]: cephadm 2020-07-16T16:28:32.968252+0000 mgr.x (mgr.34562) 8170 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:28:35.604 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:28:35 smithi188 bash[23329]: cluster 2020-07-16T16:28:33.779241+0000 mgr.x (mgr.34562) 8171 : cluster [DBG] pgmap v5096: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:28:35.713 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:28:35 smithi132 bash[27079]: cluster 2020-07-16T16:28:33.779241+0000 mgr.x (mgr.34562) 8171 : cluster [DBG] pgmap v5096: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:28:37.609 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:28:37 smithi188 bash[23329]: cluster 2020-07-16T16:28:35.779626+0000 mgr.x (mgr.34562) 8172 : cluster [DBG] pgmap v5097: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:28:37.712 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:28:37 smithi132 bash[27079]: cluster 2020-07-16T16:28:35.779626+0000 mgr.x (mgr.34562) 8172 : cluster [DBG] pgmap v5097: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:28:39.604 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:28:39 smithi188 bash[23329]: cluster 2020-07-16T16:28:37.780040+0000 mgr.x (mgr.34562) 8173 : cluster [DBG] pgmap v5098: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:28:39.713 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:28:39 smithi132 bash[27079]: cluster 2020-07-16T16:28:37.780040+0000 mgr.x (mgr.34562) 8173 : cluster [DBG] pgmap v5098: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:28:41.604 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:28:41 smithi188 bash[23329]: cluster 2020-07-16T16:28:39.780566+0000 mgr.x (mgr.34562) 8174 : cluster [DBG] pgmap v5099: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:28:41.713 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:28:41 smithi132 bash[27079]: cluster 2020-07-16T16:28:39.780566+0000 mgr.x (mgr.34562) 8174 : cluster [DBG] pgmap v5099: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:28:43.604 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:28:43 smithi188 bash[23329]: cluster 2020-07-16T16:28:41.781033+0000 mgr.x (mgr.34562) 8175 : cluster [DBG] pgmap v5100: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:28:43.713 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:28:43 smithi132 bash[27079]: cluster 2020-07-16T16:28:41.781033+0000 mgr.x (mgr.34562) 8175 : cluster [DBG] pgmap v5100: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:28:45.605 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:28:45 smithi188 bash[23329]: cluster 2020-07-16T16:28:43.781536+0000 mgr.x (mgr.34562) 8176 : cluster [DBG] pgmap v5101: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:28:45.713 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:28:45 smithi132 bash[27079]: cluster 2020-07-16T16:28:43.781536+0000 mgr.x (mgr.34562) 8176 : cluster [DBG] pgmap v5101: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:28:47.605 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:28:47 smithi188 bash[23329]: cluster 2020-07-16T16:28:45.781869+0000 mgr.x (mgr.34562) 8177 : cluster [DBG] pgmap v5102: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:28:47.713 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:28:47 smithi132 bash[27079]: cluster 2020-07-16T16:28:45.781869+0000 mgr.x (mgr.34562) 8177 : cluster [DBG] pgmap v5102: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:28:48.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:28:48 smithi132 bash[27079]: audit 2020-07-16T16:28:47.983490+0000 mon.b (mon.2) 1729 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:28:48.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:28:48 smithi132 bash[27079]: audit 2020-07-16T16:28:47.984901+0000 mon.b (mon.2) 1730 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:28:48.464 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:28:48 smithi132 bash[27079]: audit 2020-07-16T16:28:47.986106+0000 mon.b (mon.2) 1731 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:28:48.464 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:28:48 smithi132 bash[27079]: audit 2020-07-16T16:28:47.987541+0000 mon.b (mon.2) 1732 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:28:48.464 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:28:48 smithi132 bash[27079]: audit 2020-07-16T16:28:47.988860+0000 mon.b (mon.2) 1733 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:28:48.604 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:28:48 smithi188 bash[23329]: audit 2020-07-16T16:28:47.983490+0000 mon.b (mon.2) 1729 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:28:48.605 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:28:48 smithi188 bash[23329]: audit 2020-07-16T16:28:47.984901+0000 mon.b (mon.2) 1730 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:28:48.605 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:28:48 smithi188 bash[23329]: audit 2020-07-16T16:28:47.986106+0000 mon.b (mon.2) 1731 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:28:48.606 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:28:48 smithi188 bash[23329]: audit 2020-07-16T16:28:47.987541+0000 mon.b (mon.2) 1732 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:28:48.606 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:28:48 smithi188 bash[23329]: audit 2020-07-16T16:28:47.988860+0000 mon.b (mon.2) 1733 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:28:49.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:28:49 smithi132 bash[27079]: cluster 2020-07-16T16:28:47.782332+0000 mgr.x (mgr.34562) 8178 : cluster [DBG] pgmap v5103: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:28:49.464 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:28:49 smithi132 bash[27079]: audit 2020-07-16T16:28:47.983863+0000 mgr.x (mgr.34562) 8179 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:28:49.464 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:28:49 smithi132 bash[27079]: audit 2020-07-16T16:28:47.985202+0000 mgr.x (mgr.34562) 8180 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:28:49.464 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:28:49 smithi132 bash[27079]: audit 2020-07-16T16:28:47.986415+0000 mgr.x (mgr.34562) 8181 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:28:49.465 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:28:49 smithi132 bash[27079]: cephadm 2020-07-16T16:28:47.987305+0000 mgr.x (mgr.34562) 8182 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:28:49.465 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:28:49 smithi132 bash[27079]: cephadm 2020-07-16T16:28:47.988396+0000 mgr.x (mgr.34562) 8183 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:28:49.466 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:28:49 smithi132 bash[27079]: cephadm 2020-07-16T16:28:47.989610+0000 mgr.x (mgr.34562) 8184 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:28:49.466 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:28:49 smithi132 bash[27079]: cephadm 2020-07-16T16:28:47.989846+0000 mgr.x (mgr.34562) 8185 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:28:49.604 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:28:49 smithi188 bash[23329]: cluster 2020-07-16T16:28:47.782332+0000 mgr.x (mgr.34562) 8178 : cluster [DBG] pgmap v5103: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:28:49.605 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:28:49 smithi188 bash[23329]: audit 2020-07-16T16:28:47.983863+0000 mgr.x (mgr.34562) 8179 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:28:49.605 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:28:49 smithi188 bash[23329]: audit 2020-07-16T16:28:47.985202+0000 mgr.x (mgr.34562) 8180 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:28:49.606 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:28:49 smithi188 bash[23329]: audit 2020-07-16T16:28:47.986415+0000 mgr.x (mgr.34562) 8181 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:28:49.606 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:28:49 smithi188 bash[23329]: cephadm 2020-07-16T16:28:47.987305+0000 mgr.x (mgr.34562) 8182 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:28:49.607 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:28:49 smithi188 bash[23329]: cephadm 2020-07-16T16:28:47.988396+0000 mgr.x (mgr.34562) 8183 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:28:49.607 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:28:49 smithi188 bash[23329]: cephadm 2020-07-16T16:28:47.989610+0000 mgr.x (mgr.34562) 8184 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:28:49.607 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:28:49 smithi188 bash[23329]: cephadm 2020-07-16T16:28:47.989846+0000 mgr.x (mgr.34562) 8185 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:28:51.605 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:28:51 smithi188 bash[23329]: cluster 2020-07-16T16:28:49.782731+0000 mgr.x (mgr.34562) 8186 : cluster [DBG] pgmap v5104: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:28:51.605 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:28:51 smithi188 bash[23329]: audit 2020-07-16T16:28:50.736300+0000 mon.b (mon.2) 1734 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:28:51.713 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:28:51 smithi132 bash[27079]: cluster 2020-07-16T16:28:49.782731+0000 mgr.x (mgr.34562) 8186 : cluster [DBG] pgmap v5104: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:28:51.713 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:28:51 smithi132 bash[27079]: audit 2020-07-16T16:28:50.736300+0000 mon.b (mon.2) 1734 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:28:52.604 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:28:52 smithi188 bash[23329]: cephadm 2020-07-16T16:28:50.737035+0000 mgr.x (mgr.34562) 8187 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:28:52.605 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:28:52 smithi188 bash[23329]: cephadm 2020-07-16T16:28:50.737450+0000 mgr.x (mgr.34562) 8188 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:28:52.713 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:28:52 smithi132 bash[27079]: cephadm 2020-07-16T16:28:50.737035+0000 mgr.x (mgr.34562) 8187 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:28:52.713 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:28:52 smithi132 bash[27079]: cephadm 2020-07-16T16:28:50.737450+0000 mgr.x (mgr.34562) 8188 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:28:53.605 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:28:53 smithi188 bash[23329]: cluster 2020-07-16T16:28:51.783072+0000 mgr.x (mgr.34562) 8189 : cluster [DBG] pgmap v5105: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:28:53.713 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:28:53 smithi132 bash[27079]: cluster 2020-07-16T16:28:51.783072+0000 mgr.x (mgr.34562) 8189 : cluster [DBG] pgmap v5105: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:28:55.605 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:28:55 smithi188 bash[23329]: cluster 2020-07-16T16:28:53.783447+0000 mgr.x (mgr.34562) 8190 : cluster [DBG] pgmap v5106: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:28:55.713 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:28:55 smithi132 bash[27079]: cluster 2020-07-16T16:28:53.783447+0000 mgr.x (mgr.34562) 8190 : cluster [DBG] pgmap v5106: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:28:57.605 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:28:57 smithi188 bash[23329]: cluster 2020-07-16T16:28:55.783952+0000 mgr.x (mgr.34562) 8191 : cluster [DBG] pgmap v5107: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:28:57.713 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:28:57 smithi132 bash[27079]: cluster 2020-07-16T16:28:55.783952+0000 mgr.x (mgr.34562) 8191 : cluster [DBG] pgmap v5107: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:28:59.605 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:28:59 smithi188 bash[23329]: cluster 2020-07-16T16:28:57.784548+0000 mgr.x (mgr.34562) 8192 : cluster [DBG] pgmap v5108: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:28:59.715 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:28:59 smithi132 bash[27079]: cluster 2020-07-16T16:28:57.784548+0000 mgr.x (mgr.34562) 8192 : cluster [DBG] pgmap v5108: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:29:01.605 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:01 smithi188 bash[23329]: cluster 2020-07-16T16:28:59.784964+0000 mgr.x (mgr.34562) 8193 : cluster [DBG] pgmap v5109: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:29:01.713 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:01 smithi132 bash[27079]: cluster 2020-07-16T16:28:59.784964+0000 mgr.x (mgr.34562) 8193 : cluster [DBG] pgmap v5109: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:29:01.835 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:29:02.095 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:29:02.096 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 77s ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:29:02.096 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 77s ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:29:02.096 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 77s ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:29:02.097 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 77s ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:29:02.097 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 77s ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:29:02.097 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 77s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:29:02.098 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 77s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:29:02.098 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 77s ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:29:02.098 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 77s ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:29:02.099 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 77s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:29:02.099 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 77s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:29:02.099 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 77s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:29:02.100 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 77s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:29:02.100 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 77s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:29:02.100 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 77s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:29:02.100 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 77s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:29:02.101 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 77s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:29:02.101 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 77s ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:29:02.391 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:29:02.392 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:29:02.392 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:29:02.392 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:29:02.393 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:29:02.393 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:29:02.393 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:29:02.394 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:29:02.394 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:29:02.394 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:29:02.395 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:29:02.395 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:29:02.395 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:29:02.397 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:29:02.398 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:29:02.398 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:29:02.398 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:29:03.605 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:03 smithi188 bash[23329]: cluster 2020-07-16T16:29:01.785601+0000 mgr.x (mgr.34562) 8194 : cluster [DBG] pgmap v5110: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:29:03.606 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:03 smithi188 bash[23329]: audit 2020-07-16T16:29:02.139539+0000 mgr.x (mgr.34562) 8195 : audit [DBG] from='client.30598 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:29:03.606 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:03 smithi188 bash[23329]: audit 2020-07-16T16:29:02.406792+0000 mgr.x (mgr.34562) 8196 : audit [DBG] from='client.30604 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:29:03.607 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:03 smithi188 bash[23329]: audit 2020-07-16T16:29:02.706298+0000 mon.c (mon.1) 544 : audit [DBG] from='client.? 172.21.15.132:0/3645279950' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:29:03.713 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:03 smithi132 bash[27079]: cluster 2020-07-16T16:29:01.785601+0000 mgr.x (mgr.34562) 8194 : cluster [DBG] pgmap v5110: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:29:03.713 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:03 smithi132 bash[27079]: audit 2020-07-16T16:29:02.139539+0000 mgr.x (mgr.34562) 8195 : audit [DBG] from='client.30598 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:29:03.714 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:03 smithi132 bash[27079]: audit 2020-07-16T16:29:02.406792+0000 mgr.x (mgr.34562) 8196 : audit [DBG] from='client.30604 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:29:03.714 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:03 smithi132 bash[27079]: audit 2020-07-16T16:29:02.706298+0000 mon.c (mon.1) 544 : audit [DBG] from='client.? 172.21.15.132:0/3645279950' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:29:05.604 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:05 smithi188 bash[23329]: cluster 2020-07-16T16:29:03.786165+0000 mgr.x (mgr.34562) 8197 : cluster [DBG] pgmap v5111: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:29:05.713 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:05 smithi132 bash[27079]: cluster 2020-07-16T16:29:03.786165+0000 mgr.x (mgr.34562) 8197 : cluster [DBG] pgmap v5111: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:29:06.604 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:06 smithi188 bash[23329]: audit 2020-07-16T16:29:05.742809+0000 mon.b (mon.2) 1735 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:29:06.713 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:06 smithi132 bash[27079]: audit 2020-07-16T16:29:05.742809+0000 mon.b (mon.2) 1735 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:29:07.605 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:07 smithi188 bash[23329]: cephadm 2020-07-16T16:29:05.743519+0000 mgr.x (mgr.34562) 8198 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:29:07.605 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:07 smithi188 bash[23329]: cephadm 2020-07-16T16:29:05.743595+0000 mgr.x (mgr.34562) 8199 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:29:07.606 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:07 smithi188 bash[23329]: cluster 2020-07-16T16:29:05.786581+0000 mgr.x (mgr.34562) 8200 : cluster [DBG] pgmap v5112: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:29:07.713 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:07 smithi132 bash[27079]: cephadm 2020-07-16T16:29:05.743519+0000 mgr.x (mgr.34562) 8198 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:29:07.713 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:07 smithi132 bash[27079]: cephadm 2020-07-16T16:29:05.743595+0000 mgr.x (mgr.34562) 8199 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:29:07.714 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:07 smithi132 bash[27079]: cluster 2020-07-16T16:29:05.786581+0000 mgr.x (mgr.34562) 8200 : cluster [DBG] pgmap v5112: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:29:08.605 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:08 smithi188 bash[23329]: cluster 2020-07-16T16:29:07.787022+0000 mgr.x (mgr.34562) 8201 : cluster [DBG] pgmap v5113: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:29:08.716 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:08 smithi132 bash[27079]: cluster 2020-07-16T16:29:07.787022+0000 mgr.x (mgr.34562) 8201 : cluster [DBG] pgmap v5113: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:29:10.855 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:10 smithi188 bash[23329]: cluster 2020-07-16T16:29:09.787414+0000 mgr.x (mgr.34562) 8202 : cluster [DBG] pgmap v5114: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:29:10.963 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:10 smithi132 bash[27079]: cluster 2020-07-16T16:29:09.787414+0000 mgr.x (mgr.34562) 8202 : cluster [DBG] pgmap v5114: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:29:13.213 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:13 smithi132 bash[27079]: cluster 2020-07-16T16:29:11.787880+0000 mgr.x (mgr.34562) 8203 : cluster [DBG] pgmap v5115: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:29:13.355 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:13 smithi188 bash[23329]: cluster 2020-07-16T16:29:11.787880+0000 mgr.x (mgr.34562) 8203 : cluster [DBG] pgmap v5115: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:29:15.213 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:15 smithi132 bash[27079]: cluster 2020-07-16T16:29:13.788364+0000 mgr.x (mgr.34562) 8204 : cluster [DBG] pgmap v5116: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:29:15.354 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:15 smithi188 bash[23329]: cluster 2020-07-16T16:29:13.788364+0000 mgr.x (mgr.34562) 8204 : cluster [DBG] pgmap v5116: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:29:17.213 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:17 smithi132 bash[27079]: cluster 2020-07-16T16:29:15.788842+0000 mgr.x (mgr.34562) 8205 : cluster [DBG] pgmap v5117: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:29:17.354 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:17 smithi188 bash[23329]: cluster 2020-07-16T16:29:15.788842+0000 mgr.x (mgr.34562) 8205 : cluster [DBG] pgmap v5117: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:29:19.213 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:19 smithi132 bash[27079]: cluster 2020-07-16T16:29:17.789253+0000 mgr.x (mgr.34562) 8206 : cluster [DBG] pgmap v5118: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:29:19.354 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:19 smithi188 bash[23329]: cluster 2020-07-16T16:29:17.789253+0000 mgr.x (mgr.34562) 8206 : cluster [DBG] pgmap v5118: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:29:21.213 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:21 smithi132 bash[27079]: cluster 2020-07-16T16:29:19.789776+0000 mgr.x (mgr.34562) 8207 : cluster [DBG] pgmap v5119: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:29:21.214 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:21 smithi132 bash[27079]: audit 2020-07-16T16:29:20.759487+0000 mon.b (mon.2) 1736 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:29:21.354 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:21 smithi188 bash[23329]: cluster 2020-07-16T16:29:19.789776+0000 mgr.x (mgr.34562) 8207 : cluster [DBG] pgmap v5119: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:29:21.355 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:21 smithi188 bash[23329]: audit 2020-07-16T16:29:20.759487+0000 mon.b (mon.2) 1736 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:29:22.213 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:22 smithi132 bash[27079]: cephadm 2020-07-16T16:29:20.760198+0000 mgr.x (mgr.34562) 8208 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:29:22.214 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:22 smithi132 bash[27079]: cephadm 2020-07-16T16:29:20.760647+0000 mgr.x (mgr.34562) 8209 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:29:22.354 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:22 smithi188 bash[23329]: cephadm 2020-07-16T16:29:20.760198+0000 mgr.x (mgr.34562) 8208 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:29:22.355 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:22 smithi188 bash[23329]: cephadm 2020-07-16T16:29:20.760647+0000 mgr.x (mgr.34562) 8209 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:29:23.213 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:23 smithi132 bash[27079]: cluster 2020-07-16T16:29:21.790262+0000 mgr.x (mgr.34562) 8210 : cluster [DBG] pgmap v5120: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:29:23.359 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:23 smithi188 bash[23329]: cluster 2020-07-16T16:29:21.790262+0000 mgr.x (mgr.34562) 8210 : cluster [DBG] pgmap v5120: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:29:25.213 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:25 smithi132 bash[27079]: cluster 2020-07-16T16:29:23.790759+0000 mgr.x (mgr.34562) 8211 : cluster [DBG] pgmap v5121: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:29:25.354 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:25 smithi188 bash[23329]: cluster 2020-07-16T16:29:23.790759+0000 mgr.x (mgr.34562) 8211 : cluster [DBG] pgmap v5121: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:29:27.213 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:27 smithi132 bash[27079]: cluster 2020-07-16T16:29:25.791141+0000 mgr.x (mgr.34562) 8212 : cluster [DBG] pgmap v5122: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:29:27.354 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:27 smithi188 bash[23329]: cluster 2020-07-16T16:29:25.791141+0000 mgr.x (mgr.34562) 8212 : cluster [DBG] pgmap v5122: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:29:29.213 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:29 smithi132 bash[27079]: cluster 2020-07-16T16:29:27.791502+0000 mgr.x (mgr.34562) 8213 : cluster [DBG] pgmap v5123: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:29:29.354 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:29 smithi188 bash[23329]: cluster 2020-07-16T16:29:27.791502+0000 mgr.x (mgr.34562) 8213 : cluster [DBG] pgmap v5123: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:29:31.218 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:31 smithi132 bash[27079]: cluster 2020-07-16T16:29:29.791964+0000 mgr.x (mgr.34562) 8214 : cluster [DBG] pgmap v5124: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:29:31.354 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:31 smithi188 bash[23329]: cluster 2020-07-16T16:29:29.791964+0000 mgr.x (mgr.34562) 8214 : cluster [DBG] pgmap v5124: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:29:32.688 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:29:32.950 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:29:32.951 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 108s ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:29:32.951 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 108s ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:29:32.951 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 108s ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:29:32.951 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 108s ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:29:32.952 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 108s ago 2h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:29:32.952 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 108s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:29:32.952 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 108s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:29:32.953 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 108s ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:29:32.953 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 108s ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:29:32.953 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 108s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:29:32.954 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 108s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:29:32.954 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 108s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:29:32.954 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 108s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:29:32.955 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 108s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:29:32.955 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 108s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:29:32.955 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 108s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:29:32.956 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 108s ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:29:32.956 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 108s ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:29:33.213 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:33 smithi132 bash[27079]: cluster 2020-07-16T16:29:31.792373+0000 mgr.x (mgr.34562) 8215 : cluster [DBG] pgmap v5125: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:29:33.251 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:29:33.252 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:29:33.252 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:29:33.253 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:29:33.253 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:29:33.253 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:29:33.254 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:29:33.254 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:29:33.254 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:29:33.255 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:29:33.255 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:29:33.255 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:29:33.256 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:29:33.256 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:29:33.256 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:29:33.256 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:29:33.257 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:29:33.355 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:33 smithi188 bash[23329]: cluster 2020-07-16T16:29:31.792373+0000 mgr.x (mgr.34562) 8215 : cluster [DBG] pgmap v5125: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:29:34.213 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:34 smithi132 bash[27079]: audit 2020-07-16T16:29:32.992672+0000 mgr.x (mgr.34562) 8216 : audit [DBG] from='client.30616 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:29:34.214 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:34 smithi132 bash[27079]: audit 2020-07-16T16:29:33.261670+0000 mgr.x (mgr.34562) 8217 : audit [DBG] from='client.30622 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:29:34.215 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:34 smithi132 bash[27079]: audit 2020-07-16T16:29:33.566626+0000 mon.c (mon.1) 545 : audit [DBG] from='client.? 172.21.15.132:0/398688466' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:29:34.355 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:34 smithi188 bash[23329]: audit 2020-07-16T16:29:32.992672+0000 mgr.x (mgr.34562) 8216 : audit [DBG] from='client.30616 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:29:34.355 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:34 smithi188 bash[23329]: audit 2020-07-16T16:29:33.261670+0000 mgr.x (mgr.34562) 8217 : audit [DBG] from='client.30622 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:29:34.355 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:34 smithi188 bash[23329]: audit 2020-07-16T16:29:33.566626+0000 mon.c (mon.1) 545 : audit [DBG] from='client.? 172.21.15.132:0/398688466' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:29:35.355 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:35 smithi188 bash[23329]: cluster 2020-07-16T16:29:33.792679+0000 mgr.x (mgr.34562) 8218 : cluster [DBG] pgmap v5126: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:29:35.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:35 smithi132 bash[27079]: cluster 2020-07-16T16:29:33.792679+0000 mgr.x (mgr.34562) 8218 : cluster [DBG] pgmap v5126: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:29:36.355 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:36 smithi188 bash[23329]: audit 2020-07-16T16:29:35.776299+0000 mon.b (mon.2) 1737 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:29:36.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:36 smithi132 bash[27079]: audit 2020-07-16T16:29:35.776299+0000 mon.b (mon.2) 1737 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:29:37.360 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:37 smithi188 bash[23329]: cephadm 2020-07-16T16:29:35.777031+0000 mgr.x (mgr.34562) 8219 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:29:37.361 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:37 smithi188 bash[23329]: cephadm 2020-07-16T16:29:35.777455+0000 mgr.x (mgr.34562) 8220 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:29:37.361 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:37 smithi188 bash[23329]: cluster 2020-07-16T16:29:35.792999+0000 mgr.x (mgr.34562) 8221 : cluster [DBG] pgmap v5127: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:29:37.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:37 smithi132 bash[27079]: cephadm 2020-07-16T16:29:35.777031+0000 mgr.x (mgr.34562) 8219 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:29:37.464 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:37 smithi132 bash[27079]: cephadm 2020-07-16T16:29:35.777455+0000 mgr.x (mgr.34562) 8220 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:29:37.464 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:37 smithi132 bash[27079]: cluster 2020-07-16T16:29:35.792999+0000 mgr.x (mgr.34562) 8221 : cluster [DBG] pgmap v5127: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:29:39.355 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:39 smithi188 bash[23329]: cluster 2020-07-16T16:29:37.793530+0000 mgr.x (mgr.34562) 8222 : cluster [DBG] pgmap v5128: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:29:39.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:39 smithi132 bash[27079]: cluster 2020-07-16T16:29:37.793530+0000 mgr.x (mgr.34562) 8222 : cluster [DBG] pgmap v5128: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:29:41.355 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:41 smithi188 bash[23329]: cluster 2020-07-16T16:29:39.794036+0000 mgr.x (mgr.34562) 8223 : cluster [DBG] pgmap v5129: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:29:41.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:41 smithi132 bash[27079]: cluster 2020-07-16T16:29:39.794036+0000 mgr.x (mgr.34562) 8223 : cluster [DBG] pgmap v5129: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:29:43.355 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:43 smithi188 bash[23329]: cluster 2020-07-16T16:29:41.794496+0000 mgr.x (mgr.34562) 8224 : cluster [DBG] pgmap v5130: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:29:43.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:43 smithi132 bash[27079]: cluster 2020-07-16T16:29:41.794496+0000 mgr.x (mgr.34562) 8224 : cluster [DBG] pgmap v5130: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:29:45.355 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:45 smithi188 bash[23329]: cluster 2020-07-16T16:29:43.795017+0000 mgr.x (mgr.34562) 8225 : cluster [DBG] pgmap v5131: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:29:45.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:45 smithi132 bash[27079]: cluster 2020-07-16T16:29:43.795017+0000 mgr.x (mgr.34562) 8225 : cluster [DBG] pgmap v5131: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:29:47.355 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:47 smithi188 bash[23329]: cluster 2020-07-16T16:29:45.795394+0000 mgr.x (mgr.34562) 8226 : cluster [DBG] pgmap v5132: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:29:47.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:47 smithi132 bash[27079]: cluster 2020-07-16T16:29:45.795394+0000 mgr.x (mgr.34562) 8226 : cluster [DBG] pgmap v5132: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:29:49.355 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:49 smithi188 bash[23329]: cluster 2020-07-16T16:29:47.795833+0000 mgr.x (mgr.34562) 8227 : cluster [DBG] pgmap v5133: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:29:49.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:49 smithi132 bash[27079]: cluster 2020-07-16T16:29:47.795833+0000 mgr.x (mgr.34562) 8227 : cluster [DBG] pgmap v5133: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:29:51.268 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:51 smithi132 bash[27079]: cluster 2020-07-16T16:29:49.796341+0000 mgr.x (mgr.34562) 8228 : cluster [DBG] pgmap v5134: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:29:51.268 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:51 smithi132 bash[27079]: audit 2020-07-16T16:29:51.015686+0000 mon.b (mon.2) 1738 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T16:27:44.811366\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811424\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811460\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811490\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811652\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811759\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811862\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811962\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811996\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T16:27:44.812067\", \"last_device_update\": \"2020-07-16T16:05:32.972399\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T16:29:51.014515\"}"}]: dispatch 2020-07-16T16:29:51.269 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:51 smithi132 bash[27079]: audit 2020-07-16T16:29:51.016207+0000 mon.c (mon.1) 546 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T16:27:44.811366\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811424\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811460\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811490\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811652\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811759\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811862\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811962\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811996\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T16:27:44.812067\", \"last_device_update\": \"2020-07-16T16:05:32.972399\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T16:29:51.014515\"}"}]: dispatch 2020-07-16T16:29:51.269 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:51 smithi132 bash[27079]: audit 2020-07-16T16:29:51.018808+0000 mon.c (mon.1) 547 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T16:27:44.811366\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811424\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811460\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811490\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811652\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811759\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811862\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811962\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811996\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T16:27:44.812067\", \"last_device_update\": \"2020-07-16T16:05:32.972399\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T16:29:51.014515\"}"}]': finished 2020-07-16T16:29:51.270 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:51 smithi132 bash[27079]: audit 2020-07-16T16:29:51.019593+0000 mon.b (mon.2) 1739 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120242\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120344\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120377\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120537\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120653\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120749\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120847\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120879\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120907\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T16:27:45.120974\", \"last_device_update\": \"2020-07-16T16:06:41.170725\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T16:29:51.018831\"}"}]: dispatch 2020-07-16T16:29:51.270 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:51 smithi132 bash[27079]: audit 2020-07-16T16:29:51.019918+0000 mon.c (mon.1) 548 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120242\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120344\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120377\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120537\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120653\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120749\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120847\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120879\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120907\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T16:27:45.120974\", \"last_device_update\": \"2020-07-16T16:06:41.170725\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T16:29:51.018831\"}"}]: dispatch 2020-07-16T16:29:51.271 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:51 smithi132 bash[27079]: audit 2020-07-16T16:29:51.021838+0000 mon.c (mon.1) 549 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120242\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120344\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120377\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120537\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120653\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120749\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120847\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120879\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120907\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T16:27:45.120974\", \"last_device_update\": \"2020-07-16T16:06:41.170725\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T16:29:51.018831\"}"}]': finished 2020-07-16T16:29:51.271 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:51 smithi132 bash[27079]: audit 2020-07-16T16:29:51.024723+0000 mon.b (mon.2) 1740 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:29:51.271 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:51 smithi132 bash[27079]: audit 2020-07-16T16:29:51.025649+0000 mon.b (mon.2) 1741 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:29:51.272 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:51 smithi132 bash[27079]: audit 2020-07-16T16:29:51.026491+0000 mon.b (mon.2) 1742 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:29:51.272 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:51 smithi132 bash[27079]: audit 2020-07-16T16:29:51.027395+0000 mon.b (mon.2) 1743 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:29:51.272 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:51 smithi132 bash[27079]: audit 2020-07-16T16:29:51.028340+0000 mon.b (mon.2) 1744 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:29:51.356 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:51 smithi188 bash[23329]: cluster 2020-07-16T16:29:49.796341+0000 mgr.x (mgr.34562) 8228 : cluster [DBG] pgmap v5134: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:29:51.356 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:51 smithi188 bash[23329]: audit 2020-07-16T16:29:51.015686+0000 mon.b (mon.2) 1738 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T16:27:44.811366\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811424\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811460\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811490\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811652\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811759\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811862\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811962\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811996\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T16:27:44.812067\", \"last_device_update\": \"2020-07-16T16:05:32.972399\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T16:29:51.014515\"}"}]: dispatch 2020-07-16T16:29:51.357 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:51 smithi188 bash[23329]: audit 2020-07-16T16:29:51.016207+0000 mon.c (mon.1) 546 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T16:27:44.811366\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811424\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811460\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811490\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811652\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811759\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811862\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811962\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811996\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T16:27:44.812067\", \"last_device_update\": \"2020-07-16T16:05:32.972399\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T16:29:51.014515\"}"}]: dispatch 2020-07-16T16:29:51.357 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:51 smithi188 bash[23329]: audit 2020-07-16T16:29:51.018808+0000 mon.c (mon.1) 547 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T16:27:44.811366\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811424\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811460\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811490\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811652\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811759\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811862\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811962\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811996\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T16:27:44.812067\", \"last_device_update\": \"2020-07-16T16:05:32.972399\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T16:29:51.014515\"}"}]': finished 2020-07-16T16:29:51.358 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:51 smithi188 bash[23329]: audit 2020-07-16T16:29:51.019593+0000 mon.b (mon.2) 1739 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120242\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120344\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120377\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120537\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120653\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120749\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120847\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120879\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120907\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T16:27:45.120974\", \"last_device_update\": \"2020-07-16T16:06:41.170725\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T16:29:51.018831\"}"}]: dispatch 2020-07-16T16:29:51.358 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:51 smithi188 bash[23329]: audit 2020-07-16T16:29:51.019918+0000 mon.c (mon.1) 548 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120242\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120344\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120377\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120537\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120653\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120749\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120847\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120879\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120907\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T16:27:45.120974\", \"last_device_update\": \"2020-07-16T16:06:41.170725\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T16:29:51.018831\"}"}]: dispatch 2020-07-16T16:29:51.359 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:51 smithi188 bash[23329]: audit 2020-07-16T16:29:51.021838+0000 mon.c (mon.1) 549 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120242\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120344\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120377\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120537\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120653\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120749\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120847\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120879\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120907\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T16:27:45.120974\", \"last_device_update\": \"2020-07-16T16:06:41.170725\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T16:29:51.018831\"}"}]': finished 2020-07-16T16:29:51.359 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:51 smithi188 bash[23329]: audit 2020-07-16T16:29:51.024723+0000 mon.b (mon.2) 1740 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:29:51.359 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:51 smithi188 bash[23329]: audit 2020-07-16T16:29:51.025649+0000 mon.b (mon.2) 1741 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:29:51.360 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:51 smithi188 bash[23329]: audit 2020-07-16T16:29:51.026491+0000 mon.b (mon.2) 1742 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:29:51.360 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:51 smithi188 bash[23329]: audit 2020-07-16T16:29:51.027395+0000 mon.b (mon.2) 1743 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:29:51.360 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:51 smithi188 bash[23329]: audit 2020-07-16T16:29:51.028340+0000 mon.b (mon.2) 1744 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:29:52.355 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:52 smithi188 bash[23329]: audit 2020-07-16T16:29:51.024994+0000 mgr.x (mgr.34562) 8229 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:29:52.355 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:52 smithi188 bash[23329]: audit 2020-07-16T16:29:51.025892+0000 mgr.x (mgr.34562) 8230 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:29:52.356 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:52 smithi188 bash[23329]: audit 2020-07-16T16:29:51.026712+0000 mgr.x (mgr.34562) 8231 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:29:52.356 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:52 smithi188 bash[23329]: cephadm 2020-07-16T16:29:51.027232+0000 mgr.x (mgr.34562) 8232 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:29:52.356 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:52 smithi188 bash[23329]: cephadm 2020-07-16T16:29:51.027998+0000 mgr.x (mgr.34562) 8233 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:29:52.357 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:52 smithi188 bash[23329]: cephadm 2020-07-16T16:29:51.028868+0000 mgr.x (mgr.34562) 8234 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:29:52.357 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:52 smithi188 bash[23329]: cephadm 2020-07-16T16:29:51.028945+0000 mgr.x (mgr.34562) 8235 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:29:52.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:52 smithi132 bash[27079]: audit 2020-07-16T16:29:51.024994+0000 mgr.x (mgr.34562) 8229 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:29:52.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:52 smithi132 bash[27079]: audit 2020-07-16T16:29:51.025892+0000 mgr.x (mgr.34562) 8230 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:29:52.464 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:52 smithi132 bash[27079]: audit 2020-07-16T16:29:51.026712+0000 mgr.x (mgr.34562) 8231 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:29:52.464 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:52 smithi132 bash[27079]: cephadm 2020-07-16T16:29:51.027232+0000 mgr.x (mgr.34562) 8232 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:29:52.464 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:52 smithi132 bash[27079]: cephadm 2020-07-16T16:29:51.027998+0000 mgr.x (mgr.34562) 8233 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:29:52.465 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:52 smithi132 bash[27079]: cephadm 2020-07-16T16:29:51.028868+0000 mgr.x (mgr.34562) 8234 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:29:52.465 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:52 smithi132 bash[27079]: cephadm 2020-07-16T16:29:51.028945+0000 mgr.x (mgr.34562) 8235 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:29:53.213 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:53 smithi132 bash[27079]: cluster 2020-07-16T16:29:51.796855+0000 mgr.x (mgr.34562) 8236 : cluster [DBG] pgmap v5135: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:29:53.354 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:53 smithi188 bash[23329]: cluster 2020-07-16T16:29:51.796855+0000 mgr.x (mgr.34562) 8236 : cluster [DBG] pgmap v5135: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:29:54.355 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:54 smithi188 bash[23329]: audit 2020-07-16T16:29:53.881190+0000 mon.b (mon.2) 1745 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:29:54.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:54 smithi132 bash[27079]: audit 2020-07-16T16:29:53.881190+0000 mon.b (mon.2) 1745 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:29:55.355 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:55 smithi188 bash[23329]: cluster 2020-07-16T16:29:53.797260+0000 mgr.x (mgr.34562) 8237 : cluster [DBG] pgmap v5136: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:29:55.355 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:55 smithi188 bash[23329]: cephadm 2020-07-16T16:29:53.881872+0000 mgr.x (mgr.34562) 8238 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:29:55.355 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:55 smithi188 bash[23329]: cephadm 2020-07-16T16:29:53.881951+0000 mgr.x (mgr.34562) 8239 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:29:55.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:55 smithi132 bash[27079]: cluster 2020-07-16T16:29:53.797260+0000 mgr.x (mgr.34562) 8237 : cluster [DBG] pgmap v5136: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:29:55.464 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:55 smithi132 bash[27079]: cephadm 2020-07-16T16:29:53.881872+0000 mgr.x (mgr.34562) 8238 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:29:55.464 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:55 smithi132 bash[27079]: cephadm 2020-07-16T16:29:53.881951+0000 mgr.x (mgr.34562) 8239 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:29:57.355 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:57 smithi188 bash[23329]: cluster 2020-07-16T16:29:55.797744+0000 mgr.x (mgr.34562) 8240 : cluster [DBG] pgmap v5137: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:29:57.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:57 smithi132 bash[27079]: cluster 2020-07-16T16:29:55.797744+0000 mgr.x (mgr.34562) 8240 : cluster [DBG] pgmap v5137: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:29:59.355 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:29:59 smithi188 bash[23329]: cluster 2020-07-16T16:29:57.798215+0000 mgr.x (mgr.34562) 8241 : cluster [DBG] pgmap v5138: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:29:59.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:29:59 smithi132 bash[27079]: cluster 2020-07-16T16:29:57.798215+0000 mgr.x (mgr.34562) 8241 : cluster [DBG] pgmap v5138: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:30:01.355 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:30:01 smithi188 bash[23329]: cluster 2020-07-16T16:29:59.798689+0000 mgr.x (mgr.34562) 8242 : cluster [DBG] pgmap v5139: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:30:01.465 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:30:01 smithi132 bash[27079]: cluster 2020-07-16T16:29:59.798689+0000 mgr.x (mgr.34562) 8242 : cluster [DBG] pgmap v5139: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:30:03.360 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:30:03 smithi188 bash[23329]: cluster 2020-07-16T16:30:01.799121+0000 mgr.x (mgr.34562) 8243 : cluster [DBG] pgmap v5140: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:30:03.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:30:03 smithi132 bash[27079]: cluster 2020-07-16T16:30:01.799121+0000 mgr.x (mgr.34562) 8243 : cluster [DBG] pgmap v5140: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:30:03.553 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:30:03.813 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:30:03.813 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 2m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:30:03.813 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 2m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:30:03.814 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 2m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:30:03.814 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 2m ago 3h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:30:03.814 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 2m ago 3h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:30:03.815 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:30:03.815 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:30:03.815 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 2m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:30:03.816 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 2m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:30:03.816 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:30:03.816 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:30:03.817 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:30:03.817 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:30:03.817 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:30:03.818 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:30:03.818 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:30:03.818 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:30:03.819 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 2m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:30:04.110 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:30:04.110 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:30:04.111 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:30:04.111 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:30:04.112 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:30:04.112 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:30:04.112 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:30:04.113 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:30:04.113 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:30:04.113 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:30:04.114 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:30:04.114 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:30:04.114 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:30:04.114 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:30:04.115 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:30:04.115 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:30:04.115 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:30:05.355 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:30:05 smithi188 bash[23329]: cluster 2020-07-16T16:30:03.799481+0000 mgr.x (mgr.34562) 8244 : cluster [DBG] pgmap v5141: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:30:05.355 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:30:05 smithi188 bash[23329]: audit 2020-07-16T16:30:03.856351+0000 mgr.x (mgr.34562) 8245 : audit [DBG] from='client.30634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:30:05.356 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:30:05 smithi188 bash[23329]: audit 2020-07-16T16:30:04.124143+0000 mgr.x (mgr.34562) 8246 : audit [DBG] from='client.30640 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:30:05.356 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:30:05 smithi188 bash[23329]: audit 2020-07-16T16:30:04.424744+0000 mon.c (mon.1) 550 : audit [DBG] from='client.? 172.21.15.132:0/3636406953' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:30:05.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:30:05 smithi132 bash[27079]: cluster 2020-07-16T16:30:03.799481+0000 mgr.x (mgr.34562) 8244 : cluster [DBG] pgmap v5141: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:30:05.464 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:30:05 smithi132 bash[27079]: audit 2020-07-16T16:30:03.856351+0000 mgr.x (mgr.34562) 8245 : audit [DBG] from='client.30634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:30:05.464 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:30:05 smithi132 bash[27079]: audit 2020-07-16T16:30:04.124143+0000 mgr.x (mgr.34562) 8246 : audit [DBG] from='client.30640 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:30:05.465 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:30:05 smithi132 bash[27079]: audit 2020-07-16T16:30:04.424744+0000 mon.c (mon.1) 550 : audit [DBG] from='client.? 172.21.15.132:0/3636406953' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:30:07.355 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:30:07 smithi188 bash[23329]: cluster 2020-07-16T16:30:05.800041+0000 mgr.x (mgr.34562) 8247 : cluster [DBG] pgmap v5142: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:30:07.465 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:30:07 smithi132 bash[27079]: cluster 2020-07-16T16:30:05.800041+0000 mgr.x (mgr.34562) 8247 : cluster [DBG] pgmap v5142: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:30:09.355 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:30:09 smithi188 bash[23329]: cluster 2020-07-16T16:30:07.800616+0000 mgr.x (mgr.34562) 8248 : cluster [DBG] pgmap v5143: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:30:09.355 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:30:09 smithi188 bash[23329]: audit 2020-07-16T16:30:08.897614+0000 mon.b (mon.2) 1746 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:30:09.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:30:09 smithi132 bash[27079]: cluster 2020-07-16T16:30:07.800616+0000 mgr.x (mgr.34562) 8248 : cluster [DBG] pgmap v5143: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:30:09.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:30:09 smithi132 bash[27079]: audit 2020-07-16T16:30:08.897614+0000 mon.b (mon.2) 1746 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:30:10.355 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:30:10 smithi188 bash[23329]: cephadm 2020-07-16T16:30:08.898330+0000 mgr.x (mgr.34562) 8249 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:30:10.356 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:30:10 smithi188 bash[23329]: cephadm 2020-07-16T16:30:08.898728+0000 mgr.x (mgr.34562) 8250 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:30:10.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:30:10 smithi132 bash[27079]: cephadm 2020-07-16T16:30:08.898330+0000 mgr.x (mgr.34562) 8249 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:30:10.464 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:30:10 smithi132 bash[27079]: cephadm 2020-07-16T16:30:08.898728+0000 mgr.x (mgr.34562) 8250 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:30:11.355 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:30:11 smithi188 bash[23329]: cluster 2020-07-16T16:30:09.800958+0000 mgr.x (mgr.34562) 8251 : cluster [DBG] pgmap v5144: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:30:11.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:30:11 smithi132 bash[27079]: cluster 2020-07-16T16:30:09.800958+0000 mgr.x (mgr.34562) 8251 : cluster [DBG] pgmap v5144: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:30:13.355 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:30:13 smithi188 bash[23329]: cluster 2020-07-16T16:30:11.801356+0000 mgr.x (mgr.34562) 8252 : cluster [DBG] pgmap v5145: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:30:13.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:30:13 smithi132 bash[27079]: cluster 2020-07-16T16:30:11.801356+0000 mgr.x (mgr.34562) 8252 : cluster [DBG] pgmap v5145: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:30:15.355 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:30:15 smithi188 bash[23329]: cluster 2020-07-16T16:30:13.801838+0000 mgr.x (mgr.34562) 8253 : cluster [DBG] pgmap v5146: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:30:15.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:30:15 smithi132 bash[27079]: cluster 2020-07-16T16:30:13.801838+0000 mgr.x (mgr.34562) 8253 : cluster [DBG] pgmap v5146: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:30:17.355 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:30:17 smithi188 bash[23329]: cluster 2020-07-16T16:30:15.802425+0000 mgr.x (mgr.34562) 8254 : cluster [DBG] pgmap v5147: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:30:17.467 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:30:17 smithi132 bash[27079]: cluster 2020-07-16T16:30:15.802425+0000 mgr.x (mgr.34562) 8254 : cluster [DBG] pgmap v5147: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:30:19.355 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:30:19 smithi188 bash[23329]: cluster 2020-07-16T16:30:17.802822+0000 mgr.x (mgr.34562) 8255 : cluster [DBG] pgmap v5148: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:30:19.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:30:19 smithi132 bash[27079]: cluster 2020-07-16T16:30:17.802822+0000 mgr.x (mgr.34562) 8255 : cluster [DBG] pgmap v5148: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:30:21.357 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:30:21 smithi188 bash[23329]: cluster 2020-07-16T16:30:19.803213+0000 mgr.x (mgr.34562) 8256 : cluster [DBG] pgmap v5149: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:30:21.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:30:21 smithi132 bash[27079]: cluster 2020-07-16T16:30:19.803213+0000 mgr.x (mgr.34562) 8256 : cluster [DBG] pgmap v5149: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:30:23.355 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:30:23 smithi188 bash[23329]: cluster 2020-07-16T16:30:21.803566+0000 mgr.x (mgr.34562) 8257 : cluster [DBG] pgmap v5150: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:30:23.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:30:23 smithi132 bash[27079]: cluster 2020-07-16T16:30:21.803566+0000 mgr.x (mgr.34562) 8257 : cluster [DBG] pgmap v5150: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:30:24.355 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:30:24 smithi188 bash[23329]: audit 2020-07-16T16:30:23.914237+0000 mon.b (mon.2) 1747 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:30:24.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:30:24 smithi132 bash[27079]: audit 2020-07-16T16:30:23.914237+0000 mon.b (mon.2) 1747 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:30:25.355 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:30:25 smithi188 bash[23329]: cluster 2020-07-16T16:30:23.804004+0000 mgr.x (mgr.34562) 8258 : cluster [DBG] pgmap v5151: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:30:25.355 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:30:25 smithi188 bash[23329]: cephadm 2020-07-16T16:30:23.914963+0000 mgr.x (mgr.34562) 8259 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:30:25.356 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:30:25 smithi188 bash[23329]: cephadm 2020-07-16T16:30:23.915240+0000 mgr.x (mgr.34562) 8260 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:30:25.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:30:25 smithi132 bash[27079]: cluster 2020-07-16T16:30:23.804004+0000 mgr.x (mgr.34562) 8258 : cluster [DBG] pgmap v5151: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:30:25.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:30:25 smithi132 bash[27079]: cephadm 2020-07-16T16:30:23.914963+0000 mgr.x (mgr.34562) 8259 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:30:25.464 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:30:25 smithi132 bash[27079]: cephadm 2020-07-16T16:30:23.915240+0000 mgr.x (mgr.34562) 8260 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:30:27.355 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:30:27 smithi188 bash[23329]: cluster 2020-07-16T16:30:25.804479+0000 mgr.x (mgr.34562) 8261 : cluster [DBG] pgmap v5152: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:30:27.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:30:27 smithi132 bash[27079]: cluster 2020-07-16T16:30:25.804479+0000 mgr.x (mgr.34562) 8261 : cluster [DBG] pgmap v5152: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:30:29.355 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:30:29 smithi188 bash[23329]: cluster 2020-07-16T16:30:27.805027+0000 mgr.x (mgr.34562) 8262 : cluster [DBG] pgmap v5153: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:30:29.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:30:29 smithi132 bash[27079]: cluster 2020-07-16T16:30:27.805027+0000 mgr.x (mgr.34562) 8262 : cluster [DBG] pgmap v5153: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:30:31.355 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:30:31 smithi188 bash[23329]: cluster 2020-07-16T16:30:29.805452+0000 mgr.x (mgr.34562) 8263 : cluster [DBG] pgmap v5154: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:30:31.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:30:31 smithi132 bash[27079]: cluster 2020-07-16T16:30:29.805452+0000 mgr.x (mgr.34562) 8263 : cluster [DBG] pgmap v5154: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:30:33.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:30:33 smithi132 bash[27079]: cluster 2020-07-16T16:30:31.805966+0000 mgr.x (mgr.34562) 8264 : cluster [DBG] pgmap v5155: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:30:33.605 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:30:33 smithi188 bash[23329]: cluster 2020-07-16T16:30:31.805966+0000 mgr.x (mgr.34562) 8264 : cluster [DBG] pgmap v5155: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:30:34.410 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:30:34.670 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:30:34.671 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 2m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:30:34.671 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 2m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:30:34.671 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 2m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:30:34.672 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 2m ago 3h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:30:34.672 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 2m ago 3h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:30:34.672 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:30:34.673 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:30:34.673 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 2m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:30:34.673 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 2m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:30:34.674 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:30:34.674 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:30:34.674 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:30:34.675 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:30:34.675 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:30:34.675 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:30:34.676 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:30:34.676 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 2m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:30:34.676 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 2m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:30:34.966 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:30:34.967 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:30:34.967 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:30:34.967 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:30:34.968 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:30:34.968 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:30:34.968 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:30:34.969 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:30:34.969 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:30:34.969 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:30:34.970 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:30:34.970 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:30:34.970 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:30:34.971 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:30:34.971 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:30:34.971 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:30:34.971 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:30:35.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:30:35 smithi132 bash[27079]: cluster 2020-07-16T16:30:33.806353+0000 mgr.x (mgr.34562) 8265 : cluster [DBG] pgmap v5156: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:30:35.464 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:30:35 smithi132 bash[27079]: audit 2020-07-16T16:30:35.280965+0000 mon.c (mon.1) 551 : audit [DBG] from='client.? 172.21.15.132:0/3088212696' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:30:35.605 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:30:35 smithi188 bash[23329]: cluster 2020-07-16T16:30:33.806353+0000 mgr.x (mgr.34562) 8265 : cluster [DBG] pgmap v5156: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:30:35.605 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:30:35 smithi188 bash[23329]: audit 2020-07-16T16:30:35.280965+0000 mon.c (mon.1) 551 : audit [DBG] from='client.? 172.21.15.132:0/3088212696' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:30:36.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:30:36 smithi132 bash[27079]: audit 2020-07-16T16:30:34.713686+0000 mgr.x (mgr.34562) 8266 : audit [DBG] from='client.30652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:30:36.464 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:30:36 smithi132 bash[27079]: audit 2020-07-16T16:30:34.981427+0000 mgr.x (mgr.34562) 8267 : audit [DBG] from='client.30658 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:30:36.605 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:30:36 smithi188 bash[23329]: audit 2020-07-16T16:30:34.713686+0000 mgr.x (mgr.34562) 8266 : audit [DBG] from='client.30652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:30:36.605 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:30:36 smithi188 bash[23329]: audit 2020-07-16T16:30:34.981427+0000 mgr.x (mgr.34562) 8267 : audit [DBG] from='client.30658 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:30:37.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:30:37 smithi132 bash[27079]: cluster 2020-07-16T16:30:35.806767+0000 mgr.x (mgr.34562) 8268 : cluster [DBG] pgmap v5157: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:30:37.605 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:30:37 smithi188 bash[23329]: cluster 2020-07-16T16:30:35.806767+0000 mgr.x (mgr.34562) 8268 : cluster [DBG] pgmap v5157: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:30:39.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:30:39 smithi132 bash[27079]: cluster 2020-07-16T16:30:37.807238+0000 mgr.x (mgr.34562) 8269 : cluster [DBG] pgmap v5158: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:30:39.464 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:30:39 smithi132 bash[27079]: audit 2020-07-16T16:30:38.930923+0000 mon.b (mon.2) 1748 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:30:39.605 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:30:39 smithi188 bash[23329]: cluster 2020-07-16T16:30:37.807238+0000 mgr.x (mgr.34562) 8269 : cluster [DBG] pgmap v5158: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:30:39.605 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:30:39 smithi188 bash[23329]: audit 2020-07-16T16:30:38.930923+0000 mon.b (mon.2) 1748 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:30:40.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:30:40 smithi132 bash[27079]: cephadm 2020-07-16T16:30:38.931648+0000 mgr.x (mgr.34562) 8270 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:30:40.464 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:30:40 smithi132 bash[27079]: cephadm 2020-07-16T16:30:38.931818+0000 mgr.x (mgr.34562) 8271 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:30:40.605 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:30:40 smithi188 bash[23329]: cephadm 2020-07-16T16:30:38.931648+0000 mgr.x (mgr.34562) 8270 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:30:40.605 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:30:40 smithi188 bash[23329]: cephadm 2020-07-16T16:30:38.931818+0000 mgr.x (mgr.34562) 8271 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:30:41.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:30:41 smithi132 bash[27079]: cluster 2020-07-16T16:30:39.807698+0000 mgr.x (mgr.34562) 8272 : cluster [DBG] pgmap v5159: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:30:41.605 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:30:41 smithi188 bash[23329]: cluster 2020-07-16T16:30:39.807698+0000 mgr.x (mgr.34562) 8272 : cluster [DBG] pgmap v5159: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:30:43.463 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:30:43 smithi132 bash[27079]: cluster 2020-07-16T16:30:41.808213+0000 mgr.x (mgr.34562) 8273 : cluster [DBG] pgmap v5160: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:30:43.605 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:30:43 smithi188 bash[23329]: cluster 2020-07-16T16:30:41.808213+0000 mgr.x (mgr.34562) 8273 : cluster [DBG] pgmap v5160: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:30:45.520 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:30:45 smithi132 bash[27079]: cluster 2020-07-16T16:30:43.808675+0000 mgr.x (mgr.34562) 8274 : cluster [DBG] pgmap v5161: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:30:45.666 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:30:45 smithi188 bash[23329]: cluster 2020-07-16T16:30:43.808675+0000 mgr.x (mgr.34562) 8274 : cluster [DBG] pgmap v5161: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:30:47.581 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:30:47 smithi132 bash[27079]: cluster 2020-07-16T16:30:45.809145+0000 mgr.x (mgr.34562) 8275 : cluster [DBG] pgmap v5162: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:30:47.726 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:30:47 smithi188 bash[23329]: cluster 2020-07-16T16:30:45.809145+0000 mgr.x (mgr.34562) 8275 : cluster [DBG] pgmap v5162: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:30:49.628 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:30:49 smithi132 bash[27079]: cluster 2020-07-16T16:30:47.809691+0000 mgr.x (mgr.34562) 8276 : cluster [DBG] pgmap v5163: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:30:49.772 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:30:49 smithi188 bash[23329]: cluster 2020-07-16T16:30:47.809691+0000 mgr.x (mgr.34562) 8276 : cluster [DBG] pgmap v5163: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:30:51.665 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:30:51 smithi132 bash[27079]: cluster 2020-07-16T16:30:49.810203+0000 mgr.x (mgr.34562) 8277 : cluster [DBG] pgmap v5164: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:30:51.807 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:30:51 smithi188 bash[23329]: cluster 2020-07-16T16:30:49.810203+0000 mgr.x (mgr.34562) 8277 : cluster [DBG] pgmap v5164: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:30:53.691 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:30:53 smithi132 bash[27079]: cluster 2020-07-16T16:30:51.810583+0000 mgr.x (mgr.34562) 8278 : cluster [DBG] pgmap v5165: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:30:53.835 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:30:53 smithi188 bash[23329]: cluster 2020-07-16T16:30:51.810583+0000 mgr.x (mgr.34562) 8278 : cluster [DBG] pgmap v5165: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:30:54.658 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:30:54 smithi132 bash[27079]: audit 2020-07-16T16:30:53.950683+0000 mon.b (mon.2) 1749 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:30:54.659 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:30:54 smithi132 bash[27079]: audit 2020-07-16T16:30:53.952050+0000 mon.b (mon.2) 1750 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:30:54.660 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:30:54 smithi132 bash[27079]: audit 2020-07-16T16:30:53.953254+0000 mon.b (mon.2) 1751 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:30:54.660 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:30:54 smithi132 bash[27079]: audit 2020-07-16T16:30:53.954654+0000 mon.b (mon.2) 1752 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:30:54.661 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:30:54 smithi132 bash[27079]: audit 2020-07-16T16:30:53.956042+0000 mon.b (mon.2) 1753 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:30:54.846 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:30:54 smithi188 bash[23329]: audit 2020-07-16T16:30:53.950683+0000 mon.b (mon.2) 1749 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:30:54.846 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:30:54 smithi188 bash[23329]: audit 2020-07-16T16:30:53.952050+0000 mon.b (mon.2) 1750 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:30:54.846 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:30:54 smithi188 bash[23329]: audit 2020-07-16T16:30:53.953254+0000 mon.b (mon.2) 1751 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:30:54.847 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:30:54 smithi188 bash[23329]: audit 2020-07-16T16:30:53.954654+0000 mon.b (mon.2) 1752 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:30:54.847 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:30:54 smithi188 bash[23329]: audit 2020-07-16T16:30:53.956042+0000 mon.b (mon.2) 1753 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:30:55.713 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:30:55 smithi132 bash[27079]: cluster 2020-07-16T16:30:53.811082+0000 mgr.x (mgr.34562) 8279 : cluster [DBG] pgmap v5166: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:30:55.713 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:30:55 smithi132 bash[27079]: audit 2020-07-16T16:30:53.951056+0000 mgr.x (mgr.34562) 8280 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:30:55.714 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:30:55 smithi132 bash[27079]: audit 2020-07-16T16:30:53.952378+0000 mgr.x (mgr.34562) 8281 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:30:55.714 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:30:55 smithi132 bash[27079]: audit 2020-07-16T16:30:53.953534+0000 mgr.x (mgr.34562) 8282 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:30:55.714 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:30:55 smithi132 bash[27079]: cephadm 2020-07-16T16:30:53.954266+0000 mgr.x (mgr.34562) 8283 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:30:55.715 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:30:55 smithi132 bash[27079]: cephadm 2020-07-16T16:30:53.955675+0000 mgr.x (mgr.34562) 8284 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:30:55.715 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:30:55 smithi132 bash[27079]: cephadm 2020-07-16T16:30:53.956814+0000 mgr.x (mgr.34562) 8285 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:30:55.716 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:30:55 smithi132 bash[27079]: cephadm 2020-07-16T16:30:53.957077+0000 mgr.x (mgr.34562) 8286 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:30:55.856 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:30:55 smithi188 bash[23329]: cluster 2020-07-16T16:30:53.811082+0000 mgr.x (mgr.34562) 8279 : cluster [DBG] pgmap v5166: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:30:55.856 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:30:55 smithi188 bash[23329]: audit 2020-07-16T16:30:53.951056+0000 mgr.x (mgr.34562) 8280 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:30:55.856 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:30:55 smithi188 bash[23329]: audit 2020-07-16T16:30:53.952378+0000 mgr.x (mgr.34562) 8281 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:30:55.857 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:30:55 smithi188 bash[23329]: audit 2020-07-16T16:30:53.953534+0000 mgr.x (mgr.34562) 8282 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:30:55.857 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:30:55 smithi188 bash[23329]: cephadm 2020-07-16T16:30:53.954266+0000 mgr.x (mgr.34562) 8283 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:30:55.857 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:30:55 smithi188 bash[23329]: cephadm 2020-07-16T16:30:53.955675+0000 mgr.x (mgr.34562) 8284 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:30:55.858 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:30:55 smithi188 bash[23329]: cephadm 2020-07-16T16:30:53.956814+0000 mgr.x (mgr.34562) 8285 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:30:55.858 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:30:55 smithi188 bash[23329]: cephadm 2020-07-16T16:30:53.957077+0000 mgr.x (mgr.34562) 8286 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:30:57.729 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:30:57 smithi132 bash[27079]: cluster 2020-07-16T16:30:55.811536+0000 mgr.x (mgr.34562) 8287 : cluster [DBG] pgmap v5167: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:30:57.730 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:30:57 smithi132 bash[27079]: audit 2020-07-16T16:30:56.691336+0000 mon.b (mon.2) 1754 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:30:57.872 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:30:57 smithi188 bash[23329]: cluster 2020-07-16T16:30:55.811536+0000 mgr.x (mgr.34562) 8287 : cluster [DBG] pgmap v5167: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:30:57.872 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:30:57 smithi188 bash[23329]: audit 2020-07-16T16:30:56.691336+0000 mon.b (mon.2) 1754 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:30:58.736 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:30:58 smithi132 bash[27079]: cephadm 2020-07-16T16:30:56.691925+0000 mgr.x (mgr.34562) 8288 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:30:58.737 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:30:58 smithi132 bash[27079]: cephadm 2020-07-16T16:30:56.692322+0000 mgr.x (mgr.34562) 8289 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:30:58.878 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:30:58 smithi188 bash[23329]: cephadm 2020-07-16T16:30:56.691925+0000 mgr.x (mgr.34562) 8288 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:30:58.879 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:30:58 smithi188 bash[23329]: cephadm 2020-07-16T16:30:56.692322+0000 mgr.x (mgr.34562) 8289 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:30:59.742 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:30:59 smithi132 bash[27079]: cluster 2020-07-16T16:30:57.812091+0000 mgr.x (mgr.34562) 8290 : cluster [DBG] pgmap v5168: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:30:59.884 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:30:59 smithi188 bash[23329]: cluster 2020-07-16T16:30:57.812091+0000 mgr.x (mgr.34562) 8290 : cluster [DBG] pgmap v5168: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:31:01.752 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:31:01 smithi132 bash[27079]: cluster 2020-07-16T16:30:59.812567+0000 mgr.x (mgr.34562) 8291 : cluster [DBG] pgmap v5169: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:31:01.900 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:31:01 smithi188 bash[23329]: cluster 2020-07-16T16:30:59.812567+0000 mgr.x (mgr.34562) 8291 : cluster [DBG] pgmap v5169: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:31:03.760 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:31:03 smithi132 bash[27079]: cluster 2020-07-16T16:31:01.812937+0000 mgr.x (mgr.34562) 8292 : cluster [DBG] pgmap v5170: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:31:03.902 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:31:03 smithi188 bash[23329]: cluster 2020-07-16T16:31:01.812937+0000 mgr.x (mgr.34562) 8292 : cluster [DBG] pgmap v5170: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:31:05.567 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:31:05.766 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:31:05 smithi132 bash[27079]: cluster 2020-07-16T16:31:03.813363+0000 mgr.x (mgr.34562) 8293 : cluster [DBG] pgmap v5171: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:31:05.830 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:31:05.831 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 3m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:31:05.831 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 3m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:31:05.832 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 3m ago 2h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:31:05.832 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 3m ago 3h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:31:05.832 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 3m ago 3h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:31:05.833 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:31:05.833 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (3h) 3m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:31:05.833 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 3m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:31:05.834 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 3m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:31:05.834 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:31:05.834 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:31:05.835 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:31:05.835 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:31:05.835 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:31:05.836 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:31:05.836 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:31:05.836 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:31:05.837 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 3m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:31:05.908 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:31:05 smithi188 bash[23329]: cluster 2020-07-16T16:31:03.813363+0000 mgr.x (mgr.34562) 8293 : cluster [DBG] pgmap v5171: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:31:06.129 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:31:06.130 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:31:06.130 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:31:06.131 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:31:06.131 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:31:06.131 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:31:06.132 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:31:06.132 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:31:06.132 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:31:06.133 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:31:06.133 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:31:06.133 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:31:06.133 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:31:06.134 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:31:06.134 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:31:06.134 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:31:06.135 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:31:06.769 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:31:06 smithi132 bash[27079]: audit 2020-07-16T16:31:05.568562+0000 mgr.x (mgr.34562) 8294 : audit [DBG] from='client.30670 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:31:06.770 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:31:06 smithi132 bash[27079]: audit 2020-07-16T16:31:06.140188+0000 mon.c (mon.1) 552 : audit [DBG] from='client.? 172.21.15.132:0/2923756368' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:31:06.911 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:31:06 smithi188 bash[23329]: audit 2020-07-16T16:31:05.568562+0000 mgr.x (mgr.34562) 8294 : audit [DBG] from='client.30670 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:31:06.911 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:31:06 smithi188 bash[23329]: audit 2020-07-16T16:31:06.140188+0000 mon.c (mon.1) 552 : audit [DBG] from='client.? 172.21.15.132:0/2923756368' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:31:07.771 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:31:07 smithi132 bash[27079]: cluster 2020-07-16T16:31:05.813748+0000 mgr.x (mgr.34562) 8295 : cluster [DBG] pgmap v5172: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:31:07.772 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:31:07 smithi132 bash[27079]: audit 2020-07-16T16:31:05.838634+0000 mgr.x (mgr.34562) 8296 : audit [DBG] from='client.30676 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:31:07.913 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:31:07 smithi188 bash[23329]: cluster 2020-07-16T16:31:05.813748+0000 mgr.x (mgr.34562) 8295 : cluster [DBG] pgmap v5172: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:31:07.914 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:31:07 smithi188 bash[23329]: audit 2020-07-16T16:31:05.838634+0000 mgr.x (mgr.34562) 8296 : audit [DBG] from='client.30676 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:31:09.776 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:31:09 smithi132 bash[27079]: cluster 2020-07-16T16:31:07.814193+0000 mgr.x (mgr.34562) 8297 : cluster [DBG] pgmap v5173: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:31:09.917 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:31:09 smithi188 bash[23329]: cluster 2020-07-16T16:31:07.814193+0000 mgr.x (mgr.34562) 8297 : cluster [DBG] pgmap v5173: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:31:11.779 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:31:11 smithi132 bash[27079]: cluster 2020-07-16T16:31:09.814691+0000 mgr.x (mgr.34562) 8298 : cluster [DBG] pgmap v5174: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:31:11.920 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:31:11 smithi188 bash[23329]: cluster 2020-07-16T16:31:09.814691+0000 mgr.x (mgr.34562) 8298 : cluster [DBG] pgmap v5174: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:31:12.780 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:31:12 smithi132 bash[27079]: audit 2020-07-16T16:31:11.701769+0000 mon.b (mon.2) 1755 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:31:12.922 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:31:12 smithi188 bash[23329]: audit 2020-07-16T16:31:11.701769+0000 mon.b (mon.2) 1755 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:31:13.782 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:31:13 smithi132 bash[27079]: cephadm 2020-07-16T16:31:11.702542+0000 mgr.x (mgr.34562) 8299 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:31:13.782 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:31:13 smithi132 bash[27079]: cephadm 2020-07-16T16:31:11.702790+0000 mgr.x (mgr.34562) 8300 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:31:13.783 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:31:13 smithi132 bash[27079]: cluster 2020-07-16T16:31:11.815222+0000 mgr.x (mgr.34562) 8301 : cluster [DBG] pgmap v5175: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:31:13.923 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:31:13 smithi188 bash[23329]: cephadm 2020-07-16T16:31:11.702542+0000 mgr.x (mgr.34562) 8299 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:31:13.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:31:13 smithi188 bash[23329]: cephadm 2020-07-16T16:31:11.702790+0000 mgr.x (mgr.34562) 8300 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:31:13.924 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:31:13 smithi188 bash[23329]: cluster 2020-07-16T16:31:11.815222+0000 mgr.x (mgr.34562) 8301 : cluster [DBG] pgmap v5175: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:31:15.784 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:31:15 smithi132 bash[27079]: cluster 2020-07-16T16:31:13.815571+0000 mgr.x (mgr.34562) 8302 : cluster [DBG] pgmap v5176: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:31:15.926 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:31:15 smithi188 bash[23329]: cluster 2020-07-16T16:31:13.815571+0000 mgr.x (mgr.34562) 8302 : cluster [DBG] pgmap v5176: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:31:17.787 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:31:17 smithi132 bash[27079]: cluster 2020-07-16T16:31:15.815931+0000 mgr.x (mgr.34562) 8303 : cluster [DBG] pgmap v5177: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:31:17.926 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:31:17 smithi188 bash[23329]: cluster 2020-07-16T16:31:15.815931+0000 mgr.x (mgr.34562) 8303 : cluster [DBG] pgmap v5177: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:31:19.785 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:31:19 smithi132 bash[27079]: cluster 2020-07-16T16:31:17.816463+0000 mgr.x (mgr.34562) 8304 : cluster [DBG] pgmap v5178: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:31:19.926 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:31:19 smithi188 bash[23329]: cluster 2020-07-16T16:31:17.816463+0000 mgr.x (mgr.34562) 8304 : cluster [DBG] pgmap v5178: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:31:21.927 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:31:21 smithi188 bash[23329]: cluster 2020-07-16T16:31:19.816917+0000 mgr.x (mgr.34562) 8305 : cluster [DBG] pgmap v5179: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:31:22.035 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:31:21 smithi132 bash[27079]: cluster 2020-07-16T16:31:19.816917+0000 mgr.x (mgr.34562) 8305 : cluster [DBG] pgmap v5179: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:31:23.928 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:31:23 smithi188 bash[23329]: cluster 2020-07-16T16:31:21.817344+0000 mgr.x (mgr.34562) 8306 : cluster [DBG] pgmap v5180: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:31:24.036 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:31:23 smithi132 bash[27079]: cluster 2020-07-16T16:31:21.817344+0000 mgr.x (mgr.34562) 8306 : cluster [DBG] pgmap v5180: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:31:25.928 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:31:25 smithi188 bash[23329]: cluster 2020-07-16T16:31:23.817676+0000 mgr.x (mgr.34562) 8307 : cluster [DBG] pgmap v5181: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:31:26.037 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:31:25 smithi132 bash[27079]: cluster 2020-07-16T16:31:23.817676+0000 mgr.x (mgr.34562) 8307 : cluster [DBG] pgmap v5181: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:31:27.931 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:31:27 smithi188 bash[23329]: cluster 2020-07-16T16:31:25.818053+0000 mgr.x (mgr.34562) 8308 : cluster [DBG] pgmap v5182: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:31:27.932 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:31:27 smithi188 bash[23329]: audit 2020-07-16T16:31:26.717712+0000 mon.b (mon.2) 1756 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:31:28.037 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:31:27 smithi132 bash[27079]: cluster 2020-07-16T16:31:25.818053+0000 mgr.x (mgr.34562) 8308 : cluster [DBG] pgmap v5182: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:31:28.038 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:31:27 smithi132 bash[27079]: audit 2020-07-16T16:31:26.717712+0000 mon.b (mon.2) 1756 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:31:28.929 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:31:28 smithi188 bash[23329]: cephadm 2020-07-16T16:31:26.718357+0000 mgr.x (mgr.34562) 8309 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:31:28.930 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:31:28 smithi188 bash[23329]: cephadm 2020-07-16T16:31:26.718647+0000 mgr.x (mgr.34562) 8310 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:31:29.038 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:31:28 smithi132 bash[27079]: cephadm 2020-07-16T16:31:26.718357+0000 mgr.x (mgr.34562) 8309 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:31:29.038 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:31:28 smithi132 bash[27079]: cephadm 2020-07-16T16:31:26.718647+0000 mgr.x (mgr.34562) 8310 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:31:29.930 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:31:29 smithi188 bash[23329]: cluster 2020-07-16T16:31:27.818622+0000 mgr.x (mgr.34562) 8311 : cluster [DBG] pgmap v5183: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:31:30.038 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:31:29 smithi132 bash[27079]: cluster 2020-07-16T16:31:27.818622+0000 mgr.x (mgr.34562) 8311 : cluster [DBG] pgmap v5183: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:31:31.930 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:31:31 smithi188 bash[23329]: cluster 2020-07-16T16:31:29.819034+0000 mgr.x (mgr.34562) 8312 : cluster [DBG] pgmap v5184: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:31:32.039 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:31:31 smithi132 bash[27079]: cluster 2020-07-16T16:31:29.819034+0000 mgr.x (mgr.34562) 8312 : cluster [DBG] pgmap v5184: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:31:33.931 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:31:33 smithi188 bash[23329]: cluster 2020-07-16T16:31:31.819562+0000 mgr.x (mgr.34562) 8313 : cluster [DBG] pgmap v5185: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:31:34.039 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:31:33 smithi132 bash[27079]: cluster 2020-07-16T16:31:31.819562+0000 mgr.x (mgr.34562) 8313 : cluster [DBG] pgmap v5185: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:31:35.932 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:31:35 smithi188 bash[23329]: cluster 2020-07-16T16:31:33.820035+0000 mgr.x (mgr.34562) 8314 : cluster [DBG] pgmap v5186: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:31:36.040 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:31:35 smithi132 bash[27079]: cluster 2020-07-16T16:31:33.820035+0000 mgr.x (mgr.34562) 8314 : cluster [DBG] pgmap v5186: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:31:36.454 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:31:36.716 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:31:36.717 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 3m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:31:36.717 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 3m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:31:36.718 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 3m ago 3h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:31:36.719 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 3m ago 3h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:31:36.719 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 3m ago 3h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:31:36.720 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (3h) 3m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:31:36.730 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (3h) 3m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:31:36.731 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 3m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:31:36.731 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 3m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:31:36.732 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:31:36.733 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:31:36.733 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:31:36.734 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:31:36.734 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:31:36.735 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:31:36.735 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:31:36.736 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 3m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:31:36.736 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 3m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:31:37.015 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:31:37.015 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:31:37.016 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:31:37.016 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:31:37.016 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:31:37.017 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:31:37.017 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:31:37.017 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:31:37.022 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:31:37.022 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:31:37.023 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:31:37.023 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:31:37.023 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:31:37.024 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:31:37.024 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:31:37.024 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:31:37.024 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:31:37.932 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:31:37 smithi188 bash[23329]: cluster 2020-07-16T16:31:35.820457+0000 mgr.x (mgr.34562) 8315 : cluster [DBG] pgmap v5187: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:31:37.933 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:31:37 smithi188 bash[23329]: audit 2020-07-16T16:31:36.430650+0000 mgr.x (mgr.34562) 8316 : audit [DBG] from='client.30688 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:31:37.933 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:31:37 smithi188 bash[23329]: audit 2020-07-16T16:31:37.002506+0000 mon.c (mon.1) 553 : audit [DBG] from='client.? 172.21.15.132:0/4186197501' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:31:38.041 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:31:37 smithi132 bash[27079]: cluster 2020-07-16T16:31:35.820457+0000 mgr.x (mgr.34562) 8315 : cluster [DBG] pgmap v5187: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:31:38.041 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:31:37 smithi132 bash[27079]: audit 2020-07-16T16:31:36.430650+0000 mgr.x (mgr.34562) 8316 : audit [DBG] from='client.30688 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:31:38.042 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:31:37 smithi132 bash[27079]: audit 2020-07-16T16:31:37.002506+0000 mon.c (mon.1) 553 : audit [DBG] from='client.? 172.21.15.132:0/4186197501' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:31:38.933 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:31:38 smithi188 bash[23329]: audit 2020-07-16T16:31:36.700279+0000 mgr.x (mgr.34562) 8317 : audit [DBG] from='client.30694 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:31:39.041 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:31:38 smithi132 bash[27079]: audit 2020-07-16T16:31:36.700279+0000 mgr.x (mgr.34562) 8317 : audit [DBG] from='client.30694 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:31:39.933 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:31:39 smithi188 bash[23329]: cluster 2020-07-16T16:31:37.820977+0000 mgr.x (mgr.34562) 8318 : cluster [DBG] pgmap v5188: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:31:40.042 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:31:39 smithi132 bash[27079]: cluster 2020-07-16T16:31:37.820977+0000 mgr.x (mgr.34562) 8318 : cluster [DBG] pgmap v5188: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:31:41.935 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:31:41 smithi188 bash[23329]: cluster 2020-07-16T16:31:39.821547+0000 mgr.x (mgr.34562) 8319 : cluster [DBG] pgmap v5189: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:31:42.042 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:31:41 smithi132 bash[27079]: cluster 2020-07-16T16:31:39.821547+0000 mgr.x (mgr.34562) 8319 : cluster [DBG] pgmap v5189: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:31:42.934 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:31:42 smithi188 bash[23329]: audit 2020-07-16T16:31:41.721771+0000 mon.b (mon.2) 1757 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:31:43.042 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:31:42 smithi132 bash[27079]: audit 2020-07-16T16:31:41.721771+0000 mon.b (mon.2) 1757 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:31:43.935 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:31:43 smithi188 bash[23329]: cephadm 2020-07-16T16:31:41.722889+0000 mgr.x (mgr.34562) 8320 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:31:43.935 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:31:43 smithi188 bash[23329]: cephadm 2020-07-16T16:31:41.722964+0000 mgr.x (mgr.34562) 8321 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:31:43.936 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:31:43 smithi188 bash[23329]: cluster 2020-07-16T16:31:41.821957+0000 mgr.x (mgr.34562) 8322 : cluster [DBG] pgmap v5190: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:31:44.045 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:31:43 smithi132 bash[27079]: cephadm 2020-07-16T16:31:41.722889+0000 mgr.x (mgr.34562) 8320 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:31:44.045 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:31:43 smithi132 bash[27079]: cephadm 2020-07-16T16:31:41.722964+0000 mgr.x (mgr.34562) 8321 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:31:44.046 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:31:43 smithi132 bash[27079]: cluster 2020-07-16T16:31:41.821957+0000 mgr.x (mgr.34562) 8322 : cluster [DBG] pgmap v5190: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:31:45.936 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:31:45 smithi188 bash[23329]: cluster 2020-07-16T16:31:43.822437+0000 mgr.x (mgr.34562) 8323 : cluster [DBG] pgmap v5191: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:31:46.044 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:31:45 smithi132 bash[27079]: cluster 2020-07-16T16:31:43.822437+0000 mgr.x (mgr.34562) 8323 : cluster [DBG] pgmap v5191: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:31:47.936 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:31:47 smithi188 bash[23329]: cluster 2020-07-16T16:31:45.822765+0000 mgr.x (mgr.34562) 8324 : cluster [DBG] pgmap v5192: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:31:48.045 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:31:47 smithi132 bash[27079]: cluster 2020-07-16T16:31:45.822765+0000 mgr.x (mgr.34562) 8324 : cluster [DBG] pgmap v5192: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:31:49.937 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:31:49 smithi188 bash[23329]: cluster 2020-07-16T16:31:47.823295+0000 mgr.x (mgr.34562) 8325 : cluster [DBG] pgmap v5193: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:31:50.046 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:31:49 smithi132 bash[27079]: cluster 2020-07-16T16:31:47.823295+0000 mgr.x (mgr.34562) 8325 : cluster [DBG] pgmap v5193: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:31:51.938 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:31:51 smithi188 bash[23329]: cluster 2020-07-16T16:31:49.823876+0000 mgr.x (mgr.34562) 8326 : cluster [DBG] pgmap v5194: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:31:52.046 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:31:51 smithi132 bash[27079]: cluster 2020-07-16T16:31:49.823876+0000 mgr.x (mgr.34562) 8326 : cluster [DBG] pgmap v5194: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:31:53.940 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:31:53 smithi188 bash[23329]: cluster 2020-07-16T16:31:51.824484+0000 mgr.x (mgr.34562) 8327 : cluster [DBG] pgmap v5195: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:31:54.047 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:31:53 smithi132 bash[27079]: cluster 2020-07-16T16:31:51.824484+0000 mgr.x (mgr.34562) 8327 : cluster [DBG] pgmap v5195: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:31:55.940 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:31:55 smithi188 bash[23329]: cluster 2020-07-16T16:31:53.825032+0000 mgr.x (mgr.34562) 8328 : cluster [DBG] pgmap v5196: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:31:56.048 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:31:55 smithi132 bash[27079]: cluster 2020-07-16T16:31:53.825032+0000 mgr.x (mgr.34562) 8328 : cluster [DBG] pgmap v5196: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:31:57.941 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:31:57 smithi188 bash[23329]: cluster 2020-07-16T16:31:55.825528+0000 mgr.x (mgr.34562) 8329 : cluster [DBG] pgmap v5197: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:31:57.942 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:31:57 smithi188 bash[23329]: audit 2020-07-16T16:31:56.734572+0000 mon.b (mon.2) 1758 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:31:57.942 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:31:57 smithi188 bash[23329]: audit 2020-07-16T16:31:56.736027+0000 mon.b (mon.2) 1759 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:31:57.942 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:31:57 smithi188 bash[23329]: audit 2020-07-16T16:31:56.737232+0000 mon.b (mon.2) 1760 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:31:57.943 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:31:57 smithi188 bash[23329]: audit 2020-07-16T16:31:56.738666+0000 mon.b (mon.2) 1761 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:31:57.943 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:31:57 smithi188 bash[23329]: audit 2020-07-16T16:31:56.739863+0000 mon.b (mon.2) 1762 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:31:58.049 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:31:57 smithi132 bash[27079]: cluster 2020-07-16T16:31:55.825528+0000 mgr.x (mgr.34562) 8329 : cluster [DBG] pgmap v5197: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:31:58.050 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:31:57 smithi132 bash[27079]: audit 2020-07-16T16:31:56.734572+0000 mon.b (mon.2) 1758 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:31:58.050 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:31:57 smithi132 bash[27079]: audit 2020-07-16T16:31:56.736027+0000 mon.b (mon.2) 1759 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:31:58.050 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:31:57 smithi132 bash[27079]: audit 2020-07-16T16:31:56.737232+0000 mon.b (mon.2) 1760 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:31:58.051 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:31:57 smithi132 bash[27079]: audit 2020-07-16T16:31:56.738666+0000 mon.b (mon.2) 1761 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:31:58.051 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:31:57 smithi132 bash[27079]: audit 2020-07-16T16:31:56.739863+0000 mon.b (mon.2) 1762 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:31:58.941 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:31:58 smithi188 bash[23329]: audit 2020-07-16T16:31:56.735011+0000 mgr.x (mgr.34562) 8330 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:31:58.942 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:31:58 smithi188 bash[23329]: audit 2020-07-16T16:31:56.736338+0000 mgr.x (mgr.34562) 8331 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:31:58.942 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:31:58 smithi188 bash[23329]: audit 2020-07-16T16:31:56.737528+0000 mgr.x (mgr.34562) 8332 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:31:58.942 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:31:58 smithi188 bash[23329]: cephadm 2020-07-16T16:31:56.738292+0000 mgr.x (mgr.34562) 8333 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:31:58.943 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:31:58 smithi188 bash[23329]: cephadm 2020-07-16T16:31:56.739496+0000 mgr.x (mgr.34562) 8334 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:31:58.943 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:31:58 smithi188 bash[23329]: cephadm 2020-07-16T16:31:56.740596+0000 mgr.x (mgr.34562) 8335 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:31:58.943 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:31:58 smithi188 bash[23329]: cephadm 2020-07-16T16:31:56.740708+0000 mgr.x (mgr.34562) 8336 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:31:59.037 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:31:58 smithi132 bash[27079]: audit 2020-07-16T16:31:56.735011+0000 mgr.x (mgr.34562) 8330 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:31:59.037 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:31:58 smithi132 bash[27079]: audit 2020-07-16T16:31:56.736338+0000 mgr.x (mgr.34562) 8331 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:31:59.038 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:31:58 smithi132 bash[27079]: audit 2020-07-16T16:31:56.737528+0000 mgr.x (mgr.34562) 8332 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:31:59.038 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:31:58 smithi132 bash[27079]: cephadm 2020-07-16T16:31:56.738292+0000 mgr.x (mgr.34562) 8333 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:31:59.038 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:31:58 smithi132 bash[27079]: cephadm 2020-07-16T16:31:56.739496+0000 mgr.x (mgr.34562) 8334 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:31:59.039 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:31:58 smithi132 bash[27079]: cephadm 2020-07-16T16:31:56.740596+0000 mgr.x (mgr.34562) 8335 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:31:59.039 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:31:58 smithi132 bash[27079]: cephadm 2020-07-16T16:31:56.740708+0000 mgr.x (mgr.34562) 8336 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:31:59.945 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:31:59 smithi188 bash[23329]: cluster 2020-07-16T16:31:57.826085+0000 mgr.x (mgr.34562) 8337 : cluster [DBG] pgmap v5198: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:31:59.945 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:31:59 smithi188 bash[23329]: audit 2020-07-16T16:31:59.603132+0000 mon.b (mon.2) 1763 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:32:00.050 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:31:59 smithi132 bash[27079]: cluster 2020-07-16T16:31:57.826085+0000 mgr.x (mgr.34562) 8337 : cluster [DBG] pgmap v5198: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:32:00.051 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:31:59 smithi132 bash[27079]: audit 2020-07-16T16:31:59.603132+0000 mon.b (mon.2) 1763 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:32:00.942 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:32:00 smithi188 bash[23329]: cephadm 2020-07-16T16:31:59.603762+0000 mgr.x (mgr.34562) 8338 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:32:00.943 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:32:00 smithi188 bash[23329]: cephadm 2020-07-16T16:31:59.604138+0000 mgr.x (mgr.34562) 8339 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:32:01.050 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:32:00 smithi132 bash[27079]: cephadm 2020-07-16T16:31:59.603762+0000 mgr.x (mgr.34562) 8338 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:32:01.051 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:32:00 smithi132 bash[27079]: cephadm 2020-07-16T16:31:59.604138+0000 mgr.x (mgr.34562) 8339 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:32:01.942 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:32:01 smithi188 bash[23329]: cluster 2020-07-16T16:31:59.826480+0000 mgr.x (mgr.34562) 8340 : cluster [DBG] pgmap v5199: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:32:02.051 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:32:01 smithi132 bash[27079]: cluster 2020-07-16T16:31:59.826480+0000 mgr.x (mgr.34562) 8340 : cluster [DBG] pgmap v5199: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:32:03.943 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:32:03 smithi188 bash[23329]: cluster 2020-07-16T16:32:01.827013+0000 mgr.x (mgr.34562) 8341 : cluster [DBG] pgmap v5200: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:32:04.052 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:32:03 smithi132 bash[27079]: cluster 2020-07-16T16:32:01.827013+0000 mgr.x (mgr.34562) 8341 : cluster [DBG] pgmap v5200: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:32:05.944 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:32:05 smithi188 bash[23329]: cluster 2020-07-16T16:32:03.827453+0000 mgr.x (mgr.34562) 8342 : cluster [DBG] pgmap v5201: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:32:06.053 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:32:05 smithi132 bash[27079]: cluster 2020-07-16T16:32:03.827453+0000 mgr.x (mgr.34562) 8342 : cluster [DBG] pgmap v5201: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:32:07.325 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:32:07.584 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:32:07.585 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 4m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:32:07.585 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 4m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:32:07.585 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 4m ago 3h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:32:07.586 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 4m ago 3h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:32:07.586 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 4m ago 3h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:32:07.586 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (3h) 4m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:32:07.587 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (3h) 4m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:32:07.587 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 4m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:32:07.587 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 4m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:32:07.588 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (3h) 4m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:32:07.588 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (3h) 4m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:32:07.589 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:32:07.589 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:32:07.589 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:32:07.590 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:32:07.590 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:32:07.590 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:32:07.591 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 4m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:32:07.885 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:32:07.885 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:32:07.886 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:32:07.886 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:32:07.886 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:32:07.887 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:32:07.887 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:32:07.887 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:32:07.887 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:32:07.888 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:32:07.888 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:32:07.888 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:32:07.889 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:32:07.889 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:32:07.889 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:32:07.890 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:32:07.890 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:32:07.945 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:32:07 smithi188 bash[23329]: cluster 2020-07-16T16:32:05.827864+0000 mgr.x (mgr.34562) 8343 : cluster [DBG] pgmap v5202: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:32:08.054 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:32:07 smithi132 bash[27079]: cluster 2020-07-16T16:32:05.827864+0000 mgr.x (mgr.34562) 8343 : cluster [DBG] pgmap v5202: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:32:08.946 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:32:08 smithi188 bash[23329]: audit 2020-07-16T16:32:07.288989+0000 mgr.x (mgr.34562) 8344 : audit [DBG] from='client.30706 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:32:08.946 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:32:08 smithi188 bash[23329]: audit 2020-07-16T16:32:07.555397+0000 mgr.x (mgr.34562) 8345 : audit [DBG] from='client.30712 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:32:08.947 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:32:08 smithi188 bash[23329]: audit 2020-07-16T16:32:07.859223+0000 mon.c (mon.1) 554 : audit [DBG] from='client.? 172.21.15.132:0/1441157867' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:32:09.055 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:32:08 smithi132 bash[27079]: audit 2020-07-16T16:32:07.288989+0000 mgr.x (mgr.34562) 8344 : audit [DBG] from='client.30706 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:32:09.055 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:32:08 smithi132 bash[27079]: audit 2020-07-16T16:32:07.555397+0000 mgr.x (mgr.34562) 8345 : audit [DBG] from='client.30712 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:32:09.056 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:32:08 smithi132 bash[27079]: audit 2020-07-16T16:32:07.859223+0000 mon.c (mon.1) 554 : audit [DBG] from='client.? 172.21.15.132:0/1441157867' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:32:09.946 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:32:09 smithi188 bash[23329]: cluster 2020-07-16T16:32:07.828244+0000 mgr.x (mgr.34562) 8346 : cluster [DBG] pgmap v5203: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:32:10.054 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:32:09 smithi132 bash[27079]: cluster 2020-07-16T16:32:07.828244+0000 mgr.x (mgr.34562) 8346 : cluster [DBG] pgmap v5203: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:32:11.947 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:32:11 smithi188 bash[23329]: cluster 2020-07-16T16:32:09.828747+0000 mgr.x (mgr.34562) 8347 : cluster [DBG] pgmap v5204: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:32:12.055 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:32:11 smithi132 bash[27079]: cluster 2020-07-16T16:32:09.828747+0000 mgr.x (mgr.34562) 8347 : cluster [DBG] pgmap v5204: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:32:13.948 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:32:13 smithi188 bash[23329]: cluster 2020-07-16T16:32:11.829251+0000 mgr.x (mgr.34562) 8348 : cluster [DBG] pgmap v5205: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:32:14.056 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:32:13 smithi132 bash[27079]: cluster 2020-07-16T16:32:11.829251+0000 mgr.x (mgr.34562) 8348 : cluster [DBG] pgmap v5205: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:32:14.948 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:32:14 smithi188 bash[23329]: audit 2020-07-16T16:32:14.619615+0000 mon.b (mon.2) 1764 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:32:15.057 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:32:14 smithi132 bash[27079]: audit 2020-07-16T16:32:14.619615+0000 mon.b (mon.2) 1764 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:32:15.949 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:32:15 smithi188 bash[23329]: cluster 2020-07-16T16:32:13.829763+0000 mgr.x (mgr.34562) 8349 : cluster [DBG] pgmap v5206: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:32:15.950 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:32:15 smithi188 bash[23329]: cephadm 2020-07-16T16:32:14.620347+0000 mgr.x (mgr.34562) 8350 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:32:15.950 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:32:15 smithi188 bash[23329]: cephadm 2020-07-16T16:32:14.620819+0000 mgr.x (mgr.34562) 8351 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:32:16.057 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:32:15 smithi132 bash[27079]: cluster 2020-07-16T16:32:13.829763+0000 mgr.x (mgr.34562) 8349 : cluster [DBG] pgmap v5206: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:32:16.058 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:32:15 smithi132 bash[27079]: cephadm 2020-07-16T16:32:14.620347+0000 mgr.x (mgr.34562) 8350 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:32:16.058 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:32:15 smithi132 bash[27079]: cephadm 2020-07-16T16:32:14.620819+0000 mgr.x (mgr.34562) 8351 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:32:17.950 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:32:17 smithi188 bash[23329]: cluster 2020-07-16T16:32:15.830244+0000 mgr.x (mgr.34562) 8352 : cluster [DBG] pgmap v5207: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:32:18.058 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:32:17 smithi132 bash[27079]: cluster 2020-07-16T16:32:15.830244+0000 mgr.x (mgr.34562) 8352 : cluster [DBG] pgmap v5207: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:32:19.952 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:32:19 smithi188 bash[23329]: cluster 2020-07-16T16:32:17.830899+0000 mgr.x (mgr.34562) 8353 : cluster [DBG] pgmap v5208: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:32:20.059 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:32:19 smithi132 bash[27079]: cluster 2020-07-16T16:32:17.830899+0000 mgr.x (mgr.34562) 8353 : cluster [DBG] pgmap v5208: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:32:21.950 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:32:21 smithi188 bash[23329]: cluster 2020-07-16T16:32:19.831363+0000 mgr.x (mgr.34562) 8354 : cluster [DBG] pgmap v5209: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:32:22.058 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:32:21 smithi132 bash[27079]: cluster 2020-07-16T16:32:19.831363+0000 mgr.x (mgr.34562) 8354 : cluster [DBG] pgmap v5209: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:32:24.057 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:32:23 smithi132 bash[27079]: cluster 2020-07-16T16:32:21.831765+0000 mgr.x (mgr.34562) 8355 : cluster [DBG] pgmap v5210: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:32:24.198 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:32:23 smithi188 bash[23329]: cluster 2020-07-16T16:32:21.831765+0000 mgr.x (mgr.34562) 8355 : cluster [DBG] pgmap v5210: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:32:26.056 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:32:25 smithi132 bash[27079]: cluster 2020-07-16T16:32:23.832179+0000 mgr.x (mgr.34562) 8356 : cluster [DBG] pgmap v5211: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:32:26.197 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:32:25 smithi188 bash[23329]: cluster 2020-07-16T16:32:23.832179+0000 mgr.x (mgr.34562) 8356 : cluster [DBG] pgmap v5211: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:32:28.055 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:32:27 smithi132 bash[27079]: cluster 2020-07-16T16:32:25.832544+0000 mgr.x (mgr.34562) 8357 : cluster [DBG] pgmap v5212: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:32:28.196 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:32:27 smithi188 bash[23329]: cluster 2020-07-16T16:32:25.832544+0000 mgr.x (mgr.34562) 8357 : cluster [DBG] pgmap v5212: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:32:30.054 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:32:29 smithi132 bash[27079]: cluster 2020-07-16T16:32:27.832942+0000 mgr.x (mgr.34562) 8358 : cluster [DBG] pgmap v5213: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:32:30.054 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:32:29 smithi132 bash[27079]: audit 2020-07-16T16:32:29.636332+0000 mon.b (mon.2) 1765 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:32:30.195 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:32:29 smithi188 bash[23329]: cluster 2020-07-16T16:32:27.832942+0000 mgr.x (mgr.34562) 8358 : cluster [DBG] pgmap v5213: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:32:30.196 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:32:29 smithi188 bash[23329]: audit 2020-07-16T16:32:29.636332+0000 mon.b (mon.2) 1765 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:32:31.054 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:32:30 smithi132 bash[27079]: cephadm 2020-07-16T16:32:29.637076+0000 mgr.x (mgr.34562) 8359 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:32:31.055 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:32:30 smithi132 bash[27079]: cephadm 2020-07-16T16:32:29.637424+0000 mgr.x (mgr.34562) 8360 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:32:31.199 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:32:30 smithi188 bash[23329]: cephadm 2020-07-16T16:32:29.637076+0000 mgr.x (mgr.34562) 8359 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:32:31.199 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:32:30 smithi188 bash[23329]: cephadm 2020-07-16T16:32:29.637424+0000 mgr.x (mgr.34562) 8360 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:32:32.053 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:32:31 smithi132 bash[27079]: cluster 2020-07-16T16:32:29.833484+0000 mgr.x (mgr.34562) 8361 : cluster [DBG] pgmap v5214: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:32:32.195 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:32:31 smithi188 bash[23329]: cluster 2020-07-16T16:32:29.833484+0000 mgr.x (mgr.34562) 8361 : cluster [DBG] pgmap v5214: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:32:33.053 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:32:32 smithi132 bash[27079]: cluster 2020-07-16T16:32:31.833911+0000 mgr.x (mgr.34562) 8362 : cluster [DBG] pgmap v5215: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:32:33.194 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:32:32 smithi188 bash[23329]: cluster 2020-07-16T16:32:31.833911+0000 mgr.x (mgr.34562) 8362 : cluster [DBG] pgmap v5215: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:32:35.194 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:32:34 smithi188 bash[23329]: cluster 2020-07-16T16:32:33.834362+0000 mgr.x (mgr.34562) 8363 : cluster [DBG] pgmap v5216: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:32:35.302 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:32:34 smithi132 bash[27079]: cluster 2020-07-16T16:32:33.834362+0000 mgr.x (mgr.34562) 8363 : cluster [DBG] pgmap v5216: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:32:37.551 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:32:37 smithi132 bash[27079]: cluster 2020-07-16T16:32:35.834753+0000 mgr.x (mgr.34562) 8364 : cluster [DBG] pgmap v5217: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:32:37.693 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:32:37 smithi188 bash[23329]: cluster 2020-07-16T16:32:35.834753+0000 mgr.x (mgr.34562) 8364 : cluster [DBG] pgmap v5217: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:32:38.179 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:32:38.440 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:32:38.441 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 4m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:32:38.441 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 4m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:32:38.441 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 4m ago 3h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:32:38.442 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 4m ago 3h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:32:38.442 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 4m ago 3h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:32:38.443 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (3h) 4m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:32:38.443 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (3h) 4m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:32:38.443 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 4m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:32:38.444 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 4m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:32:38.444 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (3h) 4m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:32:38.444 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (3h) 4m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:32:38.445 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (3h) 4m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:32:38.445 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (3h) 4m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:32:38.445 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:32:38.445 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:32:38.446 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:32:38.446 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 4m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:32:38.446 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 4m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:32:38.742 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:32:38.742 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:32:38.742 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:32:38.743 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:32:38.743 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:32:38.743 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:32:38.744 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:32:38.744 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:32:38.744 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:32:38.745 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:32:38.745 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:32:38.745 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:32:38.746 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:32:38.746 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:32:38.746 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:32:38.746 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:32:38.747 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:32:39.551 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:32:39 smithi132 bash[27079]: cluster 2020-07-16T16:32:37.835189+0000 mgr.x (mgr.34562) 8365 : cluster [DBG] pgmap v5218: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:32:39.552 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:32:39 smithi132 bash[27079]: audit 2020-07-16T16:32:38.145470+0000 mgr.x (mgr.34562) 8366 : audit [DBG] from='client.30724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:32:39.552 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:32:39 smithi132 bash[27079]: audit 2020-07-16T16:32:38.413602+0000 mgr.x (mgr.34562) 8367 : audit [DBG] from='client.30730 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:32:39.552 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:32:39 smithi132 bash[27079]: audit 2020-07-16T16:32:38.718643+0000 mon.c (mon.1) 555 : audit [DBG] from='client.? 172.21.15.132:0/2144124486' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:32:39.692 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:32:39 smithi188 bash[23329]: cluster 2020-07-16T16:32:37.835189+0000 mgr.x (mgr.34562) 8365 : cluster [DBG] pgmap v5218: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:32:39.693 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:32:39 smithi188 bash[23329]: audit 2020-07-16T16:32:38.145470+0000 mgr.x (mgr.34562) 8366 : audit [DBG] from='client.30724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:32:39.693 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:32:39 smithi188 bash[23329]: audit 2020-07-16T16:32:38.413602+0000 mgr.x (mgr.34562) 8367 : audit [DBG] from='client.30730 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:32:39.694 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:32:39 smithi188 bash[23329]: audit 2020-07-16T16:32:38.718643+0000 mon.c (mon.1) 555 : audit [DBG] from='client.? 172.21.15.132:0/2144124486' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:32:41.551 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:32:41 smithi132 bash[27079]: cluster 2020-07-16T16:32:39.835751+0000 mgr.x (mgr.34562) 8368 : cluster [DBG] pgmap v5219: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:32:41.692 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:32:41 smithi188 bash[23329]: cluster 2020-07-16T16:32:39.835751+0000 mgr.x (mgr.34562) 8368 : cluster [DBG] pgmap v5219: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:32:43.550 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:32:43 smithi132 bash[27079]: cluster 2020-07-16T16:32:41.836260+0000 mgr.x (mgr.34562) 8369 : cluster [DBG] pgmap v5220: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:32:43.692 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:32:43 smithi188 bash[23329]: cluster 2020-07-16T16:32:41.836260+0000 mgr.x (mgr.34562) 8369 : cluster [DBG] pgmap v5220: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:32:45.692 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:32:45 smithi188 bash[23329]: cluster 2020-07-16T16:32:43.836629+0000 mgr.x (mgr.34562) 8370 : cluster [DBG] pgmap v5221: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:32:45.692 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:32:45 smithi188 bash[23329]: audit 2020-07-16T16:32:44.643227+0000 mon.b (mon.2) 1766 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:32:45.692 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:32:45 smithi188 bash[23329]: cephadm 2020-07-16T16:32:44.643983+0000 mgr.x (mgr.34562) 8371 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:32:45.693 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:32:45 smithi188 bash[23329]: cephadm 2020-07-16T16:32:44.644499+0000 mgr.x (mgr.34562) 8372 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:32:45.800 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:32:45 smithi132 bash[27079]: cluster 2020-07-16T16:32:43.836629+0000 mgr.x (mgr.34562) 8370 : cluster [DBG] pgmap v5221: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:32:45.800 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:32:45 smithi132 bash[27079]: audit 2020-07-16T16:32:44.643227+0000 mon.b (mon.2) 1766 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:32:45.801 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:32:45 smithi132 bash[27079]: cephadm 2020-07-16T16:32:44.643983+0000 mgr.x (mgr.34562) 8371 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:32:45.801 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:32:45 smithi132 bash[27079]: cephadm 2020-07-16T16:32:44.644499+0000 mgr.x (mgr.34562) 8372 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:32:47.691 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:32:47 smithi188 bash[23329]: cluster 2020-07-16T16:32:45.837091+0000 mgr.x (mgr.34562) 8373 : cluster [DBG] pgmap v5222: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:32:47.799 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:32:47 smithi132 bash[27079]: cluster 2020-07-16T16:32:45.837091+0000 mgr.x (mgr.34562) 8373 : cluster [DBG] pgmap v5222: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:32:49.691 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:32:49 smithi188 bash[23329]: cluster 2020-07-16T16:32:47.837492+0000 mgr.x (mgr.34562) 8374 : cluster [DBG] pgmap v5223: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:32:49.799 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:32:49 smithi132 bash[27079]: cluster 2020-07-16T16:32:47.837492+0000 mgr.x (mgr.34562) 8374 : cluster [DBG] pgmap v5223: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:32:51.691 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:32:51 smithi188 bash[23329]: cluster 2020-07-16T16:32:49.837968+0000 mgr.x (mgr.34562) 8375 : cluster [DBG] pgmap v5224: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:32:51.799 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:32:51 smithi132 bash[27079]: cluster 2020-07-16T16:32:49.837968+0000 mgr.x (mgr.34562) 8375 : cluster [DBG] pgmap v5224: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:32:53.691 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:32:53 smithi188 bash[23329]: cluster 2020-07-16T16:32:51.838439+0000 mgr.x (mgr.34562) 8376 : cluster [DBG] pgmap v5225: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:32:53.799 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:32:53 smithi132 bash[27079]: cluster 2020-07-16T16:32:51.838439+0000 mgr.x (mgr.34562) 8376 : cluster [DBG] pgmap v5225: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:32:55.691 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:32:55 smithi188 bash[23329]: cluster 2020-07-16T16:32:53.838811+0000 mgr.x (mgr.34562) 8377 : cluster [DBG] pgmap v5226: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:32:55.800 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:32:55 smithi132 bash[27079]: cluster 2020-07-16T16:32:53.838811+0000 mgr.x (mgr.34562) 8377 : cluster [DBG] pgmap v5226: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:32:57.691 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:32:57 smithi188 bash[23329]: cluster 2020-07-16T16:32:55.839235+0000 mgr.x (mgr.34562) 8378 : cluster [DBG] pgmap v5227: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:32:57.799 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:32:57 smithi132 bash[27079]: cluster 2020-07-16T16:32:55.839235+0000 mgr.x (mgr.34562) 8378 : cluster [DBG] pgmap v5227: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:32:59.691 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:32:59 smithi188 bash[23329]: cluster 2020-07-16T16:32:57.839638+0000 mgr.x (mgr.34562) 8379 : cluster [DBG] pgmap v5228: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:32:59.799 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:32:59 smithi132 bash[27079]: cluster 2020-07-16T16:32:57.839638+0000 mgr.x (mgr.34562) 8379 : cluster [DBG] pgmap v5228: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:33:00.494 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:33:00 smithi132 bash[27079]: audit 2020-07-16T16:32:59.662608+0000 mon.b (mon.2) 1767 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:33:00.495 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:33:00 smithi132 bash[27079]: audit 2020-07-16T16:32:59.663033+0000 mgr.x (mgr.34562) 8380 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:33:00.495 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:33:00 smithi132 bash[27079]: audit 2020-07-16T16:32:59.664104+0000 mon.b (mon.2) 1768 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:33:00.495 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:33:00 smithi132 bash[27079]: audit 2020-07-16T16:32:59.664456+0000 mgr.x (mgr.34562) 8381 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:33:00.496 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:33:00 smithi132 bash[27079]: audit 2020-07-16T16:32:59.665330+0000 mon.b (mon.2) 1769 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:33:00.496 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:33:00 smithi132 bash[27079]: audit 2020-07-16T16:32:59.665616+0000 mgr.x (mgr.34562) 8382 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:33:00.496 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:33:00 smithi132 bash[27079]: cephadm 2020-07-16T16:32:59.666332+0000 mgr.x (mgr.34562) 8383 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:33:00.497 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:33:00 smithi132 bash[27079]: audit 2020-07-16T16:32:59.666779+0000 mon.b (mon.2) 1770 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:33:00.497 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:33:00 smithi132 bash[27079]: cephadm 2020-07-16T16:32:59.667649+0000 mgr.x (mgr.34562) 8384 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:33:00.498 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:33:00 smithi132 bash[27079]: audit 2020-07-16T16:32:59.668085+0000 mon.b (mon.2) 1771 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:33:00.498 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:33:00 smithi132 bash[27079]: cephadm 2020-07-16T16:32:59.668802+0000 mgr.x (mgr.34562) 8385 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:33:00.499 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:33:00 smithi132 bash[27079]: cephadm 2020-07-16T16:32:59.669072+0000 mgr.x (mgr.34562) 8386 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:33:00.691 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:33:00 smithi188 bash[23329]: audit 2020-07-16T16:32:59.662608+0000 mon.b (mon.2) 1767 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:33:00.692 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:33:00 smithi188 bash[23329]: audit 2020-07-16T16:32:59.663033+0000 mgr.x (mgr.34562) 8380 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:33:00.692 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:33:00 smithi188 bash[23329]: audit 2020-07-16T16:32:59.664104+0000 mon.b (mon.2) 1768 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:33:00.692 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:33:00 smithi188 bash[23329]: audit 2020-07-16T16:32:59.664456+0000 mgr.x (mgr.34562) 8381 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:33:00.693 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:33:00 smithi188 bash[23329]: audit 2020-07-16T16:32:59.665330+0000 mon.b (mon.2) 1769 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:33:00.693 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:33:00 smithi188 bash[23329]: audit 2020-07-16T16:32:59.665616+0000 mgr.x (mgr.34562) 8382 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:33:00.693 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:33:00 smithi188 bash[23329]: cephadm 2020-07-16T16:32:59.666332+0000 mgr.x (mgr.34562) 8383 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:33:00.694 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:33:00 smithi188 bash[23329]: audit 2020-07-16T16:32:59.666779+0000 mon.b (mon.2) 1770 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:33:00.694 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:33:00 smithi188 bash[23329]: cephadm 2020-07-16T16:32:59.667649+0000 mgr.x (mgr.34562) 8384 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:33:00.694 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:33:00 smithi188 bash[23329]: audit 2020-07-16T16:32:59.668085+0000 mon.b (mon.2) 1771 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:33:00.695 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:33:00 smithi188 bash[23329]: cephadm 2020-07-16T16:32:59.668802+0000 mgr.x (mgr.34562) 8385 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:33:00.695 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:33:00 smithi188 bash[23329]: cephadm 2020-07-16T16:32:59.669072+0000 mgr.x (mgr.34562) 8386 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:33:01.596 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:33:01 smithi132 bash[27079]: cluster 2020-07-16T16:32:59.840132+0000 mgr.x (mgr.34562) 8387 : cluster [DBG] pgmap v5229: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:33:01.691 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:33:01 smithi188 bash[23329]: cluster 2020-07-16T16:32:59.840132+0000 mgr.x (mgr.34562) 8387 : cluster [DBG] pgmap v5229: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:33:03.692 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:33:03 smithi188 bash[23329]: cluster 2020-07-16T16:33:01.840552+0000 mgr.x (mgr.34562) 8388 : cluster [DBG] pgmap v5230: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:33:03.692 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:33:03 smithi188 bash[23329]: audit 2020-07-16T16:33:02.405926+0000 mon.b (mon.2) 1772 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:33:03.693 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:33:03 smithi188 bash[23329]: cephadm 2020-07-16T16:33:02.406543+0000 mgr.x (mgr.34562) 8389 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:33:03.693 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:33:03 smithi188 bash[23329]: cephadm 2020-07-16T16:33:02.406869+0000 mgr.x (mgr.34562) 8390 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:33:03.800 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:33:03 smithi132 bash[27079]: cluster 2020-07-16T16:33:01.840552+0000 mgr.x (mgr.34562) 8388 : cluster [DBG] pgmap v5230: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:33:03.800 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:33:03 smithi132 bash[27079]: audit 2020-07-16T16:33:02.405926+0000 mon.b (mon.2) 1772 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:33:03.800 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:33:03 smithi132 bash[27079]: cephadm 2020-07-16T16:33:02.406543+0000 mgr.x (mgr.34562) 8389 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:33:03.801 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:33:03 smithi132 bash[27079]: cephadm 2020-07-16T16:33:02.406869+0000 mgr.x (mgr.34562) 8390 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:33:05.692 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:33:05 smithi188 bash[23329]: cluster 2020-07-16T16:33:03.841027+0000 mgr.x (mgr.34562) 8391 : cluster [DBG] pgmap v5231: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:33:05.800 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:33:05 smithi132 bash[27079]: cluster 2020-07-16T16:33:03.841027+0000 mgr.x (mgr.34562) 8391 : cluster [DBG] pgmap v5231: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:33:07.692 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:33:07 smithi188 bash[23329]: cluster 2020-07-16T16:33:05.841498+0000 mgr.x (mgr.34562) 8392 : cluster [DBG] pgmap v5232: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:33:07.800 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:33:07 smithi132 bash[27079]: cluster 2020-07-16T16:33:05.841498+0000 mgr.x (mgr.34562) 8392 : cluster [DBG] pgmap v5232: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:33:09.040 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:33:09.301 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:33:09.301 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 5m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:33:09.302 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 5m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:33:09.302 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 5m ago 3h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:33:09.303 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 5m ago 3h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:33:09.303 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 5m ago 3h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:33:09.304 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (3h) 5m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:33:09.304 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (3h) 5m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:33:09.305 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 5m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:33:09.306 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 5m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:33:09.306 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (3h) 5m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:33:09.307 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (3h) 5m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:33:09.307 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (3h) 5m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:33:09.308 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (3h) 5m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:33:09.308 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (3h) 5m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:33:09.309 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (3h) 5m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:33:09.309 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:33:09.310 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (2h) 5m ago 2h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:33:09.310 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 5m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:33:09.598 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:33:09.599 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:33:09.599 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:33:09.599 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:33:09.600 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:33:09.600 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:33:09.600 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:33:09.600 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:33:09.601 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:33:09.601 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:33:09.601 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:33:09.602 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:33:09.602 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:33:09.602 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:33:09.603 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:33:09.603 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:33:09.603 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:33:09.692 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:33:09 smithi188 bash[23329]: cluster 2020-07-16T16:33:07.841885+0000 mgr.x (mgr.34562) 8393 : cluster [DBG] pgmap v5233: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:33:09.800 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:33:09 smithi132 bash[27079]: cluster 2020-07-16T16:33:07.841885+0000 mgr.x (mgr.34562) 8393 : cluster [DBG] pgmap v5233: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:33:10.692 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:33:10 smithi188 bash[23329]: audit 2020-07-16T16:33:09.006206+0000 mgr.x (mgr.34562) 8394 : audit [DBG] from='client.30742 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:33:10.693 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:33:10 smithi188 bash[23329]: audit 2020-07-16T16:33:09.274270+0000 mgr.x (mgr.34562) 8395 : audit [DBG] from='client.30748 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:33:10.693 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:33:10 smithi188 bash[23329]: audit 2020-07-16T16:33:09.575772+0000 mon.c (mon.1) 556 : audit [DBG] from='client.? 172.21.15.132:0/1426984451' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:33:10.800 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:33:10 smithi132 bash[27079]: audit 2020-07-16T16:33:09.006206+0000 mgr.x (mgr.34562) 8394 : audit [DBG] from='client.30742 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:33:10.801 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:33:10 smithi132 bash[27079]: audit 2020-07-16T16:33:09.274270+0000 mgr.x (mgr.34562) 8395 : audit [DBG] from='client.30748 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:33:10.801 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:33:10 smithi132 bash[27079]: audit 2020-07-16T16:33:09.575772+0000 mon.c (mon.1) 556 : audit [DBG] from='client.? 172.21.15.132:0/1426984451' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:33:11.692 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:33:11 smithi188 bash[23329]: cluster 2020-07-16T16:33:09.842424+0000 mgr.x (mgr.34562) 8396 : cluster [DBG] pgmap v5234: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:33:11.801 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:33:11 smithi132 bash[27079]: cluster 2020-07-16T16:33:09.842424+0000 mgr.x (mgr.34562) 8396 : cluster [DBG] pgmap v5234: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:33:13.692 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:33:13 smithi188 bash[23329]: cluster 2020-07-16T16:33:11.842770+0000 mgr.x (mgr.34562) 8397 : cluster [DBG] pgmap v5235: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:33:13.801 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:33:13 smithi132 bash[27079]: cluster 2020-07-16T16:33:11.842770+0000 mgr.x (mgr.34562) 8397 : cluster [DBG] pgmap v5235: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:33:15.693 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:33:15 smithi188 bash[23329]: cluster 2020-07-16T16:33:13.843125+0000 mgr.x (mgr.34562) 8398 : cluster [DBG] pgmap v5236: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:33:15.801 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:33:15 smithi132 bash[27079]: cluster 2020-07-16T16:33:13.843125+0000 mgr.x (mgr.34562) 8398 : cluster [DBG] pgmap v5236: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:33:17.694 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:33:17 smithi188 bash[23329]: cluster 2020-07-16T16:33:15.843507+0000 mgr.x (mgr.34562) 8399 : cluster [DBG] pgmap v5237: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:33:17.802 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:33:17 smithi132 bash[27079]: cluster 2020-07-16T16:33:15.843507+0000 mgr.x (mgr.34562) 8399 : cluster [DBG] pgmap v5237: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:33:18.694 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:33:18 smithi188 bash[23329]: audit 2020-07-16T16:33:17.417863+0000 mon.b (mon.2) 1773 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:33:18.694 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:33:18 smithi188 bash[23329]: cephadm 2020-07-16T16:33:17.418559+0000 mgr.x (mgr.34562) 8400 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:33:18.695 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:33:18 smithi188 bash[23329]: cephadm 2020-07-16T16:33:17.418959+0000 mgr.x (mgr.34562) 8401 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:33:18.802 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:33:18 smithi132 bash[27079]: audit 2020-07-16T16:33:17.417863+0000 mon.b (mon.2) 1773 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:33:18.802 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:33:18 smithi132 bash[27079]: cephadm 2020-07-16T16:33:17.418559+0000 mgr.x (mgr.34562) 8400 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:33:18.802 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:33:18 smithi132 bash[27079]: cephadm 2020-07-16T16:33:17.418959+0000 mgr.x (mgr.34562) 8401 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:33:19.697 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:33:19 smithi188 bash[23329]: cluster 2020-07-16T16:33:17.843937+0000 mgr.x (mgr.34562) 8402 : cluster [DBG] pgmap v5238: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:33:19.802 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:33:19 smithi132 bash[27079]: cluster 2020-07-16T16:33:17.843937+0000 mgr.x (mgr.34562) 8402 : cluster [DBG] pgmap v5238: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:33:21.694 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:33:21 smithi188 bash[23329]: cluster 2020-07-16T16:33:19.844433+0000 mgr.x (mgr.34562) 8403 : cluster [DBG] pgmap v5239: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:33:21.802 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:33:21 smithi132 bash[27079]: cluster 2020-07-16T16:33:19.844433+0000 mgr.x (mgr.34562) 8403 : cluster [DBG] pgmap v5239: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:33:23.694 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:33:23 smithi188 bash[23329]: cluster 2020-07-16T16:33:21.844973+0000 mgr.x (mgr.34562) 8404 : cluster [DBG] pgmap v5240: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:33:23.803 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:33:23 smithi132 bash[27079]: cluster 2020-07-16T16:33:21.844973+0000 mgr.x (mgr.34562) 8404 : cluster [DBG] pgmap v5240: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:33:25.695 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:33:25 smithi188 bash[23329]: cluster 2020-07-16T16:33:23.845443+0000 mgr.x (mgr.34562) 8405 : cluster [DBG] pgmap v5241: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:33:25.803 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:33:25 smithi132 bash[27079]: cluster 2020-07-16T16:33:23.845443+0000 mgr.x (mgr.34562) 8405 : cluster [DBG] pgmap v5241: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:33:27.696 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:33:27 smithi188 bash[23329]: cluster 2020-07-16T16:33:25.845834+0000 mgr.x (mgr.34562) 8406 : cluster [DBG] pgmap v5242: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:33:27.804 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:33:27 smithi132 bash[27079]: cluster 2020-07-16T16:33:25.845834+0000 mgr.x (mgr.34562) 8406 : cluster [DBG] pgmap v5242: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:33:29.696 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:33:29 smithi188 bash[23329]: cluster 2020-07-16T16:33:27.846328+0000 mgr.x (mgr.34562) 8407 : cluster [DBG] pgmap v5243: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:33:29.804 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:33:29 smithi132 bash[27079]: cluster 2020-07-16T16:33:27.846328+0000 mgr.x (mgr.34562) 8407 : cluster [DBG] pgmap v5243: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:33:31.696 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:33:31 smithi188 bash[23329]: cluster 2020-07-16T16:33:29.846775+0000 mgr.x (mgr.34562) 8408 : cluster [DBG] pgmap v5244: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:33:31.804 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:33:31 smithi132 bash[27079]: cluster 2020-07-16T16:33:29.846775+0000 mgr.x (mgr.34562) 8408 : cluster [DBG] pgmap v5244: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:33:33.697 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:33:33 smithi188 bash[23329]: cluster 2020-07-16T16:33:31.847331+0000 mgr.x (mgr.34562) 8409 : cluster [DBG] pgmap v5245: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:33:33.698 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:33:33 smithi188 bash[23329]: audit 2020-07-16T16:33:32.421535+0000 mon.b (mon.2) 1774 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:33:33.698 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:33:33 smithi188 bash[23329]: cephadm 2020-07-16T16:33:32.422235+0000 mgr.x (mgr.34562) 8410 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:33:33.699 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:33:33 smithi188 bash[23329]: cephadm 2020-07-16T16:33:32.422322+0000 mgr.x (mgr.34562) 8411 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:33:33.805 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:33:33 smithi132 bash[27079]: cluster 2020-07-16T16:33:31.847331+0000 mgr.x (mgr.34562) 8409 : cluster [DBG] pgmap v5245: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:33:33.805 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:33:33 smithi132 bash[27079]: audit 2020-07-16T16:33:32.421535+0000 mon.b (mon.2) 1774 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:33:33.806 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:33:33 smithi132 bash[27079]: cephadm 2020-07-16T16:33:32.422235+0000 mgr.x (mgr.34562) 8410 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:33:33.806 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:33:33 smithi132 bash[27079]: cephadm 2020-07-16T16:33:32.422322+0000 mgr.x (mgr.34562) 8411 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:33:35.697 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:33:35 smithi188 bash[23329]: cluster 2020-07-16T16:33:33.847701+0000 mgr.x (mgr.34562) 8412 : cluster [DBG] pgmap v5246: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:33:35.806 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:33:35 smithi132 bash[27079]: cluster 2020-07-16T16:33:33.847701+0000 mgr.x (mgr.34562) 8412 : cluster [DBG] pgmap v5246: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:33:37.697 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:33:37 smithi188 bash[23329]: cluster 2020-07-16T16:33:35.848097+0000 mgr.x (mgr.34562) 8413 : cluster [DBG] pgmap v5247: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:33:37.806 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:33:37 smithi132 bash[27079]: cluster 2020-07-16T16:33:35.848097+0000 mgr.x (mgr.34562) 8413 : cluster [DBG] pgmap v5247: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:33:39.698 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:33:39 smithi188 bash[23329]: cluster 2020-07-16T16:33:37.848632+0000 mgr.x (mgr.34562) 8414 : cluster [DBG] pgmap v5248: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:33:39.808 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:33:39 smithi132 bash[27079]: cluster 2020-07-16T16:33:37.848632+0000 mgr.x (mgr.34562) 8414 : cluster [DBG] pgmap v5248: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:33:39.904 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:33:40.163 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:33:40.164 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 5m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:33:40.164 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 5m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:33:40.164 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 5m ago 3h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:33:40.165 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 5m ago 3h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:33:40.165 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 5m ago 3h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:33:40.165 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (3h) 5m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:33:40.166 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (3h) 5m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:33:40.166 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (2h) 5m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:33:40.166 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (2h) 5m ago 2h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:33:40.167 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (3h) 5m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:33:40.167 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (3h) 5m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:33:40.167 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (3h) 5m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:33:40.168 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (3h) 5m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:33:40.168 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (3h) 5m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:33:40.168 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (3h) 5m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:33:40.169 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (3h) 5m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:33:40.169 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (3h) 5m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:33:40.170 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 5m ago 2h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:33:40.465 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:33:40.466 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:33:40.466 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:33:40.466 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:33:40.467 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:33:40.467 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:33:40.467 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:33:40.467 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:33:40.468 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:33:40.468 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:33:40.468 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:33:40.469 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:33:40.469 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:33:40.469 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:33:40.470 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:33:40.470 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:33:40.470 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:33:41.699 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:33:41 smithi188 bash[23329]: cluster 2020-07-16T16:33:39.849104+0000 mgr.x (mgr.34562) 8415 : cluster [DBG] pgmap v5249: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:33:41.699 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:33:41 smithi188 bash[23329]: audit 2020-07-16T16:33:39.865082+0000 mgr.x (mgr.34562) 8416 : audit [DBG] from='client.30760 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:33:41.699 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:33:41 smithi188 bash[23329]: audit 2020-07-16T16:33:40.131345+0000 mgr.x (mgr.34562) 8417 : audit [DBG] from='client.30766 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:33:41.700 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:33:41 smithi188 bash[23329]: audit 2020-07-16T16:33:40.436543+0000 mon.c (mon.1) 557 : audit [DBG] from='client.? 172.21.15.132:0/3084909005' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:33:41.807 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:33:41 smithi132 bash[27079]: cluster 2020-07-16T16:33:39.849104+0000 mgr.x (mgr.34562) 8415 : cluster [DBG] pgmap v5249: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:33:41.807 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:33:41 smithi132 bash[27079]: audit 2020-07-16T16:33:39.865082+0000 mgr.x (mgr.34562) 8416 : audit [DBG] from='client.30760 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:33:41.808 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:33:41 smithi132 bash[27079]: audit 2020-07-16T16:33:40.131345+0000 mgr.x (mgr.34562) 8417 : audit [DBG] from='client.30766 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:33:41.808 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:33:41 smithi132 bash[27079]: audit 2020-07-16T16:33:40.436543+0000 mon.c (mon.1) 557 : audit [DBG] from='client.? 172.21.15.132:0/3084909005' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:33:43.807 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:33:43 smithi132 bash[27079]: cluster 2020-07-16T16:33:41.849450+0000 mgr.x (mgr.34562) 8418 : cluster [DBG] pgmap v5250: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:33:43.949 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:33:43 smithi188 bash[23329]: cluster 2020-07-16T16:33:41.849450+0000 mgr.x (mgr.34562) 8418 : cluster [DBG] pgmap v5250: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:33:45.808 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:33:45 smithi132 bash[27079]: cluster 2020-07-16T16:33:43.849939+0000 mgr.x (mgr.34562) 8419 : cluster [DBG] pgmap v5251: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:33:45.950 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:33:45 smithi188 bash[23329]: cluster 2020-07-16T16:33:43.849939+0000 mgr.x (mgr.34562) 8419 : cluster [DBG] pgmap v5251: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:33:47.809 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:33:47 smithi132 bash[27079]: cluster 2020-07-16T16:33:45.850439+0000 mgr.x (mgr.34562) 8420 : cluster [DBG] pgmap v5252: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:33:47.950 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:33:47 smithi188 bash[23329]: cluster 2020-07-16T16:33:45.850439+0000 mgr.x (mgr.34562) 8420 : cluster [DBG] pgmap v5252: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:33:48.809 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:33:48 smithi132 bash[27079]: audit 2020-07-16T16:33:47.436768+0000 mon.b (mon.2) 1775 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:33:48.810 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:33:48 smithi132 bash[27079]: cephadm 2020-07-16T16:33:47.437500+0000 mgr.x (mgr.34562) 8421 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:33:48.810 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:33:48 smithi132 bash[27079]: cephadm 2020-07-16T16:33:47.437592+0000 mgr.x (mgr.34562) 8422 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:33:48.950 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:33:48 smithi188 bash[23329]: audit 2020-07-16T16:33:47.436768+0000 mon.b (mon.2) 1775 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:33:48.951 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:33:48 smithi188 bash[23329]: cephadm 2020-07-16T16:33:47.437500+0000 mgr.x (mgr.34562) 8421 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:33:48.951 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:33:48 smithi188 bash[23329]: cephadm 2020-07-16T16:33:47.437592+0000 mgr.x (mgr.34562) 8422 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:33:49.809 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:33:49 smithi132 bash[27079]: cluster 2020-07-16T16:33:47.850831+0000 mgr.x (mgr.34562) 8423 : cluster [DBG] pgmap v5253: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:33:49.951 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:33:49 smithi188 bash[23329]: cluster 2020-07-16T16:33:47.850831+0000 mgr.x (mgr.34562) 8423 : cluster [DBG] pgmap v5253: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:33:51.810 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:33:51 smithi132 bash[27079]: cluster 2020-07-16T16:33:49.851364+0000 mgr.x (mgr.34562) 8424 : cluster [DBG] pgmap v5254: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:33:51.951 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:33:51 smithi188 bash[23329]: cluster 2020-07-16T16:33:49.851364+0000 mgr.x (mgr.34562) 8424 : cluster [DBG] pgmap v5254: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:33:53.810 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:33:53 smithi132 bash[27079]: cluster 2020-07-16T16:33:51.851877+0000 mgr.x (mgr.34562) 8425 : cluster [DBG] pgmap v5255: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:33:53.952 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:33:53 smithi188 bash[23329]: cluster 2020-07-16T16:33:51.851877+0000 mgr.x (mgr.34562) 8425 : cluster [DBG] pgmap v5255: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:33:55.811 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:33:55 smithi132 bash[27079]: cluster 2020-07-16T16:33:53.852323+0000 mgr.x (mgr.34562) 8426 : cluster [DBG] pgmap v5256: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:33:55.953 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:33:55 smithi188 bash[23329]: cluster 2020-07-16T16:33:53.852323+0000 mgr.x (mgr.34562) 8426 : cluster [DBG] pgmap v5256: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:33:57.812 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:33:57 smithi132 bash[27079]: cluster 2020-07-16T16:33:55.852674+0000 mgr.x (mgr.34562) 8427 : cluster [DBG] pgmap v5257: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:33:57.953 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:33:57 smithi188 bash[23329]: cluster 2020-07-16T16:33:55.852674+0000 mgr.x (mgr.34562) 8427 : cluster [DBG] pgmap v5257: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:33:59.812 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:33:59 smithi132 bash[27079]: cluster 2020-07-16T16:33:57.853095+0000 mgr.x (mgr.34562) 8428 : cluster [DBG] pgmap v5258: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:33:59.954 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:33:59 smithi188 bash[23329]: cluster 2020-07-16T16:33:57.853095+0000 mgr.x (mgr.34562) 8428 : cluster [DBG] pgmap v5258: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:34:01.813 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:34:01 smithi132 bash[27079]: cluster 2020-07-16T16:33:59.853506+0000 mgr.x (mgr.34562) 8429 : cluster [DBG] pgmap v5259: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:34:01.954 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:34:01 smithi188 bash[23329]: cluster 2020-07-16T16:33:59.853506+0000 mgr.x (mgr.34562) 8429 : cluster [DBG] pgmap v5259: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:34:02.813 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:34:02 smithi132 bash[27079]: audit 2020-07-16T16:34:02.442011+0000 mon.b (mon.2) 1776 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:34:02.814 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:34:02 smithi132 bash[27079]: audit 2020-07-16T16:34:02.443340+0000 mon.b (mon.2) 1777 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:34:02.814 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:34:02 smithi132 bash[27079]: audit 2020-07-16T16:34:02.444389+0000 mon.b (mon.2) 1778 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:34:02.814 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:34:02 smithi132 bash[27079]: audit 2020-07-16T16:34:02.445492+0000 mon.b (mon.2) 1779 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:34:02.815 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:34:02 smithi132 bash[27079]: audit 2020-07-16T16:34:02.446612+0000 mon.b (mon.2) 1780 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:34:02.955 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:34:02 smithi188 bash[23329]: audit 2020-07-16T16:34:02.442011+0000 mon.b (mon.2) 1776 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:34:02.955 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:34:02 smithi188 bash[23329]: audit 2020-07-16T16:34:02.443340+0000 mon.b (mon.2) 1777 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:34:02.955 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:34:02 smithi188 bash[23329]: audit 2020-07-16T16:34:02.444389+0000 mon.b (mon.2) 1778 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:34:02.956 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:34:02 smithi188 bash[23329]: audit 2020-07-16T16:34:02.445492+0000 mon.b (mon.2) 1779 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:34:02.956 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:34:02 smithi188 bash[23329]: audit 2020-07-16T16:34:02.446612+0000 mon.b (mon.2) 1780 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:34:03.814 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:34:03 smithi132 bash[27079]: cluster 2020-07-16T16:34:01.854000+0000 mgr.x (mgr.34562) 8430 : cluster [DBG] pgmap v5260: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:34:03.814 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:34:03 smithi132 bash[27079]: audit 2020-07-16T16:34:02.442397+0000 mgr.x (mgr.34562) 8431 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:34:03.815 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:34:03 smithi132 bash[27079]: audit 2020-07-16T16:34:02.443646+0000 mgr.x (mgr.34562) 8432 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:34:03.815 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:34:03 smithi132 bash[27079]: audit 2020-07-16T16:34:02.444647+0000 mgr.x (mgr.34562) 8433 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:34:03.815 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:34:03 smithi132 bash[27079]: cephadm 2020-07-16T16:34:02.445264+0000 mgr.x (mgr.34562) 8434 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:34:03.816 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:34:03 smithi132 bash[27079]: cephadm 2020-07-16T16:34:02.446296+0000 mgr.x (mgr.34562) 8435 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:34:03.816 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:34:03 smithi132 bash[27079]: cephadm 2020-07-16T16:34:02.447359+0000 mgr.x (mgr.34562) 8436 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:34:03.816 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:34:03 smithi132 bash[27079]: cephadm 2020-07-16T16:34:02.447582+0000 mgr.x (mgr.34562) 8437 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:34:03.956 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:34:03 smithi188 bash[23329]: cluster 2020-07-16T16:34:01.854000+0000 mgr.x (mgr.34562) 8430 : cluster [DBG] pgmap v5260: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:34:03.957 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:34:03 smithi188 bash[23329]: audit 2020-07-16T16:34:02.442397+0000 mgr.x (mgr.34562) 8431 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:34:03.957 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:34:03 smithi188 bash[23329]: audit 2020-07-16T16:34:02.443646+0000 mgr.x (mgr.34562) 8432 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:34:03.958 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:34:03 smithi188 bash[23329]: audit 2020-07-16T16:34:02.444647+0000 mgr.x (mgr.34562) 8433 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:34:03.958 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:34:03 smithi188 bash[23329]: cephadm 2020-07-16T16:34:02.445264+0000 mgr.x (mgr.34562) 8434 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:34:03.958 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:34:03 smithi188 bash[23329]: cephadm 2020-07-16T16:34:02.446296+0000 mgr.x (mgr.34562) 8435 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:34:03.959 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:34:03 smithi188 bash[23329]: cephadm 2020-07-16T16:34:02.447359+0000 mgr.x (mgr.34562) 8436 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:34:03.959 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:34:03 smithi188 bash[23329]: cephadm 2020-07-16T16:34:02.447582+0000 mgr.x (mgr.34562) 8437 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:34:05.814 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:34:05 smithi132 bash[27079]: cluster 2020-07-16T16:34:03.854508+0000 mgr.x (mgr.34562) 8438 : cluster [DBG] pgmap v5261: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:34:05.815 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:34:05 smithi132 bash[27079]: audit 2020-07-16T16:34:05.342495+0000 mon.b (mon.2) 1781 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:34:05.955 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:34:05 smithi188 bash[23329]: cluster 2020-07-16T16:34:03.854508+0000 mgr.x (mgr.34562) 8438 : cluster [DBG] pgmap v5261: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:34:05.956 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:34:05 smithi188 bash[23329]: audit 2020-07-16T16:34:05.342495+0000 mon.b (mon.2) 1781 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:34:06.814 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:34:06 smithi132 bash[27079]: cephadm 2020-07-16T16:34:05.343105+0000 mgr.x (mgr.34562) 8439 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:34:06.815 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:34:06 smithi132 bash[27079]: cephadm 2020-07-16T16:34:05.343189+0000 mgr.x (mgr.34562) 8440 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:34:06.962 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:34:06 smithi188 bash[23329]: cephadm 2020-07-16T16:34:05.343105+0000 mgr.x (mgr.34562) 8439 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:34:06.963 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:34:06 smithi188 bash[23329]: cephadm 2020-07-16T16:34:05.343189+0000 mgr.x (mgr.34562) 8440 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:34:07.815 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:34:07 smithi132 bash[27079]: cluster 2020-07-16T16:34:05.854994+0000 mgr.x (mgr.34562) 8441 : cluster [DBG] pgmap v5262: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:34:07.956 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:34:07 smithi188 bash[23329]: cluster 2020-07-16T16:34:05.854994+0000 mgr.x (mgr.34562) 8441 : cluster [DBG] pgmap v5262: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:34:09.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:34:09 smithi132 bash[27079]: cluster 2020-07-16T16:34:07.855516+0000 mgr.x (mgr.34562) 8442 : cluster [DBG] pgmap v5263: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:34:09.957 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:34:09 smithi188 bash[23329]: cluster 2020-07-16T16:34:07.855516+0000 mgr.x (mgr.34562) 8442 : cluster [DBG] pgmap v5263: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:34:10.772 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:34:11.033 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:34:11.034 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 6m ago 2h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:34:11.034 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (2h) 6m ago 2h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:34:11.034 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 6m ago 3h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:34:11.035 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 6m ago 3h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:34:11.035 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 6m ago 3h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:34:11.035 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (3h) 6m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:34:11.036 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (3h) 6m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:34:11.036 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (3h) 6m ago 3h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:34:11.036 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (3h) 6m ago 3h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:34:11.037 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (3h) 6m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:34:11.037 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (3h) 6m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:34:11.037 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (3h) 6m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:34:11.038 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (3h) 6m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:34:11.038 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (3h) 6m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:34:11.038 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (3h) 6m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:34:11.039 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (3h) 6m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:34:11.039 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (3h) 6m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:34:11.039 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 6m ago 3h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:34:11.332 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:34:11.332 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:34:11.333 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:34:11.333 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:34:11.333 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:34:11.334 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:34:11.334 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:34:11.334 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:34:11.335 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:34:11.335 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:34:11.335 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:34:11.336 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:34:11.336 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:34:11.336 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:34:11.336 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:34:11.337 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:34:11.337 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:34:11.816 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:34:11 smithi132 bash[27079]: cluster 2020-07-16T16:34:09.855894+0000 mgr.x (mgr.34562) 8443 : cluster [DBG] pgmap v5264: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:34:11.816 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:34:11 smithi132 bash[27079]: audit 2020-07-16T16:34:11.294254+0000 mon.c (mon.1) 558 : audit [DBG] from='client.? 172.21.15.132:0/1975532473' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:34:11.957 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:34:11 smithi188 bash[23329]: cluster 2020-07-16T16:34:09.855894+0000 mgr.x (mgr.34562) 8443 : cluster [DBG] pgmap v5264: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:34:11.958 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:34:11 smithi188 bash[23329]: audit 2020-07-16T16:34:11.294254+0000 mon.c (mon.1) 558 : audit [DBG] from='client.? 172.21.15.132:0/1975532473' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:34:12.816 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:34:12 smithi132 bash[27079]: audit 2020-07-16T16:34:10.723250+0000 mgr.x (mgr.34562) 8444 : audit [DBG] from='client.30778 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:34:12.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:34:12 smithi132 bash[27079]: audit 2020-07-16T16:34:10.992511+0000 mgr.x (mgr.34562) 8445 : audit [DBG] from='client.30784 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:34:12.958 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:34:12 smithi188 bash[23329]: audit 2020-07-16T16:34:10.723250+0000 mgr.x (mgr.34562) 8444 : audit [DBG] from='client.30778 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:34:12.958 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:34:12 smithi188 bash[23329]: audit 2020-07-16T16:34:10.992511+0000 mgr.x (mgr.34562) 8445 : audit [DBG] from='client.30784 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:34:13.816 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:34:13 smithi132 bash[27079]: cluster 2020-07-16T16:34:11.856296+0000 mgr.x (mgr.34562) 8446 : cluster [DBG] pgmap v5265: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:34:13.958 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:34:13 smithi188 bash[23329]: cluster 2020-07-16T16:34:11.856296+0000 mgr.x (mgr.34562) 8446 : cluster [DBG] pgmap v5265: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:34:15.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:34:15 smithi132 bash[27079]: cluster 2020-07-16T16:34:13.856665+0000 mgr.x (mgr.34562) 8447 : cluster [DBG] pgmap v5266: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:34:15.962 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:34:15 smithi188 bash[23329]: cluster 2020-07-16T16:34:13.856665+0000 mgr.x (mgr.34562) 8447 : cluster [DBG] pgmap v5266: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:34:17.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:34:17 smithi132 bash[27079]: cluster 2020-07-16T16:34:15.857089+0000 mgr.x (mgr.34562) 8448 : cluster [DBG] pgmap v5267: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:34:17.959 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:34:17 smithi188 bash[23329]: cluster 2020-07-16T16:34:15.857089+0000 mgr.x (mgr.34562) 8448 : cluster [DBG] pgmap v5267: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:34:19.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:34:19 smithi132 bash[27079]: cluster 2020-07-16T16:34:17.857650+0000 mgr.x (mgr.34562) 8449 : cluster [DBG] pgmap v5268: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:34:19.960 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:34:19 smithi188 bash[23329]: cluster 2020-07-16T16:34:17.857650+0000 mgr.x (mgr.34562) 8449 : cluster [DBG] pgmap v5268: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:34:20.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:34:20 smithi132 bash[27079]: audit 2020-07-16T16:34:20.359112+0000 mon.b (mon.2) 1782 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:34:20.960 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:34:20 smithi188 bash[23329]: audit 2020-07-16T16:34:20.359112+0000 mon.b (mon.2) 1782 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:34:21.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:34:21 smithi132 bash[27079]: cluster 2020-07-16T16:34:19.858077+0000 mgr.x (mgr.34562) 8450 : cluster [DBG] pgmap v5269: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:34:21.820 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:34:21 smithi132 bash[27079]: cephadm 2020-07-16T16:34:20.359885+0000 mgr.x (mgr.34562) 8451 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:34:21.820 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:34:21 smithi132 bash[27079]: cephadm 2020-07-16T16:34:20.360304+0000 mgr.x (mgr.34562) 8452 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:34:21.960 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:34:21 smithi188 bash[23329]: cluster 2020-07-16T16:34:19.858077+0000 mgr.x (mgr.34562) 8450 : cluster [DBG] pgmap v5269: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:34:21.961 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:34:21 smithi188 bash[23329]: cephadm 2020-07-16T16:34:20.359885+0000 mgr.x (mgr.34562) 8451 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:34:21.961 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:34:21 smithi188 bash[23329]: cephadm 2020-07-16T16:34:20.360304+0000 mgr.x (mgr.34562) 8452 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:34:23.820 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:34:23 smithi132 bash[27079]: cluster 2020-07-16T16:34:21.858613+0000 mgr.x (mgr.34562) 8453 : cluster [DBG] pgmap v5270: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:34:23.961 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:34:23 smithi188 bash[23329]: cluster 2020-07-16T16:34:21.858613+0000 mgr.x (mgr.34562) 8453 : cluster [DBG] pgmap v5270: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:34:25.820 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:34:25 smithi132 bash[27079]: cluster 2020-07-16T16:34:23.858941+0000 mgr.x (mgr.34562) 8454 : cluster [DBG] pgmap v5271: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:34:25.962 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:34:25 smithi188 bash[23329]: cluster 2020-07-16T16:34:23.858941+0000 mgr.x (mgr.34562) 8454 : cluster [DBG] pgmap v5271: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:34:27.821 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:34:27 smithi132 bash[27079]: cluster 2020-07-16T16:34:25.859342+0000 mgr.x (mgr.34562) 8455 : cluster [DBG] pgmap v5272: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:34:27.962 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:34:27 smithi188 bash[23329]: cluster 2020-07-16T16:34:25.859342+0000 mgr.x (mgr.34562) 8455 : cluster [DBG] pgmap v5272: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:34:29.820 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:34:29 smithi132 bash[27079]: cluster 2020-07-16T16:34:27.859899+0000 mgr.x (mgr.34562) 8456 : cluster [DBG] pgmap v5273: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:34:29.962 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:34:29 smithi188 bash[23329]: cluster 2020-07-16T16:34:27.859899+0000 mgr.x (mgr.34562) 8456 : cluster [DBG] pgmap v5273: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:34:31.961 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:34:31 smithi188 bash[23329]: cluster 2020-07-16T16:34:29.860493+0000 mgr.x (mgr.34562) 8457 : cluster [DBG] pgmap v5274: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:34:32.070 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:34:31 smithi132 bash[27079]: cluster 2020-07-16T16:34:29.860493+0000 mgr.x (mgr.34562) 8457 : cluster [DBG] pgmap v5274: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:34:33.960 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:34:33 smithi188 bash[23329]: cluster 2020-07-16T16:34:31.860924+0000 mgr.x (mgr.34562) 8458 : cluster [DBG] pgmap v5275: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:34:34.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:34:33 smithi132 bash[27079]: cluster 2020-07-16T16:34:31.860924+0000 mgr.x (mgr.34562) 8458 : cluster [DBG] pgmap v5275: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:34:35.960 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:34:35 smithi188 bash[23329]: cluster 2020-07-16T16:34:33.861429+0000 mgr.x (mgr.34562) 8459 : cluster [DBG] pgmap v5276: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:34:35.960 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:34:35 smithi188 bash[23329]: audit 2020-07-16T16:34:35.375832+0000 mon.b (mon.2) 1783 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:34:36.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:34:35 smithi132 bash[27079]: cluster 2020-07-16T16:34:33.861429+0000 mgr.x (mgr.34562) 8459 : cluster [DBG] pgmap v5276: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:34:36.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:34:35 smithi132 bash[27079]: audit 2020-07-16T16:34:35.375832+0000 mon.b (mon.2) 1783 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:34:36.959 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:34:36 smithi188 bash[23329]: cephadm 2020-07-16T16:34:35.376569+0000 mgr.x (mgr.34562) 8460 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:34:36.960 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:34:36 smithi188 bash[23329]: cephadm 2020-07-16T16:34:35.376997+0000 mgr.x (mgr.34562) 8461 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:34:37.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:34:36 smithi132 bash[27079]: cephadm 2020-07-16T16:34:35.376569+0000 mgr.x (mgr.34562) 8460 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:34:37.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:34:36 smithi132 bash[27079]: cephadm 2020-07-16T16:34:35.376997+0000 mgr.x (mgr.34562) 8461 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:34:37.959 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:34:37 smithi188 bash[23329]: cluster 2020-07-16T16:34:35.861986+0000 mgr.x (mgr.34562) 8462 : cluster [DBG] pgmap v5277: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:34:38.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:34:37 smithi132 bash[27079]: cluster 2020-07-16T16:34:35.861986+0000 mgr.x (mgr.34562) 8462 : cluster [DBG] pgmap v5277: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:34:39.958 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:34:39 smithi188 bash[23329]: cluster 2020-07-16T16:34:37.862549+0000 mgr.x (mgr.34562) 8463 : cluster [DBG] pgmap v5278: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:34:40.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:34:39 smithi132 bash[27079]: cluster 2020-07-16T16:34:37.862549+0000 mgr.x (mgr.34562) 8463 : cluster [DBG] pgmap v5278: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:34:41.632 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:34:41.892 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:34:41.892 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 6m ago 3h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:34:41.892 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (3h) 6m ago 3h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:34:41.893 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 6m ago 3h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:34:41.893 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 6m ago 3h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:34:41.893 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 6m ago 3h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:34:41.894 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (3h) 6m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:34:41.894 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (3h) 6m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:34:41.894 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (3h) 6m ago 3h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:34:41.895 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (3h) 6m ago 3h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:34:41.895 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (3h) 6m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:34:41.895 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (3h) 6m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:34:41.896 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (3h) 6m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:34:41.896 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (3h) 6m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:34:41.896 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (3h) 6m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:34:41.897 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (3h) 6m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:34:41.897 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (3h) 6m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:34:41.897 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (3h) 6m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:34:41.898 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (2h) 6m ago 3h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:34:41.958 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:34:41 smithi188 bash[23329]: cluster 2020-07-16T16:34:39.862988+0000 mgr.x (mgr.34562) 8464 : cluster [DBG] pgmap v5279: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:34:42.066 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:34:41 smithi132 bash[27079]: cluster 2020-07-16T16:34:39.862988+0000 mgr.x (mgr.34562) 8464 : cluster [DBG] pgmap v5279: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:34:42.188 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:34:42.188 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:34:42.188 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:34:42.189 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:34:42.189 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:34:42.189 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:34:42.190 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:34:42.190 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:34:42.190 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:34:42.191 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:34:42.191 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:34:42.191 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:34:42.192 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:34:42.192 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:34:42.192 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:34:42.193 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:34:42.193 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:34:42.958 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:34:42 smithi188 bash[23329]: audit 2020-07-16T16:34:41.583253+0000 mgr.x (mgr.34562) 8465 : audit [DBG] from='client.30796 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:34:42.958 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:34:42 smithi188 bash[23329]: audit 2020-07-16T16:34:42.149710+0000 mon.c (mon.1) 559 : audit [DBG] from='client.? 172.21.15.132:0/2832977259' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:34:43.066 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:34:42 smithi132 bash[27079]: audit 2020-07-16T16:34:41.583253+0000 mgr.x (mgr.34562) 8465 : audit [DBG] from='client.30796 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:34:43.066 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:34:42 smithi132 bash[27079]: audit 2020-07-16T16:34:42.149710+0000 mon.c (mon.1) 559 : audit [DBG] from='client.? 172.21.15.132:0/2832977259' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:34:43.957 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:34:43 smithi188 bash[23329]: audit 2020-07-16T16:34:41.850042+0000 mgr.x (mgr.34562) 8466 : audit [DBG] from='client.30802 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:34:43.958 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:34:43 smithi188 bash[23329]: cluster 2020-07-16T16:34:41.863484+0000 mgr.x (mgr.34562) 8467 : cluster [DBG] pgmap v5280: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:34:44.066 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:34:43 smithi132 bash[27079]: audit 2020-07-16T16:34:41.850042+0000 mgr.x (mgr.34562) 8466 : audit [DBG] from='client.30802 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:34:44.066 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:34:43 smithi132 bash[27079]: cluster 2020-07-16T16:34:41.863484+0000 mgr.x (mgr.34562) 8467 : cluster [DBG] pgmap v5280: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:34:45.957 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:34:45 smithi188 bash[23329]: cluster 2020-07-16T16:34:43.863876+0000 mgr.x (mgr.34562) 8468 : cluster [DBG] pgmap v5281: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:34:46.065 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:34:45 smithi132 bash[27079]: cluster 2020-07-16T16:34:43.863876+0000 mgr.x (mgr.34562) 8468 : cluster [DBG] pgmap v5281: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:34:47.956 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:34:47 smithi188 bash[23329]: cluster 2020-07-16T16:34:45.864222+0000 mgr.x (mgr.34562) 8469 : cluster [DBG] pgmap v5282: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:34:48.064 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:34:47 smithi132 bash[27079]: cluster 2020-07-16T16:34:45.864222+0000 mgr.x (mgr.34562) 8469 : cluster [DBG] pgmap v5282: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:34:49.956 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:34:49 smithi188 bash[23329]: cluster 2020-07-16T16:34:47.864829+0000 mgr.x (mgr.34562) 8470 : cluster [DBG] pgmap v5283: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:34:50.064 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:34:49 smithi132 bash[27079]: cluster 2020-07-16T16:34:47.864829+0000 mgr.x (mgr.34562) 8470 : cluster [DBG] pgmap v5283: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:34:50.956 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:34:50 smithi188 bash[23329]: audit 2020-07-16T16:34:50.390724+0000 mon.b (mon.2) 1784 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:34:51.064 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:34:50 smithi132 bash[27079]: audit 2020-07-16T16:34:50.390724+0000 mon.b (mon.2) 1784 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:34:51.956 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:34:51 smithi188 bash[23329]: cluster 2020-07-16T16:34:49.865384+0000 mgr.x (mgr.34562) 8471 : cluster [DBG] pgmap v5284: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:34:51.956 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:34:51 smithi188 bash[23329]: cephadm 2020-07-16T16:34:50.391423+0000 mgr.x (mgr.34562) 8472 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:34:51.957 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:34:51 smithi188 bash[23329]: cephadm 2020-07-16T16:34:50.391822+0000 mgr.x (mgr.34562) 8473 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:34:52.064 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:34:51 smithi132 bash[27079]: cluster 2020-07-16T16:34:49.865384+0000 mgr.x (mgr.34562) 8471 : cluster [DBG] pgmap v5284: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:34:52.065 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:34:51 smithi132 bash[27079]: cephadm 2020-07-16T16:34:50.391423+0000 mgr.x (mgr.34562) 8472 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:34:52.065 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:34:51 smithi132 bash[27079]: cephadm 2020-07-16T16:34:50.391822+0000 mgr.x (mgr.34562) 8473 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:34:53.955 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:34:53 smithi188 bash[23329]: cluster 2020-07-16T16:34:51.865918+0000 mgr.x (mgr.34562) 8474 : cluster [DBG] pgmap v5285: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:34:54.063 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:34:53 smithi132 bash[27079]: cluster 2020-07-16T16:34:51.865918+0000 mgr.x (mgr.34562) 8474 : cluster [DBG] pgmap v5285: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:34:55.955 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:34:55 smithi188 bash[23329]: cluster 2020-07-16T16:34:53.866474+0000 mgr.x (mgr.34562) 8475 : cluster [DBG] pgmap v5286: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:34:56.063 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:34:55 smithi132 bash[27079]: cluster 2020-07-16T16:34:53.866474+0000 mgr.x (mgr.34562) 8475 : cluster [DBG] pgmap v5286: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:34:56.705 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 16:34:56 smithi188 bash[2065]: level=info ts=2020-07-16T16:34:56.390Z caller=compact.go:495 component=tsdb msg="write block" mint=1594906494667 maxt=1594908000000 ulid=01EDC7N67D77ZJ1C8379SZ088Z duration=24.338533ms 2020-07-16T16:34:56.705 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Jul 16 16:34:56 smithi188 bash[2065]: level=info ts=2020-07-16T16:34:56.396Z caller=head.go:792 component=tsdb msg="Head GC completed" duration=1.85874ms 2020-07-16T16:34:57.954 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:34:57 smithi188 bash[23329]: cluster 2020-07-16T16:34:55.866987+0000 mgr.x (mgr.34562) 8476 : cluster [DBG] pgmap v5287: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:34:58.063 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:34:57 smithi132 bash[27079]: cluster 2020-07-16T16:34:55.866987+0000 mgr.x (mgr.34562) 8476 : cluster [DBG] pgmap v5287: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:34:59.954 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:34:59 smithi188 bash[23329]: cluster 2020-07-16T16:34:57.867490+0000 mgr.x (mgr.34562) 8477 : cluster [DBG] pgmap v5288: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:35:00.062 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:34:59 smithi132 bash[27079]: cluster 2020-07-16T16:34:57.867490+0000 mgr.x (mgr.34562) 8477 : cluster [DBG] pgmap v5288: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:35:01.954 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:35:01 smithi188 bash[23329]: cluster 2020-07-16T16:34:59.867860+0000 mgr.x (mgr.34562) 8478 : cluster [DBG] pgmap v5289: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:35:02.062 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:35:01 smithi132 bash[27079]: cluster 2020-07-16T16:34:59.867860+0000 mgr.x (mgr.34562) 8478 : cluster [DBG] pgmap v5289: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:35:03.954 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:35:03 smithi188 bash[23329]: cluster 2020-07-16T16:35:01.868281+0000 mgr.x (mgr.34562) 8479 : cluster [DBG] pgmap v5290: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:35:04.062 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:35:03 smithi132 bash[27079]: cluster 2020-07-16T16:35:01.868281+0000 mgr.x (mgr.34562) 8479 : cluster [DBG] pgmap v5290: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:35:05.912 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:35:05 smithi132 bash[27079]: cluster 2020-07-16T16:35:03.868661+0000 mgr.x (mgr.34562) 8480 : cluster [DBG] pgmap v5291: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:35:05.913 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:35:05 smithi132 bash[27079]: audit 2020-07-16T16:35:05.409385+0000 mon.b (mon.2) 1785 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:35:05.913 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:35:05 smithi132 bash[27079]: audit 2020-07-16T16:35:05.410807+0000 mon.b (mon.2) 1786 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:35:05.914 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:35:05 smithi132 bash[27079]: audit 2020-07-16T16:35:05.412013+0000 mon.b (mon.2) 1787 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:35:05.914 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:35:05 smithi132 bash[27079]: audit 2020-07-16T16:35:05.413436+0000 mon.b (mon.2) 1788 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:35:05.915 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:35:05 smithi132 bash[27079]: audit 2020-07-16T16:35:05.414826+0000 mon.b (mon.2) 1789 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:35:05.953 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:35:05 smithi188 bash[23329]: cluster 2020-07-16T16:35:03.868661+0000 mgr.x (mgr.34562) 8480 : cluster [DBG] pgmap v5291: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:35:05.954 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:35:05 smithi188 bash[23329]: audit 2020-07-16T16:35:05.409385+0000 mon.b (mon.2) 1785 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:35:05.954 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:35:05 smithi188 bash[23329]: audit 2020-07-16T16:35:05.410807+0000 mon.b (mon.2) 1786 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:35:05.955 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:35:05 smithi188 bash[23329]: audit 2020-07-16T16:35:05.412013+0000 mon.b (mon.2) 1787 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:35:05.955 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:35:05 smithi188 bash[23329]: audit 2020-07-16T16:35:05.413436+0000 mon.b (mon.2) 1788 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:35:05.955 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:35:05 smithi188 bash[23329]: audit 2020-07-16T16:35:05.414826+0000 mon.b (mon.2) 1789 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:35:06.953 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:35:06 smithi188 bash[23329]: audit 2020-07-16T16:35:05.409808+0000 mgr.x (mgr.34562) 8481 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:35:06.954 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:35:06 smithi188 bash[23329]: audit 2020-07-16T16:35:05.411105+0000 mgr.x (mgr.34562) 8482 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:35:06.954 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:35:06 smithi188 bash[23329]: audit 2020-07-16T16:35:05.412337+0000 mgr.x (mgr.34562) 8483 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:35:06.955 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:35:06 smithi188 bash[23329]: cephadm 2020-07-16T16:35:05.413066+0000 mgr.x (mgr.34562) 8484 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:35:06.955 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:35:06 smithi188 bash[23329]: cephadm 2020-07-16T16:35:05.414296+0000 mgr.x (mgr.34562) 8485 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:35:06.955 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:35:06 smithi188 bash[23329]: cephadm 2020-07-16T16:35:05.415521+0000 mgr.x (mgr.34562) 8486 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:35:06.956 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:35:06 smithi188 bash[23329]: cephadm 2020-07-16T16:35:05.415820+0000 mgr.x (mgr.34562) 8487 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:35:07.062 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:35:06 smithi132 bash[27079]: audit 2020-07-16T16:35:05.409808+0000 mgr.x (mgr.34562) 8481 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:35:07.063 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:35:06 smithi132 bash[27079]: audit 2020-07-16T16:35:05.411105+0000 mgr.x (mgr.34562) 8482 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:35:07.064 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:35:06 smithi132 bash[27079]: audit 2020-07-16T16:35:05.412337+0000 mgr.x (mgr.34562) 8483 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:35:07.064 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:35:06 smithi132 bash[27079]: cephadm 2020-07-16T16:35:05.413066+0000 mgr.x (mgr.34562) 8484 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:35:07.065 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:35:06 smithi132 bash[27079]: cephadm 2020-07-16T16:35:05.414296+0000 mgr.x (mgr.34562) 8485 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:35:07.065 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:35:06 smithi132 bash[27079]: cephadm 2020-07-16T16:35:05.415521+0000 mgr.x (mgr.34562) 8486 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:35:07.066 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:35:06 smithi132 bash[27079]: cephadm 2020-07-16T16:35:05.415820+0000 mgr.x (mgr.34562) 8487 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:35:07.953 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:35:07 smithi188 bash[23329]: cluster 2020-07-16T16:35:05.869176+0000 mgr.x (mgr.34562) 8488 : cluster [DBG] pgmap v5292: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:35:08.061 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:35:07 smithi132 bash[27079]: cluster 2020-07-16T16:35:05.869176+0000 mgr.x (mgr.34562) 8488 : cluster [DBG] pgmap v5292: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:35:08.953 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:35:08 smithi188 bash[23329]: audit 2020-07-16T16:35:08.161608+0000 mon.b (mon.2) 1790 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:35:09.061 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:35:08 smithi132 bash[27079]: audit 2020-07-16T16:35:08.161608+0000 mon.b (mon.2) 1790 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:35:09.953 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:35:09 smithi188 bash[23329]: cluster 2020-07-16T16:35:07.869683+0000 mgr.x (mgr.34562) 8489 : cluster [DBG] pgmap v5293: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:35:09.954 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:35:09 smithi188 bash[23329]: cephadm 2020-07-16T16:35:08.162238+0000 mgr.x (mgr.34562) 8490 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:35:09.954 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:35:09 smithi188 bash[23329]: cephadm 2020-07-16T16:35:08.162670+0000 mgr.x (mgr.34562) 8491 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:35:10.061 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:35:09 smithi132 bash[27079]: cluster 2020-07-16T16:35:07.869683+0000 mgr.x (mgr.34562) 8489 : cluster [DBG] pgmap v5293: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:35:10.062 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:35:09 smithi132 bash[27079]: cephadm 2020-07-16T16:35:08.162238+0000 mgr.x (mgr.34562) 8490 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:35:10.062 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:35:09 smithi132 bash[27079]: cephadm 2020-07-16T16:35:08.162670+0000 mgr.x (mgr.34562) 8491 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:35:11.953 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:35:11 smithi188 bash[23329]: cluster 2020-07-16T16:35:09.870044+0000 mgr.x (mgr.34562) 8492 : cluster [DBG] pgmap v5294: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:35:12.061 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:35:11 smithi132 bash[27079]: cluster 2020-07-16T16:35:09.870044+0000 mgr.x (mgr.34562) 8492 : cluster [DBG] pgmap v5294: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:35:12.482 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:35:12.745 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:35:12.745 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 7m ago 3h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:35:12.746 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (3h) 7m ago 3h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:35:12.746 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 7m ago 3h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:35:12.747 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 7m ago 3h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:35:12.747 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 7m ago 3h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:35:12.747 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (3h) 7m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:35:12.747 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (3h) 7m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:35:12.748 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (3h) 7m ago 3h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:35:12.748 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (3h) 7m ago 3h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:35:12.748 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (3h) 7m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:35:12.749 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (3h) 7m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:35:12.749 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (3h) 7m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:35:12.749 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (3h) 7m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:35:12.750 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (3h) 7m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:35:12.750 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (3h) 7m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:35:12.750 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (3h) 7m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:35:12.751 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (3h) 7m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:35:12.751 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (3h) 7m ago 3h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:35:13.042 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:35:13.043 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:35:13.043 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:35:13.043 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:35:13.044 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:35:13.044 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:35:13.044 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:35:13.045 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:35:13.045 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:35:13.045 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:35:13.046 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:35:13.046 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:35:13.046 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:35:13.047 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:35:13.047 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:35:13.047 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:35:13.048 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:35:13.953 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:35:13 smithi188 bash[23329]: cluster 2020-07-16T16:35:11.870428+0000 mgr.x (mgr.34562) 8493 : cluster [DBG] pgmap v5295: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:35:13.953 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:35:13 smithi188 bash[23329]: audit 2020-07-16T16:35:12.437858+0000 mgr.x (mgr.34562) 8494 : audit [DBG] from='client.30814 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:35:13.954 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:35:13 smithi188 bash[23329]: audit 2020-07-16T16:35:12.708336+0000 mgr.x (mgr.34562) 8495 : audit [DBG] from='client.30820 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:35:13.954 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:35:13 smithi188 bash[23329]: audit 2020-07-16T16:35:13.008803+0000 mon.c (mon.1) 560 : audit [DBG] from='client.? 172.21.15.132:0/3721248808' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:35:14.062 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:35:13 smithi132 bash[27079]: cluster 2020-07-16T16:35:11.870428+0000 mgr.x (mgr.34562) 8493 : cluster [DBG] pgmap v5295: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:35:14.062 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:35:13 smithi132 bash[27079]: audit 2020-07-16T16:35:12.437858+0000 mgr.x (mgr.34562) 8494 : audit [DBG] from='client.30814 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:35:14.062 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:35:13 smithi132 bash[27079]: audit 2020-07-16T16:35:12.708336+0000 mgr.x (mgr.34562) 8495 : audit [DBG] from='client.30820 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:35:14.063 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:35:13 smithi132 bash[27079]: audit 2020-07-16T16:35:13.008803+0000 mon.c (mon.1) 560 : audit [DBG] from='client.? 172.21.15.132:0/3721248808' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:35:15.953 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:35:15 smithi188 bash[23329]: cluster 2020-07-16T16:35:13.870833+0000 mgr.x (mgr.34562) 8496 : cluster [DBG] pgmap v5296: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:35:16.061 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:35:15 smithi132 bash[27079]: cluster 2020-07-16T16:35:13.870833+0000 mgr.x (mgr.34562) 8496 : cluster [DBG] pgmap v5296: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:35:17.953 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:35:17 smithi188 bash[23329]: cluster 2020-07-16T16:35:15.871337+0000 mgr.x (mgr.34562) 8497 : cluster [DBG] pgmap v5297: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:35:18.061 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:35:17 smithi132 bash[27079]: cluster 2020-07-16T16:35:15.871337+0000 mgr.x (mgr.34562) 8497 : cluster [DBG] pgmap v5297: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:35:19.952 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:35:19 smithi188 bash[23329]: cluster 2020-07-16T16:35:17.871768+0000 mgr.x (mgr.34562) 8498 : cluster [DBG] pgmap v5298: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:35:20.061 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:35:19 smithi132 bash[27079]: cluster 2020-07-16T16:35:17.871768+0000 mgr.x (mgr.34562) 8498 : cluster [DBG] pgmap v5298: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:35:21.952 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:35:21 smithi188 bash[23329]: cluster 2020-07-16T16:35:19.872270+0000 mgr.x (mgr.34562) 8499 : cluster [DBG] pgmap v5299: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:35:22.061 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:35:21 smithi132 bash[27079]: cluster 2020-07-16T16:35:19.872270+0000 mgr.x (mgr.34562) 8499 : cluster [DBG] pgmap v5299: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:35:23.953 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:35:23 smithi188 bash[23329]: cluster 2020-07-16T16:35:21.872693+0000 mgr.x (mgr.34562) 8500 : cluster [DBG] pgmap v5300: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:35:23.953 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:35:23 smithi188 bash[23329]: audit 2020-07-16T16:35:23.177352+0000 mon.b (mon.2) 1791 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:35:24.061 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:35:23 smithi132 bash[27079]: cluster 2020-07-16T16:35:21.872693+0000 mgr.x (mgr.34562) 8500 : cluster [DBG] pgmap v5300: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:35:24.061 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:35:23 smithi132 bash[27079]: audit 2020-07-16T16:35:23.177352+0000 mon.b (mon.2) 1791 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:35:24.952 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:35:24 smithi188 bash[23329]: cephadm 2020-07-16T16:35:23.178078+0000 mgr.x (mgr.34562) 8501 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:35:24.953 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:35:24 smithi188 bash[23329]: cephadm 2020-07-16T16:35:23.178505+0000 mgr.x (mgr.34562) 8502 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:35:25.061 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:35:24 smithi132 bash[27079]: cephadm 2020-07-16T16:35:23.178078+0000 mgr.x (mgr.34562) 8501 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:35:25.061 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:35:24 smithi132 bash[27079]: cephadm 2020-07-16T16:35:23.178505+0000 mgr.x (mgr.34562) 8502 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:35:25.952 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:35:25 smithi188 bash[23329]: cluster 2020-07-16T16:35:23.873183+0000 mgr.x (mgr.34562) 8503 : cluster [DBG] pgmap v5301: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:35:26.060 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:35:25 smithi132 bash[27079]: cluster 2020-07-16T16:35:23.873183+0000 mgr.x (mgr.34562) 8503 : cluster [DBG] pgmap v5301: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:35:27.958 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:35:27 smithi188 bash[23329]: cluster 2020-07-16T16:35:25.873753+0000 mgr.x (mgr.34562) 8504 : cluster [DBG] pgmap v5302: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:35:28.061 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:35:27 smithi132 bash[27079]: cluster 2020-07-16T16:35:25.873753+0000 mgr.x (mgr.34562) 8504 : cluster [DBG] pgmap v5302: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:35:29.952 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:35:29 smithi188 bash[23329]: cluster 2020-07-16T16:35:27.874182+0000 mgr.x (mgr.34562) 8505 : cluster [DBG] pgmap v5303: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:35:30.060 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:35:29 smithi132 bash[27079]: cluster 2020-07-16T16:35:27.874182+0000 mgr.x (mgr.34562) 8505 : cluster [DBG] pgmap v5303: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:35:31.952 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:35:31 smithi188 bash[23329]: cluster 2020-07-16T16:35:29.874587+0000 mgr.x (mgr.34562) 8506 : cluster [DBG] pgmap v5304: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:35:32.060 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:35:31 smithi132 bash[27079]: cluster 2020-07-16T16:35:29.874587+0000 mgr.x (mgr.34562) 8506 : cluster [DBG] pgmap v5304: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:35:33.953 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:35:33 smithi188 bash[23329]: cluster 2020-07-16T16:35:31.874980+0000 mgr.x (mgr.34562) 8507 : cluster [DBG] pgmap v5305: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:35:34.061 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:35:33 smithi132 bash[27079]: cluster 2020-07-16T16:35:31.874980+0000 mgr.x (mgr.34562) 8507 : cluster [DBG] pgmap v5305: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:35:35.953 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:35:35 smithi188 bash[23329]: cluster 2020-07-16T16:35:33.875442+0000 mgr.x (mgr.34562) 8508 : cluster [DBG] pgmap v5306: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:35:36.061 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:35:35 smithi132 bash[27079]: cluster 2020-07-16T16:35:33.875442+0000 mgr.x (mgr.34562) 8508 : cluster [DBG] pgmap v5306: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:35:37.952 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:35:37 smithi188 bash[23329]: cluster 2020-07-16T16:35:35.875929+0000 mgr.x (mgr.34562) 8509 : cluster [DBG] pgmap v5307: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:35:38.061 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:35:37 smithi132 bash[27079]: cluster 2020-07-16T16:35:35.875929+0000 mgr.x (mgr.34562) 8509 : cluster [DBG] pgmap v5307: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:35:38.952 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:35:38 smithi188 bash[23329]: audit 2020-07-16T16:35:38.182907+0000 mon.b (mon.2) 1792 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:35:39.061 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:35:38 smithi132 bash[27079]: audit 2020-07-16T16:35:38.182907+0000 mon.b (mon.2) 1792 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:35:39.954 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:35:39 smithi188 bash[23329]: cluster 2020-07-16T16:35:37.876437+0000 mgr.x (mgr.34562) 8510 : cluster [DBG] pgmap v5308: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:35:39.955 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:35:39 smithi188 bash[23329]: cephadm 2020-07-16T16:35:38.183648+0000 mgr.x (mgr.34562) 8511 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:35:39.955 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:35:39 smithi188 bash[23329]: cephadm 2020-07-16T16:35:38.183739+0000 mgr.x (mgr.34562) 8512 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:35:40.061 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:35:39 smithi132 bash[27079]: cluster 2020-07-16T16:35:37.876437+0000 mgr.x (mgr.34562) 8510 : cluster [DBG] pgmap v5308: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:35:40.062 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:35:39 smithi132 bash[27079]: cephadm 2020-07-16T16:35:38.183648+0000 mgr.x (mgr.34562) 8511 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:35:40.062 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:35:39 smithi132 bash[27079]: cephadm 2020-07-16T16:35:38.183739+0000 mgr.x (mgr.34562) 8512 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:35:42.061 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:35:41 smithi132 bash[27079]: cluster 2020-07-16T16:35:39.876880+0000 mgr.x (mgr.34562) 8513 : cluster [DBG] pgmap v5309: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:35:42.203 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:35:41 smithi188 bash[23329]: cluster 2020-07-16T16:35:39.876880+0000 mgr.x (mgr.34562) 8513 : cluster [DBG] pgmap v5309: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:35:43.340 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:35:43.601 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:35:43.602 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 7m ago 3h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:35:43.602 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (3h) 7m ago 3h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:35:43.602 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 7m ago 3h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:35:43.603 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 7m ago 3h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:35:43.603 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 7m ago 3h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:35:43.603 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (3h) 7m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:35:43.604 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (3h) 7m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:35:43.604 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (3h) 7m ago 3h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:35:43.604 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (3h) 7m ago 3h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:35:43.605 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (3h) 7m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:35:43.605 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (3h) 7m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:35:43.605 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (3h) 7m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:35:43.606 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (3h) 7m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:35:43.606 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (3h) 7m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:35:43.606 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (3h) 7m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:35:43.607 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (3h) 7m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:35:43.607 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (3h) 7m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:35:43.608 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (3h) 7m ago 3h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:35:43.901 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:35:43.901 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:35:43.902 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:35:43.902 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:35:43.903 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:35:43.903 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:35:43.904 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:35:43.904 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:35:43.905 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:35:43.905 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:35:43.905 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:35:43.906 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:35:43.906 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:35:43.907 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:35:43.907 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:35:43.907 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:35:43.908 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:35:44.061 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:35:43 smithi132 bash[27079]: cluster 2020-07-16T16:35:41.877432+0000 mgr.x (mgr.34562) 8514 : cluster [DBG] pgmap v5310: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:35:44.203 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:35:43 smithi188 bash[23329]: cluster 2020-07-16T16:35:41.877432+0000 mgr.x (mgr.34562) 8514 : cluster [DBG] pgmap v5310: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:35:45.061 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:35:44 smithi132 bash[27079]: audit 2020-07-16T16:35:43.296357+0000 mgr.x (mgr.34562) 8515 : audit [DBG] from='client.30832 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:35:45.062 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:35:44 smithi132 bash[27079]: audit 2020-07-16T16:35:43.564274+0000 mgr.x (mgr.34562) 8516 : audit [DBG] from='client.30838 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:35:45.062 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:35:44 smithi132 bash[27079]: audit 2020-07-16T16:35:43.867274+0000 mon.c (mon.1) 561 : audit [DBG] from='client.? 172.21.15.132:0/1693648761' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:35:45.203 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:35:44 smithi188 bash[23329]: audit 2020-07-16T16:35:43.296357+0000 mgr.x (mgr.34562) 8515 : audit [DBG] from='client.30832 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:35:45.204 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:35:44 smithi188 bash[23329]: audit 2020-07-16T16:35:43.564274+0000 mgr.x (mgr.34562) 8516 : audit [DBG] from='client.30838 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:35:45.204 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:35:44 smithi188 bash[23329]: audit 2020-07-16T16:35:43.867274+0000 mon.c (mon.1) 561 : audit [DBG] from='client.? 172.21.15.132:0/1693648761' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:35:46.061 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:35:45 smithi132 bash[27079]: cluster 2020-07-16T16:35:43.877851+0000 mgr.x (mgr.34562) 8517 : cluster [DBG] pgmap v5311: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:35:46.203 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:35:45 smithi188 bash[23329]: cluster 2020-07-16T16:35:43.877851+0000 mgr.x (mgr.34562) 8517 : cluster [DBG] pgmap v5311: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:35:48.061 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:35:47 smithi132 bash[27079]: cluster 2020-07-16T16:35:45.878203+0000 mgr.x (mgr.34562) 8518 : cluster [DBG] pgmap v5312: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:35:48.203 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:35:47 smithi188 bash[23329]: cluster 2020-07-16T16:35:45.878203+0000 mgr.x (mgr.34562) 8518 : cluster [DBG] pgmap v5312: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:35:50.062 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:35:49 smithi132 bash[27079]: cluster 2020-07-16T16:35:47.878598+0000 mgr.x (mgr.34562) 8519 : cluster [DBG] pgmap v5313: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:35:50.203 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:35:49 smithi188 bash[23329]: cluster 2020-07-16T16:35:47.878598+0000 mgr.x (mgr.34562) 8519 : cluster [DBG] pgmap v5313: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:35:52.066 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:35:51 smithi132 bash[27079]: cluster 2020-07-16T16:35:49.879011+0000 mgr.x (mgr.34562) 8520 : cluster [DBG] pgmap v5314: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:35:52.203 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:35:51 smithi188 bash[23329]: cluster 2020-07-16T16:35:49.879011+0000 mgr.x (mgr.34562) 8520 : cluster [DBG] pgmap v5314: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:35:54.062 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:35:53 smithi132 bash[27079]: cluster 2020-07-16T16:35:51.879366+0000 mgr.x (mgr.34562) 8521 : cluster [DBG] pgmap v5315: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:35:54.063 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:35:53 smithi132 bash[27079]: audit 2020-07-16T16:35:53.184778+0000 mon.b (mon.2) 1793 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:35:54.203 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:35:53 smithi188 bash[23329]: cluster 2020-07-16T16:35:51.879366+0000 mgr.x (mgr.34562) 8521 : cluster [DBG] pgmap v5315: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:35:54.204 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:35:53 smithi188 bash[23329]: audit 2020-07-16T16:35:53.184778+0000 mon.b (mon.2) 1793 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:35:55.062 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:35:54 smithi132 bash[27079]: cephadm 2020-07-16T16:35:53.185521+0000 mgr.x (mgr.34562) 8522 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:35:55.062 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:35:54 smithi132 bash[27079]: cephadm 2020-07-16T16:35:53.185912+0000 mgr.x (mgr.34562) 8523 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:35:55.204 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:35:54 smithi188 bash[23329]: cephadm 2020-07-16T16:35:53.185521+0000 mgr.x (mgr.34562) 8522 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:35:55.204 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:35:54 smithi188 bash[23329]: cephadm 2020-07-16T16:35:53.185912+0000 mgr.x (mgr.34562) 8523 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:35:56.062 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:35:55 smithi132 bash[27079]: cluster 2020-07-16T16:35:53.879825+0000 mgr.x (mgr.34562) 8524 : cluster [DBG] pgmap v5316: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:35:56.204 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:35:55 smithi188 bash[23329]: cluster 2020-07-16T16:35:53.879825+0000 mgr.x (mgr.34562) 8524 : cluster [DBG] pgmap v5316: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:35:58.062 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:35:57 smithi132 bash[27079]: cluster 2020-07-16T16:35:55.880346+0000 mgr.x (mgr.34562) 8525 : cluster [DBG] pgmap v5317: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:35:58.208 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:35:57 smithi188 bash[23329]: cluster 2020-07-16T16:35:55.880346+0000 mgr.x (mgr.34562) 8525 : cluster [DBG] pgmap v5317: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:36:00.062 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:35:59 smithi132 bash[27079]: cluster 2020-07-16T16:35:57.880885+0000 mgr.x (mgr.34562) 8526 : cluster [DBG] pgmap v5318: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:36:00.204 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:35:59 smithi188 bash[23329]: cluster 2020-07-16T16:35:57.880885+0000 mgr.x (mgr.34562) 8526 : cluster [DBG] pgmap v5318: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:36:02.063 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:36:01 smithi132 bash[27079]: cluster 2020-07-16T16:35:59.881392+0000 mgr.x (mgr.34562) 8527 : cluster [DBG] pgmap v5319: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:36:02.204 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:36:01 smithi188 bash[23329]: cluster 2020-07-16T16:35:59.881392+0000 mgr.x (mgr.34562) 8527 : cluster [DBG] pgmap v5319: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:36:04.063 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:36:03 smithi132 bash[27079]: cluster 2020-07-16T16:36:01.881923+0000 mgr.x (mgr.34562) 8528 : cluster [DBG] pgmap v5320: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:36:04.205 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:36:03 smithi188 bash[23329]: cluster 2020-07-16T16:36:01.881923+0000 mgr.x (mgr.34562) 8528 : cluster [DBG] pgmap v5320: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:36:06.063 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:36:05 smithi132 bash[27079]: cluster 2020-07-16T16:36:03.882333+0000 mgr.x (mgr.34562) 8529 : cluster [DBG] pgmap v5321: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:36:06.205 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:36:05 smithi188 bash[23329]: cluster 2020-07-16T16:36:03.882333+0000 mgr.x (mgr.34562) 8529 : cluster [DBG] pgmap v5321: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:36:08.063 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:36:07 smithi132 bash[27079]: cluster 2020-07-16T16:36:05.882657+0000 mgr.x (mgr.34562) 8530 : cluster [DBG] pgmap v5322: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:36:08.205 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:36:07 smithi188 bash[23329]: cluster 2020-07-16T16:36:05.882657+0000 mgr.x (mgr.34562) 8530 : cluster [DBG] pgmap v5322: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:36:09.053 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:36:08 smithi132 bash[27079]: audit 2020-07-16T16:36:08.201985+0000 mon.b (mon.2) 1794 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T16:36:09.205 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:36:08 smithi188 bash[23329]: audit 2020-07-16T16:36:08.201985+0000 mon.b (mon.2) 1794 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T16:36:09.929 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:36:09 smithi132 bash[27079]: cluster 2020-07-16T16:36:07.883065+0000 mgr.x (mgr.34562) 8531 : cluster [DBG] pgmap v5323: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:36:10.205 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:36:09 smithi188 bash[23329]: cluster 2020-07-16T16:36:07.883065+0000 mgr.x (mgr.34562) 8531 : cluster [DBG] pgmap v5323: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:36:11.064 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:36:10 smithi132 bash[27079]: cluster 2020-07-16T16:36:09.883444+0000 mgr.x (mgr.34562) 8532 : cluster [DBG] pgmap v5324: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:36:11.205 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:36:10 smithi188 bash[23329]: cluster 2020-07-16T16:36:09.883444+0000 mgr.x (mgr.34562) 8532 : cluster [DBG] pgmap v5324: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:36:12.109 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:36:11 smithi188 bash[23329]: audit 2020-07-16T16:36:11.130616+0000 mon.b (mon.2) 1795 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T16:36:12.110 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:36:11 smithi188 bash[23329]: audit 2020-07-16T16:36:11.337292+0000 mon.b (mon.2) 1796 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T16:27:44.811366\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811424\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811460\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811490\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811652\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811759\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811862\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811962\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811996\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T16:27:44.812067\", \"last_device_update\": \"2020-07-16T16:36:11.336233\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T16:29:51.014515\"}"}]: dispatch 2020-07-16T16:36:12.110 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:36:11 smithi188 bash[23329]: audit 2020-07-16T16:36:11.337800+0000 mon.c (mon.1) 562 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T16:27:44.811366\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811424\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811460\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811490\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811652\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811759\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811862\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811962\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811996\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T16:27:44.812067\", \"last_device_update\": \"2020-07-16T16:36:11.336233\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T16:29:51.014515\"}"}]: dispatch 2020-07-16T16:36:12.110 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:36:11 smithi188 bash[23329]: audit 2020-07-16T16:36:11.340562+0000 mon.c (mon.1) 563 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T16:27:44.811366\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811424\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811460\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811490\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811652\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811759\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811862\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811962\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811996\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T16:27:44.812067\", \"last_device_update\": \"2020-07-16T16:36:11.336233\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T16:29:51.014515\"}"}]': finished 2020-07-16T16:36:12.111 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:36:11 smithi188 bash[23329]: audit 2020-07-16T16:36:11.343867+0000 mon.b (mon.2) 1797 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:36:12.118 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:36:11 smithi188 bash[23329]: audit 2020-07-16T16:36:11.344308+0000 mgr.x (mgr.34562) 8533 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:36:12.118 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:36:11 smithi188 bash[23329]: audit 2020-07-16T16:36:11.346520+0000 mon.b (mon.2) 1798 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:36:12.118 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:36:11 smithi188 bash[23329]: audit 2020-07-16T16:36:11.347051+0000 mgr.x (mgr.34562) 8534 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:36:12.119 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:36:11 smithi188 bash[23329]: audit 2020-07-16T16:36:11.348076+0000 mon.b (mon.2) 1799 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:36:12.119 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:36:11 smithi188 bash[23329]: audit 2020-07-16T16:36:11.348463+0000 mgr.x (mgr.34562) 8535 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:36:12.119 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:36:11 smithi188 bash[23329]: cephadm 2020-07-16T16:36:11.349418+0000 mgr.x (mgr.34562) 8536 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:36:12.120 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:36:11 smithi188 bash[23329]: audit 2020-07-16T16:36:11.349811+0000 mon.b (mon.2) 1800 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:36:12.120 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:36:11 smithi188 bash[23329]: cephadm 2020-07-16T16:36:11.350678+0000 mgr.x (mgr.34562) 8537 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:36:12.120 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:36:11 smithi188 bash[23329]: audit 2020-07-16T16:36:11.350958+0000 mon.b (mon.2) 1801 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:36:12.121 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:36:11 smithi188 bash[23329]: cephadm 2020-07-16T16:36:11.351724+0000 mgr.x (mgr.34562) 8538 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:36:12.121 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:36:11 smithi188 bash[23329]: cephadm 2020-07-16T16:36:11.352004+0000 mgr.x (mgr.34562) 8539 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:36:12.179 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:36:11 smithi132 bash[27079]: audit 2020-07-16T16:36:11.130616+0000 mon.b (mon.2) 1795 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T16:36:12.180 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:36:11 smithi132 bash[27079]: audit 2020-07-16T16:36:11.337292+0000 mon.b (mon.2) 1796 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T16:27:44.811366\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811424\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811460\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811490\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811652\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811759\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811862\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811962\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811996\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T16:27:44.812067\", \"last_device_update\": \"2020-07-16T16:36:11.336233\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T16:29:51.014515\"}"}]: dispatch 2020-07-16T16:36:12.180 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:36:11 smithi132 bash[27079]: audit 2020-07-16T16:36:11.337800+0000 mon.c (mon.1) 562 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T16:27:44.811366\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811424\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811460\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811490\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811652\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811759\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811862\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811962\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811996\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T16:27:44.812067\", \"last_device_update\": \"2020-07-16T16:36:11.336233\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T16:29:51.014515\"}"}]: dispatch 2020-07-16T16:36:12.180 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:36:11 smithi132 bash[27079]: audit 2020-07-16T16:36:11.340562+0000 mon.c (mon.1) 563 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T16:27:44.811366\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811424\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811460\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811490\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811652\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811759\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811862\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811962\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:44.811996\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T16:27:44.812067\", \"last_device_update\": \"2020-07-16T16:36:11.336233\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T16:29:51.014515\"}"}]': finished 2020-07-16T16:36:12.181 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:36:11 smithi132 bash[27079]: audit 2020-07-16T16:36:11.343867+0000 mon.b (mon.2) 1797 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:36:12.181 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:36:11 smithi132 bash[27079]: audit 2020-07-16T16:36:11.344308+0000 mgr.x (mgr.34562) 8533 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:36:12.182 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:36:11 smithi132 bash[27079]: audit 2020-07-16T16:36:11.346520+0000 mon.b (mon.2) 1798 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:36:12.182 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:36:11 smithi132 bash[27079]: audit 2020-07-16T16:36:11.347051+0000 mgr.x (mgr.34562) 8534 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:36:12.182 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:36:11 smithi132 bash[27079]: audit 2020-07-16T16:36:11.348076+0000 mon.b (mon.2) 1799 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:36:12.182 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:36:11 smithi132 bash[27079]: audit 2020-07-16T16:36:11.348463+0000 mgr.x (mgr.34562) 8535 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:36:12.183 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:36:11 smithi132 bash[27079]: cephadm 2020-07-16T16:36:11.349418+0000 mgr.x (mgr.34562) 8536 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:36:12.183 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:36:11 smithi132 bash[27079]: audit 2020-07-16T16:36:11.349811+0000 mon.b (mon.2) 1800 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:36:12.183 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:36:11 smithi132 bash[27079]: cephadm 2020-07-16T16:36:11.350678+0000 mgr.x (mgr.34562) 8537 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:36:12.184 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:36:11 smithi132 bash[27079]: audit 2020-07-16T16:36:11.350958+0000 mon.b (mon.2) 1801 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:36:12.184 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:36:11 smithi132 bash[27079]: cephadm 2020-07-16T16:36:11.351724+0000 mgr.x (mgr.34562) 8538 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:36:12.184 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:36:11 smithi132 bash[27079]: cephadm 2020-07-16T16:36:11.352004+0000 mgr.x (mgr.34562) 8539 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:36:13.071 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:36:12 smithi132 bash[27079]: cluster 2020-07-16T16:36:11.883853+0000 mgr.x (mgr.34562) 8540 : cluster [DBG] pgmap v5325: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:36:13.206 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:36:12 smithi188 bash[23329]: cluster 2020-07-16T16:36:11.883853+0000 mgr.x (mgr.34562) 8540 : cluster [DBG] pgmap v5325: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:36:14.201 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:36:14.460 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:36:14.461 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 8m ago 3h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:36:14.461 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (3h) 8m ago 3h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:36:14.461 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 8m ago 3h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:36:14.462 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 8m ago 3h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:36:14.462 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 8m ago 3h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:36:14.462 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (3h) 8m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:36:14.463 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (3h) 8m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:36:14.463 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (3h) 8m ago 3h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:36:14.463 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (3h) 8m ago 3h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:36:14.464 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (3h) 8m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:36:14.464 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (3h) 8m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:36:14.464 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (3h) 8m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:36:14.465 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (3h) 8m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:36:14.465 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (3h) 8m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:36:14.465 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (3h) 8m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:36:14.465 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (3h) 8m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:36:14.466 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (3h) 8m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:36:14.466 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (3h) 8m ago 3h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:36:14.758 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:36:14.759 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:36:14.759 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:36:14.759 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:36:14.760 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:36:14.760 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:36:14.760 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:36:14.761 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:36:14.761 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:36:14.761 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:36:14.762 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:36:14.762 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:36:14.762 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:36:14.762 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:36:14.763 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:36:14.763 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:36:14.763 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:36:15.314 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:36:14 smithi132 bash[27079]: cluster 2020-07-16T16:36:13.884351+0000 mgr.x (mgr.34562) 8541 : cluster [DBG] pgmap v5326: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:36:15.315 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:36:14 smithi132 bash[27079]: audit 2020-07-16T16:36:14.074086+0000 mon.b (mon.2) 1802 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:36:15.315 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:36:14 smithi132 bash[27079]: cephadm 2020-07-16T16:36:14.074717+0000 mgr.x (mgr.34562) 8542 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:36:15.315 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:36:14 smithi132 bash[27079]: cephadm 2020-07-16T16:36:14.074837+0000 mgr.x (mgr.34562) 8543 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:36:15.316 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:36:14 smithi132 bash[27079]: audit 2020-07-16T16:36:14.153463+0000 mgr.x (mgr.34562) 8544 : audit [DBG] from='client.30850 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:36:15.316 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:36:14 smithi132 bash[27079]: audit 2020-07-16T16:36:14.420314+0000 mgr.x (mgr.34562) 8545 : audit [DBG] from='client.30856 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:36:15.316 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:36:14 smithi132 bash[27079]: audit 2020-07-16T16:36:14.722061+0000 mon.c (mon.1) 564 : audit [DBG] from='client.? 172.21.15.132:0/924076506' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:36:15.456 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:36:14 smithi188 bash[23329]: cluster 2020-07-16T16:36:13.884351+0000 mgr.x (mgr.34562) 8541 : cluster [DBG] pgmap v5326: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:36:15.457 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:36:14 smithi188 bash[23329]: audit 2020-07-16T16:36:14.074086+0000 mon.b (mon.2) 1802 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:36:15.457 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:36:14 smithi188 bash[23329]: cephadm 2020-07-16T16:36:14.074717+0000 mgr.x (mgr.34562) 8542 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:36:15.457 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:36:14 smithi188 bash[23329]: cephadm 2020-07-16T16:36:14.074837+0000 mgr.x (mgr.34562) 8543 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:36:15.458 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:36:14 smithi188 bash[23329]: audit 2020-07-16T16:36:14.153463+0000 mgr.x (mgr.34562) 8544 : audit [DBG] from='client.30850 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:36:15.458 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:36:14 smithi188 bash[23329]: audit 2020-07-16T16:36:14.420314+0000 mgr.x (mgr.34562) 8545 : audit [DBG] from='client.30856 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:36:15.458 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:36:14 smithi188 bash[23329]: audit 2020-07-16T16:36:14.722061+0000 mon.c (mon.1) 564 : audit [DBG] from='client.? 172.21.15.132:0/924076506' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:36:17.706 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:36:17 smithi188 bash[23329]: cluster 2020-07-16T16:36:15.884845+0000 mgr.x (mgr.34562) 8546 : cluster [DBG] pgmap v5327: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:36:17.815 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:36:17 smithi132 bash[27079]: cluster 2020-07-16T16:36:15.884845+0000 mgr.x (mgr.34562) 8546 : cluster [DBG] pgmap v5327: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:36:19.707 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:36:19 smithi188 bash[23329]: cluster 2020-07-16T16:36:17.885442+0000 mgr.x (mgr.34562) 8547 : cluster [DBG] pgmap v5328: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:36:19.815 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:36:19 smithi132 bash[27079]: cluster 2020-07-16T16:36:17.885442+0000 mgr.x (mgr.34562) 8547 : cluster [DBG] pgmap v5328: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:36:21.707 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:36:21 smithi188 bash[23329]: cluster 2020-07-16T16:36:19.885843+0000 mgr.x (mgr.34562) 8548 : cluster [DBG] pgmap v5329: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:36:21.815 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:36:21 smithi132 bash[27079]: cluster 2020-07-16T16:36:19.885843+0000 mgr.x (mgr.34562) 8548 : cluster [DBG] pgmap v5329: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:36:23.707 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:36:23 smithi188 bash[23329]: cluster 2020-07-16T16:36:21.886205+0000 mgr.x (mgr.34562) 8549 : cluster [DBG] pgmap v5330: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:36:23.815 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:36:23 smithi132 bash[27079]: cluster 2020-07-16T16:36:21.886205+0000 mgr.x (mgr.34562) 8549 : cluster [DBG] pgmap v5330: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:36:25.708 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:36:25 smithi188 bash[23329]: cluster 2020-07-16T16:36:23.886621+0000 mgr.x (mgr.34562) 8550 : cluster [DBG] pgmap v5331: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:36:25.816 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:36:25 smithi132 bash[27079]: cluster 2020-07-16T16:36:23.886621+0000 mgr.x (mgr.34562) 8550 : cluster [DBG] pgmap v5331: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:36:27.708 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:36:27 smithi188 bash[23329]: cluster 2020-07-16T16:36:25.887093+0000 mgr.x (mgr.34562) 8551 : cluster [DBG] pgmap v5332: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:36:27.816 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:36:27 smithi132 bash[27079]: cluster 2020-07-16T16:36:25.887093+0000 mgr.x (mgr.34562) 8551 : cluster [DBG] pgmap v5332: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:36:29.708 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:36:29 smithi188 bash[23329]: cluster 2020-07-16T16:36:27.887590+0000 mgr.x (mgr.34562) 8552 : cluster [DBG] pgmap v5333: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:36:29.709 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:36:29 smithi188 bash[23329]: audit 2020-07-16T16:36:29.080345+0000 mon.b (mon.2) 1803 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:36:29.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:36:29 smithi132 bash[27079]: cluster 2020-07-16T16:36:27.887590+0000 mgr.x (mgr.34562) 8552 : cluster [DBG] pgmap v5333: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:36:29.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:36:29 smithi132 bash[27079]: audit 2020-07-16T16:36:29.080345+0000 mon.b (mon.2) 1803 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:36:30.708 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:36:30 smithi188 bash[23329]: cephadm 2020-07-16T16:36:29.081046+0000 mgr.x (mgr.34562) 8553 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:36:30.709 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:36:30 smithi188 bash[23329]: cephadm 2020-07-16T16:36:29.081278+0000 mgr.x (mgr.34562) 8554 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:36:30.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:36:30 smithi132 bash[27079]: cephadm 2020-07-16T16:36:29.081046+0000 mgr.x (mgr.34562) 8553 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:36:30.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:36:30 smithi132 bash[27079]: cephadm 2020-07-16T16:36:29.081278+0000 mgr.x (mgr.34562) 8554 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:36:31.708 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:36:31 smithi188 bash[23329]: cluster 2020-07-16T16:36:29.888033+0000 mgr.x (mgr.34562) 8555 : cluster [DBG] pgmap v5334: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:36:31.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:36:31 smithi132 bash[27079]: cluster 2020-07-16T16:36:29.888033+0000 mgr.x (mgr.34562) 8555 : cluster [DBG] pgmap v5334: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:36:33.709 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:36:33 smithi188 bash[23329]: cluster 2020-07-16T16:36:31.888581+0000 mgr.x (mgr.34562) 8556 : cluster [DBG] pgmap v5335: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:36:33.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:36:33 smithi132 bash[27079]: cluster 2020-07-16T16:36:31.888581+0000 mgr.x (mgr.34562) 8556 : cluster [DBG] pgmap v5335: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:36:35.709 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:36:35 smithi188 bash[23329]: cluster 2020-07-16T16:36:33.888938+0000 mgr.x (mgr.34562) 8557 : cluster [DBG] pgmap v5336: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:36:35.817 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:36:35 smithi132 bash[27079]: cluster 2020-07-16T16:36:33.888938+0000 mgr.x (mgr.34562) 8557 : cluster [DBG] pgmap v5336: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:36:37.710 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:36:37 smithi188 bash[23329]: cluster 2020-07-16T16:36:35.889325+0000 mgr.x (mgr.34562) 8558 : cluster [DBG] pgmap v5337: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:36:37.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:36:37 smithi132 bash[27079]: cluster 2020-07-16T16:36:35.889325+0000 mgr.x (mgr.34562) 8558 : cluster [DBG] pgmap v5337: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:36:39.710 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:36:39 smithi188 bash[23329]: cluster 2020-07-16T16:36:37.889814+0000 mgr.x (mgr.34562) 8559 : cluster [DBG] pgmap v5338: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:36:39.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:36:39 smithi132 bash[27079]: cluster 2020-07-16T16:36:37.889814+0000 mgr.x (mgr.34562) 8559 : cluster [DBG] pgmap v5338: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:36:41.710 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:36:41 smithi188 bash[23329]: cluster 2020-07-16T16:36:39.890343+0000 mgr.x (mgr.34562) 8560 : cluster [DBG] pgmap v5339: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:36:41.818 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:36:41 smithi132 bash[27079]: cluster 2020-07-16T16:36:39.890343+0000 mgr.x (mgr.34562) 8560 : cluster [DBG] pgmap v5339: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:36:43.710 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:36:43 smithi188 bash[23329]: cluster 2020-07-16T16:36:41.890694+0000 mgr.x (mgr.34562) 8561 : cluster [DBG] pgmap v5340: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:36:43.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:36:43 smithi132 bash[27079]: cluster 2020-07-16T16:36:41.890694+0000 mgr.x (mgr.34562) 8561 : cluster [DBG] pgmap v5340: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:36:44.711 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:36:44 smithi188 bash[23329]: audit 2020-07-16T16:36:44.096951+0000 mon.b (mon.2) 1804 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:36:44.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:36:44 smithi132 bash[27079]: audit 2020-07-16T16:36:44.096951+0000 mon.b (mon.2) 1804 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:36:45.071 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:36:45.330 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:36:45.330 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (2h) 9m ago 3h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:36:45.330 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (3h) 9m ago 3h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:36:45.331 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (2h) 9m ago 3h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:36:45.331 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 9m ago 3h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:36:45.331 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 9m ago 3h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:36:45.332 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (3h) 9m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:36:45.332 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (3h) 9m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:36:45.332 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (3h) 9m ago 3h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:36:45.333 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (3h) 9m ago 3h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:36:45.333 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (3h) 9m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:36:45.333 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (3h) 9m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:36:45.334 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (3h) 9m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:36:45.334 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (3h) 9m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:36:45.334 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (3h) 9m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:36:45.334 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (3h) 9m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:36:45.335 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (3h) 9m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:36:45.335 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (3h) 9m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:36:45.335 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (3h) 9m ago 3h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:36:45.628 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:36:45.628 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:36:45.629 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:36:45.629 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:36:45.629 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:36:45.630 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:36:45.630 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:36:45.630 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:36:45.630 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:36:45.631 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:36:45.631 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:36:45.631 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:36:45.632 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:36:45.632 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:36:45.632 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:36:45.633 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:36:45.633 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:36:45.711 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:36:45 smithi188 bash[23329]: cluster 2020-07-16T16:36:43.891095+0000 mgr.x (mgr.34562) 8562 : cluster [DBG] pgmap v5341: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:36:45.711 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:36:45 smithi188 bash[23329]: cephadm 2020-07-16T16:36:44.097752+0000 mgr.x (mgr.34562) 8563 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:36:45.712 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:36:45 smithi188 bash[23329]: cephadm 2020-07-16T16:36:44.098173+0000 mgr.x (mgr.34562) 8564 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:36:45.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:36:45 smithi132 bash[27079]: cluster 2020-07-16T16:36:43.891095+0000 mgr.x (mgr.34562) 8562 : cluster [DBG] pgmap v5341: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:36:45.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:36:45 smithi132 bash[27079]: cephadm 2020-07-16T16:36:44.097752+0000 mgr.x (mgr.34562) 8563 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:36:45.820 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:36:45 smithi132 bash[27079]: cephadm 2020-07-16T16:36:44.098173+0000 mgr.x (mgr.34562) 8564 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:36:46.711 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:36:46 smithi188 bash[23329]: audit 2020-07-16T16:36:45.019090+0000 mgr.x (mgr.34562) 8565 : audit [DBG] from='client.30868 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:36:46.712 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:36:46 smithi188 bash[23329]: audit 2020-07-16T16:36:45.285018+0000 mgr.x (mgr.34562) 8566 : audit [DBG] from='client.30874 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:36:46.712 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:36:46 smithi188 bash[23329]: audit 2020-07-16T16:36:45.586606+0000 mon.c (mon.1) 565 : audit [DBG] from='client.? 172.21.15.132:0/241373703' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:36:46.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:36:46 smithi132 bash[27079]: audit 2020-07-16T16:36:45.019090+0000 mgr.x (mgr.34562) 8565 : audit [DBG] from='client.30868 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:36:46.820 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:36:46 smithi132 bash[27079]: audit 2020-07-16T16:36:45.285018+0000 mgr.x (mgr.34562) 8566 : audit [DBG] from='client.30874 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:36:46.820 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:36:46 smithi132 bash[27079]: audit 2020-07-16T16:36:45.586606+0000 mon.c (mon.1) 565 : audit [DBG] from='client.? 172.21.15.132:0/241373703' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:36:47.711 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:36:47 smithi188 bash[23329]: cluster 2020-07-16T16:36:45.891432+0000 mgr.x (mgr.34562) 8567 : cluster [DBG] pgmap v5342: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:36:47.819 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:36:47 smithi132 bash[27079]: cluster 2020-07-16T16:36:45.891432+0000 mgr.x (mgr.34562) 8567 : cluster [DBG] pgmap v5342: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:36:49.712 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:36:49 smithi188 bash[23329]: cluster 2020-07-16T16:36:47.891795+0000 mgr.x (mgr.34562) 8568 : cluster [DBG] pgmap v5343: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:36:49.820 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:36:49 smithi132 bash[27079]: cluster 2020-07-16T16:36:47.891795+0000 mgr.x (mgr.34562) 8568 : cluster [DBG] pgmap v5343: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:36:51.712 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:36:51 smithi188 bash[23329]: cluster 2020-07-16T16:36:49.892144+0000 mgr.x (mgr.34562) 8569 : cluster [DBG] pgmap v5344: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:36:51.820 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:36:51 smithi132 bash[27079]: cluster 2020-07-16T16:36:49.892144+0000 mgr.x (mgr.34562) 8569 : cluster [DBG] pgmap v5344: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:36:53.712 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:36:53 smithi188 bash[23329]: cluster 2020-07-16T16:36:51.892661+0000 mgr.x (mgr.34562) 8570 : cluster [DBG] pgmap v5345: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:36:53.821 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:36:53 smithi132 bash[27079]: cluster 2020-07-16T16:36:51.892661+0000 mgr.x (mgr.34562) 8570 : cluster [DBG] pgmap v5345: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:36:55.713 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:36:55 smithi188 bash[23329]: cluster 2020-07-16T16:36:53.893175+0000 mgr.x (mgr.34562) 8571 : cluster [DBG] pgmap v5346: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:36:55.821 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:36:55 smithi132 bash[27079]: cluster 2020-07-16T16:36:53.893175+0000 mgr.x (mgr.34562) 8571 : cluster [DBG] pgmap v5346: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:36:57.713 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:36:57 smithi188 bash[23329]: cluster 2020-07-16T16:36:55.893635+0000 mgr.x (mgr.34562) 8572 : cluster [DBG] pgmap v5347: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:36:57.821 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:36:57 smithi132 bash[27079]: cluster 2020-07-16T16:36:55.893635+0000 mgr.x (mgr.34562) 8572 : cluster [DBG] pgmap v5347: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:36:59.714 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:36:59 smithi188 bash[23329]: cluster 2020-07-16T16:36:57.894153+0000 mgr.x (mgr.34562) 8573 : cluster [DBG] pgmap v5348: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:36:59.715 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:36:59 smithi188 bash[23329]: audit 2020-07-16T16:36:59.100623+0000 mon.b (mon.2) 1805 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:36:59.823 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:36:59 smithi132 bash[27079]: cluster 2020-07-16T16:36:57.894153+0000 mgr.x (mgr.34562) 8573 : cluster [DBG] pgmap v5348: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:36:59.823 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:36:59 smithi132 bash[27079]: audit 2020-07-16T16:36:59.100623+0000 mon.b (mon.2) 1805 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:37:00.714 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:00 smithi188 bash[23329]: cephadm 2020-07-16T16:36:59.101291+0000 mgr.x (mgr.34562) 8574 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:37:00.714 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:00 smithi188 bash[23329]: cephadm 2020-07-16T16:36:59.101374+0000 mgr.x (mgr.34562) 8575 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:37:00.822 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:00 smithi132 bash[27079]: cephadm 2020-07-16T16:36:59.101291+0000 mgr.x (mgr.34562) 8574 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:37:00.823 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:00 smithi132 bash[27079]: cephadm 2020-07-16T16:36:59.101374+0000 mgr.x (mgr.34562) 8575 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:37:01.822 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:01 smithi132 bash[27079]: cluster 2020-07-16T16:36:59.894592+0000 mgr.x (mgr.34562) 8576 : cluster [DBG] pgmap v5349: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:37:01.965 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:01 smithi188 bash[23329]: cluster 2020-07-16T16:36:59.894592+0000 mgr.x (mgr.34562) 8576 : cluster [DBG] pgmap v5349: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:37:03.823 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:03 smithi132 bash[27079]: cluster 2020-07-16T16:37:01.895109+0000 mgr.x (mgr.34562) 8577 : cluster [DBG] pgmap v5350: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:37:03.964 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:03 smithi188 bash[23329]: cluster 2020-07-16T16:37:01.895109+0000 mgr.x (mgr.34562) 8577 : cluster [DBG] pgmap v5350: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:37:05.823 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:05 smithi132 bash[27079]: cluster 2020-07-16T16:37:03.895568+0000 mgr.x (mgr.34562) 8578 : cluster [DBG] pgmap v5351: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:37:05.965 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:05 smithi188 bash[23329]: cluster 2020-07-16T16:37:03.895568+0000 mgr.x (mgr.34562) 8578 : cluster [DBG] pgmap v5351: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:37:07.824 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:07 smithi132 bash[27079]: cluster 2020-07-16T16:37:05.896033+0000 mgr.x (mgr.34562) 8579 : cluster [DBG] pgmap v5352: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:37:07.966 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:07 smithi188 bash[23329]: cluster 2020-07-16T16:37:05.896033+0000 mgr.x (mgr.34562) 8579 : cluster [DBG] pgmap v5352: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:37:09.824 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:09 smithi132 bash[27079]: cluster 2020-07-16T16:37:07.896487+0000 mgr.x (mgr.34562) 8580 : cluster [DBG] pgmap v5353: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:37:09.966 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:09 smithi188 bash[23329]: cluster 2020-07-16T16:37:07.896487+0000 mgr.x (mgr.34562) 8580 : cluster [DBG] pgmap v5353: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:37:11.824 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:11 smithi132 bash[27079]: cluster 2020-07-16T16:37:09.896843+0000 mgr.x (mgr.34562) 8581 : cluster [DBG] pgmap v5354: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:37:11.966 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:11 smithi188 bash[23329]: cluster 2020-07-16T16:37:09.896843+0000 mgr.x (mgr.34562) 8581 : cluster [DBG] pgmap v5354: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:37:13.825 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:13 smithi132 bash[27079]: cluster 2020-07-16T16:37:11.897387+0000 mgr.x (mgr.34562) 8582 : cluster [DBG] pgmap v5355: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:37:13.967 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:13 smithi188 bash[23329]: cluster 2020-07-16T16:37:11.897387+0000 mgr.x (mgr.34562) 8582 : cluster [DBG] pgmap v5355: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:37:14.825 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:14 smithi132 bash[27079]: audit 2020-07-16T16:37:14.106431+0000 mon.b (mon.2) 1806 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T16:37:14.870 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:14 smithi188 bash[23329]: audit 2020-07-16T16:37:14.106431+0000 mon.b (mon.2) 1806 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-07-16T16:37:15.579 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:15 smithi188 bash[23329]: cluster 2020-07-16T16:37:13.897741+0000 mgr.x (mgr.34562) 8583 : cluster [DBG] pgmap v5356: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:37:15.825 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:15 smithi132 bash[27079]: cluster 2020-07-16T16:37:13.897741+0000 mgr.x (mgr.34562) 8583 : cluster [DBG] pgmap v5356: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:37:15.930 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:37:16.196 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:37:16.196 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (3h) 9m ago 3h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:37:16.197 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (3h) 9m ago 3h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:37:16.197 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (3h) 9m ago 3h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:37:16.198 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (2h) 9m ago 3h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:37:16.199 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 9m ago 3h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:37:16.199 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (3h) 9m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:37:16.200 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (3h) 9m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:37:16.200 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (3h) 9m ago 3h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:37:16.200 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (3h) 9m ago 3h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:37:16.201 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (3h) 9m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:37:16.202 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (3h) 9m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:37:16.202 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (3h) 9m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:37:16.202 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (3h) 9m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:37:16.203 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (3h) 9m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:37:16.203 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (3h) 9m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:37:16.204 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (3h) 9m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:37:16.205 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (3h) 9m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:37:16.205 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (3h) 9m ago 3h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:37:16.495 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:37:16.495 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:37:16.496 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:37:16.496 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:37:16.496 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:37:16.497 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:37:16.497 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:37:16.497 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:37:16.498 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:37:16.498 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:37:16.498 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:37:16.498 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:37:16.499 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:37:16.499 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:37:16.499 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:37:16.500 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:37:16.500 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:37:17.718 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:17 smithi188 bash[23329]: audit 2020-07-16T16:37:15.873005+0000 mgr.x (mgr.34562) 8584 : audit [DBG] from='client.30886 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:37:17.719 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:17 smithi188 bash[23329]: cluster 2020-07-16T16:37:15.898042+0000 mgr.x (mgr.34562) 8585 : cluster [DBG] pgmap v5357: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:37:17.719 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:17 smithi188 bash[23329]: audit 2020-07-16T16:37:16.144708+0000 mgr.x (mgr.34562) 8586 : audit [DBG] from='client.30892 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:37:17.720 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:17 smithi188 bash[23329]: audit 2020-07-16T16:37:16.447523+0000 mon.c (mon.1) 566 : audit [DBG] from='client.? 172.21.15.132:0/1395228480' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:37:17.720 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:17 smithi188 bash[23329]: audit 2020-07-16T16:37:16.721126+0000 mon.b (mon.2) 1807 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T16:37:17.720 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:17 smithi188 bash[23329]: audit 2020-07-16T16:37:16.926609+0000 mon.b (mon.2) 1808 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120242\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120344\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120377\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120537\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120653\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120749\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120847\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120879\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120907\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T16:27:45.120974\", \"last_device_update\": \"2020-07-16T16:37:16.925684\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T16:29:51.018831\"}"}]: dispatch 2020-07-16T16:37:17.721 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:17 smithi188 bash[23329]: audit 2020-07-16T16:37:16.927268+0000 mon.c (mon.1) 567 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120242\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120344\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120377\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120537\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120653\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120749\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120847\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120879\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120907\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T16:27:45.120974\", \"last_device_update\": \"2020-07-16T16:37:16.925684\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T16:29:51.018831\"}"}]: dispatch 2020-07-16T16:37:17.721 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:17 smithi188 bash[23329]: audit 2020-07-16T16:37:16.930279+0000 mon.c (mon.1) 568 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120242\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120344\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120377\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120537\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120653\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120749\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120847\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120879\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120907\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T16:27:45.120974\", \"last_device_update\": \"2020-07-16T16:37:16.925684\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T16:29:51.018831\"}"}]': finished 2020-07-16T16:37:17.722 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:17 smithi188 bash[23329]: audit 2020-07-16T16:37:16.932770+0000 mon.b (mon.2) 1809 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:37:17.722 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:17 smithi188 bash[23329]: audit 2020-07-16T16:37:16.933715+0000 mon.b (mon.2) 1810 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:37:17.722 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:17 smithi188 bash[23329]: audit 2020-07-16T16:37:16.934507+0000 mon.b (mon.2) 1811 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:37:17.723 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:17 smithi188 bash[23329]: audit 2020-07-16T16:37:16.935472+0000 mon.b (mon.2) 1812 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:37:17.723 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:17 smithi188 bash[23329]: audit 2020-07-16T16:37:16.936396+0000 mon.b (mon.2) 1813 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:37:17.772 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:17 smithi132 bash[27079]: audit 2020-07-16T16:37:15.873005+0000 mgr.x (mgr.34562) 8584 : audit [DBG] from='client.30886 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:37:17.772 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:17 smithi132 bash[27079]: cluster 2020-07-16T16:37:15.898042+0000 mgr.x (mgr.34562) 8585 : cluster [DBG] pgmap v5357: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:37:17.773 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:17 smithi132 bash[27079]: audit 2020-07-16T16:37:16.144708+0000 mgr.x (mgr.34562) 8586 : audit [DBG] from='client.30892 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:37:17.773 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:17 smithi132 bash[27079]: audit 2020-07-16T16:37:16.447523+0000 mon.c (mon.1) 566 : audit [DBG] from='client.? 172.21.15.132:0/1395228480' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:37:17.774 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:17 smithi132 bash[27079]: audit 2020-07-16T16:37:16.721126+0000 mon.b (mon.2) 1807 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T16:37:17.774 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:17 smithi132 bash[27079]: audit 2020-07-16T16:37:16.926609+0000 mon.b (mon.2) 1808 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120242\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120344\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120377\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120537\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120653\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120749\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120847\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120879\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120907\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T16:27:45.120974\", \"last_device_update\": \"2020-07-16T16:37:16.925684\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T16:29:51.018831\"}"}]: dispatch 2020-07-16T16:37:17.774 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:17 smithi132 bash[27079]: audit 2020-07-16T16:37:16.927268+0000 mon.c (mon.1) 567 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120242\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120344\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120377\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120537\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120653\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120749\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120847\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120879\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120907\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T16:27:45.120974\", \"last_device_update\": \"2020-07-16T16:37:16.925684\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T16:29:51.018831\"}"}]: dispatch 2020-07-16T16:37:17.775 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:17 smithi132 bash[27079]: audit 2020-07-16T16:37:16.930279+0000 mon.c (mon.1) 568 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120242\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120344\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120377\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120537\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120653\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120749\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120847\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120879\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:27:45.120907\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T16:27:45.120974\", \"last_device_update\": \"2020-07-16T16:37:16.925684\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T16:29:51.018831\"}"}]': finished 2020-07-16T16:37:17.775 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:17 smithi132 bash[27079]: audit 2020-07-16T16:37:16.932770+0000 mon.b (mon.2) 1809 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:37:17.776 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:17 smithi132 bash[27079]: audit 2020-07-16T16:37:16.933715+0000 mon.b (mon.2) 1810 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:37:17.776 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:17 smithi132 bash[27079]: audit 2020-07-16T16:37:16.934507+0000 mon.b (mon.2) 1811 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:37:17.776 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:17 smithi132 bash[27079]: audit 2020-07-16T16:37:16.935472+0000 mon.b (mon.2) 1812 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:37:17.777 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:17 smithi132 bash[27079]: audit 2020-07-16T16:37:16.936396+0000 mon.b (mon.2) 1813 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:37:18.718 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:18 smithi188 bash[23329]: audit 2020-07-16T16:37:16.933029+0000 mgr.x (mgr.34562) 8587 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:37:18.719 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:18 smithi188 bash[23329]: audit 2020-07-16T16:37:16.933948+0000 mgr.x (mgr.34562) 8588 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:37:18.719 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:18 smithi188 bash[23329]: audit 2020-07-16T16:37:16.934743+0000 mgr.x (mgr.34562) 8589 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:37:18.719 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:18 smithi188 bash[23329]: cephadm 2020-07-16T16:37:16.935238+0000 mgr.x (mgr.34562) 8590 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:37:18.720 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:18 smithi188 bash[23329]: cephadm 2020-07-16T16:37:16.936061+0000 mgr.x (mgr.34562) 8591 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:37:18.720 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:18 smithi188 bash[23329]: cephadm 2020-07-16T16:37:16.936895+0000 mgr.x (mgr.34562) 8592 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:37:18.721 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:18 smithi188 bash[23329]: cephadm 2020-07-16T16:37:16.936963+0000 mgr.x (mgr.34562) 8593 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:37:18.826 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:18 smithi132 bash[27079]: audit 2020-07-16T16:37:16.933029+0000 mgr.x (mgr.34562) 8587 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:37:18.826 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:18 smithi132 bash[27079]: audit 2020-07-16T16:37:16.933948+0000 mgr.x (mgr.34562) 8588 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:37:18.827 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:18 smithi132 bash[27079]: audit 2020-07-16T16:37:16.934743+0000 mgr.x (mgr.34562) 8589 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:37:18.827 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:18 smithi132 bash[27079]: cephadm 2020-07-16T16:37:16.935238+0000 mgr.x (mgr.34562) 8590 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:37:18.827 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:18 smithi132 bash[27079]: cephadm 2020-07-16T16:37:16.936061+0000 mgr.x (mgr.34562) 8591 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:37:18.828 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:18 smithi132 bash[27079]: cephadm 2020-07-16T16:37:16.936895+0000 mgr.x (mgr.34562) 8592 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:37:18.828 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:18 smithi132 bash[27079]: cephadm 2020-07-16T16:37:16.936963+0000 mgr.x (mgr.34562) 8593 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:37:19.576 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:19 smithi132 bash[27079]: cluster 2020-07-16T16:37:17.898626+0000 mgr.x (mgr.34562) 8594 : cluster [DBG] pgmap v5358: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:37:19.717 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:19 smithi188 bash[23329]: cluster 2020-07-16T16:37:17.898626+0000 mgr.x (mgr.34562) 8594 : cluster [DBG] pgmap v5358: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:37:20.718 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:20 smithi188 bash[23329]: audit 2020-07-16T16:37:19.760565+0000 mon.b (mon.2) 1814 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:37:20.826 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:20 smithi132 bash[27079]: audit 2020-07-16T16:37:19.760565+0000 mon.b (mon.2) 1814 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:37:21.718 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:21 smithi188 bash[23329]: cephadm 2020-07-16T16:37:19.761209+0000 mgr.x (mgr.34562) 8595 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:37:21.719 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:21 smithi188 bash[23329]: cephadm 2020-07-16T16:37:19.761612+0000 mgr.x (mgr.34562) 8596 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:37:21.719 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:21 smithi188 bash[23329]: cluster 2020-07-16T16:37:19.899057+0000 mgr.x (mgr.34562) 8597 : cluster [DBG] pgmap v5359: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:37:21.826 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:21 smithi132 bash[27079]: cephadm 2020-07-16T16:37:19.761209+0000 mgr.x (mgr.34562) 8595 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:37:21.827 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:21 smithi132 bash[27079]: cephadm 2020-07-16T16:37:19.761612+0000 mgr.x (mgr.34562) 8596 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:37:21.827 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:21 smithi132 bash[27079]: cluster 2020-07-16T16:37:19.899057+0000 mgr.x (mgr.34562) 8597 : cluster [DBG] pgmap v5359: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:37:23.719 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:23 smithi188 bash[23329]: cluster 2020-07-16T16:37:21.899469+0000 mgr.x (mgr.34562) 8598 : cluster [DBG] pgmap v5360: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:37:23.827 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:23 smithi132 bash[27079]: cluster 2020-07-16T16:37:21.899469+0000 mgr.x (mgr.34562) 8598 : cluster [DBG] pgmap v5360: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:37:25.719 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:25 smithi188 bash[23329]: cluster 2020-07-16T16:37:23.899940+0000 mgr.x (mgr.34562) 8599 : cluster [DBG] pgmap v5361: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:37:25.827 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:25 smithi132 bash[27079]: cluster 2020-07-16T16:37:23.899940+0000 mgr.x (mgr.34562) 8599 : cluster [DBG] pgmap v5361: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:37:27.720 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:27 smithi188 bash[23329]: cluster 2020-07-16T16:37:25.900321+0000 mgr.x (mgr.34562) 8600 : cluster [DBG] pgmap v5362: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:37:27.830 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:27 smithi132 bash[27079]: cluster 2020-07-16T16:37:25.900321+0000 mgr.x (mgr.34562) 8600 : cluster [DBG] pgmap v5362: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:37:29.720 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:29 smithi188 bash[23329]: cluster 2020-07-16T16:37:27.900865+0000 mgr.x (mgr.34562) 8601 : cluster [DBG] pgmap v5363: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:37:29.828 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:29 smithi132 bash[27079]: cluster 2020-07-16T16:37:27.900865+0000 mgr.x (mgr.34562) 8601 : cluster [DBG] pgmap v5363: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:37:31.720 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:31 smithi188 bash[23329]: cluster 2020-07-16T16:37:29.901415+0000 mgr.x (mgr.34562) 8602 : cluster [DBG] pgmap v5364: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:37:31.829 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:31 smithi132 bash[27079]: cluster 2020-07-16T16:37:29.901415+0000 mgr.x (mgr.34562) 8602 : cluster [DBG] pgmap v5364: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:37:33.721 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:33 smithi188 bash[23329]: cluster 2020-07-16T16:37:31.901922+0000 mgr.x (mgr.34562) 8603 : cluster [DBG] pgmap v5365: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:37:33.829 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:33 smithi132 bash[27079]: cluster 2020-07-16T16:37:31.901922+0000 mgr.x (mgr.34562) 8603 : cluster [DBG] pgmap v5365: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:37:35.721 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:35 smithi188 bash[23329]: cluster 2020-07-16T16:37:33.902269+0000 mgr.x (mgr.34562) 8604 : cluster [DBG] pgmap v5366: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:37:35.722 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:35 smithi188 bash[23329]: audit 2020-07-16T16:37:34.769680+0000 mon.b (mon.2) 1815 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:37:35.829 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:35 smithi132 bash[27079]: cluster 2020-07-16T16:37:33.902269+0000 mgr.x (mgr.34562) 8604 : cluster [DBG] pgmap v5366: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:37:35.830 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:35 smithi132 bash[27079]: audit 2020-07-16T16:37:34.769680+0000 mon.b (mon.2) 1815 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:37:36.721 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:36 smithi188 bash[23329]: cephadm 2020-07-16T16:37:34.770392+0000 mgr.x (mgr.34562) 8605 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:37:36.722 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:36 smithi188 bash[23329]: cephadm 2020-07-16T16:37:34.770801+0000 mgr.x (mgr.34562) 8606 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:37:36.830 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:36 smithi132 bash[27079]: cephadm 2020-07-16T16:37:34.770392+0000 mgr.x (mgr.34562) 8605 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:37:36.830 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:36 smithi132 bash[27079]: cephadm 2020-07-16T16:37:34.770801+0000 mgr.x (mgr.34562) 8606 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:37:37.721 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:37 smithi188 bash[23329]: cluster 2020-07-16T16:37:35.902799+0000 mgr.x (mgr.34562) 8607 : cluster [DBG] pgmap v5367: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:37:37.830 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:37 smithi132 bash[27079]: cluster 2020-07-16T16:37:35.902799+0000 mgr.x (mgr.34562) 8607 : cluster [DBG] pgmap v5367: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:37:39.722 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:39 smithi188 bash[23329]: cluster 2020-07-16T16:37:37.903253+0000 mgr.x (mgr.34562) 8608 : cluster [DBG] pgmap v5368: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:37:39.830 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:39 smithi132 bash[27079]: cluster 2020-07-16T16:37:37.903253+0000 mgr.x (mgr.34562) 8608 : cluster [DBG] pgmap v5368: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:37:41.722 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:41 smithi188 bash[23329]: cluster 2020-07-16T16:37:39.903775+0000 mgr.x (mgr.34562) 8609 : cluster [DBG] pgmap v5369: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:37:41.831 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:41 smithi132 bash[27079]: cluster 2020-07-16T16:37:39.903775+0000 mgr.x (mgr.34562) 8609 : cluster [DBG] pgmap v5369: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:37:43.723 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:43 smithi188 bash[23329]: cluster 2020-07-16T16:37:41.904330+0000 mgr.x (mgr.34562) 8610 : cluster [DBG] pgmap v5370: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:37:43.831 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:43 smithi132 bash[27079]: cluster 2020-07-16T16:37:41.904330+0000 mgr.x (mgr.34562) 8610 : cluster [DBG] pgmap v5370: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:37:45.723 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:45 smithi188 bash[23329]: cluster 2020-07-16T16:37:43.904781+0000 mgr.x (mgr.34562) 8611 : cluster [DBG] pgmap v5371: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:37:45.832 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:45 smithi132 bash[27079]: cluster 2020-07-16T16:37:43.904781+0000 mgr.x (mgr.34562) 8611 : cluster [DBG] pgmap v5371: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:37:46.794 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:37:47.057 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:37:47.058 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (3h) 10m ago 3h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:37:47.058 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (3h) 10m ago 3h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:37:47.059 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (3h) 10m ago 3h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:37:47.059 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (3h) 10m ago 3h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:37:47.060 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 10m ago 3h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:37:47.060 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (3h) 10m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:37:47.061 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (3h) 10m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:37:47.062 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (3h) 10m ago 3h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:37:47.062 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (3h) 10m ago 3h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:37:47.063 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (3h) 10m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:37:47.063 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (3h) 10m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:37:47.064 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (3h) 10m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:37:47.064 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (3h) 10m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:37:47.065 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (3h) 10m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:37:47.065 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (3h) 10m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:37:47.066 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (3h) 10m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:37:47.066 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (3h) 10m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:37:47.067 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (3h) 10m ago 3h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:37:47.353 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:37:47.353 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:37:47.353 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:37:47.354 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:37:47.354 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:37:47.354 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:37:47.355 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:37:47.355 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:37:47.355 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:37:47.356 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:37:47.356 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:37:47.356 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:37:47.356 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:37:47.357 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:37:47.357 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:37:47.357 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:37:47.358 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:37:47.724 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:47 smithi188 bash[23329]: cluster 2020-07-16T16:37:45.905100+0000 mgr.x (mgr.34562) 8612 : cluster [DBG] pgmap v5372: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:37:47.724 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:47 smithi188 bash[23329]: audit 2020-07-16T16:37:46.729823+0000 mgr.x (mgr.34562) 8613 : audit [DBG] from='client.30904 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:37:47.725 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:47 smithi188 bash[23329]: audit 2020-07-16T16:37:47.298593+0000 mon.c (mon.1) 569 : audit [DBG] from='client.? 172.21.15.132:0/1886318534' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:37:47.834 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:47 smithi132 bash[27079]: cluster 2020-07-16T16:37:45.905100+0000 mgr.x (mgr.34562) 8612 : cluster [DBG] pgmap v5372: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:37:47.835 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:47 smithi132 bash[27079]: audit 2020-07-16T16:37:46.729823+0000 mgr.x (mgr.34562) 8613 : audit [DBG] from='client.30904 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:37:47.835 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:47 smithi132 bash[27079]: audit 2020-07-16T16:37:47.298593+0000 mon.c (mon.1) 569 : audit [DBG] from='client.? 172.21.15.132:0/1886318534' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:37:48.724 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:48 smithi188 bash[23329]: audit 2020-07-16T16:37:46.999715+0000 mgr.x (mgr.34562) 8614 : audit [DBG] from='client.30910 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:37:48.832 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:48 smithi132 bash[27079]: audit 2020-07-16T16:37:46.999715+0000 mgr.x (mgr.34562) 8614 : audit [DBG] from='client.30910 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:37:49.725 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:49 smithi188 bash[23329]: cluster 2020-07-16T16:37:47.905591+0000 mgr.x (mgr.34562) 8615 : cluster [DBG] pgmap v5373: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:37:49.833 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:49 smithi132 bash[27079]: cluster 2020-07-16T16:37:47.905591+0000 mgr.x (mgr.34562) 8615 : cluster [DBG] pgmap v5373: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:37:50.724 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:50 smithi188 bash[23329]: audit 2020-07-16T16:37:49.786389+0000 mon.b (mon.2) 1816 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:37:50.833 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:50 smithi132 bash[27079]: audit 2020-07-16T16:37:49.786389+0000 mon.b (mon.2) 1816 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:37:51.725 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:51 smithi188 bash[23329]: cephadm 2020-07-16T16:37:49.787064+0000 mgr.x (mgr.34562) 8616 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:37:51.725 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:51 smithi188 bash[23329]: cephadm 2020-07-16T16:37:49.787451+0000 mgr.x (mgr.34562) 8617 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:37:51.726 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:51 smithi188 bash[23329]: cluster 2020-07-16T16:37:49.906073+0000 mgr.x (mgr.34562) 8618 : cluster [DBG] pgmap v5374: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:37:51.833 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:51 smithi132 bash[27079]: cephadm 2020-07-16T16:37:49.787064+0000 mgr.x (mgr.34562) 8616 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:37:51.834 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:51 smithi132 bash[27079]: cephadm 2020-07-16T16:37:49.787451+0000 mgr.x (mgr.34562) 8617 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:37:51.834 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:51 smithi132 bash[27079]: cluster 2020-07-16T16:37:49.906073+0000 mgr.x (mgr.34562) 8618 : cluster [DBG] pgmap v5374: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:37:53.725 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:53 smithi188 bash[23329]: cluster 2020-07-16T16:37:51.906509+0000 mgr.x (mgr.34562) 8619 : cluster [DBG] pgmap v5375: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:37:53.834 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:53 smithi132 bash[27079]: cluster 2020-07-16T16:37:51.906509+0000 mgr.x (mgr.34562) 8619 : cluster [DBG] pgmap v5375: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:37:55.834 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:55 smithi132 bash[27079]: cluster 2020-07-16T16:37:53.906909+0000 mgr.x (mgr.34562) 8620 : cluster [DBG] pgmap v5376: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:37:55.976 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:55 smithi188 bash[23329]: cluster 2020-07-16T16:37:53.906909+0000 mgr.x (mgr.34562) 8620 : cluster [DBG] pgmap v5376: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:37:57.834 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:57 smithi132 bash[27079]: cluster 2020-07-16T16:37:55.907340+0000 mgr.x (mgr.34562) 8621 : cluster [DBG] pgmap v5377: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:37:57.976 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:57 smithi188 bash[23329]: cluster 2020-07-16T16:37:55.907340+0000 mgr.x (mgr.34562) 8621 : cluster [DBG] pgmap v5377: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:37:59.836 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:37:59 smithi132 bash[27079]: cluster 2020-07-16T16:37:57.907754+0000 mgr.x (mgr.34562) 8622 : cluster [DBG] pgmap v5378: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:37:59.977 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:37:59 smithi188 bash[23329]: cluster 2020-07-16T16:37:57.907754+0000 mgr.x (mgr.34562) 8622 : cluster [DBG] pgmap v5378: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:38:01.835 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:01 smithi132 bash[27079]: cluster 2020-07-16T16:37:59.908264+0000 mgr.x (mgr.34562) 8623 : cluster [DBG] pgmap v5379: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:38:01.977 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:01 smithi188 bash[23329]: cluster 2020-07-16T16:37:59.908264+0000 mgr.x (mgr.34562) 8623 : cluster [DBG] pgmap v5379: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:38:03.836 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:03 smithi132 bash[27079]: cluster 2020-07-16T16:38:01.908793+0000 mgr.x (mgr.34562) 8624 : cluster [DBG] pgmap v5380: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:38:03.978 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:03 smithi188 bash[23329]: cluster 2020-07-16T16:38:01.908793+0000 mgr.x (mgr.34562) 8624 : cluster [DBG] pgmap v5380: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:38:05.837 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:05 smithi132 bash[27079]: cluster 2020-07-16T16:38:03.909172+0000 mgr.x (mgr.34562) 8625 : cluster [DBG] pgmap v5381: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:38:05.837 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:05 smithi132 bash[27079]: audit 2020-07-16T16:38:04.790665+0000 mon.b (mon.2) 1817 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:38:05.978 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:05 smithi188 bash[23329]: cluster 2020-07-16T16:38:03.909172+0000 mgr.x (mgr.34562) 8625 : cluster [DBG] pgmap v5381: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:38:05.979 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:05 smithi188 bash[23329]: audit 2020-07-16T16:38:04.790665+0000 mon.b (mon.2) 1817 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:38:06.837 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:06 smithi132 bash[27079]: cephadm 2020-07-16T16:38:04.791326+0000 mgr.x (mgr.34562) 8626 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:38:06.837 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:06 smithi132 bash[27079]: cephadm 2020-07-16T16:38:04.791759+0000 mgr.x (mgr.34562) 8627 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:38:06.978 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:06 smithi188 bash[23329]: cephadm 2020-07-16T16:38:04.791326+0000 mgr.x (mgr.34562) 8626 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:38:06.979 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:06 smithi188 bash[23329]: cephadm 2020-07-16T16:38:04.791759+0000 mgr.x (mgr.34562) 8627 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:38:07.837 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:07 smithi132 bash[27079]: cluster 2020-07-16T16:38:05.909537+0000 mgr.x (mgr.34562) 8628 : cluster [DBG] pgmap v5382: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:38:07.979 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:07 smithi188 bash[23329]: cluster 2020-07-16T16:38:05.909537+0000 mgr.x (mgr.34562) 8628 : cluster [DBG] pgmap v5382: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:38:09.838 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:09 smithi132 bash[27079]: cluster 2020-07-16T16:38:07.909902+0000 mgr.x (mgr.34562) 8629 : cluster [DBG] pgmap v5383: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:38:09.979 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:09 smithi188 bash[23329]: cluster 2020-07-16T16:38:07.909902+0000 mgr.x (mgr.34562) 8629 : cluster [DBG] pgmap v5383: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:38:11.838 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:11 smithi132 bash[27079]: cluster 2020-07-16T16:38:09.910302+0000 mgr.x (mgr.34562) 8630 : cluster [DBG] pgmap v5384: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:38:11.979 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:11 smithi188 bash[23329]: cluster 2020-07-16T16:38:09.910302+0000 mgr.x (mgr.34562) 8630 : cluster [DBG] pgmap v5384: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:38:13.838 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:13 smithi132 bash[27079]: cluster 2020-07-16T16:38:11.910735+0000 mgr.x (mgr.34562) 8631 : cluster [DBG] pgmap v5385: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:38:13.980 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:13 smithi188 bash[23329]: cluster 2020-07-16T16:38:11.910735+0000 mgr.x (mgr.34562) 8631 : cluster [DBG] pgmap v5385: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:38:15.839 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:15 smithi132 bash[27079]: cluster 2020-07-16T16:38:13.911080+0000 mgr.x (mgr.34562) 8632 : cluster [DBG] pgmap v5386: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:38:15.980 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:15 smithi188 bash[23329]: cluster 2020-07-16T16:38:13.911080+0000 mgr.x (mgr.34562) 8632 : cluster [DBG] pgmap v5386: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:38:17.657 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:38:17.839 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:17 smithi132 bash[27079]: cluster 2020-07-16T16:38:15.911577+0000 mgr.x (mgr.34562) 8633 : cluster [DBG] pgmap v5387: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:38:17.919 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:38:17.919 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (3h) 10m ago 3h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:38:17.920 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (3h) 10m ago 3h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:38:17.920 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (3h) 10m ago 3h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:38:17.921 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (3h) 10m ago 3h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:38:17.922 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 10m ago 3h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:38:17.922 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (3h) 10m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:38:17.923 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (3h) 10m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:38:17.923 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (3h) 10m ago 3h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:38:17.924 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (3h) 10m ago 3h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:38:17.924 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (3h) 10m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:38:17.925 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (3h) 10m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:38:17.925 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (3h) 10m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:38:17.926 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (3h) 10m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:38:17.926 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (3h) 10m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:38:17.927 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (3h) 10m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:38:17.928 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (3h) 10m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:38:17.928 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (3h) 10m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:38:17.929 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (3h) 10m ago 3h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:38:17.981 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:17 smithi188 bash[23329]: cluster 2020-07-16T16:38:15.911577+0000 mgr.x (mgr.34562) 8633 : cluster [DBG] pgmap v5387: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:38:18.214 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:38:18.215 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:38:18.215 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:38:18.216 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:38:18.216 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:38:18.217 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:38:18.218 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:38:18.218 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:38:18.219 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:38:18.219 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:38:18.220 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:38:18.220 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:38:18.221 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:38:18.221 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:38:18.222 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:38:18.222 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:38:18.223 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:38:18.839 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:18 smithi132 bash[27079]: audit 2020-07-16T16:38:17.584666+0000 mgr.x (mgr.34562) 8634 : audit [DBG] from='client.30922 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:38:18.840 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:18 smithi132 bash[27079]: audit 2020-07-16T16:38:18.152518+0000 mon.c (mon.1) 570 : audit [DBG] from='client.? 172.21.15.132:0/1568318873' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:38:18.981 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:18 smithi188 bash[23329]: audit 2020-07-16T16:38:17.584666+0000 mgr.x (mgr.34562) 8634 : audit [DBG] from='client.30922 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:38:18.982 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:18 smithi188 bash[23329]: audit 2020-07-16T16:38:18.152518+0000 mon.c (mon.1) 570 : audit [DBG] from='client.? 172.21.15.132:0/1568318873' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:38:19.840 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:19 smithi132 bash[27079]: audit 2020-07-16T16:38:17.853861+0000 mgr.x (mgr.34562) 8635 : audit [DBG] from='client.30928 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:38:19.841 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:19 smithi132 bash[27079]: cluster 2020-07-16T16:38:17.912077+0000 mgr.x (mgr.34562) 8636 : cluster [DBG] pgmap v5388: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:38:19.981 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:19 smithi188 bash[23329]: audit 2020-07-16T16:38:17.853861+0000 mgr.x (mgr.34562) 8635 : audit [DBG] from='client.30928 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:38:19.982 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:19 smithi188 bash[23329]: cluster 2020-07-16T16:38:17.912077+0000 mgr.x (mgr.34562) 8636 : cluster [DBG] pgmap v5388: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:38:20.776 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:20 smithi132 bash[27079]: audit 2020-07-16T16:38:19.807981+0000 mon.b (mon.2) 1818 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T16:38:20.776 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:20 smithi132 bash[27079]: audit 2020-07-16T16:38:19.808249+0000 mon.b (mon.2) 1819 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T16:38:20.982 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:20 smithi188 bash[23329]: audit 2020-07-16T16:38:19.807981+0000 mon.b (mon.2) 1818 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T16:38:20.982 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:20 smithi188 bash[23329]: audit 2020-07-16T16:38:19.808249+0000 mon.b (mon.2) 1819 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-07-16T16:38:21.732 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:21 smithi188 bash[23329]: cluster 2020-07-16T16:38:19.912426+0000 mgr.x (mgr.34562) 8637 : cluster [DBG] pgmap v5389: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:38:21.840 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:21 smithi132 bash[27079]: cluster 2020-07-16T16:38:19.912426+0000 mgr.x (mgr.34562) 8637 : cluster [DBG] pgmap v5389: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:38:22.802 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:22 smithi132 bash[27079]: audit 2020-07-16T16:38:21.963521+0000 mon.b (mon.2) 1820 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T16:38:21.961826\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.961886\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.961924\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.961955\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.962149\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.962280\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.962396\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.962579\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.962649\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T16:38:21.962734\", \"last_device_update\": \"2020-07-16T16:36:11.336233\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T16:29:51.014515\"}"}]: dispatch 2020-07-16T16:38:22.803 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:22 smithi132 bash[27079]: audit 2020-07-16T16:38:21.964006+0000 mon.c (mon.1) 571 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T16:38:21.961826\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.961886\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.961924\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.961955\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.962149\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.962280\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.962396\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.962579\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.962649\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T16:38:21.962734\", \"last_device_update\": \"2020-07-16T16:36:11.336233\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T16:29:51.014515\"}"}]: dispatch 2020-07-16T16:38:22.804 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:22 smithi132 bash[27079]: audit 2020-07-16T16:38:21.966937+0000 mon.c (mon.1) 572 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T16:38:21.961826\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.961886\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.961924\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.961955\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.962149\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.962280\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.962396\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.962579\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.962649\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T16:38:21.962734\", \"last_device_update\": \"2020-07-16T16:36:11.336233\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T16:29:51.014515\"}"}]': finished 2020-07-16T16:38:22.805 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:22 smithi132 bash[27079]: audit 2020-07-16T16:38:22.282234+0000 mon.b (mon.2) 1821 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.280703\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.280774\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.280806\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.280964\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.281065\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.281161\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.281257\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.281314\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.281345\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T16:38:22.281418\", \"last_device_update\": \"2020-07-16T16:37:16.925684\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T16:29:51.018831\"}"}]: dispatch 2020-07-16T16:38:22.807 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:22 smithi132 bash[27079]: audit 2020-07-16T16:38:22.282793+0000 mon.c (mon.1) 573 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.280703\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.280774\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.280806\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.280964\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.281065\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.281161\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.281257\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.281314\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.281345\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T16:38:22.281418\", \"last_device_update\": \"2020-07-16T16:37:16.925684\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T16:29:51.018831\"}"}]: dispatch 2020-07-16T16:38:22.807 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:22 smithi132 bash[27079]: audit 2020-07-16T16:38:22.285568+0000 mon.c (mon.1) 574 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.280703\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.280774\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.280806\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.280964\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.281065\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.281161\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.281257\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.281314\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.281345\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T16:38:22.281418\", \"last_device_update\": \"2020-07-16T16:37:16.925684\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T16:29:51.018831\"}"}]': finished 2020-07-16T16:38:22.808 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:22 smithi132 bash[27079]: audit 2020-07-16T16:38:22.290061+0000 mon.b (mon.2) 1822 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:38:22.809 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:22 smithi132 bash[27079]: audit 2020-07-16T16:38:22.291017+0000 mon.b (mon.2) 1823 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:38:22.809 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:22 smithi132 bash[27079]: audit 2020-07-16T16:38:22.291871+0000 mon.b (mon.2) 1824 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:38:22.810 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:22 smithi132 bash[27079]: audit 2020-07-16T16:38:22.292801+0000 mon.b (mon.2) 1825 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:38:22.810 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:22 smithi132 bash[27079]: audit 2020-07-16T16:38:22.293604+0000 mon.b (mon.2) 1826 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:38:22.983 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:22 smithi188 bash[23329]: audit 2020-07-16T16:38:21.963521+0000 mon.b (mon.2) 1820 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T16:38:21.961826\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.961886\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.961924\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.961955\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.962149\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.962280\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.962396\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.962579\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.962649\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T16:38:21.962734\", \"last_device_update\": \"2020-07-16T16:36:11.336233\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T16:29:51.014515\"}"}]: dispatch 2020-07-16T16:38:22.984 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:22 smithi188 bash[23329]: audit 2020-07-16T16:38:21.964006+0000 mon.c (mon.1) 571 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T16:38:21.961826\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.961886\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.961924\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.961955\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.962149\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.962280\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.962396\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.962579\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.962649\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T16:38:21.962734\", \"last_device_update\": \"2020-07-16T16:36:11.336233\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T16:29:51.014515\"}"}]: dispatch 2020-07-16T16:38:22.984 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:22 smithi188 bash[23329]: audit 2020-07-16T16:38:21.966937+0000 mon.c (mon.1) 572 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T16:38:21.961826\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.961886\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.961924\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.961955\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.962149\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.962280\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.962396\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.962579\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.962649\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T16:38:21.962734\", \"last_device_update\": \"2020-07-16T16:36:11.336233\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T16:29:51.014515\"}"}]': finished 2020-07-16T16:38:22.985 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:22 smithi188 bash[23329]: audit 2020-07-16T16:38:22.282234+0000 mon.b (mon.2) 1821 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.280703\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.280774\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.280806\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.280964\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.281065\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.281161\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.281257\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.281314\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.281345\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T16:38:22.281418\", \"last_device_update\": \"2020-07-16T16:37:16.925684\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T16:29:51.018831\"}"}]: dispatch 2020-07-16T16:38:22.985 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:22 smithi188 bash[23329]: audit 2020-07-16T16:38:22.282793+0000 mon.c (mon.1) 573 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.280703\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.280774\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.280806\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.280964\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.281065\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.281161\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.281257\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.281314\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.281345\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T16:38:22.281418\", \"last_device_update\": \"2020-07-16T16:37:16.925684\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T16:29:51.018831\"}"}]: dispatch 2020-07-16T16:38:22.986 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:22 smithi188 bash[23329]: audit 2020-07-16T16:38:22.285568+0000 mon.c (mon.1) 574 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.280703\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.280774\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.280806\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.280964\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.281065\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.281161\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.281257\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.281314\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.281345\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T16:38:22.281418\", \"last_device_update\": \"2020-07-16T16:37:16.925684\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T16:29:51.018831\"}"}]': finished 2020-07-16T16:38:22.986 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:22 smithi188 bash[23329]: audit 2020-07-16T16:38:22.290061+0000 mon.b (mon.2) 1822 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:38:22.987 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:22 smithi188 bash[23329]: audit 2020-07-16T16:38:22.291017+0000 mon.b (mon.2) 1823 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:38:22.987 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:22 smithi188 bash[23329]: audit 2020-07-16T16:38:22.291871+0000 mon.b (mon.2) 1824 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:38:22.988 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:22 smithi188 bash[23329]: audit 2020-07-16T16:38:22.292801+0000 mon.b (mon.2) 1825 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:38:22.988 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:22 smithi188 bash[23329]: audit 2020-07-16T16:38:22.293604+0000 mon.b (mon.2) 1826 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:38:23.820 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:23 smithi132 bash[27079]: cluster 2020-07-16T16:38:21.912717+0000 mgr.x (mgr.34562) 8638 : cluster [DBG] pgmap v5390: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:38:23.820 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:23 smithi132 bash[27079]: audit 2020-07-16T16:38:22.290329+0000 mgr.x (mgr.34562) 8639 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:38:23.820 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:23 smithi132 bash[27079]: audit 2020-07-16T16:38:22.291242+0000 mgr.x (mgr.34562) 8640 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:38:23.821 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:23 smithi132 bash[27079]: audit 2020-07-16T16:38:22.292079+0000 mgr.x (mgr.34562) 8641 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:38:23.821 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:23 smithi132 bash[27079]: cephadm 2020-07-16T16:38:22.292586+0000 mgr.x (mgr.34562) 8642 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:38:23.821 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:23 smithi132 bash[27079]: cephadm 2020-07-16T16:38:22.293406+0000 mgr.x (mgr.34562) 8643 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:38:23.822 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:23 smithi132 bash[27079]: cephadm 2020-07-16T16:38:22.294093+0000 mgr.x (mgr.34562) 8644 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:38:23.822 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:23 smithi132 bash[27079]: cephadm 2020-07-16T16:38:22.294164+0000 mgr.x (mgr.34562) 8645 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:38:23.982 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:23 smithi188 bash[23329]: cluster 2020-07-16T16:38:21.912717+0000 mgr.x (mgr.34562) 8638 : cluster [DBG] pgmap v5390: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:38:23.983 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:23 smithi188 bash[23329]: audit 2020-07-16T16:38:22.290329+0000 mgr.x (mgr.34562) 8639 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:38:23.983 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:23 smithi188 bash[23329]: audit 2020-07-16T16:38:22.291242+0000 mgr.x (mgr.34562) 8640 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:38:23.984 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:23 smithi188 bash[23329]: audit 2020-07-16T16:38:22.292079+0000 mgr.x (mgr.34562) 8641 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:38:23.984 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:23 smithi188 bash[23329]: cephadm 2020-07-16T16:38:22.292586+0000 mgr.x (mgr.34562) 8642 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:38:23.984 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:23 smithi188 bash[23329]: cephadm 2020-07-16T16:38:22.293406+0000 mgr.x (mgr.34562) 8643 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:38:23.985 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:23 smithi188 bash[23329]: cephadm 2020-07-16T16:38:22.294093+0000 mgr.x (mgr.34562) 8644 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:38:23.985 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:23 smithi188 bash[23329]: cephadm 2020-07-16T16:38:22.294164+0000 mgr.x (mgr.34562) 8645 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:38:25.841 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:25 smithi132 bash[27079]: cluster 2020-07-16T16:38:23.913074+0000 mgr.x (mgr.34562) 8646 : cluster [DBG] pgmap v5391: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:38:25.842 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:25 smithi132 bash[27079]: audit 2020-07-16T16:38:25.149432+0000 mon.b (mon.2) 1827 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:38:25.983 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:25 smithi188 bash[23329]: cluster 2020-07-16T16:38:23.913074+0000 mgr.x (mgr.34562) 8646 : cluster [DBG] pgmap v5391: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:38:25.984 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:25 smithi188 bash[23329]: audit 2020-07-16T16:38:25.149432+0000 mon.b (mon.2) 1827 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:38:26.842 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:26 smithi132 bash[27079]: cephadm 2020-07-16T16:38:25.150092+0000 mgr.x (mgr.34562) 8647 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:38:26.842 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:26 smithi132 bash[27079]: cephadm 2020-07-16T16:38:25.150169+0000 mgr.x (mgr.34562) 8648 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:38:26.983 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:26 smithi188 bash[23329]: cephadm 2020-07-16T16:38:25.150092+0000 mgr.x (mgr.34562) 8647 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:38:26.984 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:26 smithi188 bash[23329]: cephadm 2020-07-16T16:38:25.150169+0000 mgr.x (mgr.34562) 8648 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:38:27.842 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:27 smithi132 bash[27079]: cluster 2020-07-16T16:38:25.913516+0000 mgr.x (mgr.34562) 8649 : cluster [DBG] pgmap v5392: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:38:27.983 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:27 smithi188 bash[23329]: cluster 2020-07-16T16:38:25.913516+0000 mgr.x (mgr.34562) 8649 : cluster [DBG] pgmap v5392: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:38:29.842 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:29 smithi132 bash[27079]: cluster 2020-07-16T16:38:27.914046+0000 mgr.x (mgr.34562) 8650 : cluster [DBG] pgmap v5393: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:38:29.984 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:29 smithi188 bash[23329]: cluster 2020-07-16T16:38:27.914046+0000 mgr.x (mgr.34562) 8650 : cluster [DBG] pgmap v5393: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:38:31.847 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:31 smithi132 bash[27079]: cluster 2020-07-16T16:38:29.914570+0000 mgr.x (mgr.34562) 8651 : cluster [DBG] pgmap v5394: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:38:31.984 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:31 smithi188 bash[23329]: cluster 2020-07-16T16:38:29.914570+0000 mgr.x (mgr.34562) 8651 : cluster [DBG] pgmap v5394: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:38:33.843 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:33 smithi132 bash[27079]: cluster 2020-07-16T16:38:31.915046+0000 mgr.x (mgr.34562) 8652 : cluster [DBG] pgmap v5395: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:38:33.985 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:33 smithi188 bash[23329]: cluster 2020-07-16T16:38:31.915046+0000 mgr.x (mgr.34562) 8652 : cluster [DBG] pgmap v5395: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:38:35.844 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:35 smithi132 bash[27079]: cluster 2020-07-16T16:38:33.915437+0000 mgr.x (mgr.34562) 8653 : cluster [DBG] pgmap v5396: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:38:35.985 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:35 smithi188 bash[23329]: cluster 2020-07-16T16:38:33.915437+0000 mgr.x (mgr.34562) 8653 : cluster [DBG] pgmap v5396: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:38:37.844 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:37 smithi132 bash[27079]: cluster 2020-07-16T16:38:35.915915+0000 mgr.x (mgr.34562) 8654 : cluster [DBG] pgmap v5397: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:38:37.986 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:37 smithi188 bash[23329]: cluster 2020-07-16T16:38:35.915915+0000 mgr.x (mgr.34562) 8654 : cluster [DBG] pgmap v5397: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:38:39.845 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:39 smithi132 bash[27079]: cluster 2020-07-16T16:38:37.916496+0000 mgr.x (mgr.34562) 8655 : cluster [DBG] pgmap v5398: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:38:39.986 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:39 smithi188 bash[23329]: cluster 2020-07-16T16:38:37.916496+0000 mgr.x (mgr.34562) 8655 : cluster [DBG] pgmap v5398: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:38:40.845 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:40 smithi132 bash[27079]: audit 2020-07-16T16:38:40.165690+0000 mon.b (mon.2) 1828 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:38:40.986 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:40 smithi188 bash[23329]: audit 2020-07-16T16:38:40.165690+0000 mon.b (mon.2) 1828 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:38:41.988 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:41 smithi188 bash[23329]: cluster 2020-07-16T16:38:39.917034+0000 mgr.x (mgr.34562) 8656 : cluster [DBG] pgmap v5399: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:38:41.988 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:41 smithi188 bash[23329]: cephadm 2020-07-16T16:38:40.166441+0000 mgr.x (mgr.34562) 8657 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:38:41.988 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:41 smithi188 bash[23329]: cephadm 2020-07-16T16:38:40.166962+0000 mgr.x (mgr.34562) 8658 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:38:42.095 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:41 smithi132 bash[27079]: cluster 2020-07-16T16:38:39.917034+0000 mgr.x (mgr.34562) 8656 : cluster [DBG] pgmap v5399: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:38:42.095 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:41 smithi132 bash[27079]: cephadm 2020-07-16T16:38:40.166441+0000 mgr.x (mgr.34562) 8657 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:38:42.096 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:41 smithi132 bash[27079]: cephadm 2020-07-16T16:38:40.166962+0000 mgr.x (mgr.34562) 8658 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:38:43.987 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:43 smithi188 bash[23329]: cluster 2020-07-16T16:38:41.917452+0000 mgr.x (mgr.34562) 8659 : cluster [DBG] pgmap v5400: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:38:44.096 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:43 smithi132 bash[27079]: cluster 2020-07-16T16:38:41.917452+0000 mgr.x (mgr.34562) 8659 : cluster [DBG] pgmap v5400: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:38:45.986 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:45 smithi188 bash[23329]: cluster 2020-07-16T16:38:43.917910+0000 mgr.x (mgr.34562) 8660 : cluster [DBG] pgmap v5401: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:38:46.095 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:45 smithi132 bash[27079]: cluster 2020-07-16T16:38:43.917910+0000 mgr.x (mgr.34562) 8660 : cluster [DBG] pgmap v5401: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:38:47.985 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:47 smithi188 bash[23329]: cluster 2020-07-16T16:38:45.918405+0000 mgr.x (mgr.34562) 8661 : cluster [DBG] pgmap v5402: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:38:48.093 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:47 smithi132 bash[27079]: cluster 2020-07-16T16:38:45.918405+0000 mgr.x (mgr.34562) 8661 : cluster [DBG] pgmap v5402: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:38:48.515 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:38:48.779 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:38:48.780 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (3h) 26s ago 3h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:38:48.780 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (3h) 26s ago 3h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:38:48.781 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (3h) 26s ago 3h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:38:48.781 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (3h) 26s ago 3h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:38:48.781 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 26s ago 3h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:38:48.781 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (3h) 26s ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:38:48.782 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (3h) 26s ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:38:48.782 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (3h) 26s ago 3h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:38:48.782 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (3h) 26s ago 3h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:38:48.783 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (3h) 26s ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:38:48.783 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (3h) 26s ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:38:48.783 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (3h) 26s ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:38:48.784 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (3h) 26s ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:38:48.784 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (3h) 26s ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:38:48.784 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (3h) 26s ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:38:48.785 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (3h) 26s ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:38:48.785 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (3h) 26s ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:38:48.785 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (3h) 26s ago 3h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:38:49.077 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:38:49.077 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:38:49.078 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:38:49.078 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:38:49.078 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:38:49.079 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:38:49.079 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:38:49.079 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:38:49.080 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:38:49.080 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:38:49.080 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:38:49.081 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:38:49.081 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:38:49.081 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:38:49.081 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:38:49.082 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:38:49.082 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:38:49.983 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:49 smithi188 bash[23329]: cluster 2020-07-16T16:38:47.918929+0000 mgr.x (mgr.34562) 8662 : cluster [DBG] pgmap v5403: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:38:49.983 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:49 smithi188 bash[23329]: audit 2020-07-16T16:38:48.439484+0000 mgr.x (mgr.34562) 8663 : audit [DBG] from='client.30940 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:38:49.984 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:49 smithi188 bash[23329]: audit 2020-07-16T16:38:48.711628+0000 mgr.x (mgr.34562) 8664 : audit [DBG] from='client.30946 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:38:49.984 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:49 smithi188 bash[23329]: audit 2020-07-16T16:38:49.012795+0000 mon.c (mon.1) 575 : audit [DBG] from='client.? 172.21.15.132:0/3257991610' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:38:50.091 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:49 smithi132 bash[27079]: cluster 2020-07-16T16:38:47.918929+0000 mgr.x (mgr.34562) 8662 : cluster [DBG] pgmap v5403: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:38:50.092 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:49 smithi132 bash[27079]: audit 2020-07-16T16:38:48.439484+0000 mgr.x (mgr.34562) 8663 : audit [DBG] from='client.30940 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:38:50.092 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:49 smithi132 bash[27079]: audit 2020-07-16T16:38:48.711628+0000 mgr.x (mgr.34562) 8664 : audit [DBG] from='client.30946 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:38:50.092 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:49 smithi132 bash[27079]: audit 2020-07-16T16:38:49.012795+0000 mon.c (mon.1) 575 : audit [DBG] from='client.? 172.21.15.132:0/3257991610' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:38:51.981 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:51 smithi188 bash[23329]: cluster 2020-07-16T16:38:49.919360+0000 mgr.x (mgr.34562) 8665 : cluster [DBG] pgmap v5404: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:38:52.090 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:51 smithi132 bash[27079]: cluster 2020-07-16T16:38:49.919360+0000 mgr.x (mgr.34562) 8665 : cluster [DBG] pgmap v5404: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:38:53.980 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:53 smithi188 bash[23329]: cluster 2020-07-16T16:38:51.919800+0000 mgr.x (mgr.34562) 8666 : cluster [DBG] pgmap v5405: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:38:54.088 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:53 smithi132 bash[27079]: cluster 2020-07-16T16:38:51.919800+0000 mgr.x (mgr.34562) 8666 : cluster [DBG] pgmap v5405: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:38:55.978 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:55 smithi188 bash[23329]: cluster 2020-07-16T16:38:53.920347+0000 mgr.x (mgr.34562) 8667 : cluster [DBG] pgmap v5406: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:38:55.979 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:55 smithi188 bash[23329]: audit 2020-07-16T16:38:55.182477+0000 mon.b (mon.2) 1829 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:38:56.086 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:55 smithi132 bash[27079]: cluster 2020-07-16T16:38:53.920347+0000 mgr.x (mgr.34562) 8667 : cluster [DBG] pgmap v5406: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:38:56.087 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:55 smithi132 bash[27079]: audit 2020-07-16T16:38:55.182477+0000 mon.b (mon.2) 1829 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:38:56.977 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:56 smithi188 bash[23329]: cephadm 2020-07-16T16:38:55.183184+0000 mgr.x (mgr.34562) 8668 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:38:56.978 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:56 smithi188 bash[23329]: cephadm 2020-07-16T16:38:55.183305+0000 mgr.x (mgr.34562) 8669 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:38:57.086 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:56 smithi132 bash[27079]: cephadm 2020-07-16T16:38:55.183184+0000 mgr.x (mgr.34562) 8668 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:38:57.086 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:56 smithi132 bash[27079]: cephadm 2020-07-16T16:38:55.183305+0000 mgr.x (mgr.34562) 8669 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:38:57.977 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:57 smithi188 bash[23329]: cluster 2020-07-16T16:38:55.920700+0000 mgr.x (mgr.34562) 8670 : cluster [DBG] pgmap v5407: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:38:58.085 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:57 smithi132 bash[27079]: cluster 2020-07-16T16:38:55.920700+0000 mgr.x (mgr.34562) 8670 : cluster [DBG] pgmap v5407: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:38:59.975 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:38:59 smithi188 bash[23329]: cluster 2020-07-16T16:38:57.921142+0000 mgr.x (mgr.34562) 8671 : cluster [DBG] pgmap v5408: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:39:00.084 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:38:59 smithi132 bash[27079]: cluster 2020-07-16T16:38:57.921142+0000 mgr.x (mgr.34562) 8671 : cluster [DBG] pgmap v5408: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:39:01.974 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:39:01 smithi188 bash[23329]: cluster 2020-07-16T16:38:59.921644+0000 mgr.x (mgr.34562) 8672 : cluster [DBG] pgmap v5409: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:39:02.082 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:39:01 smithi132 bash[27079]: cluster 2020-07-16T16:38:59.921644+0000 mgr.x (mgr.34562) 8672 : cluster [DBG] pgmap v5409: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:39:03.973 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:39:03 smithi188 bash[23329]: cluster 2020-07-16T16:39:01.922182+0000 mgr.x (mgr.34562) 8673 : cluster [DBG] pgmap v5410: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:39:04.081 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:39:03 smithi132 bash[27079]: cluster 2020-07-16T16:39:01.922182+0000 mgr.x (mgr.34562) 8673 : cluster [DBG] pgmap v5410: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:39:05.971 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:39:05 smithi188 bash[23329]: cluster 2020-07-16T16:39:03.922663+0000 mgr.x (mgr.34562) 8674 : cluster [DBG] pgmap v5411: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:39:06.079 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:39:05 smithi132 bash[27079]: cluster 2020-07-16T16:39:03.922663+0000 mgr.x (mgr.34562) 8674 : cluster [DBG] pgmap v5411: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:39:07.970 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:39:07 smithi188 bash[23329]: cluster 2020-07-16T16:39:05.923184+0000 mgr.x (mgr.34562) 8675 : cluster [DBG] pgmap v5412: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:39:08.078 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:39:07 smithi132 bash[27079]: cluster 2020-07-16T16:39:05.923184+0000 mgr.x (mgr.34562) 8675 : cluster [DBG] pgmap v5412: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:39:09.969 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:39:09 smithi188 bash[23329]: cluster 2020-07-16T16:39:07.923563+0000 mgr.x (mgr.34562) 8676 : cluster [DBG] pgmap v5413: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:39:10.077 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:39:09 smithi132 bash[27079]: cluster 2020-07-16T16:39:07.923563+0000 mgr.x (mgr.34562) 8676 : cluster [DBG] pgmap v5413: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:39:10.968 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:39:10 smithi188 bash[23329]: audit 2020-07-16T16:39:10.199309+0000 mon.b (mon.2) 1830 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:39:11.076 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:39:10 smithi132 bash[27079]: audit 2020-07-16T16:39:10.199309+0000 mon.b (mon.2) 1830 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:39:11.968 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:39:11 smithi188 bash[23329]: cluster 2020-07-16T16:39:09.924066+0000 mgr.x (mgr.34562) 8677 : cluster [DBG] pgmap v5414: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:39:11.968 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:39:11 smithi188 bash[23329]: cephadm 2020-07-16T16:39:10.200000+0000 mgr.x (mgr.34562) 8678 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:39:11.969 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:39:11 smithi188 bash[23329]: cephadm 2020-07-16T16:39:10.200221+0000 mgr.x (mgr.34562) 8679 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:39:12.076 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:39:11 smithi132 bash[27079]: cluster 2020-07-16T16:39:09.924066+0000 mgr.x (mgr.34562) 8677 : cluster [DBG] pgmap v5414: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:39:12.077 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:39:11 smithi132 bash[27079]: cephadm 2020-07-16T16:39:10.200000+0000 mgr.x (mgr.34562) 8678 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:39:12.077 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:39:11 smithi132 bash[27079]: cephadm 2020-07-16T16:39:10.200221+0000 mgr.x (mgr.34562) 8679 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:39:13.966 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:39:13 smithi188 bash[23329]: cluster 2020-07-16T16:39:11.924652+0000 mgr.x (mgr.34562) 8680 : cluster [DBG] pgmap v5415: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:39:14.075 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:39:13 smithi132 bash[27079]: cluster 2020-07-16T16:39:11.924652+0000 mgr.x (mgr.34562) 8680 : cluster [DBG] pgmap v5415: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:39:15.965 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:39:15 smithi188 bash[23329]: cluster 2020-07-16T16:39:13.925131+0000 mgr.x (mgr.34562) 8681 : cluster [DBG] pgmap v5416: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:39:16.074 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:39:15 smithi132 bash[27079]: cluster 2020-07-16T16:39:13.925131+0000 mgr.x (mgr.34562) 8681 : cluster [DBG] pgmap v5416: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:39:17.964 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:39:17 smithi188 bash[23329]: cluster 2020-07-16T16:39:15.925573+0000 mgr.x (mgr.34562) 8682 : cluster [DBG] pgmap v5417: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:39:18.073 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:39:17 smithi132 bash[27079]: cluster 2020-07-16T16:39:15.925573+0000 mgr.x (mgr.34562) 8682 : cluster [DBG] pgmap v5417: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:39:19.355 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:39:19.613 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:39:19.614 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (3h) 57s ago 3h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:39:19.614 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (3h) 57s ago 3h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:39:19.615 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (3h) 57s ago 3h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:39:19.615 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (3h) 57s ago 3h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:39:19.615 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 57s ago 3h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:39:19.616 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (3h) 57s ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:39:19.616 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (3h) 57s ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:39:19.616 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (3h) 57s ago 3h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:39:19.616 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (3h) 57s ago 3h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:39:19.617 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (3h) 57s ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:39:19.617 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (3h) 57s ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:39:19.617 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (3h) 57s ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:39:19.618 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (3h) 57s ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:39:19.618 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (3h) 57s ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:39:19.619 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (3h) 57s ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:39:19.619 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (3h) 57s ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:39:19.619 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (3h) 57s ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:39:19.620 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (3h) 57s ago 3h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:39:19.929 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:39:19.930 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:39:19.931 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:39:19.931 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:39:19.931 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:39:19.932 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:39:19.932 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:39:19.932 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:39:19.933 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:39:19.933 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:39:19.934 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:39:19.934 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:39:19.934 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:39:19.935 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:39:19.935 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:39:19.935 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:39:19.936 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:39:19.963 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:39:19 smithi188 bash[23329]: cluster 2020-07-16T16:39:17.926109+0000 mgr.x (mgr.34562) 8683 : cluster [DBG] pgmap v5418: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:39:20.072 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:39:19 smithi132 bash[27079]: cluster 2020-07-16T16:39:17.926109+0000 mgr.x (mgr.34562) 8683 : cluster [DBG] pgmap v5418: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:39:20.963 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:39:20 smithi188 bash[23329]: audit 2020-07-16T16:39:19.300042+0000 mgr.x (mgr.34562) 8684 : audit [DBG] from='client.30958 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:39:20.964 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:39:20 smithi188 bash[23329]: audit 2020-07-16T16:39:19.565810+0000 mgr.x (mgr.34562) 8685 : audit [DBG] from='client.30964 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:39:20.964 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:39:20 smithi188 bash[23329]: audit 2020-07-16T16:39:19.885670+0000 mon.c (mon.1) 576 : audit [DBG] from='client.? 172.21.15.132:0/3852389436' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:39:21.071 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:39:20 smithi132 bash[27079]: audit 2020-07-16T16:39:19.300042+0000 mgr.x (mgr.34562) 8684 : audit [DBG] from='client.30958 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:39:21.072 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:39:20 smithi132 bash[27079]: audit 2020-07-16T16:39:19.565810+0000 mgr.x (mgr.34562) 8685 : audit [DBG] from='client.30964 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:39:21.072 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:39:20 smithi132 bash[27079]: audit 2020-07-16T16:39:19.885670+0000 mon.c (mon.1) 576 : audit [DBG] from='client.? 172.21.15.132:0/3852389436' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:39:21.963 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:39:21 smithi188 bash[23329]: cluster 2020-07-16T16:39:19.926544+0000 mgr.x (mgr.34562) 8686 : cluster [DBG] pgmap v5419: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:39:22.071 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:39:21 smithi132 bash[27079]: cluster 2020-07-16T16:39:19.926544+0000 mgr.x (mgr.34562) 8686 : cluster [DBG] pgmap v5419: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:39:23.962 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:39:23 smithi188 bash[23329]: cluster 2020-07-16T16:39:21.926930+0000 mgr.x (mgr.34562) 8687 : cluster [DBG] pgmap v5420: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:39:24.070 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:39:23 smithi132 bash[27079]: cluster 2020-07-16T16:39:21.926930+0000 mgr.x (mgr.34562) 8687 : cluster [DBG] pgmap v5420: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:39:25.961 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:39:25 smithi188 bash[23329]: cluster 2020-07-16T16:39:23.927413+0000 mgr.x (mgr.34562) 8688 : cluster [DBG] pgmap v5421: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:39:25.961 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:39:25 smithi188 bash[23329]: audit 2020-07-16T16:39:25.218459+0000 mon.b (mon.2) 1831 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:39:25.962 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:39:25 smithi188 bash[23329]: audit 2020-07-16T16:39:25.219803+0000 mon.b (mon.2) 1832 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:39:25.962 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:39:25 smithi188 bash[23329]: audit 2020-07-16T16:39:25.221031+0000 mon.b (mon.2) 1833 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:39:25.962 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:39:25 smithi188 bash[23329]: audit 2020-07-16T16:39:25.222588+0000 mon.b (mon.2) 1834 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:39:25.963 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:39:25 smithi188 bash[23329]: audit 2020-07-16T16:39:25.223854+0000 mon.b (mon.2) 1835 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:39:26.069 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:39:25 smithi132 bash[27079]: cluster 2020-07-16T16:39:23.927413+0000 mgr.x (mgr.34562) 8688 : cluster [DBG] pgmap v5421: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:39:26.070 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:39:25 smithi132 bash[27079]: audit 2020-07-16T16:39:25.218459+0000 mon.b (mon.2) 1831 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:39:26.070 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:39:25 smithi132 bash[27079]: audit 2020-07-16T16:39:25.219803+0000 mon.b (mon.2) 1832 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:39:26.071 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:39:25 smithi132 bash[27079]: audit 2020-07-16T16:39:25.221031+0000 mon.b (mon.2) 1833 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:39:26.071 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:39:25 smithi132 bash[27079]: audit 2020-07-16T16:39:25.222588+0000 mon.b (mon.2) 1834 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:39:26.071 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:39:25 smithi132 bash[27079]: audit 2020-07-16T16:39:25.223854+0000 mon.b (mon.2) 1835 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:39:26.961 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:39:26 smithi188 bash[23329]: audit 2020-07-16T16:39:25.218835+0000 mgr.x (mgr.34562) 8689 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:39:26.961 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:39:26 smithi188 bash[23329]: audit 2020-07-16T16:39:25.220150+0000 mgr.x (mgr.34562) 8690 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:39:26.962 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:39:26 smithi188 bash[23329]: audit 2020-07-16T16:39:25.221364+0000 mgr.x (mgr.34562) 8691 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:39:26.962 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:39:26 smithi188 bash[23329]: cephadm 2020-07-16T16:39:25.222127+0000 mgr.x (mgr.34562) 8692 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:39:26.962 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:39:26 smithi188 bash[23329]: cephadm 2020-07-16T16:39:25.223466+0000 mgr.x (mgr.34562) 8693 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:39:26.963 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:39:26 smithi188 bash[23329]: cephadm 2020-07-16T16:39:25.224618+0000 mgr.x (mgr.34562) 8694 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:39:26.963 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:39:26 smithi188 bash[23329]: cephadm 2020-07-16T16:39:25.224790+0000 mgr.x (mgr.34562) 8695 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:39:27.069 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:39:26 smithi132 bash[27079]: audit 2020-07-16T16:39:25.218835+0000 mgr.x (mgr.34562) 8689 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:39:27.069 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:39:26 smithi132 bash[27079]: audit 2020-07-16T16:39:25.220150+0000 mgr.x (mgr.34562) 8690 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:39:27.069 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:39:26 smithi132 bash[27079]: audit 2020-07-16T16:39:25.221364+0000 mgr.x (mgr.34562) 8691 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:39:27.070 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:39:26 smithi132 bash[27079]: cephadm 2020-07-16T16:39:25.222127+0000 mgr.x (mgr.34562) 8692 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:39:27.070 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:39:26 smithi132 bash[27079]: cephadm 2020-07-16T16:39:25.223466+0000 mgr.x (mgr.34562) 8693 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:39:27.070 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:39:26 smithi132 bash[27079]: cephadm 2020-07-16T16:39:25.224618+0000 mgr.x (mgr.34562) 8694 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:39:27.071 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:39:26 smithi132 bash[27079]: cephadm 2020-07-16T16:39:25.224790+0000 mgr.x (mgr.34562) 8695 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:39:27.960 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:39:27 smithi188 bash[23329]: cluster 2020-07-16T16:39:25.927774+0000 mgr.x (mgr.34562) 8696 : cluster [DBG] pgmap v5422: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:39:28.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:39:27 smithi132 bash[27079]: cluster 2020-07-16T16:39:25.927774+0000 mgr.x (mgr.34562) 8696 : cluster [DBG] pgmap v5422: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:39:28.960 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:39:28 smithi188 bash[23329]: audit 2020-07-16T16:39:28.110581+0000 mon.b (mon.2) 1836 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:39:29.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:39:28 smithi132 bash[27079]: audit 2020-07-16T16:39:28.110581+0000 mon.b (mon.2) 1836 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:39:29.960 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:39:29 smithi188 bash[23329]: cluster 2020-07-16T16:39:27.928220+0000 mgr.x (mgr.34562) 8697 : cluster [DBG] pgmap v5423: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:39:29.960 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:39:29 smithi188 bash[23329]: cephadm 2020-07-16T16:39:28.111602+0000 mgr.x (mgr.34562) 8698 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:39:29.961 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:39:29 smithi188 bash[23329]: cephadm 2020-07-16T16:39:28.111829+0000 mgr.x (mgr.34562) 8699 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:39:30.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:39:29 smithi132 bash[27079]: cluster 2020-07-16T16:39:27.928220+0000 mgr.x (mgr.34562) 8697 : cluster [DBG] pgmap v5423: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:39:30.068 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:39:29 smithi132 bash[27079]: cephadm 2020-07-16T16:39:28.111602+0000 mgr.x (mgr.34562) 8698 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:39:30.069 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:39:29 smithi132 bash[27079]: cephadm 2020-07-16T16:39:28.111829+0000 mgr.x (mgr.34562) 8699 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:39:31.958 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:39:31 smithi188 bash[23329]: cluster 2020-07-16T16:39:29.928529+0000 mgr.x (mgr.34562) 8700 : cluster [DBG] pgmap v5424: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:39:32.067 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:39:31 smithi132 bash[27079]: cluster 2020-07-16T16:39:29.928529+0000 mgr.x (mgr.34562) 8700 : cluster [DBG] pgmap v5424: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:39:33.958 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:39:33 smithi188 bash[23329]: cluster 2020-07-16T16:39:31.929085+0000 mgr.x (mgr.34562) 8701 : cluster [DBG] pgmap v5425: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:39:34.066 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:39:33 smithi132 bash[27079]: cluster 2020-07-16T16:39:31.929085+0000 mgr.x (mgr.34562) 8701 : cluster [DBG] pgmap v5425: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:39:35.957 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:39:35 smithi188 bash[23329]: cluster 2020-07-16T16:39:33.929628+0000 mgr.x (mgr.34562) 8702 : cluster [DBG] pgmap v5426: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:39:36.065 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:39:35 smithi132 bash[27079]: cluster 2020-07-16T16:39:33.929628+0000 mgr.x (mgr.34562) 8702 : cluster [DBG] pgmap v5426: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:39:37.957 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:39:37 smithi188 bash[23329]: cluster 2020-07-16T16:39:35.930106+0000 mgr.x (mgr.34562) 8703 : cluster [DBG] pgmap v5427: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:39:38.065 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:39:37 smithi132 bash[27079]: cluster 2020-07-16T16:39:35.930106+0000 mgr.x (mgr.34562) 8703 : cluster [DBG] pgmap v5427: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:39:39.956 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:39:39 smithi188 bash[23329]: cluster 2020-07-16T16:39:37.930670+0000 mgr.x (mgr.34562) 8704 : cluster [DBG] pgmap v5428: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:39:40.064 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:39:39 smithi132 bash[27079]: cluster 2020-07-16T16:39:37.930670+0000 mgr.x (mgr.34562) 8704 : cluster [DBG] pgmap v5428: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:39:41.955 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:39:41 smithi188 bash[23329]: cluster 2020-07-16T16:39:39.931126+0000 mgr.x (mgr.34562) 8705 : cluster [DBG] pgmap v5429: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:39:42.063 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:39:41 smithi132 bash[27079]: cluster 2020-07-16T16:39:39.931126+0000 mgr.x (mgr.34562) 8705 : cluster [DBG] pgmap v5429: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:39:43.955 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:39:43 smithi188 bash[23329]: cluster 2020-07-16T16:39:41.931583+0000 mgr.x (mgr.34562) 8706 : cluster [DBG] pgmap v5430: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:39:43.955 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:39:43 smithi188 bash[23329]: audit 2020-07-16T16:39:43.127485+0000 mon.b (mon.2) 1837 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:39:44.063 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:39:43 smithi132 bash[27079]: cluster 2020-07-16T16:39:41.931583+0000 mgr.x (mgr.34562) 8706 : cluster [DBG] pgmap v5430: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:39:44.063 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:39:43 smithi132 bash[27079]: audit 2020-07-16T16:39:43.127485+0000 mon.b (mon.2) 1837 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:39:45.063 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:39:44 smithi132 bash[27079]: cephadm 2020-07-16T16:39:43.128181+0000 mgr.x (mgr.34562) 8707 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:39:45.063 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:39:44 smithi132 bash[27079]: cephadm 2020-07-16T16:39:43.128261+0000 mgr.x (mgr.34562) 8708 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:39:45.204 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:39:44 smithi188 bash[23329]: cephadm 2020-07-16T16:39:43.128181+0000 mgr.x (mgr.34562) 8707 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:39:45.204 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:39:44 smithi188 bash[23329]: cephadm 2020-07-16T16:39:43.128261+0000 mgr.x (mgr.34562) 8708 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:39:46.062 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:39:45 smithi132 bash[27079]: cluster 2020-07-16T16:39:43.931941+0000 mgr.x (mgr.34562) 8709 : cluster [DBG] pgmap v5431: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:39:46.204 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:39:45 smithi188 bash[23329]: cluster 2020-07-16T16:39:43.931941+0000 mgr.x (mgr.34562) 8709 : cluster [DBG] pgmap v5431: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:39:48.062 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:39:47 smithi132 bash[27079]: cluster 2020-07-16T16:39:45.932335+0000 mgr.x (mgr.34562) 8710 : cluster [DBG] pgmap v5432: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:39:48.203 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:39:47 smithi188 bash[23329]: cluster 2020-07-16T16:39:45.932335+0000 mgr.x (mgr.34562) 8710 : cluster [DBG] pgmap v5432: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:39:50.061 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:39:49 smithi132 bash[27079]: cluster 2020-07-16T16:39:47.932767+0000 mgr.x (mgr.34562) 8711 : cluster [DBG] pgmap v5433: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:39:50.203 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:39:49 smithi188 bash[23329]: cluster 2020-07-16T16:39:47.932767+0000 mgr.x (mgr.34562) 8711 : cluster [DBG] pgmap v5433: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:39:50.227 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:39:50.491 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:39:50.491 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (3h) 88s ago 3h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:39:50.492 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (3h) 88s ago 3h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:39:50.492 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (3h) 88s ago 3h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:39:50.492 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (3h) 88s ago 3h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:39:50.493 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 88s ago 3h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:39:50.493 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (3h) 88s ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:39:50.493 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (3h) 88s ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:39:50.494 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (3h) 88s ago 3h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:39:50.494 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (3h) 88s ago 3h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:39:50.494 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (3h) 88s ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:39:50.495 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (3h) 88s ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:39:50.495 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (3h) 88s ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:39:50.495 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (3h) 88s ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:39:50.496 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (3h) 88s ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:39:50.496 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (3h) 88s ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:39:50.496 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (3h) 88s ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:39:50.496 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (3h) 88s ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:39:50.497 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (3h) 88s ago 3h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:39:50.790 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:39:50.791 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:39:50.791 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:39:50.791 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:39:50.792 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:39:50.792 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:39:50.792 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:39:50.793 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:39:50.793 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:39:50.793 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:39:50.794 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:39:50.794 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:39:50.794 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:39:50.795 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:39:50.795 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:39:50.795 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:39:50.796 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:39:52.061 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:39:51 smithi132 bash[27079]: cluster 2020-07-16T16:39:49.933248+0000 mgr.x (mgr.34562) 8712 : cluster [DBG] pgmap v5434: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:39:52.062 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:39:51 smithi132 bash[27079]: audit 2020-07-16T16:39:50.182715+0000 mgr.x (mgr.34562) 8713 : audit [DBG] from='client.30976 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:39:52.062 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:39:51 smithi132 bash[27079]: audit 2020-07-16T16:39:50.453409+0000 mgr.x (mgr.34562) 8714 : audit [DBG] from='client.30982 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:39:52.062 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:39:51 smithi132 bash[27079]: audit 2020-07-16T16:39:50.757345+0000 mon.c (mon.1) 577 : audit [DBG] from='client.? 172.21.15.132:0/4062266138' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:39:52.202 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:39:51 smithi188 bash[23329]: cluster 2020-07-16T16:39:49.933248+0000 mgr.x (mgr.34562) 8712 : cluster [DBG] pgmap v5434: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:39:52.203 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:39:51 smithi188 bash[23329]: audit 2020-07-16T16:39:50.182715+0000 mgr.x (mgr.34562) 8713 : audit [DBG] from='client.30976 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:39:52.203 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:39:51 smithi188 bash[23329]: audit 2020-07-16T16:39:50.453409+0000 mgr.x (mgr.34562) 8714 : audit [DBG] from='client.30982 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:39:52.203 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:39:51 smithi188 bash[23329]: audit 2020-07-16T16:39:50.757345+0000 mon.c (mon.1) 577 : audit [DBG] from='client.? 172.21.15.132:0/4062266138' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:39:54.060 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:39:53 smithi132 bash[27079]: cluster 2020-07-16T16:39:51.933752+0000 mgr.x (mgr.34562) 8715 : cluster [DBG] pgmap v5435: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:39:54.202 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:39:53 smithi188 bash[23329]: cluster 2020-07-16T16:39:51.933752+0000 mgr.x (mgr.34562) 8715 : cluster [DBG] pgmap v5435: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:39:56.060 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:39:55 smithi132 bash[27079]: cluster 2020-07-16T16:39:53.934218+0000 mgr.x (mgr.34562) 8716 : cluster [DBG] pgmap v5436: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:39:56.201 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:39:55 smithi188 bash[23329]: cluster 2020-07-16T16:39:53.934218+0000 mgr.x (mgr.34562) 8716 : cluster [DBG] pgmap v5436: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:39:58.059 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:39:57 smithi132 bash[27079]: cluster 2020-07-16T16:39:55.934696+0000 mgr.x (mgr.34562) 8717 : cluster [DBG] pgmap v5437: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:39:58.201 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:39:57 smithi188 bash[23329]: cluster 2020-07-16T16:39:55.934696+0000 mgr.x (mgr.34562) 8717 : cluster [DBG] pgmap v5437: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:39:59.059 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:39:58 smithi132 bash[27079]: audit 2020-07-16T16:39:58.143900+0000 mon.b (mon.2) 1838 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:39:59.201 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:39:58 smithi188 bash[23329]: audit 2020-07-16T16:39:58.143900+0000 mon.b (mon.2) 1838 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:40:00.059 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:39:59 smithi132 bash[27079]: cluster 2020-07-16T16:39:57.935262+0000 mgr.x (mgr.34562) 8718 : cluster [DBG] pgmap v5438: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:40:00.060 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:39:59 smithi132 bash[27079]: cephadm 2020-07-16T16:39:58.144613+0000 mgr.x (mgr.34562) 8719 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:40:00.060 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:39:59 smithi132 bash[27079]: cephadm 2020-07-16T16:39:58.144869+0000 mgr.x (mgr.34562) 8720 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:40:00.200 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:39:59 smithi188 bash[23329]: cluster 2020-07-16T16:39:57.935262+0000 mgr.x (mgr.34562) 8718 : cluster [DBG] pgmap v5438: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:40:00.201 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:39:59 smithi188 bash[23329]: cephadm 2020-07-16T16:39:58.144613+0000 mgr.x (mgr.34562) 8719 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:40:00.201 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:39:59 smithi188 bash[23329]: cephadm 2020-07-16T16:39:58.144869+0000 mgr.x (mgr.34562) 8720 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:40:02.059 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:40:01 smithi132 bash[27079]: cluster 2020-07-16T16:39:59.935825+0000 mgr.x (mgr.34562) 8721 : cluster [DBG] pgmap v5439: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:40:02.200 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:40:01 smithi188 bash[23329]: cluster 2020-07-16T16:39:59.935825+0000 mgr.x (mgr.34562) 8721 : cluster [DBG] pgmap v5439: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:40:04.058 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:40:03 smithi132 bash[27079]: cluster 2020-07-16T16:40:01.936251+0000 mgr.x (mgr.34562) 8722 : cluster [DBG] pgmap v5440: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:40:04.200 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:40:03 smithi188 bash[23329]: cluster 2020-07-16T16:40:01.936251+0000 mgr.x (mgr.34562) 8722 : cluster [DBG] pgmap v5440: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:40:06.058 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:40:05 smithi132 bash[27079]: cluster 2020-07-16T16:40:03.936630+0000 mgr.x (mgr.34562) 8723 : cluster [DBG] pgmap v5441: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:40:06.199 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:40:05 smithi188 bash[23329]: cluster 2020-07-16T16:40:03.936630+0000 mgr.x (mgr.34562) 8723 : cluster [DBG] pgmap v5441: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:40:08.057 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:40:07 smithi132 bash[27079]: cluster 2020-07-16T16:40:05.937035+0000 mgr.x (mgr.34562) 8724 : cluster [DBG] pgmap v5442: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:40:08.199 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:40:07 smithi188 bash[23329]: cluster 2020-07-16T16:40:05.937035+0000 mgr.x (mgr.34562) 8724 : cluster [DBG] pgmap v5442: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:40:10.057 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:40:09 smithi132 bash[27079]: cluster 2020-07-16T16:40:07.937532+0000 mgr.x (mgr.34562) 8725 : cluster [DBG] pgmap v5443: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:40:10.199 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:40:09 smithi188 bash[23329]: cluster 2020-07-16T16:40:07.937532+0000 mgr.x (mgr.34562) 8725 : cluster [DBG] pgmap v5443: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:40:12.057 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:40:11 smithi132 bash[27079]: cluster 2020-07-16T16:40:09.938070+0000 mgr.x (mgr.34562) 8726 : cluster [DBG] pgmap v5444: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:40:12.199 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:40:11 smithi188 bash[23329]: cluster 2020-07-16T16:40:09.938070+0000 mgr.x (mgr.34562) 8726 : cluster [DBG] pgmap v5444: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:40:14.057 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:40:13 smithi132 bash[27079]: cluster 2020-07-16T16:40:11.938693+0000 mgr.x (mgr.34562) 8727 : cluster [DBG] pgmap v5445: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:40:14.057 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:40:13 smithi132 bash[27079]: audit 2020-07-16T16:40:13.160601+0000 mon.b (mon.2) 1839 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:40:14.198 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:40:13 smithi188 bash[23329]: cluster 2020-07-16T16:40:11.938693+0000 mgr.x (mgr.34562) 8727 : cluster [DBG] pgmap v5445: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:40:14.199 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:40:13 smithi188 bash[23329]: audit 2020-07-16T16:40:13.160601+0000 mon.b (mon.2) 1839 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:40:15.057 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:40:14 smithi132 bash[27079]: cephadm 2020-07-16T16:40:13.161328+0000 mgr.x (mgr.34562) 8728 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:40:15.057 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:40:14 smithi132 bash[27079]: cephadm 2020-07-16T16:40:13.161724+0000 mgr.x (mgr.34562) 8729 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:40:15.198 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:40:14 smithi188 bash[23329]: cephadm 2020-07-16T16:40:13.161328+0000 mgr.x (mgr.34562) 8728 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:40:15.199 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:40:14 smithi188 bash[23329]: cephadm 2020-07-16T16:40:13.161724+0000 mgr.x (mgr.34562) 8729 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:40:16.056 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:40:15 smithi132 bash[27079]: cluster 2020-07-16T16:40:13.939049+0000 mgr.x (mgr.34562) 8730 : cluster [DBG] pgmap v5446: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:40:16.198 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:40:15 smithi188 bash[23329]: cluster 2020-07-16T16:40:13.939049+0000 mgr.x (mgr.34562) 8730 : cluster [DBG] pgmap v5446: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:40:18.056 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:40:17 smithi132 bash[27079]: cluster 2020-07-16T16:40:15.939563+0000 mgr.x (mgr.34562) 8731 : cluster [DBG] pgmap v5447: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:40:18.198 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:40:17 smithi188 bash[23329]: cluster 2020-07-16T16:40:15.939563+0000 mgr.x (mgr.34562) 8731 : cluster [DBG] pgmap v5447: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:40:20.056 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:40:19 smithi132 bash[27079]: cluster 2020-07-16T16:40:17.940139+0000 mgr.x (mgr.34562) 8732 : cluster [DBG] pgmap v5448: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:40:20.198 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:40:19 smithi188 bash[23329]: cluster 2020-07-16T16:40:17.940139+0000 mgr.x (mgr.34562) 8732 : cluster [DBG] pgmap v5448: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:40:21.084 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:40:21.347 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:40:21.347 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (3h) 119s ago 3h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:40:21.348 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (3h) 119s ago 3h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:40:21.348 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (3h) 119s ago 3h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:40:21.348 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (3h) 119s ago 3h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:40:21.349 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 119s ago 3h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:40:21.349 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (3h) 119s ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:40:21.349 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (3h) 119s ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:40:21.349 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (3h) 119s ago 3h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:40:21.350 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (3h) 119s ago 3h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:40:21.350 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (3h) 119s ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:40:21.350 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (3h) 119s ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:40:21.351 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (3h) 119s ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:40:21.351 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (3h) 119s ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:40:21.351 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (3h) 119s ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:40:21.352 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (3h) 119s ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:40:21.352 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (3h) 119s ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:40:21.352 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (3h) 119s ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:40:21.353 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (3h) 119s ago 3h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:40:21.662 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:40:21.663 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:40:21.664 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:40:21.664 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:40:21.665 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:40:21.665 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:40:21.670 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:40:21.670 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:40:21.671 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:40:21.671 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:40:21.672 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:40:21.672 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:40:21.673 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:40:21.673 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:40:21.674 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:40:21.674 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:40:21.675 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:40:22.056 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:40:21 smithi132 bash[27079]: cluster 2020-07-16T16:40:19.940642+0000 mgr.x (mgr.34562) 8733 : cluster [DBG] pgmap v5449: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:40:22.057 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:40:21 smithi132 bash[27079]: audit 2020-07-16T16:40:21.634571+0000 mon.c (mon.1) 578 : audit [DBG] from='client.? 172.21.15.132:0/40393103' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:40:22.197 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:40:21 smithi188 bash[23329]: cluster 2020-07-16T16:40:19.940642+0000 mgr.x (mgr.34562) 8733 : cluster [DBG] pgmap v5449: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:40:22.198 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:40:21 smithi188 bash[23329]: audit 2020-07-16T16:40:21.634571+0000 mon.c (mon.1) 578 : audit [DBG] from='client.? 172.21.15.132:0/40393103' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:40:23.056 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:40:22 smithi132 bash[27079]: audit 2020-07-16T16:40:21.045523+0000 mgr.x (mgr.34562) 8734 : audit [DBG] from='client.30994 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:40:23.056 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:40:22 smithi132 bash[27079]: audit 2020-07-16T16:40:21.315666+0000 mgr.x (mgr.34562) 8735 : audit [DBG] from='client.31000 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:40:23.197 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:40:22 smithi188 bash[23329]: audit 2020-07-16T16:40:21.045523+0000 mgr.x (mgr.34562) 8734 : audit [DBG] from='client.30994 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:40:23.198 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:40:22 smithi188 bash[23329]: audit 2020-07-16T16:40:21.315666+0000 mgr.x (mgr.34562) 8735 : audit [DBG] from='client.31000 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:40:24.055 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:40:23 smithi132 bash[27079]: cluster 2020-07-16T16:40:21.941047+0000 mgr.x (mgr.34562) 8736 : cluster [DBG] pgmap v5450: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:40:24.197 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:40:23 smithi188 bash[23329]: cluster 2020-07-16T16:40:21.941047+0000 mgr.x (mgr.34562) 8736 : cluster [DBG] pgmap v5450: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:40:26.056 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:40:25 smithi132 bash[27079]: cluster 2020-07-16T16:40:23.941463+0000 mgr.x (mgr.34562) 8737 : cluster [DBG] pgmap v5451: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:40:26.197 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:40:25 smithi188 bash[23329]: cluster 2020-07-16T16:40:23.941463+0000 mgr.x (mgr.34562) 8737 : cluster [DBG] pgmap v5451: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:40:28.055 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:40:27 smithi132 bash[27079]: cluster 2020-07-16T16:40:25.941842+0000 mgr.x (mgr.34562) 8738 : cluster [DBG] pgmap v5452: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:40:28.197 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:40:27 smithi188 bash[23329]: cluster 2020-07-16T16:40:25.941842+0000 mgr.x (mgr.34562) 8738 : cluster [DBG] pgmap v5452: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:40:29.057 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:40:28 smithi132 bash[27079]: audit 2020-07-16T16:40:28.406576+0000 mon.b (mon.2) 1840 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.280703\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.280774\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.280806\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.280964\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.281065\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.281161\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.281257\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.281314\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.281345\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T16:38:22.281418\", \"last_device_update\": \"2020-07-16T16:37:16.925684\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T16:40:28.405737\"}"}]: dispatch 2020-07-16T16:40:29.058 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:40:28 smithi132 bash[27079]: audit 2020-07-16T16:40:28.407020+0000 mon.c (mon.1) 579 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.280703\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.280774\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.280806\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.280964\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.281065\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.281161\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.281257\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.281314\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.281345\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T16:38:22.281418\", \"last_device_update\": \"2020-07-16T16:37:16.925684\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T16:40:28.405737\"}"}]: dispatch 2020-07-16T16:40:29.058 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:40:28 smithi132 bash[27079]: audit 2020-07-16T16:40:28.407795+0000 mon.b (mon.2) 1841 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T16:38:21.961826\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.961886\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.961924\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.961955\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.962149\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.962280\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.962396\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.962579\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.962649\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T16:38:21.962734\", \"last_device_update\": \"2020-07-16T16:36:11.336233\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T16:40:28.407067\"}"}]: dispatch 2020-07-16T16:40:29.059 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:40:28 smithi132 bash[27079]: audit 2020-07-16T16:40:28.409565+0000 mon.c (mon.1) 580 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.280703\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.280774\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.280806\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.280964\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.281065\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.281161\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.281257\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.281314\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.281345\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T16:38:22.281418\", \"last_device_update\": \"2020-07-16T16:37:16.925684\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T16:40:28.405737\"}"}]': finished 2020-07-16T16:40:29.059 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:40:28 smithi132 bash[27079]: audit 2020-07-16T16:40:28.409790+0000 mon.c (mon.1) 581 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T16:38:21.961826\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.961886\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.961924\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.961955\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.962149\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.962280\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.962396\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.962579\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.962649\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T16:38:21.962734\", \"last_device_update\": \"2020-07-16T16:36:11.336233\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T16:40:28.407067\"}"}]: dispatch 2020-07-16T16:40:29.060 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:40:28 smithi132 bash[27079]: audit 2020-07-16T16:40:28.412239+0000 mon.c (mon.1) 582 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T16:38:21.961826\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.961886\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.961924\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.961955\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.962149\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.962280\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.962396\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.962579\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.962649\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T16:38:21.962734\", \"last_device_update\": \"2020-07-16T16:36:11.336233\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T16:40:28.407067\"}"}]': finished 2020-07-16T16:40:29.060 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:40:28 smithi132 bash[27079]: audit 2020-07-16T16:40:28.416566+0000 mon.b (mon.2) 1842 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:40:29.060 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:40:28 smithi132 bash[27079]: audit 2020-07-16T16:40:28.417483+0000 mon.b (mon.2) 1843 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:40:29.061 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:40:28 smithi132 bash[27079]: audit 2020-07-16T16:40:28.418295+0000 mon.b (mon.2) 1844 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:40:29.061 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:40:28 smithi132 bash[27079]: audit 2020-07-16T16:40:28.419162+0000 mon.b (mon.2) 1845 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:40:29.061 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:40:28 smithi132 bash[27079]: audit 2020-07-16T16:40:28.420099+0000 mon.b (mon.2) 1846 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:40:29.099 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:40:28 smithi188 bash[23329]: audit 2020-07-16T16:40:28.406576+0000 mon.b (mon.2) 1840 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.280703\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.280774\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.280806\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.280964\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.281065\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.281161\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.281257\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.281314\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.281345\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T16:38:22.281418\", \"last_device_update\": \"2020-07-16T16:37:16.925684\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T16:40:28.405737\"}"}]: dispatch 2020-07-16T16:40:29.100 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:40:28 smithi188 bash[23329]: audit 2020-07-16T16:40:28.407020+0000 mon.c (mon.1) 579 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.280703\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.280774\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.280806\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.280964\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.281065\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.281161\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.281257\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.281314\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.281345\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T16:38:22.281418\", \"last_device_update\": \"2020-07-16T16:37:16.925684\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T16:40:28.405737\"}"}]: dispatch 2020-07-16T16:40:29.100 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:40:28 smithi188 bash[23329]: audit 2020-07-16T16:40:28.407795+0000 mon.b (mon.2) 1841 : audit [INF] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T16:38:21.961826\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.961886\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.961924\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.961955\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.962149\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.962280\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.962396\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.962579\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.962649\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T16:38:21.962734\", \"last_device_update\": \"2020-07-16T16:36:11.336233\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T16:40:28.407067\"}"}]: dispatch 2020-07-16T16:40:29.101 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:40:28 smithi188 bash[23329]: audit 2020-07-16T16:40:28.409565+0000 mon.c (mon.1) 580 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi188","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"169df9f5fb9d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.280703\", \"created\": \"2020-07-16T13:31:10.489756\", \"started\": \"2020-07-16T13:31:10.538803\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi188\", \"container_id\": \"2e95f416d8f0\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.280774\", \"created\": \"2020-07-16T13:31:23.555506\", \"started\": \"2020-07-16T13:36:56.021419\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi188\", \"container_id\": \"58eb7519ce63\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.280806\", \"created\": \"2020-07-16T13:32:42.226001\", \"started\": \"2020-07-16T13:33:02.001370\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi188\", \"container_id\": \"53df92e732cc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.280964\", \"created\": \"2020-07-16T13:33:02.260617\", \"started\": \"2020-07-16T13:33:04.168684\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi188\", \"container_id\": \"7981505d5f0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.281065\", \"created\": \"2020-07-16T13:33:19.454288\", \"started\": \"2020-07-16T13:33:21.233910\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi188\", \"container_id\": \"5a270dcc2599\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.281161\", \"created\": \"2020-07-16T13:33:36.640960\", \"started\": \"2020-07-16T13:33:38.429104\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"a143aea22145\", \"container_image_id\": \"9f345bfa8fefdd9580d5bd951a99e105af38d6047878c4bfb7c5c0250f77998e\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"version\": \"2.19.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.281257\", \"created\": \"2020-07-16T13:33:56.982571\", \"started\": \"2020-07-16T13:34:46.877731\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"smithi188\", \"container_id\": \"379b3ae3abda\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.281314\", \"created\": \"2020-07-16T13:33:57.481562\", \"started\": \"2020-07-16T13:34:01.531419\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"smithi188\", \"container_id\": \"ac88c2d305d5\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:22.281345\", \"created\": \"2020-07-16T13:34:31.510911\", \"started\": \"2020-07-16T13:34:31.556760\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1c6baa9-7ca9-4bf4-aeea-2fb5564fe077\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"fguRMU-h27X-Uyij-ZB8w-RGO8-nLEi-XIEcFP\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a7c2ccf5-4bf1-49ad-b927-a5dec96c641f\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"QFNDbc-q1Rg-qQLF-tTxn-vMeY-20tN-Tk319Y\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"04a15200-6710-4b02-9351-c321c8619514\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"nGzicE-mOo6-3Wr4-GhK9-S6v2-kEVH-DJQ8kc\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"78d29045-b36d-4f75-b245-d0f79869b999\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"V6c3jC-lzcb-tgA5-3FKa-KVfP-lhlO-Z4QfBW\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500MP400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XTEX\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:14.678293\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-07-16T13:36:43.512698\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:57.062550\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:00.249340\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:17.968577\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:35.192019\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2020-07-16T13:34:41.938599\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.020689\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2020-07-16T13:34:12.965490\"}}, \"last_daemon_update\": \"2020-07-16T16:38:22.281418\", \"last_device_update\": \"2020-07-16T16:37:16.925684\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.188\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8039\"]}, \"last_host_check\": \"2020-07-16T16:40:28.405737\"}"}]': finished 2020-07-16T16:40:29.101 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:40:28 smithi188 bash[23329]: audit 2020-07-16T16:40:28.409790+0000 mon.c (mon.1) 581 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T16:38:21.961826\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.961886\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.961924\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.961955\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.962149\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.962280\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.962396\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.962579\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.962649\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T16:38:21.962734\", \"last_device_update\": \"2020-07-16T16:36:11.336233\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T16:40:28.407067\"}"}]: dispatch 2020-07-16T16:40:29.102 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:40:28 smithi188 bash[23329]: audit 2020-07-16T16:40:28.412239+0000 mon.c (mon.1) 582 : audit [INF] from='mgr.34562 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi132","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2020-07-16T16:38:21.961826\", \"created\": \"2020-07-16T13:29:34.140048\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi132\", \"container_id\": \"9f86dd60ad4e\", \"container_image_id\": \"4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca\", \"version\": \"16.0.0-3349-g7260671e53b\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.961886\", \"created\": \"2020-07-16T13:29:40.508887\", \"started\": \"2020-07-16T13:37:30.207343\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi132\", \"container_id\": \"240c36a54649\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.961924\", \"created\": \"2020-07-16T13:30:58.460914\", \"started\": \"2020-07-16T13:30:58.512469\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi132\", \"container_id\": \"440f85c650d2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.961955\", \"created\": \"2020-07-16T13:31:37.557928\", \"started\": \"2020-07-16T13:31:39.246802\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi132\", \"container_id\": \"b7c66d3e8979\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.962149\", \"created\": \"2020-07-16T13:31:53.818518\", \"started\": \"2020-07-16T13:31:55.604271\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi132\", \"container_id\": \"781335bb0392\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.962280\", \"created\": \"2020-07-16T13:32:10.695093\", \"started\": \"2020-07-16T13:32:12.460287\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi132\", \"container_id\": \"cba1b711fd95\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.962396\", \"created\": \"2020-07-16T13:32:27.347674\", \"started\": \"2020-07-16T13:32:28.864429\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"3bf4a744ea1e\", \"container_image_id\": \"0e0218889c33b5fbb9e158d45ff6193c7c145b4ce3ec348045626cfa09f8331d\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"version\": \"1.0.1\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.962579\", \"created\": \"2020-07-16T13:33:57.978389\", \"started\": \"2020-07-16T13:34:01.289144\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"smithi132\", \"container_id\": \"30a3c37e52ed\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2020-07-16T16:38:21.962649\", \"created\": \"2020-07-16T13:34:12.925012\", \"started\": \"2020-07-16T13:37:14.704850\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"72a90982-aa5f-4c26-9afe-50294c5c503b\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"ghnpv1-OPl0-stKX-3Hcw-PtnE-OgG0-74HfFZ\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"79e0e8c0-9b49-4a93-9185-918c9a5cd4d0\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"KOS8wC-fM1f-wIbm-Vzde-8pQP-R3xm-5fytlS\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"39ea8fcd-c323-4683-9f7c-4f373a4e4f67\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"4wNvcj-rTzS-MrYX-wPWU-sZbL-Ld0N-xjA9F4\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"882744a6-1a4e-4c33-86ea-b3ae0c9db141\", \"cluster_fsid\": \"4c8ed362-c768-11ea-a06f-001a4aab830c\", \"block_uuid\": \"kaAgZ2-DOB2-byXW-RU4v-f2ER-Qv6M-ddPkTG\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT6232000B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XM6D\"}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:05.546315\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:17.779002\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:36.217252\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-07-16T13:31:52.413977\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:09.243203\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-07-16T13:32:25.894784\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:33:57.517255\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2020-07-16T13:37:07.007755\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2020-07-16T13:37:34.248685\"}}, \"last_daemon_update\": \"2020-07-16T16:38:21.962734\", \"last_device_update\": \"2020-07-16T16:36:11.336233\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.132\"], \"::1\": [\"::1\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:773f\"]}, \"last_host_check\": \"2020-07-16T16:40:28.407067\"}"}]': finished 2020-07-16T16:40:29.106 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:40:28 smithi188 bash[23329]: audit 2020-07-16T16:40:28.416566+0000 mon.b (mon.2) 1842 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:40:29.106 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:40:28 smithi188 bash[23329]: audit 2020-07-16T16:40:28.417483+0000 mon.b (mon.2) 1843 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:40:29.106 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:40:28 smithi188 bash[23329]: audit 2020-07-16T16:40:28.418295+0000 mon.b (mon.2) 1844 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:40:29.107 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:40:28 smithi188 bash[23329]: audit 2020-07-16T16:40:28.419162+0000 mon.b (mon.2) 1845 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:40:29.107 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:40:28 smithi188 bash[23329]: audit 2020-07-16T16:40:28.420099+0000 mon.b (mon.2) 1846 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:40:30.055 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:40:29 smithi132 bash[27079]: cluster 2020-07-16T16:40:27.942357+0000 mgr.x (mgr.34562) 8739 : cluster [DBG] pgmap v5453: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:40:30.056 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:40:29 smithi132 bash[27079]: audit 2020-07-16T16:40:28.416834+0000 mgr.x (mgr.34562) 8740 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:40:30.056 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:40:29 smithi132 bash[27079]: audit 2020-07-16T16:40:28.417718+0000 mgr.x (mgr.34562) 8741 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:40:30.057 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:40:29 smithi132 bash[27079]: audit 2020-07-16T16:40:28.418498+0000 mgr.x (mgr.34562) 8742 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:40:30.057 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:40:29 smithi132 bash[27079]: cephadm 2020-07-16T16:40:28.418973+0000 mgr.x (mgr.34562) 8743 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:40:30.057 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:40:29 smithi132 bash[27079]: cephadm 2020-07-16T16:40:28.419799+0000 mgr.x (mgr.34562) 8744 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:40:30.058 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:40:29 smithi132 bash[27079]: cephadm 2020-07-16T16:40:28.420598+0000 mgr.x (mgr.34562) 8745 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:40:30.058 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:40:29 smithi132 bash[27079]: cephadm 2020-07-16T16:40:28.420670+0000 mgr.x (mgr.34562) 8746 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:40:30.197 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:40:29 smithi188 bash[23329]: cluster 2020-07-16T16:40:27.942357+0000 mgr.x (mgr.34562) 8739 : cluster [DBG] pgmap v5453: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:40:30.197 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:40:29 smithi188 bash[23329]: audit 2020-07-16T16:40:28.416834+0000 mgr.x (mgr.34562) 8740 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:40:30.198 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:40:29 smithi188 bash[23329]: audit 2020-07-16T16:40:28.417718+0000 mgr.x (mgr.34562) 8741 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:40:30.198 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:40:29 smithi188 bash[23329]: audit 2020-07-16T16:40:28.418498+0000 mgr.x (mgr.34562) 8742 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:40:30.198 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:40:29 smithi188 bash[23329]: cephadm 2020-07-16T16:40:28.418973+0000 mgr.x (mgr.34562) 8743 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:40:30.199 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:40:29 smithi188 bash[23329]: cephadm 2020-07-16T16:40:28.419799+0000 mgr.x (mgr.34562) 8744 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:40:30.199 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:40:29 smithi188 bash[23329]: cephadm 2020-07-16T16:40:28.420598+0000 mgr.x (mgr.34562) 8745 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:40:30.199 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:40:29 smithi188 bash[23329]: cephadm 2020-07-16T16:40:28.420670+0000 mgr.x (mgr.34562) 8746 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:40:32.055 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:40:31 smithi132 bash[27079]: cluster 2020-07-16T16:40:29.942881+0000 mgr.x (mgr.34562) 8747 : cluster [DBG] pgmap v5454: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:40:32.056 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:40:31 smithi132 bash[27079]: audit 2020-07-16T16:40:31.213572+0000 mon.b (mon.2) 1847 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:40:32.196 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:40:31 smithi188 bash[23329]: cluster 2020-07-16T16:40:29.942881+0000 mgr.x (mgr.34562) 8747 : cluster [DBG] pgmap v5454: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:40:32.197 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:40:31 smithi188 bash[23329]: audit 2020-07-16T16:40:31.213572+0000 mon.b (mon.2) 1847 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:40:33.055 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:40:32 smithi132 bash[27079]: cephadm 2020-07-16T16:40:31.214176+0000 mgr.x (mgr.34562) 8748 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:40:33.055 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:40:32 smithi132 bash[27079]: cephadm 2020-07-16T16:40:31.214604+0000 mgr.x (mgr.34562) 8749 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:40:33.196 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:40:32 smithi188 bash[23329]: cephadm 2020-07-16T16:40:31.214176+0000 mgr.x (mgr.34562) 8748 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:40:33.197 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:40:32 smithi188 bash[23329]: cephadm 2020-07-16T16:40:31.214604+0000 mgr.x (mgr.34562) 8749 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:40:34.196 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:40:33 smithi188 bash[23329]: cluster 2020-07-16T16:40:31.943346+0000 mgr.x (mgr.34562) 8750 : cluster [DBG] pgmap v5455: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:40:34.305 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:40:33 smithi132 bash[27079]: cluster 2020-07-16T16:40:31.943346+0000 mgr.x (mgr.34562) 8750 : cluster [DBG] pgmap v5455: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:40:35.196 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:40:34 smithi188 bash[23329]: cluster 2020-07-16T16:40:33.943821+0000 mgr.x (mgr.34562) 8751 : cluster [DBG] pgmap v5456: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:40:35.305 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:40:34 smithi132 bash[27079]: cluster 2020-07-16T16:40:33.943821+0000 mgr.x (mgr.34562) 8751 : cluster [DBG] pgmap v5456: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:40:37.696 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:40:37 smithi188 bash[23329]: cluster 2020-07-16T16:40:35.944242+0000 mgr.x (mgr.34562) 8752 : cluster [DBG] pgmap v5457: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:40:37.804 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:40:37 smithi132 bash[27079]: cluster 2020-07-16T16:40:35.944242+0000 mgr.x (mgr.34562) 8752 : cluster [DBG] pgmap v5457: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:40:39.696 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:40:39 smithi188 bash[23329]: cluster 2020-07-16T16:40:37.944679+0000 mgr.x (mgr.34562) 8753 : cluster [DBG] pgmap v5458: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:40:39.805 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:40:39 smithi132 bash[27079]: cluster 2020-07-16T16:40:37.944679+0000 mgr.x (mgr.34562) 8753 : cluster [DBG] pgmap v5458: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:40:41.696 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:40:41 smithi188 bash[23329]: cluster 2020-07-16T16:40:39.945130+0000 mgr.x (mgr.34562) 8754 : cluster [DBG] pgmap v5459: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:40:41.804 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:40:41 smithi132 bash[27079]: cluster 2020-07-16T16:40:39.945130+0000 mgr.x (mgr.34562) 8754 : cluster [DBG] pgmap v5459: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:40:43.696 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:40:43 smithi188 bash[23329]: cluster 2020-07-16T16:40:41.945597+0000 mgr.x (mgr.34562) 8755 : cluster [DBG] pgmap v5460: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:40:43.804 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:40:43 smithi132 bash[27079]: cluster 2020-07-16T16:40:41.945597+0000 mgr.x (mgr.34562) 8755 : cluster [DBG] pgmap v5460: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:40:45.699 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:40:45 smithi188 bash[23329]: cluster 2020-07-16T16:40:43.945979+0000 mgr.x (mgr.34562) 8756 : cluster [DBG] pgmap v5461: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:40:45.804 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:40:45 smithi132 bash[27079]: cluster 2020-07-16T16:40:43.945979+0000 mgr.x (mgr.34562) 8756 : cluster [DBG] pgmap v5461: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:40:46.696 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:40:46 smithi188 bash[23329]: audit 2020-07-16T16:40:46.230057+0000 mon.b (mon.2) 1848 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:40:46.804 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:40:46 smithi132 bash[27079]: audit 2020-07-16T16:40:46.230057+0000 mon.b (mon.2) 1848 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:40:47.696 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:40:47 smithi188 bash[23329]: cluster 2020-07-16T16:40:45.946479+0000 mgr.x (mgr.34562) 8757 : cluster [DBG] pgmap v5462: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:40:47.696 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:40:47 smithi188 bash[23329]: cephadm 2020-07-16T16:40:46.230771+0000 mgr.x (mgr.34562) 8758 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:40:47.697 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:40:47 smithi188 bash[23329]: cephadm 2020-07-16T16:40:46.231065+0000 mgr.x (mgr.34562) 8759 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:40:47.804 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:40:47 smithi132 bash[27079]: cluster 2020-07-16T16:40:45.946479+0000 mgr.x (mgr.34562) 8757 : cluster [DBG] pgmap v5462: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:40:47.804 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:40:47 smithi132 bash[27079]: cephadm 2020-07-16T16:40:46.230771+0000 mgr.x (mgr.34562) 8758 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:40:47.805 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:40:47 smithi132 bash[27079]: cephadm 2020-07-16T16:40:46.231065+0000 mgr.x (mgr.34562) 8759 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:40:49.696 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:40:49 smithi188 bash[23329]: cluster 2020-07-16T16:40:47.946874+0000 mgr.x (mgr.34562) 8760 : cluster [DBG] pgmap v5463: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:40:49.804 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:40:49 smithi132 bash[27079]: cluster 2020-07-16T16:40:47.946874+0000 mgr.x (mgr.34562) 8760 : cluster [DBG] pgmap v5463: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:40:51.696 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:40:51 smithi188 bash[23329]: cluster 2020-07-16T16:40:49.947294+0000 mgr.x (mgr.34562) 8761 : cluster [DBG] pgmap v5464: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:40:51.804 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:40:51 smithi132 bash[27079]: cluster 2020-07-16T16:40:49.947294+0000 mgr.x (mgr.34562) 8761 : cluster [DBG] pgmap v5464: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:40:51.959 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:40:52.218 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:40:52.219 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (3h) 2m ago 3h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:40:52.220 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (3h) 2m ago 3h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:40:52.220 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (3h) 2m ago 3h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:40:52.221 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (3h) 2m ago 3h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:40:52.221 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 2m ago 3h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:40:52.221 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (3h) 2m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:40:52.222 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (3h) 2m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:40:52.222 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (3h) 2m ago 3h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:40:52.222 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (3h) 2m ago 3h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:40:52.223 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (3h) 2m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:40:52.223 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (3h) 2m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:40:52.223 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (3h) 2m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:40:52.224 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (3h) 2m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:40:52.224 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (3h) 2m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:40:52.224 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (3h) 2m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:40:52.225 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (3h) 2m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:40:52.225 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (3h) 2m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:40:52.225 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (3h) 2m ago 3h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:40:52.515 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:40:52.516 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:40:52.516 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:40:52.517 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:40:52.518 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:40:52.518 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:40:52.518 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:40:52.519 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:40:52.519 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:40:52.519 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:40:52.520 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:40:52.520 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:40:52.520 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:40:52.521 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:40:52.521 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:40:52.521 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:40:52.522 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:40:53.696 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:40:53 smithi188 bash[23329]: audit 2020-07-16T16:40:51.922516+0000 mgr.x (mgr.34562) 8762 : audit [DBG] from='client.31012 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:40:53.696 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:40:53 smithi188 bash[23329]: cluster 2020-07-16T16:40:51.947763+0000 mgr.x (mgr.34562) 8763 : cluster [DBG] pgmap v5465: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:40:53.696 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:40:53 smithi188 bash[23329]: audit 2020-07-16T16:40:52.188937+0000 mgr.x (mgr.34562) 8764 : audit [DBG] from='client.31018 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:40:53.697 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:40:53 smithi188 bash[23329]: audit 2020-07-16T16:40:52.488997+0000 mon.c (mon.1) 583 : audit [DBG] from='client.? 172.21.15.132:0/2486631097' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:40:53.804 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:40:53 smithi132 bash[27079]: audit 2020-07-16T16:40:51.922516+0000 mgr.x (mgr.34562) 8762 : audit [DBG] from='client.31012 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:40:53.804 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:40:53 smithi132 bash[27079]: cluster 2020-07-16T16:40:51.947763+0000 mgr.x (mgr.34562) 8763 : cluster [DBG] pgmap v5465: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:40:53.805 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:40:53 smithi132 bash[27079]: audit 2020-07-16T16:40:52.188937+0000 mgr.x (mgr.34562) 8764 : audit [DBG] from='client.31018 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:40:53.805 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:40:53 smithi132 bash[27079]: audit 2020-07-16T16:40:52.488997+0000 mon.c (mon.1) 583 : audit [DBG] from='client.? 172.21.15.132:0/2486631097' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:40:55.696 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:40:55 smithi188 bash[23329]: cluster 2020-07-16T16:40:53.948183+0000 mgr.x (mgr.34562) 8765 : cluster [DBG] pgmap v5466: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:40:55.804 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:40:55 smithi132 bash[27079]: cluster 2020-07-16T16:40:53.948183+0000 mgr.x (mgr.34562) 8765 : cluster [DBG] pgmap v5466: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:40:57.804 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:40:57 smithi132 bash[27079]: cluster 2020-07-16T16:40:55.948555+0000 mgr.x (mgr.34562) 8766 : cluster [DBG] pgmap v5467: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:40:57.946 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:40:57 smithi188 bash[23329]: cluster 2020-07-16T16:40:55.948555+0000 mgr.x (mgr.34562) 8766 : cluster [DBG] pgmap v5467: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:40:59.804 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:40:59 smithi132 bash[27079]: cluster 2020-07-16T16:40:57.948933+0000 mgr.x (mgr.34562) 8767 : cluster [DBG] pgmap v5468: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:40:59.946 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:40:59 smithi188 bash[23329]: cluster 2020-07-16T16:40:57.948933+0000 mgr.x (mgr.34562) 8767 : cluster [DBG] pgmap v5468: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:41:01.804 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:41:01 smithi132 bash[27079]: cluster 2020-07-16T16:40:59.949342+0000 mgr.x (mgr.34562) 8768 : cluster [DBG] pgmap v5469: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:41:01.805 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:41:01 smithi132 bash[27079]: audit 2020-07-16T16:41:01.246726+0000 mon.b (mon.2) 1849 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:41:01.946 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:41:01 smithi188 bash[23329]: cluster 2020-07-16T16:40:59.949342+0000 mgr.x (mgr.34562) 8768 : cluster [DBG] pgmap v5469: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:41:01.946 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:41:01 smithi188 bash[23329]: audit 2020-07-16T16:41:01.246726+0000 mon.b (mon.2) 1849 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:41:02.804 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:41:02 smithi132 bash[27079]: cephadm 2020-07-16T16:41:01.247403+0000 mgr.x (mgr.34562) 8769 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:41:02.805 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:41:02 smithi132 bash[27079]: cephadm 2020-07-16T16:41:01.247480+0000 mgr.x (mgr.34562) 8770 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:41:02.946 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:41:02 smithi188 bash[23329]: cephadm 2020-07-16T16:41:01.247403+0000 mgr.x (mgr.34562) 8769 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:41:02.946 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:41:02 smithi188 bash[23329]: cephadm 2020-07-16T16:41:01.247480+0000 mgr.x (mgr.34562) 8770 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:41:03.807 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:41:03 smithi132 bash[27079]: cluster 2020-07-16T16:41:01.949879+0000 mgr.x (mgr.34562) 8771 : cluster [DBG] pgmap v5470: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:41:03.946 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:41:03 smithi188 bash[23329]: cluster 2020-07-16T16:41:01.949879+0000 mgr.x (mgr.34562) 8771 : cluster [DBG] pgmap v5470: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:41:05.804 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:41:05 smithi132 bash[27079]: cluster 2020-07-16T16:41:03.950322+0000 mgr.x (mgr.34562) 8772 : cluster [DBG] pgmap v5471: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:41:05.946 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:41:05 smithi188 bash[23329]: cluster 2020-07-16T16:41:03.950322+0000 mgr.x (mgr.34562) 8772 : cluster [DBG] pgmap v5471: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:41:07.804 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:41:07 smithi132 bash[27079]: cluster 2020-07-16T16:41:05.950832+0000 mgr.x (mgr.34562) 8773 : cluster [DBG] pgmap v5472: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:41:07.946 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:41:07 smithi188 bash[23329]: cluster 2020-07-16T16:41:05.950832+0000 mgr.x (mgr.34562) 8773 : cluster [DBG] pgmap v5472: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:41:09.804 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:41:09 smithi132 bash[27079]: cluster 2020-07-16T16:41:07.951441+0000 mgr.x (mgr.34562) 8774 : cluster [DBG] pgmap v5473: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:41:09.946 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:41:09 smithi188 bash[23329]: cluster 2020-07-16T16:41:07.951441+0000 mgr.x (mgr.34562) 8774 : cluster [DBG] pgmap v5473: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:41:11.804 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:41:11 smithi132 bash[27079]: cluster 2020-07-16T16:41:09.951853+0000 mgr.x (mgr.34562) 8775 : cluster [DBG] pgmap v5474: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:41:11.946 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:41:11 smithi188 bash[23329]: cluster 2020-07-16T16:41:09.951853+0000 mgr.x (mgr.34562) 8775 : cluster [DBG] pgmap v5474: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:41:13.804 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:41:13 smithi132 bash[27079]: cluster 2020-07-16T16:41:11.952277+0000 mgr.x (mgr.34562) 8776 : cluster [DBG] pgmap v5475: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:41:13.946 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:41:13 smithi188 bash[23329]: cluster 2020-07-16T16:41:11.952277+0000 mgr.x (mgr.34562) 8776 : cluster [DBG] pgmap v5475: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:41:15.804 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:41:15 smithi132 bash[27079]: cluster 2020-07-16T16:41:13.952732+0000 mgr.x (mgr.34562) 8777 : cluster [DBG] pgmap v5476: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:41:15.946 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:41:15 smithi188 bash[23329]: cluster 2020-07-16T16:41:13.952732+0000 mgr.x (mgr.34562) 8777 : cluster [DBG] pgmap v5476: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:41:16.805 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:41:16 smithi132 bash[27079]: audit 2020-07-16T16:41:16.249876+0000 mon.b (mon.2) 1850 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:41:16.946 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:41:16 smithi188 bash[23329]: audit 2020-07-16T16:41:16.249876+0000 mon.b (mon.2) 1850 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:41:17.804 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:41:17 smithi132 bash[27079]: cluster 2020-07-16T16:41:15.953208+0000 mgr.x (mgr.34562) 8778 : cluster [DBG] pgmap v5477: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:41:17.805 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:41:17 smithi132 bash[27079]: cephadm 2020-07-16T16:41:16.250505+0000 mgr.x (mgr.34562) 8779 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:41:17.805 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:41:17 smithi132 bash[27079]: cephadm 2020-07-16T16:41:16.250829+0000 mgr.x (mgr.34562) 8780 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:41:17.946 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:41:17 smithi188 bash[23329]: cluster 2020-07-16T16:41:15.953208+0000 mgr.x (mgr.34562) 8778 : cluster [DBG] pgmap v5477: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:41:17.947 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:41:17 smithi188 bash[23329]: cephadm 2020-07-16T16:41:16.250505+0000 mgr.x (mgr.34562) 8779 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:41:17.947 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:41:17 smithi188 bash[23329]: cephadm 2020-07-16T16:41:16.250829+0000 mgr.x (mgr.34562) 8780 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:41:19.805 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:41:19 smithi132 bash[27079]: cluster 2020-07-16T16:41:17.953620+0000 mgr.x (mgr.34562) 8781 : cluster [DBG] pgmap v5478: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:41:19.946 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:41:19 smithi188 bash[23329]: cluster 2020-07-16T16:41:17.953620+0000 mgr.x (mgr.34562) 8781 : cluster [DBG] pgmap v5478: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:41:21.805 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:41:21 smithi132 bash[27079]: cluster 2020-07-16T16:41:19.954035+0000 mgr.x (mgr.34562) 8782 : cluster [DBG] pgmap v5479: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:41:21.946 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:41:21 smithi188 bash[23329]: cluster 2020-07-16T16:41:19.954035+0000 mgr.x (mgr.34562) 8782 : cluster [DBG] pgmap v5479: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:41:22.815 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:41:23.076 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:41:23.077 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (3h) 3m ago 3h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:41:23.077 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (3h) 3m ago 3h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:41:23.078 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (3h) 3m ago 3h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:41:23.078 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (3h) 3m ago 3h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:41:23.078 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 3m ago 3h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:41:23.079 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (3h) 3m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:41:23.079 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (3h) 3m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:41:23.079 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (3h) 3m ago 3h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:41:23.080 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (3h) 3m ago 3h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:41:23.080 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (3h) 3m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:41:23.080 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (3h) 3m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:41:23.081 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (3h) 3m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:41:23.081 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (3h) 3m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:41:23.081 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (3h) 3m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:41:23.081 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (3h) 3m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:41:23.082 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (3h) 3m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:41:23.082 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (3h) 3m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:41:23.082 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (3h) 3m ago 3h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:41:23.373 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:41:23.374 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:41:23.374 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:41:23.374 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:41:23.375 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:41:23.375 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:41:23.375 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:41:23.376 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:41:23.376 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:41:23.376 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:41:23.377 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:41:23.377 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:41:23.377 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:41:23.378 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:41:23.378 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:41:23.378 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:41:23.379 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:41:23.805 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:41:23 smithi132 bash[27079]: cluster 2020-07-16T16:41:21.954485+0000 mgr.x (mgr.34562) 8783 : cluster [DBG] pgmap v5480: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:41:23.805 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:41:23 smithi132 bash[27079]: audit 2020-07-16T16:41:22.778191+0000 mgr.x (mgr.34562) 8784 : audit [DBG] from='client.31030 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:41:23.806 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:41:23 smithi132 bash[27079]: audit 2020-07-16T16:41:23.346554+0000 mon.c (mon.1) 584 : audit [DBG] from='client.? 172.21.15.132:0/1309182730' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:41:23.946 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:41:23 smithi188 bash[23329]: cluster 2020-07-16T16:41:21.954485+0000 mgr.x (mgr.34562) 8783 : cluster [DBG] pgmap v5480: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:41:23.947 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:41:23 smithi188 bash[23329]: audit 2020-07-16T16:41:22.778191+0000 mgr.x (mgr.34562) 8784 : audit [DBG] from='client.31030 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:41:23.947 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:41:23 smithi188 bash[23329]: audit 2020-07-16T16:41:23.346554+0000 mon.c (mon.1) 584 : audit [DBG] from='client.? 172.21.15.132:0/1309182730' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:41:24.805 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:41:24 smithi132 bash[27079]: audit 2020-07-16T16:41:23.046635+0000 mgr.x (mgr.34562) 8785 : audit [DBG] from='client.31036 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:41:24.946 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:41:24 smithi188 bash[23329]: audit 2020-07-16T16:41:23.046635+0000 mgr.x (mgr.34562) 8785 : audit [DBG] from='client.31036 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:41:25.805 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:41:25 smithi132 bash[27079]: cluster 2020-07-16T16:41:23.954901+0000 mgr.x (mgr.34562) 8786 : cluster [DBG] pgmap v5481: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:41:25.946 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:41:25 smithi188 bash[23329]: cluster 2020-07-16T16:41:23.954901+0000 mgr.x (mgr.34562) 8786 : cluster [DBG] pgmap v5481: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:41:27.805 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:41:27 smithi132 bash[27079]: cluster 2020-07-16T16:41:25.955392+0000 mgr.x (mgr.34562) 8787 : cluster [DBG] pgmap v5482: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:41:27.947 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:41:27 smithi188 bash[23329]: cluster 2020-07-16T16:41:25.955392+0000 mgr.x (mgr.34562) 8787 : cluster [DBG] pgmap v5482: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:41:29.805 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:41:29 smithi132 bash[27079]: cluster 2020-07-16T16:41:27.955832+0000 mgr.x (mgr.34562) 8788 : cluster [DBG] pgmap v5483: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:41:29.947 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:41:29 smithi188 bash[23329]: cluster 2020-07-16T16:41:27.955832+0000 mgr.x (mgr.34562) 8788 : cluster [DBG] pgmap v5483: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:41:31.805 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:41:31 smithi132 bash[27079]: cluster 2020-07-16T16:41:29.956221+0000 mgr.x (mgr.34562) 8789 : cluster [DBG] pgmap v5484: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:41:31.805 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:41:31 smithi132 bash[27079]: audit 2020-07-16T16:41:31.263419+0000 mon.b (mon.2) 1851 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:41:31.806 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:41:31 smithi132 bash[27079]: audit 2020-07-16T16:41:31.264803+0000 mon.b (mon.2) 1852 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:41:31.806 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:41:31 smithi132 bash[27079]: audit 2020-07-16T16:41:31.265903+0000 mon.b (mon.2) 1853 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:41:31.806 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:41:31 smithi132 bash[27079]: audit 2020-07-16T16:41:31.267265+0000 mon.b (mon.2) 1854 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:41:31.807 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:41:31 smithi132 bash[27079]: audit 2020-07-16T16:41:31.268571+0000 mon.b (mon.2) 1855 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:41:31.947 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:41:31 smithi188 bash[23329]: cluster 2020-07-16T16:41:29.956221+0000 mgr.x (mgr.34562) 8789 : cluster [DBG] pgmap v5484: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:41:31.947 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:41:31 smithi188 bash[23329]: audit 2020-07-16T16:41:31.263419+0000 mon.b (mon.2) 1851 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:41:31.948 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:41:31 smithi188 bash[23329]: audit 2020-07-16T16:41:31.264803+0000 mon.b (mon.2) 1852 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:41:31.948 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:41:31 smithi188 bash[23329]: audit 2020-07-16T16:41:31.265903+0000 mon.b (mon.2) 1853 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:41:31.948 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:41:31 smithi188 bash[23329]: audit 2020-07-16T16:41:31.267265+0000 mon.b (mon.2) 1854 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:41:31.949 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:41:31 smithi188 bash[23329]: audit 2020-07-16T16:41:31.268571+0000 mon.b (mon.2) 1855 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:41:32.805 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:41:32 smithi132 bash[27079]: audit 2020-07-16T16:41:31.263777+0000 mgr.x (mgr.34562) 8790 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:41:32.806 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:41:32 smithi132 bash[27079]: audit 2020-07-16T16:41:31.265094+0000 mgr.x (mgr.34562) 8791 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:41:32.806 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:41:32 smithi132 bash[27079]: audit 2020-07-16T16:41:31.266197+0000 mgr.x (mgr.34562) 8792 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:41:32.806 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:41:32 smithi132 bash[27079]: cephadm 2020-07-16T16:41:31.266925+0000 mgr.x (mgr.34562) 8793 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:41:32.807 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:41:32 smithi132 bash[27079]: cephadm 2020-07-16T16:41:31.268094+0000 mgr.x (mgr.34562) 8794 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:41:32.807 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:41:32 smithi132 bash[27079]: cephadm 2020-07-16T16:41:31.269276+0000 mgr.x (mgr.34562) 8795 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:41:32.807 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:41:32 smithi132 bash[27079]: cephadm 2020-07-16T16:41:31.269398+0000 mgr.x (mgr.34562) 8796 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:41:32.947 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:41:32 smithi188 bash[23329]: audit 2020-07-16T16:41:31.263777+0000 mgr.x (mgr.34562) 8790 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:41:32.947 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:41:32 smithi188 bash[23329]: audit 2020-07-16T16:41:31.265094+0000 mgr.x (mgr.34562) 8791 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:41:32.947 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:41:32 smithi188 bash[23329]: audit 2020-07-16T16:41:31.266197+0000 mgr.x (mgr.34562) 8792 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:41:32.948 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:41:32 smithi188 bash[23329]: cephadm 2020-07-16T16:41:31.266925+0000 mgr.x (mgr.34562) 8793 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:41:32.948 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:41:32 smithi188 bash[23329]: cephadm 2020-07-16T16:41:31.268094+0000 mgr.x (mgr.34562) 8794 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:41:32.948 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:41:32 smithi188 bash[23329]: cephadm 2020-07-16T16:41:31.269276+0000 mgr.x (mgr.34562) 8795 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:41:32.949 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:41:32 smithi188 bash[23329]: cephadm 2020-07-16T16:41:31.269398+0000 mgr.x (mgr.34562) 8796 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:41:33.806 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:41:33 smithi132 bash[27079]: cluster 2020-07-16T16:41:31.956770+0000 mgr.x (mgr.34562) 8797 : cluster [DBG] pgmap v5485: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:41:33.947 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:41:33 smithi188 bash[23329]: cluster 2020-07-16T16:41:31.956770+0000 mgr.x (mgr.34562) 8797 : cluster [DBG] pgmap v5485: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:41:34.805 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:41:34 smithi132 bash[27079]: audit 2020-07-16T16:41:34.107967+0000 mon.b (mon.2) 1856 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:41:34.947 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:41:34 smithi188 bash[23329]: audit 2020-07-16T16:41:34.107967+0000 mon.b (mon.2) 1856 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:41:35.805 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:41:35 smithi132 bash[27079]: cluster 2020-07-16T16:41:33.957209+0000 mgr.x (mgr.34562) 8798 : cluster [DBG] pgmap v5486: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:41:35.806 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:41:35 smithi132 bash[27079]: cephadm 2020-07-16T16:41:34.108579+0000 mgr.x (mgr.34562) 8799 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:41:35.806 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:41:35 smithi132 bash[27079]: cephadm 2020-07-16T16:41:34.108659+0000 mgr.x (mgr.34562) 8800 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:41:35.947 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:41:35 smithi188 bash[23329]: cluster 2020-07-16T16:41:33.957209+0000 mgr.x (mgr.34562) 8798 : cluster [DBG] pgmap v5486: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:41:35.947 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:41:35 smithi188 bash[23329]: cephadm 2020-07-16T16:41:34.108579+0000 mgr.x (mgr.34562) 8799 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:41:35.947 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:41:35 smithi188 bash[23329]: cephadm 2020-07-16T16:41:34.108659+0000 mgr.x (mgr.34562) 8800 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:41:37.806 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:41:37 smithi132 bash[27079]: cluster 2020-07-16T16:41:35.957713+0000 mgr.x (mgr.34562) 8801 : cluster [DBG] pgmap v5487: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:41:37.947 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:41:37 smithi188 bash[23329]: cluster 2020-07-16T16:41:35.957713+0000 mgr.x (mgr.34562) 8801 : cluster [DBG] pgmap v5487: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:41:39.805 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:41:39 smithi132 bash[27079]: cluster 2020-07-16T16:41:37.958180+0000 mgr.x (mgr.34562) 8802 : cluster [DBG] pgmap v5488: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:41:39.947 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:41:39 smithi188 bash[23329]: cluster 2020-07-16T16:41:37.958180+0000 mgr.x (mgr.34562) 8802 : cluster [DBG] pgmap v5488: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:41:41.947 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:41:41 smithi188 bash[23329]: cluster 2020-07-16T16:41:39.958701+0000 mgr.x (mgr.34562) 8803 : cluster [DBG] pgmap v5489: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:41:42.055 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:41:41 smithi132 bash[27079]: cluster 2020-07-16T16:41:39.958701+0000 mgr.x (mgr.34562) 8803 : cluster [DBG] pgmap v5489: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:41:43.947 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:41:43 smithi188 bash[23329]: cluster 2020-07-16T16:41:41.959134+0000 mgr.x (mgr.34562) 8804 : cluster [DBG] pgmap v5490: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:41:44.056 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:41:43 smithi132 bash[27079]: cluster 2020-07-16T16:41:41.959134+0000 mgr.x (mgr.34562) 8804 : cluster [DBG] pgmap v5490: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:41:45.947 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:41:45 smithi188 bash[23329]: cluster 2020-07-16T16:41:43.959503+0000 mgr.x (mgr.34562) 8805 : cluster [DBG] pgmap v5491: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:41:46.056 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:41:45 smithi132 bash[27079]: cluster 2020-07-16T16:41:43.959503+0000 mgr.x (mgr.34562) 8805 : cluster [DBG] pgmap v5491: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:41:47.948 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:41:47 smithi188 bash[23329]: cluster 2020-07-16T16:41:45.960027+0000 mgr.x (mgr.34562) 8806 : cluster [DBG] pgmap v5492: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:41:48.056 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:41:47 smithi132 bash[27079]: cluster 2020-07-16T16:41:45.960027+0000 mgr.x (mgr.34562) 8806 : cluster [DBG] pgmap v5492: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:41:49.948 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:41:49 smithi188 bash[23329]: cluster 2020-07-16T16:41:47.960465+0000 mgr.x (mgr.34562) 8807 : cluster [DBG] pgmap v5493: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:41:49.948 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:41:49 smithi188 bash[23329]: audit 2020-07-16T16:41:49.124404+0000 mon.b (mon.2) 1857 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:41:50.056 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:41:49 smithi132 bash[27079]: cluster 2020-07-16T16:41:47.960465+0000 mgr.x (mgr.34562) 8807 : cluster [DBG] pgmap v5493: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:41:50.056 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:41:49 smithi132 bash[27079]: audit 2020-07-16T16:41:49.124404+0000 mon.b (mon.2) 1857 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:41:50.948 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:41:50 smithi188 bash[23329]: cephadm 2020-07-16T16:41:49.125109+0000 mgr.x (mgr.34562) 8808 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:41:50.948 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:41:50 smithi188 bash[23329]: cephadm 2020-07-16T16:41:49.125543+0000 mgr.x (mgr.34562) 8809 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:41:51.056 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:41:50 smithi132 bash[27079]: cephadm 2020-07-16T16:41:49.125109+0000 mgr.x (mgr.34562) 8808 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:41:51.056 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:41:50 smithi132 bash[27079]: cephadm 2020-07-16T16:41:49.125543+0000 mgr.x (mgr.34562) 8809 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:41:51.948 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:41:51 smithi188 bash[23329]: cluster 2020-07-16T16:41:49.960834+0000 mgr.x (mgr.34562) 8810 : cluster [DBG] pgmap v5494: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:41:52.056 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:41:51 smithi132 bash[27079]: cluster 2020-07-16T16:41:49.960834+0000 mgr.x (mgr.34562) 8810 : cluster [DBG] pgmap v5494: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:41:53.677 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:41:53.938 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:41:53.938 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (3h) 3m ago 3h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:41:53.938 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (3h) 3m ago 3h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:41:53.939 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (3h) 3m ago 3h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:41:53.939 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (3h) 3m ago 3h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:41:53.939 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 3m ago 3h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:41:53.940 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (3h) 3m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:41:53.940 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (3h) 3m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:41:53.940 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (3h) 3m ago 3h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:41:53.941 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (3h) 3m ago 3h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:41:53.941 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (3h) 3m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:41:53.941 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (3h) 3m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:41:53.942 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (3h) 3m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:41:53.942 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (3h) 3m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:41:53.942 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (3h) 3m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:41:53.943 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (3h) 3m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:41:53.943 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (3h) 3m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:41:53.943 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (3h) 3m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:41:53.944 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (3h) 3m ago 3h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:41:53.948 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:41:53 smithi188 bash[23329]: cluster 2020-07-16T16:41:51.961223+0000 mgr.x (mgr.34562) 8811 : cluster [DBG] pgmap v5495: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:41:54.056 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:41:53 smithi132 bash[27079]: cluster 2020-07-16T16:41:51.961223+0000 mgr.x (mgr.34562) 8811 : cluster [DBG] pgmap v5495: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:41:54.241 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:41:54.241 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:41:54.241 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:41:54.242 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:41:54.242 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:41:54.242 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:41:54.243 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:41:54.243 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:41:54.243 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:41:54.244 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:41:54.244 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:41:54.244 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:41:54.245 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:41:54.245 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:41:54.245 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:41:54.246 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:41:54.246 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:41:54.948 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:41:54 smithi188 bash[23329]: audit 2020-07-16T16:41:53.636897+0000 mgr.x (mgr.34562) 8812 : audit [DBG] from='client.31048 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:41:54.948 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:41:54 smithi188 bash[23329]: audit 2020-07-16T16:41:54.212062+0000 mon.c (mon.1) 585 : audit [DBG] from='client.? 172.21.15.132:0/156809158' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:41:55.056 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:41:54 smithi132 bash[27079]: audit 2020-07-16T16:41:53.636897+0000 mgr.x (mgr.34562) 8812 : audit [DBG] from='client.31048 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:41:55.057 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:41:54 smithi132 bash[27079]: audit 2020-07-16T16:41:54.212062+0000 mon.c (mon.1) 585 : audit [DBG] from='client.? 172.21.15.132:0/156809158' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:41:55.948 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:41:55 smithi188 bash[23329]: audit 2020-07-16T16:41:53.904703+0000 mgr.x (mgr.34562) 8813 : audit [DBG] from='client.31054 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:41:55.949 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:41:55 smithi188 bash[23329]: cluster 2020-07-16T16:41:53.961563+0000 mgr.x (mgr.34562) 8814 : cluster [DBG] pgmap v5496: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:41:56.056 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:41:55 smithi132 bash[27079]: audit 2020-07-16T16:41:53.904703+0000 mgr.x (mgr.34562) 8813 : audit [DBG] from='client.31054 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:41:56.057 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:41:55 smithi132 bash[27079]: cluster 2020-07-16T16:41:53.961563+0000 mgr.x (mgr.34562) 8814 : cluster [DBG] pgmap v5496: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:41:57.948 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:41:57 smithi188 bash[23329]: cluster 2020-07-16T16:41:55.962044+0000 mgr.x (mgr.34562) 8815 : cluster [DBG] pgmap v5497: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:41:58.057 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:41:57 smithi132 bash[27079]: cluster 2020-07-16T16:41:55.962044+0000 mgr.x (mgr.34562) 8815 : cluster [DBG] pgmap v5497: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:41:59.949 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:41:59 smithi188 bash[23329]: cluster 2020-07-16T16:41:57.962607+0000 mgr.x (mgr.34562) 8816 : cluster [DBG] pgmap v5498: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:42:00.057 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:41:59 smithi132 bash[27079]: cluster 2020-07-16T16:41:57.962607+0000 mgr.x (mgr.34562) 8816 : cluster [DBG] pgmap v5498: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:42:01.949 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:42:01 smithi188 bash[23329]: cluster 2020-07-16T16:41:59.963089+0000 mgr.x (mgr.34562) 8817 : cluster [DBG] pgmap v5499: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:42:02.057 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:42:01 smithi132 bash[27079]: cluster 2020-07-16T16:41:59.963089+0000 mgr.x (mgr.34562) 8817 : cluster [DBG] pgmap v5499: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:42:03.949 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:42:03 smithi188 bash[23329]: cluster 2020-07-16T16:42:01.963622+0000 mgr.x (mgr.34562) 8818 : cluster [DBG] pgmap v5500: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:42:04.057 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:42:03 smithi132 bash[27079]: cluster 2020-07-16T16:42:01.963622+0000 mgr.x (mgr.34562) 8818 : cluster [DBG] pgmap v5500: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:42:04.949 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:42:04 smithi188 bash[23329]: audit 2020-07-16T16:42:04.130576+0000 mon.b (mon.2) 1858 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:42:05.057 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:42:04 smithi132 bash[27079]: audit 2020-07-16T16:42:04.130576+0000 mon.b (mon.2) 1858 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:42:05.949 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:42:05 smithi188 bash[23329]: cluster 2020-07-16T16:42:03.964068+0000 mgr.x (mgr.34562) 8819 : cluster [DBG] pgmap v5501: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:42:05.950 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:42:05 smithi188 bash[23329]: cephadm 2020-07-16T16:42:04.131308+0000 mgr.x (mgr.34562) 8820 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:42:05.950 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:42:05 smithi188 bash[23329]: cephadm 2020-07-16T16:42:04.131747+0000 mgr.x (mgr.34562) 8821 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:42:06.057 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:42:05 smithi132 bash[27079]: cluster 2020-07-16T16:42:03.964068+0000 mgr.x (mgr.34562) 8819 : cluster [DBG] pgmap v5501: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:42:06.058 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:42:05 smithi132 bash[27079]: cephadm 2020-07-16T16:42:04.131308+0000 mgr.x (mgr.34562) 8820 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:42:06.058 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:42:05 smithi132 bash[27079]: cephadm 2020-07-16T16:42:04.131747+0000 mgr.x (mgr.34562) 8821 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:42:07.949 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:42:07 smithi188 bash[23329]: cluster 2020-07-16T16:42:05.964577+0000 mgr.x (mgr.34562) 8822 : cluster [DBG] pgmap v5502: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:42:08.058 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:42:07 smithi132 bash[27079]: cluster 2020-07-16T16:42:05.964577+0000 mgr.x (mgr.34562) 8822 : cluster [DBG] pgmap v5502: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:42:09.949 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:42:09 smithi188 bash[23329]: cluster 2020-07-16T16:42:07.965058+0000 mgr.x (mgr.34562) 8823 : cluster [DBG] pgmap v5503: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:42:10.058 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:42:09 smithi132 bash[27079]: cluster 2020-07-16T16:42:07.965058+0000 mgr.x (mgr.34562) 8823 : cluster [DBG] pgmap v5503: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:42:11.950 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:42:11 smithi188 bash[23329]: cluster 2020-07-16T16:42:09.965566+0000 mgr.x (mgr.34562) 8824 : cluster [DBG] pgmap v5504: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:42:12.058 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:42:11 smithi132 bash[27079]: cluster 2020-07-16T16:42:09.965566+0000 mgr.x (mgr.34562) 8824 : cluster [DBG] pgmap v5504: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:42:13.950 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:42:13 smithi188 bash[23329]: cluster 2020-07-16T16:42:11.965990+0000 mgr.x (mgr.34562) 8825 : cluster [DBG] pgmap v5505: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:42:14.058 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:42:13 smithi132 bash[27079]: cluster 2020-07-16T16:42:11.965990+0000 mgr.x (mgr.34562) 8825 : cluster [DBG] pgmap v5505: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:42:15.950 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:42:15 smithi188 bash[23329]: cluster 2020-07-16T16:42:13.966438+0000 mgr.x (mgr.34562) 8826 : cluster [DBG] pgmap v5506: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:42:16.058 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:42:15 smithi132 bash[27079]: cluster 2020-07-16T16:42:13.966438+0000 mgr.x (mgr.34562) 8826 : cluster [DBG] pgmap v5506: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:42:17.950 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:42:17 smithi188 bash[23329]: cluster 2020-07-16T16:42:15.966795+0000 mgr.x (mgr.34562) 8827 : cluster [DBG] pgmap v5507: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:42:18.058 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:42:17 smithi132 bash[27079]: cluster 2020-07-16T16:42:15.966795+0000 mgr.x (mgr.34562) 8827 : cluster [DBG] pgmap v5507: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:42:19.950 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:42:19 smithi188 bash[23329]: cluster 2020-07-16T16:42:17.967228+0000 mgr.x (mgr.34562) 8828 : cluster [DBG] pgmap v5508: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:42:19.951 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:42:19 smithi188 bash[23329]: audit 2020-07-16T16:42:19.145786+0000 mon.b (mon.2) 1859 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:42:20.058 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:42:19 smithi132 bash[27079]: cluster 2020-07-16T16:42:17.967228+0000 mgr.x (mgr.34562) 8828 : cluster [DBG] pgmap v5508: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:42:20.059 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:42:19 smithi132 bash[27079]: audit 2020-07-16T16:42:19.145786+0000 mon.b (mon.2) 1859 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:42:20.951 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:42:20 smithi188 bash[23329]: cephadm 2020-07-16T16:42:19.146509+0000 mgr.x (mgr.34562) 8829 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:42:20.951 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:42:20 smithi188 bash[23329]: cephadm 2020-07-16T16:42:19.146919+0000 mgr.x (mgr.34562) 8830 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:42:21.058 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:42:20 smithi132 bash[27079]: cephadm 2020-07-16T16:42:19.146509+0000 mgr.x (mgr.34562) 8829 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:42:21.059 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:42:20 smithi132 bash[27079]: cephadm 2020-07-16T16:42:19.146919+0000 mgr.x (mgr.34562) 8830 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:42:21.951 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:42:21 smithi188 bash[23329]: cluster 2020-07-16T16:42:19.967691+0000 mgr.x (mgr.34562) 8831 : cluster [DBG] pgmap v5509: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:42:22.059 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:42:21 smithi132 bash[27079]: cluster 2020-07-16T16:42:19.967691+0000 mgr.x (mgr.34562) 8831 : cluster [DBG] pgmap v5509: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:42:23.951 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:42:23 smithi188 bash[23329]: cluster 2020-07-16T16:42:21.968068+0000 mgr.x (mgr.34562) 8832 : cluster [DBG] pgmap v5510: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:42:24.059 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:42:23 smithi132 bash[27079]: cluster 2020-07-16T16:42:21.968068+0000 mgr.x (mgr.34562) 8832 : cluster [DBG] pgmap v5510: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:42:24.541 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:42:24.814 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:42:24.814 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (3h) 4m ago 3h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:42:24.814 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (3h) 4m ago 3h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:42:24.815 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (3h) 4m ago 3h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:42:24.815 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (3h) 4m ago 3h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:42:24.815 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 4m ago 3h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:42:24.816 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (3h) 4m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:42:24.816 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (3h) 4m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:42:24.816 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (3h) 4m ago 3h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:42:24.817 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (3h) 4m ago 3h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:42:24.817 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (3h) 4m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:42:24.817 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (3h) 4m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:42:24.818 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (3h) 4m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:42:24.818 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (3h) 4m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:42:24.818 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (3h) 4m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:42:24.819 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (3h) 4m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:42:24.819 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (3h) 4m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:42:24.819 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (3h) 4m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:42:24.819 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (3h) 4m ago 3h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:42:25.112 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:42:25.113 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:42:25.113 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:42:25.113 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:42:25.114 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:42:25.114 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:42:25.114 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:42:25.115 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:42:25.115 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:42:25.115 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:42:25.116 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:42:25.116 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:42:25.116 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:42:25.117 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:42:25.117 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:42:25.117 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:42:25.118 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:42:25.951 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:42:25 smithi188 bash[23329]: cluster 2020-07-16T16:42:23.968571+0000 mgr.x (mgr.34562) 8833 : cluster [DBG] pgmap v5511: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:42:25.951 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:42:25 smithi188 bash[23329]: audit 2020-07-16T16:42:24.498981+0000 mgr.x (mgr.34562) 8834 : audit [DBG] from='client.31066 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:42:25.952 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:42:25 smithi188 bash[23329]: audit 2020-07-16T16:42:24.779302+0000 mgr.x (mgr.34562) 8835 : audit [DBG] from='client.31072 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:42:25.952 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:42:25 smithi188 bash[23329]: audit 2020-07-16T16:42:25.081307+0000 mon.c (mon.1) 586 : audit [DBG] from='client.? 172.21.15.132:0/4003302997' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:42:26.059 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:42:25 smithi132 bash[27079]: cluster 2020-07-16T16:42:23.968571+0000 mgr.x (mgr.34562) 8833 : cluster [DBG] pgmap v5511: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:42:26.060 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:42:25 smithi132 bash[27079]: audit 2020-07-16T16:42:24.498981+0000 mgr.x (mgr.34562) 8834 : audit [DBG] from='client.31066 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:42:26.060 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:42:25 smithi132 bash[27079]: audit 2020-07-16T16:42:24.779302+0000 mgr.x (mgr.34562) 8835 : audit [DBG] from='client.31072 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:42:26.060 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:42:25 smithi132 bash[27079]: audit 2020-07-16T16:42:25.081307+0000 mon.c (mon.1) 586 : audit [DBG] from='client.? 172.21.15.132:0/4003302997' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:42:27.951 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:42:27 smithi188 bash[23329]: cluster 2020-07-16T16:42:25.969057+0000 mgr.x (mgr.34562) 8836 : cluster [DBG] pgmap v5512: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:42:28.059 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:42:27 smithi132 bash[27079]: cluster 2020-07-16T16:42:25.969057+0000 mgr.x (mgr.34562) 8836 : cluster [DBG] pgmap v5512: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:42:29.951 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:42:29 smithi188 bash[23329]: cluster 2020-07-16T16:42:27.969489+0000 mgr.x (mgr.34562) 8837 : cluster [DBG] pgmap v5513: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:42:30.059 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:42:29 smithi132 bash[27079]: cluster 2020-07-16T16:42:27.969489+0000 mgr.x (mgr.34562) 8837 : cluster [DBG] pgmap v5513: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:42:31.952 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:42:31 smithi188 bash[23329]: cluster 2020-07-16T16:42:29.969865+0000 mgr.x (mgr.34562) 8838 : cluster [DBG] pgmap v5514: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:42:32.060 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:42:31 smithi132 bash[27079]: cluster 2020-07-16T16:42:29.969865+0000 mgr.x (mgr.34562) 8838 : cluster [DBG] pgmap v5514: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:42:33.951 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:42:33 smithi188 bash[23329]: cluster 2020-07-16T16:42:31.970371+0000 mgr.x (mgr.34562) 8839 : cluster [DBG] pgmap v5515: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:42:34.060 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:42:33 smithi132 bash[27079]: cluster 2020-07-16T16:42:31.970371+0000 mgr.x (mgr.34562) 8839 : cluster [DBG] pgmap v5515: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:42:34.952 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:42:34 smithi188 bash[23329]: audit 2020-07-16T16:42:34.164954+0000 mon.b (mon.2) 1860 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:42:34.952 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:42:34 smithi188 bash[23329]: audit 2020-07-16T16:42:34.166422+0000 mon.b (mon.2) 1861 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:42:34.953 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:42:34 smithi188 bash[23329]: audit 2020-07-16T16:42:34.167526+0000 mon.b (mon.2) 1862 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:42:34.953 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:42:34 smithi188 bash[23329]: audit 2020-07-16T16:42:34.168921+0000 mon.b (mon.2) 1863 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:42:34.953 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:42:34 smithi188 bash[23329]: audit 2020-07-16T16:42:34.170163+0000 mon.b (mon.2) 1864 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:42:35.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:42:34 smithi132 bash[27079]: audit 2020-07-16T16:42:34.164954+0000 mon.b (mon.2) 1860 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:42:35.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:42:34 smithi132 bash[27079]: audit 2020-07-16T16:42:34.166422+0000 mon.b (mon.2) 1861 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:42:35.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:42:34 smithi132 bash[27079]: audit 2020-07-16T16:42:34.167526+0000 mon.b (mon.2) 1862 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:42:35.032 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:42:34 smithi132 bash[27079]: audit 2020-07-16T16:42:34.168921+0000 mon.b (mon.2) 1863 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:42:35.033 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:42:34 smithi132 bash[27079]: audit 2020-07-16T16:42:34.170163+0000 mon.b (mon.2) 1864 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:42:35.952 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:42:35 smithi188 bash[23329]: cluster 2020-07-16T16:42:33.970701+0000 mgr.x (mgr.34562) 8840 : cluster [DBG] pgmap v5516: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:42:35.953 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:42:35 smithi188 bash[23329]: audit 2020-07-16T16:42:34.165381+0000 mgr.x (mgr.34562) 8841 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:42:35.953 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:42:35 smithi188 bash[23329]: audit 2020-07-16T16:42:34.166712+0000 mgr.x (mgr.34562) 8842 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:42:35.954 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:42:35 smithi188 bash[23329]: audit 2020-07-16T16:42:34.167807+0000 mgr.x (mgr.34562) 8843 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:42:35.954 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:42:35 smithi188 bash[23329]: cephadm 2020-07-16T16:42:34.168507+0000 mgr.x (mgr.34562) 8844 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:42:35.955 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:42:35 smithi188 bash[23329]: cephadm 2020-07-16T16:42:34.169849+0000 mgr.x (mgr.34562) 8845 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:42:35.955 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:42:35 smithi188 bash[23329]: cephadm 2020-07-16T16:42:34.170865+0000 mgr.x (mgr.34562) 8846 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:42:35.956 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:42:35 smithi188 bash[23329]: cephadm 2020-07-16T16:42:34.171150+0000 mgr.x (mgr.34562) 8847 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:42:36.060 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:42:35 smithi132 bash[27079]: cluster 2020-07-16T16:42:33.970701+0000 mgr.x (mgr.34562) 8840 : cluster [DBG] pgmap v5516: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:42:36.060 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:42:35 smithi132 bash[27079]: audit 2020-07-16T16:42:34.165381+0000 mgr.x (mgr.34562) 8841 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:42:36.061 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:42:35 smithi132 bash[27079]: audit 2020-07-16T16:42:34.166712+0000 mgr.x (mgr.34562) 8842 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:42:36.061 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:42:35 smithi132 bash[27079]: audit 2020-07-16T16:42:34.167807+0000 mgr.x (mgr.34562) 8843 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:42:36.061 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:42:35 smithi132 bash[27079]: cephadm 2020-07-16T16:42:34.168507+0000 mgr.x (mgr.34562) 8844 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:42:36.062 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:42:35 smithi132 bash[27079]: cephadm 2020-07-16T16:42:34.169849+0000 mgr.x (mgr.34562) 8845 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:42:36.062 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:42:35 smithi132 bash[27079]: cephadm 2020-07-16T16:42:34.170865+0000 mgr.x (mgr.34562) 8846 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:42:36.062 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:42:35 smithi132 bash[27079]: cephadm 2020-07-16T16:42:34.171150+0000 mgr.x (mgr.34562) 8847 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:42:37.952 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:42:37 smithi188 bash[23329]: cluster 2020-07-16T16:42:35.971025+0000 mgr.x (mgr.34562) 8848 : cluster [DBG] pgmap v5517: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:42:37.952 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:42:37 smithi188 bash[23329]: audit 2020-07-16T16:42:37.135042+0000 mon.b (mon.2) 1865 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:42:38.060 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:42:37 smithi132 bash[27079]: cluster 2020-07-16T16:42:35.971025+0000 mgr.x (mgr.34562) 8848 : cluster [DBG] pgmap v5517: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:42:38.061 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:42:37 smithi132 bash[27079]: audit 2020-07-16T16:42:37.135042+0000 mon.b (mon.2) 1865 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:42:38.952 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:42:38 smithi188 bash[23329]: cephadm 2020-07-16T16:42:37.135659+0000 mgr.x (mgr.34562) 8849 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:42:38.953 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:42:38 smithi188 bash[23329]: cephadm 2020-07-16T16:42:37.136040+0000 mgr.x (mgr.34562) 8850 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:42:39.060 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:42:38 smithi132 bash[27079]: cephadm 2020-07-16T16:42:37.135659+0000 mgr.x (mgr.34562) 8849 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:42:39.061 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:42:38 smithi132 bash[27079]: cephadm 2020-07-16T16:42:37.136040+0000 mgr.x (mgr.34562) 8850 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:42:39.952 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:42:39 smithi188 bash[23329]: cluster 2020-07-16T16:42:37.971556+0000 mgr.x (mgr.34562) 8851 : cluster [DBG] pgmap v5518: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:42:40.060 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:42:39 smithi132 bash[27079]: cluster 2020-07-16T16:42:37.971556+0000 mgr.x (mgr.34562) 8851 : cluster [DBG] pgmap v5518: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:42:42.061 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:42:41 smithi132 bash[27079]: cluster 2020-07-16T16:42:39.971998+0000 mgr.x (mgr.34562) 8852 : cluster [DBG] pgmap v5519: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:42:42.202 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:42:41 smithi188 bash[23329]: cluster 2020-07-16T16:42:39.971998+0000 mgr.x (mgr.34562) 8852 : cluster [DBG] pgmap v5519: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:42:44.061 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:42:43 smithi132 bash[27079]: cluster 2020-07-16T16:42:41.972538+0000 mgr.x (mgr.34562) 8853 : cluster [DBG] pgmap v5520: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:42:44.202 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:42:43 smithi188 bash[23329]: cluster 2020-07-16T16:42:41.972538+0000 mgr.x (mgr.34562) 8853 : cluster [DBG] pgmap v5520: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:42:46.061 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:42:45 smithi132 bash[27079]: cluster 2020-07-16T16:42:43.973032+0000 mgr.x (mgr.34562) 8854 : cluster [DBG] pgmap v5521: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:42:46.203 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:42:45 smithi188 bash[23329]: cluster 2020-07-16T16:42:43.973032+0000 mgr.x (mgr.34562) 8854 : cluster [DBG] pgmap v5521: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:42:48.062 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:42:47 smithi132 bash[27079]: cluster 2020-07-16T16:42:45.973504+0000 mgr.x (mgr.34562) 8855 : cluster [DBG] pgmap v5522: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:42:48.203 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:42:47 smithi188 bash[23329]: cluster 2020-07-16T16:42:45.973504+0000 mgr.x (mgr.34562) 8855 : cluster [DBG] pgmap v5522: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:42:50.061 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:42:49 smithi132 bash[27079]: cluster 2020-07-16T16:42:47.974000+0000 mgr.x (mgr.34562) 8856 : cluster [DBG] pgmap v5523: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:42:50.203 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:42:49 smithi188 bash[23329]: cluster 2020-07-16T16:42:47.974000+0000 mgr.x (mgr.34562) 8856 : cluster [DBG] pgmap v5523: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:42:52.062 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:42:51 smithi132 bash[27079]: cluster 2020-07-16T16:42:49.974566+0000 mgr.x (mgr.34562) 8857 : cluster [DBG] pgmap v5524: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:42:52.203 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:42:51 smithi188 bash[23329]: cluster 2020-07-16T16:42:49.974566+0000 mgr.x (mgr.34562) 8857 : cluster [DBG] pgmap v5524: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:42:53.062 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:42:52 smithi132 bash[27079]: audit 2020-07-16T16:42:52.151477+0000 mon.b (mon.2) 1866 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:42:53.203 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:42:52 smithi188 bash[23329]: audit 2020-07-16T16:42:52.151477+0000 mon.b (mon.2) 1866 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:42:54.062 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:42:53 smithi132 bash[27079]: cluster 2020-07-16T16:42:51.975115+0000 mgr.x (mgr.34562) 8858 : cluster [DBG] pgmap v5525: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:42:54.062 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:42:53 smithi132 bash[27079]: cephadm 2020-07-16T16:42:52.152178+0000 mgr.x (mgr.34562) 8859 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:42:54.063 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:42:53 smithi132 bash[27079]: cephadm 2020-07-16T16:42:52.152510+0000 mgr.x (mgr.34562) 8860 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:42:54.203 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:42:53 smithi188 bash[23329]: cluster 2020-07-16T16:42:51.975115+0000 mgr.x (mgr.34562) 8858 : cluster [DBG] pgmap v5525: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:42:54.204 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:42:53 smithi188 bash[23329]: cephadm 2020-07-16T16:42:52.152178+0000 mgr.x (mgr.34562) 8859 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:42:54.204 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:42:53 smithi188 bash[23329]: cephadm 2020-07-16T16:42:52.152510+0000 mgr.x (mgr.34562) 8860 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:42:55.412 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:42:55.678 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:42:55.678 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (3h) 4m ago 3h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:42:55.679 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (3h) 4m ago 3h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:42:55.679 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (3h) 4m ago 3h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:42:55.679 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (3h) 4m ago 3h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:42:55.680 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 4m ago 3h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:42:55.680 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (3h) 4m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:42:55.680 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (3h) 4m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:42:55.681 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (3h) 4m ago 3h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:42:55.681 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (3h) 4m ago 3h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:42:55.681 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (3h) 4m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:42:55.682 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (3h) 4m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:42:55.682 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (3h) 4m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:42:55.682 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (3h) 4m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:42:55.683 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (3h) 4m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:42:55.683 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (3h) 4m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:42:55.683 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (3h) 4m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:42:55.684 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (3h) 4m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:42:55.684 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (3h) 4m ago 3h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:42:55.970 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:42:55.971 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:42:55.971 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:42:55.972 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:42:55.972 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:42:55.972 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:42:55.973 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:42:55.973 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:42:55.973 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:42:55.973 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:42:55.974 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:42:55.974 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:42:55.974 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:42:55.975 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:42:55.975 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:42:55.975 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:42:55.976 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:42:56.062 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:42:55 smithi132 bash[27079]: cluster 2020-07-16T16:42:53.975558+0000 mgr.x (mgr.34562) 8861 : cluster [DBG] pgmap v5526: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:42:56.204 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:42:55 smithi188 bash[23329]: cluster 2020-07-16T16:42:53.975558+0000 mgr.x (mgr.34562) 8861 : cluster [DBG] pgmap v5526: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:42:57.062 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:42:56 smithi132 bash[27079]: audit 2020-07-16T16:42:55.367373+0000 mgr.x (mgr.34562) 8862 : audit [DBG] from='client.31084 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:42:57.063 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:42:56 smithi132 bash[27079]: audit 2020-07-16T16:42:55.635511+0000 mgr.x (mgr.34562) 8863 : audit [DBG] from='client.31090 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:42:57.063 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:42:56 smithi132 bash[27079]: audit 2020-07-16T16:42:55.936309+0000 mon.c (mon.1) 587 : audit [DBG] from='client.? 172.21.15.132:0/1818155981' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:42:57.204 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:42:56 smithi188 bash[23329]: audit 2020-07-16T16:42:55.367373+0000 mgr.x (mgr.34562) 8862 : audit [DBG] from='client.31084 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:42:57.204 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:42:56 smithi188 bash[23329]: audit 2020-07-16T16:42:55.635511+0000 mgr.x (mgr.34562) 8863 : audit [DBG] from='client.31090 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:42:57.205 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:42:56 smithi188 bash[23329]: audit 2020-07-16T16:42:55.936309+0000 mon.c (mon.1) 587 : audit [DBG] from='client.? 172.21.15.132:0/1818155981' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:42:58.062 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:42:57 smithi132 bash[27079]: cluster 2020-07-16T16:42:55.975946+0000 mgr.x (mgr.34562) 8864 : cluster [DBG] pgmap v5527: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:42:58.204 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:42:57 smithi188 bash[23329]: cluster 2020-07-16T16:42:55.975946+0000 mgr.x (mgr.34562) 8864 : cluster [DBG] pgmap v5527: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:43:00.063 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:42:59 smithi132 bash[27079]: cluster 2020-07-16T16:42:57.976479+0000 mgr.x (mgr.34562) 8865 : cluster [DBG] pgmap v5528: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:43:00.204 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:42:59 smithi188 bash[23329]: cluster 2020-07-16T16:42:57.976479+0000 mgr.x (mgr.34562) 8865 : cluster [DBG] pgmap v5528: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:43:02.063 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:43:01 smithi132 bash[27079]: cluster 2020-07-16T16:42:59.976780+0000 mgr.x (mgr.34562) 8866 : cluster [DBG] pgmap v5529: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:43:02.204 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:43:01 smithi188 bash[23329]: cluster 2020-07-16T16:42:59.976780+0000 mgr.x (mgr.34562) 8866 : cluster [DBG] pgmap v5529: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:43:04.062 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:43:03 smithi132 bash[27079]: cluster 2020-07-16T16:43:01.977305+0000 mgr.x (mgr.34562) 8867 : cluster [DBG] pgmap v5530: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:43:04.204 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:43:03 smithi188 bash[23329]: cluster 2020-07-16T16:43:01.977305+0000 mgr.x (mgr.34562) 8867 : cluster [DBG] pgmap v5530: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:43:06.062 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:43:05 smithi132 bash[27079]: cluster 2020-07-16T16:43:03.977776+0000 mgr.x (mgr.34562) 8868 : cluster [DBG] pgmap v5531: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:43:06.204 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:43:05 smithi188 bash[23329]: cluster 2020-07-16T16:43:03.977776+0000 mgr.x (mgr.34562) 8868 : cluster [DBG] pgmap v5531: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:43:08.062 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:43:07 smithi132 bash[27079]: cluster 2020-07-16T16:43:05.978217+0000 mgr.x (mgr.34562) 8869 : cluster [DBG] pgmap v5532: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:43:08.062 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:43:07 smithi132 bash[27079]: audit 2020-07-16T16:43:07.153710+0000 mon.b (mon.2) 1867 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:43:08.203 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:43:07 smithi188 bash[23329]: cluster 2020-07-16T16:43:05.978217+0000 mgr.x (mgr.34562) 8869 : cluster [DBG] pgmap v5532: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:43:08.203 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:43:07 smithi188 bash[23329]: audit 2020-07-16T16:43:07.153710+0000 mon.b (mon.2) 1867 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:43:09.061 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:43:08 smithi132 bash[27079]: cephadm 2020-07-16T16:43:07.154445+0000 mgr.x (mgr.34562) 8870 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:43:09.062 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:43:08 smithi132 bash[27079]: cephadm 2020-07-16T16:43:07.154832+0000 mgr.x (mgr.34562) 8871 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:43:09.203 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:43:08 smithi188 bash[23329]: cephadm 2020-07-16T16:43:07.154445+0000 mgr.x (mgr.34562) 8870 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:43:09.203 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:43:08 smithi188 bash[23329]: cephadm 2020-07-16T16:43:07.154832+0000 mgr.x (mgr.34562) 8871 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:43:10.062 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:43:09 smithi132 bash[27079]: cluster 2020-07-16T16:43:07.978554+0000 mgr.x (mgr.34562) 8872 : cluster [DBG] pgmap v5533: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:43:10.203 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:43:09 smithi188 bash[23329]: cluster 2020-07-16T16:43:07.978554+0000 mgr.x (mgr.34562) 8872 : cluster [DBG] pgmap v5533: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:43:12.061 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:43:11 smithi132 bash[27079]: cluster 2020-07-16T16:43:09.979050+0000 mgr.x (mgr.34562) 8873 : cluster [DBG] pgmap v5534: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:43:12.202 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:43:11 smithi188 bash[23329]: cluster 2020-07-16T16:43:09.979050+0000 mgr.x (mgr.34562) 8873 : cluster [DBG] pgmap v5534: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:43:14.060 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:43:13 smithi132 bash[27079]: cluster 2020-07-16T16:43:11.979578+0000 mgr.x (mgr.34562) 8874 : cluster [DBG] pgmap v5535: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:43:14.202 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:43:13 smithi188 bash[23329]: cluster 2020-07-16T16:43:11.979578+0000 mgr.x (mgr.34562) 8874 : cluster [DBG] pgmap v5535: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:43:16.060 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:43:15 smithi132 bash[27079]: cluster 2020-07-16T16:43:13.979943+0000 mgr.x (mgr.34562) 8875 : cluster [DBG] pgmap v5536: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:43:16.202 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:43:15 smithi188 bash[23329]: cluster 2020-07-16T16:43:13.979943+0000 mgr.x (mgr.34562) 8875 : cluster [DBG] pgmap v5536: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:43:18.060 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:43:17 smithi132 bash[27079]: cluster 2020-07-16T16:43:15.980418+0000 mgr.x (mgr.34562) 8876 : cluster [DBG] pgmap v5537: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:43:18.202 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:43:17 smithi188 bash[23329]: cluster 2020-07-16T16:43:15.980418+0000 mgr.x (mgr.34562) 8876 : cluster [DBG] pgmap v5537: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:43:20.060 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:43:19 smithi132 bash[27079]: cluster 2020-07-16T16:43:17.980935+0000 mgr.x (mgr.34562) 8877 : cluster [DBG] pgmap v5538: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:43:20.201 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:43:19 smithi188 bash[23329]: cluster 2020-07-16T16:43:17.980935+0000 mgr.x (mgr.34562) 8877 : cluster [DBG] pgmap v5538: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:43:22.060 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:43:21 smithi132 bash[27079]: cluster 2020-07-16T16:43:19.981280+0000 mgr.x (mgr.34562) 8878 : cluster [DBG] pgmap v5539: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:43:22.201 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:43:21 smithi188 bash[23329]: cluster 2020-07-16T16:43:19.981280+0000 mgr.x (mgr.34562) 8878 : cluster [DBG] pgmap v5539: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:43:23.059 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:43:22 smithi132 bash[27079]: audit 2020-07-16T16:43:22.170371+0000 mon.b (mon.2) 1868 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:43:23.201 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:43:22 smithi188 bash[23329]: audit 2020-07-16T16:43:22.170371+0000 mon.b (mon.2) 1868 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:43:24.059 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:43:23 smithi132 bash[27079]: cluster 2020-07-16T16:43:21.981612+0000 mgr.x (mgr.34562) 8879 : cluster [DBG] pgmap v5540: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:43:24.060 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:43:23 smithi132 bash[27079]: cephadm 2020-07-16T16:43:22.171088+0000 mgr.x (mgr.34562) 8880 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:43:24.060 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:43:23 smithi132 bash[27079]: cephadm 2020-07-16T16:43:22.171503+0000 mgr.x (mgr.34562) 8881 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:43:24.201 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:43:23 smithi188 bash[23329]: cluster 2020-07-16T16:43:21.981612+0000 mgr.x (mgr.34562) 8879 : cluster [DBG] pgmap v5540: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:43:24.201 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:43:23 smithi188 bash[23329]: cephadm 2020-07-16T16:43:22.171088+0000 mgr.x (mgr.34562) 8880 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:43:24.202 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:43:23 smithi188 bash[23329]: cephadm 2020-07-16T16:43:22.171503+0000 mgr.x (mgr.34562) 8881 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:43:26.059 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:43:25 smithi132 bash[27079]: cluster 2020-07-16T16:43:23.982083+0000 mgr.x (mgr.34562) 8882 : cluster [DBG] pgmap v5541: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:43:26.201 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:43:25 smithi188 bash[23329]: cluster 2020-07-16T16:43:23.982083+0000 mgr.x (mgr.34562) 8882 : cluster [DBG] pgmap v5541: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:43:26.275 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:43:26.532 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:43:26.532 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (3h) 5m ago 3h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:43:26.532 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (3h) 5m ago 3h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:43:26.533 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (3h) 5m ago 3h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:43:26.534 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (3h) 5m ago 3h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:43:26.535 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 5m ago 3h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:43:26.535 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (3h) 5m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:43:26.535 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (3h) 5m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:43:26.536 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (3h) 5m ago 3h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:43:26.536 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (3h) 5m ago 3h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:43:26.536 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (3h) 5m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:43:26.538 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (3h) 5m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:43:26.538 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (3h) 5m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:43:26.538 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (3h) 5m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:43:26.539 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (3h) 5m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:43:26.539 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (3h) 5m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:43:26.539 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (3h) 5m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:43:26.540 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (3h) 5m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:43:26.540 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (3h) 5m ago 3h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:43:26.829 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:43:26.830 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:43:26.830 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:43:26.830 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:43:26.831 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:43:26.831 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:43:26.831 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:43:26.832 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:43:26.832 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:43:26.832 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:43:26.832 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:43:26.833 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:43:26.833 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:43:26.833 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:43:26.834 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:43:26.834 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:43:26.834 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:43:28.059 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:43:27 smithi132 bash[27079]: cluster 2020-07-16T16:43:25.982640+0000 mgr.x (mgr.34562) 8883 : cluster [DBG] pgmap v5542: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:43:28.059 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:43:27 smithi132 bash[27079]: audit 2020-07-16T16:43:26.228160+0000 mgr.x (mgr.34562) 8884 : audit [DBG] from='client.31102 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:43:28.060 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:43:27 smithi132 bash[27079]: audit 2020-07-16T16:43:26.497253+0000 mgr.x (mgr.34562) 8885 : audit [DBG] from='client.31108 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:43:28.060 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:43:27 smithi132 bash[27079]: audit 2020-07-16T16:43:26.798214+0000 mon.c (mon.1) 588 : audit [DBG] from='client.? 172.21.15.132:0/3482379232' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:43:28.200 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:43:27 smithi188 bash[23329]: cluster 2020-07-16T16:43:25.982640+0000 mgr.x (mgr.34562) 8883 : cluster [DBG] pgmap v5542: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:43:28.201 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:43:27 smithi188 bash[23329]: audit 2020-07-16T16:43:26.228160+0000 mgr.x (mgr.34562) 8884 : audit [DBG] from='client.31102 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:43:28.201 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:43:27 smithi188 bash[23329]: audit 2020-07-16T16:43:26.497253+0000 mgr.x (mgr.34562) 8885 : audit [DBG] from='client.31108 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:43:28.202 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:43:27 smithi188 bash[23329]: audit 2020-07-16T16:43:26.798214+0000 mon.c (mon.1) 588 : audit [DBG] from='client.? 172.21.15.132:0/3482379232' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:43:30.058 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:43:29 smithi132 bash[27079]: cluster 2020-07-16T16:43:27.983183+0000 mgr.x (mgr.34562) 8886 : cluster [DBG] pgmap v5543: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:43:30.200 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:43:29 smithi188 bash[23329]: cluster 2020-07-16T16:43:27.983183+0000 mgr.x (mgr.34562) 8886 : cluster [DBG] pgmap v5543: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:43:32.059 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:43:31 smithi132 bash[27079]: cluster 2020-07-16T16:43:29.983504+0000 mgr.x (mgr.34562) 8887 : cluster [DBG] pgmap v5544: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:43:32.200 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:43:31 smithi188 bash[23329]: cluster 2020-07-16T16:43:29.983504+0000 mgr.x (mgr.34562) 8887 : cluster [DBG] pgmap v5544: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:43:34.058 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:43:33 smithi132 bash[27079]: cluster 2020-07-16T16:43:31.984059+0000 mgr.x (mgr.34562) 8888 : cluster [DBG] pgmap v5545: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:43:34.200 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:43:33 smithi188 bash[23329]: cluster 2020-07-16T16:43:31.984059+0000 mgr.x (mgr.34562) 8888 : cluster [DBG] pgmap v5545: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:43:36.058 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:43:35 smithi132 bash[27079]: cluster 2020-07-16T16:43:33.984475+0000 mgr.x (mgr.34562) 8889 : cluster [DBG] pgmap v5546: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:43:36.199 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:43:35 smithi188 bash[23329]: cluster 2020-07-16T16:43:33.984475+0000 mgr.x (mgr.34562) 8889 : cluster [DBG] pgmap v5546: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:43:38.058 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:43:37 smithi132 bash[27079]: cluster 2020-07-16T16:43:35.984963+0000 mgr.x (mgr.34562) 8890 : cluster [DBG] pgmap v5547: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:43:38.058 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:43:37 smithi132 bash[27079]: audit 2020-07-16T16:43:37.189468+0000 mon.b (mon.2) 1869 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:43:38.059 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:43:37 smithi132 bash[27079]: audit 2020-07-16T16:43:37.190907+0000 mon.b (mon.2) 1870 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:43:38.059 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:43:37 smithi132 bash[27079]: audit 2020-07-16T16:43:37.192132+0000 mon.b (mon.2) 1871 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:43:38.059 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:43:37 smithi132 bash[27079]: audit 2020-07-16T16:43:37.193677+0000 mon.b (mon.2) 1872 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:43:38.060 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:43:37 smithi132 bash[27079]: audit 2020-07-16T16:43:37.194917+0000 mon.b (mon.2) 1873 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:43:38.199 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:43:37 smithi188 bash[23329]: cluster 2020-07-16T16:43:35.984963+0000 mgr.x (mgr.34562) 8890 : cluster [DBG] pgmap v5547: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:43:38.200 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:43:37 smithi188 bash[23329]: audit 2020-07-16T16:43:37.189468+0000 mon.b (mon.2) 1869 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:43:38.200 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:43:37 smithi188 bash[23329]: audit 2020-07-16T16:43:37.190907+0000 mon.b (mon.2) 1870 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:43:38.200 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:43:37 smithi188 bash[23329]: audit 2020-07-16T16:43:37.192132+0000 mon.b (mon.2) 1871 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:43:38.201 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:43:37 smithi188 bash[23329]: audit 2020-07-16T16:43:37.193677+0000 mon.b (mon.2) 1872 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:43:38.201 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:43:37 smithi188 bash[23329]: audit 2020-07-16T16:43:37.194917+0000 mon.b (mon.2) 1873 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:43:39.057 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:43:38 smithi132 bash[27079]: audit 2020-07-16T16:43:37.189814+0000 mgr.x (mgr.34562) 8891 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:43:39.058 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:43:38 smithi132 bash[27079]: audit 2020-07-16T16:43:37.191210+0000 mgr.x (mgr.34562) 8892 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:43:39.058 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:43:38 smithi132 bash[27079]: audit 2020-07-16T16:43:37.192472+0000 mgr.x (mgr.34562) 8893 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:43:39.059 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:43:38 smithi132 bash[27079]: cephadm 2020-07-16T16:43:37.193206+0000 mgr.x (mgr.34562) 8894 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:43:39.059 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:43:38 smithi132 bash[27079]: cephadm 2020-07-16T16:43:37.194532+0000 mgr.x (mgr.34562) 8895 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:43:39.059 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:43:38 smithi132 bash[27079]: cephadm 2020-07-16T16:43:37.195693+0000 mgr.x (mgr.34562) 8896 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:43:39.060 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:43:38 smithi132 bash[27079]: cephadm 2020-07-16T16:43:37.195917+0000 mgr.x (mgr.34562) 8897 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:43:39.199 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:43:38 smithi188 bash[23329]: audit 2020-07-16T16:43:37.189814+0000 mgr.x (mgr.34562) 8891 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:43:39.200 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:43:38 smithi188 bash[23329]: audit 2020-07-16T16:43:37.191210+0000 mgr.x (mgr.34562) 8892 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:43:39.200 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:43:38 smithi188 bash[23329]: audit 2020-07-16T16:43:37.192472+0000 mgr.x (mgr.34562) 8893 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:43:39.200 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:43:38 smithi188 bash[23329]: cephadm 2020-07-16T16:43:37.193206+0000 mgr.x (mgr.34562) 8894 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:43:39.201 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:43:38 smithi188 bash[23329]: cephadm 2020-07-16T16:43:37.194532+0000 mgr.x (mgr.34562) 8895 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:43:39.201 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:43:38 smithi188 bash[23329]: cephadm 2020-07-16T16:43:37.195693+0000 mgr.x (mgr.34562) 8896 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:43:39.201 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:43:38 smithi188 bash[23329]: cephadm 2020-07-16T16:43:37.195917+0000 mgr.x (mgr.34562) 8897 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:43:40.199 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:43:39 smithi188 bash[23329]: cluster 2020-07-16T16:43:37.985536+0000 mgr.x (mgr.34562) 8898 : cluster [DBG] pgmap v5548: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:43:40.307 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:43:39 smithi132 bash[27079]: cluster 2020-07-16T16:43:37.985536+0000 mgr.x (mgr.34562) 8898 : cluster [DBG] pgmap v5548: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:43:41.199 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:43:40 smithi188 bash[23329]: audit 2020-07-16T16:43:40.012043+0000 mon.b (mon.2) 1874 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:43:41.307 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:43:40 smithi132 bash[27079]: audit 2020-07-16T16:43:40.012043+0000 mon.b (mon.2) 1874 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:43:42.199 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:43:41 smithi188 bash[23329]: cluster 2020-07-16T16:43:39.986013+0000 mgr.x (mgr.34562) 8899 : cluster [DBG] pgmap v5549: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:43:42.199 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:43:41 smithi188 bash[23329]: cephadm 2020-07-16T16:43:40.012687+0000 mgr.x (mgr.34562) 8900 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:43:42.200 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:43:41 smithi188 bash[23329]: cephadm 2020-07-16T16:43:40.013096+0000 mgr.x (mgr.34562) 8901 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:43:42.307 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:43:41 smithi132 bash[27079]: cluster 2020-07-16T16:43:39.986013+0000 mgr.x (mgr.34562) 8899 : cluster [DBG] pgmap v5549: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:43:42.308 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:43:41 smithi132 bash[27079]: cephadm 2020-07-16T16:43:40.012687+0000 mgr.x (mgr.34562) 8900 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:43:42.308 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:43:41 smithi132 bash[27079]: cephadm 2020-07-16T16:43:40.013096+0000 mgr.x (mgr.34562) 8901 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:43:44.199 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:43:43 smithi188 bash[23329]: cluster 2020-07-16T16:43:41.986424+0000 mgr.x (mgr.34562) 8902 : cluster [DBG] pgmap v5550: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:43:44.307 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:43:43 smithi132 bash[27079]: cluster 2020-07-16T16:43:41.986424+0000 mgr.x (mgr.34562) 8902 : cluster [DBG] pgmap v5550: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:43:46.199 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:43:45 smithi188 bash[23329]: cluster 2020-07-16T16:43:43.986769+0000 mgr.x (mgr.34562) 8903 : cluster [DBG] pgmap v5551: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:43:46.307 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:43:45 smithi132 bash[27079]: cluster 2020-07-16T16:43:43.986769+0000 mgr.x (mgr.34562) 8903 : cluster [DBG] pgmap v5551: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:43:48.198 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:43:47 smithi188 bash[23329]: cluster 2020-07-16T16:43:45.987238+0000 mgr.x (mgr.34562) 8904 : cluster [DBG] pgmap v5552: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:43:48.307 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:43:47 smithi132 bash[27079]: cluster 2020-07-16T16:43:45.987238+0000 mgr.x (mgr.34562) 8904 : cluster [DBG] pgmap v5552: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:43:50.198 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:43:49 smithi188 bash[23329]: cluster 2020-07-16T16:43:47.987617+0000 mgr.x (mgr.34562) 8905 : cluster [DBG] pgmap v5553: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:43:50.306 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:43:49 smithi132 bash[27079]: cluster 2020-07-16T16:43:47.987617+0000 mgr.x (mgr.34562) 8905 : cluster [DBG] pgmap v5553: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:43:52.198 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:43:51 smithi188 bash[23329]: cluster 2020-07-16T16:43:49.987968+0000 mgr.x (mgr.34562) 8906 : cluster [DBG] pgmap v5554: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:43:52.306 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:43:51 smithi132 bash[27079]: cluster 2020-07-16T16:43:49.987968+0000 mgr.x (mgr.34562) 8906 : cluster [DBG] pgmap v5554: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:43:54.198 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:43:53 smithi188 bash[23329]: cluster 2020-07-16T16:43:51.988535+0000 mgr.x (mgr.34562) 8907 : cluster [DBG] pgmap v5555: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:43:54.306 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:43:53 smithi132 bash[27079]: cluster 2020-07-16T16:43:51.988535+0000 mgr.x (mgr.34562) 8907 : cluster [DBG] pgmap v5555: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:43:56.198 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:43:55 smithi188 bash[23329]: cluster 2020-07-16T16:43:53.989023+0000 mgr.x (mgr.34562) 8908 : cluster [DBG] pgmap v5556: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:43:56.198 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:43:55 smithi188 bash[23329]: audit 2020-07-16T16:43:55.019475+0000 mon.b (mon.2) 1875 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:43:56.306 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:43:55 smithi132 bash[27079]: cluster 2020-07-16T16:43:53.989023+0000 mgr.x (mgr.34562) 8908 : cluster [DBG] pgmap v5556: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:43:56.306 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:43:55 smithi132 bash[27079]: audit 2020-07-16T16:43:55.019475+0000 mon.b (mon.2) 1875 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:43:57.126 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:43:57.198 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:43:56 smithi188 bash[23329]: cephadm 2020-07-16T16:43:55.020162+0000 mgr.x (mgr.34562) 8909 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:43:57.198 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:43:56 smithi188 bash[23329]: cephadm 2020-07-16T16:43:55.020247+0000 mgr.x (mgr.34562) 8910 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:43:57.199 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:43:56 smithi188 bash[23329]: cluster 2020-07-16T16:43:55.989581+0000 mgr.x (mgr.34562) 8911 : cluster [DBG] pgmap v5557: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:43:57.306 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:43:56 smithi132 bash[27079]: cephadm 2020-07-16T16:43:55.020162+0000 mgr.x (mgr.34562) 8909 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:43:57.306 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:43:56 smithi132 bash[27079]: cephadm 2020-07-16T16:43:55.020247+0000 mgr.x (mgr.34562) 8910 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:43:57.307 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:43:56 smithi132 bash[27079]: cluster 2020-07-16T16:43:55.989581+0000 mgr.x (mgr.34562) 8911 : cluster [DBG] pgmap v5557: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:43:57.388 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:43:57.388 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (3h) 5m ago 3h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:43:57.389 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (3h) 5m ago 3h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:43:57.389 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (3h) 5m ago 3h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:43:57.390 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (3h) 5m ago 3h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:43:57.390 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 5m ago 3h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:43:57.391 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (3h) 5m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:43:57.393 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (3h) 5m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:43:57.393 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (3h) 5m ago 3h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:43:57.394 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (3h) 5m ago 3h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:43:57.394 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (3h) 5m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:43:57.395 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (3h) 5m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:43:57.395 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (3h) 5m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:43:57.396 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (3h) 5m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:43:57.397 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (3h) 5m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:43:57.397 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (3h) 5m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:43:57.398 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (3h) 5m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:43:57.399 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (3h) 5m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:43:57.400 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (3h) 5m ago 3h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:43:57.683 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:43:57.684 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:43:57.684 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:43:57.684 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:43:57.685 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:43:57.685 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:43:57.686 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:43:57.686 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:43:57.686 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:43:57.687 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:43:57.687 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:43:57.687 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:43:57.688 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:43:57.688 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:43:57.688 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:43:57.689 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:43:57.689 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:43:58.198 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:43:57 smithi188 bash[23329]: audit 2020-07-16T16:43:57.087124+0000 mgr.x (mgr.34562) 8912 : audit [DBG] from='client.31120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:43:58.199 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:43:57 smithi188 bash[23329]: audit 2020-07-16T16:43:57.356152+0000 mgr.x (mgr.34562) 8913 : audit [DBG] from='client.31126 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:43:58.199 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:43:57 smithi188 bash[23329]: audit 2020-07-16T16:43:57.655421+0000 mon.c (mon.1) 589 : audit [DBG] from='client.? 172.21.15.132:0/2881079177' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:43:58.306 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:43:57 smithi132 bash[27079]: audit 2020-07-16T16:43:57.087124+0000 mgr.x (mgr.34562) 8912 : audit [DBG] from='client.31120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:43:58.306 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:43:57 smithi132 bash[27079]: audit 2020-07-16T16:43:57.356152+0000 mgr.x (mgr.34562) 8913 : audit [DBG] from='client.31126 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:43:58.306 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:43:57 smithi132 bash[27079]: audit 2020-07-16T16:43:57.655421+0000 mon.c (mon.1) 589 : audit [DBG] from='client.? 172.21.15.132:0/2881079177' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:43:59.197 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:43:58 smithi188 bash[23329]: cluster 2020-07-16T16:43:57.990133+0000 mgr.x (mgr.34562) 8914 : cluster [DBG] pgmap v5558: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:43:59.306 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:43:58 smithi132 bash[27079]: cluster 2020-07-16T16:43:57.990133+0000 mgr.x (mgr.34562) 8914 : cluster [DBG] pgmap v5558: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:44:01.447 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:44:01 smithi188 bash[23329]: cluster 2020-07-16T16:43:59.990632+0000 mgr.x (mgr.34562) 8915 : cluster [DBG] pgmap v5559: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:44:01.555 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:44:01 smithi132 bash[27079]: cluster 2020-07-16T16:43:59.990632+0000 mgr.x (mgr.34562) 8915 : cluster [DBG] pgmap v5559: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:44:03.806 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:44:03 smithi132 bash[27079]: cluster 2020-07-16T16:44:01.991067+0000 mgr.x (mgr.34562) 8916 : cluster [DBG] pgmap v5560: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:44:03.947 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:44:03 smithi188 bash[23329]: cluster 2020-07-16T16:44:01.991067+0000 mgr.x (mgr.34562) 8916 : cluster [DBG] pgmap v5560: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:44:05.805 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:44:05 smithi132 bash[27079]: cluster 2020-07-16T16:44:03.991450+0000 mgr.x (mgr.34562) 8917 : cluster [DBG] pgmap v5561: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:44:05.947 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:44:05 smithi188 bash[23329]: cluster 2020-07-16T16:44:03.991450+0000 mgr.x (mgr.34562) 8917 : cluster [DBG] pgmap v5561: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:44:07.805 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:44:07 smithi132 bash[27079]: cluster 2020-07-16T16:44:05.991863+0000 mgr.x (mgr.34562) 8918 : cluster [DBG] pgmap v5562: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:44:07.947 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:44:07 smithi188 bash[23329]: cluster 2020-07-16T16:44:05.991863+0000 mgr.x (mgr.34562) 8918 : cluster [DBG] pgmap v5562: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:44:09.805 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:44:09 smithi132 bash[27079]: cluster 2020-07-16T16:44:07.992221+0000 mgr.x (mgr.34562) 8919 : cluster [DBG] pgmap v5563: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:44:09.947 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:44:09 smithi188 bash[23329]: cluster 2020-07-16T16:44:07.992221+0000 mgr.x (mgr.34562) 8919 : cluster [DBG] pgmap v5563: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:44:10.805 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:44:10 smithi132 bash[27079]: audit 2020-07-16T16:44:10.036012+0000 mon.b (mon.2) 1876 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:44:10.947 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:44:10 smithi188 bash[23329]: audit 2020-07-16T16:44:10.036012+0000 mon.b (mon.2) 1876 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:44:11.805 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:44:11 smithi132 bash[27079]: cluster 2020-07-16T16:44:09.992716+0000 mgr.x (mgr.34562) 8920 : cluster [DBG] pgmap v5564: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:44:11.806 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:44:11 smithi132 bash[27079]: cephadm 2020-07-16T16:44:10.036765+0000 mgr.x (mgr.34562) 8921 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:44:11.806 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:44:11 smithi132 bash[27079]: cephadm 2020-07-16T16:44:10.036842+0000 mgr.x (mgr.34562) 8922 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:44:11.946 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:44:11 smithi188 bash[23329]: cluster 2020-07-16T16:44:09.992716+0000 mgr.x (mgr.34562) 8920 : cluster [DBG] pgmap v5564: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:44:11.947 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:44:11 smithi188 bash[23329]: cephadm 2020-07-16T16:44:10.036765+0000 mgr.x (mgr.34562) 8921 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:44:11.947 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:44:11 smithi188 bash[23329]: cephadm 2020-07-16T16:44:10.036842+0000 mgr.x (mgr.34562) 8922 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:44:13.805 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:44:13 smithi132 bash[27079]: cluster 2020-07-16T16:44:11.993265+0000 mgr.x (mgr.34562) 8923 : cluster [DBG] pgmap v5565: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:44:13.946 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:44:13 smithi188 bash[23329]: cluster 2020-07-16T16:44:11.993265+0000 mgr.x (mgr.34562) 8923 : cluster [DBG] pgmap v5565: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:44:15.805 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:44:15 smithi132 bash[27079]: cluster 2020-07-16T16:44:13.993780+0000 mgr.x (mgr.34562) 8924 : cluster [DBG] pgmap v5566: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:44:15.946 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:44:15 smithi188 bash[23329]: cluster 2020-07-16T16:44:13.993780+0000 mgr.x (mgr.34562) 8924 : cluster [DBG] pgmap v5566: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:44:17.805 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:44:17 smithi132 bash[27079]: cluster 2020-07-16T16:44:15.994156+0000 mgr.x (mgr.34562) 8925 : cluster [DBG] pgmap v5567: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:44:17.946 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:44:17 smithi188 bash[23329]: cluster 2020-07-16T16:44:15.994156+0000 mgr.x (mgr.34562) 8925 : cluster [DBG] pgmap v5567: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:44:19.804 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:44:19 smithi132 bash[27079]: cluster 2020-07-16T16:44:17.994640+0000 mgr.x (mgr.34562) 8926 : cluster [DBG] pgmap v5568: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:44:19.946 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:44:19 smithi188 bash[23329]: cluster 2020-07-16T16:44:17.994640+0000 mgr.x (mgr.34562) 8926 : cluster [DBG] pgmap v5568: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:44:21.805 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:44:21 smithi132 bash[27079]: cluster 2020-07-16T16:44:19.994947+0000 mgr.x (mgr.34562) 8927 : cluster [DBG] pgmap v5569: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:44:21.946 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:44:21 smithi188 bash[23329]: cluster 2020-07-16T16:44:19.994947+0000 mgr.x (mgr.34562) 8927 : cluster [DBG] pgmap v5569: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:44:23.804 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:44:23 smithi132 bash[27079]: cluster 2020-07-16T16:44:21.995305+0000 mgr.x (mgr.34562) 8928 : cluster [DBG] pgmap v5570: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:44:23.946 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:44:23 smithi188 bash[23329]: cluster 2020-07-16T16:44:21.995305+0000 mgr.x (mgr.34562) 8928 : cluster [DBG] pgmap v5570: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:44:25.804 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:44:25 smithi132 bash[27079]: cluster 2020-07-16T16:44:23.995798+0000 mgr.x (mgr.34562) 8929 : cluster [DBG] pgmap v5571: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:44:25.805 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:44:25 smithi132 bash[27079]: audit 2020-07-16T16:44:25.052610+0000 mon.b (mon.2) 1877 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:44:25.946 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:44:25 smithi188 bash[23329]: cluster 2020-07-16T16:44:23.995798+0000 mgr.x (mgr.34562) 8929 : cluster [DBG] pgmap v5571: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:44:25.946 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:44:25 smithi188 bash[23329]: audit 2020-07-16T16:44:25.052610+0000 mon.b (mon.2) 1877 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:44:26.804 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:44:26 smithi132 bash[27079]: cephadm 2020-07-16T16:44:25.053331+0000 mgr.x (mgr.34562) 8930 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:44:26.805 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:44:26 smithi132 bash[27079]: cephadm 2020-07-16T16:44:25.053776+0000 mgr.x (mgr.34562) 8931 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:44:26.958 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:44:26 smithi188 bash[23329]: cephadm 2020-07-16T16:44:25.053331+0000 mgr.x (mgr.34562) 8930 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:44:26.959 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:44:26 smithi188 bash[23329]: cephadm 2020-07-16T16:44:25.053776+0000 mgr.x (mgr.34562) 8931 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:44:27.806 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:44:27 smithi132 bash[27079]: cluster 2020-07-16T16:44:25.996326+0000 mgr.x (mgr.34562) 8932 : cluster [DBG] pgmap v5572: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:44:27.946 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:44:27 smithi188 bash[23329]: cluster 2020-07-16T16:44:25.996326+0000 mgr.x (mgr.34562) 8932 : cluster [DBG] pgmap v5572: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:44:27.979 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:44:28.238 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:44:28.238 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (3h) 6m ago 3h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:44:28.239 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (3h) 6m ago 3h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:44:28.239 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (3h) 6m ago 3h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:44:28.239 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (3h) 6m ago 3h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:44:28.240 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 6m ago 3h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:44:28.240 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (3h) 6m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:44:28.240 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (3h) 6m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:44:28.241 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (3h) 6m ago 3h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:44:28.241 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (3h) 6m ago 3h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:44:28.241 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (3h) 6m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:44:28.242 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (3h) 6m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:44:28.242 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (3h) 6m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:44:28.242 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (3h) 6m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:44:28.243 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (3h) 6m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:44:28.243 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (3h) 6m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:44:28.243 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (3h) 6m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:44:28.243 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (3h) 6m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:44:28.244 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (3h) 6m ago 3h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:44:28.534 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:44:28.535 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:44:28.535 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:44:28.536 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:44:28.536 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:44:28.536 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:44:28.537 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:44:28.537 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:44:28.537 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:44:28.537 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:44:28.538 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:44:28.538 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:44:28.538 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:44:28.539 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:44:28.539 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:44:28.539 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:44:28.540 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:44:29.804 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:44:29 smithi132 bash[27079]: audit 2020-07-16T16:44:27.942824+0000 mgr.x (mgr.34562) 8933 : audit [DBG] from='client.31138 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:44:29.805 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:44:29 smithi132 bash[27079]: cluster 2020-07-16T16:44:27.996864+0000 mgr.x (mgr.34562) 8934 : cluster [DBG] pgmap v5573: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:44:29.805 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:44:29 smithi132 bash[27079]: audit 2020-07-16T16:44:28.208472+0000 mgr.x (mgr.34562) 8935 : audit [DBG] from='client.31144 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:44:29.805 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:44:29 smithi132 bash[27079]: audit 2020-07-16T16:44:28.508348+0000 mon.c (mon.1) 590 : audit [DBG] from='client.? 172.21.15.132:0/1273878341' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:44:29.946 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:44:29 smithi188 bash[23329]: audit 2020-07-16T16:44:27.942824+0000 mgr.x (mgr.34562) 8933 : audit [DBG] from='client.31138 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:44:29.946 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:44:29 smithi188 bash[23329]: cluster 2020-07-16T16:44:27.996864+0000 mgr.x (mgr.34562) 8934 : cluster [DBG] pgmap v5573: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:44:29.946 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:44:29 smithi188 bash[23329]: audit 2020-07-16T16:44:28.208472+0000 mgr.x (mgr.34562) 8935 : audit [DBG] from='client.31144 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:44:29.947 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:44:29 smithi188 bash[23329]: audit 2020-07-16T16:44:28.508348+0000 mon.c (mon.1) 590 : audit [DBG] from='client.? 172.21.15.132:0/1273878341' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:44:31.804 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:44:31 smithi132 bash[27079]: cluster 2020-07-16T16:44:29.997295+0000 mgr.x (mgr.34562) 8936 : cluster [DBG] pgmap v5574: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:44:31.946 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:44:31 smithi188 bash[23329]: cluster 2020-07-16T16:44:29.997295+0000 mgr.x (mgr.34562) 8936 : cluster [DBG] pgmap v5574: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:44:33.804 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:44:33 smithi132 bash[27079]: cluster 2020-07-16T16:44:31.997763+0000 mgr.x (mgr.34562) 8937 : cluster [DBG] pgmap v5575: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:44:33.946 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:44:33 smithi188 bash[23329]: cluster 2020-07-16T16:44:31.997763+0000 mgr.x (mgr.34562) 8937 : cluster [DBG] pgmap v5575: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:44:35.804 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:44:35 smithi132 bash[27079]: cluster 2020-07-16T16:44:33.998212+0000 mgr.x (mgr.34562) 8938 : cluster [DBG] pgmap v5576: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:44:35.945 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:44:35 smithi188 bash[23329]: cluster 2020-07-16T16:44:33.998212+0000 mgr.x (mgr.34562) 8938 : cluster [DBG] pgmap v5576: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:44:37.804 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:44:37 smithi132 bash[27079]: cluster 2020-07-16T16:44:35.998692+0000 mgr.x (mgr.34562) 8939 : cluster [DBG] pgmap v5577: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:44:37.945 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:44:37 smithi188 bash[23329]: cluster 2020-07-16T16:44:35.998692+0000 mgr.x (mgr.34562) 8939 : cluster [DBG] pgmap v5577: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:44:39.804 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:44:39 smithi132 bash[27079]: cluster 2020-07-16T16:44:37.999055+0000 mgr.x (mgr.34562) 8940 : cluster [DBG] pgmap v5578: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:44:39.945 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:44:39 smithi188 bash[23329]: cluster 2020-07-16T16:44:37.999055+0000 mgr.x (mgr.34562) 8940 : cluster [DBG] pgmap v5578: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:44:40.804 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:44:40 smithi132 bash[27079]: audit 2020-07-16T16:44:40.063755+0000 mon.b (mon.2) 1878 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:44:40.804 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:44:40 smithi132 bash[27079]: audit 2020-07-16T16:44:40.065445+0000 mon.b (mon.2) 1879 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:44:40.805 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:44:40 smithi132 bash[27079]: audit 2020-07-16T16:44:40.066594+0000 mon.b (mon.2) 1880 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:44:40.805 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:44:40 smithi132 bash[27079]: audit 2020-07-16T16:44:40.068039+0000 mon.b (mon.2) 1881 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:44:40.805 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:44:40 smithi132 bash[27079]: audit 2020-07-16T16:44:40.069498+0000 mon.b (mon.2) 1882 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:44:40.945 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:44:40 smithi188 bash[23329]: audit 2020-07-16T16:44:40.063755+0000 mon.b (mon.2) 1878 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:44:40.946 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:44:40 smithi188 bash[23329]: audit 2020-07-16T16:44:40.065445+0000 mon.b (mon.2) 1879 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:44:40.946 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:44:40 smithi188 bash[23329]: audit 2020-07-16T16:44:40.066594+0000 mon.b (mon.2) 1880 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:44:40.946 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:44:40 smithi188 bash[23329]: audit 2020-07-16T16:44:40.068039+0000 mon.b (mon.2) 1881 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2020-07-16T16:44:40.947 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:44:40 smithi188 bash[23329]: audit 2020-07-16T16:44:40.069498+0000 mon.b (mon.2) 1882 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:44:41.804 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:44:41 smithi132 bash[27079]: cluster 2020-07-16T16:44:39.999452+0000 mgr.x (mgr.34562) 8941 : cluster [DBG] pgmap v5579: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:44:41.804 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:44:41 smithi132 bash[27079]: audit 2020-07-16T16:44:40.064143+0000 mgr.x (mgr.34562) 8942 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:44:41.805 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:44:41 smithi132 bash[27079]: audit 2020-07-16T16:44:40.065750+0000 mgr.x (mgr.34562) 8943 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:44:41.805 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:44:41 smithi132 bash[27079]: audit 2020-07-16T16:44:40.066940+0000 mgr.x (mgr.34562) 8944 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:44:41.805 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:44:41 smithi132 bash[27079]: cephadm 2020-07-16T16:44:40.067681+0000 mgr.x (mgr.34562) 8945 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:44:41.806 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:44:41 smithi132 bash[27079]: cephadm 2020-07-16T16:44:40.068954+0000 mgr.x (mgr.34562) 8946 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:44:41.806 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:44:41 smithi132 bash[27079]: cephadm 2020-07-16T16:44:40.070244+0000 mgr.x (mgr.34562) 8947 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:44:41.806 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:44:41 smithi132 bash[27079]: cephadm 2020-07-16T16:44:40.070397+0000 mgr.x (mgr.34562) 8948 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:44:41.945 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:44:41 smithi188 bash[23329]: cluster 2020-07-16T16:44:39.999452+0000 mgr.x (mgr.34562) 8941 : cluster [DBG] pgmap v5579: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:44:41.946 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:44:41 smithi188 bash[23329]: audit 2020-07-16T16:44:40.064143+0000 mgr.x (mgr.34562) 8942 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2020-07-16T16:44:41.946 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:44:41 smithi188 bash[23329]: audit 2020-07-16T16:44:40.065750+0000 mgr.x (mgr.34562) 8943 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2020-07-16T16:44:41.946 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:44:41 smithi188 bash[23329]: audit 2020-07-16T16:44:40.066940+0000 mgr.x (mgr.34562) 8944 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2020-07-16T16:44:41.947 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:44:41 smithi188 bash[23329]: cephadm 2020-07-16T16:44:40.067681+0000 mgr.x (mgr.34562) 8945 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca with id 4f0e793741c4e6827cfa905fcebb0493fce45a257474fab051393f8ac8af03e5 2020-07-16T16:44:41.947 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:44:41 smithi188 bash[23329]: cephadm 2020-07-16T16:44:40.068954+0000 mgr.x (mgr.34562) 8946 : cephadm [INF] Upgrade: Checking mgr daemons... 2020-07-16T16:44:41.947 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:44:41 smithi188 bash[23329]: cephadm 2020-07-16T16:44:40.070244+0000 mgr.x (mgr.34562) 8947 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2020-07-16T16:44:41.948 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:44:41 smithi188 bash[23329]: cephadm 2020-07-16T16:44:40.070397+0000 mgr.x (mgr.34562) 8948 : cephadm [INF] Upgrade: Checking mon daemons... 2020-07-16T16:44:43.804 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:44:43 smithi132 bash[27079]: cluster 2020-07-16T16:44:41.999841+0000 mgr.x (mgr.34562) 8949 : cluster [DBG] pgmap v5580: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:44:43.804 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:44:43 smithi132 bash[27079]: audit 2020-07-16T16:44:42.872563+0000 mon.b (mon.2) 1883 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:44:43.945 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:44:43 smithi188 bash[23329]: cluster 2020-07-16T16:44:41.999841+0000 mgr.x (mgr.34562) 8949 : cluster [DBG] pgmap v5580: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:44:43.945 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:44:43 smithi188 bash[23329]: audit 2020-07-16T16:44:42.872563+0000 mon.b (mon.2) 1883 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:44:44.803 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:44:44 smithi132 bash[27079]: cephadm 2020-07-16T16:44:42.873172+0000 mgr.x (mgr.34562) 8950 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:44:44.804 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:44:44 smithi132 bash[27079]: cephadm 2020-07-16T16:44:42.873364+0000 mgr.x (mgr.34562) 8951 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:44:44.945 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:44:44 smithi188 bash[23329]: cephadm 2020-07-16T16:44:42.873172+0000 mgr.x (mgr.34562) 8950 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:44:44.945 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:44:44 smithi188 bash[23329]: cephadm 2020-07-16T16:44:42.873364+0000 mgr.x (mgr.34562) 8951 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:44:45.803 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:44:45 smithi132 bash[27079]: cluster 2020-07-16T16:44:44.000173+0000 mgr.x (mgr.34562) 8952 : cluster [DBG] pgmap v5581: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:44:45.945 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:44:45 smithi188 bash[23329]: cluster 2020-07-16T16:44:44.000173+0000 mgr.x (mgr.34562) 8952 : cluster [DBG] pgmap v5581: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:44:47.804 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:44:47 smithi132 bash[27079]: cluster 2020-07-16T16:44:46.000577+0000 mgr.x (mgr.34562) 8953 : cluster [DBG] pgmap v5582: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:44:47.945 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:44:47 smithi188 bash[23329]: cluster 2020-07-16T16:44:46.000577+0000 mgr.x (mgr.34562) 8953 : cluster [DBG] pgmap v5582: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:44:49.804 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:44:49 smithi132 bash[27079]: cluster 2020-07-16T16:44:48.001119+0000 mgr.x (mgr.34562) 8954 : cluster [DBG] pgmap v5583: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:44:49.945 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:44:49 smithi188 bash[23329]: cluster 2020-07-16T16:44:48.001119+0000 mgr.x (mgr.34562) 8954 : cluster [DBG] pgmap v5583: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:44:51.804 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:44:51 smithi132 bash[27079]: cluster 2020-07-16T16:44:50.001514+0000 mgr.x (mgr.34562) 8955 : cluster [DBG] pgmap v5584: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:44:51.945 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:44:51 smithi188 bash[23329]: cluster 2020-07-16T16:44:50.001514+0000 mgr.x (mgr.34562) 8955 : cluster [DBG] pgmap v5584: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:44:53.804 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:44:53 smithi132 bash[27079]: cluster 2020-07-16T16:44:52.002015+0000 mgr.x (mgr.34562) 8956 : cluster [DBG] pgmap v5585: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:44:53.945 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:44:53 smithi188 bash[23329]: cluster 2020-07-16T16:44:52.002015+0000 mgr.x (mgr.34562) 8956 : cluster [DBG] pgmap v5585: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:44:55.804 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:44:55 smithi132 bash[27079]: cluster 2020-07-16T16:44:54.002389+0000 mgr.x (mgr.34562) 8957 : cluster [DBG] pgmap v5586: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:44:55.945 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:44:55 smithi188 bash[23329]: cluster 2020-07-16T16:44:54.002389+0000 mgr.x (mgr.34562) 8957 : cluster [DBG] pgmap v5586: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:44:57.803 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:44:57 smithi132 bash[27079]: cluster 2020-07-16T16:44:56.002868+0000 mgr.x (mgr.34562) 8958 : cluster [DBG] pgmap v5587: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:44:57.945 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:44:57 smithi188 bash[23329]: cluster 2020-07-16T16:44:56.002868+0000 mgr.x (mgr.34562) 8958 : cluster [DBG] pgmap v5587: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:44:58.830 INFO:teuthology.orchestra.run.smithi132.stdout:true 2020-07-16T16:44:58.945 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:44:58 smithi188 bash[23329]: audit 2020-07-16T16:44:57.883189+0000 mon.b (mon.2) 1884 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:44:59.053 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:44:58 smithi132 bash[27079]: audit 2020-07-16T16:44:57.883189+0000 mon.b (mon.2) 1884 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:44:59.089 INFO:teuthology.orchestra.run.smithi132.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2020-07-16T16:44:59.090 INFO:teuthology.orchestra.run.smithi132.stdout:alertmanager.a smithi132 running (3h) 6m ago 3h 0.21.0 docker.io/prom/alertmanager:latest c876f5897d7b 30a3c37e52ed 2020-07-16T16:44:59.090 INFO:teuthology.orchestra.run.smithi132.stdout:grafana.a smithi188 running (3h) 6m ago 3h 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c ac88c2d305d5 2020-07-16T16:44:59.090 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.x smithi188 running (3h) 6m ago 3h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 2e95f416d8f0 2020-07-16T16:44:59.091 INFO:teuthology.orchestra.run.smithi132.stdout:mgr.y smithi132 running (3h) 6m ago 3h 16.0.0-3349-g7260671e53b quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 4f0e793741c4 9f86dd60ad4e 2020-07-16T16:44:59.091 INFO:teuthology.orchestra.run.smithi132.stdout:mon.a smithi132 error 6m ago 3h quay.ceph.io/ceph-ci/ceph:7260671e53beca8ba2a87a02b9c7c669f4c30eca 2020-07-16T16:44:59.091 INFO:teuthology.orchestra.run.smithi132.stdout:mon.b smithi188 running (3h) 6m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 169df9f5fb9d 2020-07-16T16:44:59.092 INFO:teuthology.orchestra.run.smithi132.stdout:mon.c smithi132 running (3h) 6m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 240c36a54649 2020-07-16T16:44:59.092 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.a smithi132 running (3h) 6m ago 3h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 3bf4a744ea1e 2020-07-16T16:44:59.092 INFO:teuthology.orchestra.run.smithi132.stdout:node-exporter.b smithi188 running (3h) 6m ago 3h 1.0.1 docker.io/prom/node-exporter:latest 0e0218889c33 379b3ae3abda 2020-07-16T16:44:59.093 INFO:teuthology.orchestra.run.smithi132.stdout:osd.0 smithi132 running (3h) 6m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 440f85c650d2 2020-07-16T16:44:59.093 INFO:teuthology.orchestra.run.smithi132.stdout:osd.1 smithi132 running (3h) 6m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7c66d3e8979 2020-07-16T16:44:59.093 INFO:teuthology.orchestra.run.smithi132.stdout:osd.2 smithi132 running (3h) 6m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 781335bb0392 2020-07-16T16:44:59.094 INFO:teuthology.orchestra.run.smithi132.stdout:osd.3 smithi132 running (3h) 6m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cba1b711fd95 2020-07-16T16:44:59.094 INFO:teuthology.orchestra.run.smithi132.stdout:osd.4 smithi188 running (3h) 6m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 58eb7519ce63 2020-07-16T16:44:59.094 INFO:teuthology.orchestra.run.smithi132.stdout:osd.5 smithi188 running (3h) 6m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53df92e732cc 2020-07-16T16:44:59.094 INFO:teuthology.orchestra.run.smithi132.stdout:osd.6 smithi188 running (3h) 6m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7981505d5f0b 2020-07-16T16:44:59.095 INFO:teuthology.orchestra.run.smithi132.stdout:osd.7 smithi188 running (3h) 6m ago 3h 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a270dcc2599 2020-07-16T16:44:59.095 INFO:teuthology.orchestra.run.smithi132.stdout:prometheus.a smithi188 running (3h) 6m ago 3h 2.19.2 docker.io/prom/prometheus:latest 9f345bfa8fef a143aea22145 2020-07-16T16:44:59.386 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2020-07-16T16:44:59.387 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": { 2020-07-16T16:44:59.387 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2020-07-16T16:44:59.387 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 1 2020-07-16T16:44:59.388 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:44:59.388 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": { 2020-07-16T16:44:59.388 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 2 2020-07-16T16:44:59.388 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:44:59.389 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": { 2020-07-16T16:44:59.389 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2020-07-16T16:44:59.389 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2020-07-16T16:44:59.390 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": {}, 2020-07-16T16:44:59.390 INFO:teuthology.orchestra.run.smithi132.stdout: "overall": { 2020-07-16T16:44:59.390 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2020-07-16T16:44:59.391 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph version 16.0.0-3349-g7260671e53b (7260671e53beca8ba2a87a02b9c7c669f4c30eca) pacific (dev)": 3 2020-07-16T16:44:59.391 INFO:teuthology.orchestra.run.smithi132.stdout: } 2020-07-16T16:44:59.391 INFO:teuthology.orchestra.run.smithi132.stdout:} 2020-07-16T16:44:59.945 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:44:59 smithi188 bash[23329]: cephadm 2020-07-16T16:44:57.883945+0000 mgr.x (mgr.34562) 8959 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:44:59.946 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:44:59 smithi188 bash[23329]: cephadm 2020-07-16T16:44:57.884395+0000 mgr.x (mgr.34562) 8960 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:44:59.946 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:44:59 smithi188 bash[23329]: cluster 2020-07-16T16:44:58.003383+0000 mgr.x (mgr.34562) 8961 : cluster [DBG] pgmap v5588: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:44:59.946 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:44:59 smithi188 bash[23329]: audit 2020-07-16T16:44:58.793056+0000 mgr.x (mgr.34562) 8962 : audit [DBG] from='client.31156 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:44:59.946 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:44:59 smithi188 bash[23329]: audit 2020-07-16T16:44:59.360880+0000 mon.c (mon.1) 591 : audit [DBG] from='client.? 172.21.15.132:0/2020293509' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:45:00.053 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:44:59 smithi132 bash[27079]: cephadm 2020-07-16T16:44:57.883945+0000 mgr.x (mgr.34562) 8959 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:45:00.054 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:44:59 smithi132 bash[27079]: cephadm 2020-07-16T16:44:57.884395+0000 mgr.x (mgr.34562) 8960 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:45:00.054 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:44:59 smithi132 bash[27079]: cluster 2020-07-16T16:44:58.003383+0000 mgr.x (mgr.34562) 8961 : cluster [DBG] pgmap v5588: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:45:00.054 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:44:59 smithi132 bash[27079]: audit 2020-07-16T16:44:58.793056+0000 mgr.x (mgr.34562) 8962 : audit [DBG] from='client.31156 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:45:00.054 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:44:59 smithi132 bash[27079]: audit 2020-07-16T16:44:59.360880+0000 mon.c (mon.1) 591 : audit [DBG] from='client.? 172.21.15.132:0/2020293509' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2020-07-16T16:45:00.945 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:45:00 smithi188 bash[23329]: audit 2020-07-16T16:44:59.060825+0000 mgr.x (mgr.34562) 8963 : audit [DBG] from='client.31162 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:45:01.053 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:45:00 smithi132 bash[27079]: audit 2020-07-16T16:44:59.060825+0000 mgr.x (mgr.34562) 8963 : audit [DBG] from='client.31162 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2020-07-16T16:45:01.945 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:45:01 smithi188 bash[23329]: cluster 2020-07-16T16:45:00.003765+0000 mgr.x (mgr.34562) 8964 : cluster [DBG] pgmap v5589: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:45:02.053 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:45:01 smithi132 bash[27079]: cluster 2020-07-16T16:45:00.003765+0000 mgr.x (mgr.34562) 8964 : cluster [DBG] pgmap v5589: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:45:03.945 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:45:03 smithi188 bash[23329]: cluster 2020-07-16T16:45:02.004195+0000 mgr.x (mgr.34562) 8965 : cluster [DBG] pgmap v5590: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:45:04.053 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:45:03 smithi132 bash[27079]: cluster 2020-07-16T16:45:02.004195+0000 mgr.x (mgr.34562) 8965 : cluster [DBG] pgmap v5590: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:45:05.945 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:45:05 smithi188 bash[23329]: cluster 2020-07-16T16:45:04.004586+0000 mgr.x (mgr.34562) 8966 : cluster [DBG] pgmap v5591: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:45:06.053 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:45:05 smithi132 bash[27079]: cluster 2020-07-16T16:45:04.004586+0000 mgr.x (mgr.34562) 8966 : cluster [DBG] pgmap v5591: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:45:07.945 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:45:07 smithi188 bash[23329]: cluster 2020-07-16T16:45:06.005058+0000 mgr.x (mgr.34562) 8967 : cluster [DBG] pgmap v5592: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:45:08.053 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:45:07 smithi132 bash[27079]: cluster 2020-07-16T16:45:06.005058+0000 mgr.x (mgr.34562) 8967 : cluster [DBG] pgmap v5592: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:45:09.945 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:45:09 smithi188 bash[23329]: cluster 2020-07-16T16:45:08.005459+0000 mgr.x (mgr.34562) 8968 : cluster [DBG] pgmap v5593: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:45:10.053 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:45:09 smithi132 bash[27079]: cluster 2020-07-16T16:45:08.005459+0000 mgr.x (mgr.34562) 8968 : cluster [DBG] pgmap v5593: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:45:11.945 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:45:11 smithi188 bash[23329]: cluster 2020-07-16T16:45:10.005944+0000 mgr.x (mgr.34562) 8969 : cluster [DBG] pgmap v5594: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:45:12.053 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:45:11 smithi132 bash[27079]: cluster 2020-07-16T16:45:10.005944+0000 mgr.x (mgr.34562) 8969 : cluster [DBG] pgmap v5594: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:45:13.945 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:45:13 smithi188 bash[23329]: cluster 2020-07-16T16:45:12.006329+0000 mgr.x (mgr.34562) 8970 : cluster [DBG] pgmap v5595: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:45:13.946 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:45:13 smithi188 bash[23329]: audit 2020-07-16T16:45:12.899944+0000 mon.b (mon.2) 1885 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:45:14.053 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:45:13 smithi132 bash[27079]: cluster 2020-07-16T16:45:12.006329+0000 mgr.x (mgr.34562) 8970 : cluster [DBG] pgmap v5595: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:45:14.054 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:45:13 smithi132 bash[27079]: audit 2020-07-16T16:45:12.899944+0000 mon.b (mon.2) 1885 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:45:14.945 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:45:14 smithi188 bash[23329]: cephadm 2020-07-16T16:45:12.900674+0000 mgr.x (mgr.34562) 8971 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:45:14.946 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:45:14 smithi188 bash[23329]: cephadm 2020-07-16T16:45:12.900900+0000 mgr.x (mgr.34562) 8972 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:45:15.053 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:45:14 smithi132 bash[27079]: cephadm 2020-07-16T16:45:12.900674+0000 mgr.x (mgr.34562) 8971 : cephadm [INF] It is NOT safe to stop ['mon.c']: not enough monitors would be available (b) after stopping mons [c] 2020-07-16T16:45:15.054 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:45:14 smithi132 bash[27079]: cephadm 2020-07-16T16:45:12.900900+0000 mgr.x (mgr.34562) 8972 : cephadm [INF] Upgrade: It is NOT safe to stop mon.c 2020-07-16T16:45:15.946 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:45:15 smithi188 bash[23329]: cluster 2020-07-16T16:45:14.006759+0000 mgr.x (mgr.34562) 8973 : cluster [DBG] pgmap v5596: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:45:16.053 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:45:15 smithi132 bash[27079]: cluster 2020-07-16T16:45:14.006759+0000 mgr.x (mgr.34562) 8973 : cluster [DBG] pgmap v5596: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:45:17.945 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:45:17 smithi188 bash[23329]: cluster 2020-07-16T16:45:16.007135+0000 mgr.x (mgr.34562) 8974 : cluster [DBG] pgmap v5597: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:45:18.053 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:45:17 smithi132 bash[27079]: cluster 2020-07-16T16:45:16.007135+0000 mgr.x (mgr.34562) 8974 : cluster [DBG] pgmap v5597: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:45:19.945 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:45:19 smithi188 bash[23329]: cluster 2020-07-16T16:45:18.007689+0000 mgr.x (mgr.34562) 8975 : cluster [DBG] pgmap v5598: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:45:20.053 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:45:19 smithi132 bash[27079]: cluster 2020-07-16T16:45:18.007689+0000 mgr.x (mgr.34562) 8975 : cluster [DBG] pgmap v5598: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:45:21.945 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:45:21 smithi188 bash[23329]: cluster 2020-07-16T16:45:20.008063+0000 mgr.x (mgr.34562) 8976 : cluster [DBG] pgmap v5599: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:45:22.053 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:45:21 smithi132 bash[27079]: cluster 2020-07-16T16:45:20.008063+0000 mgr.x (mgr.34562) 8976 : cluster [DBG] pgmap v5599: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:45:23.945 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:45:23 smithi188 bash[23329]: cluster 2020-07-16T16:45:22.008504+0000 mgr.x (mgr.34562) 8977 : cluster [DBG] pgmap v5600: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:45:24.053 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:45:23 smithi132 bash[27079]: cluster 2020-07-16T16:45:22.008504+0000 mgr.x (mgr.34562) 8977 : cluster [DBG] pgmap v5600: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:45:25.946 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:45:25 smithi188 bash[23329]: cluster 2020-07-16T16:45:24.008883+0000 mgr.x (mgr.34562) 8978 : cluster [DBG] pgmap v5601: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:45:26.053 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:45:25 smithi132 bash[27079]: cluster 2020-07-16T16:45:24.008883+0000 mgr.x (mgr.34562) 8978 : cluster [DBG] pgmap v5601: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:45:27.945 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:45:27 smithi188 bash[23329]: cluster 2020-07-16T16:45:26.009356+0000 mgr.x (mgr.34562) 8979 : cluster [DBG] pgmap v5602: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:45:28.053 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:45:27 smithi132 bash[27079]: cluster 2020-07-16T16:45:26.009356+0000 mgr.x (mgr.34562) 8979 : cluster [DBG] pgmap v5602: 1 pgs: 1 active+clean; 0 B data, 4.3 MiB used, 707 GiB / 715 GiB avail 2020-07-16T16:45:28.945 INFO:journalctl@ceph.mon.b.smithi188.stdout:Jul 16 16:45:28 smithi188 bash[23329]: audit 2020-07-16T16:45:27.915690+0000 mon.b (mon.2) 1886 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:45:29.054 INFO:journalctl@ceph.mon.c.smithi132.stdout:Jul 16 16:45:28 smithi132 bash[27079]: audit 2020-07-16T16:45:27.915690+0000 mon.b (mon.2) 1886 : audit [DBG] from='mgr.34562 172.21.15.188:0/1390184046' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2020-07-16T16:45:29.137 DEBUG:teuthology.exit:Got signal 15; running 2 handlers... 2020-07-16T16:45:29.139 DEBUG:teuthology.task.console_log:Killing console logger for smithi132 2020-07-16T16:45:29.141 DEBUG:teuthology.task.console_log:Killing console logger for smithi188 2020-07-16T16:45:29.143 DEBUG:teuthology.task.console_log:Killing console logger for smithi132 2020-07-16T16:45:29.144 DEBUG:teuthology.task.console_log:Killing console logger for smithi188 2020-07-16T16:45:29.144 DEBUG:teuthology.exit:Finished running handlers